2026-02-12T17:20:32.867 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T17:20:32.881 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:20:32.962 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421 branch: wip-yuri4-testing-2026-02-11-2126 description: rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore/{alloc$/{hybrid} base mem$/{normal-2} onode-segment$/{512K-onoff} write$/{v1/{compr$/{no$/{no}} v1}}}} rados supported-random-distro$/{centos_latest} thrashers/sync workloads/snaps-few-objects} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '46421' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri4-testing-2026-02-11-2126 ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 30 debug ms: 20 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos min: 10 paxos service trim min: 5 paxos trim min: 10 osd: bdev async discard: true bdev enable discard: true bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore debug onode segmentation random: true bluestore fsck on mount: true bluestore onode segment size: 512K bluestore write v2: false bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - \(MON_NETSPLIT) - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) mon_bind_msgr2: false sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2026-02-11-2126 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 7172 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2026-02-11-2126 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 targets: trial057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIMsusF/xT4p7R8UJej+V8+520hvAfBC01usp8rw7JG8jPSoEmX/RDctiu8gBkWCeDLccroqUJfiNCyNPwQ2Qs= trial082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKISbTADi+4NKDqLwbxjvYy07jNMPUUXCgkDL/CYDhQEK+GiiEoGUmW1s9FTJ9OrYAfxs5i3fNS+/NDUcPfjuqg= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 thrash_delay: 1 - rados: clients: - client.0 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-12_15:38:14 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T17:20:32.962 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa; will attempt to use it 2026-02-12T17:20:32.962 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks 2026-02-12T17:20:32.962 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T17:20:32.964 INFO:teuthology.task.internal:Checking packages... 2026-02-12T17:20:32.964 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'afefaa40503a4bf024e96f97dd7f852b75f00ad6' 2026-02-12T17:20:32.964 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T17:20:32.964 INFO:teuthology.packaging:ref: None 2026-02-12T17:20:32.964 INFO:teuthology.packaging:tag: None 2026-02-12T17:20:32.964 INFO:teuthology.packaging:branch: wip-yuri4-testing-2026-02-11-2126 2026-02-12T17:20:32.964 INFO:teuthology.packaging:sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T17:20:32.964 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri4-testing-2026-02-11-2126 2026-02-12T17:20:33.084 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5230.gafefaa40 2026-02-12T17:20:33.085 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T17:20:33.096 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T17:20:33.096 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T17:20:33.110 INFO:teuthology.task.internal:Saving configuration 2026-02-12T17:20:33.122 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T17:20:33.135 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T17:20:33.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial057.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 17:17:19.034232', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIMsusF/xT4p7R8UJej+V8+520hvAfBC01usp8rw7JG8jPSoEmX/RDctiu8gBkWCeDLccroqUJfiNCyNPwQ2Qs='} 2026-02-12T17:20:33.279 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial082.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 17:17:19.034856', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKISbTADi+4NKDqLwbxjvYy07jNMPUUXCgkDL/CYDhQEK+GiiEoGUmW1s9FTJ9OrYAfxs5i3fNS+/NDUcPfjuqg='} 2026-02-12T17:20:33.279 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T17:20:33.291 INFO:teuthology.task.internal:roles: ubuntu@trial057.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2026-02-12T17:20:33.291 INFO:teuthology.task.internal:roles: ubuntu@trial082.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-12T17:20:33.291 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T17:20:33.424 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x73e0a71e3060>, signals=[15]) 2026-02-12T17:20:33.424 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T17:20:33.444 INFO:teuthology.task.internal:Opening connections... 2026-02-12T17:20:33.444 DEBUG:teuthology.task.internal:connecting to ubuntu@trial057.front.sepia.ceph.com 2026-02-12T17:20:33.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:20:33.507 DEBUG:teuthology.task.internal:connecting to ubuntu@trial082.front.sepia.ceph.com 2026-02-12T17:20:33.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:20:33.570 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T17:20:33.582 DEBUG:teuthology.orchestra.run.trial057:> uname -m 2026-02-12T17:20:33.597 INFO:teuthology.orchestra.run.trial057.stdout:x86_64 2026-02-12T17:20:33.597 DEBUG:teuthology.orchestra.run.trial057:> cat /etc/os-release 2026-02-12T17:20:33.652 INFO:teuthology.orchestra.run.trial057.stdout:NAME="CentOS Stream" 2026-02-12T17:20:33.652 INFO:teuthology.orchestra.run.trial057.stdout:VERSION="9" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:ID="centos" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:ID_LIKE="rhel fedora" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:VERSION_ID="9" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:PLATFORM_ID="platform:el9" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:ANSI_COLOR="0;31" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:LOGO="fedora-logo-icon" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:HOME_URL="https://centos.org/" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T17:20:33.653 INFO:teuthology.orchestra.run.trial057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T17:20:33.653 INFO:teuthology.lock.ops:Updating trial057.front.sepia.ceph.com on lock server 2026-02-12T17:20:33.724 DEBUG:teuthology.orchestra.run.trial082:> uname -m 2026-02-12T17:20:33.739 INFO:teuthology.orchestra.run.trial082.stdout:x86_64 2026-02-12T17:20:33.739 DEBUG:teuthology.orchestra.run.trial082:> cat /etc/os-release 2026-02-12T17:20:33.795 INFO:teuthology.orchestra.run.trial082.stdout:NAME="CentOS Stream" 2026-02-12T17:20:33.795 INFO:teuthology.orchestra.run.trial082.stdout:VERSION="9" 2026-02-12T17:20:33.795 INFO:teuthology.orchestra.run.trial082.stdout:ID="centos" 2026-02-12T17:20:33.795 INFO:teuthology.orchestra.run.trial082.stdout:ID_LIKE="rhel fedora" 2026-02-12T17:20:33.795 INFO:teuthology.orchestra.run.trial082.stdout:VERSION_ID="9" 2026-02-12T17:20:33.795 INFO:teuthology.orchestra.run.trial082.stdout:PLATFORM_ID="platform:el9" 2026-02-12T17:20:33.795 INFO:teuthology.orchestra.run.trial082.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T17:20:33.795 INFO:teuthology.orchestra.run.trial082.stdout:ANSI_COLOR="0;31" 2026-02-12T17:20:33.796 INFO:teuthology.orchestra.run.trial082.stdout:LOGO="fedora-logo-icon" 2026-02-12T17:20:33.796 INFO:teuthology.orchestra.run.trial082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T17:20:33.796 INFO:teuthology.orchestra.run.trial082.stdout:HOME_URL="https://centos.org/" 2026-02-12T17:20:33.796 INFO:teuthology.orchestra.run.trial082.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T17:20:33.796 INFO:teuthology.orchestra.run.trial082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T17:20:33.796 INFO:teuthology.orchestra.run.trial082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T17:20:33.796 INFO:teuthology.lock.ops:Updating trial082.front.sepia.ceph.com on lock server 2026-02-12T17:20:33.875 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T17:20:33.888 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T17:20:33.901 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T17:20:33.901 DEBUG:teuthology.orchestra.run.trial057:> test '!' -e /home/ubuntu/cephtest 2026-02-12T17:20:33.902 DEBUG:teuthology.orchestra.run.trial082:> test '!' -e /home/ubuntu/cephtest 2026-02-12T17:20:33.917 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T17:20:33.928 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T17:20:33.928 DEBUG:teuthology.orchestra.run.trial057:> test -z $(ls -A /var/lib/ceph) 2026-02-12T17:20:33.958 DEBUG:teuthology.orchestra.run.trial082:> test -z $(ls -A /var/lib/ceph) 2026-02-12T17:20:33.974 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T17:20:34.123 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T17:20:34.142 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-12T17:20:34.142 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-12T17:20:34.142 DEBUG:teuthology.orchestra.run.trial057:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T17:20:34.143 DEBUG:teuthology.orchestra.run.trial082:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T17:20:34.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:20:34.157 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T17:20:34.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:20:34.157 DEBUG:teuthology.orchestra.run.trial057:> uname -r 2026-02-12T17:20:34.213 INFO:teuthology.orchestra.run.trial082.stdout:5.14.0-645.el9.x86_64 2026-02-12T17:20:34.213 INFO:teuthology.task.kernel:Running kernel on trial082: 5.14.0-645.el9.x86_64 2026-02-12T17:20:34.213 DEBUG:teuthology.orchestra.run.trial082:> sudo yum install -y kernel 2026-02-12T17:20:34.214 INFO:teuthology.orchestra.run.trial057.stdout:5.14.0-645.el9.x86_64 2026-02-12T17:20:34.214 INFO:teuthology.task.kernel:Running kernel on trial057: 5.14.0-645.el9.x86_64 2026-02-12T17:20:34.214 DEBUG:teuthology.orchestra.run.trial057:> sudo yum install -y kernel 2026-02-12T17:20:36.021 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.9 MB 00:01 2026-02-12T17:20:38.579 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-12T17:20:41.848 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 7.8 MB 00:00 2026-02-12T17:20:42.761 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - Extras packages 104 kB/s | 20 kB 00:00 2026-02-12T17:20:42.887 INFO:teuthology.orchestra.run.trial082.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-12T17:20:43.302 INFO:teuthology.orchestra.run.trial057.stdout:Extra Packages for Enterprise Linux 43 MB/s | 20 MB 00:00 2026-02-12T17:20:46.551 INFO:teuthology.orchestra.run.trial057.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-12T17:20:47.611 INFO:teuthology.orchestra.run.trial057.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T17:20:47.631 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:20:47.632 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:20:47.632 INFO:teuthology.orchestra.run.trial057.stdout: Package Architecture Version Repository Size 2026-02-12T17:20:47.632 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:20:47.632 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:20:47.632 INFO:teuthology.orchestra.run.trial057.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout:Install 4 Packages 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 88 M 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 135 M 2026-02-12T17:20:47.633 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:20:50.411 INFO:teuthology.orchestra.run.trial057.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 282 kB/s | 768 kB 00:02 2026-02-12T17:20:50.564 INFO:teuthology.orchestra.run.trial057.stdout:[MIRROR] kernel-modules-core-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T17:20:51.178 INFO:teuthology.orchestra.run.trial057.stdout:[MIRROR] kernel-modules-core-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T17:20:52.771 INFO:teuthology.orchestra.run.trial057.stdout:(2/4): kernel-modules-core-5.14.0-677.el9.x86_6 13 MB/s | 31 MB 00:02 2026-02-12T17:21:07.118 INFO:teuthology.orchestra.run.trial057.stdout:(3/4): kernel-core-5.14.0-677.el9.x86_64.rpm 899 kB/s | 17 MB 00:19 2026-02-12T17:21:08.740 INFO:teuthology.orchestra.run.trial082.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 27 MB 00:25 2026-02-12T17:21:13.119 INFO:teuthology.orchestra.run.trial082.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 7.8 MB 00:01 2026-02-12T17:21:15.124 INFO:teuthology.orchestra.run.trial082.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-12T17:21:16.458 INFO:teuthology.orchestra.run.trial082.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-12T17:21:19.651 INFO:teuthology.orchestra.run.trial082.stdout:lab-extras 1.1 MB/s | 50 kB 00:00 2026-02-12T17:21:20.714 INFO:teuthology.orchestra.run.trial082.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T17:21:20.733 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:21:20.734 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout: Package Architecture Version Repository Size 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:21:20.735 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:21:20.736 INFO:teuthology.orchestra.run.trial082.stdout:Install 4 Packages 2026-02-12T17:21:20.736 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:21:20.736 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 88 M 2026-02-12T17:21:20.736 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 135 M 2026-02-12T17:21:20.736 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:21:21.140 INFO:teuthology.orchestra.run.trial082.stdout:[MIRROR] kernel-modules-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T17:21:21.144 INFO:teuthology.orchestra.run.trial082.stdout:[MIRROR] kernel-core-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T17:21:21.188 INFO:teuthology.orchestra.run.trial082.stdout:[MIRROR] kernel-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T17:21:21.539 INFO:teuthology.orchestra.run.trial082.stdout:[MIRROR] kernel-core-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T17:21:21.581 INFO:teuthology.orchestra.run.trial082.stdout:[MIRROR] kernel-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T17:21:21.585 INFO:teuthology.orchestra.run.trial082.stdout:[MIRROR] kernel-modules-5.14.0-677.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-677.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-12T17:21:21.664 INFO:teuthology.orchestra.run.trial082.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 882 kB/s | 768 kB 00:00 2026-02-12T17:21:21.732 INFO:teuthology.orchestra.run.trial082.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 18 MB/s | 17 MB 00:00 2026-02-12T17:21:21.824 INFO:teuthology.orchestra.run.trial082.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 38 MB/s | 40 MB 00:01 2026-02-12T17:21:32.239 INFO:teuthology.orchestra.run.trial057.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 910 kB/s | 40 MB 00:44 2026-02-12T17:21:32.242 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:21:32.242 INFO:teuthology.orchestra.run.trial057.stdout:Total 2.0 MB/s | 88 MB 00:44 2026-02-12T17:21:32.432 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:21:32.635 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:21:32.635 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:21:32.981 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:21:32.981 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:21:34.073 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:21:34.357 INFO:teuthology.orchestra.run.trial057.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T17:21:34.376 INFO:teuthology.orchestra.run.trial057.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T17:21:36.131 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T17:21:36.159 INFO:teuthology.orchestra.run.trial057.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T17:21:39.255 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T17:21:39.261 INFO:teuthology.orchestra.run.trial057.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:21:42.293 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:21:54.582 INFO:teuthology.orchestra.run.trial082.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 958 kB/s | 31 MB 00:32 2026-02-12T17:21:54.584 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:21:54.584 INFO:teuthology.orchestra.run.trial082.stdout:Total 2.6 MB/s | 88 MB 00:33 2026-02-12T17:21:54.773 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:21:54.973 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:21:54.973 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:21:55.318 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:21:55.319 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:21:56.405 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:21:56.689 INFO:teuthology.orchestra.run.trial082.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T17:21:56.708 INFO:teuthology.orchestra.run.trial082.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T17:21:58.481 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T17:21:58.510 INFO:teuthology.orchestra.run.trial082.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T17:22:01.529 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T17:22:01.535 INFO:teuthology.orchestra.run.trial082.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:04.630 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:12.456 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:12.477 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:12.538 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:12.539 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T17:22:12.539 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T17:22:12.539 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T17:22:12.590 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:12.590 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:22:12.590 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:22:12.590 INFO:teuthology.orchestra.run.trial057.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T17:22:12.590 INFO:teuthology.orchestra.run.trial057.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T17:22:12.591 INFO:teuthology.orchestra.run.trial057.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T17:22:12.591 INFO:teuthology.orchestra.run.trial057.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T17:22:12.591 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:22:12.591 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:22:12.648 DEBUG:teuthology.orchestra.run.trial057:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T17:22:12.675 INFO:teuthology.orchestra.run.trial057.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T17:22:12.676 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T17:22:12.676 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T17:22:12.676 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T17:22:12.676 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T17:22:12.676 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T17:22:12.676 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial057.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T17:22:12.677 DEBUG:teuthology.orchestra.run.trial057:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T17:22:12.738 INFO:teuthology.orchestra.run.trial057.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T17:22:12.739 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T17:22:12.740 DEBUG:teuthology.orchestra.run.trial057:> sudo rpm -qi grub2-tools 2026-02-12T17:22:12.812 INFO:teuthology.orchestra.run.trial057.stdout:Name : grub2-tools 2026-02-12T17:22:12.812 INFO:teuthology.orchestra.run.trial057.stdout:Epoch : 1 2026-02-12T17:22:12.812 INFO:teuthology.orchestra.run.trial057.stdout:Version : 2.06 2026-02-12T17:22:12.812 INFO:teuthology.orchestra.run.trial057.stdout:Release : 118.el9 2026-02-12T17:22:12.812 INFO:teuthology.orchestra.run.trial057.stdout:Architecture: x86_64 2026-02-12T17:22:12.812 INFO:teuthology.orchestra.run.trial057.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:Group : Unspecified 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:Size : 8393909 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:License : GPLv3+ 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:Packager : builder@centos.org 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:Vendor : CentOS 2026-02-12T17:22:12.813 INFO:teuthology.orchestra.run.trial057.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T17:22:12.814 INFO:teuthology.orchestra.run.trial057.stdout:Summary : Support tools for GRUB. 2026-02-12T17:22:12.814 INFO:teuthology.orchestra.run.trial057.stdout:Description : 2026-02-12T17:22:12.814 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:22:12.814 INFO:teuthology.orchestra.run.trial057.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T17:22:12.814 INFO:teuthology.orchestra.run.trial057.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T17:22:12.814 INFO:teuthology.orchestra.run.trial057.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T17:22:12.814 INFO:teuthology.orchestra.run.trial057.stdout:hardware devices. 2026-02-12T17:22:12.814 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:22:12.814 INFO:teuthology.orchestra.run.trial057.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T17:22:12.815 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T17:22:12.816 INFO:teuthology.task.kernel:Updating grub on trial057 to boot 5.14.0-677.el9.x86_64 2026-02-12T17:22:12.816 DEBUG:teuthology.orchestra.run.trial057:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T17:22:12.879 INFO:teuthology.orchestra.run.trial057.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T17:22:12.880 DEBUG:teuthology.orchestra.run.trial057:> sudo command -v grubby && echo yes || echo no 2026-02-12T17:22:12.943 INFO:teuthology.orchestra.run.trial057.stdout:/sbin/grubby 2026-02-12T17:22:12.944 INFO:teuthology.orchestra.run.trial057.stdout:yes 2026-02-12T17:22:12.945 DEBUG:teuthology.orchestra.run.trial057:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T17:22:13.009 INFO:teuthology.orchestra.run.trial057.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T17:22:13.010 DEBUG:teuthology.orchestra.run.trial057:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T17:22:13.085 DEBUG:teuthology.orchestra.run.trial057:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T17:22:13.293 INFO:teuthology.orchestra.run.trial057.stderr:Generating grub configuration file ... 2026-02-12T17:22:13.356 INFO:teuthology.orchestra.run.trial057.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T17:22:13.363 INFO:teuthology.orchestra.run.trial057.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T17:22:13.616 INFO:teuthology.orchestra.run.trial057.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T17:22:13.623 INFO:teuthology.orchestra.run.trial057.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T17:22:13.655 INFO:teuthology.orchestra.run.trial057.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T17:22:13.662 INFO:teuthology.orchestra.run.trial057.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T17:22:13.685 INFO:teuthology.orchestra.run.trial057.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T17:22:13.692 INFO:teuthology.orchestra.run.trial057.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T17:22:13.775 INFO:teuthology.orchestra.run.trial057.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T17:22:13.783 INFO:teuthology.orchestra.run.trial057.stderr:done 2026-02-12T17:22:13.785 DEBUG:teuthology.orchestra.run.trial057:> test -d /sys/firmware/efi 2026-02-12T17:22:13.802 DEBUG:teuthology.orchestra.run.trial057:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T17:22:13.870 INFO:teuthology.orchestra.run.trial057.stdout:/boot/efi/EFI/BOOT 2026-02-12T17:22:13.870 INFO:teuthology.orchestra.run.trial057.stdout:/boot/efi/EFI/centos 2026-02-12T17:22:13.871 DEBUG:teuthology.orchestra.run.trial057:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T17:22:13.937 INFO:teuthology.orchestra.run.trial057.stdout:no 2026-02-12T17:22:13.937 DEBUG:teuthology.orchestra.run.trial057:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T17:22:14.002 INFO:teuthology.orchestra.run.trial057.stdout:yes 2026-02-12T17:22:14.003 DEBUG:teuthology.orchestra.run.trial057:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T17:22:14.067 DEBUG:teuthology.orchestra.run.trial057:> sudo shutdown -r now 2026-02-12T17:22:14.140 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T17:22:35.127 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:35.148 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:35.319 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:35.319 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T17:22:35.319 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T17:22:35.320 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T17:22:35.371 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:22:35.371 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:22:35.371 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:22:35.371 INFO:teuthology.orchestra.run.trial082.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T17:22:35.371 INFO:teuthology.orchestra.run.trial082.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T17:22:35.372 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T17:22:35.372 INFO:teuthology.orchestra.run.trial082.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T17:22:35.372 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:22:35.372 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:22:35.428 DEBUG:teuthology.orchestra.run.trial082:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T17:22:35.452 INFO:teuthology.orchestra.run.trial082.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T17:22:35.454 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T17:22:35.454 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T17:22:35.454 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T17:22:35.454 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T17:22:35.454 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T17:22:35.454 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial082.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T17:22:35.454 DEBUG:teuthology.orchestra.run.trial082:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T17:22:35.516 INFO:teuthology.orchestra.run.trial082.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T17:22:35.517 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T17:22:35.517 DEBUG:teuthology.orchestra.run.trial082:> sudo rpm -qi grub2-tools 2026-02-12T17:22:35.587 INFO:teuthology.orchestra.run.trial082.stdout:Name : grub2-tools 2026-02-12T17:22:35.587 INFO:teuthology.orchestra.run.trial082.stdout:Epoch : 1 2026-02-12T17:22:35.587 INFO:teuthology.orchestra.run.trial082.stdout:Version : 2.06 2026-02-12T17:22:35.587 INFO:teuthology.orchestra.run.trial082.stdout:Release : 118.el9 2026-02-12T17:22:35.587 INFO:teuthology.orchestra.run.trial082.stdout:Architecture: x86_64 2026-02-12T17:22:35.588 INFO:teuthology.orchestra.run.trial082.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T17:22:35.588 INFO:teuthology.orchestra.run.trial082.stdout:Group : Unspecified 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:Size : 8393909 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:License : GPLv3+ 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:Packager : builder@centos.org 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:Vendor : CentOS 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:Summary : Support tools for GRUB. 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout:Description : 2026-02-12T17:22:35.589 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:22:35.590 INFO:teuthology.orchestra.run.trial082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T17:22:35.590 INFO:teuthology.orchestra.run.trial082.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T17:22:35.590 INFO:teuthology.orchestra.run.trial082.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T17:22:35.590 INFO:teuthology.orchestra.run.trial082.stdout:hardware devices. 2026-02-12T17:22:35.590 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:22:35.590 INFO:teuthology.orchestra.run.trial082.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T17:22:35.591 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T17:22:35.591 INFO:teuthology.task.kernel:Updating grub on trial082 to boot 5.14.0-677.el9.x86_64 2026-02-12T17:22:35.591 DEBUG:teuthology.orchestra.run.trial082:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T17:22:35.657 INFO:teuthology.orchestra.run.trial082.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T17:22:35.658 DEBUG:teuthology.orchestra.run.trial082:> sudo command -v grubby && echo yes || echo no 2026-02-12T17:22:35.721 INFO:teuthology.orchestra.run.trial082.stdout:/sbin/grubby 2026-02-12T17:22:35.723 INFO:teuthology.orchestra.run.trial082.stdout:yes 2026-02-12T17:22:35.723 DEBUG:teuthology.orchestra.run.trial082:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T17:22:35.788 INFO:teuthology.orchestra.run.trial082.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T17:22:35.789 DEBUG:teuthology.orchestra.run.trial082:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T17:22:35.864 DEBUG:teuthology.orchestra.run.trial082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T17:22:36.074 INFO:teuthology.orchestra.run.trial082.stderr:Generating grub configuration file ... 2026-02-12T17:22:36.137 INFO:teuthology.orchestra.run.trial082.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T17:22:36.143 INFO:teuthology.orchestra.run.trial082.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T17:22:36.394 INFO:teuthology.orchestra.run.trial082.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T17:22:36.401 INFO:teuthology.orchestra.run.trial082.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T17:22:36.433 INFO:teuthology.orchestra.run.trial082.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T17:22:36.439 INFO:teuthology.orchestra.run.trial082.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T17:22:36.463 INFO:teuthology.orchestra.run.trial082.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T17:22:36.469 INFO:teuthology.orchestra.run.trial082.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T17:22:36.551 INFO:teuthology.orchestra.run.trial082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T17:22:36.560 INFO:teuthology.orchestra.run.trial082.stderr:done 2026-02-12T17:22:36.562 DEBUG:teuthology.orchestra.run.trial082:> test -d /sys/firmware/efi 2026-02-12T17:22:36.578 DEBUG:teuthology.orchestra.run.trial082:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T17:22:36.644 INFO:teuthology.orchestra.run.trial082.stdout:/boot/efi/EFI/BOOT 2026-02-12T17:22:36.644 INFO:teuthology.orchestra.run.trial082.stdout:/boot/efi/EFI/centos 2026-02-12T17:22:36.646 DEBUG:teuthology.orchestra.run.trial082:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T17:22:36.712 INFO:teuthology.orchestra.run.trial082.stdout:no 2026-02-12T17:22:36.712 DEBUG:teuthology.orchestra.run.trial082:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T17:22:36.777 INFO:teuthology.orchestra.run.trial082.stdout:yes 2026-02-12T17:22:36.778 DEBUG:teuthology.orchestra.run.trial082:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T17:22:36.841 DEBUG:teuthology.orchestra.run.trial082:> sudo shutdown -r now 2026-02-12T17:22:44.117 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T17:22:44.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial057.front.sepia.ceph.com' 2026-02-12T17:22:44.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:22:58.397 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.57 2026-02-12T17:23:06.893 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T17:23:06.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T17:23:06.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:23:07.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial057.front.sepia.ceph.com' 2026-02-12T17:23:07.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:23:10.493 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.57 2026-02-12T17:23:22.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial057.front.sepia.ceph.com' 2026-02-12T17:23:22.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:23:58.372 DEBUG:teuthology.orchestra.run.trial057:> true 2026-02-12T17:23:58.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial057.front.sepia.ceph.com' 2026-02-12T17:23:58.619 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T17:23:58.619 DEBUG:teuthology.orchestra.run.trial057:> uname -r 2026-02-12T17:23:58.675 INFO:teuthology.orchestra.run.trial057.stdout:5.14.0-677.el9.x86_64 2026-02-12T17:23:58.675 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T17:23:58.675 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T17:23:58.675 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T17:23:59.676 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T17:23:59.676 DEBUG:teuthology.orchestra.run.trial057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T17:23:59.706 INFO:teuthology.orchestra.run.trial057.stdout:ttyS1 2026-02-12T17:23:59.737 DEBUG:teuthology.parallel:result is None 2026-02-12T17:24:06.895 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T17:24:15.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T17:24:15.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:24:16.037 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T17:24:16.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T17:24:16.199 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T17:24:16.199 DEBUG:teuthology.orchestra.run.trial082:> uname -r 2026-02-12T17:24:16.255 INFO:teuthology.orchestra.run.trial082.stdout:5.14.0-677.el9.x86_64 2026-02-12T17:24:16.255 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T17:24:16.255 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T17:24:16.255 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T17:24:17.256 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-12T17:24:17.257 DEBUG:teuthology.orchestra.run.trial082:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T17:24:17.287 INFO:teuthology.orchestra.run.trial082.stdout:ttyS1 2026-02-12T17:24:17.320 DEBUG:teuthology.parallel:result is None 2026-02-12T17:24:17.320 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T17:24:17.332 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T17:24:17.332 DEBUG:teuthology.orchestra.run.trial057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T17:24:17.336 DEBUG:teuthology.orchestra.run.trial082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T17:24:17.378 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T17:24:17.389 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T17:24:17.403 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T17:24:17.403 DEBUG:teuthology.orchestra.run.trial057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T17:24:17.405 DEBUG:teuthology.orchestra.run.trial082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T17:24:17.443 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T17:24:17.454 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T17:24:17.454 DEBUG:teuthology.orchestra.run.trial057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T17:24:17.462 DEBUG:teuthology.orchestra.run.trial082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T17:24:17.485 INFO:teuthology.orchestra.run.trial057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T17:24:17.494 INFO:teuthology.orchestra.run.trial057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T17:24:17.499 INFO:teuthology.orchestra.run.trial082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T17:24:17.508 INFO:teuthology.orchestra.run.trial082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T17:24:17.510 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T17:24:17.523 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T17:24:17.523 DEBUG:teuthology.orchestra.run.trial057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T17:24:17.538 DEBUG:teuthology.orchestra.run.trial082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T17:24:17.574 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T17:24:17.592 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T17:24:17.592 DEBUG:teuthology.orchestra.run.trial057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T17:24:17.602 DEBUG:teuthology.orchestra.run.trial082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T17:24:17.632 DEBUG:teuthology.orchestra.run.trial057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T17:24:17.776 DEBUG:teuthology.orchestra.run.trial057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T17:24:17.800 DEBUG:teuthology.orchestra.run.trial057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T17:24:17.943 DEBUG:teuthology.orchestra.run.trial057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T17:24:17.966 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:24:17.966 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T17:24:18.030 DEBUG:teuthology.orchestra.run.trial082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T17:24:18.130 DEBUG:teuthology.orchestra.run.trial082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T17:24:18.155 DEBUG:teuthology.orchestra.run.trial082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T17:24:18.299 DEBUG:teuthology.orchestra.run.trial082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T17:24:18.323 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:24:18.323 DEBUG:teuthology.orchestra.run.trial082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T17:24:18.387 DEBUG:teuthology.orchestra.run.trial057:> sudo service rsyslog restart 2026-02-12T17:24:18.389 DEBUG:teuthology.orchestra.run.trial082:> sudo service rsyslog restart 2026-02-12T17:24:18.416 INFO:teuthology.orchestra.run.trial057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T17:24:18.456 INFO:teuthology.orchestra.run.trial082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T17:24:18.907 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T17:24:18.919 INFO:teuthology.task.internal:Starting timer... 2026-02-12T17:24:18.919 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T17:24:18.935 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T17:24:18.948 DEBUG:teuthology.orchestra.run.trial057:> sudo service auditd rotate 2026-02-12T17:24:18.978 INFO:teuthology.orchestra.run.trial057.stdout:Rotating logs: 2026-02-12T17:24:18.979 DEBUG:teuthology.orchestra.run.trial082:> sudo service auditd rotate 2026-02-12T17:24:19.009 INFO:teuthology.orchestra.run.trial082.stdout:Rotating logs: 2026-02-12T17:24:19.010 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T17:24:19.010 DEBUG:teuthology.orchestra.run.trial057:> /usr/sbin/getenforce 2026-02-12T17:24:19.035 INFO:teuthology.orchestra.run.trial057.stdout:Permissive 2026-02-12T17:24:19.035 DEBUG:teuthology.orchestra.run.trial082:> /usr/sbin/getenforce 2026-02-12T17:24:19.066 INFO:teuthology.orchestra.run.trial082.stdout:Permissive 2026-02-12T17:24:19.066 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial057.front.sepia.ceph.com': 'permissive', 'ubuntu@trial082.front.sepia.ceph.com': 'permissive'} 2026-02-12T17:24:19.066 DEBUG:teuthology.orchestra.run.trial057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T17:24:19.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:24:19.100 DEBUG:teuthology.orchestra.run.trial082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T17:24:19.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:24:19.131 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T17:24:19.131 DEBUG:teuthology.orchestra.run.trial057:> sudo /usr/sbin/setenforce permissive 2026-02-12T17:24:19.164 DEBUG:teuthology.orchestra.run.trial082:> sudo /usr/sbin/setenforce permissive 2026-02-12T17:24:19.196 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T17:24:19.211 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T17:24:19.225 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T17:24:19.226 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial057.front.sepia.ceph.com,trial082.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T17:25:43.738 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial057.front.sepia.ceph.com'), Remote(name='ubuntu@trial082.front.sepia.ceph.com')] 2026-02-12T17:25:43.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial057.front.sepia.ceph.com' 2026-02-12T17:25:43.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:25:43.896 DEBUG:teuthology.orchestra.run.trial057:> true 2026-02-12T17:25:43.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial057.front.sepia.ceph.com' 2026-02-12T17:25:43.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T17:25:43.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:25:44.061 DEBUG:teuthology.orchestra.run.trial082:> true 2026-02-12T17:25:44.139 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial082.front.sepia.ceph.com' 2026-02-12T17:25:44.140 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T17:25:44.154 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T17:25:44.154 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T17:25:44.155 DEBUG:teuthology.orchestra.run.trial057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T17:25:44.157 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T17:25:44.157 DEBUG:teuthology.orchestra.run.trial082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T17:25:44.183 INFO:teuthology.orchestra.run.trial057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T17:25:44.195 INFO:teuthology.orchestra.run.trial057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T17:25:44.206 INFO:teuthology.orchestra.run.trial082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T17:25:44.216 INFO:teuthology.orchestra.run.trial057.stderr:sudo: ntpd: command not found 2026-02-12T17:25:44.218 INFO:teuthology.orchestra.run.trial082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T17:25:44.226 INFO:teuthology.orchestra.run.trial057.stdout:506 Cannot talk to daemon 2026-02-12T17:25:44.238 INFO:teuthology.orchestra.run.trial057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T17:25:44.239 INFO:teuthology.orchestra.run.trial082.stderr:sudo: ntpd: command not found 2026-02-12T17:25:44.249 INFO:teuthology.orchestra.run.trial082.stdout:506 Cannot talk to daemon 2026-02-12T17:25:44.250 INFO:teuthology.orchestra.run.trial057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T17:25:44.261 INFO:teuthology.orchestra.run.trial082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T17:25:44.273 INFO:teuthology.orchestra.run.trial082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T17:25:44.298 INFO:teuthology.orchestra.run.trial057.stderr:bash: line 1: ntpq: command not found 2026-02-12T17:25:44.324 INFO:teuthology.orchestra.run.trial057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T17:25:44.324 INFO:teuthology.orchestra.run.trial057.stdout:=============================================================================== 2026-02-12T17:25:44.324 INFO:teuthology.orchestra.run.trial057.stdout:^? 172-233-177-198.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T17:25:44.325 INFO:teuthology.orchestra.run.trial057.stdout:^? 23.186.168.129 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T17:25:44.325 INFO:teuthology.orchestra.run.trial057.stdout:^? 149.28.200.179.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T17:25:44.325 INFO:teuthology.orchestra.run.trial057.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T17:25:44.326 INFO:teuthology.orchestra.run.trial082.stderr:bash: line 1: ntpq: command not found 2026-02-12T17:25:44.340 INFO:teuthology.orchestra.run.trial082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T17:25:44.340 INFO:teuthology.orchestra.run.trial082.stdout:=============================================================================== 2026-02-12T17:25:44.341 INFO:teuthology.orchestra.run.trial082.stdout:^? ntp1.lax.us.hojmark.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T17:25:44.341 INFO:teuthology.orchestra.run.trial082.stdout:^? ntp.nyc.icanbwell.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T17:25:44.341 INFO:teuthology.orchestra.run.trial082.stdout:^? rn-03.koehn.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T17:25:44.341 INFO:teuthology.orchestra.run.trial082.stdout:^? 149.248.12.167.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T17:25:44.342 INFO:teuthology.run_tasks:Running task install... 2026-02-12T17:25:44.356 DEBUG:teuthology.task.install:project ceph 2026-02-12T17:25:44.356 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-12T17:25:44.357 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'} 2026-02-12T17:25:44.357 INFO:teuthology.task.install:Using flavor: default 2026-02-12T17:25:44.366 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T17:25:44.366 INFO:teuthology.task.install:extra packages: [] 2026-02-12T17:25:44.367 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'tag': None, 'wait_for_package': False} 2026-02-12T17:25:44.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T17:25:44.369 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'tag': None, 'wait_for_package': False} 2026-02-12T17:25:44.370 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T17:25:44.585 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/ 2026-02-12T17:25:44.585 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5230.gafefaa40 2026-02-12T17:25:44.595 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/ 2026-02-12T17:25:44.595 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5230.gafefaa40 2026-02-12T17:25:44.780 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T17:25:44.781 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:25:44.781 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T17:25:44.790 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T17:25:44.790 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:25:44.790 DEBUG:teuthology.orchestra.run.trial082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T17:25:44.806 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T17:25:44.806 DEBUG:teuthology.orchestra.run.trial057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/afefaa40503a4bf024e96f97dd7f852b75f00ad6/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T17:25:44.816 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T17:25:44.816 DEBUG:teuthology.orchestra.run.trial082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/afefaa40503a4bf024e96f97dd7f852b75f00ad6/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T17:25:44.870 DEBUG:teuthology.orchestra.run.trial057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T17:25:44.880 DEBUG:teuthology.orchestra.run.trial082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T17:25:44.944 DEBUG:teuthology.orchestra.run.trial057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T17:25:44.955 DEBUG:teuthology.orchestra.run.trial082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T17:25:45.008 INFO:teuthology.orchestra.run.trial057.stdout:check_obsoletes = 1 2026-02-12T17:25:45.010 DEBUG:teuthology.orchestra.run.trial057:> sudo yum clean all 2026-02-12T17:25:45.018 INFO:teuthology.orchestra.run.trial082.stdout:check_obsoletes = 1 2026-02-12T17:25:45.020 DEBUG:teuthology.orchestra.run.trial082:> sudo yum clean all 2026-02-12T17:25:45.160 INFO:teuthology.orchestra.run.trial057.stdout:41 files removed 2026-02-12T17:25:45.166 INFO:teuthology.orchestra.run.trial082.stdout:41 files removed 2026-02-12T17:25:45.175 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-radosgw 2026-02-12T17:25:45.179 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-radosgw 2026-02-12T17:25:45.451 INFO:teuthology.orchestra.run.trial057.stdout:ceph packages for x86_64 702 kB/s | 91 kB 00:00 2026-02-12T17:25:45.454 INFO:teuthology.orchestra.run.trial082.stdout:ceph packages for x86_64 707 kB/s | 91 kB 00:00 2026-02-12T17:25:45.593 INFO:teuthology.orchestra.run.trial057.stdout:ceph noarch packages 202 kB/s | 24 kB 00:00 2026-02-12T17:25:45.719 INFO:teuthology.orchestra.run.trial057.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-12T17:25:46.608 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-12T17:25:47.787 INFO:teuthology.orchestra.run.trial082.stdout:ceph noarch packages 10 kB/s | 24 kB 00:02 2026-02-12T17:25:47.914 INFO:teuthology.orchestra.run.trial082.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-12T17:25:48.740 INFO:teuthology.orchestra.run.trial082.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-12T17:26:13.057 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:25 2026-02-12T17:26:15.473 INFO:teuthology.orchestra.run.trial082.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:26 2026-02-12T17:26:16.718 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 7.8 MB 00:01 2026-02-12T17:26:17.661 INFO:teuthology.orchestra.run.trial057.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 20 kB 00:00 2026-02-12T17:26:18.691 INFO:teuthology.orchestra.run.trial057.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-12T17:26:19.823 INFO:teuthology.orchestra.run.trial082.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 7.8 MB 00:01 2026-02-12T17:26:20.637 INFO:teuthology.orchestra.run.trial082.stdout:CentOS Stream 9 - Extras packages 222 kB/s | 20 kB 00:00 2026-02-12T17:26:21.904 INFO:teuthology.orchestra.run.trial082.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-12T17:26:21.905 INFO:teuthology.orchestra.run.trial057.stdout:lab-extras 1.0 MB/s | 50 kB 00:00 2026-02-12T17:26:23.193 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:23.195 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:23.195 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout: ceph-radosgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 13 M 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout:Upgrading: 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout: librados2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 3.5 M 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout: librbd1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.8 M 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout: ceph-base x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.2 M 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout: ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 24 M 2026-02-12T17:26:23.196 INFO:teuthology.orchestra.run.trial057.stdout: ceph-selinux x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 909 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: libradosstriper1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 248 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: librgw2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 M 2026-02-12T17:26:23.197 INFO:teuthology.orchestra.run.trial057.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-argparse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 45 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 185 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: python3-cephfs x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 203 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: python3-rados x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 324 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: python3-rbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 305 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: python3-rgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 100 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T17:26:23.198 INFO:teuthology.orchestra.run.trial057.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout:Installing weak dependencies: 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout:Install 32 Packages 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout:Upgrade 2 Packages 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 67 M 2026-02-12T17:26:23.199 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:26:24.169 INFO:teuthology.orchestra.run.trial057.stdout:(1/34): ceph-base-20.3.0-5230.gafefaa40.el9.x86 12 MB/s | 5.2 MB 00:00 2026-02-12T17:26:24.219 INFO:teuthology.orchestra.run.trial057.stdout:(2/34): ceph-selinux-20.3.0-5230.gafefaa40.el9. 500 kB/s | 25 kB 00:00 2026-02-12T17:26:24.285 INFO:teuthology.orchestra.run.trial057.stdout:(3/34): libcephfs2-20.3.0-5230.gafefaa40.el9.x8 13 MB/s | 909 kB 00:00 2026-02-12T17:26:24.340 INFO:teuthology.orchestra.run.trial057.stdout:(4/34): libradosstriper1-20.3.0-5230.gafefaa40. 4.4 MB/s | 248 kB 00:00 2026-02-12T17:26:24.460 INFO:teuthology.orchestra.run.trial057.stdout:(5/34): ceph-radosgw-20.3.0-5230.gafefaa40.el9. 18 MB/s | 13 MB 00:00 2026-02-12T17:26:24.518 INFO:teuthology.orchestra.run.trial057.stdout:(6/34): python3-ceph-argparse-20.3.0-5230.gafef 784 kB/s | 45 kB 00:00 2026-02-12T17:26:24.562 INFO:teuthology.orchestra.run.trial057.stdout:(7/34): python3-ceph-common-20.3.0-5230.gafefaa 4.1 MB/s | 185 kB 00:00 2026-02-12T17:26:24.605 INFO:teuthology.orchestra.run.trial057.stdout:(8/34): python3-cephfs-20.3.0-5230.gafefaa40.el 4.7 MB/s | 203 kB 00:00 2026-02-12T17:26:24.651 INFO:teuthology.orchestra.run.trial057.stdout:(9/34): python3-rados-20.3.0-5230.gafefaa40.el9 7.0 MB/s | 324 kB 00:00 2026-02-12T17:26:24.696 INFO:teuthology.orchestra.run.trial057.stdout:(10/34): python3-rbd-20.3.0-5230.gafefaa40.el9. 6.6 MB/s | 305 kB 00:00 2026-02-12T17:26:24.709 INFO:teuthology.orchestra.run.trial057.stdout:(11/34): librgw2-20.3.0-5230.gafefaa40.el9.x86_ 18 MB/s | 6.5 MB 00:00 2026-02-12T17:26:24.710 INFO:teuthology.orchestra.run.trial057.stdout:(12/34): python3-rgw-20.3.0-5230.gafefaa40.el9. 7.2 MB/s | 100 kB 00:00 2026-02-12T17:26:24.744 INFO:teuthology.orchestra.run.trial057.stdout:(13/34): ceph-common-20.3.0-5230.gafefaa40.el9. 24 MB/s | 24 MB 00:01 2026-02-12T17:26:24.816 INFO:teuthology.orchestra.run.trial057.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 1.4 MB/s | 104 kB 00:00 2026-02-12T17:26:24.816 INFO:teuthology.orchestra.run.trial057.stdout:(15/34): mailcap-2.1.49-5.el9.noarch.rpm 310 kB/s | 33 kB 00:00 2026-02-12T17:26:24.820 INFO:teuthology.orchestra.run.trial057.stdout:(16/34): pciutils-3.7.0-7.el9.x86_64.rpm 846 kB/s | 93 kB 00:00 2026-02-12T17:26:24.842 INFO:teuthology.orchestra.run.trial057.stdout:(17/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.0 MB/s | 160 kB 00:00 2026-02-12T17:26:24.844 INFO:teuthology.orchestra.run.trial057.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 5.7 MB/s | 164 kB 00:00 2026-02-12T17:26:24.850 INFO:teuthology.orchestra.run.trial057.stdout:(19/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.5 MB/s | 45 kB 00:00 2026-02-12T17:26:24.875 INFO:teuthology.orchestra.run.trial057.stdout:(20/34): librdkafka-1.6.1-102.el9.x86_64.rpm 20 MB/s | 662 kB 00:00 2026-02-12T17:26:24.876 INFO:teuthology.orchestra.run.trial057.stdout:(21/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.9 MB/s | 292 kB 00:00 2026-02-12T17:26:24.882 INFO:teuthology.orchestra.run.trial057.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 7.5 MB/s | 240 kB 00:00 2026-02-12T17:26:24.896 INFO:teuthology.orchestra.run.trial057.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.8 MB/s | 37 kB 00:00 2026-02-12T17:26:24.903 INFO:teuthology.orchestra.run.trial057.stdout:(24/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-12T17:26:25.103 INFO:teuthology.orchestra.run.trial082.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-12T17:26:25.207 INFO:teuthology.orchestra.run.trial057.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 81 kB/s | 25 kB 00:00 2026-02-12T17:26:25.358 INFO:teuthology.orchestra.run.trial057.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 326 kB/s | 49 kB 00:00 2026-02-12T17:26:25.366 INFO:teuthology.orchestra.run.trial057.stdout:(27/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 636 kB/s | 308 kB 00:00 2026-02-12T17:26:25.467 INFO:teuthology.orchestra.run.trial057.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 615 kB/s | 67 kB 00:00 2026-02-12T17:26:25.577 INFO:teuthology.orchestra.run.trial057.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2026-02-12T17:26:25.651 INFO:teuthology.orchestra.run.trial057.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2026-02-12T17:26:25.688 INFO:teuthology.orchestra.run.trial057.stdout:(31/34): libarrow-9.0.0-15.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2026-02-12T17:26:25.748 INFO:teuthology.orchestra.run.trial057.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 9.3 MB/s | 1.6 MB 00:00 2026-02-12T17:26:25.771 INFO:teuthology.orchestra.run.trial057.stdout:(33/34): librados2-20.3.0-5230.gafefaa40.el9.x8 29 MB/s | 3.5 MB 00:00 2026-02-12T17:26:25.795 INFO:teuthology.orchestra.run.trial057.stdout:(34/34): librbd1-20.3.0-5230.gafefaa40.el9.x86_ 26 MB/s | 2.8 MB 00:00 2026-02-12T17:26:25.799 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:25.799 INFO:teuthology.orchestra.run.trial057.stdout:Total 26 MB/s | 67 MB 00:02 2026-02-12T17:26:25.888 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:26:25.906 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:26:25.906 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:26:26.168 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:26:26.168 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:26:26.379 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:26:26.380 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:26.380 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repository Size 2026-02-12T17:26:26.380 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout: ceph-radosgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 13 M 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout:Upgrading: 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout: librados2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 3.5 M 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout: librbd1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.8 M 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout: ceph-base x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.2 M 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout: ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 24 M 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout: ceph-selinux x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T17:26:26.381 INFO:teuthology.orchestra.run.trial082.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: libcephfs2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 909 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: libradosstriper1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 248 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: librgw2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 M 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T17:26:26.382 INFO:teuthology.orchestra.run.trial082.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: python3-ceph-argparse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 45 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: python3-ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 185 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: python3-cephfs x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 203 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: python3-rados x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 324 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: python3-rbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 305 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: python3-rgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 100 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T17:26:26.383 INFO:teuthology.orchestra.run.trial082.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T17:26:26.384 INFO:teuthology.orchestra.run.trial082.stdout:Installing weak dependencies: 2026-02-12T17:26:26.384 INFO:teuthology.orchestra.run.trial082.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T17:26:26.384 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:26.384 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:26:26.384 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:26.384 INFO:teuthology.orchestra.run.trial082.stdout:Install 32 Packages 2026-02-12T17:26:26.384 INFO:teuthology.orchestra.run.trial082.stdout:Upgrade 2 Packages 2026-02-12T17:26:26.384 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:26.385 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 67 M 2026-02-12T17:26:26.385 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:26:26.470 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:26:26.622 INFO:teuthology.orchestra.run.trial057.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-12T17:26:26.628 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T17:26:26.657 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T17:26:26.695 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T17:26:26.696 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T17:26:26.708 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T17:26:26.718 INFO:teuthology.orchestra.run.trial057.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-12T17:26:26.721 INFO:teuthology.orchestra.run.trial057.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-12T17:26:26.724 INFO:teuthology.orchestra.run.trial057.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-12T17:26:26.729 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-12T17:26:26.740 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 9/36 2026-02-12T17:26:26.751 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T17:26:26.752 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T17:26:26.776 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T17:26:26.781 INFO:teuthology.orchestra.run.trial057.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-12T17:26:26.811 INFO:teuthology.orchestra.run.trial057.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-12T17:26:26.815 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-12T17:26:26.824 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-12T17:26:26.826 INFO:teuthology.orchestra.run.trial057.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-12T17:26:26.830 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-12T17:26:26.952 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-12T17:26:26.953 INFO:teuthology.orchestra.run.trial057.stdout: Upgrading : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T17:26:26.979 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T17:26:26.981 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 20/36 2026-02-12T17:26:26.987 INFO:teuthology.orchestra.run.trial057.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-12T17:26:27.232 INFO:teuthology.orchestra.run.trial082.stdout:(1/34): ceph-base-20.3.0-5230.gafefaa40.el9.x86 15 MB/s | 5.2 MB 00:00 2026-02-12T17:26:27.269 INFO:teuthology.orchestra.run.trial057.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-12T17:26:27.270 INFO:teuthology.orchestra.run.trial057.stdout: Installing : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T17:26:27.278 INFO:teuthology.orchestra.run.trial082.stdout:(2/34): ceph-selinux-20.3.0-5230.gafefaa40.el9. 538 kB/s | 25 kB 00:00 2026-02-12T17:26:27.287 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T17:26:27.290 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 24/36 2026-02-12T17:26:27.295 INFO:teuthology.orchestra.run.trial057.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-12T17:26:27.297 INFO:teuthology.orchestra.run.trial057.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-12T17:26:27.298 INFO:teuthology.orchestra.run.trial057.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T17:26:27.317 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T17:26:27.320 INFO:teuthology.orchestra.run.trial057.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-12T17:26:27.345 INFO:teuthology.orchestra.run.trial082.stdout:(3/34): libcephfs2-20.3.0-5230.gafefaa40.el9.x8 13 MB/s | 909 kB 00:00 2026-02-12T17:26:27.355 INFO:teuthology.orchestra.run.trial057.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-12T17:26:27.357 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 30/36 2026-02-12T17:26:27.402 INFO:teuthology.orchestra.run.trial082.stdout:(4/34): libradosstriper1-20.3.0-5230.gafefaa40. 4.3 MB/s | 248 kB 00:00 2026-02-12T17:26:27.739 INFO:teuthology.orchestra.run.trial082.stdout:(5/34): ceph-radosgw-20.3.0-5230.gafefaa40.el9. 15 MB/s | 13 MB 00:00 2026-02-12T17:26:27.777 INFO:teuthology.orchestra.run.trial082.stdout:(6/34): python3-ceph-argparse-20.3.0-5230.gafef 1.2 MB/s | 45 kB 00:00 2026-02-12T17:26:27.785 INFO:teuthology.orchestra.run.trial082.stdout:(7/34): librgw2-20.3.0-5230.gafefaa40.el9.x86_6 17 MB/s | 6.5 MB 00:00 2026-02-12T17:26:27.802 INFO:teuthology.orchestra.run.trial082.stdout:(8/34): python3-ceph-common-20.3.0-5230.gafefaa 7.2 MB/s | 185 kB 00:00 2026-02-12T17:26:27.813 INFO:teuthology.orchestra.run.trial082.stdout:(9/34): python3-cephfs-20.3.0-5230.gafefaa40.el 7.1 MB/s | 203 kB 00:00 2026-02-12T17:26:27.863 INFO:teuthology.orchestra.run.trial082.stdout:(10/34): ceph-common-20.3.0-5230.gafefaa40.el9. 25 MB/s | 24 MB 00:00 2026-02-12T17:26:27.864 INFO:teuthology.orchestra.run.trial082.stdout:(11/34): python3-rados-20.3.0-5230.gafefaa40.el 5.1 MB/s | 324 kB 00:00 2026-02-12T17:26:27.865 INFO:teuthology.orchestra.run.trial082.stdout:(12/34): python3-rbd-20.3.0-5230.gafefaa40.el9. 5.8 MB/s | 305 kB 00:00 2026-02-12T17:26:27.875 INFO:teuthology.orchestra.run.trial082.stdout:(13/34): python3-rgw-20.3.0-5230.gafefaa40.el9. 8.3 MB/s | 100 kB 00:00 2026-02-12T17:26:28.295 INFO:teuthology.orchestra.run.trial082.stdout:(14/34): mailcap-2.1.49-5.el9.noarch.rpm 77 kB/s | 33 kB 00:00 2026-02-12T17:26:28.450 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T17:26:28.452 INFO:teuthology.orchestra.run.trial082.stdout:(15/34): boost-program-options-1.75.0-13.el9.x8 180 kB/s | 104 kB 00:00 2026-02-12T17:26:28.453 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T17:26:28.453 INFO:teuthology.orchestra.run.trial082.stdout:(16/34): pciutils-3.7.0-7.el9.x86_64.rpm 158 kB/s | 93 kB 00:00 2026-02-12T17:26:28.538 INFO:teuthology.orchestra.run.trial082.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 537 kB/s | 45 kB 00:00 2026-02-12T17:26:28.604 INFO:teuthology.orchestra.run.trial082.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 530 kB/s | 164 kB 00:00 2026-02-12T17:26:28.687 INFO:teuthology.orchestra.run.trial082.stdout:(19/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 684 kB/s | 160 kB 00:00 2026-02-12T17:26:28.716 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T17:26:28.719 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T17:26:28.755 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T17:26:28.755 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T17:26:28.755 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T17:26:28.755 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:28.758 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T17:26:28.989 INFO:teuthology.orchestra.run.trial082.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 761 kB/s | 292 kB 00:00 2026-02-12T17:26:28.997 INFO:teuthology.orchestra.run.trial082.stdout:(21/34): qatlib-25.08.0-2.el9.x86_64.rpm 771 kB/s | 240 kB 00:00 2026-02-12T17:26:29.079 INFO:teuthology.orchestra.run.trial082.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 815 kB/s | 66 kB 00:00 2026-02-12T17:26:29.083 INFO:teuthology.orchestra.run.trial082.stdout:(23/34): qatlib-service-25.08.0-2.el9.x86_64.rp 392 kB/s | 37 kB 00:00 2026-02-12T17:26:29.269 INFO:teuthology.orchestra.run.trial082.stdout:(24/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.6 MB/s | 308 kB 00:00 2026-02-12T17:26:29.294 INFO:teuthology.orchestra.run.trial082.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.0 MB/s | 25 kB 00:00 2026-02-12T17:26:29.300 INFO:teuthology.orchestra.run.trial082.stdout:(26/34): librdkafka-1.6.1-102.el9.x86_64.rpm 869 kB/s | 662 kB 00:00 2026-02-12T17:26:29.319 INFO:teuthology.orchestra.run.trial082.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2026-02-12T17:26:29.327 INFO:teuthology.orchestra.run.trial082.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 2.4 MB/s | 67 kB 00:00 2026-02-12T17:26:29.367 INFO:teuthology.orchestra.run.trial082.stdout:(29/34): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-12T17:26:29.385 INFO:teuthology.orchestra.run.trial082.stdout:(30/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-12T17:26:29.391 INFO:teuthology.orchestra.run.trial082.stdout:(31/34): re2-20211101-20.el9.x86_64.rpm 2.9 MB/s | 191 kB 00:00 2026-02-12T17:26:29.420 INFO:teuthology.orchestra.run.trial082.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 30 MB/s | 1.6 MB 00:00 2026-02-12T17:26:29.523 INFO:teuthology.orchestra.run.trial082.stdout:(33/34): librbd1-20.3.0-5230.gafefaa40.el9.x86_ 21 MB/s | 2.8 MB 00:00 2026-02-12T17:26:29.538 INFO:teuthology.orchestra.run.trial082.stdout:(34/34): librados2-20.3.0-5230.gafefaa40.el9.x8 23 MB/s | 3.5 MB 00:00 2026-02-12T17:26:29.542 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:29.542 INFO:teuthology.orchestra.run.trial082.stdout:Total 21 MB/s | 67 MB 00:03 2026-02-12T17:26:29.631 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:26:29.648 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:26:29.649 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:26:29.910 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:26:29.910 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:26:30.212 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:26:30.364 INFO:teuthology.orchestra.run.trial082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-12T17:26:30.368 INFO:teuthology.orchestra.run.trial082.stdout: Upgrading : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T17:26:30.399 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T17:26:30.438 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T17:26:30.439 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T17:26:30.451 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T17:26:30.462 INFO:teuthology.orchestra.run.trial082.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-12T17:26:30.464 INFO:teuthology.orchestra.run.trial082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-12T17:26:30.467 INFO:teuthology.orchestra.run.trial082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-12T17:26:30.472 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-12T17:26:30.483 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 9/36 2026-02-12T17:26:30.494 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T17:26:30.495 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T17:26:30.519 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T17:26:30.523 INFO:teuthology.orchestra.run.trial082.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-12T17:26:30.555 INFO:teuthology.orchestra.run.trial082.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-12T17:26:30.559 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-12T17:26:30.567 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-12T17:26:30.570 INFO:teuthology.orchestra.run.trial082.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-12T17:26:30.574 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-12T17:26:30.695 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-12T17:26:30.696 INFO:teuthology.orchestra.run.trial082.stdout: Upgrading : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T17:26:30.724 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T17:26:30.727 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 20/36 2026-02-12T17:26:30.733 INFO:teuthology.orchestra.run.trial082.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-12T17:26:31.016 INFO:teuthology.orchestra.run.trial082.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-12T17:26:31.017 INFO:teuthology.orchestra.run.trial082.stdout: Installing : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T17:26:31.034 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T17:26:31.037 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 24/36 2026-02-12T17:26:31.043 INFO:teuthology.orchestra.run.trial082.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-12T17:26:31.045 INFO:teuthology.orchestra.run.trial082.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-12T17:26:31.046 INFO:teuthology.orchestra.run.trial082.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T17:26:31.064 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T17:26:31.067 INFO:teuthology.orchestra.run.trial082.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-12T17:26:31.101 INFO:teuthology.orchestra.run.trial082.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-12T17:26:31.103 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 30/36 2026-02-12T17:26:32.197 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T17:26:32.200 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T17:26:32.464 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T17:26:32.467 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T17:26:32.509 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T17:26:32.509 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T17:26:32.509 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T17:26:32.509 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:32.512 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T17:26:33.279 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T17:26:33.279 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /sys 2026-02-12T17:26:33.279 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /proc 2026-02-12T17:26:33.279 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /mnt 2026-02-12T17:26:33.279 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /var/tmp 2026-02-12T17:26:33.279 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /home 2026-02-12T17:26:33.280 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /root 2026-02-12T17:26:33.280 INFO:teuthology.orchestra.run.trial057.stdout:skipping the directory /tmp 2026-02-12T17:26:33.280 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:33.858 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T17:26:33.882 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T17:26:33.882 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:33.882 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T17:26:33.882 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T17:26:33.882 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T17:26:33.882 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:33.884 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T17:26:33.897 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T17:26:33.898 INFO:teuthology.orchestra.run.trial057.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T17:26:33.952 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T17:26:33.953 INFO:teuthology.orchestra.run.trial057.stdout:Creating group 'qat' with GID 992. 2026-02-12T17:26:33.953 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:34.244 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 1/36 2026-02-12T17:26:34.244 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T17:26:34.245 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T17:26:34.245 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T17:26:34.245 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 5/36 2026-02-12T17:26:34.245 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 6/36 2026-02-12T17:26:34.245 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 7/36 2026-02-12T17:26:34.245 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 8/36 2026-02-12T17:26:34.245 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 9/36 2026-02-12T17:26:34.245 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T17:26:34.246 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 11/36 2026-02-12T17:26:34.246 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 12/36 2026-02-12T17:26:34.246 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 13/36 2026-02-12T17:26:34.246 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-12T17:26:34.246 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-12T17:26:34.246 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-12T17:26:34.247 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-12T17:26:34.247 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-12T17:26:34.247 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-12T17:26:34.247 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-12T17:26:34.247 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-12T17:26:34.247 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-12T17:26:34.247 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-12T17:26:34.248 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T17:26:34.249 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-12T17:26:34.249 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 35/36 2026-02-12T17:26:34.305 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T17:26:34.306 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:34.306 INFO:teuthology.orchestra.run.trial057.stdout:Upgraded: 2026-02-12T17:26:34.306 INFO:teuthology.orchestra.run.trial057.stdout: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.306 INFO:teuthology.orchestra.run.trial057.stdout: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.306 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:26:34.306 INFO:teuthology.orchestra.run.trial057.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T17:26:34.306 INFO:teuthology.orchestra.run.trial057.stdout: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.306 INFO:teuthology.orchestra.run.trial057.stdout: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.306 INFO:teuthology.orchestra.run.trial057.stdout: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T17:26:34.307 INFO:teuthology.orchestra.run.trial057.stdout: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T17:26:34.308 INFO:teuthology.orchestra.run.trial057.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T17:26:34.309 INFO:teuthology.orchestra.run.trial057.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T17:26:34.309 INFO:teuthology.orchestra.run.trial057.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T17:26:34.309 INFO:teuthology.orchestra.run.trial057.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T17:26:34.309 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:34.309 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:26:34.347 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-test 2026-02-12T17:26:34.651 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:13 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:26:34.734 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:34.735 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:34.735 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-12T17:26:34.735 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:34.735 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:26:34.735 INFO:teuthology.orchestra.run.trial057.stdout: ceph-test x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 78 M 2026-02-12T17:26:34.736 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:26:34.736 INFO:teuthology.orchestra.run.trial057.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T17:26:34.736 INFO:teuthology.orchestra.run.trial057.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T17:26:34.736 INFO:teuthology.orchestra.run.trial057.stdout: libcephsqlite x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 159 k 2026-02-12T17:26:34.736 INFO:teuthology.orchestra.run.trial057.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T17:26:34.736 INFO:teuthology.orchestra.run.trial057.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T17:26:34.736 INFO:teuthology.orchestra.run.trial057.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout:Install 10 Packages 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 82 M 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 339 M 2026-02-12T17:26:34.737 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:26:35.173 INFO:teuthology.orchestra.run.trial057.stdout:(1/10): libcephsqlite-20.3.0-5230.gafefaa40.el9 1.6 MB/s | 159 kB 00:00 2026-02-12T17:26:35.282 INFO:teuthology.orchestra.run.trial057.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 209 kB/s | 23 kB 00:00 2026-02-12T17:26:35.287 INFO:teuthology.orchestra.run.trial057.stdout:(3/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 10 MB/s | 2.1 MB 00:00 2026-02-12T17:26:35.406 INFO:teuthology.orchestra.run.trial057.stdout:(4/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 761 kB/s | 94 kB 00:00 2026-02-12T17:26:35.433 INFO:teuthology.orchestra.run.trial057.stdout:(5/10): libxslt-1.1.34-12.el9.x86_64.rpm 1.6 MB/s | 233 kB 00:00 2026-02-12T17:26:35.515 INFO:teuthology.orchestra.run.trial057.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 3.6 MB/s | 303 kB 00:00 2026-02-12T17:26:35.539 INFO:teuthology.orchestra.run.trial057.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.7 MB/s | 64 kB 00:00 2026-02-12T17:26:35.554 INFO:teuthology.orchestra.run.trial057.stdout:(8/10): protobuf-3.14.0-17.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2026-02-12T17:26:35.742 INFO:teuthology.orchestra.run.trial057.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 598 kB/s | 122 kB 00:00 2026-02-12T17:26:36.624 INFO:teuthology.orchestra.run.trial057.stdout:(10/10): ceph-test-20.3.0-5230.gafefaa40.el9.x8 51 MB/s | 78 MB 00:01 2026-02-12T17:26:36.626 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:36.626 INFO:teuthology.orchestra.run.trial057.stdout:Total 44 MB/s | 82 MB 00:01 2026-02-12T17:26:36.689 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:26:36.699 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:26:36.700 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:26:36.981 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:26:36.981 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:26:37.044 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T17:26:37.044 INFO:teuthology.orchestra.run.trial082.stdout:skipping the directory /sys 2026-02-12T17:26:37.044 INFO:teuthology.orchestra.run.trial082.stdout:skipping the directory /proc 2026-02-12T17:26:37.044 INFO:teuthology.orchestra.run.trial082.stdout:skipping the directory /mnt 2026-02-12T17:26:37.045 INFO:teuthology.orchestra.run.trial082.stdout:skipping the directory /var/tmp 2026-02-12T17:26:37.045 INFO:teuthology.orchestra.run.trial082.stdout:skipping the directory /home 2026-02-12T17:26:37.045 INFO:teuthology.orchestra.run.trial082.stdout:skipping the directory /root 2026-02-12T17:26:37.045 INFO:teuthology.orchestra.run.trial082.stdout:skipping the directory /tmp 2026-02-12T17:26:37.045 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:37.287 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:26:37.296 INFO:teuthology.orchestra.run.trial057.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-12T17:26:37.304 INFO:teuthology.orchestra.run.trial057.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-12T17:26:37.309 INFO:teuthology.orchestra.run.trial057.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-12T17:26:37.313 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-12T17:26:37.318 INFO:teuthology.orchestra.run.trial057.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-12T17:26:37.322 INFO:teuthology.orchestra.run.trial057.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-12T17:26:37.331 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-12T17:26:37.339 INFO:teuthology.orchestra.run.trial057.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-12T17:26:37.340 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T17:26:37.625 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T17:26:37.649 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T17:26:37.649 INFO:teuthology.orchestra.run.trial082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:37.649 INFO:teuthology.orchestra.run.trial082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T17:26:37.649 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T17:26:37.649 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T17:26:37.649 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:37.651 INFO:teuthology.orchestra.run.trial082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T17:26:37.663 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T17:26:37.663 INFO:teuthology.orchestra.run.trial082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T17:26:37.717 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T17:26:37.717 INFO:teuthology.orchestra.run.trial082.stdout:Creating group 'qat' with GID 992. 2026-02-12T17:26:37.717 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:38.013 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 1/36 2026-02-12T17:26:38.013 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T17:26:38.013 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T17:26:38.013 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T17:26:38.013 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 5/36 2026-02-12T17:26:38.013 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 6/36 2026-02-12T17:26:38.013 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 7/36 2026-02-12T17:26:38.013 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 8/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 9/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 11/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 12/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 13/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-12T17:26:38.014 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-12T17:26:38.015 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T17:26:38.016 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-12T17:26:38.016 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 35/36 2026-02-12T17:26:38.074 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T17:26:38.074 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:38.074 INFO:teuthology.orchestra.run.trial082.stdout:Upgraded: 2026-02-12T17:26:38.074 INFO:teuthology.orchestra.run.trial082.stdout: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.074 INFO:teuthology.orchestra.run.trial082.stdout: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.074 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T17:26:38.075 INFO:teuthology.orchestra.run.trial082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.076 INFO:teuthology.orchestra.run.trial082.stdout: python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout: python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout: python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout: python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:38.077 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:26:38.117 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-test 2026-02-12T17:26:38.424 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:00:13 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:26:38.506 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:26:38.507 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:38.507 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repository Size 2026-02-12T17:26:38.507 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:38.507 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: ceph-test x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 78 M 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: libcephsqlite x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 159 k 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T17:26:38.508 INFO:teuthology.orchestra.run.trial082.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T17:26:38.509 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:38.509 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:26:38.509 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:38.509 INFO:teuthology.orchestra.run.trial082.stdout:Install 10 Packages 2026-02-12T17:26:38.509 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:38.510 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 82 M 2026-02-12T17:26:38.510 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 339 M 2026-02-12T17:26:38.510 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:26:38.992 INFO:teuthology.orchestra.run.trial082.stdout:(1/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 56 MB/s | 2.1 MB 00:00 2026-02-12T17:26:38.996 INFO:teuthology.orchestra.run.trial082.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 5.5 MB/s | 23 kB 00:00 2026-02-12T17:26:39.001 INFO:teuthology.orchestra.run.trial082.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 19 MB/s | 94 kB 00:00 2026-02-12T17:26:39.041 INFO:teuthology.orchestra.run.trial082.stdout:(4/10): libcephsqlite-20.3.0-5230.gafefaa40.el9 1.8 MB/s | 159 kB 00:00 2026-02-12T17:26:39.076 INFO:teuthology.orchestra.run.trial082.stdout:(5/10): libxslt-1.1.34-12.el9.x86_64.rpm 3.0 MB/s | 233 kB 00:00 2026-02-12T17:26:39.091 INFO:teuthology.orchestra.run.trial082.stdout:(6/10): protobuf-3.14.0-17.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2026-02-12T17:26:39.116 INFO:teuthology.orchestra.run.trial082.stdout:(7/10): socat-1.7.4.1-8.el9.x86_64.rpm 7.5 MB/s | 303 kB 00:00 2026-02-12T17:26:39.124 INFO:teuthology.orchestra.run.trial082.stdout:(8/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2026-02-12T17:26:39.404 INFO:teuthology.orchestra.run.trial082.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 422 kB/s | 122 kB 00:00 2026-02-12T17:26:40.493 INFO:teuthology.orchestra.run.trial082.stdout:(10/10): ceph-test-20.3.0-5230.gafefaa40.el9.x8 51 MB/s | 78 MB 00:01 2026-02-12T17:26:40.495 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:40.495 INFO:teuthology.orchestra.run.trial082.stdout:Total 41 MB/s | 82 MB 00:01 2026-02-12T17:26:40.563 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:26:40.573 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:26:40.573 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:26:40.775 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T17:26:40.793 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T17:26:40.855 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:26:40.855 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:26:41.117 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T17:26:41.117 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 1/10 2026-02-12T17:26:41.118 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2/10 2026-02-12T17:26:41.118 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-12T17:26:41.118 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-12T17:26:41.118 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-12T17:26:41.118 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-12T17:26:41.118 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-12T17:26:41.118 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-12T17:26:41.118 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-12T17:26:41.164 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:26:41.172 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-12T17:26:41.172 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T17:26:41.173 INFO:teuthology.orchestra.run.trial057.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T17:26:41.174 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:41.174 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:26:41.174 INFO:teuthology.orchestra.run.trial082.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-12T17:26:41.182 INFO:teuthology.orchestra.run.trial082.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-12T17:26:41.187 INFO:teuthology.orchestra.run.trial082.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-12T17:26:41.191 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-12T17:26:41.196 INFO:teuthology.orchestra.run.trial082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-12T17:26:41.198 INFO:teuthology.orchestra.run.trial082.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-12T17:26:41.208 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-12T17:26:41.212 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph 2026-02-12T17:26:41.216 INFO:teuthology.orchestra.run.trial082.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-12T17:26:41.216 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T17:26:41.506 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:20 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:26:41.591 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:41.592 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:41.592 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-12T17:26:41.592 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:41.592 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:26:41.592 INFO:teuthology.orchestra.run.trial057.stdout: ceph x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 k 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mds x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.4 M 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 936 k 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 297 k 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mon x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.0 M 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 166 k 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd-classic x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 16 M 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd-crimson x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 19 M 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T17:26:41.593 INFO:teuthology.orchestra.run.trial057.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T17:26:41.594 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-collections 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T17:26:41.595 INFO:teuthology.orchestra.run.trial057.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout:Install 42 Packages 2026-02-12T17:26:41.596 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:41.597 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 48 M 2026-02-12T17:26:41.597 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 167 M 2026-02-12T17:26:41.597 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:26:41.968 INFO:teuthology.orchestra.run.trial057.stdout:(1/42): ceph-20.3.0-5230.gafefaa40.el9.x86_64.r 129 kB/s | 6.5 kB 00:00 2026-02-12T17:26:42.055 INFO:teuthology.orchestra.run.trial057.stdout:(2/42): ceph-mgr-20.3.0-5230.gafefaa40.el9.x86_ 6.7 MB/s | 936 kB 00:00 2026-02-12T17:26:42.084 INFO:teuthology.orchestra.run.trial057.stdout:(3/42): ceph-mds-20.3.0-5230.gafefaa40.el9.x86_ 14 MB/s | 2.4 MB 00:00 2026-02-12T17:26:42.087 INFO:teuthology.orchestra.run.trial057.stdout:(4/42): ceph-osd-20.3.0-5230.gafefaa40.el9.x86_ 5.1 MB/s | 166 kB 00:00 2026-02-12T17:26:42.251 INFO:teuthology.orchestra.run.trial057.stdout:(5/42): ceph-mon-20.3.0-5230.gafefaa40.el9.x86_ 18 MB/s | 5.0 MB 00:00 2026-02-12T17:26:42.297 INFO:teuthology.orchestra.run.trial057.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5230.gafef 6.3 MB/s | 297 kB 00:00 2026-02-12T17:26:42.366 INFO:teuthology.orchestra.run.trial057.stdout:(7/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 594 kB/s | 40 kB 00:00 2026-02-12T17:26:42.388 INFO:teuthology.orchestra.run.trial057.stdout:(8/42): libconfig-1.7.2-9.el9.x86_64.rpm 3.2 MB/s | 72 kB 00:00 2026-02-12T17:26:42.433 INFO:teuthology.orchestra.run.trial057.stdout:(9/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.5 MB/s | 253 kB 00:00 2026-02-12T17:26:42.501 INFO:teuthology.orchestra.run.trial057.stdout:(10/42): python3-cryptography-36.0.1-5.el9.x86_ 18 MB/s | 1.2 MB 00:00 2026-02-12T17:26:42.524 INFO:teuthology.orchestra.run.trial057.stdout:(11/42): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-12T17:26:42.548 INFO:teuthology.orchestra.run.trial057.stdout:(12/42): python3-pycparser-2.20-6.el9.noarch.rp 5.6 MB/s | 135 kB 00:00 2026-02-12T17:26:42.572 INFO:teuthology.orchestra.run.trial057.stdout:(13/42): python3-pyparsing-2.4.7-9.el9.noarch.r 6.2 MB/s | 150 kB 00:00 2026-02-12T17:26:42.596 INFO:teuthology.orchestra.run.trial057.stdout:(14/42): python3-requests-2.25.1-10.el9.noarch. 5.1 MB/s | 126 kB 00:00 2026-02-12T17:26:42.620 INFO:teuthology.orchestra.run.trial057.stdout:(15/42): python3-urllib3-1.26.5-7.el9.noarch.rp 8.8 MB/s | 218 kB 00:00 2026-02-12T17:26:42.661 INFO:teuthology.orchestra.run.trial057.stdout:(16/42): ceph-osd-classic-20.3.0-5230.gafefaa40 27 MB/s | 16 MB 00:00 2026-02-12T17:26:42.662 INFO:teuthology.orchestra.run.trial057.stdout:(17/42): unzip-6.0-59.el9.x86_64.rpm 4.3 MB/s | 182 kB 00:00 2026-02-12T17:26:42.768 INFO:teuthology.orchestra.run.trial057.stdout:(18/42): ceph-osd-crimson-20.3.0-5230.gafefaa40 28 MB/s | 19 MB 00:00 2026-02-12T17:26:42.769 INFO:teuthology.orchestra.run.trial057.stdout:(19/42): zip-3.0-35.el9.x86_64.rpm 2.4 MB/s | 266 kB 00:00 2026-02-12T17:26:43.188 INFO:teuthology.orchestra.run.trial057.stdout:(20/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 468 kB/s | 246 kB 00:00 2026-02-12T17:26:43.233 INFO:teuthology.orchestra.run.trial057.stdout:(21/42): python3-libstoragemgmt-1.10.1-1.el9.x8 381 kB/s | 177 kB 00:00 2026-02-12T17:26:43.234 INFO:teuthology.orchestra.run.trial057.stdout:(22/42): lua-5.4.4-4.el9.x86_64.rpm 404 kB/s | 188 kB 00:00 2026-02-12T17:26:43.284 INFO:teuthology.orchestra.run.trial057.stdout:(23/42): python3-packaging-20.9-5.el9.noarch.rp 804 kB/s | 77 kB 00:00 2026-02-12T17:26:43.289 INFO:teuthology.orchestra.run.trial057.stdout:(24/42): lua-devel-5.4.4-4.el9.x86_64.rpm 403 kB/s | 22 kB 00:00 2026-02-12T17:26:43.324 INFO:teuthology.orchestra.run.trial057.stdout:(25/42): python3-toml-0.10.2-6.el9.noarch.rpm 457 kB/s | 42 kB 00:00 2026-02-12T17:26:43.380 INFO:teuthology.orchestra.run.trial057.stdout:(26/42): python3-autocommand-2.2.2-8.el9.noarch 324 kB/s | 29 kB 00:00 2026-02-12T17:26:43.419 INFO:teuthology.orchestra.run.trial057.stdout:(27/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.1 MB/s | 43 kB 00:00 2026-02-12T17:26:43.422 INFO:teuthology.orchestra.run.trial057.stdout:(28/42): python3-backports-tarfile-1.2.0-1.el9. 613 kB/s | 60 kB 00:00 2026-02-12T17:26:43.432 INFO:teuthology.orchestra.run.trial057.stdout:(29/42): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2026-02-12T17:26:43.466 INFO:teuthology.orchestra.run.trial057.stdout:(30/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 322 kB/s | 11 kB 00:00 2026-02-12T17:26:43.493 INFO:teuthology.orchestra.run.trial057.stdout:(31/42): python3-cheroot-10.0.1-4.el9.noarch.rp 2.3 MB/s | 173 kB 00:00 2026-02-12T17:26:43.500 INFO:teuthology.orchestra.run.trial057.stdout:(32/42): python3-jaraco-classes-3.2.1-5.el9.noa 515 kB/s | 18 kB 00:00 2026-02-12T17:26:43.512 INFO:teuthology.orchestra.run.trial057.stdout:(33/42): python3-cherrypy-18.6.1-2.el9.noarch.r 3.9 MB/s | 358 kB 00:00 2026-02-12T17:26:43.528 INFO:teuthology.orchestra.run.trial057.stdout:(34/42): python3-jaraco-collections-3.0.0-8.el9 667 kB/s | 23 kB 00:00 2026-02-12T17:26:43.542 INFO:teuthology.orchestra.run.trial057.stdout:(35/42): python3-jaraco-context-6.0.1-3.el9.noa 468 kB/s | 20 kB 00:00 2026-02-12T17:26:43.546 INFO:teuthology.orchestra.run.trial057.stdout:(36/42): python3-jaraco-functools-3.5.0-2.el9.n 580 kB/s | 19 kB 00:00 2026-02-12T17:26:43.555 INFO:teuthology.orchestra.run.trial057.stdout:(37/42): python3-jaraco-text-4.0.0-2.el9.noarch 998 kB/s | 26 kB 00:00 2026-02-12T17:26:43.571 INFO:teuthology.orchestra.run.trial057.stdout:(38/42): python3-portend-3.1.0-2.el9.noarch.rpm 645 kB/s | 16 kB 00:00 2026-02-12T17:26:43.581 INFO:teuthology.orchestra.run.trial057.stdout:(39/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.4 MB/s | 90 kB 00:00 2026-02-12T17:26:43.583 INFO:teuthology.orchestra.run.trial057.stdout:(40/42): python3-more-itertools-8.12.0-2.el9.no 1.9 MB/s | 79 kB 00:00 2026-02-12T17:26:43.592 INFO:teuthology.orchestra.run.trial057.stdout:(41/42): python3-tempora-5.0.0-2.el9.noarch.rpm 1.7 MB/s | 36 kB 00:00 2026-02-12T17:26:43.615 INFO:teuthology.orchestra.run.trial057.stdout:(42/42): python3-zc-lockfile-2.0-10.el9.noarch. 587 kB/s | 20 kB 00:00 2026-02-12T17:26:43.617 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:43.617 INFO:teuthology.orchestra.run.trial057.stdout:Total 24 MB/s | 48 MB 00:02 2026-02-12T17:26:43.766 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:26:43.784 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:26:43.784 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:26:43.982 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:26:43.982 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:26:44.212 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:26:44.214 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-12T17:26:44.218 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-12T17:26:44.223 INFO:teuthology.orchestra.run.trial057.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-12T17:26:44.225 INFO:teuthology.orchestra.run.trial057.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-12T17:26:44.231 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-12T17:26:44.254 INFO:teuthology.orchestra.run.trial057.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-12T17:26:44.258 INFO:teuthology.orchestra.run.trial057.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-12T17:26:44.262 INFO:teuthology.orchestra.run.trial057.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-12T17:26:44.267 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-12T17:26:44.273 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-12T17:26:44.277 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-12T17:26:44.283 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-12T17:26:44.288 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-12T17:26:44.291 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-12T17:26:44.297 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-12T17:26:44.300 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-12T17:26:44.307 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-12T17:26:44.310 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-12T17:26:44.333 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-12T17:26:44.345 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-12T17:26:44.350 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-12T17:26:44.360 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-12T17:26:44.366 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T17:26:44.379 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-12T17:26:44.394 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-12T17:26:44.468 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-12T17:26:44.477 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-12T17:26:44.499 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-12T17:26:44.528 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-12T17:26:44.534 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-12T17:26:44.585 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-12T17:26:44.627 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 32/42 2026-02-12T17:26:44.628 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T17:26:44.651 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T17:26:44.651 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:44.651 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T17:26:44.651 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T17:26:44.651 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T17:26:44.651 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:44.655 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T17:26:44.656 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-12T17:26:44.672 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T17:26:44.673 INFO:teuthology.orchestra.run.trial057.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T17:26:44.673 INFO:teuthology.orchestra.run.trial057.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T17:26:44.673 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:44.674 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T17:26:44.680 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T17:26:44.704 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T17:26:44.704 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T17:26:44.704 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:44.966 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T17:26:44.966 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 1/10 2026-02-12T17:26:44.966 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2/10 2026-02-12T17:26:44.966 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-12T17:26:44.966 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-12T17:26:44.966 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-12T17:26:44.967 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-12T17:26:44.967 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-12T17:26:44.967 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-12T17:26:44.967 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-12T17:26:45.020 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-12T17:26:45.020 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:45.020 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:26:45.020 INFO:teuthology.orchestra.run.trial082.stdout: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:45.020 INFO:teuthology.orchestra.run.trial082.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T17:26:45.021 INFO:teuthology.orchestra.run.trial082.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T17:26:45.021 INFO:teuthology.orchestra.run.trial082.stdout: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:45.021 INFO:teuthology.orchestra.run.trial082.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T17:26:45.021 INFO:teuthology.orchestra.run.trial082.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T17:26:45.021 INFO:teuthology.orchestra.run.trial082.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T17:26:45.021 INFO:teuthology.orchestra.run.trial082.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T17:26:45.021 INFO:teuthology.orchestra.run.trial082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T17:26:45.021 INFO:teuthology.orchestra.run.trial082.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T17:26:45.022 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:45.022 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:26:45.056 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph 2026-02-12T17:26:45.337 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-12T17:26:45.351 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:00:20 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:26:45.435 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:26:45.436 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:45.436 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repository Size 2026-02-12T17:26:45.436 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:45.436 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:26:45.436 INFO:teuthology.orchestra.run.trial082.stdout: ceph x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 k 2026-02-12T17:26:45.436 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:26:45.436 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mds x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.4 M 2026-02-12T17:26:45.437 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 936 k 2026-02-12T17:26:45.437 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 297 k 2026-02-12T17:26:45.437 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mon x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.0 M 2026-02-12T17:26:45.437 INFO:teuthology.orchestra.run.trial082.stdout: ceph-osd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 166 k 2026-02-12T17:26:45.437 INFO:teuthology.orchestra.run.trial082.stdout: ceph-osd-classic x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 16 M 2026-02-12T17:26:45.437 INFO:teuthology.orchestra.run.trial082.stdout: ceph-osd-crimson x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 19 M 2026-02-12T17:26:45.437 INFO:teuthology.orchestra.run.trial082.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T17:26:45.437 INFO:teuthology.orchestra.run.trial082.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T17:26:45.437 INFO:teuthology.orchestra.run.trial082.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-collections 2026-02-12T17:26:45.438 INFO:teuthology.orchestra.run.trial082.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T17:26:45.439 INFO:teuthology.orchestra.run.trial082.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T17:26:45.440 INFO:teuthology.orchestra.run.trial082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T17:26:45.440 INFO:teuthology.orchestra.run.trial082.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T17:26:45.440 INFO:teuthology.orchestra.run.trial082.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T17:26:45.440 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:45.440 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:26:45.440 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:45.440 INFO:teuthology.orchestra.run.trial082.stdout:Install 42 Packages 2026-02-12T17:26:45.440 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:45.441 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 48 M 2026-02-12T17:26:45.441 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 167 M 2026-02-12T17:26:45.441 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:26:46.095 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 37/42 2026-02-12T17:26:46.105 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 38/42 2026-02-12T17:26:46.106 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T17:26:46.133 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T17:26:46.133 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:46.133 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T17:26:46.133 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T17:26:46.133 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T17:26:46.133 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:46.210 INFO:teuthology.orchestra.run.trial082.stdout:(1/42): ceph-20.3.0-5230.gafefaa40.el9.x86_64.r 109 kB/s | 6.5 kB 00:00 2026-02-12T17:26:46.297 INFO:teuthology.orchestra.run.trial082.stdout:(2/42): ceph-mgr-20.3.0-5230.gafefaa40.el9.x86_ 6.2 MB/s | 936 kB 00:00 2026-02-12T17:26:46.321 INFO:teuthology.orchestra.run.trial082.stdout:(3/42): ceph-mds-20.3.0-5230.gafefaa40.el9.x86_ 14 MB/s | 2.4 MB 00:00 2026-02-12T17:26:46.324 INFO:teuthology.orchestra.run.trial082.stdout:(4/42): ceph-osd-20.3.0-5230.gafefaa40.el9.x86_ 6.0 MB/s | 166 kB 00:00 2026-02-12T17:26:46.343 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T17:26:46.365 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T17:26:46.365 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:46.365 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T17:26:46.365 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T17:26:46.365 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T17:26:46.365 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:46.459 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T17:26:46.462 INFO:teuthology.orchestra.run.trial082.stdout:(5/42): ceph-mon-20.3.0-5230.gafefaa40.el9.x86_ 20 MB/s | 5.0 MB 00:00 2026-02-12T17:26:46.480 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T17:26:46.480 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:46.480 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T17:26:46.481 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T17:26:46.481 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T17:26:46.481 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:46.481 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T17:26:46.489 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T17:26:46.510 INFO:teuthology.orchestra.run.trial082.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5230.gafef 6.1 MB/s | 297 kB 00:00 2026-02-12T17:26:46.511 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T17:26:46.875 INFO:teuthology.orchestra.run.trial082.stdout:(7/42): ceph-osd-classic-20.3.0-5230.gafefaa40. 28 MB/s | 16 MB 00:00 2026-02-12T17:26:46.904 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 1/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 3/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 4/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 5/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 6/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 7/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 8/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-12T17:26:46.905 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T17:26:46.906 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-12T17:26:46.907 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-12T17:26:46.908 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-12T17:26:46.908 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-12T17:26:46.908 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-12T17:26:46.908 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-12T17:26:46.961 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-12T17:26:46.961 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:46.962 INFO:teuthology.orchestra.run.trial057.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T17:26:46.963 INFO:teuthology.orchestra.run.trial057.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T17:26:46.964 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: zip-3.0-35.el9.x86_64 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:46.965 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:26:46.999 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-base 2026-02-12T17:26:47.007 INFO:teuthology.orchestra.run.trial082.stdout:(8/42): ceph-osd-crimson-20.3.0-5230.gafefaa40. 28 MB/s | 19 MB 00:00 2026-02-12T17:26:47.084 INFO:teuthology.orchestra.run.trial082.stdout:(9/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-12T17:26:47.298 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:26 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:26:47.362 INFO:teuthology.orchestra.run.trial057.stdout:Package ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:26:47.379 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:47.380 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:26:47.380 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:26:47.389 INFO:teuthology.orchestra.run.trial082.stdout:(10/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 664 kB/s | 253 kB 00:00 2026-02-12T17:26:47.401 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install cephadm 2026-02-12T17:26:47.414 INFO:teuthology.orchestra.run.trial082.stdout:(11/42): libconfig-1.7.2-9.el9.x86_64.rpm 134 kB/s | 72 kB 00:00 2026-02-12T17:26:47.619 INFO:teuthology.orchestra.run.trial082.stdout:(12/42): python3-ply-3.11-14.el9.noarch.rpm 464 kB/s | 106 kB 00:00 2026-02-12T17:26:47.695 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:26 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:26:47.719 INFO:teuthology.orchestra.run.trial082.stdout:(13/42): python3-pycparser-2.20-6.el9.noarch.rp 443 kB/s | 135 kB 00:00 2026-02-12T17:26:47.778 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:47.778 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:47.778 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-12T17:26:47.778 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:47.778 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:26:47.779 INFO:teuthology.orchestra.run.trial057.stdout: cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 1.0 M 2026-02-12T17:26:47.779 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:47.779 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:26:47.779 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:47.779 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-12T17:26:47.779 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:47.779 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 1.0 M 2026-02-12T17:26:47.779 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 1.0 M 2026-02-12T17:26:47.779 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:26:47.898 INFO:teuthology.orchestra.run.trial057.stdout:cephadm-20.3.0-5230.gafefaa40.el9.noarch.rpm 8.5 MB/s | 1.0 MB 00:00 2026-02-12T17:26:47.899 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:47.899 INFO:teuthology.orchestra.run.trial057.stdout:Total 8.4 MB/s | 1.0 MB 00:00 2026-02-12T17:26:47.899 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:26:47.901 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:26:47.902 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:26:47.906 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:26:47.906 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:26:47.924 INFO:teuthology.orchestra.run.trial082.stdout:(14/42): python3-pyparsing-2.4.7-9.el9.noarch.r 492 kB/s | 150 kB 00:00 2026-02-12T17:26:47.924 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:26:47.949 INFO:teuthology.orchestra.run.trial082.stdout:(15/42): python3-requests-2.25.1-10.el9.noarch. 550 kB/s | 126 kB 00:00 2026-02-12T17:26:47.986 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T17:26:48.000 INFO:teuthology.orchestra.run.trial057.stdout: Installing : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T17:26:48.063 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T17:26:48.118 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T17:26:48.118 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:48.119 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:26:48.119 INFO:teuthology.orchestra.run.trial057.stdout: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:26:48.119 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:48.119 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:26:48.147 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T17:26:48.255 INFO:teuthology.orchestra.run.trial082.stdout:(16/42): unzip-6.0-59.el9.x86_64.rpm 594 kB/s | 182 kB 00:00 2026-02-12T17:26:48.305 INFO:teuthology.orchestra.run.trial082.stdout:(17/42): python3-urllib3-1.26.5-7.el9.noarch.rp 573 kB/s | 218 kB 00:00 2026-02-12T17:26:48.446 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:27 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:26:48.463 INFO:teuthology.orchestra.run.trial082.stdout:(18/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 1.5 MB/s | 246 kB 00:00 2026-02-12T17:26:48.500 INFO:teuthology.orchestra.run.trial082.stdout:(19/42): lua-5.4.4-4.el9.x86_64.rpm 5.0 MB/s | 188 kB 00:00 2026-02-12T17:26:48.529 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:48.530 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:48.530 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repo Size 2026-02-12T17:26:48.530 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:48.530 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:26:48.530 INFO:teuthology.orchestra.run.trial057.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 147 k 2026-02-12T17:26:48.530 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:48.531 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:26:48.531 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:48.531 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-12T17:26:48.531 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:48.531 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 147 k 2026-02-12T17:26:48.531 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 419 k 2026-02-12T17:26:48.531 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:26:48.535 INFO:teuthology.orchestra.run.trial082.stdout:(20/42): python3-libstoragemgmt-1.10.1-1.el9.x8 4.9 MB/s | 177 kB 00:00 2026-02-12T17:26:48.565 INFO:teuthology.orchestra.run.trial082.stdout:(21/42): python3-packaging-20.9-5.el9.noarch.rp 2.6 MB/s | 77 kB 00:00 2026-02-12T17:26:48.591 INFO:teuthology.orchestra.run.trial082.stdout:(22/42): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-12T17:26:48.622 INFO:teuthology.orchestra.run.trial082.stdout:(23/42): python3-cryptography-36.0.1-5.el9.x86_ 829 kB/s | 1.2 MB 00:01 2026-02-12T17:26:48.635 INFO:teuthology.orchestra.run.trial082.stdout:(24/42): zip-3.0-35.el9.x86_64.rpm 698 kB/s | 266 kB 00:00 2026-02-12T17:26:48.666 INFO:teuthology.orchestra.run.trial057.stdout:ceph-immutable-object-cache-20.3.0-5230.gafefaa 1.1 MB/s | 147 kB 00:00 2026-02-12T17:26:48.667 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:48.667 INFO:teuthology.orchestra.run.trial057.stdout:Total 1.0 MB/s | 147 kB 00:00 2026-02-12T17:26:48.667 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:26:48.672 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:26:48.672 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:26:48.698 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:26:48.699 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:26:48.712 INFO:teuthology.orchestra.run.trial082.stdout:(25/42): lua-devel-5.4.4-4.el9.x86_64.rpm 183 kB/s | 22 kB 00:00 2026-02-12T17:26:48.724 INFO:teuthology.orchestra.run.trial082.stdout:(26/42): python3-autocommand-2.2.2-8.el9.noarch 334 kB/s | 29 kB 00:00 2026-02-12T17:26:48.748 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:26:48.749 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T17:26:48.755 INFO:teuthology.orchestra.run.trial082.stdout:(27/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.4 MB/s | 43 kB 00:00 2026-02-12T17:26:48.771 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T17:26:48.771 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:48.771 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T17:26:48.772 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:48.789 INFO:teuthology.orchestra.run.trial082.stdout:(28/42): luarocks-3.9.2-5.el9.noarch.rpm 902 kB/s | 151 kB 00:00 2026-02-12T17:26:48.816 INFO:teuthology.orchestra.run.trial082.stdout:(29/42): python3-cheroot-10.0.1-4.el9.noarch.rp 2.8 MB/s | 173 kB 00:00 2026-02-12T17:26:48.843 INFO:teuthology.orchestra.run.trial082.stdout:(30/42): python3-backports-tarfile-1.2.0-1.el9. 461 kB/s | 60 kB 00:00 2026-02-12T17:26:48.847 INFO:teuthology.orchestra.run.trial082.stdout:(31/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 353 kB/s | 11 kB 00:00 2026-02-12T17:26:48.862 INFO:teuthology.orchestra.run.trial082.stdout:(32/42): python3-cherrypy-18.6.1-2.el9.noarch.r 4.8 MB/s | 358 kB 00:00 2026-02-12T17:26:48.877 INFO:teuthology.orchestra.run.trial082.stdout:(33/42): python3-jaraco-collections-3.0.0-8.el9 769 kB/s | 23 kB 00:00 2026-02-12T17:26:48.877 INFO:teuthology.orchestra.run.trial082.stdout:(34/42): python3-jaraco-classes-3.2.1-5.el9.noa 511 kB/s | 18 kB 00:00 2026-02-12T17:26:48.896 INFO:teuthology.orchestra.run.trial082.stdout:(35/42): python3-jaraco-context-6.0.1-3.el9.noa 579 kB/s | 20 kB 00:00 2026-02-12T17:26:48.912 INFO:teuthology.orchestra.run.trial082.stdout:(36/42): python3-jaraco-text-4.0.0-2.el9.noarch 772 kB/s | 26 kB 00:00 2026-02-12T17:26:48.925 INFO:teuthology.orchestra.run.trial082.stdout:(37/42): python3-jaraco-functools-3.5.0-2.el9.n 406 kB/s | 19 kB 00:00 2026-02-12T17:26:48.931 INFO:teuthology.orchestra.run.trial082.stdout:(38/42): python3-more-itertools-8.12.0-2.el9.no 2.2 MB/s | 79 kB 00:00 2026-02-12T17:26:48.946 INFO:teuthology.orchestra.run.trial082.stdout:(39/42): python3-portend-3.1.0-2.el9.noarch.rpm 484 kB/s | 16 kB 00:00 2026-02-12T17:26:48.956 INFO:teuthology.orchestra.run.trial082.stdout:(40/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.8 MB/s | 90 kB 00:00 2026-02-12T17:26:48.966 INFO:teuthology.orchestra.run.trial082.stdout:(41/42): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2026-02-12T17:26:48.980 INFO:teuthology.orchestra.run.trial082.stdout:(42/42): python3-zc-lockfile-2.0-10.el9.noarch. 587 kB/s | 20 kB 00:00 2026-02-12T17:26:48.981 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:48.981 INFO:teuthology.orchestra.run.trial082.stdout:Total 14 MB/s | 48 MB 00:03 2026-02-12T17:26:49.044 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T17:26:49.045 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:49.045 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:26:49.045 INFO:teuthology.orchestra.run.trial057.stdout: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:49.045 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:49.045 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:26:49.073 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-mgr 2026-02-12T17:26:49.130 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:26:49.150 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:26:49.150 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:26:49.347 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:26:49.347 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:26:49.376 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:26:49.440 INFO:teuthology.orchestra.run.trial057.stdout:Package ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:26:49.457 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:49.458 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:26:49.458 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:26:49.479 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T17:26:49.578 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:26:49.581 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-12T17:26:49.585 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-12T17:26:49.590 INFO:teuthology.orchestra.run.trial082.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-12T17:26:49.592 INFO:teuthology.orchestra.run.trial082.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-12T17:26:49.598 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-12T17:26:49.622 INFO:teuthology.orchestra.run.trial082.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-12T17:26:49.625 INFO:teuthology.orchestra.run.trial082.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-12T17:26:49.630 INFO:teuthology.orchestra.run.trial082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-12T17:26:49.635 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-12T17:26:49.641 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-12T17:26:49.645 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-12T17:26:49.650 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-12T17:26:49.656 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-12T17:26:49.659 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-12T17:26:49.665 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-12T17:26:49.668 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-12T17:26:49.675 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-12T17:26:49.678 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-12T17:26:49.701 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-12T17:26:49.713 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-12T17:26:49.718 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-12T17:26:49.728 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-12T17:26:49.735 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T17:26:49.748 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-12T17:26:49.765 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-12T17:26:49.778 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:26:49.839 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-12T17:26:49.848 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-12T17:26:49.860 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:49.861 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:49.861 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-12T17:26:49.861 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:49.861 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:26:49.861 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 51 M 2026-02-12T17:26:49.861 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:26:49.861 INFO:teuthology.orchestra.run.trial057.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T17:26:49.861 INFO:teuthology.orchestra.run.trial057.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 57 k 2026-02-12T17:26:49.861 INFO:teuthology.orchestra.run.trial057.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 17 k 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:49.862 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:26:49.863 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:49.863 INFO:teuthology.orchestra.run.trial057.stdout:Install 13 Packages 2026-02-12T17:26:49.863 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:49.863 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 55 M 2026-02-12T17:26:49.864 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 262 M 2026-02-12T17:26:49.864 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:26:49.870 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-12T17:26:49.899 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-12T17:26:49.905 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-12T17:26:49.957 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-12T17:26:49.999 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 32/42 2026-02-12T17:26:50.000 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T17:26:50.025 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T17:26:50.025 INFO:teuthology.orchestra.run.trial082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:50.025 INFO:teuthology.orchestra.run.trial082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T17:26:50.025 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T17:26:50.025 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T17:26:50.026 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:50.031 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-12T17:26:50.049 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T17:26:50.049 INFO:teuthology.orchestra.run.trial082.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T17:26:50.049 INFO:teuthology.orchestra.run.trial082.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T17:26:50.049 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:50.057 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T17:26:50.081 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T17:26:50.082 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T17:26:50.082 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:50.174 INFO:teuthology.orchestra.run.trial057.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5230.gafe 264 kB/s | 17 kB 00:00 2026-02-12T17:26:50.186 INFO:teuthology.orchestra.run.trial057.stdout:(2/13): ceph-grafana-dashboards-20.3.0-5230.gaf 728 kB/s | 57 kB 00:00 2026-02-12T17:26:50.671 INFO:teuthology.orchestra.run.trial057.stdout:(3/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 96 kB/s | 48 kB 00:00 2026-02-12T17:26:50.714 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-12T17:26:50.748 INFO:teuthology.orchestra.run.trial057.stdout:(4/13): protobuf-compiler-3.14.0-17.el9.x86_64. 11 MB/s | 862 kB 00:00 2026-02-12T17:26:50.914 INFO:teuthology.orchestra.run.trial057.stdout:(5/13): python3-protobuf-3.14.0-17.el9.noarch.r 368 kB/s | 267 kB 00:00 2026-02-12T17:26:50.960 INFO:teuthology.orchestra.run.trial057.stdout:(6/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.5 MB/s | 551 kB 00:00 2026-02-12T17:26:50.961 INFO:teuthology.orchestra.run.trial057.stdout:(7/13): grpc-data-1.46.7-10.el9.noarch.rpm 422 kB/s | 19 kB 00:00 2026-02-12T17:26:51.136 INFO:teuthology.orchestra.run.trial057.stdout:(8/13): ceph-mgr-dashboard-20.3.0-5230.gafefaa4 49 MB/s | 51 MB 00:01 2026-02-12T17:26:51.139 INFO:teuthology.orchestra.run.trial057.stdout:(9/13): python3-grpcio-1.46.7-10.el9.x86_64.rpm 11 MB/s | 2.0 MB 00:00 2026-02-12T17:26:51.139 INFO:teuthology.orchestra.run.trial057.stdout:(10/13): python3-grpcio-tools-1.46.7-10.el9.x86 808 kB/s | 144 kB 00:00 2026-02-12T17:26:51.156 INFO:teuthology.orchestra.run.trial057.stdout:(11/13): python3-repoze-lru-0.7-16.el9.noarch.r 1.5 MB/s | 31 kB 00:00 2026-02-12T17:26:51.161 INFO:teuthology.orchestra.run.trial057.stdout:(12/13): python3-routes-2.5.1-5.el9.noarch.rpm 8.6 MB/s | 188 kB 00:00 2026-02-12T17:26:51.164 INFO:teuthology.orchestra.run.trial057.stdout:(13/13): python3-xmltodict-0.12.0-15.el9.noarch 908 kB/s | 22 kB 00:00 2026-02-12T17:26:51.167 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:51.167 INFO:teuthology.orchestra.run.trial057.stdout:Total 42 MB/s | 55 MB 00:01 2026-02-12T17:26:51.193 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:26:51.202 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:26:51.203 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:26:51.415 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:26:51.416 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:26:51.471 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 37/42 2026-02-12T17:26:51.481 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 38/42 2026-02-12T17:26:51.482 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T17:26:51.508 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T17:26:51.508 INFO:teuthology.orchestra.run.trial082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:51.508 INFO:teuthology.orchestra.run.trial082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T17:26:51.508 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T17:26:51.508 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T17:26:51.508 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:51.642 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:26:51.647 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-12T17:26:51.659 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-12T17:26:51.661 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-12T17:26:51.688 INFO:teuthology.orchestra.run.trial057.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-12T17:26:51.720 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T17:26:51.731 INFO:teuthology.orchestra.run.trial057.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-12T17:26:51.740 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-12T17:26:51.741 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T17:26:51.741 INFO:teuthology.orchestra.run.trial082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:51.741 INFO:teuthology.orchestra.run.trial082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T17:26:51.741 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T17:26:51.741 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T17:26:51.741 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:51.767 INFO:teuthology.orchestra.run.trial057.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-12T17:26:51.777 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-12T17:26:51.784 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-12T17:26:51.787 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-12T17:26:51.796 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 11/13 2026-02-12T17:26:51.836 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T17:26:51.857 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T17:26:51.857 INFO:teuthology.orchestra.run.trial082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:51.857 INFO:teuthology.orchestra.run.trial082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T17:26:51.857 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T17:26:51.858 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T17:26:51.858 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:51.858 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T17:26:51.866 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T17:26:51.889 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T17:26:52.262 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T17:26:52.262 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 1/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 3/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 4/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 5/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 6/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 7/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 8/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-12T17:26:52.263 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-12T17:26:52.264 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-12T17:26:52.265 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-12T17:26:52.266 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-12T17:26:52.318 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-12T17:26:52.318 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:52.318 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T17:26:52.319 INFO:teuthology.orchestra.run.trial082.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T17:26:52.320 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T17:26:52.321 INFO:teuthology.orchestra.run.trial082.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T17:26:52.322 INFO:teuthology.orchestra.run.trial082.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T17:26:52.322 INFO:teuthology.orchestra.run.trial082.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T17:26:52.322 INFO:teuthology.orchestra.run.trial082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T17:26:52.322 INFO:teuthology.orchestra.run.trial082.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T17:26:52.322 INFO:teuthology.orchestra.run.trial082.stdout: zip-3.0-35.el9.x86_64 2026-02-12T17:26:52.322 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:52.322 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:26:52.356 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-base 2026-02-12T17:26:52.655 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:00:27 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:26:52.718 INFO:teuthology.orchestra.run.trial082.stdout:Package ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:26:52.736 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:26:52.736 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:26:52.737 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:26:52.757 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install cephadm 2026-02-12T17:26:53.053 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:26:53.135 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:26:53.136 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:53.136 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repository Size 2026-02-12T17:26:53.136 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:53.136 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:26:53.136 INFO:teuthology.orchestra.run.trial082.stdout: cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 1.0 M 2026-02-12T17:26:53.136 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:53.136 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:26:53.137 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:53.137 INFO:teuthology.orchestra.run.trial082.stdout:Install 1 Package 2026-02-12T17:26:53.137 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:53.137 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 1.0 M 2026-02-12T17:26:53.137 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 1.0 M 2026-02-12T17:26:53.137 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:26:53.255 INFO:teuthology.orchestra.run.trial082.stdout:cephadm-20.3.0-5230.gafefaa40.el9.noarch.rpm 8.5 MB/s | 1.0 MB 00:00 2026-02-12T17:26:53.256 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:53.256 INFO:teuthology.orchestra.run.trial082.stdout:Total 8.4 MB/s | 1.0 MB 00:00 2026-02-12T17:26:53.256 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:26:53.259 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:26:53.259 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:26:53.263 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:26:53.263 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:26:53.281 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:26:53.344 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T17:26:53.358 INFO:teuthology.orchestra.run.trial082.stdout: Installing : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T17:26:53.419 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T17:26:53.472 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T17:26:53.472 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:53.472 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:26:53.472 INFO:teuthology.orchestra.run.trial082.stdout: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:26:53.472 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:53.472 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:26:53.499 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T17:26:53.793 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:26:53.875 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:26:53.876 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:53.876 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repo Size 2026-02-12T17:26:53.876 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:53.876 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:26:53.877 INFO:teuthology.orchestra.run.trial082.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 147 k 2026-02-12T17:26:53.877 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:53.877 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:26:53.877 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:53.877 INFO:teuthology.orchestra.run.trial082.stdout:Install 1 Package 2026-02-12T17:26:53.877 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:53.877 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 147 k 2026-02-12T17:26:53.877 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 419 k 2026-02-12T17:26:53.877 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:26:53.962 INFO:teuthology.orchestra.run.trial082.stdout:ceph-immutable-object-cache-20.3.0-5230.gafefaa 1.7 MB/s | 147 kB 00:00 2026-02-12T17:26:53.962 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:53.963 INFO:teuthology.orchestra.run.trial082.stdout:Total 1.7 MB/s | 147 kB 00:00 2026-02-12T17:26:53.963 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:26:53.966 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:26:53.967 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:26:53.993 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:26:53.993 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:26:54.042 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:26:54.043 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T17:26:54.066 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T17:26:54.066 INFO:teuthology.orchestra.run.trial082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:26:54.067 INFO:teuthology.orchestra.run.trial082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T17:26:54.067 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:54.343 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T17:26:54.343 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:54.344 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:26:54.344 INFO:teuthology.orchestra.run.trial082.stdout: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:26:54.344 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:54.344 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:26:54.371 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-mgr 2026-02-12T17:26:54.664 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:26:54.693 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 12/13 2026-02-12T17:26:54.699 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T17:26:54.728 INFO:teuthology.orchestra.run.trial082.stdout:Package ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:26:54.745 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:26:54.746 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:26:54.746 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:26:54.767 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T17:26:54.956 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T17:26:54.956 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 1/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 2/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 3/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-12T17:26:54.957 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-12T17:26:55.011 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-12T17:26:55.011 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:55.011 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:26:55.011 INFO:teuthology.orchestra.run.trial057.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T17:26:55.011 INFO:teuthology.orchestra.run.trial057.stdout: ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:26:55.011 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:55.012 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:26:55.048 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T17:26:55.063 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:00:30 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:26:55.145 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:26:55.145 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:55.145 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repository Size 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 51 M 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 57 k 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 17 k 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T17:26:55.146 INFO:teuthology.orchestra.run.trial082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout:Install 13 Packages 2026-02-12T17:26:55.147 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:26:55.148 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 55 M 2026-02-12T17:26:55.148 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 262 M 2026-02-12T17:26:55.148 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:26:55.347 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:34 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:26:55.430 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout:======================================================================================= 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout:======================================================================================= 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 7.4 M 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T17:26:55.431 INFO:teuthology.orchestra.run.trial057.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout:======================================================================================= 2026-02-12T17:26:55.432 INFO:teuthology.orchestra.run.trial057.stdout:Install 12 Packages 2026-02-12T17:26:55.433 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:55.434 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 43 M 2026-02-12T17:26:55.434 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 234 M 2026-02-12T17:26:55.434 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:26:55.782 INFO:teuthology.orchestra.run.trial082.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5230.gafe 250 kB/s | 17 kB 00:00 2026-02-12T17:26:55.782 INFO:teuthology.orchestra.run.trial057.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 7.2 MB/s | 184 kB 00:00 2026-02-12T17:26:55.784 INFO:teuthology.orchestra.run.trial082.stdout:(2/13): ceph-grafana-dashboards-20.3.0-5230.gaf 785 kB/s | 57 kB 00:00 2026-02-12T17:26:55.788 INFO:teuthology.orchestra.run.trial057.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 24 MB/s | 794 kB 00:00 2026-02-12T17:26:55.808 INFO:teuthology.orchestra.run.trial057.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 33 kB 00:00 2026-02-12T17:26:55.816 INFO:teuthology.orchestra.run.trial057.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 2.1 MB/s | 18 kB 00:00 2026-02-12T17:26:55.826 INFO:teuthology.orchestra.run.trial057.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 4.2 MB/s | 42 kB 00:00 2026-02-12T17:26:55.863 INFO:teuthology.orchestra.run.trial057.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 40 MB/s | 3.0 MB 00:00 2026-02-12T17:26:55.875 INFO:teuthology.orchestra.run.trial057.stdout:(7/12): python3-devel-3.9.25-2.el9.x86_64.rpm 21 MB/s | 244 kB 00:00 2026-02-12T17:26:55.885 INFO:teuthology.orchestra.run.trial057.stdout:(8/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 90 MB/s | 5.3 MB 00:00 2026-02-12T17:26:55.898 INFO:teuthology.orchestra.run.trial057.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 36 MB/s | 442 kB 00:00 2026-02-12T17:26:55.909 INFO:teuthology.orchestra.run.trial057.stdout:(10/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 182 MB/s | 6.1 MB 00:00 2026-02-12T17:26:55.990 INFO:teuthology.orchestra.run.trial057.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 209 MB/s | 19 MB 00:00 2026-02-12T17:26:56.371 INFO:teuthology.orchestra.run.trial082.stdout:(3/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 81 kB/s | 48 kB 00:00 2026-02-12T17:26:56.556 INFO:teuthology.orchestra.run.trial082.stdout:(4/13): python3-protobuf-3.14.0-17.el9.noarch.r 347 kB/s | 267 kB 00:00 2026-02-12T17:26:56.567 INFO:teuthology.orchestra.run.trial082.stdout:(5/13): protobuf-compiler-3.14.0-17.el9.x86_64. 4.3 MB/s | 862 kB 00:00 2026-02-12T17:26:56.591 INFO:teuthology.orchestra.run.trial057.stdout:(12/12): ceph-mgr-diskprediction-local-20.3.0-5 8.9 MB/s | 7.4 MB 00:00 2026-02-12T17:26:56.592 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:56.592 INFO:teuthology.orchestra.run.trial057.stdout:Total 37 MB/s | 43 MB 00:01 2026-02-12T17:26:56.751 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:26:56.753 INFO:teuthology.orchestra.run.trial082.stdout:(6/13): grpc-data-1.46.7-10.el9.noarch.rpm 104 kB/s | 19 kB 00:00 2026-02-12T17:26:56.765 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:26:56.765 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:26:56.872 INFO:teuthology.orchestra.run.trial082.stdout:(7/13): ceph-mgr-dashboard-20.3.0-5230.gafefaa4 44 MB/s | 51 MB 00:01 2026-02-12T17:26:56.967 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:26:56.968 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:26:57.075 INFO:teuthology.orchestra.run.trial082.stdout:(8/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-12T17:26:57.138 INFO:teuthology.orchestra.run.trial082.stdout:(9/13): python3-repoze-lru-0.7-16.el9.noarch.rp 483 kB/s | 31 kB 00:00 2026-02-12T17:26:57.183 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:26:57.186 INFO:teuthology.orchestra.run.trial057.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2026-02-12T17:26:57.192 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-12T17:26:57.214 INFO:teuthology.orchestra.run.trial082.stdout:(10/13): python3-grpcio-tools-1.46.7-10.el9.x86 422 kB/s | 144 kB 00:00 2026-02-12T17:26:57.215 INFO:teuthology.orchestra.run.trial082.stdout:(11/13): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2026-02-12T17:26:57.225 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-12T17:26:57.230 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 4/12 2026-02-12T17:26:57.262 INFO:teuthology.orchestra.run.trial082.stdout:(12/13): python3-grpcio-1.46.7-10.el9.x86_64.rp 4.0 MB/s | 2.0 MB 00:00 2026-02-12T17:26:57.282 INFO:teuthology.orchestra.run.trial082.stdout:(13/13): python3-xmltodict-0.12.0-15.el9.noarch 327 kB/s | 22 kB 00:00 2026-02-12T17:26:57.283 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:26:57.284 INFO:teuthology.orchestra.run.trial082.stdout:Total 26 MB/s | 55 MB 00:02 2026-02-12T17:26:57.289 INFO:teuthology.orchestra.run.trial057.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-12T17:26:57.291 INFO:teuthology.orchestra.run.trial057.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-12T17:26:57.310 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:26:57.312 INFO:teuthology.orchestra.run.trial057.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2026-02-12T17:26:57.320 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:26:57.320 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:26:57.531 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:26:57.531 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:26:57.630 INFO:teuthology.orchestra.run.trial057.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2026-02-12T17:26:57.701 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-12T17:26:57.757 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:26:57.762 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-12T17:26:57.773 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-12T17:26:57.776 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-12T17:26:57.803 INFO:teuthology.orchestra.run.trial082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-12T17:26:57.846 INFO:teuthology.orchestra.run.trial082.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-12T17:26:57.855 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-12T17:26:57.882 INFO:teuthology.orchestra.run.trial082.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-12T17:26:57.892 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-12T17:26:57.899 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-12T17:26:57.902 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-12T17:26:57.911 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 11/13 2026-02-12T17:26:58.358 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T17:26:58.815 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-12T17:26:58.816 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T17:26:59.091 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T17:26:59.091 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 1/12 2026-02-12T17:26:59.091 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-12T17:26:59.091 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-12T17:26:59.091 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2026-02-12T17:26:59.091 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2026-02-12T17:26:59.091 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2026-02-12T17:26:59.091 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-12T17:26:59.092 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-12T17:26:59.092 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 9/12 2026-02-12T17:26:59.092 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T17:26:59.092 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-12T17:26:59.148 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-12T17:26:59.148 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:59.148 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:26:59.148 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:26:59.148 INFO:teuthology.orchestra.run.trial057.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:59.149 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:26:59.188 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-mgr-rook 2026-02-12T17:26:59.495 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:38 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:26:59.578 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:26:59.579 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:59.579 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-12T17:26:59.579 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:59.579 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:26:59.579 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-rook noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 50 k 2026-02-12T17:26:59.579 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:26:59.579 INFO:teuthology.orchestra.run.trial057.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:26:59.580 INFO:teuthology.orchestra.run.trial057.stdout:Install 10 Packages 2026-02-12T17:26:59.581 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:26:59.581 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 2.0 M 2026-02-12T17:26:59.581 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 25 M 2026-02-12T17:26:59.581 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:27:00.061 INFO:teuthology.orchestra.run.trial057.stdout:(1/10): ceph-mgr-rook-20.3.0-5230.gafefaa40.el9 694 kB/s | 50 kB 00:00 2026-02-12T17:27:00.389 INFO:teuthology.orchestra.run.trial057.stdout:(2/10): python3-requests-oauthlib-1.3.0-12.el9. 164 kB/s | 54 kB 00:00 2026-02-12T17:27:00.448 INFO:teuthology.orchestra.run.trial057.stdout:(3/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 346 kB/s | 159 kB 00:00 2026-02-12T17:27:00.511 INFO:teuthology.orchestra.run.trial057.stdout:(4/10): python3-pyasn1-modules-0.4.8-6.el9.noar 534 kB/s | 279 kB 00:00 2026-02-12T17:27:00.542 INFO:teuthology.orchestra.run.trial057.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 210 kB/s | 32 kB 00:00 2026-02-12T17:27:00.552 INFO:teuthology.orchestra.run.trial057.stdout:(6/10): python3-certifi-2023.05.07-4.el9.noarch 136 kB/s | 14 kB 00:00 2026-02-12T17:27:00.570 INFO:teuthology.orchestra.run.trial057.stdout:(7/10): python3-kubernetes-26.1.0-3.el9.noarch. 37 MB/s | 1.0 MB 00:00 2026-02-12T17:27:00.571 INFO:teuthology.orchestra.run.trial057.stdout:(8/10): python3-google-auth-2.45.0-1.el9.noarch 4.1 MB/s | 254 kB 00:00 2026-02-12T17:27:00.611 INFO:teuthology.orchestra.run.trial057.stdout:(9/10): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2026-02-12T17:27:00.630 INFO:teuthology.orchestra.run.trial057.stdout:(10/10): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2026-02-12T17:27:00.631 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:00.632 INFO:teuthology.orchestra.run.trial057.stdout:Total 1.9 MB/s | 2.0 MB 00:01 2026-02-12T17:27:00.660 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:27:00.668 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:27:00.668 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:27:00.708 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:27:00.708 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:27:00.783 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:27:00.815 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 12/13 2026-02-12T17:27:00.822 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T17:27:00.833 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-12T17:27:00.846 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-12T17:27:00.860 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-12T17:27:00.865 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-12T17:27:00.872 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-12T17:27:00.911 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-12T17:27:00.923 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T17:27:01.110 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T17:27:01.110 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 1/13 2026-02-12T17:27:01.110 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 2/13 2026-02-12T17:27:01.110 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 3/13 2026-02-12T17:27:01.110 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-12T17:27:01.110 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-12T17:27:01.111 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-12T17:27:01.111 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-12T17:27:01.111 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-12T17:27:01.111 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-12T17:27:01.111 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-12T17:27:01.111 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-12T17:27:01.111 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-12T17:27:01.163 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T17:27:01.164 INFO:teuthology.orchestra.run.trial082.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T17:27:01.165 INFO:teuthology.orchestra.run.trial082.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T17:27:01.165 INFO:teuthology.orchestra.run.trial082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T17:27:01.165 INFO:teuthology.orchestra.run.trial082.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T17:27:01.165 INFO:teuthology.orchestra.run.trial082.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T17:27:01.165 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:01.165 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:01.201 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T17:27:01.238 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-12T17:27:01.252 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-12T17:27:01.253 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T17:27:01.361 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T17:27:01.361 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 1/10 2026-02-12T17:27:01.362 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-12T17:27:01.362 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-12T17:27:01.362 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-12T17:27:01.362 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-12T17:27:01.362 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-12T17:27:01.362 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T17:27:01.362 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-12T17:27:01.362 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-12T17:27:01.417 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-12T17:27:01.417 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:01.417 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:27:01.417 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:01.418 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:01.447 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T17:27:01.498 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:00:36 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:01.581 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:01.581 INFO:teuthology.orchestra.run.trial082.stdout:======================================================================================= 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repository Size 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout:======================================================================================= 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 7.4 M 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T17:27:01.582 INFO:teuthology.orchestra.run.trial082.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout:======================================================================================= 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout:Install 12 Packages 2026-02-12T17:27:01.583 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:01.584 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 43 M 2026-02-12T17:27:01.584 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 234 M 2026-02-12T17:27:01.584 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:01.745 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:01.771 INFO:teuthology.orchestra.run.trial082.stdout:(1/12): libgfortran-11.5.0-14.el9.x86_64.rpm 12 MB/s | 794 kB 00:00 2026-02-12T17:27:01.772 INFO:teuthology.orchestra.run.trial082.stdout:(2/12): libquadmath-11.5.0-14.el9.x86_64.rpm 2.7 MB/s | 184 kB 00:00 2026-02-12T17:27:01.828 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:01.829 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:01.829 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-12T17:27:01.829 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:01.829 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:27:01.829 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 184 k 2026-02-12T17:27:01.829 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:27:01.829 INFO:teuthology.orchestra.run.trial057.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout:Install 7 Packages 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 7.1 M 2026-02-12T17:27:01.830 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 34 M 2026-02-12T17:27:01.831 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:27:01.933 INFO:teuthology.orchestra.run.trial082.stdout:(3/12): ceph-mgr-diskprediction-local-20.3.0-52 33 MB/s | 7.4 MB 00:00 2026-02-12T17:27:02.309 INFO:teuthology.orchestra.run.trial082.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 61 kB/s | 33 kB 00:00 2026-02-12T17:27:02.378 INFO:teuthology.orchestra.run.trial057.stdout:(1/7): ceph-mgr-cephadm-20.3.0-5230.gafefaa40.e 2.1 MB/s | 184 kB 00:00 2026-02-12T17:27:02.396 INFO:teuthology.orchestra.run.trial082.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 39 kB/s | 18 kB 00:00 2026-02-12T17:27:02.458 INFO:teuthology.orchestra.run.trial057.stdout:(2/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-12T17:27:02.462 INFO:teuthology.orchestra.run.trial082.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 276 kB/s | 42 kB 00:00 2026-02-12T17:27:02.475 INFO:teuthology.orchestra.run.trial057.stdout:(3/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 359 kB/s | 35 kB 00:00 2026-02-12T17:27:02.492 INFO:teuthology.orchestra.run.trial057.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 3.3 MB/s | 58 kB 00:00 2026-02-12T17:27:02.494 INFO:teuthology.orchestra.run.trial057.stdout:(5/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 15 MB/s | 548 kB 00:00 2026-02-12T17:27:02.501 INFO:teuthology.orchestra.run.trial057.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 9.4 MB/s | 86 kB 00:00 2026-02-12T17:27:02.619 INFO:teuthology.orchestra.run.trial057.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2026-02-12T17:27:02.619 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:02.619 INFO:teuthology.orchestra.run.trial057.stdout:Total 9.0 MB/s | 7.1 MB 00:00 2026-02-12T17:27:02.657 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:27:02.663 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:27:02.663 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:27:02.735 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:27:02.735 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:27:02.826 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:27:02.874 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-12T17:27:02.884 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-12T17:27:02.890 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-12T17:27:02.920 INFO:teuthology.orchestra.run.trial082.stdout:(7/12): python3-devel-3.9.25-2.el9.x86_64.rpm 534 kB/s | 244 kB 00:00 2026-02-12T17:27:03.109 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T17:27:03.132 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-12T17:27:03.156 INFO:teuthology.orchestra.run.trial057.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-12T17:27:03.158 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T17:27:03.268 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T17:27:03.269 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/7 2026-02-12T17:27:03.269 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-12T17:27:03.269 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-12T17:27:03.269 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T17:27:03.269 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-12T17:27:03.269 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-12T17:27:03.325 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-12T17:27:03.325 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:03.325 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:27:03.325 INFO:teuthology.orchestra.run.trial057.stdout: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:27:03.325 INFO:teuthology.orchestra.run.trial057.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T17:27:03.325 INFO:teuthology.orchestra.run.trial057.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T17:27:03.326 INFO:teuthology.orchestra.run.trial057.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T17:27:03.326 INFO:teuthology.orchestra.run.trial057.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T17:27:03.326 INFO:teuthology.orchestra.run.trial057.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T17:27:03.326 INFO:teuthology.orchestra.run.trial057.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T17:27:03.326 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:03.326 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:03.356 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-osd 2026-02-12T17:27:03.653 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:03.718 INFO:teuthology.orchestra.run.trial057.stdout:Package ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:03.736 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:03.737 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:27:03.737 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:03.758 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-osd-classic 2026-02-12T17:27:04.061 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:04.125 INFO:teuthology.orchestra.run.trial057.stdout:Package ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:04.144 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:04.144 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:27:04.144 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:04.165 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-fuse 2026-02-12T17:27:04.473 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:04.556 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:04.557 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:04.557 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repo Size 2026-02-12T17:27:04.557 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:04.557 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:27:04.558 INFO:teuthology.orchestra.run.trial057.stdout: ceph-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 987 k 2026-02-12T17:27:04.558 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:04.558 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:27:04.558 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:04.558 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-12T17:27:04.558 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:04.558 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 987 k 2026-02-12T17:27:04.558 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 2.9 M 2026-02-12T17:27:04.558 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:27:04.883 INFO:teuthology.orchestra.run.trial057.stdout:ceph-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 3.0 MB/s | 987 kB 00:00 2026-02-12T17:27:04.884 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:04.884 INFO:teuthology.orchestra.run.trial057.stdout:Total 2.9 MB/s | 987 kB 00:00 2026-02-12T17:27:04.885 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:27:04.890 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:27:04.890 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:27:04.926 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:27:04.926 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:27:05.020 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:27:05.036 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:05.271 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:05.327 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:05.327 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:05.328 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:27:05.328 INFO:teuthology.orchestra.run.trial057.stdout: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:05.328 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:05.328 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:05.355 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install ceph-volume 2026-02-12T17:27:05.658 INFO:teuthology.orchestra.run.trial082.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 788 kB/s | 3.0 MB 00:03 2026-02-12T17:27:05.661 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:44 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:05.744 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:05.745 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:05.745 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repository Size 2026-02-12T17:27:05.745 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:05.745 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:27:05.745 INFO:teuthology.orchestra.run.trial057.stdout: ceph-volume noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 299 k 2026-02-12T17:27:05.745 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:27:05.746 INFO:teuthology.orchestra.run.trial057.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T17:27:05.746 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:05.746 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:27:05.746 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:05.746 INFO:teuthology.orchestra.run.trial057.stdout:Install 2 Packages 2026-02-12T17:27:05.746 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:05.746 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 649 k 2026-02-12T17:27:05.747 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 2.2 M 2026-02-12T17:27:05.747 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:27:06.100 INFO:teuthology.orchestra.run.trial057.stdout:(1/2): cryptsetup-2.8.1-2.el9.x86_64.rpm 6.9 MB/s | 350 kB 00:00 2026-02-12T17:27:06.146 INFO:teuthology.orchestra.run.trial057.stdout:(2/2): ceph-volume-20.3.0-5230.gafefaa40.el9.no 3.1 MB/s | 299 kB 00:00 2026-02-12T17:27:06.146 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:06.146 INFO:teuthology.orchestra.run.trial057.stdout:Total 1.6 MB/s | 649 kB 00:00 2026-02-12T17:27:06.155 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:27:06.161 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:27:06.161 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:27:06.204 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:27:06.205 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:27:06.266 INFO:teuthology.orchestra.run.trial082.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 727 kB/s | 442 kB 00:00 2026-02-12T17:27:06.285 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:27:06.348 INFO:teuthology.orchestra.run.trial057.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 1/2 2026-02-12T17:27:06.350 INFO:teuthology.orchestra.run.trial057.stdout: Installing : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T17:27:06.366 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T17:27:06.366 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:27:06.366 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T17:27:06.366 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:06.571 INFO:teuthology.orchestra.run.trial082.stdout:(10/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 1.7 MB/s | 6.1 MB 00:03 2026-02-12T17:27:06.596 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 1/2 2026-02-12T17:27:06.652 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 2/2 2026-02-12T17:27:06.653 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:06.653 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:27:06.653 INFO:teuthology.orchestra.run.trial057.stdout: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T17:27:06.653 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:06.653 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:06.682 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install librados-devel 2026-02-12T17:27:06.992 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:07.075 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:07.076 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:07.076 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repo Size 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout: librados-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 123 k 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 123 k 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 437 k 2026-02-12T17:27:07.077 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:27:07.234 INFO:teuthology.orchestra.run.trial057.stdout:librados-devel-20.3.0-5230.gafefaa40.el9.x86_64 782 kB/s | 123 kB 00:00 2026-02-12T17:27:07.234 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:07.234 INFO:teuthology.orchestra.run.trial057.stdout:Total 779 kB/s | 123 kB 00:00 2026-02-12T17:27:07.234 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:27:07.237 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:27:07.237 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:27:07.269 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:27:07.269 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:27:07.322 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:27:07.338 INFO:teuthology.orchestra.run.trial057.stdout: Installing : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:07.420 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:07.477 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:07.477 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:07.477 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:27:07.477 INFO:teuthology.orchestra.run.trial057.stdout: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:07.477 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:07.477 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:07.506 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install libcephfs2 2026-02-12T17:27:07.806 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:07.871 INFO:teuthology.orchestra.run.trial057.stdout:Package libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:07.889 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:07.889 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:27:07.890 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:07.911 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install libcephfs-devel 2026-02-12T17:27:08.219 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:47 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:08.303 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:08.304 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repo Size 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 37 k 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout:Installing dependencies: 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:08.305 INFO:teuthology.orchestra.run.trial057.stdout:Install 2 Packages 2026-02-12T17:27:08.306 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:08.306 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 62 k 2026-02-12T17:27:08.306 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 223 k 2026-02-12T17:27:08.306 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:27:08.367 INFO:teuthology.orchestra.run.trial057.stdout:(1/2): libcephfs-proxy2-20.3.0-5230.gafefaa40.e 400 kB/s | 25 kB 00:00 2026-02-12T17:27:08.369 INFO:teuthology.orchestra.run.trial057.stdout:(2/2): libcephfs-devel-20.3.0-5230.gafefaa40.el 580 kB/s | 37 kB 00:00 2026-02-12T17:27:08.370 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:08.370 INFO:teuthology.orchestra.run.trial057.stdout:Total 944 kB/s | 62 kB 00:00 2026-02-12T17:27:08.370 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:27:08.373 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:27:08.373 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:27:08.385 INFO:teuthology.orchestra.run.trial082.stdout:(11/12): openblas-openmp-0.3.29-1.el9.x86_64.rp 903 kB/s | 5.3 MB 00:05 2026-02-12T17:27:08.405 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:27:08.405 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:27:08.454 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:27:08.455 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T17:27:08.471 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T17:27:08.487 INFO:teuthology.orchestra.run.trial057.stdout: Installing : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T17:27:08.545 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T17:27:08.546 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T17:27:08.604 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T17:27:08.604 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:08.605 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:27:08.605 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:08.605 INFO:teuthology.orchestra.run.trial057.stdout: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:08.605 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:08.605 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:08.635 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install librados2 2026-02-12T17:27:08.938 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:47 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:09.004 INFO:teuthology.orchestra.run.trial057.stdout:Package librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:09.022 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:09.022 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:27:09.023 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:09.045 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install librbd1 2026-02-12T17:27:09.346 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:09.411 INFO:teuthology.orchestra.run.trial057.stdout:Package librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:09.429 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:09.430 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:27:09.430 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:09.451 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install python3-rados 2026-02-12T17:27:09.756 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:09.821 INFO:teuthology.orchestra.run.trial057.stdout:Package python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:09.839 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:09.839 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:27:09.840 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:09.860 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install python3-rgw 2026-02-12T17:27:10.159 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:10.224 INFO:teuthology.orchestra.run.trial057.stdout:Package python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:10.242 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:10.242 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:27:10.242 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:10.263 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install python3-cephfs 2026-02-12T17:27:10.566 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:10.632 INFO:teuthology.orchestra.run.trial057.stdout:Package python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:10.650 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:10.651 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:27:10.651 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:10.672 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install python3-rbd 2026-02-12T17:27:10.973 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:11.037 INFO:teuthology.orchestra.run.trial057.stdout:Package python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:11.056 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:11.056 INFO:teuthology.orchestra.run.trial057.stdout:Nothing to do. 2026-02-12T17:27:11.057 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:11.077 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install rbd-fuse 2026-02-12T17:27:11.378 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:50 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:11.461 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:11.462 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:11.462 INFO:teuthology.orchestra.run.trial057.stdout: Package Architecture Version Repository Size 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout: rbd-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 84 k 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 84 k 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 209 k 2026-02-12T17:27:11.463 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:27:11.536 INFO:teuthology.orchestra.run.trial057.stdout:rbd-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 1.1 MB/s | 84 kB 00:00 2026-02-12T17:27:11.537 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:11.537 INFO:teuthology.orchestra.run.trial057.stdout:Total 1.1 MB/s | 84 kB 00:00 2026-02-12T17:27:11.538 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:27:11.541 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:27:11.541 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:27:11.573 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:27:11.573 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:27:11.625 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:27:11.641 INFO:teuthology.orchestra.run.trial057.stdout: Installing : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:11.721 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:11.779 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:11.779 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:11.780 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:27:11.780 INFO:teuthology.orchestra.run.trial057.stdout: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:11.780 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:11.780 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:11.808 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install rbd-mirror 2026-02-12T17:27:12.110 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:51 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:12.194 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:12.194 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:12.194 INFO:teuthology.orchestra.run.trial057.stdout: Package Arch Version Repo Size 2026-02-12T17:27:12.194 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:12.194 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:27:12.194 INFO:teuthology.orchestra.run.trial057.stdout: rbd-mirror x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.9 M 2026-02-12T17:27:12.194 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:12.194 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:27:12.195 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:12.195 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-12T17:27:12.195 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:12.195 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 2.9 M 2026-02-12T17:27:12.195 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 11 M 2026-02-12T17:27:12.195 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:27:13.044 INFO:teuthology.orchestra.run.trial057.stdout:rbd-mirror-20.3.0-5230.gafefaa40.el9.x86_64.rpm 3.4 MB/s | 2.9 MB 00:00 2026-02-12T17:27:13.044 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:13.044 INFO:teuthology.orchestra.run.trial057.stdout:Total 3.4 MB/s | 2.9 MB 00:00 2026-02-12T17:27:13.044 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:27:13.049 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:27:13.049 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:27:13.088 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:27:13.089 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:27:13.265 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:27:13.267 INFO:teuthology.orchestra.run.trial057.stdout: Installing : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:13.289 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:13.289 INFO:teuthology.orchestra.run.trial057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:27:13.290 INFO:teuthology.orchestra.run.trial057.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T17:27:13.290 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T17:27:13.290 INFO:teuthology.orchestra.run.trial057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T17:27:13.290 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:13.610 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:13.610 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:13.610 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:27:13.610 INFO:teuthology.orchestra.run.trial057.stdout: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:13.610 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:13.611 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:13.638 DEBUG:teuthology.orchestra.run.trial057:> sudo yum -y install rbd-nbd 2026-02-12T17:27:13.940 INFO:teuthology.orchestra.run.trial057.stdout:Last metadata expiration check: 0:00:52 ago on Thu 12 Feb 2026 05:26:21 PM UTC. 2026-02-12T17:27:14.024 INFO:teuthology.orchestra.run.trial057.stdout:Dependencies resolved. 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout: Package Architecture Version Repository Size 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout:Installing: 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout: rbd-nbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 172 k 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout:Transaction Summary 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout:================================================================================ 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout:Install 1 Package 2026-02-12T17:27:14.025 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:14.026 INFO:teuthology.orchestra.run.trial057.stdout:Total download size: 172 k 2026-02-12T17:27:14.026 INFO:teuthology.orchestra.run.trial057.stdout:Installed size: 462 k 2026-02-12T17:27:14.026 INFO:teuthology.orchestra.run.trial057.stdout:Downloading Packages: 2026-02-12T17:27:14.109 INFO:teuthology.orchestra.run.trial057.stdout:rbd-nbd-20.3.0-5230.gafefaa40.el9.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2026-02-12T17:27:14.109 INFO:teuthology.orchestra.run.trial057.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:14.110 INFO:teuthology.orchestra.run.trial057.stdout:Total 2.0 MB/s | 172 kB 00:00 2026-02-12T17:27:14.110 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction check 2026-02-12T17:27:14.114 INFO:teuthology.orchestra.run.trial057.stdout:Transaction check succeeded. 2026-02-12T17:27:14.114 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction test 2026-02-12T17:27:14.146 INFO:teuthology.orchestra.run.trial057.stdout:Transaction test succeeded. 2026-02-12T17:27:14.146 INFO:teuthology.orchestra.run.trial057.stdout:Running transaction 2026-02-12T17:27:14.201 INFO:teuthology.orchestra.run.trial057.stdout: Preparing : 1/1 2026-02-12T17:27:14.217 INFO:teuthology.orchestra.run.trial057.stdout: Installing : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:14.305 INFO:teuthology.orchestra.run.trial057.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:14.362 INFO:teuthology.orchestra.run.trial057.stdout: Verifying : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:14.363 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:14.363 INFO:teuthology.orchestra.run.trial057.stdout:Installed: 2026-02-12T17:27:14.363 INFO:teuthology.orchestra.run.trial057.stdout: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:14.363 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:14.363 INFO:teuthology.orchestra.run.trial057.stdout:Complete! 2026-02-12T17:27:14.396 DEBUG:teuthology.parallel:result is None 2026-02-12T17:27:27.647 INFO:teuthology.orchestra.run.trial082.stdout:(12/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 923 kB/s | 19 MB 00:21 2026-02-12T17:27:27.650 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:27.651 INFO:teuthology.orchestra.run.trial082.stdout:Total 1.6 MB/s | 43 MB 00:26 2026-02-12T17:27:27.806 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:27.821 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:27.821 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:28.023 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:28.024 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:28.241 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:28.243 INFO:teuthology.orchestra.run.trial082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2026-02-12T17:27:28.250 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-12T17:27:28.283 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-12T17:27:28.288 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 4/12 2026-02-12T17:27:28.348 INFO:teuthology.orchestra.run.trial082.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-12T17:27:28.350 INFO:teuthology.orchestra.run.trial082.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-12T17:27:28.371 INFO:teuthology.orchestra.run.trial082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2026-02-12T17:27:28.695 INFO:teuthology.orchestra.run.trial082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2026-02-12T17:27:28.767 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-12T17:27:29.433 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T17:27:29.892 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-12T17:27:29.893 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T17:27:30.179 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T17:27:30.179 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 1/12 2026-02-12T17:27:30.179 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-12T17:27:30.180 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-12T17:27:30.180 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2026-02-12T17:27:30.180 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2026-02-12T17:27:30.180 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2026-02-12T17:27:30.180 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-12T17:27:30.180 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-12T17:27:30.180 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 9/12 2026-02-12T17:27:30.180 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T17:27:30.180 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-12T17:27:30.235 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-12T17:27:30.235 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:30.235 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:30.235 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:27:30.235 INFO:teuthology.orchestra.run.trial082.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T17:27:30.235 INFO:teuthology.orchestra.run.trial082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T17:27:30.235 INFO:teuthology.orchestra.run.trial082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T17:27:30.235 INFO:teuthology.orchestra.run.trial082.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T17:27:30.236 INFO:teuthology.orchestra.run.trial082.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T17:27:30.236 INFO:teuthology.orchestra.run.trial082.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T17:27:30.236 INFO:teuthology.orchestra.run.trial082.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T17:27:30.236 INFO:teuthology.orchestra.run.trial082.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T17:27:30.236 INFO:teuthology.orchestra.run.trial082.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T17:27:30.236 INFO:teuthology.orchestra.run.trial082.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T17:27:30.236 INFO:teuthology.orchestra.run.trial082.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T17:27:30.236 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:30.236 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:30.271 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-mgr-rook 2026-02-12T17:27:30.571 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:05 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:30.653 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repository Size 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-rook noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 50 k 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:Install 10 Packages 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 2.0 M 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 25 M 2026-02-12T17:27:30.654 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:30.864 INFO:teuthology.orchestra.run.trial082.stdout:(1/10): ceph-mgr-rook-20.3.0-5230.gafefaa40.el9 700 kB/s | 50 kB 00:00 2026-02-12T17:27:30.887 INFO:teuthology.orchestra.run.trial082.stdout:(2/10): python3-pyasn1-modules-0.4.8-6.el9.noar 2.9 MB/s | 279 kB 00:00 2026-02-12T17:27:30.887 INFO:teuthology.orchestra.run.trial082.stdout:(3/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2026-02-12T17:27:30.917 INFO:teuthology.orchestra.run.trial082.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 473 kB/s | 14 kB 00:00 2026-02-12T17:27:30.917 INFO:teuthology.orchestra.run.trial082.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 1.0 MB/s | 32 kB 00:00 2026-02-12T17:27:30.928 INFO:teuthology.orchestra.run.trial082.stdout:(6/10): python3-requests-oauthlib-1.3.0-12.el9. 841 kB/s | 54 kB 00:00 2026-02-12T17:27:30.946 INFO:teuthology.orchestra.run.trial082.stdout:(7/10): python3-google-auth-2.45.0-1.el9.noarch 8.6 MB/s | 254 kB 00:00 2026-02-12T17:27:30.953 INFO:teuthology.orchestra.run.trial082.stdout:(8/10): python3-kubernetes-26.1.0-3.el9.noarch. 29 MB/s | 1.0 MB 00:00 2026-02-12T17:27:30.955 INFO:teuthology.orchestra.run.trial082.stdout:(9/10): python3-rsa-4.9-2.el9.noarch.rpm 2.1 MB/s | 59 kB 00:00 2026-02-12T17:27:30.955 INFO:teuthology.orchestra.run.trial082.stdout:(10/10): python3-websocket-client-1.2.3-2.el9.n 9.7 MB/s | 90 kB 00:00 2026-02-12T17:27:30.956 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:30.956 INFO:teuthology.orchestra.run.trial082.stdout:Total 6.6 MB/s | 2.0 MB 00:00 2026-02-12T17:27:30.982 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:30.990 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:30.990 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:31.029 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:31.029 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:31.103 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:31.152 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-12T17:27:31.165 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-12T17:27:31.179 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-12T17:27:31.184 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-12T17:27:31.192 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-12T17:27:31.231 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-12T17:27:31.243 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T17:27:31.558 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-12T17:27:31.572 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-12T17:27:31.573 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 1/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-12T17:27:31.684 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:31.740 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:31.771 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T17:27:32.069 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:07 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:32.150 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repository Size 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 184 k 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:32.151 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:32.152 INFO:teuthology.orchestra.run.trial082.stdout:Install 7 Packages 2026-02-12T17:27:32.152 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:32.153 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 7.1 M 2026-02-12T17:27:32.153 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 34 M 2026-02-12T17:27:32.153 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:32.380 INFO:teuthology.orchestra.run.trial082.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.8 MB/s | 249 kB 00:00 2026-02-12T17:27:32.402 INFO:teuthology.orchestra.run.trial082.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 1.5 MB/s | 35 kB 00:00 2026-02-12T17:27:32.490 INFO:teuthology.orchestra.run.trial082.stdout:(3/7): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2026-02-12T17:27:32.597 INFO:teuthology.orchestra.run.trial082.stdout:(4/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.8 MB/s | 548 kB 00:00 2026-02-12T17:27:32.609 INFO:teuthology.orchestra.run.trial082.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 483 kB/s | 58 kB 00:00 2026-02-12T17:27:32.621 INFO:teuthology.orchestra.run.trial082.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 3.4 MB/s | 86 kB 00:00 2026-02-12T17:27:32.678 INFO:teuthology.orchestra.run.trial082.stdout:(7/7): ceph-mgr-cephadm-20.3.0-5230.gafefaa40.e 477 kB/s | 184 kB 00:00 2026-02-12T17:27:32.679 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:32.679 INFO:teuthology.orchestra.run.trial082.stdout:Total 13 MB/s | 7.1 MB 00:00 2026-02-12T17:27:32.720 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:32.726 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:32.726 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:32.797 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:32.797 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:32.886 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:32.935 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-12T17:27:32.944 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-12T17:27:32.950 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-12T17:27:33.170 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T17:27:33.193 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-12T17:27:33.217 INFO:teuthology.orchestra.run.trial082.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-12T17:27:33.219 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T17:27:33.327 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T17:27:33.327 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/7 2026-02-12T17:27:33.327 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-12T17:27:33.327 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-12T17:27:33.327 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T17:27:33.327 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-12T17:27:33.327 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-12T17:27:33.383 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-12T17:27:33.383 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:33.383 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:33.383 INFO:teuthology.orchestra.run.trial082.stdout: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T17:27:33.384 INFO:teuthology.orchestra.run.trial082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T17:27:33.384 INFO:teuthology.orchestra.run.trial082.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T17:27:33.384 INFO:teuthology.orchestra.run.trial082.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T17:27:33.384 INFO:teuthology.orchestra.run.trial082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T17:27:33.384 INFO:teuthology.orchestra.run.trial082.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T17:27:33.384 INFO:teuthology.orchestra.run.trial082.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T17:27:33.384 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:33.384 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:33.415 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-osd 2026-02-12T17:27:33.713 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:08 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:33.778 INFO:teuthology.orchestra.run.trial082.stdout:Package ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:33.797 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:33.798 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:27:33.798 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:33.818 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-osd-classic 2026-02-12T17:27:34.119 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:09 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:34.183 INFO:teuthology.orchestra.run.trial082.stdout:Package ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:34.201 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:34.202 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:27:34.202 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:34.223 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-fuse 2026-02-12T17:27:34.522 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:09 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:34.605 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:34.606 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:34.606 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repo Size 2026-02-12T17:27:34.606 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:34.606 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:34.606 INFO:teuthology.orchestra.run.trial082.stdout: ceph-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 987 k 2026-02-12T17:27:34.606 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:34.606 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:34.606 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:34.606 INFO:teuthology.orchestra.run.trial082.stdout:Install 1 Package 2026-02-12T17:27:34.607 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:34.607 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 987 k 2026-02-12T17:27:34.607 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 2.9 M 2026-02-12T17:27:34.607 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:34.825 INFO:teuthology.orchestra.run.trial082.stdout:ceph-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 4.4 MB/s | 987 kB 00:00 2026-02-12T17:27:34.825 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:34.825 INFO:teuthology.orchestra.run.trial082.stdout:Total 4.4 MB/s | 987 kB 00:00 2026-02-12T17:27:34.825 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:34.829 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:34.829 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:34.865 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:34.865 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:34.956 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:34.973 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:35.186 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:35.241 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:35.242 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:35.242 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:35.242 INFO:teuthology.orchestra.run.trial082.stdout: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:35.242 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:35.242 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:35.270 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install ceph-volume 2026-02-12T17:27:35.569 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:10 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:35.652 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:35.653 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:35.653 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repository Size 2026-02-12T17:27:35.653 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:35.653 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout: ceph-volume noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 299 k 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout:Install 2 Packages 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 649 k 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 2.2 M 2026-02-12T17:27:35.654 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:35.871 INFO:teuthology.orchestra.run.trial082.stdout:(1/2): ceph-volume-20.3.0-5230.gafefaa40.el9.no 2.8 MB/s | 299 kB 00:00 2026-02-12T17:27:36.563 INFO:teuthology.orchestra.run.trial082.stdout:(2/2): cryptsetup-2.8.1-2.el9.x86_64.rpm 439 kB/s | 350 kB 00:00 2026-02-12T17:27:36.564 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:36.564 INFO:teuthology.orchestra.run.trial082.stdout:Total 713 kB/s | 649 kB 00:00 2026-02-12T17:27:36.573 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:36.579 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:36.580 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:36.625 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:36.625 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:36.703 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:36.766 INFO:teuthology.orchestra.run.trial082.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 1/2 2026-02-12T17:27:36.768 INFO:teuthology.orchestra.run.trial082.stdout: Installing : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T17:27:36.784 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T17:27:36.784 INFO:teuthology.orchestra.run.trial082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:27:36.785 INFO:teuthology.orchestra.run.trial082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T17:27:36.785 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:37.009 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 1/2 2026-02-12T17:27:37.066 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 2/2 2026-02-12T17:27:37.066 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:37.066 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:37.067 INFO:teuthology.orchestra.run.trial082.stdout: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T17:27:37.067 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:37.067 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:37.099 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install librados-devel 2026-02-12T17:27:37.404 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:12 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:37.486 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:37.487 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:37.487 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repo Size 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout: librados-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 123 k 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout:Install 1 Package 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 123 k 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 437 k 2026-02-12T17:27:37.488 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:37.693 INFO:teuthology.orchestra.run.trial082.stdout:librados-devel-20.3.0-5230.gafefaa40.el9.x86_64 599 kB/s | 123 kB 00:00 2026-02-12T17:27:37.694 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:37.694 INFO:teuthology.orchestra.run.trial082.stdout:Total 597 kB/s | 123 kB 00:00 2026-02-12T17:27:37.694 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:37.696 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:37.697 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:37.728 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:37.728 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:37.781 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:37.797 INFO:teuthology.orchestra.run.trial082.stdout: Installing : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:37.880 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:37.937 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:37.937 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:37.938 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:37.938 INFO:teuthology.orchestra.run.trial082.stdout: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:37.938 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:37.938 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:37.966 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install libcephfs2 2026-02-12T17:27:38.270 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:13 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:38.336 INFO:teuthology.orchestra.run.trial082.stdout:Package libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:38.354 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:38.355 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:27:38.355 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:38.376 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install libcephfs-devel 2026-02-12T17:27:38.676 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:13 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:38.759 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:38.760 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:38.760 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repo Size 2026-02-12T17:27:38.760 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:38.760 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:38.760 INFO:teuthology.orchestra.run.trial082.stdout: libcephfs-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 37 k 2026-02-12T17:27:38.760 INFO:teuthology.orchestra.run.trial082.stdout:Installing dependencies: 2026-02-12T17:27:38.760 INFO:teuthology.orchestra.run.trial082.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T17:27:38.760 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:38.760 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:38.761 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:38.761 INFO:teuthology.orchestra.run.trial082.stdout:Install 2 Packages 2026-02-12T17:27:38.761 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:38.761 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 62 k 2026-02-12T17:27:38.761 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 223 k 2026-02-12T17:27:38.761 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:38.823 INFO:teuthology.orchestra.run.trial082.stdout:(1/2): libcephfs-proxy2-20.3.0-5230.gafefaa40.e 396 kB/s | 25 kB 00:00 2026-02-12T17:27:38.825 INFO:teuthology.orchestra.run.trial082.stdout:(2/2): libcephfs-devel-20.3.0-5230.gafefaa40.el 574 kB/s | 37 kB 00:00 2026-02-12T17:27:38.826 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:38.826 INFO:teuthology.orchestra.run.trial082.stdout:Total 930 kB/s | 62 kB 00:00 2026-02-12T17:27:38.826 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:38.829 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:38.829 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:38.861 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:38.861 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:38.909 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:38.910 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T17:27:38.924 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T17:27:38.940 INFO:teuthology.orchestra.run.trial082.stdout: Installing : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T17:27:38.998 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T17:27:38.998 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T17:27:39.055 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T17:27:39.055 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:39.055 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:39.055 INFO:teuthology.orchestra.run.trial082.stdout: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:39.055 INFO:teuthology.orchestra.run.trial082.stdout: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:39.055 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:39.055 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:39.082 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install librados2 2026-02-12T17:27:39.378 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:14 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:39.442 INFO:teuthology.orchestra.run.trial082.stdout:Package librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:39.461 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:39.461 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:27:39.461 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:39.482 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install librbd1 2026-02-12T17:27:39.780 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:14 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:39.844 INFO:teuthology.orchestra.run.trial082.stdout:Package librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:39.862 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:39.863 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:27:39.863 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:39.884 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install python3-rados 2026-02-12T17:27:40.182 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:15 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:40.246 INFO:teuthology.orchestra.run.trial082.stdout:Package python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:40.265 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:40.265 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:27:40.265 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:40.288 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install python3-rgw 2026-02-12T17:27:40.586 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:15 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:40.650 INFO:teuthology.orchestra.run.trial082.stdout:Package python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:40.669 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:40.669 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:27:40.669 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:40.691 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install python3-cephfs 2026-02-12T17:27:40.994 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:15 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:41.060 INFO:teuthology.orchestra.run.trial082.stdout:Package python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:41.079 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:41.079 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:27:41.079 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:41.101 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install python3-rbd 2026-02-12T17:27:41.395 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:16 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:41.460 INFO:teuthology.orchestra.run.trial082.stdout:Package python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T17:27:41.478 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:41.479 INFO:teuthology.orchestra.run.trial082.stdout:Nothing to do. 2026-02-12T17:27:41.479 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:41.499 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install rbd-fuse 2026-02-12T17:27:41.800 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:16 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:41.884 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:41.885 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:41.885 INFO:teuthology.orchestra.run.trial082.stdout: Package Architecture Version Repository Size 2026-02-12T17:27:41.885 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:41.885 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:41.885 INFO:teuthology.orchestra.run.trial082.stdout: rbd-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 84 k 2026-02-12T17:27:41.885 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:41.885 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:41.885 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:41.885 INFO:teuthology.orchestra.run.trial082.stdout:Install 1 Package 2026-02-12T17:27:41.886 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:41.886 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 84 k 2026-02-12T17:27:41.886 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 209 k 2026-02-12T17:27:41.886 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:41.960 INFO:teuthology.orchestra.run.trial082.stdout:rbd-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 1.1 MB/s | 84 kB 00:00 2026-02-12T17:27:41.960 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:41.960 INFO:teuthology.orchestra.run.trial082.stdout:Total 1.1 MB/s | 84 kB 00:00 2026-02-12T17:27:41.960 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:41.964 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:41.964 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:41.995 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:41.995 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:42.045 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:42.062 INFO:teuthology.orchestra.run.trial082.stdout: Installing : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:42.140 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:42.196 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:42.196 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:42.196 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:42.197 INFO:teuthology.orchestra.run.trial082.stdout: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:42.197 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:42.197 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:42.226 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install rbd-mirror 2026-02-12T17:27:42.524 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:17 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:42.607 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:42.607 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout: Package Arch Version Repo Size 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout: rbd-mirror x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.9 M 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout:Install 1 Package 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 2.9 M 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 11 M 2026-02-12T17:27:42.608 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:42.811 INFO:teuthology.orchestra.run.trial082.stdout:rbd-mirror-20.3.0-5230.gafefaa40.el9.x86_64.rpm 14 MB/s | 2.9 MB 00:00 2026-02-12T17:27:42.811 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:42.811 INFO:teuthology.orchestra.run.trial082.stdout:Total 14 MB/s | 2.9 MB 00:00 2026-02-12T17:27:42.812 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:42.817 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:42.817 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:42.856 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:42.856 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:43.033 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:43.035 INFO:teuthology.orchestra.run.trial082.stdout: Installing : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:43.058 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:43.058 INFO:teuthology.orchestra.run.trial082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T17:27:43.058 INFO:teuthology.orchestra.run.trial082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T17:27:43.058 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T17:27:43.058 INFO:teuthology.orchestra.run.trial082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T17:27:43.058 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:43.366 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:43.367 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:43.367 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:43.367 INFO:teuthology.orchestra.run.trial082.stdout: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:43.367 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:43.367 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:43.393 DEBUG:teuthology.orchestra.run.trial082:> sudo yum -y install rbd-nbd 2026-02-12T17:27:43.693 INFO:teuthology.orchestra.run.trial082.stdout:Last metadata expiration check: 0:01:18 ago on Thu 12 Feb 2026 05:26:25 PM UTC. 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout:Dependencies resolved. 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout: Package Architecture Version Repository Size 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout:Installing: 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout: rbd-nbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 172 k 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout:Transaction Summary 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout:================================================================================ 2026-02-12T17:27:43.776 INFO:teuthology.orchestra.run.trial082.stdout:Install 1 Package 2026-02-12T17:27:43.777 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:43.777 INFO:teuthology.orchestra.run.trial082.stdout:Total download size: 172 k 2026-02-12T17:27:43.777 INFO:teuthology.orchestra.run.trial082.stdout:Installed size: 462 k 2026-02-12T17:27:43.777 INFO:teuthology.orchestra.run.trial082.stdout:Downloading Packages: 2026-02-12T17:27:43.912 INFO:teuthology.orchestra.run.trial082.stdout:rbd-nbd-20.3.0-5230.gafefaa40.el9.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2026-02-12T17:27:43.912 INFO:teuthology.orchestra.run.trial082.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:27:43.913 INFO:teuthology.orchestra.run.trial082.stdout:Total 1.2 MB/s | 172 kB 00:00 2026-02-12T17:27:43.913 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction check 2026-02-12T17:27:43.917 INFO:teuthology.orchestra.run.trial082.stdout:Transaction check succeeded. 2026-02-12T17:27:43.917 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction test 2026-02-12T17:27:43.948 INFO:teuthology.orchestra.run.trial082.stdout:Transaction test succeeded. 2026-02-12T17:27:43.949 INFO:teuthology.orchestra.run.trial082.stdout:Running transaction 2026-02-12T17:27:44.004 INFO:teuthology.orchestra.run.trial082.stdout: Preparing : 1/1 2026-02-12T17:27:44.020 INFO:teuthology.orchestra.run.trial082.stdout: Installing : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:44.104 INFO:teuthology.orchestra.run.trial082.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:44.160 INFO:teuthology.orchestra.run.trial082.stdout: Verifying : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T17:27:44.160 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:44.160 INFO:teuthology.orchestra.run.trial082.stdout:Installed: 2026-02-12T17:27:44.160 INFO:teuthology.orchestra.run.trial082.stdout: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T17:27:44.160 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:44.160 INFO:teuthology.orchestra.run.trial082.stdout:Complete! 2026-02-12T17:27:44.193 DEBUG:teuthology.parallel:result is None 2026-02-12T17:27:44.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T17:27:44.364 DEBUG:teuthology.orchestra.run.trial057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T17:27:44.385 INFO:teuthology.orchestra.run.trial057.stdout:20.3.0-5230.gafefaa40.el9 2026-02-12T17:27:44.386 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230.gafefaa40.el9 2026-02-12T17:27:44.386 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230.gafefaa40 is installed. 2026-02-12T17:27:44.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T17:27:44.544 DEBUG:teuthology.orchestra.run.trial082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T17:27:44.563 INFO:teuthology.orchestra.run.trial082.stdout:20.3.0-5230.gafefaa40.el9 2026-02-12T17:27:44.564 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230.gafefaa40.el9 2026-02-12T17:27:44.564 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230.gafefaa40 is installed. 2026-02-12T17:27:44.566 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T17:27:44.566 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:44.566 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T17:27:44.593 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:44.593 DEBUG:teuthology.orchestra.run.trial082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T17:27:44.628 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T17:27:44.628 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:44.628 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T17:27:44.655 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T17:27:44.720 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:44.720 DEBUG:teuthology.orchestra.run.trial082:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T17:27:44.746 DEBUG:teuthology.orchestra.run.trial082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T17:27:44.810 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T17:27:44.811 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:44.811 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T17:27:44.836 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T17:27:44.898 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:44.899 DEBUG:teuthology.orchestra.run.trial082:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T17:27:44.924 DEBUG:teuthology.orchestra.run.trial082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T17:27:44.989 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T17:27:44.989 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:44.989 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T17:27:45.014 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T17:27:45.078 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:45.078 DEBUG:teuthology.orchestra.run.trial082:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T17:27:45.105 DEBUG:teuthology.orchestra.run.trial082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T17:27:45.172 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T17:27:45.293 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T17:27:45.293 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 777 /var/log/ceph 2026-02-12T17:27:45.295 DEBUG:teuthology.orchestra.run.trial082:> sudo chmod 777 /var/log/ceph 2026-02-12T17:27:45.319 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T17:27:45.319 DEBUG:teuthology.orchestra.run.trial057:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T17:27:45.359 DEBUG:teuthology.orchestra.run.trial082:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T17:27:45.383 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T17:27:45.383 DEBUG:teuthology.orchestra.run.trial057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T17:27:45.422 DEBUG:teuthology.orchestra.run.trial082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T17:27:45.460 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T17:27:45.460 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore debug onode segmentation random': True, 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-12T17:27:45.460 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421', 'branch': 'wip-yuri4-testing-2026-02-11-2126', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore/{alloc$/{hybrid} base mem$/{normal-2} onode-segment$/{512K-onoff} write$/{v1/{compr$/{no$/{no}} v1}}}} rados supported-random-distro$/{centos_latest} thrashers/sync workloads/snaps-few-objects}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '46421', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2026-02-11-2126'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore debug onode segmentation random': True, 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'mon_bind_msgr2': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2026-02-11-2126', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 7172, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2026-02-11-2126', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'targets': {'trial057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIMsusF/xT4p7R8UJej+V8+520hvAfBC01usp8rw7JG8jPSoEmX/RDctiu8gBkWCeDLccroqUJfiNCyNPwQ2Qs=', 'trial082.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKISbTADi+4NKDqLwbxjvYy07jNMPUUXCgkDL/CYDhQEK+GiiEoGUmW1s9FTJ9OrYAfxs5i3fNS+/NDUcPfjuqg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'thrash_delay': 1}}, {'rados': {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-12_15:38:14', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482'} 2026-02-12T17:27:45.461 DEBUG:teuthology.orchestra.run.trial057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T17:27:45.487 DEBUG:teuthology.orchestra.run.trial082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T17:27:45.503 DEBUG:teuthology.orchestra.run.trial057:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T17:27:45.542 DEBUG:teuthology.orchestra.run.trial082:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T17:27:45.568 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:45.568 DEBUG:teuthology.orchestra.run.trial057:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T17:27:45.622 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T17:27:45.622 DEBUG:teuthology.orchestra.run.trial057:> stat /dev/vg_nvme/lv_1 2026-02-12T17:27:45.679 INFO:teuthology.orchestra.run.trial057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T17:27:45.679 INFO:teuthology.orchestra.run.trial057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T17:27:45.679 INFO:teuthology.orchestra.run.trial057.stdout:Device: 6h/6d Inode: 913 Links: 1 2026-02-12T17:27:45.679 INFO:teuthology.orchestra.run.trial057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T17:27:45.679 INFO:teuthology.orchestra.run.trial057.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T17:27:45.679 INFO:teuthology.orchestra.run.trial057.stdout:Access: 2026-02-12 17:27:13.442035339 +0000 2026-02-12T17:27:45.679 INFO:teuthology.orchestra.run.trial057.stdout:Modify: 2026-02-12 17:25:15.703802062 +0000 2026-02-12T17:27:45.680 INFO:teuthology.orchestra.run.trial057.stdout:Change: 2026-02-12 17:25:15.703802062 +0000 2026-02-12T17:27:45.680 INFO:teuthology.orchestra.run.trial057.stdout: Birth: 2026-02-12 17:25:15.703802062 +0000 2026-02-12T17:27:45.680 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T17:27:45.742 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records in 2026-02-12T17:27:45.743 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records out 2026-02-12T17:27:45.743 INFO:teuthology.orchestra.run.trial057.stderr:512 bytes copied, 0.000153143 s, 3.3 MB/s 2026-02-12T17:27:45.744 DEBUG:teuthology.orchestra.run.trial057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T17:27:45.801 DEBUG:teuthology.orchestra.run.trial057:> stat /dev/vg_nvme/lv_2 2026-02-12T17:27:45.857 INFO:teuthology.orchestra.run.trial057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T17:27:45.857 INFO:teuthology.orchestra.run.trial057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T17:27:45.858 INFO:teuthology.orchestra.run.trial057.stdout:Device: 6h/6d Inode: 940 Links: 1 2026-02-12T17:27:45.858 INFO:teuthology.orchestra.run.trial057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T17:27:45.858 INFO:teuthology.orchestra.run.trial057.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T17:27:45.858 INFO:teuthology.orchestra.run.trial057.stdout:Access: 2026-02-12 17:27:13.442035339 +0000 2026-02-12T17:27:45.858 INFO:teuthology.orchestra.run.trial057.stdout:Modify: 2026-02-12 17:25:15.935803216 +0000 2026-02-12T17:27:45.858 INFO:teuthology.orchestra.run.trial057.stdout:Change: 2026-02-12 17:25:15.935803216 +0000 2026-02-12T17:27:45.858 INFO:teuthology.orchestra.run.trial057.stdout: Birth: 2026-02-12 17:25:15.935803216 +0000 2026-02-12T17:27:45.858 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T17:27:45.920 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records in 2026-02-12T17:27:45.920 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records out 2026-02-12T17:27:45.920 INFO:teuthology.orchestra.run.trial057.stderr:512 bytes copied, 0.000143224 s, 3.6 MB/s 2026-02-12T17:27:45.921 DEBUG:teuthology.orchestra.run.trial057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T17:27:45.978 DEBUG:teuthology.orchestra.run.trial057:> stat /dev/vg_nvme/lv_3 2026-02-12T17:27:46.034 INFO:teuthology.orchestra.run.trial057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T17:27:46.034 INFO:teuthology.orchestra.run.trial057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T17:27:46.034 INFO:teuthology.orchestra.run.trial057.stdout:Device: 6h/6d Inode: 967 Links: 1 2026-02-12T17:27:46.035 INFO:teuthology.orchestra.run.trial057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T17:27:46.035 INFO:teuthology.orchestra.run.trial057.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T17:27:46.035 INFO:teuthology.orchestra.run.trial057.stdout:Access: 2026-02-12 17:27:13.443035312 +0000 2026-02-12T17:27:46.035 INFO:teuthology.orchestra.run.trial057.stdout:Modify: 2026-02-12 17:25:16.167804371 +0000 2026-02-12T17:27:46.035 INFO:teuthology.orchestra.run.trial057.stdout:Change: 2026-02-12 17:25:16.167804371 +0000 2026-02-12T17:27:46.035 INFO:teuthology.orchestra.run.trial057.stdout: Birth: 2026-02-12 17:25:16.167804371 +0000 2026-02-12T17:27:46.035 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T17:27:46.096 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records in 2026-02-12T17:27:46.096 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records out 2026-02-12T17:27:46.096 INFO:teuthology.orchestra.run.trial057.stderr:512 bytes copied, 0.00014615 s, 3.5 MB/s 2026-02-12T17:27:46.098 DEBUG:teuthology.orchestra.run.trial057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T17:27:46.156 DEBUG:teuthology.orchestra.run.trial057:> stat /dev/vg_nvme/lv_4 2026-02-12T17:27:46.212 INFO:teuthology.orchestra.run.trial057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T17:27:46.212 INFO:teuthology.orchestra.run.trial057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T17:27:46.213 INFO:teuthology.orchestra.run.trial057.stdout:Device: 6h/6d Inode: 998 Links: 1 2026-02-12T17:27:46.213 INFO:teuthology.orchestra.run.trial057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T17:27:46.213 INFO:teuthology.orchestra.run.trial057.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T17:27:46.213 INFO:teuthology.orchestra.run.trial057.stdout:Access: 2026-02-12 17:27:13.443035312 +0000 2026-02-12T17:27:46.213 INFO:teuthology.orchestra.run.trial057.stdout:Modify: 2026-02-12 17:25:16.414805602 +0000 2026-02-12T17:27:46.213 INFO:teuthology.orchestra.run.trial057.stdout:Change: 2026-02-12 17:25:16.414805602 +0000 2026-02-12T17:27:46.213 INFO:teuthology.orchestra.run.trial057.stdout: Birth: 2026-02-12 17:25:16.414805602 +0000 2026-02-12T17:27:46.213 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T17:27:46.277 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records in 2026-02-12T17:27:46.277 INFO:teuthology.orchestra.run.trial057.stderr:1+0 records out 2026-02-12T17:27:46.277 INFO:teuthology.orchestra.run.trial057.stderr:512 bytes copied, 0.000133086 s, 3.8 MB/s 2026-02-12T17:27:46.278 DEBUG:teuthology.orchestra.run.trial057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T17:27:46.335 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T17:27:46.336 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:46.336 DEBUG:teuthology.orchestra.run.trial082:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T17:27:46.354 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T17:27:46.355 DEBUG:teuthology.orchestra.run.trial082:> stat /dev/vg_nvme/lv_1 2026-02-12T17:27:46.412 INFO:teuthology.orchestra.run.trial082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T17:27:46.413 INFO:teuthology.orchestra.run.trial082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T17:27:46.413 INFO:teuthology.orchestra.run.trial082.stdout:Device: 6h/6d Inode: 912 Links: 1 2026-02-12T17:27:46.413 INFO:teuthology.orchestra.run.trial082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T17:27:46.413 INFO:teuthology.orchestra.run.trial082.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T17:27:46.413 INFO:teuthology.orchestra.run.trial082.stdout:Access: 2026-02-12 17:27:43.194799831 +0000 2026-02-12T17:27:46.413 INFO:teuthology.orchestra.run.trial082.stdout:Modify: 2026-02-12 17:25:15.681389254 +0000 2026-02-12T17:27:46.413 INFO:teuthology.orchestra.run.trial082.stdout:Change: 2026-02-12 17:25:15.681389254 +0000 2026-02-12T17:27:46.413 INFO:teuthology.orchestra.run.trial082.stdout: Birth: 2026-02-12 17:25:15.681389254 +0000 2026-02-12T17:27:46.414 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T17:27:46.476 INFO:teuthology.orchestra.run.trial082.stderr:1+0 records in 2026-02-12T17:27:46.476 INFO:teuthology.orchestra.run.trial082.stderr:1+0 records out 2026-02-12T17:27:46.477 INFO:teuthology.orchestra.run.trial082.stderr:512 bytes copied, 0.000138408 s, 3.7 MB/s 2026-02-12T17:27:46.478 DEBUG:teuthology.orchestra.run.trial082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T17:27:46.535 DEBUG:teuthology.orchestra.run.trial082:> stat /dev/vg_nvme/lv_2 2026-02-12T17:27:46.590 INFO:teuthology.orchestra.run.trial082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T17:27:46.591 INFO:teuthology.orchestra.run.trial082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T17:27:46.591 INFO:teuthology.orchestra.run.trial082.stdout:Device: 6h/6d Inode: 938 Links: 1 2026-02-12T17:27:46.591 INFO:teuthology.orchestra.run.trial082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T17:27:46.591 INFO:teuthology.orchestra.run.trial082.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T17:27:46.591 INFO:teuthology.orchestra.run.trial082.stdout:Access: 2026-02-12 17:27:43.194799831 +0000 2026-02-12T17:27:46.591 INFO:teuthology.orchestra.run.trial082.stdout:Modify: 2026-02-12 17:25:15.932377972 +0000 2026-02-12T17:27:46.591 INFO:teuthology.orchestra.run.trial082.stdout:Change: 2026-02-12 17:25:15.932377972 +0000 2026-02-12T17:27:46.591 INFO:teuthology.orchestra.run.trial082.stdout: Birth: 2026-02-12 17:25:15.932377972 +0000 2026-02-12T17:27:46.592 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T17:27:46.655 INFO:teuthology.orchestra.run.trial082.stderr:1+0 records in 2026-02-12T17:27:46.655 INFO:teuthology.orchestra.run.trial082.stderr:1+0 records out 2026-02-12T17:27:46.655 INFO:teuthology.orchestra.run.trial082.stderr:512 bytes copied, 0.000145752 s, 3.5 MB/s 2026-02-12T17:27:46.656 DEBUG:teuthology.orchestra.run.trial082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T17:27:46.713 DEBUG:teuthology.orchestra.run.trial082:> stat /dev/vg_nvme/lv_3 2026-02-12T17:27:46.769 INFO:teuthology.orchestra.run.trial082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T17:27:46.769 INFO:teuthology.orchestra.run.trial082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T17:27:46.770 INFO:teuthology.orchestra.run.trial082.stdout:Device: 6h/6d Inode: 967 Links: 1 2026-02-12T17:27:46.770 INFO:teuthology.orchestra.run.trial082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T17:27:46.770 INFO:teuthology.orchestra.run.trial082.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T17:27:46.770 INFO:teuthology.orchestra.run.trial082.stdout:Access: 2026-02-12 17:27:43.195799812 +0000 2026-02-12T17:27:46.770 INFO:teuthology.orchestra.run.trial082.stdout:Modify: 2026-02-12 17:25:16.187366511 +0000 2026-02-12T17:27:46.770 INFO:teuthology.orchestra.run.trial082.stdout:Change: 2026-02-12 17:25:16.187366511 +0000 2026-02-12T17:27:46.770 INFO:teuthology.orchestra.run.trial082.stdout: Birth: 2026-02-12 17:25:16.187366511 +0000 2026-02-12T17:27:46.770 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T17:27:46.833 INFO:teuthology.orchestra.run.trial082.stderr:1+0 records in 2026-02-12T17:27:46.833 INFO:teuthology.orchestra.run.trial082.stderr:1+0 records out 2026-02-12T17:27:46.834 INFO:teuthology.orchestra.run.trial082.stderr:512 bytes copied, 0.000143607 s, 3.6 MB/s 2026-02-12T17:27:46.835 DEBUG:teuthology.orchestra.run.trial082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T17:27:46.893 DEBUG:teuthology.orchestra.run.trial082:> stat /dev/vg_nvme/lv_4 2026-02-12T17:27:46.949 INFO:teuthology.orchestra.run.trial082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T17:27:46.949 INFO:teuthology.orchestra.run.trial082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T17:27:46.949 INFO:teuthology.orchestra.run.trial082.stdout:Device: 6h/6d Inode: 997 Links: 1 2026-02-12T17:27:46.949 INFO:teuthology.orchestra.run.trial082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T17:27:46.949 INFO:teuthology.orchestra.run.trial082.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T17:27:46.949 INFO:teuthology.orchestra.run.trial082.stdout:Access: 2026-02-12 17:27:43.195799812 +0000 2026-02-12T17:27:46.950 INFO:teuthology.orchestra.run.trial082.stdout:Modify: 2026-02-12 17:25:16.430355589 +0000 2026-02-12T17:27:46.950 INFO:teuthology.orchestra.run.trial082.stdout:Change: 2026-02-12 17:25:16.430355589 +0000 2026-02-12T17:27:46.950 INFO:teuthology.orchestra.run.trial082.stdout: Birth: 2026-02-12 17:25:16.430355589 +0000 2026-02-12T17:27:46.950 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T17:27:47.013 INFO:teuthology.orchestra.run.trial082.stderr:1+0 records in 2026-02-12T17:27:47.013 INFO:teuthology.orchestra.run.trial082.stderr:1+0 records out 2026-02-12T17:27:47.013 INFO:teuthology.orchestra.run.trial082.stderr:512 bytes copied, 0.000136414 s, 3.8 MB/s 2026-02-12T17:27:47.014 DEBUG:teuthology.orchestra.run.trial082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T17:27:47.073 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-12T17:27:47.073 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial082.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-12T17:27:47.073 INFO:tasks.ceph:Generating config... 2026-02-12T17:27:47.075 INFO:tasks.ceph:[client] debug monc = 20 2026-02-12T17:27:47.076 INFO:tasks.ceph:[client] debug ms = 1 2026-02-12T17:27:47.076 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-12T17:27:47.076 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-12T17:27:47.076 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-12T17:27:47.076 INFO:tasks.ceph:[global] ms inject delay max = 1 2026-02-12T17:27:47.076 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2026-02-12T17:27:47.076 INFO:tasks.ceph:[global] ms inject delay type = mon 2026-02-12T17:27:47.076 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2026-02-12T17:27:47.076 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2026-02-12T17:27:47.077 INFO:tasks.ceph:[global] ms type = async 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mgr] debug monc = 10 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mon] debug mon = 30 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mon] debug ms = 20 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-12T17:27:47.077 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-12T17:27:47.078 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-12T17:27:47.078 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-12T17:27:47.078 INFO:tasks.ceph:[mon] paxos min = 10 2026-02-12T17:27:47.078 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-12T17:27:47.078 INFO:tasks.ceph:[mon] paxos trim min = 10 2026-02-12T17:27:47.078 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-12T17:27:47.078 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-12T17:27:47.078 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2026-02-12T17:27:47.078 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2026-02-12T17:27:47.078 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-12T17:27:47.078 INFO:tasks.ceph:[osd] bluestore debug onode segmentation random = True 2026-02-12T17:27:47.078 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-12T17:27:47.078 INFO:tasks.ceph:[osd] bluestore onode segment size = 512K 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] bluestore write v2 = False 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-12T17:27:47.079 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-12T17:27:47.080 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-12T17:27:47.080 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-12T17:27:47.080 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-12T17:27:47.080 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-12T17:27:47.080 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-12T17:27:47.080 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-12T17:27:47.080 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T17:27:47.080 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T17:27:47.114 INFO:teuthology.orchestra.run.trial057.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T17:27:47.116 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T17:27:47.190 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T17:27:47.254 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.57:6789]'), ('mon.c', '[v1:10.20.193.57:6790]'), ('mon.b', '[v1:10.20.193.82:6789]')] 2026-02-12T17:27:47.255 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.57:6789],[v1:10.20.193.57:6790],[v1:10.20.193.82:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore debug onode segmentation random': True, 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 20, 'debug mon': 30, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-12T17:27:47.256 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:47.256 DEBUG:teuthology.orchestra.run.trial057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T17:27:47.312 DEBUG:teuthology.orchestra.run.trial057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.57:6789]' --addv c '[v1:10.20.193.57:6790]' --addv b '[v1:10.20.193.82:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:47.384 INFO:teuthology.orchestra.run.trial057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:47.384 INFO:teuthology.orchestra.run.trial057.stdout:monmaptool: generated fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:setting min_mon_release = tentacle 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:epoch 0 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:min_mon_release 20 (tentacle) 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:election_strategy: 3 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:27:47.385 INFO:teuthology.orchestra.run.trial057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-12T17:27:47.387 DEBUG:teuthology.orchestra.run.trial057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T17:27:47.444 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2c564c25-fc44-46b7-9900-7876a1cecb3c... 2026-02-12T17:27:47.445 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T17:27:47.486 DEBUG:teuthology.orchestra.run.trial082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T17:27:47.524 INFO:teuthology.orchestra.run.trial057.stdout:[global] 2026-02-12T17:27:47.524 INFO:teuthology.orchestra.run.trial057.stdout: chdir = "" 2026-02-12T17:27:47.524 INFO:teuthology.orchestra.run.trial057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T17:27:47.524 INFO:teuthology.orchestra.run.trial057.stdout: auth supported = cephx 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: filestore xattr use omap = true 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: mon clock drift allowed = 1.000 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: osd crush chooseleaf type = 0 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: auth debug = true 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: ms die on old message = true 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: ms die on bug = true 2026-02-12T17:27:47.525 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: mon pg warn max object skew = 0 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: osd pool default size = 2 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: mon osd allow primary affinity = true 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: mon osd allow pg remap = true 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on legacy crush tunables = false 2026-02-12T17:27:47.526 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on crush straw calc version zero = false 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on no sortbitwise = false 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on osd down out interval zero = false 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: mon warn on too few osds = false 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: mon_allow_pool_size_one = true 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: osd default data pool replay window = 5 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.527 INFO:teuthology.orchestra.run.trial057.stdout: mon allow pool delete = true 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: mon cluster log file level = debug 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: debug asserts on shutdown = true 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: mon health detail to clog = false 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: mon host = "[v1:10.20.193.57:6789],[v1:10.20.193.57:6790],[v1:10.20.193.82:6789]" 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: mon client directed command retry = 5 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: mon election default strategy = 3 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: ms bind msgr2 = False 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: ms inject delay max = 1 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: ms inject delay probability = 0.005 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: ms inject delay type = mon 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: ms inject internal delays = 0.002 2026-02-12T17:27:47.528 INFO:teuthology.orchestra.run.trial057.stdout: ms inject socket failures = 2500 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: ms type = async 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: fsid = 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout:[osd] 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: osd journal size = 100 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: osd scrub load threshold = 5.0 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: osd scrub max interval = 600 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: osd mclock profile = high_recovery_ops 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: osd mclock skip benchmark = True 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.529 INFO:teuthology.orchestra.run.trial057.stdout: osd recover clone overlap = true 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: osd recovery max chunk = 1048576 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: osd debug shutdown = true 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: osd debug op order = true 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: osd debug verify stray on activate = true 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: osd debug trim objects = true 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: osd open classes on start = true 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: osd debug pg log writeout = true 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: osd deep scrub update digest min age = 30 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.530 INFO:teuthology.orchestra.run.trial057.stdout: osd map max advance = 10 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: journal zero on create = true 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: filestore ondisk finisher threads = 3 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: filestore apply finisher threads = 3 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: bdev debug aio = true 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: osd debug misdirected ops = true 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: bdev async discard = True 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: bdev enable discard = True 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: bluefs allocator = hybrid 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: bluestore allocator = hybrid 2026-02-12T17:27:47.531 INFO:teuthology.orchestra.run.trial057.stdout: bluestore block size = 96636764160 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: bluestore debug onode segmentation random = True 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: bluestore fsck on mount = True 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: bluestore onode segment size = 512K 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: bluestore write v2 = False 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: bluestore zero block detection = True 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: debug bluefs = 20 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: debug bluestore = 20 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: debug ms = 1 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: debug osd = 20 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: debug rocksdb = 10 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: mon osd backfillfull_ratio = 0.85 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: mon osd full ratio = 0.9 2026-02-12T17:27:47.532 INFO:teuthology.orchestra.run.trial057.stdout: mon osd nearfull ratio = 0.8 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: osd debug verify cached snaps = True 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: osd debug verify missing on start = True 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: osd failsafe full ratio = 0.95 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: osd mclock override recovery settings = True 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: osd objectstore = bluestore 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: osd op queue = debug_random 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: osd op queue cut off = debug_random 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout:[mgr] 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: debug ms = 1 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: debug mgr = 20 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: debug mon = 20 2026-02-12T17:27:47.533 INFO:teuthology.orchestra.run.trial057.stdout: debug auth = 20 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: mon reweight min pgs per osd = 4 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: mon reweight min bytes per osd = 10 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: mgr/telemetry/nag = false 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: debug monc = 10 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout:[mon] 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: debug ms = 20 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: debug mon = 30 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: debug paxos = 20 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: debug auth = 20 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: mon data avail warn = 5 2026-02-12T17:27:47.534 INFO:teuthology.orchestra.run.trial057.stdout: mon mgr mkfs grace = 240 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: mon reweight min pgs per osd = 4 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: mon osd reporter subtree level = osd 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: mon osd prime pg temp = true 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: mon reweight min bytes per osd = 10 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T17:27:47.535 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: # 1m isn't quite enough 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: mon_down_mkfs_grace = 2m 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: mon_warn_on_filestore_osds = false 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: mon min osdmap epochs = 25 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: mon osdmap full prune interval = 2 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: mon osdmap full prune min = 15 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: mon osdmap full prune txsize = 2 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: mon scrub inject crc mismatch = 0.01 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: mon scrub inject missing keys = 0.05 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: mon scrub interval = 300 2026-02-12T17:27:47.536 INFO:teuthology.orchestra.run.trial057.stdout: paxos min = 10 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: paxos service trim min = 5 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: paxos trim min = 10 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout:[client] 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: rgw cache enabled = true 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: rgw enable ops log = true 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: rgw enable usage log = true 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: debug monc = 20 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout: debug ms = 1 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout:[mon.a] 2026-02-12T17:27:47.537 INFO:teuthology.orchestra.run.trial057.stdout:[mon.c] 2026-02-12T17:27:47.538 INFO:teuthology.orchestra.run.trial057.stdout:[mon.b] 2026-02-12T17:27:47.539 INFO:teuthology.orchestra.run.trial082.stdout:[global] 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: chdir = "" 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: auth supported = cephx 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: filestore xattr use omap = true 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: mon clock drift allowed = 1.000 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: osd crush chooseleaf type = 0 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: auth debug = true 2026-02-12T17:27:47.540 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: ms die on old message = true 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: ms die on bug = true 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: mon pg warn max object skew = 0 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: osd pool default size = 2 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: mon osd allow primary affinity = true 2026-02-12T17:27:47.541 INFO:teuthology.orchestra.run.trial082.stdout: mon osd allow pg remap = true 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: mon warn on legacy crush tunables = false 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: mon warn on crush straw calc version zero = false 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: mon warn on no sortbitwise = false 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: mon warn on osd down out interval zero = false 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: mon warn on too few osds = false 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: mon_allow_pool_size_one = true 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.542 INFO:teuthology.orchestra.run.trial082.stdout: osd default data pool replay window = 5 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: mon allow pool delete = true 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: mon cluster log file level = debug 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: debug asserts on shutdown = true 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: mon health detail to clog = false 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: mon host = "[v1:10.20.193.57:6789],[v1:10.20.193.57:6790],[v1:10.20.193.82:6789]" 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: mon client directed command retry = 5 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: mon election default strategy = 3 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: ms bind msgr2 = False 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: ms inject delay max = 1 2026-02-12T17:27:47.543 INFO:teuthology.orchestra.run.trial082.stdout: ms inject delay probability = 0.005 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: ms inject delay type = mon 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: ms inject internal delays = 0.002 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: ms inject socket failures = 2500 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: ms type = async 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: fsid = 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout:[osd] 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: osd journal size = 100 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: osd scrub load threshold = 5.0 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: osd scrub max interval = 600 2026-02-12T17:27:47.544 INFO:teuthology.orchestra.run.trial082.stdout: osd mclock profile = high_recovery_ops 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: osd mclock skip benchmark = True 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: osd recover clone overlap = true 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: osd recovery max chunk = 1048576 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: osd debug shutdown = true 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: osd debug op order = true 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: osd debug verify stray on activate = true 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: osd debug trim objects = true 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: osd open classes on start = true 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: osd debug pg log writeout = true 2026-02-12T17:27:47.545 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: osd deep scrub update digest min age = 30 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: osd map max advance = 10 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: journal zero on create = true 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: filestore ondisk finisher threads = 3 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: filestore apply finisher threads = 3 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: bdev debug aio = true 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: osd debug misdirected ops = true 2026-02-12T17:27:47.546 INFO:teuthology.orchestra.run.trial082.stdout: bdev async discard = True 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: bdev enable discard = True 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: bluefs allocator = hybrid 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: bluestore allocator = hybrid 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: bluestore block size = 96636764160 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: bluestore debug onode segmentation random = True 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: bluestore fsck on mount = True 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: bluestore onode segment size = 512K 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: bluestore write v2 = False 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: bluestore zero block detection = True 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: debug bluefs = 20 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: debug bluestore = 20 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: debug ms = 1 2026-02-12T17:27:47.547 INFO:teuthology.orchestra.run.trial082.stdout: debug osd = 20 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: debug rocksdb = 10 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: mon osd backfillfull_ratio = 0.85 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: mon osd full ratio = 0.9 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: mon osd nearfull ratio = 0.8 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: osd debug verify cached snaps = True 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: osd debug verify missing on start = True 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: osd failsafe full ratio = 0.95 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: osd mclock override recovery settings = True 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: osd objectstore = bluestore 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: osd op queue = debug_random 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: osd op queue cut off = debug_random 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.548 INFO:teuthology.orchestra.run.trial082.stdout:[mgr] 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: debug ms = 1 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: debug mgr = 20 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: debug mon = 20 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: debug auth = 20 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: mon reweight min pgs per osd = 4 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: mon reweight min bytes per osd = 10 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: mgr/telemetry/nag = false 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: debug monc = 10 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout:[mon] 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: debug ms = 20 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: debug mon = 30 2026-02-12T17:27:47.549 INFO:teuthology.orchestra.run.trial082.stdout: debug paxos = 20 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: debug auth = 20 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: mon data avail warn = 5 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: mon mgr mkfs grace = 240 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: mon reweight min pgs per osd = 4 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: mon osd reporter subtree level = osd 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: mon osd prime pg temp = true 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: mon reweight min bytes per osd = 10 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.550 INFO:teuthology.orchestra.run.trial082.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: # 1m isn't quite enough 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: mon_down_mkfs_grace = 2m 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: mon_warn_on_filestore_osds = false 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: mon min osdmap epochs = 25 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: mon osdmap full prune interval = 2 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: mon osdmap full prune min = 15 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: mon osdmap full prune txsize = 2 2026-02-12T17:27:47.551 INFO:teuthology.orchestra.run.trial082.stdout: mon scrub inject crc mismatch = 0.01 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: mon scrub inject missing keys = 0.05 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: mon scrub interval = 300 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: paxos min = 10 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: paxos service trim min = 5 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: paxos trim min = 10 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout:[client] 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: rgw cache enabled = true 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: rgw enable ops log = true 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: rgw enable usage log = true 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: debug monc = 20 2026-02-12T17:27:47.552 INFO:teuthology.orchestra.run.trial082.stdout: debug ms = 1 2026-02-12T17:27:47.553 INFO:teuthology.orchestra.run.trial082.stdout:[mon.a] 2026-02-12T17:27:47.553 INFO:teuthology.orchestra.run.trial082.stdout:[mon.c] 2026-02-12T17:27:47.553 INFO:teuthology.orchestra.run.trial082.stdout:[mon.b] 2026-02-12T17:27:47.553 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T17:27:47.553 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T17:27:47.619 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T17:27:47.619 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:47.619 DEBUG:teuthology.orchestra.run.trial057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T17:27:47.676 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:47.676 DEBUG:teuthology.orchestra.run.trial057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T17:27:47.733 INFO:tasks.ceph:Sending monmap to node ubuntu@trial057.front.sepia.ceph.com 2026-02-12T17:27:47.733 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:47.733 DEBUG:teuthology.orchestra.run.trial057:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T17:27:47.734 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T17:27:47.806 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:47.806 DEBUG:teuthology.orchestra.run.trial057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:47.863 INFO:tasks.ceph:Sending monmap to node ubuntu@trial082.front.sepia.ceph.com 2026-02-12T17:27:47.863 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:47.863 DEBUG:teuthology.orchestra.run.trial082:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T17:27:47.863 DEBUG:teuthology.orchestra.run.trial082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T17:27:47.897 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:47.897 DEBUG:teuthology.orchestra.run.trial082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:47.955 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T17:27:47.955 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T17:27:47.955 DEBUG:teuthology.orchestra.run.trial082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T17:27:48.038 INFO:teuthology.orchestra.run.trial082.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T17:27:48.040 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T17:27:48.040 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T17:27:48.040 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T17:27:48.113 INFO:teuthology.orchestra.run.trial082.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T17:27:48.124 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T17:27:48.124 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial082.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-12T17:27:48.124 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T17:27:48.150 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T17:27:48.151 INFO:tasks.ceph:role: osd.0 2026-02-12T17:27:48.151 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial057.front.sepia.ceph.com 2026-02-12T17:27:48.151 DEBUG:teuthology.orchestra.run.trial057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T17:27:48.216 INFO:teuthology.orchestra.run.trial057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T17:27:48.217 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T17:27:48.217 INFO:teuthology.orchestra.run.trial057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T17:27:48.217 INFO:teuthology.orchestra.run.trial057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T17:27:48.217 INFO:teuthology.orchestra.run.trial057.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T17:27:48.217 INFO:teuthology.orchestra.run.trial057.stdout: = sunit=0 swidth=0 blks 2026-02-12T17:27:48.217 INFO:teuthology.orchestra.run.trial057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T17:27:48.217 INFO:teuthology.orchestra.run.trial057.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T17:27:48.217 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T17:27:48.217 INFO:teuthology.orchestra.run.trial057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T17:27:48.789 INFO:teuthology.orchestra.run.trial057.stdout:Discarding blocks...Done. 2026-02-12T17:27:48.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial057.front.sepia.ceph.com -o noatime 2026-02-12T17:27:48.791 DEBUG:teuthology.orchestra.run.trial057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T17:27:48.858 DEBUG:teuthology.orchestra.run.trial057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T17:27:48.925 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T17:27:48.988 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T17:27:48.988 INFO:tasks.ceph:role: osd.1 2026-02-12T17:27:48.988 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial057.front.sepia.ceph.com 2026-02-12T17:27:48.988 DEBUG:teuthology.orchestra.run.trial057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T17:27:49.052 INFO:teuthology.orchestra.run.trial057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T17:27:49.053 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T17:27:49.053 INFO:teuthology.orchestra.run.trial057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T17:27:49.053 INFO:teuthology.orchestra.run.trial057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T17:27:49.053 INFO:teuthology.orchestra.run.trial057.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T17:27:49.053 INFO:teuthology.orchestra.run.trial057.stdout: = sunit=0 swidth=0 blks 2026-02-12T17:27:49.053 INFO:teuthology.orchestra.run.trial057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T17:27:49.053 INFO:teuthology.orchestra.run.trial057.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T17:27:49.053 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T17:27:49.053 INFO:teuthology.orchestra.run.trial057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T17:27:49.612 INFO:teuthology.orchestra.run.trial057.stdout:Discarding blocks...Done. 2026-02-12T17:27:49.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial057.front.sepia.ceph.com -o noatime 2026-02-12T17:27:49.614 DEBUG:teuthology.orchestra.run.trial057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-12T17:27:49.683 DEBUG:teuthology.orchestra.run.trial057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T17:27:49.749 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T17:27:49.813 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T17:27:49.813 INFO:tasks.ceph:role: osd.2 2026-02-12T17:27:49.813 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial057.front.sepia.ceph.com 2026-02-12T17:27:49.813 DEBUG:teuthology.orchestra.run.trial057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T17:27:49.878 INFO:teuthology.orchestra.run.trial057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T17:27:49.879 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T17:27:49.879 INFO:teuthology.orchestra.run.trial057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T17:27:49.879 INFO:teuthology.orchestra.run.trial057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T17:27:49.879 INFO:teuthology.orchestra.run.trial057.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T17:27:49.879 INFO:teuthology.orchestra.run.trial057.stdout: = sunit=0 swidth=0 blks 2026-02-12T17:27:49.879 INFO:teuthology.orchestra.run.trial057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T17:27:49.879 INFO:teuthology.orchestra.run.trial057.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T17:27:49.879 INFO:teuthology.orchestra.run.trial057.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T17:27:49.879 INFO:teuthology.orchestra.run.trial057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T17:27:50.435 INFO:teuthology.orchestra.run.trial057.stdout:Discarding blocks...Done. 2026-02-12T17:27:50.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial057.front.sepia.ceph.com -o noatime 2026-02-12T17:27:50.437 DEBUG:teuthology.orchestra.run.trial057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-12T17:27:50.507 DEBUG:teuthology.orchestra.run.trial057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T17:27:50.575 DEBUG:teuthology.orchestra.run.trial057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:50.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:50.654+0000 7fb20bfc6780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-12T17:27:50.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:50.654+0000 7fb20bfc6780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-12T17:27:50.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:50.654+0000 7fb20bfc6780 -1 bdev(0x248f400 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-12T17:27:50.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:50.655+0000 7fb20bfc6780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-12T17:27:51.124 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T17:27:51.188 DEBUG:teuthology.orchestra.run.trial057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:51.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:51.266+0000 7ffa9c817780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-12T17:27:51.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:51.266+0000 7ffa9c817780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-12T17:27:51.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:51.267+0000 7ffa9c817780 -1 bdev(0x265d400 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-12T17:27:51.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:51.267+0000 7ffa9c817780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-12T17:27:51.725 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T17:27:51.791 DEBUG:teuthology.orchestra.run.trial057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:51.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:51.867+0000 7f80029d8780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-12T17:27:51.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:51.868+0000 7f80029d8780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-12T17:27:51.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:51.868+0000 7f80029d8780 -1 bdev(0x2be7400 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-12T17:27:51.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:51.868+0000 7f80029d8780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-12T17:27:52.323 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T17:27:52.388 DEBUG:teuthology.orchestra.run.trial082:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-12T17:27:52.414 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-12T17:27:52.414 INFO:tasks.ceph:role: osd.3 2026-02-12T17:27:52.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial082.front.sepia.ceph.com 2026-02-12T17:27:52.414 DEBUG:teuthology.orchestra.run.trial082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T17:27:52.480 INFO:teuthology.orchestra.run.trial082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T17:27:52.480 INFO:teuthology.orchestra.run.trial082.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T17:27:52.481 INFO:teuthology.orchestra.run.trial082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T17:27:52.481 INFO:teuthology.orchestra.run.trial082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T17:27:52.481 INFO:teuthology.orchestra.run.trial082.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T17:27:52.481 INFO:teuthology.orchestra.run.trial082.stdout: = sunit=0 swidth=0 blks 2026-02-12T17:27:52.481 INFO:teuthology.orchestra.run.trial082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T17:27:52.481 INFO:teuthology.orchestra.run.trial082.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T17:27:52.481 INFO:teuthology.orchestra.run.trial082.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T17:27:52.481 INFO:teuthology.orchestra.run.trial082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T17:27:53.050 INFO:teuthology.orchestra.run.trial082.stdout:Discarding blocks...Done. 2026-02-12T17:27:53.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial082.front.sepia.ceph.com -o noatime 2026-02-12T17:27:53.053 DEBUG:teuthology.orchestra.run.trial082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-12T17:27:53.121 DEBUG:teuthology.orchestra.run.trial082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-12T17:27:53.192 DEBUG:teuthology.orchestra.run.trial082:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-12T17:27:53.256 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-12T17:27:53.256 INFO:tasks.ceph:role: osd.4 2026-02-12T17:27:53.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial082.front.sepia.ceph.com 2026-02-12T17:27:53.257 DEBUG:teuthology.orchestra.run.trial082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T17:27:53.321 INFO:teuthology.orchestra.run.trial082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T17:27:53.321 INFO:teuthology.orchestra.run.trial082.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T17:27:53.321 INFO:teuthology.orchestra.run.trial082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T17:27:53.321 INFO:teuthology.orchestra.run.trial082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T17:27:53.321 INFO:teuthology.orchestra.run.trial082.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T17:27:53.322 INFO:teuthology.orchestra.run.trial082.stdout: = sunit=0 swidth=0 blks 2026-02-12T17:27:53.322 INFO:teuthology.orchestra.run.trial082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T17:27:53.322 INFO:teuthology.orchestra.run.trial082.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T17:27:53.322 INFO:teuthology.orchestra.run.trial082.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T17:27:53.322 INFO:teuthology.orchestra.run.trial082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T17:27:53.881 INFO:teuthology.orchestra.run.trial082.stdout:Discarding blocks...Done. 2026-02-12T17:27:53.883 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial082.front.sepia.ceph.com -o noatime 2026-02-12T17:27:53.884 DEBUG:teuthology.orchestra.run.trial082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-12T17:27:53.953 DEBUG:teuthology.orchestra.run.trial082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-12T17:27:54.020 DEBUG:teuthology.orchestra.run.trial082:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-12T17:27:54.084 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-12T17:27:54.084 INFO:tasks.ceph:role: osd.5 2026-02-12T17:27:54.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial082.front.sepia.ceph.com 2026-02-12T17:27:54.085 DEBUG:teuthology.orchestra.run.trial082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T17:27:54.149 INFO:teuthology.orchestra.run.trial082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T17:27:54.150 INFO:teuthology.orchestra.run.trial082.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T17:27:54.150 INFO:teuthology.orchestra.run.trial082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T17:27:54.150 INFO:teuthology.orchestra.run.trial082.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T17:27:54.150 INFO:teuthology.orchestra.run.trial082.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T17:27:54.150 INFO:teuthology.orchestra.run.trial082.stdout: = sunit=0 swidth=0 blks 2026-02-12T17:27:54.150 INFO:teuthology.orchestra.run.trial082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T17:27:54.151 INFO:teuthology.orchestra.run.trial082.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T17:27:54.151 INFO:teuthology.orchestra.run.trial082.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T17:27:54.151 INFO:teuthology.orchestra.run.trial082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T17:27:54.707 INFO:teuthology.orchestra.run.trial082.stdout:Discarding blocks...Done. 2026-02-12T17:27:54.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial082.front.sepia.ceph.com -o noatime 2026-02-12T17:27:54.710 DEBUG:teuthology.orchestra.run.trial082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-12T17:27:54.777 DEBUG:teuthology.orchestra.run.trial082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-12T17:27:54.844 DEBUG:teuthology.orchestra.run.trial082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:54.920 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:54.918+0000 7f77c9c2e780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-12T17:27:54.920 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:54.918+0000 7f77c9c2e780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-12T17:27:54.921 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:54.918+0000 7f77c9c2e780 -1 bdev(0x2ca3400 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-12T17:27:54.921 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:54.919+0000 7f77c9c2e780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-12T17:27:55.400 DEBUG:teuthology.orchestra.run.trial082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-12T17:27:55.466 DEBUG:teuthology.orchestra.run.trial082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:55.542 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:55.540+0000 7fbaa4437780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-12T17:27:55.542 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:55.540+0000 7fbaa4437780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-12T17:27:55.542 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:55.541+0000 7fbaa4437780 -1 bdev(0x2f0f400 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-12T17:27:55.542 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:55.541+0000 7fbaa4437780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-12T17:27:56.007 DEBUG:teuthology.orchestra.run.trial082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-12T17:27:56.072 DEBUG:teuthology.orchestra.run.trial082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:56.149 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:56.148+0000 7f0f76652780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-12T17:27:56.150 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:56.148+0000 7f0f76652780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-12T17:27:56.150 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:56.148+0000 7f0f76652780 -1 bdev(0x34f3400 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-12T17:27:56.151 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:27:56.148+0000 7f0f76652780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-12T17:27:56.628 DEBUG:teuthology.orchestra.run.trial082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-12T17:27:56.693 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T17:27:56.693 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:56.693 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T17:27:56.718 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:56.719 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T17:27:56.783 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:27:56.783 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T17:27:56.846 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:56.847 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T17:27:56.873 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:56.873 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-12T17:27:56.938 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:56.938 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-12T17:27:57.001 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:57.002 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-12T17:27:57.066 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:27:57.066 DEBUG:teuthology.orchestra.run.trial082:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T17:27:57.124 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T17:27:57.124 DEBUG:teuthology.orchestra.run.trial057:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T17:27:57.126 DEBUG:teuthology.orchestra.run.trial082:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T17:27:57.166 INFO:teuthology.orchestra.run.trial057.stdout:[osd.0] 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout: key = AQCWDY5pf/cQJxAAIblNNo32Rcc22oQu/SwwRA== 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout:[osd.1] 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout: key = AQCXDY5paUEBEBAAH8AP2/2BIuLJgG9BamfH4w== 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout:[osd.2] 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout: key = AQCXDY5pu8XVMxAAa2f5hCA+MmeVBcvam1HX9A== 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout:[mgr.x] 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout: key = AQCUDY5pJa4/AhAAgP7buQ9S+kOU9hC562cJwQ== 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout:[osd.3] 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout: key = AQCaDY5pSqbSNhAAtp8g9XOXudKyzXjJ5RlH6Q== 2026-02-12T17:27:57.167 INFO:teuthology.orchestra.run.trial057.stdout:[osd.4] 2026-02-12T17:27:57.168 INFO:teuthology.orchestra.run.trial057.stdout: key = AQCbDY5p4c1LIBAAmsOKNNZ5Dk0RK/BASzqWgg== 2026-02-12T17:27:57.168 INFO:teuthology.orchestra.run.trial057.stdout:[osd.5] 2026-02-12T17:27:57.168 INFO:teuthology.orchestra.run.trial057.stdout: key = AQCcDY5p+L3qCBAAMexdEcBaTNYaRobml7IXIg== 2026-02-12T17:27:57.168 INFO:teuthology.orchestra.run.trial057.stdout:[client.0] 2026-02-12T17:27:57.168 INFO:teuthology.orchestra.run.trial057.stdout: key = AQCUDY5px4TDBhAAFK2kLoru/UrIMCRR0BYiCQ== 2026-02-12T17:27:57.186 INFO:teuthology.orchestra.run.trial082.stdout:[osd.0] 2026-02-12T17:27:57.186 INFO:teuthology.orchestra.run.trial082.stdout: key = AQCWDY5pf/cQJxAAIblNNo32Rcc22oQu/SwwRA== 2026-02-12T17:27:57.186 INFO:teuthology.orchestra.run.trial082.stdout:[osd.1] 2026-02-12T17:27:57.186 INFO:teuthology.orchestra.run.trial082.stdout: key = AQCXDY5paUEBEBAAH8AP2/2BIuLJgG9BamfH4w== 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout:[osd.2] 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout: key = AQCXDY5pu8XVMxAAa2f5hCA+MmeVBcvam1HX9A== 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout:[mgr.x] 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout: key = AQCUDY5pJa4/AhAAgP7buQ9S+kOU9hC562cJwQ== 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout:[osd.3] 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout: key = AQCaDY5pSqbSNhAAtp8g9XOXudKyzXjJ5RlH6Q== 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout:[osd.4] 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout: key = AQCbDY5p4c1LIBAAmsOKNNZ5Dk0RK/BASzqWgg== 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout:[osd.5] 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout: key = AQCcDY5p+L3qCBAAMexdEcBaTNYaRobml7IXIg== 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout:[client.0] 2026-02-12T17:27:57.187 INFO:teuthology.orchestra.run.trial082.stdout: key = AQCUDY5px4TDBhAAFK2kLoru/UrIMCRR0BYiCQ== 2026-02-12T17:27:57.189 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.212 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.267 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.290 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.344 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.367 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.423 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T17:27:57.445 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T17:27:57.501 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.523 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.579 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.600 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.657 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.676 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T17:27:57.735 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T17:27:57.755 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T17:27:57.815 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T17:27:57.815 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T17:27:57.857 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T17:27:57.938 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T17:27:58.003 DEBUG:teuthology.orchestra.run.trial057:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-12T17:27:58.067 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T17:27:58.147 DEBUG:teuthology.orchestra.run.trial057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-12T17:27:58.212 DEBUG:teuthology.orchestra.run.trial082:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-12T17:27:58.238 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T17:27:58.323 DEBUG:teuthology.orchestra.run.trial082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-12T17:27:58.348 DEBUG:teuthology.orchestra.run.trial057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:58.351 DEBUG:teuthology.orchestra.run.trial082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T17:27:58.405 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T17:27:58.405 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T17:27:58.405 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T17:27:58.409 INFO:tasks.ceph.mon.a:Started 2026-02-12T17:27:58.409 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T17:27:58.409 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T17:27:58.411 INFO:tasks.ceph.mon.c:Started 2026-02-12T17:27:58.411 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-12T17:27:58.412 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-12T17:27:58.447 INFO:tasks.ceph.mon.b:Started 2026-02-12T17:27:58.447 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T17:27:58.447 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T17:27:58.447 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-12T17:27:58.450 INFO:tasks.ceph.mgr.x:Started 2026-02-12T17:27:58.450 DEBUG:tasks.ceph:set 0 configs 2026-02-12T17:27:58.450 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config dump 2026-02-12T17:27:58.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.515+0000 7f7a759e6640 10 monclient: get_monmap_and_config 2026-02-12T17:27:58.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.515+0000 7f7a759e6640 10 monclient: build_initial_monmap 2026-02-12T17:27:58.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.515+0000 7f7a759e6640 10 monclient: monmap: 2026-02-12T17:27:58.513 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:27:58.513 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:27:58.514 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:58.516327+0000 2026-02-12T17:27:58.514 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:58.516327+0000 2026-02-12T17:27:58.514 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:27:58.514 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:27:58.514 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:27:58.514 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:27:58.514 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:27:58.514 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:27:58.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.515+0000 7f7a759e6640 1 Processor -- start 2026-02-12T17:27:58.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 1 -- start start 2026-02-12T17:27:58.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 10 monclient: init 2026-02-12T17:27:58.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 10 monclient: _reopen_session rank -1 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 10 monclient(hunting): picked mon.noname-c con 0x7f7a70142b10 addr v1:10.20.193.82:6789/0 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 10 monclient(hunting): picked mon.noname-b con 0x7f7a7008ff60 addr v1:10.20.193.57:6790/0 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 10 monclient(hunting): picked mon.noname-a con 0x7f7a7005de60 addr v1:10.20.193.57:6789/0 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a700953c0 con 0x7f7a7005de60 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7005d110 con 0x7f7a70142b10 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7005d3f0 con 0x7f7a7008ff60 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 10 monclient(hunting): _renew_subs 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a759e6640 10 monclient(hunting): authenticate will time out at 558.335398s 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a6effd640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f7a70142b10 0x7f7a70142ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:32776/0 (socket says 10.20.193.57:32776) 2026-02-12T17:27:58.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.516+0000 7f7a6effd640 1 -- 10.20.193.57:0/3461355691 learned_addr learned my addr 10.20.193.57:0/3461355691 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:27:58.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.518+0000 7f7a6f7fe640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.57:6789/0 conn(0x7f7a7005de60 legacy=0x7f7a701a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:27:58.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.518+0000 7f7a6e7fc640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.57:6790/0 conn(0x7f7a7008ff60 legacy=0x7f7a70183840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:27:58.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:27:58.518+0000 7f7a6effd640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.82:6789/0 conn(0x7f7a70142b10 legacy=0x7f7a70142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:01.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 10 monclient(hunting): tick 2026-02-12T17:28:01.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:28:01.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 1 monclient(hunting): continuing hunt 2026-02-12T17:28:01.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:28:01.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.57:6790/0 conn(0x7f7a7008ff60 legacy=0x7f7a70183840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:01.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.82:6789/0 conn(0x7f7a70142b10 legacy=0x7f7a70142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:01.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.57:6789/0 conn(0x7f7a7005de60 legacy=0x7f7a701a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:01.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:01.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 10 monclient(hunting): picked mon.noname-a con 0x7f7a7005de60 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:01.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 10 monclient(hunting): picked mon.noname-b con 0x7f7a7008ff60 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:01.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 10 monclient(hunting): picked mon.noname-c con 0x7f7a70142b10 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:01.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 1 -- 10.20.193.57:0/3461355691 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7005d6d0 con 0x7f7a7005de60 2026-02-12T17:28:01.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 1 -- 10.20.193.57:0/3461355691 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a54069130 con 0x7f7a70142b10 2026-02-12T17:28:01.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 1 -- 10.20.193.57:0/3461355691 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5406a390 con 0x7f7a7008ff60 2026-02-12T17:28:01.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.516+0000 7f7a6cff9640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:01.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.518+0000 7f7a6e7fc640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.57:6790/0 conn(0x7f7a7008ff60 legacy=0x7f7a54045110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:01.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.518+0000 7f7a6effd640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.57:6789/0 conn(0x7f7a7005de60 legacy=0x7f7a54023930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:01.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.518+0000 7f7a6f7fe640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.82:6789/0 conn(0x7f7a70142b10 legacy=0x7f7a54066940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:01.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:01.518+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:28:03.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133601264 0 0) 0x7f7a7005d6d0 con 0x7f7a7005de60 2026-02-12T17:28:03.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:03.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:03.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:03.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient(hunting): my global_id is 4098 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a5c0035e0 con 0x7f7a7005de60 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2142022350 0 0) 0x7f7a5c0035e0 con 0x7f7a7005de60 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.57:6790/0 conn(0x7f7a7008ff60 legacy=0x7f7a54045110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.82:6789/0 conn(0x7f7a70142b10 legacy=0x7f7a54066940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 monclient: found mon.noname-a 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5406b5f0 con 0x7f7a7005de60 2026-02-12T17:28:03.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a64003110 con 0x7f7a7005de60 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: dump: 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:03.752 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a759e6640 5 monclient: authenticate success, global_id 4098 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a759e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a64003410 con 0x7f7a7005de60 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 1 -- 10.20.193.57:0/3461355691 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a64004b10 con 0x7f7a7005de60 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:03.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a6dffb640 10 monclient: dump: 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:03.754 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a759e6640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.749+0000 7f7a759e6640 4 set_mon_vals no callback set 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 10 monclient: shutdown 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 1 -- 10.20.193.57:0/3461355691 >> v1:10.20.193.57:6789/0 conn(0x7f7a7005de60 legacy=0x7f7a54023930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 1 -- 10.20.193.57:0/3461355691 shutdown_connections 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 1 -- 10.20.193.57:0/3461355691 >> 10.20.193.57:0/3461355691 conn(0x7f7a700544d0 msgr2=0x7f7a700548d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 1 -- 10.20.193.57:0/3461355691 shutdown_connections 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 1 -- 10.20.193.57:0/3461355691 wait complete. 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 10 monclient: build_initial_monmap 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 10 monclient: monmap: 2026-02-12T17:28:03.755 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 1 Processor -- start 2026-02-12T17:28:03.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 1 -- start start 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.750+0000 7f7a759e6640 10 monclient: init 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 10 monclient(hunting): picked mon.noname-c con 0x7f7a7005de60 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 10 monclient(hunting): picked mon.noname-b con 0x7f7a7008ff60 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 10 monclient(hunting): picked mon.noname-a con 0x7f7a70142b10 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7008fa80 con 0x7f7a70142b10 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7012f0e0 con 0x7f7a7008ff60 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a701421c0 con 0x7f7a7005de60 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a759e6640 10 monclient(hunting): authenticate will time out at 563.570213s 2026-02-12T17:28:03.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a6effd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f7a7005de60 0x7f7a7013fe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:37514/0 (socket says 10.20.193.57:37514) 2026-02-12T17:28:03.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.751+0000 7f7a6effd640 1 -- 10.20.193.57:0/1231825945 learned_addr learned my addr 10.20.193.57:0/1231825945 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:03.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a6f7fe640 1 -- 10.20.193.57:0/1231825945 >> v1:10.20.193.57:6789/0 conn(0x7f7a70142b10 legacy=0x7f7a7023c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a6effd640 1 -- 10.20.193.57:0/1231825945 >> v1:10.20.193.57:6790/0 conn(0x7f7a7005de60 legacy=0x7f7a7013fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a6e7fc640 1 -- 10.20.193.57:0/1231825945 >> v1:10.20.193.82:6789/0 conn(0x7f7a7008ff60 legacy=0x7f7a7021a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144306701 0 0) 0x7f7a54069130 con 0x7f7a70142b10 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): my global_id is 4104 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a400035e0 con 0x7f7a70142b10 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517325890 0 0) 0x7f7a7012f0e0 con 0x7f7a7008ff60 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:03.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): my global_id is 4102 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a54069130 con 0x7f7a7008ff60 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 506997120 0 0) 0x7f7a400035e0 con 0x7f7a70142b10 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a7012f0e0 con 0x7f7a70142b10 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a600043a0 con 0x7f7a70142b10 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): dump: 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:03.763 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2985958176 0 0) 0x7f7a54069130 con 0x7f7a7008ff60 2026-02-12T17:28:03.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a400035e0 con 0x7f7a7008ff60 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a58003310 con 0x7f7a7008ff60 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient(hunting): dump: 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:03.765 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3771234797 0 0) 0x7f7a7012f0e0 con 0x7f7a70142b10 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 >> v1:10.20.193.57:6790/0 conn(0x7f7a7005de60 legacy=0x7f7a7013fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 >> v1:10.20.193.82:6789/0 conn(0x7f7a7008ff60 legacy=0x7f7a7021a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 monclient: found mon.a 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a70062c40 con 0x7f7a70142b10 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:03.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a47fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a759e6640 5 monclient: authenticate success, global_id 4104 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a759e6640 10 monclient: _renew_subs 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a759e6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a759e6640 1 -- 10.20.193.57:0/1231825945 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a70131440 con 0x7f7a70142b10 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a759e6640 10 monclient: _renew_subs 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a759e6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.753+0000 7f7a759e6640 1 -- 10.20.193.57:0/1231825945 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a701d7b20 con 0x7f7a70142b10 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a60004580 con 0x7f7a70142b10 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a47fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a60004c10 con 0x7f7a70142b10 2026-02-12T17:28:03.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a47fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a47fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a47fff640 10 monclient: dump: 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:03.768 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7a60005180 con 0x7f7a70142b10 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a6d7fa640 4 set_mon_vals no callback set 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1338912606 0 0) 0x7f7a60007c30 con 0x7f7a70142b10 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a759e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a759e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a759e6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.754+0000 7f7a759e6640 1 -- 10.20.193.57:0/1231825945 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a701da560 con 0x7f7a70142b10 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.755+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f7a701da560 con 0x7f7a70142b10 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.755+0000 7f7a47fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:03.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.755+0000 7f7a47fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:03.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.783+0000 7f7a759e6640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-12T17:28:03.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.783+0000 7f7a759e6640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-12T17:28:03.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.783+0000 7f7a759e6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.783+0000 7f7a759e6640 1 -- 10.20.193.57:0/1231825945 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7f7a70055340 con 0x7f7a70142b10 2026-02-12T17:28:03.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a47fff640 1 -- 10.20.193.57:0/1231825945 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7f7a7008fa80 con 0x7f7a70142b10 2026-02-12T17:28:03.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a47fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-12T17:28:03.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a47fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:03.783 INFO:teuthology.orchestra.run.trial057.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T17:28:03.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a759e6640 10 monclient: shutdown 2026-02-12T17:28:03.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a759e6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:03.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a759e6640 1 -- 10.20.193.57:0/1231825945 >> v1:10.20.193.57:6789/0 conn(0x7f7a70142b10 legacy=0x7f7a7023c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a759e6640 1 -- 10.20.193.57:0/1231825945 shutdown_connections 2026-02-12T17:28:03.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a759e6640 1 -- 10.20.193.57:0/1231825945 >> 10.20.193.57:0/1231825945 conn(0x7f7a700544d0 msgr2=0x7f7a70089fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:03.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a759e6640 1 -- 10.20.193.57:0/1231825945 shutdown_connections 2026-02-12T17:28:03.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.784+0000 7f7a759e6640 1 -- 10.20.193.57:0/1231825945 wait complete. 2026-02-12T17:28:03.790 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T17:28:03.790 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T17:28:03.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.856+0000 7f266abb9640 10 monclient: get_monmap_and_config 2026-02-12T17:28:03.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.856+0000 7f266abb9640 10 monclient: build_initial_monmap 2026-02-12T17:28:03.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.856+0000 7f266abb9640 10 monclient: monmap: 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:03.857338+0000 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:03.857338+0000 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.856+0000 7f266abb9640 1 Processor -- start 2026-02-12T17:28:03.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.856+0000 7f266abb9640 1 -- start start 2026-02-12T17:28:03.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.856+0000 7f266abb9640 10 monclient: init 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 10 monclient(hunting): picked mon.noname-c con 0x7f266408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 10 monclient(hunting): picked mon.noname-a con 0x7f266408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 10 monclient(hunting): picked mon.noname-b con 0x7f2664182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266408a820 con 0x7f266408c620 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2664089450 con 0x7f266408c250 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2664089730 con 0x7f2664182cc0 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:03.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f266abb9640 10 monclient(hunting): authenticate will time out at 563.676347s 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f265bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f266408c620 0x7f266408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:48164/0 (socket says 10.20.193.57:48164) 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.857+0000 7f265bfff640 1 -- 10.20.193.57:0/918841988 learned_addr learned my addr 10.20.193.57:0/918841988 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265bfff640 1 -- 10.20.193.57:0/918841988 >> v1:10.20.193.57:6789/0 conn(0x7f266408c620 legacy=0x7f266408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f266912f640 1 -- 10.20.193.57:0/918841988 >> v1:10.20.193.57:6790/0 conn(0x7f2664182cc0 legacy=0x7f26641a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f266892e640 1 -- 10.20.193.57:0/918841988 >> v1:10.20.193.82:6789/0 conn(0x7f266408c250 legacy=0x7f266408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180573462 0 0) 0x7f264c002c20 con 0x7f266408c620 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient(hunting): my global_id is 4110 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26500035e0 con 0x7f266408c620 2026-02-12T17:28:03.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3933295884 0 0) 0x7f2664089450 con 0x7f266408c250 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient(hunting): my global_id is 4108 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f264c002c20 con 0x7f266408c250 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1862973446 0 0) 0x7f26500035e0 con 0x7f266408c620 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 >> v1:10.20.193.57:6790/0 conn(0x7f2664182cc0 legacy=0x7f26641a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 >> v1:10.20.193.82:6789/0 conn(0x7f266408c250 legacy=0x7f266408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 monclient: found mon.noname-a 2026-02-12T17:28:03.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2664089a10 con 0x7f266408c620 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f264c0032e0 con 0x7f266408c620 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f265b7fe640 10 monclient: dump: 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.867 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f266abb9640 5 monclient: authenticate success, global_id 4110 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.859+0000 7f266abb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f264c004960 con 0x7f266408c620 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f265b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:03.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f265b7fe640 1 -- 10.20.193.57:0/918841988 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f264c004cf0 con 0x7f266408c620 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 4 set_mon_vals no callback set 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f265b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f265b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f265b7fe640 10 monclient: dump: 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.869 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 10 monclient: shutdown 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 1 -- 10.20.193.57:0/918841988 >> v1:10.20.193.57:6789/0 conn(0x7f266408c620 legacy=0x7f266408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 1 -- 10.20.193.57:0/918841988 shutdown_connections 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 1 -- 10.20.193.57:0/918841988 >> 10.20.193.57:0/918841988 conn(0x7f26640916b0 msgr2=0x7f2664091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 1 -- 10.20.193.57:0/918841988 shutdown_connections 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 1 -- 10.20.193.57:0/918841988 wait complete. 2026-02-12T17:28:03.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 10 monclient: build_initial_monmap 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.860+0000 7f266abb9640 10 monclient: monmap: 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 1 Processor -- start 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 1 -- start start 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 10 monclient: init 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 10 monclient(hunting): picked mon.noname-b con 0x7f266408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 10 monclient(hunting): picked mon.noname-a con 0x7f266408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 10 monclient(hunting): picked mon.noname-c con 0x7f2664182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2664138950 con 0x7f266408c620 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266413db60 con 0x7f266408c250 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26641375a0 con 0x7f2664182cc0 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f266abb9640 10 monclient(hunting): authenticate will time out at 563.680363s 2026-02-12T17:28:03.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f265bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f266408c620 0x7f2664136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:48168/0 (socket says 10.20.193.57:48168) 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.861+0000 7f265bfff640 1 -- 10.20.193.57:0/1885177562 learned_addr learned my addr 10.20.193.57:0/1885177562 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f265bfff640 1 -- 10.20.193.57:0/1885177562 >> v1:10.20.193.57:6789/0 conn(0x7f266408c620 legacy=0x7f2664136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f266912f640 1 -- 10.20.193.57:0/1885177562 >> v1:10.20.193.57:6790/0 conn(0x7f2664182cc0 legacy=0x7f2664193440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f266912f640 1 -- 10.20.193.57:0/1885177562 >> v1:10.20.193.57:6790/0 conn(0x7f2664182cc0 legacy=0x7f2664193440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f266912f640 1 -- 10.20.193.57:0/1885177562 >> v1:10.20.193.57:6790/0 conn(0x7f2664182cc0 legacy=0x7f2664193440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f266912f640 1 --1- 10.20.193.57:0/1885177562 >> v1:10.20.193.57:6790/0 conn(0x7f2664182cc0 0x7f2664193440 :-1 s=OPENED pgs=21 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f266912f640 1 --1- 10.20.193.57:0/1885177562 >> v1:10.20.193.57:6790/0 conn(0x7f2664182cc0 0x7f2664193440 :-1 s=OPENED pgs=21 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.57:6790/0 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3751134359 0 0) 0x7f2664138950 con 0x7f266408c620 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:03.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): my global_id is 4113 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26340035e0 con 0x7f266408c620 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f266892e640 1 -- 10.20.193.57:0/1885177562 >> v1:10.20.193.82:6789/0 conn(0x7f266408c250 legacy=0x7f2664136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4101958911 0 0) 0x7f26340035e0 con 0x7f266408c620 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2664138950 con 0x7f266408c620 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f264c0032e0 con 0x7f266408c620 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): dump: 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.874 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864898976 0 0) 0x7f266413db60 con 0x7f266408c250 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:03.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient(hunting): my global_id is 4111 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26340035e0 con 0x7f266408c250 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3863006901 0 0) 0x7f2664138950 con 0x7f266408c620 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 >> v1:10.20.193.57:6790/0 conn(0x7f2664182cc0 legacy=0x7f2664193440 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 >> v1:10.20.193.82:6789/0 conn(0x7f266408c250 legacy=0x7f2664136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 monclient: found mon.a 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26641380c0 con 0x7f266408c620 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:03.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f26597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f266abb9640 5 monclient: authenticate success, global_id 4113 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.863+0000 7f266abb9640 10 monclient: _renew_subs 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f266abb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f266abb9640 1 -- 10.20.193.57:0/1885177562 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2664138f10 con 0x7f266408c620 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f266abb9640 10 monclient: _renew_subs 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f266abb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f266abb9640 1 -- 10.20.193.57:0/1885177562 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2664138c30 con 0x7f266408c620 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f264c0052d0 con 0x7f266408c620 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f26597fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f264c0055f0 con 0x7f266408c620 2026-02-12T17:28:03.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f26597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f26597fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f26597fa640 10 monclient: dump: 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:03.878 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f265affd640 4 set_mon_vals no callback set 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f264c005b60 con 0x7f266408c620 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 1338912606 0 0) 0x7f264c006fb0 con 0x7f266408c620 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f266abb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f266abb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f266abb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.864+0000 7f266abb9640 1 -- 10.20.193.57:0/1885177562 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2664090810 con 0x7f266408c620 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.865+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f266408a820 con 0x7f266408c620 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.865+0000 7f26597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:03.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.865+0000 7f26597fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:03.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.895+0000 7f266abb9640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-12T17:28:03.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.895+0000 7f266abb9640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-12T17:28:03.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.895+0000 7f266abb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:03.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:03.895+0000 7f266abb9640 1 -- 10.20.193.57:0/1885177562 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f26641382e0 con 0x7f266408c620 2026-02-12T17:28:04.579 INFO:tasks.ceph.mgr.x.trial082.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T17:28:04.579 INFO:tasks.ceph.mgr.x.trial082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T17:28:04.579 INFO:tasks.ceph.mgr.x.trial082.stderr: from numpy import show_config as show_numpy_config 2026-02-12T17:28:04.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f26597fa640 1 -- 10.20.193.57:0/1885177562 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f264c005fa0 con 0x7f266408c620 2026-02-12T17:28:04.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f26597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-12T17:28:04.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f26597fa640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-12T17:28:04.665 INFO:teuthology.orchestra.run.trial057.stderr:adjusted tunables profile to default 2026-02-12T17:28:04.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f266abb9640 10 monclient: shutdown 2026-02-12T17:28:04.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f266abb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:04.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f266abb9640 1 -- 10.20.193.57:0/1885177562 >> v1:10.20.193.57:6789/0 conn(0x7f266408c620 legacy=0x7f2664136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:04.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f266abb9640 1 -- 10.20.193.57:0/1885177562 shutdown_connections 2026-02-12T17:28:04.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f266abb9640 1 -- 10.20.193.57:0/1885177562 >> 10.20.193.57:0/1885177562 conn(0x7f26640916b0 msgr2=0x7f266408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:04.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f266abb9640 1 -- 10.20.193.57:0/1885177562 shutdown_connections 2026-02-12T17:28:04.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:04.666+0000 7f266abb9640 1 -- 10.20.193.57:0/1885177562 wait complete. 2026-02-12T17:28:04.671 INFO:tasks.ceph:check_enable_crimson: False 2026-02-12T17:28:04.671 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T17:28:04.672 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:28:04.672 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T17:28:04.696 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:28:04.697 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T17:28:04.760 DEBUG:teuthology.orchestra.run.trial057:> set -ex 2026-02-12T17:28:04.761 DEBUG:teuthology.orchestra.run.trial057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T17:28:04.824 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:28:04.824 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-12T17:28:04.849 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:28:04.849 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-12T17:28:04.913 DEBUG:teuthology.orchestra.run.trial082:> set -ex 2026-02-12T17:28:04.913 DEBUG:teuthology.orchestra.run.trial082:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-12T17:28:04.977 DEBUG:teuthology.orchestra.run.trial082:> sudo ceph --cluster ceph osd new 08ee67d7-4cf0-452b-a362-8a5526fccd74 0 2026-02-12T17:28:05.081 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient: get_monmap_and_config 2026-02-12T17:28:05.081 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient: build_initial_monmap 2026-02-12T17:28:05.081 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient: monmap: 2026-02-12T17:28:05.081 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:05.081 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.081 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:28:05.079396+0000 2026-02-12T17:28:05.081 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:28:05.079396+0000 2026-02-12T17:28:05.081 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 1 Processor -- start 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 1 -- start start 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient: init 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:05.082 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient(hunting): picked mon.noname-b con 0x7f4de008b5e0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient(hunting): picked mon.noname-c con 0x7f4de0085c20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient(hunting): picked mon.noname-a con 0x7f4de00860a0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de008b9b0 con 0x7f4de00860a0 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de008dd60 con 0x7f4de0085c20 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de008d5d0 con 0x7f4de008b5e0 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.078+0000 7f4de5403640 10 monclient(hunting): authenticate will time out at 568.774979s 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.079+0000 7f4ddf7fe640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f4de0085c20 0x7f4de0180630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60388/0 (socket says 10.20.193.82:60388) 2026-02-12T17:28:05.083 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.079+0000 7f4ddf7fe640 1 -- 10.20.193.82:0/1422567857 learned_addr learned my addr 10.20.193.82:0/1422567857 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddf7fe640 1 -- 10.20.193.82:0/1422567857 >> v1:10.20.193.82:6789/0 conn(0x7f4de0085c20 legacy=0x7f4de0180630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddffff640 1 -- 10.20.193.82:0/1422567857 >> v1:10.20.193.57:6790/0 conn(0x7f4de008b5e0 legacy=0x7f4de0085510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 284716251 0 0) 0x7f4de008dd60 con 0x7f4de0085c20 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient(hunting): my global_id is 4114 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4de4c02640 1 -- 10.20.193.82:0/1422567857 >> v1:10.20.193.57:6789/0 conn(0x7f4de00860a0 legacy=0x7f4de01a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dc40035e0 con 0x7f4de0085c20 2026-02-12T17:28:05.091 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182307351 0 0) 0x7f4de008b9b0 con 0x7f4de00860a0 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient(hunting): my global_id is 4116 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4de008dd60 con 0x7f4de00860a0 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1337134089 0 0) 0x7f4dc40035e0 con 0x7f4de0085c20 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 >> v1:10.20.193.57:6790/0 conn(0x7f4de008b5e0 legacy=0x7f4de0085510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 >> v1:10.20.193.57:6789/0 conn(0x7f4de00860a0 legacy=0x7f4de01a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 monclient: found mon.noname-c 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:05.092 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de0087360 con 0x7f4de0085c20 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4dd00030d0 con 0x7f4de0085c20 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4de5403640 5 monclient: authenticate success, global_id 4114 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4de5403640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: dump: 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.093 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4de5403640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4dd00033d0 con 0x7f4de0085c20 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:05.094 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 1 -- 10.20.193.82:0/1422567857 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4dd0004b10 con 0x7f4de0085c20 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4ddeffd640 10 monclient: dump: 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.095 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4de5403640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.081+0000 7f4de5403640 4 set_mon_vals no callback set 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 10 monclient: shutdown 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 1 -- 10.20.193.82:0/1422567857 >> v1:10.20.193.82:6789/0 conn(0x7f4de0085c20 legacy=0x7f4de0180630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 1 -- 10.20.193.82:0/1422567857 shutdown_connections 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 1 -- 10.20.193.82:0/1422567857 >> 10.20.193.82:0/1422567857 conn(0x7f4de0090410 msgr2=0x7f4de00914a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 1 -- 10.20.193.82:0/1422567857 shutdown_connections 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 1 -- 10.20.193.82:0/1422567857 wait complete. 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 10 monclient: build_initial_monmap 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 10 monclient: monmap: 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:05.096 INFO:teuthology.orchestra.run.trial082.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 0.000000 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:created 0.000000 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 1 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 1 Processor -- start 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 1 -- start start 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.082+0000 7f4de5403640 10 monclient: init 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:05.097 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 10 monclient(hunting): picked mon.noname-b con 0x7f4de0085c20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 10 monclient(hunting): picked mon.noname-a con 0x7f4de00860a0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 10 monclient(hunting): picked mon.noname-c con 0x7f4de008b5e0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de007f670 con 0x7f4de00860a0 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de0085630 con 0x7f4de0085c20 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de007f840 con 0x7f4de008b5e0 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4de5403640 10 monclient(hunting): authenticate will time out at 568.779177s 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4ddffff640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f4de0085c20 0x7f4de01d74d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60396/0 (socket says 10.20.193.82:60396) 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.083+0000 7f4ddffff640 1 -- 10.20.193.82:0/2527969717 learned_addr learned my addr 10.20.193.82:0/2527969717 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:05.098 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddffff640 1 -- 10.20.193.82:0/2527969717 >> v1:10.20.193.82:6789/0 conn(0x7f4de0085c20 legacy=0x7f4de01d74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298329407 0 0) 0x7f4de0085630 con 0x7f4de0085c20 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): my global_id is 4117 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4db00035e0 con 0x7f4de0085c20 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4de4c02640 1 -- 10.20.193.82:0/2527969717 >> v1:10.20.193.57:6790/0 conn(0x7f4de008b5e0 legacy=0x7f4de0239810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddf7fe640 1 -- 10.20.193.82:0/2527969717 >> v1:10.20.193.57:6789/0 conn(0x7f4de00860a0 legacy=0x7f4de00847c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3523498847 0 0) 0x7f4db00035e0 con 0x7f4de0085c20 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4de0085630 con 0x7f4de0085c20 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4dcc0033e0 con 0x7f4de0085c20 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:05.099 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): dump: 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:05.100 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844908064 0 0) 0x7f4de007f840 con 0x7f4de008b5e0 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient(hunting): my global_id is 4109 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4db00035e0 con 0x7f4de008b5e0 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3622831645 0 0) 0x7f4de0085630 con 0x7f4de0085c20 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 >> v1:10.20.193.57:6790/0 conn(0x7f4de008b5e0 legacy=0x7f4de0239810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 >> v1:10.20.193.57:6789/0 conn(0x7f4de00860a0 legacy=0x7f4de00847c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient: _finish_hunting 0 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 monclient: found mon.b 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:05.101 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de0057b20 con 0x7f4de0085c20 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient: _finish_auth 0 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 10 monclient: _check_auth_tickets 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4ddcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4de5403640 5 monclient: authenticate success, global_id 4117 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4de5403640 10 monclient: _renew_subs 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4de5403640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4de5403640 1 -- 10.20.193.82:0/2527969717 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4de0088690 con 0x7f4de0085c20 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4de5403640 10 monclient: _renew_subs 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4de5403640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.085+0000 7f4de5403640 1 -- 10.20.193.82:0/2527969717 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4de0084ed0 con 0x7f4de0085c20 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4dcc003980 con 0x7f4de0085c20 2026-02-12T17:28:05.102 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4ddcff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4dcc003ca0 con 0x7f4de0085c20 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4ddcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4ddcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4dde7fc640 4 set_mon_vals no callback set 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4ddcff9640 10 monclient: dump: 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.103 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f4dcc004240 con 0x7f4de0085c20 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 3126987896 0 0) 0x7f4dcc006d40 con 0x7f4de0085c20 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4de5403640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4de5403640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4de5403640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.086+0000 7f4de5403640 1 -- 10.20.193.82:0/2527969717 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de00594f0 con 0x7f4de0085c20 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.087+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f4dcc006240 con 0x7f4de0085c20 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.087+0000 7f4ddcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.104 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.087+0000 7f4ddcff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:05.124 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.122+0000 7f4de5403640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "08ee67d7-4cf0-452b-a362-8a5526fccd74", "id": 0}] 2026-02-12T17:28:05.124 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.122+0000 7f4de5403640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "08ee67d7-4cf0-452b-a362-8a5526fccd74", "id": 0}] 2026-02-12T17:28:05.124 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.122+0000 7f4de5403640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.124 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.122+0000 7f4de5403640 1 -- 10.20.193.82:0/2527969717 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "osd new", "uuid": "08ee67d7-4cf0-452b-a362-8a5526fccd74", "id": 0} v 0) -- 0x7f4de0058f30 con 0x7f4de0085c20 2026-02-12T17:28:05.126 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.124+0000 7f4ddcff9640 1 -- 10.20.193.82:0/2527969717 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08ee67d7-4cf0-452b-a362-8a5526fccd74", "id": 0}]=0 v3) ==== 112+0+2 (unknown 1173308208 0 732707515) 0x7f4dcc0058d0 con 0x7f4de0085c20 2026-02-12T17:28:05.126 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.124+0000 7f4ddcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "08ee67d7-4cf0-452b-a362-8a5526fccd74", "id": 0}] 2026-02-12T17:28:05.126 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.124+0000 7f4ddcff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:05.127 INFO:teuthology.orchestra.run.trial082.stdout:0 2026-02-12T17:28:05.128 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.125+0000 7f4de5403640 10 monclient: shutdown 2026-02-12T17:28:05.128 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.125+0000 7f4de5403640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:05.128 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.125+0000 7f4de5403640 1 -- 10.20.193.82:0/2527969717 >> v1:10.20.193.82:6789/0 conn(0x7f4de0085c20 legacy=0x7f4de01d74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.128 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.125+0000 7f4de5403640 1 -- 10.20.193.82:0/2527969717 shutdown_connections 2026-02-12T17:28:05.128 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.125+0000 7f4de5403640 1 -- 10.20.193.82:0/2527969717 >> 10.20.193.82:0/2527969717 conn(0x7f4de0090410 msgr2=0x7f4de008c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:05.128 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.125+0000 7f4de5403640 1 -- 10.20.193.82:0/2527969717 shutdown_connections 2026-02-12T17:28:05.128 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.125+0000 7f4de5403640 1 -- 10.20.193.82:0/2527969717 wait complete. 2026-02-12T17:28:05.135 DEBUG:teuthology.orchestra.run.trial082:> sudo ceph --cluster ceph osd new d2ec9481-5b72-4197-a3ed-b1029fb07580 1 2026-02-12T17:28:05.198 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.196+0000 7fca2128c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:05.198 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.196+0000 7fca2128c640 10 monclient: build_initial_monmap 2026-02-12T17:28:05.198 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.196+0000 7fca2128c640 10 monclient: monmap: 2026-02-12T17:28:05.198 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:05.198 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.198 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:28:05.197654+0000 2026-02-12T17:28:05.199 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:28:05.197654+0000 2026-02-12T17:28:05.199 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:05.199 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.199 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:05.199 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:05.199 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:05.199 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 1 Processor -- start 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 1 -- start start 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 10 monclient: init 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 10 monclient(hunting): picked mon.noname-a con 0x7fca1c0906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 10 monclient(hunting): picked mon.noname-c con 0x7fca1c0911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 10 monclient(hunting): picked mon.noname-b con 0x7fca1c185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c090100 con 0x7fca1c0906d0 2026-02-12T17:28:05.201 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c091a70 con 0x7fca1c0911b0 2026-02-12T17:28:05.202 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c092360 con 0x7fca1c185070 2026-02-12T17:28:05.202 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:05.202 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca2128c640 10 monclient(hunting): authenticate will time out at 568.893439s 2026-02-12T17:28:05.202 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca1a7fc640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7fca1c0911b0 0x7fca1c183950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60400/0 (socket says 10.20.193.82:60400) 2026-02-12T17:28:05.202 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.197+0000 7fca1a7fc640 1 -- 10.20.193.82:0/3478176292 learned_addr learned my addr 10.20.193.82:0/3478176292 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:05.210 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.199+0000 7fca1a7fc640 1 -- 10.20.193.82:0/3478176292 >> v1:10.20.193.82:6789/0 conn(0x7fca1c0911b0 legacy=0x7fca1c183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.210 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.199+0000 7fca1b7fe640 1 -- 10.20.193.82:0/3478176292 >> v1:10.20.193.57:6790/0 conn(0x7fca1c185070 legacy=0x7fca1c1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.210 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.199+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2106025728 0 0) 0x7fca1c091a70 con 0x7fca1c0911b0 2026-02-12T17:28:05.210 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.199+0000 7fca19ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.210 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.199+0000 7fca19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.210 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.199+0000 7fca19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.199+0000 7fca19ffb640 10 monclient(hunting): my global_id is 4120 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.199+0000 7fca1affd640 1 -- 10.20.193.82:0/3478176292 >> v1:10.20.193.57:6789/0 conn(0x7fca1c0906d0 legacy=0x7fca1c090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.199+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca080035e0 con 0x7fca1c0911b0 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188527582 0 0) 0x7fca1c092360 con 0x7fca1c185070 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient(hunting): my global_id is 4112 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c091a70 con 0x7fca1c185070 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3593386728 0 0) 0x7fca080035e0 con 0x7fca1c0911b0 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 >> v1:10.20.193.57:6790/0 conn(0x7fca1c185070 legacy=0x7fca1c1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.211 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 >> v1:10.20.193.57:6789/0 conn(0x7fca1c0906d0 legacy=0x7fca1c090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 monclient: found mon.noname-c 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c05cf80 con 0x7fca1c0911b0 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fca040030d0 con 0x7fca1c0911b0 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:05.212 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: dump: 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 5 monclient: authenticate success, global_id 4120 2026-02-12T17:28:05.213 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca04003360 con 0x7fca1c0911b0 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 1 -- 10.20.193.82:0/3478176292 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fca04004960 con 0x7fca1c0911b0 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca19ffb640 10 monclient: dump: 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.214 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 4 set_mon_vals no callback set 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 10 monclient: shutdown 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 1 -- 10.20.193.82:0/3478176292 >> v1:10.20.193.82:6789/0 conn(0x7fca1c0911b0 legacy=0x7fca1c183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 1 -- 10.20.193.82:0/3478176292 shutdown_connections 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 1 -- 10.20.193.82:0/3478176292 >> 10.20.193.82:0/3478176292 conn(0x7fca1c054330 msgr2=0x7fca1c054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 1 -- 10.20.193.82:0/3478176292 shutdown_connections 2026-02-12T17:28:05.215 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 1 -- 10.20.193.82:0/3478176292 wait complete. 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 10 monclient: build_initial_monmap 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.200+0000 7fca2128c640 10 monclient: monmap: 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 0.000000 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:created 0.000000 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 1 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.216 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 1 Processor -- start 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 1 -- start start 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 10 monclient: init 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 10 monclient(hunting): picked mon.noname-c con 0x7fca1c0906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 10 monclient(hunting): picked mon.noname-a con 0x7fca1c0911b0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 10 monclient(hunting): picked mon.noname-b con 0x7fca1c185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c133b00 con 0x7fca1c0911b0 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c133de0 con 0x7fca1c185070 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c062bb0 con 0x7fca1c0906d0 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:05.217 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca2128c640 10 monclient(hunting): authenticate will time out at 568.897431s 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca1a7fc640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fca1c0911b0 0x7fca1c173e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.82:60914/0 (socket says 10.20.193.82:60914) 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca1b7fe640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7fca1c185070 0x7fca1c1755a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60408/0 (socket says 10.20.193.82:60408) 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.201+0000 7fca1a7fc640 1 -- 10.20.193.82:0/3175159196 learned_addr learned my addr 10.20.193.82:0/3175159196 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fca1b7fe640 1 -- 10.20.193.82:0/3175159196 >> v1:10.20.193.82:6789/0 conn(0x7fca1c185070 legacy=0x7fca1c1755a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fca1affd640 1 -- 10.20.193.82:0/3175159196 >> v1:10.20.193.57:6790/0 conn(0x7fca1c0906d0 legacy=0x7fca1c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fca1a7fc640 1 -- 10.20.193.82:0/3175159196 >> v1:10.20.193.57:6789/0 conn(0x7fca1c0911b0 legacy=0x7fca1c173e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543374951 0 0) 0x7fca1c133de0 con 0x7fca1c185070 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): my global_id is 4123 2026-02-12T17:28:05.218 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9e80035e0 con 0x7fca1c185070 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341120854 0 0) 0x7fca1c133b00 con 0x7fca1c0911b0 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): my global_id is 4125 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c133de0 con 0x7fca1c0911b0 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083619639 0 0) 0x7fca1c062bb0 con 0x7fca1c0906d0 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): my global_id is 4115 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c133b00 con 0x7fca1c0906d0 2026-02-12T17:28:05.219 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3332901030 0 0) 0x7fc9e80035e0 con 0x7fca1c185070 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca1c062bb0 con 0x7fca1c185070 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fca0c004490 con 0x7fca1c185070 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): dump: 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.220 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.203+0000 7fc9fb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1317776339 0 0) 0x7fca1c133de0 con 0x7fca1c0911b0 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc9e80035e0 con 0x7fca1c0911b0 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fca04002b50 con 0x7fca1c0911b0 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient(hunting): dump: 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.221 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 532283087 0 0) 0x7fca1c133b00 con 0x7fca1c0906d0 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca1c133de0 con 0x7fca1c0906d0 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fca10003190 con 0x7fca1c0906d0 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient(hunting): dump: 2026-02-12T17:28:05.222 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3188200190 0 0) 0x7fca1c062bb0 con 0x7fca1c185070 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 >> v1:10.20.193.57:6790/0 conn(0x7fca1c0906d0 legacy=0x7fca1c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.223 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 >> v1:10.20.193.57:6789/0 conn(0x7fca1c0911b0 legacy=0x7fca1c173e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 monclient: found mon.b 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c1433a0 con 0x7fca1c185070 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 5 monclient: authenticate success, global_id 4123 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 10 monclient: _renew_subs 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.224 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fca1c131a80 con 0x7fca1c185070 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 10 monclient: _renew_subs 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fca1c133210 con 0x7fca1c185070 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca0c004a60 con 0x7fca1c185070 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fca0c004d80 con 0x7fca1c185070 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 10 monclient: dump: 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.225 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca197fa640 4 set_mon_vals no callback set 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fca0c005360 con 0x7fca1c185070 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 946747490 0 0) 0x7fca0c007da0 con 0x7fca1c185070 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.226 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.204+0000 7fca2128c640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1c132640 con 0x7fca1c185070 2026-02-12T17:28:05.227 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.205+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fca0c006960 con 0x7fca1c185070 2026-02-12T17:28:05.227 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.205+0000 7fc9fb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.227 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.205+0000 7fc9fb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:05.240 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.238+0000 7fca2128c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d2ec9481-5b72-4197-a3ed-b1029fb07580", "id": 1}] 2026-02-12T17:28:05.240 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.238+0000 7fca2128c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d2ec9481-5b72-4197-a3ed-b1029fb07580", "id": 1}] 2026-02-12T17:28:05.240 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.238+0000 7fca2128c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.240 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.238+0000 7fca2128c640 1 -- 10.20.193.82:0/3175159196 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "osd new", "uuid": "d2ec9481-5b72-4197-a3ed-b1029fb07580", "id": 1} v 0) -- 0x7fca1c055340 con 0x7fca1c185070 2026-02-12T17:28:05.702 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.701+0000 7fc9fb7fe640 1 -- 10.20.193.82:0/3175159196 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2ec9481-5b72-4197-a3ed-b1029fb07580", "id": 1}]=0 v4) ==== 112+0+2 (unknown 2810484362 0 940483276) 0x7fca0c006ba0 con 0x7fca1c185070 2026-02-12T17:28:05.703 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.701+0000 7fc9fb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d2ec9481-5b72-4197-a3ed-b1029fb07580", "id": 1}] 2026-02-12T17:28:05.703 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.701+0000 7fc9fb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:05.703 INFO:teuthology.orchestra.run.trial082.stdout:1 2026-02-12T17:28:05.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.702+0000 7fca2128c640 10 monclient: shutdown 2026-02-12T17:28:05.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.702+0000 7fca2128c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:05.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.702+0000 7fca2128c640 1 -- 10.20.193.82:0/3175159196 >> v1:10.20.193.82:6789/0 conn(0x7fca1c185070 legacy=0x7fca1c1755a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.702+0000 7fca2128c640 1 -- 10.20.193.82:0/3175159196 shutdown_connections 2026-02-12T17:28:05.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.702+0000 7fca2128c640 1 -- 10.20.193.82:0/3175159196 >> 10.20.193.82:0/3175159196 conn(0x7fca1c054330 msgr2=0x7fca1c08eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:05.705 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.702+0000 7fca2128c640 1 -- 10.20.193.82:0/3175159196 shutdown_connections 2026-02-12T17:28:05.705 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.702+0000 7fca2128c640 1 -- 10.20.193.82:0/3175159196 wait complete. 2026-02-12T17:28:05.714 DEBUG:teuthology.orchestra.run.trial082:> sudo ceph --cluster ceph osd new 7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2 2 2026-02-12T17:28:05.778 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.776+0000 7fae3150c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:05.778 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.776+0000 7fae3150c640 10 monclient: build_initial_monmap 2026-02-12T17:28:05.778 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.776+0000 7fae3150c640 10 monclient: monmap: 2026-02-12T17:28:05.778 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:05.778 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.778 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:28:05.777450+0000 2026-02-12T17:28:05.778 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:28:05.777450+0000 2026-02-12T17:28:05.779 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:05.779 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.779 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:05.779 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:05.779 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:05.779 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.776+0000 7fae3150c640 1 Processor -- start 2026-02-12T17:28:05.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.776+0000 7fae3150c640 1 -- start start 2026-02-12T17:28:05.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.776+0000 7fae3150c640 10 monclient: init 2026-02-12T17:28:05.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:05.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:05.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 10 monclient(hunting): picked mon.noname-b con 0x7fae2c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:05.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 10 monclient(hunting): picked mon.noname-a con 0x7fae2c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 10 monclient(hunting): picked mon.noname-c con 0x7fae2c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2c08a820 con 0x7fae2c08c620 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2c089450 con 0x7fae2c182cc0 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2c089730 con 0x7fae2c08c250 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae3150c640 10 monclient(hunting): authenticate will time out at 569.473079s 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae2b7fe640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7fae2c182cc0 0x7fae2c1a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60416/0 (socket says 10.20.193.82:60416) 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.777+0000 7fae2b7fe640 1 -- 10.20.193.82:0/4222595921 learned_addr learned my addr 10.20.193.82:0/4222595921 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae2b7fe640 1 -- 10.20.193.82:0/4222595921 >> v1:10.20.193.82:6789/0 conn(0x7fae2c182cc0 legacy=0x7fae2c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 -- 10.20.193.82:0/4222595921 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999613489 0 0) 0x7fae2c089450 con 0x7fae2c182cc0 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient(hunting): my global_id is 4126 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 -- 10.20.193.82:0/4222595921 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae180035e0 con 0x7fae2c182cc0 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae2affd640 1 -- 10.20.193.82:0/4222595921 >> v1:10.20.193.57:6790/0 conn(0x7fae2c08c250 legacy=0x7fae2c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae2a7fc640 1 -- 10.20.193.82:0/4222595921 >> v1:10.20.193.57:6789/0 conn(0x7fae2c08c620 legacy=0x7fae2c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 -- 10.20.193.82:0/4222595921 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 104516271 0 0) 0x7fae180035e0 con 0x7fae2c182cc0 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 -- 10.20.193.82:0/4222595921 >> v1:10.20.193.57:6790/0 conn(0x7fae2c08c250 legacy=0x7fae2c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 -- 10.20.193.82:0/4222595921 >> v1:10.20.193.57:6789/0 conn(0x7fae2c08c620 legacy=0x7fae2c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:05.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 monclient: found mon.noname-c 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 -- 10.20.193.82:0/4222595921 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c089a10 con 0x7fae2c182cc0 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 -- 10.20.193.82:0/4222595921 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae1c0041b0 con 0x7fae2c182cc0 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: dump: 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.789 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae3150c640 5 monclient: authenticate success, global_id 4126 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae3150c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 -- 10.20.193.82:0/4222595921 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae1c0044b0 con 0x7fae2c182cc0 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:05.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 1 -- 10.20.193.82:0/4222595921 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae1c005bf0 con 0x7fae2c182cc0 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae3150c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae3150c640 4 set_mon_vals no callback set 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.779+0000 7fae29ffb640 10 monclient: dump: 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.791 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 10 monclient: shutdown 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 1 -- 10.20.193.82:0/4222595921 >> v1:10.20.193.82:6789/0 conn(0x7fae2c182cc0 legacy=0x7fae2c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 1 -- 10.20.193.82:0/4222595921 shutdown_connections 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 1 -- 10.20.193.82:0/4222595921 >> 10.20.193.82:0/4222595921 conn(0x7fae2c0916b0 msgr2=0x7fae2c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 1 -- 10.20.193.82:0/4222595921 shutdown_connections 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 1 -- 10.20.193.82:0/4222595921 wait complete. 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 10 monclient: build_initial_monmap 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 10 monclient: monmap: 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:05.792 INFO:teuthology.orchestra.run.trial082.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 0.000000 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:created 0.000000 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 1 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.780+0000 7fae3150c640 1 Processor -- start 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 1 -- start start 2026-02-12T17:28:05.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 10 monclient: init 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 10 monclient(hunting): picked mon.noname-b con 0x7fae2c08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 10 monclient(hunting): picked mon.noname-c con 0x7fae2c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 10 monclient(hunting): picked mon.noname-a con 0x7fae2c182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2c1394c0 con 0x7fae2c182cc0 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2c138f00 con 0x7fae2c08c250 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae2c1391e0 con 0x7fae2c08c620 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae3150c640 10 monclient(hunting): authenticate will time out at 569.477289s 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae2affd640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7fae2c08c250 0x7fae2c136780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60422/0 (socket says 10.20.193.82:60422) 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.781+0000 7fae2affd640 1 -- 10.20.193.82:0/734000240 learned_addr learned my addr 10.20.193.82:0/734000240 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:05.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae2affd640 1 -- 10.20.193.82:0/734000240 >> v1:10.20.193.82:6789/0 conn(0x7fae2c08c250 legacy=0x7fae2c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348875106 0 0) 0x7fae2c138f00 con 0x7fae2c08c250 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): my global_id is 4129 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadf80035e0 con 0x7fae2c08c250 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae2b7fe640 1 -- 10.20.193.82:0/734000240 >> v1:10.20.193.57:6789/0 conn(0x7fae2c182cc0 legacy=0x7fae2c193490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 253982185 0 0) 0x7fadf80035e0 con 0x7fae2c08c250 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae2c138f00 con 0x7fae2c08c250 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae20003460 con 0x7fae2c08c250 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:05.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): dump: 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:05.796 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309190405 0 0) 0x7fae2c1394c0 con 0x7fae2c182cc0 2026-02-12T17:28:05.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 10 monclient(hunting): my global_id is 4131 2026-02-12T17:28:05.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadf80035e0 con 0x7fae2c182cc0 2026-02-12T17:28:05.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:28:05.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.783+0000 7fae2a7fc640 1 -- 10.20.193.82:0/734000240 >> v1:10.20.193.57:6790/0 conn(0x7fae2c08c620 legacy=0x7fae2c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.799 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 444062428 0 0) 0x7fae2c138f00 con 0x7fae2c08c250 2026-02-12T17:28:05.799 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 >> v1:10.20.193.57:6790/0 conn(0x7fae2c08c620 legacy=0x7fae2c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.799 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 >> v1:10.20.193.57:6789/0 conn(0x7fae2c182cc0 legacy=0x7fae2c193490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 1 monclient: found mon.b 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c1375a0 con 0x7fae2c08c250 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae3150c640 5 monclient: authenticate success, global_id 4129 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae3150c640 10 monclient: _renew_subs 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae3150c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae3150c640 1 -- 10.20.193.82:0/734000240 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c13ed50 con 0x7fae2c08c250 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae3150c640 10 monclient: _renew_subs 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae3150c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.785+0000 7fae3150c640 1 -- 10.20.193.82:0/734000240 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fae2c138c20 con 0x7fae2c08c250 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae200039f0 con 0x7fae2c08c250 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae0b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae20003d10 con 0x7fae2c08c250 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae0b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae0b7fe640 10 monclient: dump: 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.801 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fae20004330 con 0x7fae2c08c250 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae297fa640 4 set_mon_vals no callback set 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 1524545479 0 0) 0x7fae20005ca0 con 0x7fae2c08c250 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae3150c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae3150c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.802 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae3150c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.803 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.786+0000 7fae3150c640 1 -- 10.20.193.82:0/734000240 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2c08f0d0 con 0x7fae2c08c250 2026-02-12T17:28:05.803 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.787+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fae20005880 con 0x7fae2c08c250 2026-02-12T17:28:05.803 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.787+0000 7fae0b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.803 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.787+0000 7fae0b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:05.822 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.820+0000 7fae3150c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2", "id": 2}] 2026-02-12T17:28:05.822 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.820+0000 7fae3150c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2", "id": 2}] 2026-02-12T17:28:05.823 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.820+0000 7fae3150c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:05.823 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.820+0000 7fae3150c640 1 -- 10.20.193.82:0/734000240 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "osd new", "uuid": "7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2", "id": 2} v 0) -- 0x7fae2c18e9c0 con 0x7fae2c08c250 2026-02-12T17:28:05.826 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.824+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mgrmap(e 2) ==== 51714+0+0 (unknown 55003653 0 0) 0x7fae20005eb0 con 0x7fae2c08c250 2026-02-12T17:28:05.832 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.830+0000 7fae0b7fe640 1 -- 10.20.193.82:0/734000240 <== mon.1 v1:10.20.193.82:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2", "id": 2}]=0 v5) ==== 112+0+2 (unknown 2566173047 0 216599125) 0x7fae20005ac0 con 0x7fae2c08c250 2026-02-12T17:28:05.832 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.830+0000 7fae0b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2", "id": 2}] 2026-02-12T17:28:05.832 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.830+0000 7fae0b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:05.832 INFO:teuthology.orchestra.run.trial082.stdout:2 2026-02-12T17:28:05.833 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.830+0000 7fae3150c640 10 monclient: shutdown 2026-02-12T17:28:05.833 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.830+0000 7fae3150c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:05.833 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.830+0000 7fae3150c640 1 -- 10.20.193.82:0/734000240 >> v1:10.20.193.82:6789/0 conn(0x7fae2c08c250 legacy=0x7fae2c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.834 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.831+0000 7fae3150c640 1 -- 10.20.193.82:0/734000240 shutdown_connections 2026-02-12T17:28:05.834 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.831+0000 7fae3150c640 1 -- 10.20.193.82:0/734000240 >> 10.20.193.82:0/734000240 conn(0x7fae2c0916b0 msgr2=0x7fae2c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:05.834 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.831+0000 7fae3150c640 1 -- 10.20.193.82:0/734000240 shutdown_connections 2026-02-12T17:28:05.834 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.831+0000 7fae3150c640 1 -- 10.20.193.82:0/734000240 wait complete. 2026-02-12T17:28:05.840 DEBUG:teuthology.orchestra.run.trial082:> sudo ceph --cluster ceph osd new 108524be-58bc-4950-b88f-d85dfa77ef48 3 2026-02-12T17:28:05.903 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.901+0000 7f81c84cc640 10 monclient: get_monmap_and_config 2026-02-12T17:28:05.903 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.901+0000 7f81c84cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:05.903 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.901+0000 7f81c84cc640 10 monclient: monmap: 2026-02-12T17:28:05.903 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:05.904 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.904 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:28:05.902821+0000 2026-02-12T17:28:05.904 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:28:05.902821+0000 2026-02-12T17:28:05.904 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:05.904 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.904 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:05.904 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:05.904 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:05.904 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.910 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 1 Processor -- start 2026-02-12T17:28:05.910 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 1 -- start start 2026-02-12T17:28:05.910 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 10 monclient: init 2026-02-12T17:28:05.910 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:05.910 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:05.910 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 10 monclient(hunting): picked mon.noname-b con 0x7f81c008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:05.910 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 10 monclient(hunting): picked mon.noname-c con 0x7f81c008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:05.910 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 10 monclient(hunting): picked mon.noname-a con 0x7f81c0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:05.910 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c008a820 con 0x7f81c0182cc0 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c0089450 con 0x7f81c008c620 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c0089730 con 0x7f81c008c250 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c84cc640 10 monclient(hunting): authenticate will time out at 569.598487s 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c5a40640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f81c008c620 0x7f81c008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60500/0 (socket says 10.20.193.82:60500) 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.902+0000 7f81c5a40640 1 -- 10.20.193.82:0/870027858 learned_addr learned my addr 10.20.193.82:0/870027858 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.904+0000 7f81c5a40640 1 -- 10.20.193.82:0/870027858 >> v1:10.20.193.82:6789/0 conn(0x7f81c008c620 legacy=0x7f81c008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.904+0000 7f81c6241640 1 -- 10.20.193.82:0/870027858 >> v1:10.20.193.57:6790/0 conn(0x7f81c008c250 legacy=0x7f81c008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.904+0000 7f81c6a42640 1 -- 10.20.193.82:0/870027858 >> v1:10.20.193.57:6789/0 conn(0x7f81c0182cc0 legacy=0x7f81c01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 784670305 0 0) 0x7f81c0089730 con 0x7f81c008c250 2026-02-12T17:28:05.911 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient(hunting): my global_id is 4136 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a80035e0 con 0x7f81c008c250 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2766252320 0 0) 0x7f81bc003d50 con 0x7f81c0182cc0 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient(hunting): my global_id is 4149 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81c0089730 con 0x7f81c0182cc0 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3402513788 0 0) 0x7f81a80035e0 con 0x7f81c008c250 2026-02-12T17:28:05.912 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 >> v1:10.20.193.82:6789/0 conn(0x7f81c008c620 legacy=0x7f81c008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 >> v1:10.20.193.57:6789/0 conn(0x7f81c0182cc0 legacy=0x7f81c01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: _finish_hunting 0 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 monclient: found mon.noname-b 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c0089a10 con 0x7f81c008c250 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: _finish_auth 0 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: _check_auth_tickets 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f81b0003120 con 0x7f81c008c250 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.913 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: dump: 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.914 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 5 monclient: authenticate success, global_id 4136 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f81b0003420 con 0x7f81c008c250 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 1 -- 10.20.193.82:0/870027858 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f81b0003880 con 0x7f81c008c250 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c523f640 10 monclient: dump: 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.915 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 4 set_mon_vals no callback set 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 10 monclient: shutdown 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 1 -- 10.20.193.82:0/870027858 >> v1:10.20.193.57:6790/0 conn(0x7f81c008c250 legacy=0x7f81c008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 1 -- 10.20.193.82:0/870027858 shutdown_connections 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 1 -- 10.20.193.82:0/870027858 >> 10.20.193.82:0/870027858 conn(0x7f81c00916b0 msgr2=0x7f81c0091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:05.916 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 1 -- 10.20.193.82:0/870027858 shutdown_connections 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.905+0000 7f81c84cc640 1 -- 10.20.193.82:0/870027858 wait complete. 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient: monmap: 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 0.000000 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:created 0.000000 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 1 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.917 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 1 Processor -- start 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 1 -- start start 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient: init 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient(hunting): picked mon.noname-c con 0x7f81c008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient(hunting): picked mon.noname-b con 0x7f81c008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient(hunting): picked mon.noname-a con 0x7f81c0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c005af80 con 0x7f81c0182cc0 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c00888a0 con 0x7f81c008c620 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c005bf70 con 0x7f81c008c250 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:05.918 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c84cc640 10 monclient(hunting): authenticate will time out at 569.602778s 2026-02-12T17:28:05.919 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c5a40640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f81c008c620 0x7f81c0194950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60508/0 (socket says 10.20.193.82:60508) 2026-02-12T17:28:05.919 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.906+0000 7f81c5a40640 1 -- 10.20.193.82:0/541423340 learned_addr learned my addr 10.20.193.82:0/541423340 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:05.926 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.908+0000 7f81c5a40640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.82:6789/0 conn(0x7f81c008c620 legacy=0x7f81c0194950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.926 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81c6a42640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6789/0 conn(0x7f81c0182cc0 legacy=0x7f81c0195480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.926 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81c6241640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6790/0 conn(0x7f81c008c250 legacy=0x7f81c0194240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.926 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133454168 0 0) 0x7f81c005bf70 con 0x7f81c008c250 2026-02-12T17:28:05.926 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.926 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.926 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): my global_id is 4139 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81900035e0 con 0x7f81c008c250 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844715058 0 0) 0x7f81c005af80 con 0x7f81c0182cc0 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): my global_id is 4152 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81c005bf70 con 0x7f81c0182cc0 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 891988334 0 0) 0x7f81900035e0 con 0x7f81c008c250 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81c005af80 con 0x7f81c008c250 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f81b00032c0 con 0x7f81c008c250 2026-02-12T17:28:05.927 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.928 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1253434565 0 0) 0x7f81c005bf70 con 0x7f81c0182cc0 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81900035e0 con 0x7f81c0182cc0 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f81bc004620 con 0x7f81c0182cc0 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.929 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2788087183 0 0) 0x7f81900035e0 con 0x7f81c0182cc0 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6790/0 conn(0x7f81c008c250 legacy=0x7f81c0194240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.82:6789/0 conn(0x7f81c008c620 legacy=0x7f81c0194950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 monclient: found mon.a 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:05.930 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c013eb90 con 0x7f81c0182cc0 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81c84cc640 5 monclient: authenticate success, global_id 4152 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81c84cc640 10 monclient: _renew_subs 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81c84cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81c84cc640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f81c005c4a0 con 0x7f81c0182cc0 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81c84cc640 10 monclient: _renew_subs 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81c84cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81c84cc640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f81c005c7e0 con 0x7f81c0182cc0 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f81bc004a60 con 0x7f81c0182cc0 2026-02-12T17:28:05.931 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f81bc004db0 con 0x7f81c0182cc0 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.909+0000 7f81a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81c4a3e640 4 set_mon_vals no callback set 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 10 monclient: dump: 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.932 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81c84cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81c84cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81c84cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81c84cc640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c0090810 con 0x7f81c0182cc0 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 2) ==== 51714+0+0 (unknown 55003653 0 0) 0x7f81bc004f10 con 0x7f81c0182cc0 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81c6a42640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6789/0 conn(0x7f81c0182cc0 legacy=0x7f81c0195480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81c6a42640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6789/0 conn(0x7f81c0182cc0 legacy=0x7f81c0195480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81c6a42640 1 --1- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6789/0 conn(0x7f81c0182cc0 0x7f81c0195480 :-1 s=OPENED pgs=36 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81c6a42640 1 --1- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6789/0 conn(0x7f81c0182cc0 0x7f81c0195480 :-1 s=OPENED pgs=36 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 10 monclient: ms_handle_reset current mon v1:10.20.193.57:6789/0 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:05.933 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6789/0 conn(0x7f81c0182cc0 legacy=0x7f81c0195480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 10 monclient(hunting): picked mon.a con 0x7f819003f7a0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 10 monclient(hunting): picked mon.b con 0x7f81c008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 10 monclient(hunting): picked mon.c con 0x7f81c008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f81900035e0 con 0x7f819003f7a0 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f81c005af80 con 0x7f81c008c620 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f81c005bf70 con 0x7f81c008c250 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.910+0000 7f81a6ffd640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.912+0000 7f81c5a40640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.82:6789/0 conn(0x7f81c008c620 legacy=0x7f8190081580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81c6a42640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6790/0 conn(0x7f81c008c250 legacy=0x7f81900a31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81c6241640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6789/0 conn(0x7f819003f7a0 legacy=0x7f819005fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138641733 0 0) 0x7f81900035e0 con 0x7f819003f7a0 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:05.934 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f81900a6d60 con 0x7f819003f7a0 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 3185609279 0 0) 0x7f81900a6d60 con 0x7f819003f7a0 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6790/0 conn(0x7f81c008c250 legacy=0x7f81900a31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.82:6789/0 conn(0x7f81c008c620 legacy=0x7f8190081580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 monclient: found mon.a 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f81900a7d90 con 0x7f819003f7a0 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81900035e0 con 0x7f819003f7a0 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:05.935 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f81b0003e60 con 0x7f819003f7a0 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: dump: 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:05.936 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f81b00040f0 con 0x7f819003f7a0 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.913+0000 7f81a7fff640 4 set_mon_vals no callback set 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.914+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mgrmap(e 2) ==== 51714+0+0 (unknown 55003653 0 0) 0x7f81b00042e0 con 0x7f819003f7a0 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.914+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 6 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 4156784293 0 0) 0x7f81b004de90 con 0x7f819003f7a0 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.914+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f81b0014630 con 0x7f819003f7a0 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.914+0000 7f81a6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:05.937 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.914+0000 7f81a6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:05.949 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.947+0000 7f81c84cc640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "108524be-58bc-4950-b88f-d85dfa77ef48", "id": 3}] 2026-02-12T17:28:05.949 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.947+0000 7f81c84cc640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "108524be-58bc-4950-b88f-d85dfa77ef48", "id": 3}] 2026-02-12T17:28:05.949 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.947+0000 7f81c84cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:05.949 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.947+0000 7f81c84cc640 1 -- 10.20.193.82:0/541423340 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd new", "uuid": "108524be-58bc-4950-b88f-d85dfa77ef48", "id": 3} v 0) -- 0x7f81c00871c0 con 0x7f819003f7a0 2026-02-12T17:28:05.951 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.949+0000 7f81a6ffd640 1 -- 10.20.193.82:0/541423340 <== mon.0 v1:10.20.193.57:6789/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "108524be-58bc-4950-b88f-d85dfa77ef48", "id": 3}]=0 v6) ==== 112+0+2 (unknown 1886910019 0 525046306) 0x7f81b0014460 con 0x7f819003f7a0 2026-02-12T17:28:05.951 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.949+0000 7f81a6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "108524be-58bc-4950-b88f-d85dfa77ef48", "id": 3}] 2026-02-12T17:28:05.951 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.949+0000 7f81a6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:05.951 INFO:teuthology.orchestra.run.trial082.stdout:3 2026-02-12T17:28:05.952 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.950+0000 7f81c84cc640 10 monclient: shutdown 2026-02-12T17:28:05.952 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.950+0000 7f81c84cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:05.952 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.950+0000 7f81c84cc640 1 -- 10.20.193.82:0/541423340 >> v1:10.20.193.57:6789/0 conn(0x7f819003f7a0 legacy=0x7f819005fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:05.952 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.950+0000 7f81c84cc640 1 -- 10.20.193.82:0/541423340 shutdown_connections 2026-02-12T17:28:05.953 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.950+0000 7f81c84cc640 1 -- 10.20.193.82:0/541423340 >> 10.20.193.82:0/541423340 conn(0x7f81c00916b0 msgr2=0x7f81c008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:05.953 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.950+0000 7f81c84cc640 1 -- 10.20.193.82:0/541423340 shutdown_connections 2026-02-12T17:28:05.953 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:05.950+0000 7f81c84cc640 1 -- 10.20.193.82:0/541423340 wait complete. 2026-02-12T17:28:05.958 DEBUG:teuthology.orchestra.run.trial082:> sudo ceph --cluster ceph osd new e9bb983d-b2d5-4543-a960-f450bede62cb 4 2026-02-12T17:28:06.023 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.020+0000 7f9a51e1b640 10 monclient: get_monmap_and_config 2026-02-12T17:28:06.024 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.020+0000 7f9a51e1b640 10 monclient: build_initial_monmap 2026-02-12T17:28:06.024 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.020+0000 7f9a51e1b640 10 monclient: monmap: 2026-02-12T17:28:06.024 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:06.024 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.024 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:28:06.022084+0000 2026-02-12T17:28:06.024 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:28:06.022084+0000 2026-02-12T17:28:06.024 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:06.024 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.024 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 1 Processor -- start 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 1 -- start start 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 10 monclient: init 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 10 monclient(hunting): picked mon.noname-c con 0x7f9a4c085720 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:06.025 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 10 monclient(hunting): picked mon.noname-b con 0x7f9a4c086ea0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:06.026 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 10 monclient(hunting): picked mon.noname-a con 0x7f9a4c086200 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:06.026 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c088220 con 0x7f9a4c086200 2026-02-12T17:28:06.026 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c089500 con 0x7f9a4c085720 2026-02-12T17:28:06.026 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c087f40 con 0x7f9a4c086ea0 2026-02-12T17:28:06.026 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:06.026 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a51e1b640 10 monclient(hunting): authenticate will time out at 569.717741s 2026-02-12T17:28:06.026 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a4b7fe640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f9a4c085720 0x7f9a4c085af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60530/0 (socket says 10.20.193.82:60530) 2026-02-12T17:28:06.026 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.021+0000 7f9a4b7fe640 1 -- 10.20.193.82:0/1504879396 learned_addr learned my addr 10.20.193.82:0/1504879396 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:06.034 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.023+0000 7f9a4b7fe640 1 -- 10.20.193.82:0/1504879396 >> v1:10.20.193.82:6789/0 conn(0x7f9a4c085720 legacy=0x7f9a4c085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.034 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4bfff640 1 -- 10.20.193.82:0/1504879396 >> v1:10.20.193.57:6789/0 conn(0x7f9a4c086200 legacy=0x7f9a4c1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4affd640 1 -- 10.20.193.82:0/1504879396 >> v1:10.20.193.57:6790/0 conn(0x7f9a4c086ea0 legacy=0x7f9a4c180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863086876 0 0) 0x7f9a4c088220 con 0x7f9a4c086200 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient(hunting): my global_id is 4155 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a300035e0 con 0x7f9a4c086200 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090747734 0 0) 0x7f9a4c087f40 con 0x7f9a4c086ea0 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:06.035 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient(hunting): my global_id is 4142 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a4c088220 con 0x7f9a4c086ea0 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 186782722 0 0) 0x7f9a300035e0 con 0x7f9a4c086200 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 >> v1:10.20.193.57:6790/0 conn(0x7f9a4c086ea0 legacy=0x7f9a4c180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 >> v1:10.20.193.82:6789/0 conn(0x7f9a4c085720 legacy=0x7f9a4c085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 monclient: found mon.noname-a 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c0867e0 con 0x7f9a4c086200 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:06.036 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9a40004200 con 0x7f9a4c086200 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 5 monclient: authenticate success, global_id 4155 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: dump: 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.037 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a40004490 con 0x7f9a4c086200 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 1 -- 10.20.193.82:0/1504879396 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9a40004630 con 0x7f9a4c086200 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 4 set_mon_vals no callback set 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:06.038 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a4a7fc640 10 monclient: dump: 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 10 monclient: shutdown 2026-02-12T17:28:06.039 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 1 -- 10.20.193.82:0/1504879396 >> v1:10.20.193.57:6789/0 conn(0x7f9a4c086200 legacy=0x7f9a4c1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 1 -- 10.20.193.82:0/1504879396 shutdown_connections 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 1 -- 10.20.193.82:0/1504879396 >> 10.20.193.82:0/1504879396 conn(0x7f9a4c0916b0 msgr2=0x7f9a4c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 1 -- 10.20.193.82:0/1504879396 shutdown_connections 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.024+0000 7f9a51e1b640 1 -- 10.20.193.82:0/1504879396 wait complete. 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient: build_initial_monmap 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient: monmap: 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 0.000000 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:created 0.000000 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:06.040 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 1 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 1 Processor -- start 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 1 -- start start 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient: init 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient(hunting): picked mon.noname-a con 0x7f9a4c085720 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient(hunting): picked mon.noname-c con 0x7f9a4c086200 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:06.041 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient(hunting): picked mon.noname-b con 0x7f9a4c086ea0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c11b4c0 con 0x7f9a4c085720 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c08af10 con 0x7f9a4c086ea0 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c05c860 con 0x7f9a4c086200 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a51e1b640 10 monclient(hunting): authenticate will time out at 569.721821s 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a4bfff640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f9a4c086ea0 0x7f9a4c05bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60532/0 (socket says 10.20.193.82:60532) 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.025+0000 7f9a4bfff640 1 -- 10.20.193.82:0/2889686356 learned_addr learned my addr 10.20.193.82:0/2889686356 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.027+0000 7f9a4bfff640 1 -- 10.20.193.82:0/2889686356 >> v1:10.20.193.82:6789/0 conn(0x7f9a4c086ea0 legacy=0x7f9a4c05bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a4b7fe640 1 -- 10.20.193.82:0/2889686356 >> v1:10.20.193.57:6789/0 conn(0x7f9a4c085720 legacy=0x7f9a4c05af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a4affd640 1 -- 10.20.193.82:0/2889686356 >> v1:10.20.193.57:6790/0 conn(0x7f9a4c086200 legacy=0x7f9a4c05b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594906749 0 0) 0x7f9a4c05c860 con 0x7f9a4c086200 2026-02-12T17:28:06.042 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): my global_id is 4145 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a1c0035e0 con 0x7f9a4c086200 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283482293 0 0) 0x7f9a4c11b4c0 con 0x7f9a4c085720 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): my global_id is 4158 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a4c05c860 con 0x7f9a4c085720 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3909509589 0 0) 0x7f9a1c0035e0 con 0x7f9a4c086200 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a4c11b4c0 con 0x7f9a4c086200 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9a3c0033b0 con 0x7f9a4c086200 2026-02-12T17:28:06.043 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): dump: 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.044 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1282890937 0 0) 0x7f9a4c05c860 con 0x7f9a4c085720 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a1c0035e0 con 0x7f9a4c085720 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9a38003230 con 0x7f9a4c085720 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient(hunting): dump: 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.045 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3987045863 0 0) 0x7f9a4c11b4c0 con 0x7f9a4c086200 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 >> v1:10.20.193.82:6789/0 conn(0x7f9a4c086ea0 legacy=0x7f9a4c05bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 >> v1:10.20.193.57:6789/0 conn(0x7f9a4c085720 legacy=0x7f9a4c05af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 monclient: found mon.c 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:06.046 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c11be10 con 0x7f9a4c086200 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a51e1b640 5 monclient: authenticate success, global_id 4145 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a51e1b640 10 monclient: _renew_subs 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a51e1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a51e1b640 1 -- 10.20.193.82:0/2889686356 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4c11c0f0 con 0x7f9a4c086200 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a51e1b640 10 monclient: _renew_subs 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a51e1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a51e1b640 1 -- 10.20.193.82:0/2889686356 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a4c05cf20 con 0x7f9a4c086200 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a3c003980 con 0x7f9a4c086200 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9a3c003ca0 con 0x7f9a4c086200 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:06.047 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.028+0000 7f9a27fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.029+0000 7f9a27fff640 10 monclient: dump: 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.029+0000 7f9a49ffb640 4 set_mon_vals no callback set 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.029+0000 7f9a51e1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:06.048 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.029+0000 7f9a51e1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:06.049 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.029+0000 7f9a51e1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:06.049 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.029+0000 7f9a51e1b640 1 -- 10.20.193.82:0/2889686356 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4c090810 con 0x7f9a4c086200 2026-02-12T17:28:06.049 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.029+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 2) ==== 51714+0+0 (unknown 55003653 0 0) 0x7f9a3c003ec0 con 0x7f9a4c086200 2026-02-12T17:28:06.049 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.029+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 3571766125 0 0) 0x7f9a3c04dbf0 con 0x7f9a4c086200 2026-02-12T17:28:06.049 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.030+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7f9a3c0171f0 con 0x7f9a4c086200 2026-02-12T17:28:06.049 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.030+0000 7f9a27fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:06.049 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.030+0000 7f9a27fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:06.066 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.064+0000 7f9a51e1b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e9bb983d-b2d5-4543-a960-f450bede62cb", "id": 4}] 2026-02-12T17:28:06.066 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.064+0000 7f9a51e1b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e9bb983d-b2d5-4543-a960-f450bede62cb", "id": 4}] 2026-02-12T17:28:06.066 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.064+0000 7f9a51e1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:06.066 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.064+0000 7f9a51e1b640 1 -- 10.20.193.82:0/2889686356 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd new", "uuid": "e9bb983d-b2d5-4543-a960-f450bede62cb", "id": 4} v 0) -- 0x7f9a4c08f5b0 con 0x7f9a4c086200 2026-02-12T17:28:06.702 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.701+0000 7f9a27fff640 1 -- 10.20.193.82:0/2889686356 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9bb983d-b2d5-4543-a960-f450bede62cb", "id": 4}]=0 v7) ==== 112+0+2 (unknown 3844982250 0 1697012583) 0x7f9a3c0191a0 con 0x7f9a4c086200 2026-02-12T17:28:06.702 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.701+0000 7f9a27fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e9bb983d-b2d5-4543-a960-f450bede62cb", "id": 4}] 2026-02-12T17:28:06.703 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.701+0000 7f9a27fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:06.703 INFO:teuthology.orchestra.run.trial082.stdout:4 2026-02-12T17:28:06.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.702+0000 7f9a51e1b640 10 monclient: shutdown 2026-02-12T17:28:06.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.702+0000 7f9a51e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:06.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.702+0000 7f9a51e1b640 1 -- 10.20.193.82:0/2889686356 >> v1:10.20.193.57:6790/0 conn(0x7f9a4c086200 legacy=0x7f9a4c05b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.702+0000 7f9a51e1b640 1 -- 10.20.193.82:0/2889686356 shutdown_connections 2026-02-12T17:28:06.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.702+0000 7f9a51e1b640 1 -- 10.20.193.82:0/2889686356 >> 10.20.193.82:0/2889686356 conn(0x7f9a4c0916b0 msgr2=0x7f9a4c08e190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:06.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.702+0000 7f9a51e1b640 1 -- 10.20.193.82:0/2889686356 shutdown_connections 2026-02-12T17:28:06.704 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.702+0000 7f9a51e1b640 1 -- 10.20.193.82:0/2889686356 wait complete. 2026-02-12T17:28:06.712 DEBUG:teuthology.orchestra.run.trial082:> sudo ceph --cluster ceph osd new 047804d0-f125-4ef6-ac99-8f8ed7d594ac 5 2026-02-12T17:28:06.774 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient: get_monmap_and_config 2026-02-12T17:28:06.774 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient: build_initial_monmap 2026-02-12T17:28:06.774 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient: monmap: 2026-02-12T17:28:06.774 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:06.774 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.774 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:28:06.773384+0000 2026-02-12T17:28:06.774 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:28:06.773384+0000 2026-02-12T17:28:06.774 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:06.774 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.775 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:06.775 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:06.775 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:06.775 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.784 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 1 Processor -- start 2026-02-12T17:28:06.784 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 1 -- start start 2026-02-12T17:28:06.784 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient: init 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient(hunting): picked mon.noname-a con 0x7fa80808c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient(hunting): picked mon.noname-b con 0x7fa80808c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient(hunting): picked mon.noname-c con 0x7fa808182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa80808a820 con 0x7fa80808c250 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa808089450 con 0x7fa808182cc0 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa808089730 con 0x7fa80808c620 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.773+0000 7fa80cfb9640 10 monclient(hunting): authenticate will time out at 570.468963s 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.774+0000 7fa806d76640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7fa808182cc0 0x7fa8081a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.82:60542/0 (socket says 10.20.193.82:60542) 2026-02-12T17:28:06.785 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.774+0000 7fa806d76640 1 -- 10.20.193.82:0/713065026 learned_addr learned my addr 10.20.193.82:0/713065026 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa806d76640 1 -- 10.20.193.82:0/713065026 >> v1:10.20.193.82:6789/0 conn(0x7fa808182cc0 legacy=0x7fa8081a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa806575640 1 -- 10.20.193.82:0/713065026 >> v1:10.20.193.57:6789/0 conn(0x7fa80808c250 legacy=0x7fa80808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805d74640 1 -- 10.20.193.82:0/713065026 >> v1:10.20.193.57:6790/0 conn(0x7fa80808c620 legacy=0x7fa80808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 -- 10.20.193.82:0/713065026 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809655254 0 0) 0x7fa7fc002c70 con 0x7fa80808c250 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient(hunting): my global_id is 4161 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 -- 10.20.193.82:0/713065026 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f40035e0 con 0x7fa80808c250 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 -- 10.20.193.82:0/713065026 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 224807535 0 0) 0x7fa7f40035e0 con 0x7fa80808c250 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 -- 10.20.193.82:0/713065026 >> v1:10.20.193.57:6790/0 conn(0x7fa80808c620 legacy=0x7fa80808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.786 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 -- 10.20.193.82:0/713065026 >> v1:10.20.193.82:6789/0 conn(0x7fa808182cc0 legacy=0x7fa8081a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: _finish_hunting 0 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 monclient: found mon.noname-a 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 -- 10.20.193.82:0/713065026 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa808089a10 con 0x7fa80808c250 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: _finish_auth 0 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: _check_auth_tickets 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 -- 10.20.193.82:0/713065026 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa7fc0032b0 con 0x7fa80808c250 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: dump: 2026-02-12T17:28:06.787 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa80cfb9640 5 monclient: authenticate success, global_id 4161 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa80cfb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:06.788 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 -- 10.20.193.82:0/713065026 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7fc0036d0 con 0x7fa80808c250 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 1 -- 10.20.193.82:0/713065026 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa7fc003a20 con 0x7fa80808c250 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa805573640 10 monclient: dump: 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.789 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa80cfb9640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.776+0000 7fa80cfb9640 4 set_mon_vals no callback set 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient: shutdown 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 -- 10.20.193.82:0/713065026 >> v1:10.20.193.57:6789/0 conn(0x7fa80808c250 legacy=0x7fa80808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 -- 10.20.193.82:0/713065026 shutdown_connections 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 -- 10.20.193.82:0/713065026 >> 10.20.193.82:0/713065026 conn(0x7fa8080916b0 msgr2=0x7fa808091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 -- 10.20.193.82:0/713065026 shutdown_connections 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 -- 10.20.193.82:0/713065026 wait complete. 2026-02-12T17:28:06.790 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient: build_initial_monmap 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient: monmap: 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:epoch 0 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 0.000000 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:created 0.000000 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 1 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 Processor -- start 2026-02-12T17:28:06.791 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 -- start start 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient: init 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient(hunting): picked mon.noname-b con 0x7fa80808c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient(hunting): picked mon.noname-c con 0x7fa80808c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient(hunting): picked mon.noname-a con 0x7fa808182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8081391d0 con 0x7fa808182cc0 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8081375a0 con 0x7fa80808c250 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa80813edc0 con 0x7fa80808c620 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa80cfb9640 10 monclient(hunting): authenticate will time out at 570.472874s 2026-02-12T17:28:06.792 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa806575640 1 -- >> v1:10.20.193.82:6789/0 conn(0x7fa80808c250 legacy=0x7fa808136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa806575640 1 -- >> v1:10.20.193.82:6789/0 conn(0x7fa80808c250 legacy=0x7fa808136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa806575640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7fa80808c250 0x7fa808136780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify read banner and identify addresses failed 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa806575640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7fa80808c250 0x7fa808136780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).fault on lossy channel, failing 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa7eeffd640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.82:6789/0 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.777+0000 7fa805d74640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fa80808c620 0x7fa808136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.82:60496/0 (socket says 10.20.193.82:60496) 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.778+0000 7fa805d74640 1 -- 10.20.193.82:0/2444405988 learned_addr learned my addr 10.20.193.82:0/2444405988 (peer_addr_for_me v1:10.20.193.82:0/0) 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.778+0000 7fa806d76640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fa808182cc0 0x7fa8081934b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.82:32820/0 (socket says 10.20.193.82:32820) 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa806d76640 1 -- 10.20.193.82:0/2444405988 >> v1:10.20.193.57:6789/0 conn(0x7fa808182cc0 legacy=0x7fa8081934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa805d74640 1 -- 10.20.193.82:0/2444405988 >> v1:10.20.193.57:6790/0 conn(0x7fa80808c620 legacy=0x7fa808136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155266532 0 0) 0x7fa8081391d0 con 0x7fa808182cc0 2026-02-12T17:28:06.793 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): my global_id is 4164 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7d40035e0 con 0x7fa808182cc0 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404084602 0 0) 0x7fa80813edc0 con 0x7fa80808c620 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): my global_id is 4151 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8081391d0 con 0x7fa80808c620 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4035937004 0 0) 0x7fa7d40035e0 con 0x7fa808182cc0 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa80813edc0 con 0x7fa808182cc0 2026-02-12T17:28:06.794 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa7f80043d0 con 0x7fa808182cc0 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): dump: 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.795 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2412745825 0 0) 0x7fa8081391d0 con 0x7fa80808c620 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7d40035e0 con 0x7fa80808c620 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa7f00033c0 con 0x7fa80808c620 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient(hunting): dump: 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.796 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2172692361 0 0) 0x7fa80813edc0 con 0x7fa808182cc0 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 >> v1:10.20.193.57:6790/0 conn(0x7fa80808c620 legacy=0x7fa808136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 >> v1:10.20.193.82:6789/0 conn(0x7fa80808c250 legacy=0x7fa808136780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 monclient: found mon.a 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:06.797 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8080888a0 con 0x7fa808182cc0 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa80cfb9640 5 monclient: authenticate success, global_id 4164 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa80cfb9640 10 monclient: _renew_subs 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa80cfb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa80cfb9640 1 -- 10.20.193.82:0/2444405988 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa80805dc10 con 0x7fa808182cc0 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa80cfb9640 10 monclient: _renew_subs 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa80cfb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa80cfb9640 1 -- 10.20.193.82:0/2444405988 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa80818e810 con 0x7fa808182cc0 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7f8005c30 con 0x7fa808182cc0 2026-02-12T17:28:06.798 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa7f8005f80 con 0x7fa808182cc0 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa7eeffd640 10 monclient: dump: 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:epoch 1 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:election_strategy: 3 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:06.799 INFO:teuthology.orchestra.run.trial082.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.780+0000 7fa804d72640 4 set_mon_vals no callback set 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.781+0000 7fa80cfb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.781+0000 7fa80cfb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.781+0000 7fa80cfb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.781+0000 7fa80cfb9640 1 -- 10.20.193.82:0/2444405988 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa808139000 con 0x7fa808182cc0 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.781+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 2) ==== 51714+0+0 (unknown 55003653 0 0) 0x7fa7f8006210 con 0x7fa808182cc0 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.781+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 3884278073 0 0) 0x7fa7f804eca0 con 0x7fa808182cc0 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.782+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (unknown 1092875540 0 2392355004) 0x7fa7f8018230 con 0x7fa808182cc0 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.782+0000 7fa7eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:06.800 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.782+0000 7fa7eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:06.815 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.814+0000 7fa80cfb9640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "047804d0-f125-4ef6-ac99-8f8ed7d594ac", "id": 5}] 2026-02-12T17:28:06.816 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.814+0000 7fa80cfb9640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "047804d0-f125-4ef6-ac99-8f8ed7d594ac", "id": 5}] 2026-02-12T17:28:06.816 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.814+0000 7fa80cfb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:06.816 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.814+0000 7fa80cfb9640 1 -- 10.20.193.82:0/2444405988 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd new", "uuid": "047804d0-f125-4ef6-ac99-8f8ed7d594ac", "id": 5} v 0) -- 0x7fa808138db0 con 0x7fa808182cc0 2026-02-12T17:28:06.941 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.940+0000 7fa7eeffd640 1 -- 10.20.193.82:0/2444405988 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "047804d0-f125-4ef6-ac99-8f8ed7d594ac", "id": 5}]=0 v8) ==== 112+0+2 (unknown 3970102793 0 1988412176) 0x7fa7f80161c0 con 0x7fa808182cc0 2026-02-12T17:28:06.941 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.940+0000 7fa7eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "047804d0-f125-4ef6-ac99-8f8ed7d594ac", "id": 5}] 2026-02-12T17:28:06.941 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.940+0000 7fa7eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:06.941 INFO:teuthology.orchestra.run.trial082.stdout:5 2026-02-12T17:28:06.942 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.940+0000 7fa80cfb9640 10 monclient: shutdown 2026-02-12T17:28:06.942 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.940+0000 7fa80cfb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:06.942 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.940+0000 7fa80cfb9640 1 -- 10.20.193.82:0/2444405988 >> v1:10.20.193.57:6789/0 conn(0x7fa808182cc0 legacy=0x7fa8081934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:06.942 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.941+0000 7fa80cfb9640 1 -- 10.20.193.82:0/2444405988 shutdown_connections 2026-02-12T17:28:06.942 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.941+0000 7fa80cfb9640 1 -- 10.20.193.82:0/2444405988 >> 10.20.193.82:0/2444405988 conn(0x7fa8080916b0 msgr2=0x7fa80808a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:06.942 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.941+0000 7fa80cfb9640 1 -- 10.20.193.82:0/2444405988 shutdown_connections 2026-02-12T17:28:06.943 INFO:teuthology.orchestra.run.trial082.stderr:2026-02-12T17:28:06.941+0000 7fa80cfb9640 1 -- 10.20.193.82:0/2444405988 wait complete. 2026-02-12T17:28:06.949 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T17:28:06.950 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-12T17:28:06.950 INFO:tasks.ceph.mgr.x.trial082.stderr:2026-02-12T17:28:06.949+0000 7f1a1a1a1640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-12T17:28:06.952 INFO:tasks.ceph.osd.0:Started 2026-02-12T17:28:06.952 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T17:28:06.952 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-12T17:28:06.954 INFO:tasks.ceph.mgr.x.trial082.stderr:2026-02-12T17:28:06.953+0000 7f1a1a1a1640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-12T17:28:06.955 INFO:tasks.ceph.osd.1:Started 2026-02-12T17:28:06.955 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T17:28:06.955 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-12T17:28:06.957 INFO:tasks.ceph.osd.2:Started 2026-02-12T17:28:06.957 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-12T17:28:06.957 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-12T17:28:06.959 INFO:tasks.ceph.osd.3:Started 2026-02-12T17:28:06.960 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-12T17:28:06.960 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-12T17:28:06.962 INFO:tasks.ceph.osd.4:Started 2026-02-12T17:28:06.963 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-12T17:28:06.963 DEBUG:teuthology.orchestra.run.trial082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-12T17:28:06.965 INFO:tasks.ceph.osd.5:Started 2026-02-12T17:28:06.965 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T17:28:07.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.033+0000 7f0841d94640 10 monclient: get_monmap_and_config 2026-02-12T17:28:07.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.033+0000 7f0841d94640 10 monclient: build_initial_monmap 2026-02-12T17:28:07.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.033+0000 7f0841d94640 10 monclient: monmap: 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:07.034742+0000 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:07.034742+0000 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:07.032 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 1 Processor -- start 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 1 -- start start 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 10 monclient: init 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 10 monclient(hunting): picked mon.noname-c con 0x7f083c088b20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 10 monclient(hunting): picked mon.noname-b con 0x7f083c08a960 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 10 monclient(hunting): picked mon.noname-a con 0x7f083c089600 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c08a0d0 con 0x7f083c089600 2026-02-12T17:28:07.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c08ba10 con 0x7f083c088b20 2026-02-12T17:28:07.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c08b170 con 0x7f083c08a960 2026-02-12T17:28:07.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:07.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f0841d94640 10 monclient(hunting): authenticate will time out at 566.853837s 2026-02-12T17:28:07.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f083affd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f083c08a960 0x7f083c1809c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:37560/0 (socket says 10.20.193.57:37560) 2026-02-12T17:28:07.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.034+0000 7f083affd640 1 -- 10.20.193.57:0/822331813 learned_addr learned my addr 10.20.193.57:0/822331813 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083affd640 1 -- 10.20.193.57:0/822331813 >> v1:10.20.193.57:6790/0 conn(0x7f083c08a960 legacy=0x7f083c1809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083bfff640 1 -- 10.20.193.57:0/822331813 >> v1:10.20.193.57:6789/0 conn(0x7f083c089600 legacy=0x7f083c1a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101214293 0 0) 0x7f083c08b170 con 0x7f083c08a960 2026-02-12T17:28:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient(hunting): my global_id is 4166 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083b7fe640 1 -- 10.20.193.57:0/822331813 >> v1:10.20.193.82:6789/0 conn(0x7f083c088b20 legacy=0x7f083c088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08200035e0 con 0x7f083c08a960 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556117346 0 0) 0x7f083c08a0d0 con 0x7f083c089600 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient(hunting): my global_id is 4185 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f083c08b170 con 0x7f083c089600 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3633087593 0 0) 0x7f08200035e0 con 0x7f083c08a960 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 >> v1:10.20.193.82:6789/0 conn(0x7f083c088b20 legacy=0x7f083c088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 >> v1:10.20.193.57:6789/0 conn(0x7f083c089600 legacy=0x7f083c1a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 monclient: found mon.noname-b 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c0574f0 con 0x7f083c08a960 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f082c0030d0 con 0x7f083c08a960 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: dump: 2026-02-12T17:28:07.044 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 5 monclient: authenticate success, global_id 4166 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:07.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f082c0033d0 con 0x7f083c08a960 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 1 -- 10.20.193.57:0/822331813 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f082c004b10 con 0x7f083c08a960 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 4 set_mon_vals no callback set 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f083a7fc640 10 monclient: dump: 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.046 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 10 monclient: shutdown 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 1 -- 10.20.193.57:0/822331813 >> v1:10.20.193.57:6790/0 conn(0x7f083c08a960 legacy=0x7f083c1809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 1 -- 10.20.193.57:0/822331813 shutdown_connections 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 1 -- 10.20.193.57:0/822331813 >> 10.20.193.57:0/822331813 conn(0x7f083c091620 msgr2=0x7f083c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 1 -- 10.20.193.57:0/822331813 shutdown_connections 2026-02-12T17:28:07.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.037+0000 7f0841d94640 1 -- 10.20.193.57:0/822331813 wait complete. 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient: build_initial_monmap 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient: monmap: 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:07.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 1 Processor -- start 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 1 -- start start 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient: init 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient(hunting): picked mon.noname-b con 0x7f083c088b20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient(hunting): picked mon.noname-c con 0x7f083c089600 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient(hunting): picked mon.noname-a con 0x7f083c08a960 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c088810 con 0x7f083c08a960 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c085d40 con 0x7f083c088b20 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c086270 con 0x7f083c089600 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f0841d94640 10 monclient(hunting): authenticate will time out at 566.857754s 2026-02-12T17:28:07.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f083affd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f083c089600 0x7f083c0879d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:37564/0 (socket says 10.20.193.57:37564) 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f083affd640 1 -- 10.20.193.57:0/2580056166 learned_addr learned my addr 10.20.193.57:0/2580056166 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.038+0000 7f083bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f083c08a960 0x7f083c194fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:48220/0 (socket says 10.20.193.57:48220) 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.040+0000 7f083affd640 1 -- 10.20.193.57:0/2580056166 >> v1:10.20.193.57:6790/0 conn(0x7f083c089600 legacy=0x7f083c0879d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.040+0000 7f083bfff640 1 -- 10.20.193.57:0/2580056166 >> v1:10.20.193.57:6789/0 conn(0x7f083c08a960 legacy=0x7f083c194fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f083b7fe640 1 -- 10.20.193.57:0/2580056166 >> v1:10.20.193.82:6789/0 conn(0x7f083c088b20 legacy=0x7f083c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658846222 0 0) 0x7f083c086270 con 0x7f083c089600 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): my global_id is 4169 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f080c0035e0 con 0x7f083c089600 2026-02-12T17:28:07.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928063536 0 0) 0x7f083c088810 con 0x7f083c08a960 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): my global_id is 4188 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f083c086270 con 0x7f083c08a960 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3375849377 0 0) 0x7f080c0035e0 con 0x7f083c089600 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f083c088810 con 0x7f083c089600 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f082c004a50 con 0x7f083c089600 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): dump: 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:07.051 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281797645 0 0) 0x7f083c085d40 con 0x7f083c088b20 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): my global_id is 4150 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f080c0035e0 con 0x7f083c088b20 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3977868097 0 0) 0x7f083c086270 con 0x7f083c08a960 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f083c085d40 con 0x7f083c08a960 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0830004490 con 0x7f083c08a960 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient(hunting): dump: 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.053 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1174033299 0 0) 0x7f083c088810 con 0x7f083c089600 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 >> v1:10.20.193.82:6789/0 conn(0x7f083c088b20 legacy=0x7f083c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 >> v1:10.20.193.57:6789/0 conn(0x7f083c08a960 legacy=0x7f083c194fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 monclient: found mon.c 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:07.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c153400 con 0x7f083c089600 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 5 monclient: authenticate success, global_id 4169 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 10 monclient: _renew_subs 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f083c083f70 con 0x7f083c089600 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 10 monclient: _renew_subs 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f083c0880e0 con 0x7f083c089600 2026-02-12T17:28:07.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f082c003540 con 0x7f083c089600 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f082c002b30 con 0x7f083c089600 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0817fff640 10 monclient: dump: 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.056 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0839ffb640 4 set_mon_vals no callback set 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.041+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083c0008d0 con 0x7f083c089600 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.042+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 3) ==== 51806+0+0 (unknown 2046111300 0 0) 0x7f082c011d10 con 0x7f083c089600 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.042+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 3113446419 0 0) 0x7f082c04df50 con 0x7f083c089600 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.042+0000 7f083b7fe640 10 monclient: get_auth_request con 0x7f080c03fb60 auth_method 0 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.044+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f082c013790 con 0x7f083c089600 2026-02-12T17:28:07.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.044+0000 7f0817fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:07.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.044+0000 7f0817fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:07.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.151+0000 7f0841d94640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:07.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.151+0000 7f0841d94640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:07.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.151+0000 7f0841d94640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:07.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.151+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f083c085ef0 con 0x7f083c089600 2026-02-12T17:28:07.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.151+0000 7f0817fff640 1 -- 10.20.193.57:0/2580056166 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 1818935521) 0x7f083c085ef0 con 0x7f083c089600 2026-02-12T17:28:07.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.151+0000 7f0817fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:07.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.151+0000 7f0817fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:07.150 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:07.150 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":8,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","created":"2026-02-12T17:28:03.716456+0000","modified":"2026-02-12T17:28:06.940287+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T17:28:06.940287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"08ee67d7-4cf0-452b-a362-8a5526fccd74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2ec9481-5b72-4197-a3ed-b1029fb07580","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"108524be-58bc-4950-b88f-d85dfa77ef48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e9bb983d-b2d5-4543-a960-f450bede62cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"047804d0-f125-4ef6-ac99-8f8ed7d594ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T17:28:07.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.153+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 >> v1:10.20.193.82:6800/2441377515 conn(0x7f080c03fb60 legacy=0x7f080c060010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.153+0000 7f0841d94640 10 monclient: shutdown 2026-02-12T17:28:07.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.153+0000 7f0841d94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:07.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.153+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 >> v1:10.20.193.57:6790/0 conn(0x7f083c089600 legacy=0x7f083c0879d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.153+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 shutdown_connections 2026-02-12T17:28:07.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.153+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 >> 10.20.193.57:0/2580056166 conn(0x7f083c091620 msgr2=0x7f083c08c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:07.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.153+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 shutdown_connections 2026-02-12T17:28:07.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:07.153+0000 7f0841d94640 1 -- 10.20.193.57:0/2580056166 wait complete. 2026-02-12T17:28:07.159 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T17:28:07.159 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T17:28:07.170 INFO:tasks.ceph.osd.3.trial082.stderr:2026-02-12T17:28:07.169+0000 7f6f3523a780 -1 Falling back to public interface 2026-02-12T17:28:07.174 INFO:tasks.ceph.osd.4.trial082.stderr:2026-02-12T17:28:07.173+0000 7f5b4ebfd780 -1 Falling back to public interface 2026-02-12T17:28:07.183 INFO:tasks.ceph.osd.5.trial082.stderr:2026-02-12T17:28:07.182+0000 7effca05d780 -1 Falling back to public interface 2026-02-12T17:28:07.211 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-12T17:28:07.213+0000 7fb5cd83b780 -1 Falling back to public interface 2026-02-12T17:28:07.211 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-12T17:28:07.213+0000 7fc76b23a780 -1 Falling back to public interface 2026-02-12T17:28:07.211 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-12T17:28:07.213+0000 7fc7691fd640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2026-02-12T17:28:07.220 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-12T17:28:07.222+0000 7f038240a780 -1 Falling back to public interface 2026-02-12T17:28:07.672 INFO:tasks.ceph.osd.3.trial082.stderr:2026-02-12T17:28:07.671+0000 7f6f3523a780 -1 osd.3 0 log_to_monitors true 2026-02-12T17:28:07.683 INFO:tasks.ceph.osd.4.trial082.stderr:2026-02-12T17:28:07.682+0000 7f5b4ebfd780 -1 osd.4 0 log_to_monitors true 2026-02-12T17:28:07.684 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-12T17:28:07.687+0000 7fb5cd83b780 -1 osd.1 0 log_to_monitors true 2026-02-12T17:28:07.696 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-12T17:28:07.699+0000 7fc76b23a780 -1 osd.0 0 log_to_monitors true 2026-02-12T17:28:07.703 INFO:tasks.ceph.osd.5.trial082.stderr:2026-02-12T17:28:07.703+0000 7effca05d780 -1 osd.5 0 log_to_monitors true 2026-02-12T17:28:07.713 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-12T17:28:07.716+0000 7f038240a780 -1 osd.2 0 log_to_monitors true 2026-02-12T17:28:07.763 DEBUG:teuthology.orchestra.run.trial057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T17:28:07.821 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.823+0000 7fbe4581b640 10 monclient: get_monmap_and_config 2026-02-12T17:28:07.821 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.823+0000 7fbe4581b640 10 monclient: build_initial_monmap 2026-02-12T17:28:07.821 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.823+0000 7fbe4581b640 10 monclient: monmap: 2026-02-12T17:28:07.821 INFO:teuthology.misc.health.trial057.stderr:epoch 0 2026-02-12T17:28:07.821 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.822 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:28:07.824526+0000 2026-02-12T17:28:07.822 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:28:07.824526+0000 2026-02-12T17:28:07.822 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:07.822 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.822 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:07.822 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:07.822 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:07.822 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:07.827 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 1 Processor -- start 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 1 -- start start 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 10 monclient: init 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 10 monclient(hunting): picked mon.noname-c con 0x7fbe4008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 10 monclient(hunting): picked mon.noname-b con 0x7fbe4008c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 10 monclient(hunting): picked mon.noname-a con 0x7fbe4008cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4008d600 con 0x7fbe4008cb30 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4008b1f0 con 0x7fbe4008ae20 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4008d1f0 con 0x7fbe4008c730 2026-02-12T17:28:07.828 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe4581b640 10 monclient(hunting): authenticate will time out at 567.643411s 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe3e7fc640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbe4008c730 0x7fbe40181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:37606/0 (socket says 10.20.193.57:37606) 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.824+0000 7fbe3e7fc640 1 -- 10.20.193.57:0/3647928024 learned_addr learned my addr 10.20.193.57:0/3647928024 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3e7fc640 1 -- 10.20.193.57:0/3647928024 >> v1:10.20.193.57:6790/0 conn(0x7fbe4008c730 legacy=0x7fbe40181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3f7fe640 1 -- 10.20.193.57:0/3647928024 >> v1:10.20.193.57:6789/0 conn(0x7fbe4008cb30 legacy=0x7fbe401a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3effd640 1 -- 10.20.193.57:0/3647928024 >> v1:10.20.193.82:6789/0 conn(0x7fbe4008ae20 legacy=0x7fbe4008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3946561283 0 0) 0x7fbe4008d1f0 con 0x7fbe4008c730 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): my global_id is 4184 2026-02-12T17:28:07.829 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe2c0035e0 con 0x7fbe4008c730 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322055913 0 0) 0x7fbe4008d600 con 0x7fbe4008cb30 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): my global_id is 4209 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe4008d1f0 con 0x7fbe4008cb30 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002658450 0 0) 0x7fbe4008b1f0 con 0x7fbe4008ae20 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 10 monclient(hunting): my global_id is 4171 2026-02-12T17:28:07.830 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.826+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe4008d600 con 0x7fbe4008ae20 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 162927243 0 0) 0x7fbe2c0035e0 con 0x7fbe4008c730 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 >> v1:10.20.193.82:6789/0 conn(0x7fbe4008ae20 legacy=0x7fbe4008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 >> v1:10.20.193.57:6789/0 conn(0x7fbe4008cb30 legacy=0x7fbe401a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 1 monclient: found mon.noname-b 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe40057320 con 0x7fbe4008c730 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:07.831 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 5 monclient: authenticate success, global_id 4184 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbe280030c0 con 0x7fbe4008c730 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: dump: 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.832 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe28003350 con 0x7fbe4008c730 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 4 set_mon_vals no callback set 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 1 -- 10.20.193.57:0/3647928024 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbe28003570 con 0x7fbe4008c730 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe3dffb640 10 monclient: dump: 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.833 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 10 monclient: shutdown 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 1 -- 10.20.193.57:0/3647928024 >> v1:10.20.193.57:6790/0 conn(0x7fbe4008c730 legacy=0x7fbe40181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.834 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 1 -- 10.20.193.57:0/3647928024 shutdown_connections 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 1 -- 10.20.193.57:0/3647928024 >> 10.20.193.57:0/3647928024 conn(0x7fbe40091620 msgr2=0x7fbe40091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 1 -- 10.20.193.57:0/3647928024 shutdown_connections 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 1 -- 10.20.193.57:0/3647928024 wait complete. 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 10 monclient: build_initial_monmap 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.827+0000 7fbe4581b640 10 monclient: monmap: 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:epoch 0 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:created 0.000000 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 1 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:07.835 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 1 Processor -- start 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 1 -- start start 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 10 monclient: init 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 10 monclient(hunting): picked mon.noname-c con 0x7fbe4008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 10 monclient(hunting): picked mon.noname-a con 0x7fbe4008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 10 monclient(hunting): picked mon.noname-b con 0x7fbe4008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4008d9c0 con 0x7fbe4008c730 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe40088020 con 0x7fbe4008cb30 2026-02-12T17:28:07.836 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe40088810 con 0x7fbe4008ae20 2026-02-12T17:28:07.837 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:07.837 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe4581b640 10 monclient(hunting): authenticate will time out at 567.647405s 2026-02-12T17:28:07.837 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe3effd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbe4008ae20 0x7fbe40152cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:37620/0 (socket says 10.20.193.57:37620) 2026-02-12T17:28:07.837 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe3effd640 1 -- 10.20.193.57:0/1780533991 learned_addr learned my addr 10.20.193.57:0/1780533991 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:07.837 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.828+0000 7fbe3e7fc640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbe4008c730 0x7fbe401533e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:48274/0 (socket says 10.20.193.57:48274) 2026-02-12T17:28:07.841 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe3e7fc640 1 -- 10.20.193.57:0/1780533991 >> v1:10.20.193.57:6789/0 conn(0x7fbe4008c730 legacy=0x7fbe401533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.841 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe3effd640 1 -- 10.20.193.57:0/1780533991 >> v1:10.20.193.57:6790/0 conn(0x7fbe4008ae20 legacy=0x7fbe40152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.841 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033385797 0 0) 0x7fbe4008d9c0 con 0x7fbe4008c730 2026-02-12T17:28:07.841 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.841 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.841 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.841 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): my global_id is 4212 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe100035e0 con 0x7fbe4008c730 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe3f7fe640 1 -- 10.20.193.57:0/1780533991 >> v1:10.20.193.82:6789/0 conn(0x7fbe4008cb30 legacy=0x7fbe401951c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852253391 0 0) 0x7fbe40088810 con 0x7fbe4008ae20 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): my global_id is 4187 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe4008d9c0 con 0x7fbe4008ae20 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069380449 0 0) 0x7fbe40088020 con 0x7fbe4008cb30 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:07.842 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): my global_id is 4174 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe40088810 con 0x7fbe4008cb30 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 184014384 0 0) 0x7fbe100035e0 con 0x7fbe4008c730 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe40088020 con 0x7fbe4008c730 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbe280048a0 con 0x7fbe4008c730 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): dump: 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.843 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 492915485 0 0) 0x7fbe4008d9c0 con 0x7fbe4008ae20 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe100035e0 con 0x7fbe4008ae20 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbe340033b0 con 0x7fbe4008ae20 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:07.844 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.830+0000 7fbe17fff640 10 monclient(hunting): dump: 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4229862746 0 0) 0x7fbe40088020 con 0x7fbe4008c730 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 >> v1:10.20.193.57:6790/0 conn(0x7fbe4008ae20 legacy=0x7fbe40152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.845 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 >> v1:10.20.193.82:6789/0 conn(0x7fbe4008cb30 legacy=0x7fbe401951c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 1 monclient: found mon.a 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe40153af0 con 0x7fbe4008c730 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 5 monclient: authenticate success, global_id 4212 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 10 monclient: _renew_subs 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:07.846 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbe40085e70 con 0x7fbe4008c730 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 10 monclient: _renew_subs 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbe40083c80 con 0x7fbe4008c730 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe28004f10 con 0x7fbe4008c730 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbe28005230 con 0x7fbe4008c730 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 10 monclient: dump: 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:07.847 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe3d7fa640 4 set_mon_vals no callback set 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 3) ==== 51806+0+0 (unknown 2046111300 0 0) 0x7fbe28011e00 con 0x7fbe4008c730 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:07.848 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe400008d0 con 0x7fbe4008c730 2026-02-12T17:28:07.849 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.831+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 3113446419 0 0) 0x7fbe2804df30 con 0x7fbe4008c730 2026-02-12T17:28:07.849 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.832+0000 7fbe3effd640 10 monclient: get_auth_request con 0x7fbe1003fb40 auth_method 0 2026-02-12T17:28:07.849 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.834+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fbe28017380 con 0x7fbe4008c730 2026-02-12T17:28:07.849 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.834+0000 7fbe17fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:07.849 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.834+0000 7fbe17fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:07.939 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.941+0000 7fbe4581b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:07.940 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.941+0000 7fbe4581b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:07.940 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.941+0000 7fbe4581b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:07.940 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.941+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe4008f520 con 0x7fbe4008c730 2026-02-12T17:28:07.940 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.942+0000 7fbe17fff640 1 -- 10.20.193.57:0/1780533991 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 1818935521) 0x7fbe28016b30 con 0x7fbe4008c730 2026-02-12T17:28:07.940 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.942+0000 7fbe17fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:07.940 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.942+0000 7fbe17fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:07.940 INFO:teuthology.misc.health.trial057.stdout: 2026-02-12T17:28:07.940 INFO:teuthology.misc.health.trial057.stdout:{"epoch":8,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","created":"2026-02-12T17:28:03.716456+0000","modified":"2026-02-12T17:28:06.940287+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T17:28:06.940287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"08ee67d7-4cf0-452b-a362-8a5526fccd74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d2ec9481-5b72-4197-a3ed-b1029fb07580","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"108524be-58bc-4950-b88f-d85dfa77ef48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e9bb983d-b2d5-4543-a960-f450bede62cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"047804d0-f125-4ef6-ac99-8f8ed7d594ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T17:28:07.941 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.943+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 >> v1:10.20.193.82:6800/2441377515 conn(0x7fbe1003fb40 legacy=0x7fbe1005fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.941 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.943+0000 7fbe4581b640 10 monclient: shutdown 2026-02-12T17:28:07.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.943+0000 7fbe4581b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:07.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.943+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 >> v1:10.20.193.57:6789/0 conn(0x7fbe4008c730 legacy=0x7fbe401533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:07.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.943+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 shutdown_connections 2026-02-12T17:28:07.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.943+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 >> 10.20.193.57:0/1780533991 conn(0x7fbe40091620 msgr2=0x7fbe40089310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:07.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.943+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 shutdown_connections 2026-02-12T17:28:07.942 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:07.943+0000 7fbe4581b640 1 -- 10.20.193.57:0/1780533991 wait complete. 2026-02-12T17:28:07.951 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-12T17:28:08.949 INFO:tasks.ceph.osd.4.trial082.stderr:2026-02-12T17:28:08.948+0000 7f5b4a1f7640 -1 osd.4 0 waiting for initial osdmap 2026-02-12T17:28:08.949 INFO:tasks.ceph.osd.5.trial082.stderr:2026-02-12T17:28:08.948+0000 7effc53f7640 -1 osd.5 0 waiting for initial osdmap 2026-02-12T17:28:08.949 INFO:tasks.ceph.osd.3.trial082.stderr:2026-02-12T17:28:08.948+0000 7f6f301f7640 -1 osd.3 0 waiting for initial osdmap 2026-02-12T17:28:08.950 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-12T17:28:08.952+0000 7fc7661f7640 -1 osd.0 0 waiting for initial osdmap 2026-02-12T17:28:08.950 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-12T17:28:08.952+0000 7f037d7f7640 -1 osd.2 0 waiting for initial osdmap 2026-02-12T17:28:08.950 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-12T17:28:08.952+0000 7fb5c87f7640 -1 osd.1 0 waiting for initial osdmap 2026-02-12T17:28:08.951 INFO:tasks.ceph.osd.1.trial057.stderr:2026-02-12T17:28:08.954+0000 7fb5c07e7640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T17:28:08.952 INFO:tasks.ceph.osd.2.trial057.stderr:2026-02-12T17:28:08.954+0000 7f037572a640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T17:28:08.952 INFO:tasks.ceph.osd.4.trial082.stderr:2026-02-12T17:28:08.951+0000 7f5b461de640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T17:28:08.952 INFO:tasks.ceph.osd.3.trial082.stderr:2026-02-12T17:28:08.951+0000 7f6f281e7640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T17:28:08.952 INFO:tasks.ceph.osd.5.trial082.stderr:2026-02-12T17:28:08.951+0000 7effbd32a640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T17:28:08.952 INFO:tasks.ceph.osd.0.trial057.stderr:2026-02-12T17:28:08.954+0000 7fc75e1e7640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T17:28:14.554 DEBUG:teuthology.orchestra.run.trial057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T17:28:14.612 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.614+0000 7fd2e088c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:14.612 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.614+0000 7fd2e088c640 10 monclient: build_initial_monmap 2026-02-12T17:28:14.612 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.614+0000 7fd2e088c640 10 monclient: monmap: 2026-02-12T17:28:14.612 INFO:teuthology.misc.health.trial057.stderr:epoch 0 2026-02-12T17:28:14.612 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.613 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:28:14.615421+0000 2026-02-12T17:28:14.613 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:28:14.615421+0000 2026-02-12T17:28:14.613 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:14.613 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.613 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:14.613 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:14.613 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:14.613 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:14.614 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.614+0000 7fd2e088c640 1 Processor -- start 2026-02-12T17:28:14.614 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 1 -- start start 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 10 monclient: init 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 10 monclient(hunting): picked mon.noname-c con 0x7fd2d808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 10 monclient(hunting): picked mon.noname-a con 0x7fd2d808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 10 monclient(hunting): picked mon.noname-b con 0x7fd2d808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d808d600 con 0x7fd2d808c730 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d808b1f0 con 0x7fd2d808ae20 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d808d1f0 con 0x7fd2d808cb30 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2e088c640 10 monclient(hunting): authenticate will time out at 574.434307s 2026-02-12T17:28:14.615 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2dde00640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd2d808c730 0x7fd2d8181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38374/0 (socket says 10.20.193.57:38374) 2026-02-12T17:28:14.616 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.615+0000 7fd2dde00640 1 -- 10.20.193.57:0/2091935159 learned_addr learned my addr 10.20.193.57:0/2091935159 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:14.623 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dde00640 1 -- 10.20.193.57:0/2091935159 >> v1:10.20.193.57:6789/0 conn(0x7fd2d808c730 legacy=0x7fd2d8181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.623 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dee02640 1 -- 10.20.193.57:0/2091935159 >> v1:10.20.193.57:6790/0 conn(0x7fd2d808cb30 legacy=0x7fd2d81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3817609286 0 0) 0x7fd2d808d600 con 0x7fd2d808c730 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient(hunting): my global_id is 4224 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c80035e0 con 0x7fd2d808c730 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707970816 0 0) 0x7fd2d808d1f0 con 0x7fd2d808cb30 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.624 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient(hunting): my global_id is 4199 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2d808d600 con 0x7fd2d808cb30 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2924588758 0 0) 0x7fd2c80035e0 con 0x7fd2d808c730 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 >> v1:10.20.193.57:6790/0 conn(0x7fd2d808cb30 legacy=0x7fd2d81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 >> v1:10.20.193.82:6789/0 conn(0x7fd2d808ae20 legacy=0x7fd2d808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2de601640 1 -- 10.20.193.57:0/2091935159 >> v1:10.20.193.82:6789/0 conn(0x7fd2d808ae20 legacy=0x7fd2d808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 1 monclient: found mon.noname-a 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d8057320 con 0x7fd2d808c730 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient: _finish_auth 0 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:14.625 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.617+0000 7fd2dd5ff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2c4003150 con 0x7fd2d808c730 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 10 monclient: dump: 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.626 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 5 monclient: authenticate success, global_id 4224 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2c4003320 con 0x7fd2d808c730 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 1 -- 10.20.193.57:0/2091935159 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2c4004960 con 0x7fd2d808c730 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2dd5ff640 10 monclient: dump: 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:14.627 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 4 set_mon_vals no callback set 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 10 monclient: shutdown 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:14.628 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 1 -- 10.20.193.57:0/2091935159 >> v1:10.20.193.57:6789/0 conn(0x7fd2d808c730 legacy=0x7fd2d8181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 1 -- 10.20.193.57:0/2091935159 shutdown_connections 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 1 -- 10.20.193.57:0/2091935159 >> 10.20.193.57:0/2091935159 conn(0x7fd2d8091620 msgr2=0x7fd2d8091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 1 -- 10.20.193.57:0/2091935159 shutdown_connections 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 1 -- 10.20.193.57:0/2091935159 wait complete. 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 10 monclient: build_initial_monmap 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 10 monclient: monmap: 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:epoch 0 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:created 0.000000 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 1 2026-02-12T17:28:14.629 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.618+0000 7fd2e088c640 1 Processor -- start 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 1 -- start start 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 10 monclient: init 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 10 monclient(hunting): picked mon.noname-a con 0x7fd2d808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 10 monclient(hunting): picked mon.noname-c con 0x7fd2d808c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 10 monclient(hunting): picked mon.noname-b con 0x7fd2d808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d808d9c0 con 0x7fd2d808ae20 2026-02-12T17:28:14.630 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d805caf0 con 0x7fd2d808cb30 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d8088810 con 0x7fd2d808c730 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2e088c640 10 monclient(hunting): authenticate will time out at 574.438284s 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2de601640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd2d808ae20 0x7fd2d8088d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38386/0 (socket says 10.20.193.57:38386) 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.619+0000 7fd2de601640 1 -- 10.20.193.57:0/3254843309 learned_addr learned my addr 10.20.193.57:0/3254843309 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2de601640 1 -- 10.20.193.57:0/3254843309 >> v1:10.20.193.57:6789/0 conn(0x7fd2d808ae20 legacy=0x7fd2d8088d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2dde00640 1 -- 10.20.193.57:0/3254843309 >> v1:10.20.193.57:6790/0 conn(0x7fd2d808c730 legacy=0x7fd2d8089490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156210895 0 0) 0x7fd2d808d9c0 con 0x7fd2d808ae20 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.631 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): my global_id is 4227 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2a80035e0 con 0x7fd2d808ae20 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638114632 0 0) 0x7fd2d8088810 con 0x7fd2d808c730 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): my global_id is 4202 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2d808d9c0 con 0x7fd2d808c730 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2dee02640 1 -- 10.20.193.57:0/3254843309 >> v1:10.20.193.82:6789/0 conn(0x7fd2d808cb30 legacy=0x7fd2d81a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3739238620 0 0) 0x7fd2a80035e0 con 0x7fd2d808ae20 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2d8088810 con 0x7fd2d808ae20 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2d00032a0 con 0x7fd2d808ae20 2026-02-12T17:28:14.632 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.633 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1715487262 0 0) 0x7fd2d808d9c0 con 0x7fd2d808c730 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2a80035e0 con 0x7fd2d808c730 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2c40048a0 con 0x7fd2d808c730 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.634 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769647936 0 0) 0x7fd2d805caf0 con 0x7fd2d808cb30 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 10 monclient(hunting): my global_id is 4186 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2d808d9c0 con 0x7fd2d808cb30 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3166449561 0 0) 0x7fd2d8088810 con 0x7fd2d808ae20 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 >> v1:10.20.193.57:6790/0 conn(0x7fd2d808c730 legacy=0x7fd2d8089490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.635 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.621+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 >> v1:10.20.193.82:6789/0 conn(0x7fd2d808cb30 legacy=0x7fd2d81a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 1 monclient: found mon.a 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d811ecf0 con 0x7fd2d808ae20 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 5 monclient: authenticate success, global_id 4227 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 10 monclient: _renew_subs 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d805af20 con 0x7fd2d808ae20 2026-02-12T17:28:14.636 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 10 monclient: _renew_subs 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd2d8123430 con 0x7fd2d808ae20 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2d0003980 con 0x7fd2d808ae20 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2d0003ca0 con 0x7fd2d808ae20 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 10 monclient: dump: 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:epoch 1 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.637 INFO:teuthology.misc.health.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr: 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2dcdfe640 4 set_mon_vals no callback set 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d80008d0 con 0x7fd2d808ae20 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.622+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 4) ==== 51912+0+0 (unknown 1464716555 0 0) 0x7fd2d0003f00 con 0x7fd2d808ae20 2026-02-12T17:28:14.638 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.623+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 3147+0+0 (unknown 3410387263 0 0) 0x7fd2d004e770 con 0x7fd2d808ae20 2026-02-12T17:28:14.639 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.623+0000 7fd2dde00640 10 monclient: get_auth_request con 0x7fd2a803fc90 auth_method 0 2026-02-12T17:28:14.639 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.625+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fd2d0016c10 con 0x7fd2d808ae20 2026-02-12T17:28:14.639 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.625+0000 7fd2c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:14.639 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.625+0000 7fd2c2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:14.726 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.728+0000 7fd2e088c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:14.726 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.728+0000 7fd2e088c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:14.727 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.728+0000 7fd2e088c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.727 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.728+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2d808f520 con 0x7fd2d808ae20 2026-02-12T17:28:14.727 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.728+0000 7fd2c2ffd640 1 -- 10.20.193.57:0/3254843309 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8894 (unknown 92231148 0 4110899834) 0x7fd2d0016a30 con 0x7fd2d808ae20 2026-02-12T17:28:14.727 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.728+0000 7fd2c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:14.727 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.728+0000 7fd2c2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:14.727 INFO:teuthology.misc.health.trial057.stdout: 2026-02-12T17:28:14.728 INFO:teuthology.misc.health.trial057.stdout:{"epoch":14,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","created":"2026-02-12T17:28:03.716456+0000","modified":"2026-02-12T17:28:13.963999+0000","last_up_change":"2026-02-12T17:28:09.951573+0000","last_in_change":"2026-02-12T17:28:06.940287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T17:28:11.851529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08ee67d7-4cf0-452b-a362-8a5526fccd74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":521925997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":521925997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":521925997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":521925997}]},"public_addr":"10.20.193.57:6803/521925997","cluster_addr":"10.20.193.57:6805/521925997","heartbeat_back_addr":"10.20.193.57:6807/521925997","heartbeat_front_addr":"10.20.193.57:6806/521925997","state":["exists","up"]},{"osd":1,"uuid":"d2ec9481-5b72-4197-a3ed-b1029fb07580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6800","nonce":3025704390}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":3025704390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":3025704390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":3025704390}]},"public_addr":"10.20.193.57:6800/3025704390","cluster_addr":"10.20.193.57:6801/3025704390","heartbeat_back_addr":"10.20.193.57:6804/3025704390","heartbeat_front_addr":"10.20.193.57:6802/3025704390","state":["exists","up"]},{"osd":2,"uuid":"7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3129121469}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3129121469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3129121469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3129121469}]},"public_addr":"10.20.193.57:6808/3129121469","cluster_addr":"10.20.193.57:6809/3129121469","heartbeat_back_addr":"10.20.193.57:6811/3129121469","heartbeat_front_addr":"10.20.193.57:6810/3129121469","state":["exists","up"]},{"osd":3,"uuid":"108524be-58bc-4950-b88f-d85dfa77ef48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6801","nonce":634754599}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6802","nonce":634754599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6804","nonce":634754599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6803","nonce":634754599}]},"public_addr":"10.20.193.82:6801/634754599","cluster_addr":"10.20.193.82:6802/634754599","heartbeat_back_addr":"10.20.193.82:6804/634754599","heartbeat_front_addr":"10.20.193.82:6803/634754599","state":["exists","up"]},{"osd":4,"uuid":"e9bb983d-b2d5-4543-a960-f450bede62cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6805","nonce":687524042}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6806","nonce":687524042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6808","nonce":687524042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6807","nonce":687524042}]},"public_addr":"10.20.193.82:6805/687524042","cluster_addr":"10.20.193.82:6806/687524042","heartbeat_back_addr":"10.20.193.82:6808/687524042","heartbeat_front_addr":"10.20.193.82:6807/687524042","state":["exists","up"]},{"osd":5,"uuid":"047804d0-f125-4ef6-ac99-8f8ed7d594ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6809","nonce":1303150362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6810","nonce":1303150362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6812","nonce":1303150362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6811","nonce":1303150362}]},"public_addr":"10.20.193.82:6809/1303150362","cluster_addr":"10.20.193.82:6810/1303150362","heartbeat_back_addr":"10.20.193.82:6812/1303150362","heartbeat_front_addr":"10.20.193.82:6811/1303150362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T17:28:14.728 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.730+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 >> v1:10.20.193.82:6800/2441377515 conn(0x7fd2a803fc90 legacy=0x7fd2a8060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.728 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.730+0000 7fd2e088c640 10 monclient: shutdown 2026-02-12T17:28:14.729 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.730+0000 7fd2e088c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:14.729 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.730+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 >> v1:10.20.193.57:6789/0 conn(0x7fd2d808ae20 legacy=0x7fd2d8088d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.729 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.730+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 shutdown_connections 2026-02-12T17:28:14.729 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.730+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 >> 10.20.193.57:0/3254843309 conn(0x7fd2d8091620 msgr2=0x7fd2d80597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:14.729 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.730+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 shutdown_connections 2026-02-12T17:28:14.729 INFO:teuthology.misc.health.trial057.stderr:2026-02-12T17:28:14.730+0000 7fd2e088c640 1 -- 10.20.193.57:0/3254843309 wait complete. 2026-02-12T17:28:14.734 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-12T17:28:14.734 INFO:tasks.ceph:Creating RBD pool 2026-02-12T17:28:14.734 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T17:28:14.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.800+0000 7f2b37e12640 10 monclient: get_monmap_and_config 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.800+0000 7f2b37e12640 10 monclient: build_initial_monmap 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.800+0000 7f2b37e12640 10 monclient: monmap: 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:14.801057+0000 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:14.801057+0000 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:14.798 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:14.799 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:14.799 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:14.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.800+0000 7f2b37e12640 1 Processor -- start 2026-02-12T17:28:14.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.800+0000 7f2b37e12640 1 -- start start 2026-02-12T17:28:14.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.800+0000 7f2b37e12640 10 monclient: init 2026-02-12T17:28:14.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 10 monclient(hunting): picked mon.noname-c con 0x7f2b3008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 10 monclient(hunting): picked mon.noname-b con 0x7f2b3008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 10 monclient(hunting): picked mon.noname-a con 0x7f2b30182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b3008a820 con 0x7f2b30182cc0 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b30089450 con 0x7f2b3008c250 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b30089730 con 0x7f2b3008c620 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b37e12640 10 monclient(hunting): authenticate will time out at 574.620113s 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b35386640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f2b3008c620 0x7f2b3008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42356/0 (socket says 10.20.193.57:42356) 2026-02-12T17:28:14.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.801+0000 7f2b35386640 1 -- 10.20.193.57:0/1958229730 learned_addr learned my addr 10.20.193.57:0/1958229730 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:14.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b36388640 1 -- 10.20.193.57:0/1958229730 >> v1:10.20.193.57:6789/0 conn(0x7f2b30182cc0 legacy=0x7f2b301a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b35386640 1 -- 10.20.193.57:0/1958229730 >> v1:10.20.193.57:6790/0 conn(0x7f2b3008c620 legacy=0x7f2b3008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b35b87640 1 -- 10.20.193.57:0/1958229730 >> v1:10.20.193.82:6789/0 conn(0x7f2b3008c250 legacy=0x7f2b3008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996418731 0 0) 0x7f2b30089730 con 0x7f2b3008c620 2026-02-12T17:28:14.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): my global_id is 4205 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b180035e0 con 0x7f2b3008c620 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3243312036 0 0) 0x7f2b2c003d50 con 0x7f2b30182cc0 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): my global_id is 4230 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b30089730 con 0x7f2b30182cc0 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 265047261 0 0) 0x7f2b30089450 con 0x7f2b3008c250 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient(hunting): my global_id is 4189 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b2c003d50 con 0x7f2b3008c250 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2594399017 0 0) 0x7f2b180035e0 con 0x7f2b3008c620 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 >> v1:10.20.193.82:6789/0 conn(0x7f2b3008c250 legacy=0x7f2b3008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 >> v1:10.20.193.57:6789/0 conn(0x7f2b30182cc0 legacy=0x7f2b301a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: _finish_hunting 0 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 monclient: found mon.noname-b 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b30089a10 con 0x7f2b3008c620 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: _finish_auth 0 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: _check_auth_tickets 2026-02-12T17:28:14.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2b240030d0 con 0x7f2b3008c620 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b37e12640 5 monclient: authenticate success, global_id 4205 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b37e12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: dump: 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.811 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b37e12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b24003360 con 0x7f2b3008c620 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 1 -- 10.20.193.57:0/1958229730 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2b24004960 con 0x7f2b3008c620 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b34b85640 10 monclient: dump: 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:14.812 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b37e12640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.803+0000 7f2b37e12640 4 set_mon_vals no callback set 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 10 monclient: shutdown 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:14.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 1 -- 10.20.193.57:0/1958229730 >> v1:10.20.193.57:6790/0 conn(0x7f2b3008c620 legacy=0x7f2b3008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 1 -- 10.20.193.57:0/1958229730 shutdown_connections 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 1 -- 10.20.193.57:0/1958229730 >> 10.20.193.57:0/1958229730 conn(0x7f2b300916b0 msgr2=0x7f2b30091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 1 -- 10.20.193.57:0/1958229730 shutdown_connections 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 1 -- 10.20.193.57:0/1958229730 wait complete. 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 10 monclient: build_initial_monmap 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 10 monclient: monmap: 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:14.814 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 1 Processor -- start 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 1 -- start start 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.804+0000 7f2b37e12640 10 monclient: init 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 10 monclient(hunting): picked mon.noname-a con 0x7f2b3008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 10 monclient(hunting): picked mon.noname-c con 0x7f2b3008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 10 monclient(hunting): picked mon.noname-b con 0x7f2b30182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:14.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b30138640 con 0x7f2b3008c250 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b30138920 con 0x7f2b30182cc0 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b30138ee0 con 0x7f2b3008c620 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b37e12640 10 monclient(hunting): authenticate will time out at 574.624198s 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b35b87640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f2b3008c250 0x7f2b30136780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38398/0 (socket says 10.20.193.57:38398) 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.805+0000 7f2b35b87640 1 -- 10.20.193.57:0/1625396842 learned_addr learned my addr 10.20.193.57:0/1625396842 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b35b87640 1 -- 10.20.193.57:0/1625396842 >> v1:10.20.193.57:6789/0 conn(0x7f2b3008c250 legacy=0x7f2b30136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b35386640 1 -- 10.20.193.57:0/1625396842 >> v1:10.20.193.57:6790/0 conn(0x7f2b3008c620 legacy=0x7f2b30136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610898249 0 0) 0x7f2b30138640 con 0x7f2b3008c250 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): my global_id is 4233 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b000035e0 con 0x7f2b3008c250 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890912880 0 0) 0x7f2b30138ee0 con 0x7f2b3008c620 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): my global_id is 4208 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b36388640 1 -- 10.20.193.57:0/1625396842 >> v1:10.20.193.82:6789/0 conn(0x7f2b30182cc0 legacy=0x7f2b30193440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b30138640 con 0x7f2b3008c620 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 939716428 0 0) 0x7f2b000035e0 con 0x7f2b3008c250 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b30138ee0 con 0x7f2b3008c250 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2b200033b0 con 0x7f2b3008c250 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:14.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): dump: 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:14.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3108196466 0 0) 0x7f2b30138640 con 0x7f2b3008c620 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b000035e0 con 0x7f2b3008c620 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199813287 0 0) 0x7f2b30138920 con 0x7f2b30182cc0 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): my global_id is 4192 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b30138640 con 0x7f2b30182cc0 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2b240034d0 con 0x7f2b3008c620 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient(hunting): dump: 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:14.819 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 371299905 0 0) 0x7f2b30138ee0 con 0x7f2b3008c250 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 >> v1:10.20.193.57:6790/0 conn(0x7f2b3008c620 legacy=0x7f2b30136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 >> v1:10.20.193.82:6789/0 conn(0x7f2b30182cc0 legacy=0x7f2b30193440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:14.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 monclient: found mon.a 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3013ec20 con 0x7f2b3008c250 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b37e12640 5 monclient: authenticate success, global_id 4233 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b37e12640 10 monclient: _renew_subs 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b37e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3008f000 con 0x7f2b3008c250 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b37e12640 10 monclient: _renew_subs 2026-02-12T17:28:14.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b37e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.807+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b30138c00 con 0x7f2b3008c250 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b20003980 con 0x7f2b3008c250 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b1e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2b20003d10 con 0x7f2b3008c250 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b1ffff640 4 set_mon_vals no callback set 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b1e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b1e7fc640 10 monclient: dump: 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:14.822 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b37e12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b37e12640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b37e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b30090810 con 0x7f2b3008c250 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f2b20003fa0 con 0x7f2b3008c250 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 3147+0+0 (unknown 3410387263 0 0) 0x7f2b2004e920 con 0x7f2b3008c250 2026-02-12T17:28:14.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.808+0000 7f2b35386640 10 monclient: get_auth_request con 0x7f2b0003fcb0 auth_method 0 2026-02-12T17:28:14.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.811+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f2b200173c0 con 0x7f2b3008c250 2026-02-12T17:28:14.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.811+0000 7f2b1e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:14.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.811+0000 7f2b1e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:14.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.918+0000 7f2b37e12640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-12T17:28:14.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.919+0000 7f2b37e12640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-12T17:28:14.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.919+0000 7f2b37e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:14.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:14.919+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f2b3008f580 con 0x7f2b3008c250 2026-02-12T17:28:16.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.032+0000 7f2b1e7fc640 1 -- 10.20.193.57:0/1625396842 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (unknown 1237045831 0 0) 0x7f2b20016b70 con 0x7f2b3008c250 2026-02-12T17:28:16.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.032+0000 7f2b1e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-12T17:28:16.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.032+0000 7f2b1e7fc640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-12T17:28:16.031 INFO:teuthology.orchestra.run.trial057.stderr:pool 'rbd' created 2026-02-12T17:28:16.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.035+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 >> v1:10.20.193.82:6800/2441377515 conn(0x7f2b0003fcb0 legacy=0x7f2b00060160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:16.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.035+0000 7f2b37e12640 10 monclient: shutdown 2026-02-12T17:28:16.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.035+0000 7f2b37e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:16.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.035+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 >> v1:10.20.193.57:6789/0 conn(0x7f2b3008c250 legacy=0x7f2b30136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:16.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.035+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 shutdown_connections 2026-02-12T17:28:16.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.035+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 >> 10.20.193.57:0/1625396842 conn(0x7f2b300916b0 msgr2=0x7f2b3008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:16.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.036+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 shutdown_connections 2026-02-12T17:28:16.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.036+0000 7f2b37e12640 1 -- 10.20.193.57:0/1625396842 wait complete. 2026-02-12T17:28:16.044 DEBUG:teuthology.orchestra.run.trial057:> rbd --cluster ceph pool init rbd 2026-02-12T17:28:16.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.078+0000 7f96ad6e8240 10 monclient: get_monmap_and_config 2026-02-12T17:28:16.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.078+0000 7f96ad6e8240 10 monclient: build_initial_monmap 2026-02-12T17:28:16.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.078+0000 7f96ad6e8240 10 monclient: monmap: 2026-02-12T17:28:16.076 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:16.076 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:16.076 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:16.079371+0000 2026-02-12T17:28:16.077 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:16.079371+0000 2026-02-12T17:28:16.077 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:16.077 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:16.077 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:16.077 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:16.077 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:16.077 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:16.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 1 Processor -- start 2026-02-12T17:28:16.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 1 -- start start 2026-02-12T17:28:16.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 10 monclient: init 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 10 monclient: _reopen_session rank -1 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 10 monclient(hunting): picked mon.noname-a con 0x1f42270 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 10 monclient(hunting): picked mon.noname-b con 0x1f42d50 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 10 monclient(hunting): picked mon.noname-c con 0x2036c40 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1d90920 con 0x1f42270 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1dbaac0 con 0x2036c40 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1da4490 con 0x1f42d50 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 10 monclient(hunting): _renew_subs 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ad6e8240 10 monclient(hunting): authenticate will time out at 575.898370s 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ab793640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x1f42270 0x1f42640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38414/0 (socket says 10.20.193.57:38414) 2026-02-12T17:28:16.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96ab793640 1 -- 10.20.193.57:0/1458748162 learned_addr learned my addr 10.20.193.57:0/1458748162 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.079+0000 7f96aaf92640 1 --1- 10.20.193.57:0/1458748162 >> v1:10.20.193.57:6790/0 conn(0x1f42d50 0x2035520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42364/0 (socket says 10.20.193.57:42364) 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96ab793640 1 -- 10.20.193.57:0/1458748162 >> v1:10.20.193.57:6789/0 conn(0x1f42270 legacy=0x1f42640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aaf92640 1 -- 10.20.193.57:0/1458748162 >> v1:10.20.193.57:6790/0 conn(0x1f42d50 legacy=0x2035520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488498216 0 0) 0x1d90920 con 0x1f42270 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient(hunting): _negotiate 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient(hunting): my global_id is 4236 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9698001e10 con 0x1f42270 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3554356683 0 0) 0x1da4490 con 0x1f42d50 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient(hunting): _negotiate 2026-02-12T17:28:16.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient(hunting): my global_id is 4211 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x1d90920 con 0x1f42d50 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3579067940 0 0) 0x7f9698001e10 con 0x1f42270 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 >> v1:10.20.193.57:6790/0 conn(0x1f42d50 legacy=0x2035520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 >> v1:10.20.193.82:6789/0 conn(0x2036c40 legacy=0x2057020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aca1c640 1 -- 10.20.193.57:0/1458748162 >> v1:10.20.193.82:6789/0 conn(0x2036c40 legacy=0x2057020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient: _finish_hunting 0 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 monclient: found mon.noname-a 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d9eb50 con 0x1f42270 2026-02-12T17:28:16.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient: _finish_auth 0 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient: _check_auth_tickets 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96ad6e8240 5 monclient: authenticate success, global_id 4236 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96a0001900 con 0x1f42270 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96ad6e8240 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96aa791640 10 monclient: dump: 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:16.086 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.081+0000 7f96ad6e8240 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96a0001c00 con 0x1f42270 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96aa791640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 10 monclient: get_monmap_and_config success 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96aa791640 1 -- 10.20.193.57:0/1458748162 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96a0003340 con 0x1f42270 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 4 set_mon_vals no callback set 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96aa791640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:16.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96aa791640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96aa791640 10 monclient: dump: 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 10 monclient: shutdown 2026-02-12T17:28:16.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1458748162 >> v1:10.20.193.57:6789/0 conn(0x1f42270 legacy=0x1f42640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1458748162 shutdown_connections 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1458748162 >> 10.20.193.57:0/1458748162 conn(0x1f44370 msgr2=0x1f44770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1458748162 shutdown_connections 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1458748162 wait complete. 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 10 monclient: build_initial_monmap 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 10 monclient: monmap: 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:16.089 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 1 Processor -- start 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 1 -- start start 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.082+0000 7f96ad6e8240 10 monclient: init 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 10 monclient: _reopen_session rank -1 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 10 monclient(hunting): picked mon.noname-a con 0x1f42270 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 10 monclient(hunting): picked mon.noname-c con 0x1f42d50 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:16.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 10 monclient(hunting): picked mon.noname-b con 0x2036c40 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:16.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1d90c50 con 0x1f42270 2026-02-12T17:28:16.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1da46f0 con 0x2036c40 2026-02-12T17:28:16.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1fe4770 con 0x1f42d50 2026-02-12T17:28:16.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 10 monclient(hunting): _renew_subs 2026-02-12T17:28:16.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ad6e8240 10 monclient(hunting): authenticate will time out at 575.902177s 2026-02-12T17:28:16.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ab793640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x1f42270 0x1fe09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38420/0 (socket says 10.20.193.57:38420) 2026-02-12T17:28:16.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96ab793640 1 -- 10.20.193.57:0/1321438376 learned_addr learned my addr 10.20.193.57:0/1321438376 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:16.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.083+0000 7f96aaf92640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x1f42d50 0x1fe1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42374/0 (socket says 10.20.193.57:42374) 2026-02-12T17:28:16.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96aaf92640 1 -- 10.20.193.57:0/1321438376 >> v1:10.20.193.57:6790/0 conn(0x1f42d50 legacy=0x1fe1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96ab793640 1 -- 10.20.193.57:0/1321438376 >> v1:10.20.193.57:6789/0 conn(0x1f42270 legacy=0x1fe09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96ab793640 1 --1- 10.20.193.57:0/1321438376 >> v1:10.20.193.57:6789/0 conn(0x1f42270 0x1fe09f0 :-1 s=OPENED pgs=69 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x1d90c50 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96aca1c640 1 -- 10.20.193.57:0/1321438376 >> v1:10.20.193.82:6789/0 conn(0x2036c40 legacy=0x2025610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294623610 0 0) 0x1fe4770 con 0x1f42d50 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): my global_id is 4214 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f968c001e10 con 0x1f42d50 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1622502869 0 0) 0x1da46f0 con 0x2036c40 2026-02-12T17:28:16.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): my global_id is 4198 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x1fe4770 con 0x2036c40 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2984842455 0 0) 0x7f968c001e10 con 0x1f42d50 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x1da46f0 con 0x1f42d50 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9694001770 con 0x1f42d50 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): dump: 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:16.096 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3373022131 0 0) 0x1fe4770 con 0x2036c40 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f968c001e10 con 0x2036c40 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2803283430 0 0) 0x1da46f0 con 0x1f42d50 2026-02-12T17:28:16.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 >> v1:10.20.193.82:6789/0 conn(0x2036c40 legacy=0x2025610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 >> v1:10.20.193.57:6789/0 conn(0x1f42270 legacy=0x1fe09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 monclient: found mon.c 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x1fe1810 con 0x1f42d50 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96ad6e8240 5 monclient: authenticate success, global_id 4214 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626374394 0 0) 0x1d90c50 con 0x1f42270 2026-02-12T17:28:16.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96937fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96ad6e8240 10 monclient: _renew_subs 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96ad6e8240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x1f3d400 con 0x1f42d50 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96ad6e8240 10 monclient: _renew_subs 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96ad6e8240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.085+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x1fe4490 con 0x1f42d50 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9694003380 con 0x1f42d50 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96937fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96940036a0 con 0x1f42d50 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96937fe640 10 monclient: dump: 2026-02-12T17:28:16.099 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96a9f90640 4 set_mon_vals no callback set 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f9694003930 con 0x1f42d50 2026-02-12T17:28:16.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3492+0+0 (unknown 4083810558 0 0) 0x7f969404d320 con 0x1f42d50 2026-02-12T17:28:16.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96ad6e8240 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-12T17:28:16.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96ad6e8240 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-12T17:28:16.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96ad6e8240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:16.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x1fe3210 con 0x1f42d50 2026-02-12T17:28:16.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:16.086+0000 7f96ab793640 10 monclient: get_auth_request con 0x7f968c03e2e0 auth_method 0 2026-02-12T17:28:17.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (unknown 2855932958 0 0) 0x7f9694004f00 con 0x1f42d50 2026-02-12T17:28:17.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96937fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-12T17:28:17.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96937fe640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-12T17:28:17.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96ad6e8240 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:17.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x1d94320 con 0x1f42d50 2026-02-12T17:28:17.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (unknown 3847591702 0 0) 0x7f9694004f00 con 0x1f42d50 2026-02-12T17:28:17.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96937fe640 10 monclient: handle_get_version_reply finishing 1 version 16 2026-02-12T17:28:17.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96a9f90640 10 monclient: _renew_subs 2026-02-12T17:28:17.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96a9f90640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:17.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96a9f90640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=16}) -- 0x7f9684002ae0 con 0x1f42d50 2026-02-12T17:28:17.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.039+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 11 ==== osd_map(16..16 src has 1..16) ==== 661+0+0 (unknown 2741705470 0 0) 0x7f9694015e20 con 0x1f42d50 2026-02-12T17:28:17.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.040+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.82:6809/1303150362 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x20291e0 con 0x20276f0 2026-02-12T17:28:17.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.040+0000 7f96aca1c640 10 monclient: get_auth_request con 0x20276f0 auth_method 0 2026-02-12T17:28:17.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.045+0000 7f96aca1c640 1 -- 10.20.193.57:0/1321438376 <== osd.5 v1:10.20.193.82:6809/1303150362 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 2685446591 0 0) 0x7f969c003130 con 0x20276f0 2026-02-12T17:28:17.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.046+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.82:6809/1303150362 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x20c4f20 con 0x20276f0 2026-02-12T17:28:17.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.046+0000 7f96aca1c640 1 -- 10.20.193.57:0/1321438376 <== osd.5 v1:10.20.193.82:6809/1303150362 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2026326479 0 0) 0x7f969c003130 con 0x20276f0 2026-02-12T17:28:17.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.046+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.82:6809/1303150362 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x20c4030 con 0x20276f0 2026-02-12T17:28:17.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.046+0000 7f96aca1c640 1 -- 10.20.193.57:0/1321438376 <== osd.5 v1:10.20.193.82:6809/1303150362 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2039985091 0 0) 0x7f969c003130 con 0x20276f0 2026-02-12T17:28:17.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.046+0000 7f96a978f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:17.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:17.046+0000 7f96a978f640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f9688001f40 con 0x1f42d50 2026-02-12T17:28:18.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:18.041+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 12 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (unknown 2331377178 0 0) 0x7f96940153a0 con 0x1f42d50 2026-02-12T17:28:18.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:18.041+0000 7f96937fe640 10 monclient: _renew_subs 2026-02-12T17:28:18.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:18.041+0000 7f96937fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:18.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:18.041+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=17}) -- 0x1d90c50 con 0x1f42d50 2026-02-12T17:28:18.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:18.041+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 13 ==== osd_map(17..17 src has 1..17) ==== 629+0+0 (unknown 868333901 0 0) 0x7f969401b7a0 con 0x1f42d50 2026-02-12T17:28:18.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:18.042+0000 7f96a9f90640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.82:6809/1303150362 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f9684005810 con 0x20276f0 2026-02-12T17:28:18.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:18.043+0000 7f96aca1c640 1 -- 10.20.193.57:0/1321438376 <== osd.5 v1:10.20.193.82:6809/1303150362 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 3115756469 0 0) 0x7f969c003130 con 0x20276f0 2026-02-12T17:28:18.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:18.043+0000 7f96a978f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:18.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:18.043+0000 7f96a978f640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7f9688003370 con 0x1f42d50 2026-02-12T17:28:19.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.083+0000 7f96927fc640 10 monclient: tick 2026-02-12T17:28:19.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.083+0000 7f96927fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:19.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.083+0000 7f96927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:19.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.083+0000 7f96927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:19.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.286+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 14 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (unknown 1512039363 0 0) 0x7f9694015580 con 0x1f42d50 2026-02-12T17:28:19.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.286+0000 7f96937fe640 10 monclient: _renew_subs 2026-02-12T17:28:19.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.286+0000 7f96937fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:19.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.286+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=18}) -- 0x1da46f0 con 0x1f42d50 2026-02-12T17:28:19.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.286+0000 7f96937fe640 1 -- 10.20.193.57:0/1321438376 <== mon.2 v1:10.20.193.57:6790/0 15 ==== osd_map(18..18 src has 1..18) ==== 657+0+0 (unknown 1691378292 0 0) 0x7f969401dd80 con 0x1f42d50 2026-02-12T17:28:19.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.286+0000 7f96a9f90640 1 -- 10.20.193.57:0/1321438376 --> v1:10.20.193.82:6809/1303150362 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f9684005bb0 con 0x20276f0 2026-02-12T17:28:19.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.287+0000 7f96aca1c640 1 -- 10.20.193.57:0/1321438376 <== osd.5 v1:10.20.193.82:6809/1303150362 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 4030416863 0 0) 0x7f969c003130 con 0x20276f0 2026-02-12T17:28:19.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.287+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 >> v1:10.20.193.82:6809/1303150362 conn(0x20276f0 legacy=0x2027ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.287+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 >> v1:10.20.193.82:6800/2441377515 conn(0x7f968c03e2e0 legacy=0x7f968c05e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.287+0000 7f96ad6e8240 10 monclient: shutdown 2026-02-12T17:28:19.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.287+0000 7f96ad6e8240 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:19.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.287+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 >> v1:10.20.193.57:6790/0 conn(0x1f42d50 legacy=0x1fe1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.287+0000 7f96aca1c640 1 -- 10.20.193.57:0/1321438376 reap_dead start 2026-02-12T17:28:19.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.288+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 shutdown_connections 2026-02-12T17:28:19.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.288+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 >> 10.20.193.57:0/1321438376 conn(0x1f44370 msgr2=0x1f3a140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:19.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.288+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 shutdown_connections 2026-02-12T17:28:19.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.288+0000 7f96ad6e8240 1 -- 10.20.193.57:0/1321438376 wait complete. 2026-02-12T17:28:19.290 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T17:28:19.291 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T17:28:19.291 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T17:28:19.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:19.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient: build_initial_monmap 2026-02-12T17:28:19.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient: monmap: 2026-02-12T17:28:19.400 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:19.400 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.400 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:19.400977+0000 2026-02-12T17:28:19.400 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:19.400977+0000 2026-02-12T17:28:19.400 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:19.400 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.401 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:19.401 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:19.401 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:19.401 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 1 Processor -- start 2026-02-12T17:28:19.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 1 -- start start 2026-02-12T17:28:19.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient: init 2026-02-12T17:28:19.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:19.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient(hunting): picked mon.noname-b con 0x7ff99c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient(hunting): picked mon.noname-a con 0x7ff99c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient(hunting): picked mon.noname-c con 0x7ff99c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c08a820 con 0x7ff99c08c620 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c089450 con 0x7ff99c182cc0 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c089730 con 0x7ff99c08c250 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a468c640 10 monclient(hunting): authenticate will time out at 579.219856s 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a1c00640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff99c08c620 0x7ff99c08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38428/0 (socket says 10.20.193.57:38428) 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a2401640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ff99c08c250 0x7ff99c08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42386/0 (socket says 10.20.193.57:42386) 2026-02-12T17:28:19.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.400+0000 7ff9a1c00640 1 -- 10.20.193.57:0/36927928 learned_addr learned my addr 10.20.193.57:0/36927928 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:19.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a1c00640 1 -- 10.20.193.57:0/36927928 >> v1:10.20.193.57:6789/0 conn(0x7ff99c08c620 legacy=0x7ff99c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a2401640 1 -- 10.20.193.57:0/36927928 >> v1:10.20.193.57:6790/0 conn(0x7ff99c08c250 legacy=0x7ff99c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354217790 0 0) 0x7ff990002c20 con 0x7ff99c08c620 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient(hunting): my global_id is 4242 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9840035e0 con 0x7ff99c08c620 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610075161 0 0) 0x7ff99c089730 con 0x7ff99c08c250 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient(hunting): my global_id is 4217 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff990002c20 con 0x7ff99c08c250 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4057696656 0 0) 0x7ff9840035e0 con 0x7ff99c08c620 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 >> v1:10.20.193.57:6790/0 conn(0x7ff99c08c250 legacy=0x7ff99c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 >> v1:10.20.193.82:6789/0 conn(0x7ff99c182cc0 legacy=0x7ff99c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 monclient: found mon.noname-a 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c089a10 con 0x7ff99c08c620 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: _finish_auth 0 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff990003260 con 0x7ff99c08c620 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: dump: 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.413 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 5 monclient: authenticate success, global_id 4242 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff990004960 con 0x7ff99c08c620 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 1 -- 10.20.193.57:0/36927928 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff990004cb0 con 0x7ff99c08c620 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:19.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a13ff640 10 monclient: dump: 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:19.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 4 set_mon_vals no callback set 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 10 monclient: shutdown 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 1 -- 10.20.193.57:0/36927928 >> v1:10.20.193.57:6789/0 conn(0x7ff99c08c620 legacy=0x7ff99c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 1 -- 10.20.193.57:0/36927928 shutdown_connections 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 1 -- 10.20.193.57:0/36927928 >> 10.20.193.57:0/36927928 conn(0x7ff99c0916b0 msgr2=0x7ff99c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 1 -- 10.20.193.57:0/36927928 shutdown_connections 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.403+0000 7ff9a468c640 1 -- 10.20.193.57:0/36927928 wait complete. 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient: build_initial_monmap 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient: monmap: 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:19.416 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 1 Processor -- start 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 1 -- start start 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient: init 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:19.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient(hunting): picked mon.noname-a con 0x7ff99c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient(hunting): picked mon.noname-b con 0x7ff99c08c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient(hunting): picked mon.noname-c con 0x7ff99c182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c088910 con 0x7ff99c08c250 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c05d5c0 con 0x7ff99c08c620 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c05e170 con 0x7ff99c182cc0 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a468c640 10 monclient(hunting): authenticate will time out at 579.223803s 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a2401640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff99c08c250 0x7ff99c05c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38440/0 (socket says 10.20.193.57:38440) 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a2401640 1 -- 10.20.193.57:0/335884443 learned_addr learned my addr 10.20.193.57:0/335884443 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.404+0000 7ff9a2c02640 1 --1- 10.20.193.57:0/335884443 >> v1:10.20.193.57:6790/0 conn(0x7ff99c182cc0 0x7ff99c192a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42398/0 (socket says 10.20.193.57:42398) 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.406+0000 7ff9a2401640 1 -- 10.20.193.57:0/335884443 >> v1:10.20.193.57:6789/0 conn(0x7ff99c08c250 legacy=0x7ff99c05c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.406+0000 7ff9a2c02640 1 -- 10.20.193.57:0/335884443 >> v1:10.20.193.57:6790/0 conn(0x7ff99c182cc0 legacy=0x7ff99c192a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427364370 0 0) 0x7ff990002c20 con 0x7ff99c08c250 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): my global_id is 4245 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff96c0035e0 con 0x7ff99c08c250 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a1c00640 1 -- 10.20.193.57:0/335884443 >> v1:10.20.193.82:6789/0 conn(0x7ff99c08c620 legacy=0x7ff99c05ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135920120 0 0) 0x7ff99c05e170 con 0x7ff99c182cc0 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): my global_id is 4220 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff990002c20 con 0x7ff99c182cc0 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3631296826 0 0) 0x7ff96c0035e0 con 0x7ff99c08c250 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff99c05e170 con 0x7ff99c08c250 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff98c003400 con 0x7ff99c08c250 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.420 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640578287 0 0) 0x7ff99c05d5c0 con 0x7ff99c08c620 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): my global_id is 4201 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff96c0035e0 con 0x7ff99c08c620 2026-02-12T17:28:19.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1167621754 0 0) 0x7ff990002c20 con 0x7ff99c182cc0 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff99c05d5c0 con 0x7ff99c182cc0 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff998005350 con 0x7ff99c182cc0 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.422 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3687665933 0 0) 0x7ff99c05e170 con 0x7ff99c08c250 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 >> v1:10.20.193.57:6790/0 conn(0x7ff99c182cc0 legacy=0x7ff99c192a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 >> v1:10.20.193.82:6789/0 conn(0x7ff99c08c620 legacy=0x7ff99c05ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 monclient: found mon.a 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c138720 con 0x7ff99c08c250 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:19.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a468c640 5 monclient: authenticate success, global_id 4245 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a468c640 10 monclient: _renew_subs 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a468c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff99c13e620 con 0x7ff99c08c250 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a468c640 10 monclient: _renew_subs 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a468c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff99c136780 con 0x7ff99c08c250 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff98c004bc0 con 0x7ff99c08c250 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff98c004ee0 con 0x7ff99c08c250 2026-02-12T17:28:19.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff982ffd640 10 monclient: dump: 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.425 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a0bfe640 4 set_mon_vals no callback set 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.407+0000 7ff9a468c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.408+0000 7ff9a468c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.408+0000 7ff9a468c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.408+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99c090810 con 0x7ff99c08c250 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.408+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff98c005130 con 0x7ff99c08c250 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.408+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7ff98c04ea10 con 0x7ff99c08c250 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.408+0000 7ff9a1c00640 10 monclient: get_auth_request con 0x7ff96c03fd10 auth_method 0 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.410+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff98c0172a0 con 0x7ff99c08c250 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.410+0000 7ff982ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:19.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.410+0000 7ff982ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:19.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.518+0000 7ff9a468c640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-12T17:28:19.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.518+0000 7ff9a468c640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-12T17:28:19.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.518+0000 7ff9a468c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.518+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7ff99c088910 con 0x7ff99c08c250 2026-02-12T17:28:19.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.518+0000 7ff982ffd640 1 -- 10.20.193.57:0/335884443 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7ff99c088910 con 0x7ff99c08c250 2026-02-12T17:28:19.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.518+0000 7ff982ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-12T17:28:19.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.518+0000 7ff982ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:19.517 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:19.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.519+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff96c03fd10 legacy=0x7ff96c0601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.519+0000 7ff9a468c640 10 monclient: shutdown 2026-02-12T17:28:19.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.519+0000 7ff9a468c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:19.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.519+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 >> v1:10.20.193.57:6789/0 conn(0x7ff99c08c250 legacy=0x7ff99c05c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.519+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 shutdown_connections 2026-02-12T17:28:19.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.519+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 >> 10.20.193.57:0/335884443 conn(0x7ff99c0916b0 msgr2=0x7ff99c18e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:19.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.519+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 shutdown_connections 2026-02-12T17:28:19.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.519+0000 7ff9a468c640 1 -- 10.20.193.57:0/335884443 wait complete. 2026-02-12T17:28:19.524 INFO:teuthology.orchestra.run.trial057.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-12T17:28:19.525 INFO:tasks.ceph_manager:config epoch is 1 2026-02-12T17:28:19.525 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T17:28:19.525 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T17:28:19.525 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T17:28:19.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:19.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:19.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient: monmap: 2026-02-12T17:28:19.593 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:19.593 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.593 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:19.595017+0000 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:19.595017+0000 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 1 Processor -- start 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 1 -- start start 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient: init 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:19.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f07ec088b20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f07ec08a960 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f07ec089600 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07ec08a0d0 con 0x7f07ec088b20 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07ec08ba10 con 0x7f07ec089600 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07ec08b170 con 0x7f07ec08a960 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07f0f0c640 10 monclient(hunting): authenticate will time out at 579.413926s 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.594+0000 7f07ea575640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f07ec088b20 0x7f07ec088ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38456/0 (socket says 10.20.193.57:38456) 2026-02-12T17:28:19.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.595+0000 7f07ea575640 1 -- 10.20.193.57:0/2325121630 learned_addr learned my addr 10.20.193.57:0/2325121630 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:19.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9d74640 1 -- 10.20.193.57:0/2325121630 >> v1:10.20.193.57:6790/0 conn(0x7f07ec08a960 legacy=0x7f07ec1809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07ea575640 1 -- 10.20.193.57:0/2325121630 >> v1:10.20.193.57:6789/0 conn(0x7f07ec088b20 legacy=0x7f07ec088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07ead76640 1 -- 10.20.193.57:0/2325121630 >> v1:10.20.193.82:6789/0 conn(0x7f07ec089600 legacy=0x7f07ec1a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035891645 0 0) 0x7f07ec08a0d0 con 0x7f07ec088b20 2026-02-12T17:28:19.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): my global_id is 4248 2026-02-12T17:28:19.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07d80035e0 con 0x7f07ec088b20 2026-02-12T17:28:19.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048095556 0 0) 0x7f07ec08b170 con 0x7f07ec08a960 2026-02-12T17:28:19.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): my global_id is 4223 2026-02-12T17:28:19.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07ec08a0d0 con 0x7f07ec08a960 2026-02-12T17:28:19.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153416691 0 0) 0x7f07ec08ba10 con 0x7f07ec089600 2026-02-12T17:28:19.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient(hunting): my global_id is 4204 2026-02-12T17:28:19.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07ec08b170 con 0x7f07ec089600 2026-02-12T17:28:19.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3274101939 0 0) 0x7f07ec08a0d0 con 0x7f07ec08a960 2026-02-12T17:28:19.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 >> v1:10.20.193.82:6789/0 conn(0x7f07ec089600 legacy=0x7f07ec1a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 >> v1:10.20.193.57:6789/0 conn(0x7f07ec088b20 legacy=0x7f07ec088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: _finish_hunting 0 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 monclient: found mon.noname-b 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec0574f0 con 0x7f07ec08a960 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: _finish_auth 0 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: _check_auth_tickets 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f07d4003120 con 0x7f07ec08a960 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:19.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: dump: 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07f0f0c640 5 monclient: authenticate success, global_id 4223 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07f0f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07d40033b0 con 0x7f07ec08a960 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 1 -- 10.20.193.57:0/2325121630 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f07d4003550 con 0x7f07ec08a960 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07e9573640 10 monclient: dump: 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.608 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07f0f0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.597+0000 7f07f0f0c640 4 set_mon_vals no callback set 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 10 monclient: shutdown 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 1 -- 10.20.193.57:0/2325121630 >> v1:10.20.193.57:6790/0 conn(0x7f07ec08a960 legacy=0x7f07ec1809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 1 -- 10.20.193.57:0/2325121630 shutdown_connections 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 1 -- 10.20.193.57:0/2325121630 >> 10.20.193.57:0/2325121630 conn(0x7f07ec091620 msgr2=0x7f07ec091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 1 -- 10.20.193.57:0/2325121630 shutdown_connections 2026-02-12T17:28:19.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 1 -- 10.20.193.57:0/2325121630 wait complete. 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 10 monclient: monmap: 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 1 Processor -- start 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 1 -- start start 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.598+0000 7f07f0f0c640 10 monclient: init 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f07ec088b20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f07ec089600 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f07ec08a960 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07ec13e160 con 0x7f07ec089600 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07ec13c960 con 0x7f07ec088b20 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07ec05cc50 con 0x7f07ec08a960 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:19.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07f0f0c640 10 monclient(hunting): authenticate will time out at 579.418162s 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07e9d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f07ec089600 0x7f07ec216b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38470/0 (socket says 10.20.193.57:38470) 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07ead76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f07ec08a960 0x7f07ec2382c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42416/0 (socket says 10.20.193.57:42416) 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.599+0000 7f07e9d74640 1 -- 10.20.193.57:0/1863114274 learned_addr learned my addr 10.20.193.57:0/1863114274 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07e9d74640 1 -- 10.20.193.57:0/1863114274 >> v1:10.20.193.57:6789/0 conn(0x7f07ec089600 legacy=0x7f07ec216b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07ead76640 1 -- 10.20.193.57:0/1863114274 >> v1:10.20.193.57:6790/0 conn(0x7f07ec08a960 legacy=0x7f07ec2382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07ea575640 1 -- 10.20.193.57:0/1863114274 >> v1:10.20.193.82:6789/0 conn(0x7f07ec088b20 legacy=0x7f07ec1d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881872435 0 0) 0x7f07ec13e160 con 0x7f07ec089600 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): my global_id is 4251 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07b80035e0 con 0x7f07ec089600 2026-02-12T17:28:19.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580730392 0 0) 0x7f07ec05cc50 con 0x7f07ec08a960 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): my global_id is 4226 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07ec13e160 con 0x7f07ec08a960 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3163564965 0 0) 0x7f07ec13c960 con 0x7f07ec088b20 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): my global_id is 4207 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07ec05cc50 con 0x7f07ec088b20 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1770486524 0 0) 0x7f07b80035e0 con 0x7f07ec089600 2026-02-12T17:28:19.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07ec13c960 con 0x7f07ec089600 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f07d4002b80 con 0x7f07ec089600 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.614 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 342411278 0 0) 0x7f07ec13e160 con 0x7f07ec08a960 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07b80035e0 con 0x7f07ec08a960 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f07dc004460 con 0x7f07ec08a960 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.615 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1390682391 0 0) 0x7f07ec13c960 con 0x7f07ec089600 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 >> v1:10.20.193.57:6790/0 conn(0x7f07ec08a960 legacy=0x7f07ec2382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 >> v1:10.20.193.82:6789/0 conn(0x7f07ec088b20 legacy=0x7f07ec1d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 monclient: found mon.a 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:19.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec13dba0 con 0x7f07ec089600 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07f0f0c640 5 monclient: authenticate success, global_id 4251 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07f0f0c640 10 monclient: _renew_subs 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07f0f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f07ec13de80 con 0x7f07ec089600 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07f0f0c640 10 monclient: _renew_subs 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07f0f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f07ec13d8c0 con 0x7f07ec089600 2026-02-12T17:28:19.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07d4003de0 con 0x7f07ec089600 2026-02-12T17:28:19.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:19.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f07d4004130 con 0x7f07ec089600 2026-02-12T17:28:19.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:19.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:19.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07e8d72640 4 set_mon_vals no callback set 2026-02-12T17:28:19.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.601+0000 7f07d2ffd640 10 monclient: dump: 2026-02-12T17:28:19.619 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.619 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.619 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.619 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.619 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.619 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.602+0000 7f07f0f0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.602+0000 7f07f0f0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.602+0000 7f07f0f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.602+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f07d4004340 con 0x7f07ec089600 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.602+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07ec0008d0 con 0x7f07ec089600 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.602+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f07d404ebb0 con 0x7f07ec089600 2026-02-12T17:28:19.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.603+0000 7f07ea575640 10 monclient: get_auth_request con 0x7f07b803fc90 auth_method 0 2026-02-12T17:28:19.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.604+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f07d4016ef0 con 0x7f07ec089600 2026-02-12T17:28:19.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.604+0000 7f07d2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:19.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.604+0000 7f07d2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:19.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.737+0000 7f07f0f0c640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-12T17:28:19.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.737+0000 7f07f0f0c640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-12T17:28:19.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.737+0000 7f07f0f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.737+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f07ec08f520 con 0x7f07ec089600 2026-02-12T17:28:19.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.738+0000 7f07d2ffd640 1 -- 10.20.193.57:0/1863114274 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+98524 (unknown 481731318 0 2607771782) 0x7f07d4017eb0 con 0x7f07ec089600 2026-02-12T17:28:19.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.738+0000 7f07d2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-12T17:28:19.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.738+0000 7f07d2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:19.737 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:19.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.739+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 >> v1:10.20.193.82:6800/2441377515 conn(0x7f07b803fc90 legacy=0x7f07b8060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.739+0000 7f07f0f0c640 10 monclient: shutdown 2026-02-12T17:28:19.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.739+0000 7f07f0f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:19.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.739+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 >> v1:10.20.193.57:6789/0 conn(0x7f07ec089600 legacy=0x7f07ec216b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.739+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 shutdown_connections 2026-02-12T17:28:19.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.739+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 >> 10.20.193.57:0/1863114274 conn(0x7f07ec091620 msgr2=0x7f07ec05a250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:19.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.739+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 shutdown_connections 2026-02-12T17:28:19.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.739+0000 7f07f0f0c640 1 -- 10.20.193.57:0/1863114274 wait complete. 2026-02-12T17:28:19.745 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6800","nonce":2441377515}]},"active_addr":"10.20.193.82:6800/2441377515","active_change":"2026-02-12T17:28:05.774096+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.82:0","nonce":45643785}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.82:0","nonce":3322624571}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.82:0","nonce":282027340}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.82:0","nonce":1137260013}]}]} 2026-02-12T17:28:19.748 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T17:28:19.749 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T17:28:19.749 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T17:28:19.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:19.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:19.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient: monmap: 2026-02-12T17:28:19.818 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:19.818 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.818 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:19.819975+0000 2026-02-12T17:28:19.818 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:19.819975+0000 2026-02-12T17:28:19.818 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:19.818 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.819 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:19.819 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:19.819 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:19.819 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 1 Processor -- start 2026-02-12T17:28:19.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 1 -- start start 2026-02-12T17:28:19.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient: init 2026-02-12T17:28:19.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:19.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f09bc08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f09bc08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f09bc08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc08d600 con 0x7f09bc08ae20 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc08b1f0 con 0x7f09bc08c730 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc08d1f0 con 0x7f09bc08cb30 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09c0d0c640 10 monclient(hunting): authenticate will time out at 579.638844s 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09ba575640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f09bc08ae20 0x7f09bc08c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38486/0 (socket says 10.20.193.57:38486) 2026-02-12T17:28:19.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.819+0000 7f09ba575640 1 -- 10.20.193.57:0/1765493800 learned_addr learned my addr 10.20.193.57:0/1765493800 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09ba575640 1 -- 10.20.193.57:0/1765493800 >> v1:10.20.193.57:6789/0 conn(0x7f09bc08ae20 legacy=0x7f09bc08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09bad76640 1 -- 10.20.193.57:0/1765493800 >> v1:10.20.193.57:6790/0 conn(0x7f09bc08cb30 legacy=0x7f09bc1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9d74640 1 -- 10.20.193.57:0/1765493800 >> v1:10.20.193.82:6789/0 conn(0x7f09bc08c730 legacy=0x7f09bc181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488338852 0 0) 0x7f09bc08d600 con 0x7f09bc08ae20 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): my global_id is 4254 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a80035e0 con 0x7f09bc08ae20 2026-02-12T17:28:19.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186494168 0 0) 0x7f09bc08d1f0 con 0x7f09bc08cb30 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): my global_id is 4229 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09bc08d600 con 0x7f09bc08cb30 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020060751 0 0) 0x7f09bc08b1f0 con 0x7f09bc08c730 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient(hunting): my global_id is 4210 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09bc08d1f0 con 0x7f09bc08c730 2026-02-12T17:28:19.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 56488228 0 0) 0x7f09a80035e0 con 0x7f09bc08ae20 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 >> v1:10.20.193.57:6790/0 conn(0x7f09bc08cb30 legacy=0x7f09bc1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 >> v1:10.20.193.82:6789/0 conn(0x7f09bc08c730 legacy=0x7f09bc181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: _finish_hunting 0 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 monclient: found mon.noname-a 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc057320 con 0x7f09bc08ae20 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: _finish_auth 0 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: _check_auth_tickets 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09b0003150 con 0x7f09bc08ae20 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:19.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: dump: 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 5 monclient: authenticate success, global_id 4254 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09b00033a0 con 0x7f09bc08ae20 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 1 -- 10.20.193.57:0/1765493800 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09b0004b10 con 0x7f09bc08ae20 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09b9573640 10 monclient: dump: 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.833 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 4 set_mon_vals no callback set 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 10 monclient: shutdown 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 1 -- 10.20.193.57:0/1765493800 >> v1:10.20.193.57:6789/0 conn(0x7f09bc08ae20 legacy=0x7f09bc08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 1 -- 10.20.193.57:0/1765493800 shutdown_connections 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 1 -- 10.20.193.57:0/1765493800 >> 10.20.193.57:0/1765493800 conn(0x7f09bc091620 msgr2=0x7f09bc091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:19.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 1 -- 10.20.193.57:0/1765493800 shutdown_connections 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.822+0000 7f09c0d0c640 1 -- 10.20.193.57:0/1765493800 wait complete. 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient: monmap: 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:19.835 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 1 Processor -- start 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 1 -- start start 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient: init 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient(hunting): picked mon.noname-c con 0x7f09bc08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f09bc08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f09bc08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc08d9c0 con 0x7f09bc08c730 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc05b0d0 con 0x7f09bc08cb30 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc088810 con 0x7f09bc08ae20 2026-02-12T17:28:19.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09c0d0c640 10 monclient(hunting): authenticate will time out at 579.642893s 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09ba575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f09bc08ae20 0x7f09bc140de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42442/0 (socket says 10.20.193.57:42442) 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.823+0000 7f09ba575640 1 -- 10.20.193.57:0/581270157 learned_addr learned my addr 10.20.193.57:0/581270157 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09ba575640 1 -- 10.20.193.57:0/581270157 >> v1:10.20.193.57:6790/0 conn(0x7f09bc08ae20 legacy=0x7f09bc140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09b9d74640 1 -- 10.20.193.57:0/581270157 >> v1:10.20.193.57:6789/0 conn(0x7f09bc08c730 legacy=0x7f09bc1920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4117564927 0 0) 0x7f09bc088810 con 0x7f09bc08ae20 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): my global_id is 4232 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09880035e0 con 0x7f09bc08ae20 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344076619 0 0) 0x7f09bc08d9c0 con 0x7f09bc08c730 2026-02-12T17:28:19.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): my global_id is 4257 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09bc088810 con 0x7f09bc08c730 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09bad76640 1 -- 10.20.193.57:0/581270157 >> v1:10.20.193.82:6789/0 conn(0x7f09bc08cb30 legacy=0x7f09bc1937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4127358144 0 0) 0x7f09bc088810 con 0x7f09bc08c730 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09bc08d9c0 con 0x7f09bc08c730 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09a4003400 con 0x7f09bc08c730 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.838 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2805133824 0 0) 0x7f09880035e0 con 0x7f09bc08ae20 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09bc088810 con 0x7f09bc08ae20 2026-02-12T17:28:19.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09b0002fa0 con 0x7f09bc08ae20 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.840 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266036442 0 0) 0x7f09bc05b0d0 con 0x7f09bc08cb30 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient(hunting): my global_id is 4213 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09880035e0 con 0x7f09bc08cb30 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3569985567 0 0) 0x7f09bc08d9c0 con 0x7f09bc08c730 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 >> v1:10.20.193.57:6790/0 conn(0x7f09bc08ae20 legacy=0x7f09bc140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 >> v1:10.20.193.82:6789/0 conn(0x7f09bc08cb30 legacy=0x7f09bc1937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 monclient: found mon.a 2026-02-12T17:28:19.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc13d550 con 0x7f09bc08c730 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09c0d0c640 5 monclient: authenticate success, global_id 4257 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09c0d0c640 10 monclient: _renew_subs 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09c0d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc13f010 con 0x7f09bc08c730 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09c0d0c640 10 monclient: _renew_subs 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09c0d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f09bc13e250 con 0x7f09bc08c730 2026-02-12T17:28:19.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09a4003980 con 0x7f09bc08c730 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09a4003cd0 con 0x7f09bc08c730 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09b8d72640 4 set_mon_vals no callback set 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.826+0000 7f09a2ffd640 10 monclient: dump: 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:19.843 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.827+0000 7f09c0d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.827+0000 7f09c0d0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.827+0000 7f09c0d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.827+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09bc05a6a0 con 0x7f09bc08c730 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.827+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f09a4003f60 con 0x7f09bc08c730 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.827+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f09a404ea10 con 0x7f09bc08c730 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.827+0000 7f09ba575640 10 monclient: get_auth_request con 0x7f098803fc70 auth_method 0 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.829+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f09a4016c30 con 0x7f09bc08c730 2026-02-12T17:28:19.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.829+0000 7f09a2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:19.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.829+0000 7f09a2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:19.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.932+0000 7f09c0d0c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:19.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.932+0000 7f09c0d0c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:19.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.932+0000 7f09c0d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:19.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.932+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09bc13f880 con 0x7f09bc08c730 2026-02-12T17:28:19.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.932+0000 7f09a2ffd640 1 -- 10.20.193.57:0/581270157 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10823 (unknown 3338201251 0 2882979589) 0x7f09a4016a50 con 0x7f09bc08c730 2026-02-12T17:28:19.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.932+0000 7f09a2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:19.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.932+0000 7f09a2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:19.931 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:19.931 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":18,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","created":"2026-02-12T17:28:03.716456+0000","modified":"2026-02-12T17:28:19.040587+0000","last_up_change":"2026-02-12T17:28:09.951573+0000","last_in_change":"2026-02-12T17:28:06.940287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T17:28:11.851529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T17:28:14.923444+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08ee67d7-4cf0-452b-a362-8a5526fccd74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":521925997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":521925997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":521925997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":521925997}]},"public_addr":"10.20.193.57:6803/521925997","cluster_addr":"10.20.193.57:6805/521925997","heartbeat_back_addr":"10.20.193.57:6807/521925997","heartbeat_front_addr":"10.20.193.57:6806/521925997","state":["exists","up"]},{"osd":1,"uuid":"d2ec9481-5b72-4197-a3ed-b1029fb07580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6800","nonce":3025704390}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":3025704390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":3025704390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":3025704390}]},"public_addr":"10.20.193.57:6800/3025704390","cluster_addr":"10.20.193.57:6801/3025704390","heartbeat_back_addr":"10.20.193.57:6804/3025704390","heartbeat_front_addr":"10.20.193.57:6802/3025704390","state":["exists","up"]},{"osd":2,"uuid":"7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3129121469}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3129121469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3129121469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3129121469}]},"public_addr":"10.20.193.57:6808/3129121469","cluster_addr":"10.20.193.57:6809/3129121469","heartbeat_back_addr":"10.20.193.57:6811/3129121469","heartbeat_front_addr":"10.20.193.57:6810/3129121469","state":["exists","up"]},{"osd":3,"uuid":"108524be-58bc-4950-b88f-d85dfa77ef48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6801","nonce":634754599}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6802","nonce":634754599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6804","nonce":634754599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6803","nonce":634754599}]},"public_addr":"10.20.193.82:6801/634754599","cluster_addr":"10.20.193.82:6802/634754599","heartbeat_back_addr":"10.20.193.82:6804/634754599","heartbeat_front_addr":"10.20.193.82:6803/634754599","state":["exists","up"]},{"osd":4,"uuid":"e9bb983d-b2d5-4543-a960-f450bede62cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6805","nonce":687524042}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6806","nonce":687524042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6808","nonce":687524042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6807","nonce":687524042}]},"public_addr":"10.20.193.82:6805/687524042","cluster_addr":"10.20.193.82:6806/687524042","heartbeat_back_addr":"10.20.193.82:6808/687524042","heartbeat_front_addr":"10.20.193.82:6807/687524042","state":["exists","up"]},{"osd":5,"uuid":"047804d0-f125-4ef6-ac99-8f8ed7d594ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6809","nonce":1303150362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6810","nonce":1303150362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6812","nonce":1303150362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6811","nonce":1303150362}]},"public_addr":"10.20.193.82:6809/1303150362","cluster_addr":"10.20.193.82:6810/1303150362","heartbeat_back_addr":"10.20.193.82:6812/1303150362","heartbeat_front_addr":"10.20.193.82:6811/1303150362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T17:28:19.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.933+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 >> v1:10.20.193.82:6800/2441377515 conn(0x7f098803fc70 legacy=0x7f0988060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.933+0000 7f09c0d0c640 10 monclient: shutdown 2026-02-12T17:28:19.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.933+0000 7f09c0d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:19.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.933+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 >> v1:10.20.193.57:6789/0 conn(0x7f09bc08c730 legacy=0x7f09bc1920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:19.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.933+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 shutdown_connections 2026-02-12T17:28:19.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.933+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 >> 10.20.193.57:0/581270157 conn(0x7f09bc091620 msgr2=0x7f09bc0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:19.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.933+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 shutdown_connections 2026-02-12T17:28:19.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:19.933+0000 7f09c0d0c640 1 -- 10.20.193.57:0/581270157 wait complete. 2026-02-12T17:28:19.940 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T17:28:19.940 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T17:28:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient: monmap: 2026-02-12T17:28:20.005 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.005 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.005 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.008034+0000 2026-02-12T17:28:20.005 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.008034+0000 2026-02-12T17:28:20.005 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.006 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.006 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.006 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.006 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.006 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 1 Processor -- start 2026-02-12T17:28:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 1 -- start start 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient: init 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient(hunting): picked mon.noname-a con 0x7fa8a008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient(hunting): picked mon.noname-c con 0x7fa8a008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient(hunting): picked mon.noname-b con 0x7fa8a008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a008d600 con 0x7fa8a008ae20 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a008b1f0 con 0x7fa8a008c730 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a008d1f0 con 0x7fa8a008cb30 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.007+0000 7fa8a6fb9640 10 monclient(hunting): authenticate will time out at 579.826955s 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.008+0000 7fa8a4d2e640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fa8a008ae20 0x7fa8a008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38504/0 (socket says 10.20.193.57:38504) 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.008+0000 7fa8a4d2e640 1 -- 10.20.193.57:0/2114457250 learned_addr learned my addr 10.20.193.57:0/2114457250 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8a4d2e640 1 -- 10.20.193.57:0/2114457250 >> v1:10.20.193.57:6789/0 conn(0x7fa8a008ae20 legacy=0x7fa8a008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8a552f640 1 -- 10.20.193.57:0/2114457250 >> v1:10.20.193.57:6790/0 conn(0x7fa8a008cb30 legacy=0x7fa8a01a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa897fff640 1 -- 10.20.193.57:0/2114457250 >> v1:10.20.193.82:6789/0 conn(0x7fa8a008c730 legacy=0x7fa8a0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913532069 0 0) 0x7fa8a008d600 con 0x7fa8a008ae20 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): my global_id is 4260 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa88c0035e0 con 0x7fa8a008ae20 2026-02-12T17:28:20.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099566829 0 0) 0x7fa8a008d1f0 con 0x7fa8a008cb30 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): my global_id is 4235 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a008d600 con 0x7fa8a008cb30 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003966756 0 0) 0x7fa8a008b1f0 con 0x7fa8a008c730 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient(hunting): my global_id is 4216 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a008d1f0 con 0x7fa8a008c730 2026-02-12T17:28:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1480051257 0 0) 0x7fa8a008d600 con 0x7fa8a008cb30 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 >> v1:10.20.193.82:6789/0 conn(0x7fa8a008c730 legacy=0x7fa8a0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 >> v1:10.20.193.57:6789/0 conn(0x7fa8a008ae20 legacy=0x7fa8a008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 monclient: found mon.noname-b 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a0057320 con 0x7fa8a008cb30 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa89c004270 con 0x7fa8a008cb30 2026-02-12T17:28:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: dump: 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8a6fb9640 5 monclient: authenticate success, global_id 4235 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8a6fb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa89c0043d0 con 0x7fa8a008cb30 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 1 -- 10.20.193.57:0/2114457250 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa89c0047b0 con 0x7fa8a008cb30 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8977fe640 10 monclient: dump: 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.021 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8a6fb9640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.010+0000 7fa8a6fb9640 4 set_mon_vals no callback set 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 10 monclient: shutdown 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/2114457250 >> v1:10.20.193.57:6790/0 conn(0x7fa8a008cb30 legacy=0x7fa8a01a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/2114457250 shutdown_connections 2026-02-12T17:28:20.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/2114457250 >> 10.20.193.57:0/2114457250 conn(0x7fa8a0091620 msgr2=0x7fa8a0091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/2114457250 shutdown_connections 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/2114457250 wait complete. 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 10 monclient: monmap: 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.023 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 1 Processor -- start 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 1 -- start start 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.011+0000 7fa8a6fb9640 10 monclient: init 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 10 monclient(hunting): picked mon.noname-a con 0x7fa8a008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 10 monclient(hunting): picked mon.noname-c con 0x7fa8a008c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 10 monclient(hunting): picked mon.noname-b con 0x7fa8a008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a008d9c0 con 0x7fa8a008ae20 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a0083240 con 0x7fa8a008cb30 2026-02-12T17:28:20.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a0088810 con 0x7fa8a008c730 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a6fb9640 10 monclient(hunting): authenticate will time out at 579.831168s 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa897fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fa8a008c730 0x7fa8a0194030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42460/0 (socket says 10.20.193.57:42460) 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa8a4d2e640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fa8a008ae20 0x7fa8a0153350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38514/0 (socket says 10.20.193.57:38514) 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.012+0000 7fa897fff640 1 -- 10.20.193.57:0/1540011830 learned_addr learned my addr 10.20.193.57:0/1540011830 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa897fff640 1 -- 10.20.193.57:0/1540011830 >> v1:10.20.193.57:6790/0 conn(0x7fa8a008c730 legacy=0x7fa8a0194030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8a4d2e640 1 -- 10.20.193.57:0/1540011830 >> v1:10.20.193.57:6789/0 conn(0x7fa8a008ae20 legacy=0x7fa8a0153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790181409 0 0) 0x7fa8a008d9c0 con 0x7fa8a008ae20 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): my global_id is 4263 2026-02-12T17:28:20.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8700035e0 con 0x7fa8a008ae20 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437438618 0 0) 0x7fa8a0088810 con 0x7fa8a008c730 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): my global_id is 4238 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a008d9c0 con 0x7fa8a008c730 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8a552f640 1 -- 10.20.193.57:0/1540011830 >> v1:10.20.193.82:6789/0 conn(0x7fa8a008cb30 legacy=0x7fa8a0195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 374111769 0 0) 0x7fa8700035e0 con 0x7fa8a008ae20 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8a0088810 con 0x7fa8a008ae20 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2302217985 0 0) 0x7fa8a008d9c0 con 0x7fa8a008c730 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8700035e0 con 0x7fa8a008c730 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa890002f00 con 0x7fa8a008ae20 2026-02-12T17:28:20.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): dump: 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.027 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa8880033b0 con 0x7fa8a008c730 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): dump: 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.028 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116740641 0 0) 0x7fa8a0083240 con 0x7fa8a008cb30 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient(hunting): my global_id is 4219 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a008d9c0 con 0x7fa8a008cb30 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1076199783 0 0) 0x7fa8a0088810 con 0x7fa8a008ae20 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 >> v1:10.20.193.57:6790/0 conn(0x7fa8a008c730 legacy=0x7fa8a0194030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 >> v1:10.20.193.82:6789/0 conn(0x7fa8a008cb30 legacy=0x7fa8a0195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 monclient: found mon.a 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a0084d00 con 0x7fa8a008ae20 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8a6fb9640 5 monclient: authenticate success, global_id 4263 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8a6fb9640 10 monclient: _renew_subs 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8a6fb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a0084fe0 con 0x7fa8a008ae20 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8a6fb9640 10 monclient: _renew_subs 2026-02-12T17:28:20.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8a6fb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.014+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa8a0085fa0 con 0x7fa8a008ae20 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa890004b50 con 0x7fa8a008ae20 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8957fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa890004e70 con 0x7fa8a008ae20 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8957fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8957fa640 10 monclient: dump: 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.031 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa896ffd640 4 set_mon_vals no callback set 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8a6fb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8a6fb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8a6fb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a00008d0 con 0x7fa8a008ae20 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fa890011ae0 con 0x7fa8a008ae20 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.015+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7fa89004e8f0 con 0x7fa8a008ae20 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.016+0000 7fa897fff640 10 monclient: get_auth_request con 0x7fa87003fc90 auth_method 0 2026-02-12T17:28:20.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.018+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa8900133f0 con 0x7fa8a008ae20 2026-02-12T17:28:20.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.018+0000 7fa8957fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.018+0000 7fa8957fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.121+0000 7fa8a6fb9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.121+0000 7fa8a6fb9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.121+0000 7fa8a6fb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.121+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8a008f520 con 0x7fa8a008ae20 2026-02-12T17:28:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.122+0000 7fa8957fa640 1 -- 10.20.193.57:0/1540011830 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10823 (unknown 3338201251 0 2882979589) 0x7fa890016930 con 0x7fa8a008ae20 2026-02-12T17:28:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.122+0000 7fa8957fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.122+0000 7fa8957fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:20.121 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:20.121 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":18,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","created":"2026-02-12T17:28:03.716456+0000","modified":"2026-02-12T17:28:19.040587+0000","last_up_change":"2026-02-12T17:28:09.951573+0000","last_in_change":"2026-02-12T17:28:06.940287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T17:28:11.851529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T17:28:14.923444+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08ee67d7-4cf0-452b-a362-8a5526fccd74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":521925997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":521925997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":521925997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":521925997}]},"public_addr":"10.20.193.57:6803/521925997","cluster_addr":"10.20.193.57:6805/521925997","heartbeat_back_addr":"10.20.193.57:6807/521925997","heartbeat_front_addr":"10.20.193.57:6806/521925997","state":["exists","up"]},{"osd":1,"uuid":"d2ec9481-5b72-4197-a3ed-b1029fb07580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6800","nonce":3025704390}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":3025704390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":3025704390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":3025704390}]},"public_addr":"10.20.193.57:6800/3025704390","cluster_addr":"10.20.193.57:6801/3025704390","heartbeat_back_addr":"10.20.193.57:6804/3025704390","heartbeat_front_addr":"10.20.193.57:6802/3025704390","state":["exists","up"]},{"osd":2,"uuid":"7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3129121469}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3129121469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3129121469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3129121469}]},"public_addr":"10.20.193.57:6808/3129121469","cluster_addr":"10.20.193.57:6809/3129121469","heartbeat_back_addr":"10.20.193.57:6811/3129121469","heartbeat_front_addr":"10.20.193.57:6810/3129121469","state":["exists","up"]},{"osd":3,"uuid":"108524be-58bc-4950-b88f-d85dfa77ef48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6801","nonce":634754599}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6802","nonce":634754599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6804","nonce":634754599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6803","nonce":634754599}]},"public_addr":"10.20.193.82:6801/634754599","cluster_addr":"10.20.193.82:6802/634754599","heartbeat_back_addr":"10.20.193.82:6804/634754599","heartbeat_front_addr":"10.20.193.82:6803/634754599","state":["exists","up"]},{"osd":4,"uuid":"e9bb983d-b2d5-4543-a960-f450bede62cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6805","nonce":687524042}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6806","nonce":687524042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6808","nonce":687524042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6807","nonce":687524042}]},"public_addr":"10.20.193.82:6805/687524042","cluster_addr":"10.20.193.82:6806/687524042","heartbeat_back_addr":"10.20.193.82:6808/687524042","heartbeat_front_addr":"10.20.193.82:6807/687524042","state":["exists","up"]},{"osd":5,"uuid":"047804d0-f125-4ef6-ac99-8f8ed7d594ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6809","nonce":1303150362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6810","nonce":1303150362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6812","nonce":1303150362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6811","nonce":1303150362}]},"public_addr":"10.20.193.82:6809/1303150362","cluster_addr":"10.20.193.82:6810/1303150362","heartbeat_back_addr":"10.20.193.82:6812/1303150362","heartbeat_front_addr":"10.20.193.82:6811/1303150362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T17:28:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.123+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 >> v1:10.20.193.82:6800/2441377515 conn(0x7fa87003fc90 legacy=0x7fa870060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.123+0000 7fa8a6fb9640 10 monclient: shutdown 2026-02-12T17:28:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.123+0000 7fa8a6fb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.123+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 >> v1:10.20.193.57:6789/0 conn(0x7fa8a008ae20 legacy=0x7fa8a0153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.123+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 shutdown_connections 2026-02-12T17:28:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.123+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 >> 10.20.193.57:0/1540011830 conn(0x7fa8a0091620 msgr2=0x7fa8a00597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.123+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 shutdown_connections 2026-02-12T17:28:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.123+0000 7fa8a6fb9640 1 -- 10.20.193.57:0/1540011830 wait complete. 2026-02-12T17:28:20.129 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T17:28:20.130 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T17:28:20.130 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T17:28:20.131 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-12T17:28:20.131 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-12T17:28:20.131 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-12T17:28:20.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.200+0000 7f8626f54640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.200+0000 7f8626f54640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.200+0000 7f8626f54640 10 monclient: monmap: 2026-02-12T17:28:20.200 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.200 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.200 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.201607+0000 2026-02-12T17:28:20.200 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.201607+0000 2026-02-12T17:28:20.200 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 1 Processor -- start 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 1 -- start start 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 10 monclient: init 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 10 monclient(hunting): picked mon.noname-a con 0x7f862008f2a0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 10 monclient(hunting): picked mon.noname-c con 0x7f862008f670 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 10 monclient(hunting): picked mon.noname-b con 0x7f862008fa40 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f862008fe80 con 0x7f862008f2a0 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8620091a40 con 0x7f862008f670 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8620091630 con 0x7f862008fa40 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8626f54640 10 monclient(hunting): authenticate will time out at 580.020629s 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f86254ca640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f862008fa40 0x7f86201a5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42462/0 (socket says 10.20.193.57:42462) 2026-02-12T17:28:20.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f86254ca640 1 -- 10.20.193.57:0/1780292583 learned_addr learned my addr 10.20.193.57:0/1780292583 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.201+0000 7f8624cc9640 1 --1- 10.20.193.57:0/1780292583 >> v1:10.20.193.57:6789/0 conn(0x7f862008f2a0 0x7f8620090890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38528/0 (socket says 10.20.193.57:38528) 2026-02-12T17:28:20.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.202+0000 7f837f10c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.202+0000 7f837f10c640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.202+0000 7f837f10c640 10 monclient: monmap: 2026-02-12T17:28:20.204 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.204 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.204 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.203180+0000 2026-02-12T17:28:20.204 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.203180+0000 2026-02-12T17:28:20.204 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.204 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.204 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.205 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.205 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.205 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.202+0000 7f837f10c640 1 Processor -- start 2026-02-12T17:28:20.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.202+0000 7f837f10c640 1 -- start start 2026-02-12T17:28:20.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.202+0000 7f837f10c640 10 monclient: init 2026-02-12T17:28:20.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient: monmap: 2026-02-12T17:28:20.206 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.206 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.206 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.203926+0000 2026-02-12T17:28:20.206 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.203926+0000 2026-02-12T17:28:20.206 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.206 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.206 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.207 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.207 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.207 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:20.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 10 monclient(hunting): picked mon.noname-a con 0x7f83780906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 10 monclient(hunting): picked mon.noname-b con 0x7f83780911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 10 monclient(hunting): picked mon.noname-c con 0x7f8378185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8378090100 con 0x7f83780906d0 2026-02-12T17:28:20.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8378091a70 con 0x7f8378185070 2026-02-12T17:28:20.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8378092360 con 0x7f83780911b0 2026-02-12T17:28:20.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837f10c640 10 monclient(hunting): authenticate will time out at 580.022212s 2026-02-12T17:28:20.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837ce81640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f83780906d0 0x7f8378090aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38534/0 (socket says 10.20.193.57:38534) 2026-02-12T17:28:20.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f837ce81640 1 -- 10.20.193.57:0/3205723265 learned_addr learned my addr 10.20.193.57:0/3205723265 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 1 Processor -- start 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 1 -- start start 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient: init 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient(hunting): picked mon.noname-c con 0x7f1d680906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient(hunting): picked mon.noname-b con 0x7f1d680911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient(hunting): picked mon.noname-a con 0x7f1d68185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d68090100 con 0x7f1d68185070 2026-02-12T17:28:20.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d68091a70 con 0x7f1d680906d0 2026-02-12T17:28:20.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d68092360 con 0x7f1d680911b0 2026-02-12T17:28:20.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6edbe640 10 monclient(hunting): authenticate will time out at 580.022899s 2026-02-12T17:28:20.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f86254ca640 1 -- 10.20.193.57:0/1780292583 >> v1:10.20.193.57:6790/0 conn(0x7f862008fa40 legacy=0x7f86201a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f8624cc9640 1 -- 10.20.193.57:0/1780292583 >> v1:10.20.193.57:6789/0 conn(0x7f862008f2a0 legacy=0x7f8620090890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f115adc7640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f115adc7640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f115adc7640 10 monclient: monmap: 2026-02-12T17:28:20.213 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.213 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.213 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.204705+0000 2026-02-12T17:28:20.213 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.204705+0000 2026-02-12T17:28:20.213 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.213 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.214 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.214 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.214 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.214 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f8617fff640 1 -- 10.20.193.57:0/1780292583 >> v1:10.20.193.82:6789/0 conn(0x7f862008f670 legacy=0x7f8620183920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7f1d6d334640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1d68185070 0x7f1d681a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38546/0 (socket says 10.20.193.57:38546) 2026-02-12T17:28:20.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f1d6d334640 1 -- 10.20.193.57:0/1783526968 learned_addr learned my addr 10.20.193.57:0/1783526968 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7fdba2852640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7fdba2852640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.203+0000 7fdba2852640 10 monclient: monmap: 2026-02-12T17:28:20.215 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.215 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.216 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.204815+0000 2026-02-12T17:28:20.216 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.204815+0000 2026-02-12T17:28:20.216 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.216 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.216 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.216 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.216 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.216 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3384194093 0 0) 0x7f8610002c20 con 0x7f862008f2a0 2026-02-12T17:28:20.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): my global_id is 4266 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f860c0035e0 con 0x7f862008f2a0 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452561950 0 0) 0x7f8620091630 con 0x7f862008fa40 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): my global_id is 4241 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8610002c20 con 0x7f862008fa40 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099203107 0 0) 0x7f8620091a40 con 0x7f862008f670 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient(hunting): my global_id is 4222 2026-02-12T17:28:20.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8620091630 con 0x7f862008f670 2026-02-12T17:28:20.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 1 Processor -- start 2026-02-12T17:28:20.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 697636675 0 0) 0x7f8620091630 con 0x7f862008f670 2026-02-12T17:28:20.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 >> v1:10.20.193.57:6790/0 conn(0x7f862008fa40 legacy=0x7f86201a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 >> v1:10.20.193.57:6789/0 conn(0x7f862008f2a0 legacy=0x7f8620090890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 monclient: found mon.noname-c 2026-02-12T17:28:20.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 1 Processor -- start 2026-02-12T17:28:20.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862008d5d0 con 0x7f862008f670 2026-02-12T17:28:20.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8608003080 con 0x7f862008f670 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient: dump: 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.222 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f8626f54640 5 monclient: authenticate success, global_id 4222 2026-02-12T17:28:20.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f8626f54640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 1 -- start start 2026-02-12T17:28:20.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 10 monclient: init 2026-02-12T17:28:20.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 1 -- start start 2026-02-12T17:28:20.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 10 monclient: init 2026-02-12T17:28:20.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f8617fff640 1 --1- 10.20.193.57:0/1780292583 >> v1:10.20.193.82:6789/0 conn(0x7f862008f670 0x7f8620183920 :-1 s=OPENED pgs=72 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f8608003310 config(0 keys) 2026-02-12T17:28:20.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8608003310 con 0x7f862008f670 2026-02-12T17:28:20.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f86177fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f8626f54640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.225 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f8626f54640 4 set_mon_vals no callback set 2026-02-12T17:28:20.225 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.225 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:20.225 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 10 monclient(hunting): picked mon.noname-b con 0x7fdb9c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 10 monclient(hunting): picked mon.noname-a con 0x7fdb9c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:20.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 10 monclient(hunting): picked mon.noname-c con 0x7fdb9c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 10 monclient(hunting): picked mon.noname-a con 0x7f11540906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9c08a820 con 0x7fdb9c08c620 2026-02-12T17:28:20.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9c089450 con 0x7fdb9c182cc0 2026-02-12T17:28:20.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 10 monclient(hunting): picked mon.noname-c con 0x7f11540911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9c089730 con 0x7fdb9c08c250 2026-02-12T17:28:20.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 10 monclient(hunting): picked mon.noname-b con 0x7f1154185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1154090100 con 0x7f11540906d0 2026-02-12T17:28:20.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1154091a70 con 0x7f11540911b0 2026-02-12T17:28:20.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1154092360 con 0x7f1154185070 2026-02-12T17:28:20.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdba2852640 10 monclient(hunting): authenticate will time out at 580.023840s 2026-02-12T17:28:20.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7f115adc7640 10 monclient(hunting): authenticate will time out at 580.023854s 2026-02-12T17:28:20.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdb9bfff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fdb9c08c250 0x7fdb9c08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42496/0 (socket says 10.20.193.57:42496) 2026-02-12T17:28:20.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.204+0000 7fdb9bfff640 1 -- 10.20.193.57:0/3896282236 learned_addr learned my addr 10.20.193.57:0/3896282236 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.231 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 10 monclient: shutdown 2026-02-12T17:28:20.231 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.231 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 1 -- 10.20.193.57:0/1780292583 >> v1:10.20.193.82:6789/0 conn(0x7f862008f670 legacy=0x7f8620183920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.231 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f86177fe640 1 -- 10.20.193.57:0/1780292583 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f86080036d0 con 0x7f862008f670 2026-02-12T17:28:20.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f86177fe640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:28:20.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 1 -- 10.20.193.57:0/1780292583 shutdown_connections 2026-02-12T17:28:20.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 1 -- 10.20.193.57:0/1780292583 >> 10.20.193.57:0/1780292583 conn(0x7f862005daa0 msgr2=0x7f862005dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 1 -- 10.20.193.57:0/1780292583 shutdown_connections 2026-02-12T17:28:20.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 1 -- 10.20.193.57:0/1780292583 wait complete. 2026-02-12T17:28:20.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f837ce81640 1 -- 10.20.193.57:0/3205723265 >> v1:10.20.193.57:6789/0 conn(0x7f83780906d0 legacy=0x7f8378090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 10 monclient: monmap: 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.233 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 -- 10.20.193.57:0/3205723265 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3358949274 0 0) 0x7f8378090100 con 0x7f83780906d0 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient(hunting): my global_id is 4269 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 -- 10.20.193.57:0/3205723265 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83640035e0 con 0x7f83780906d0 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 -- 10.20.193.57:0/3205723265 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3287793472 0 0) 0x7f83640035e0 con 0x7f83780906d0 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 -- 10.20.193.57:0/3205723265 >> v1:10.20.193.57:6790/0 conn(0x7f83780911b0 legacy=0x7f8378183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 -- 10.20.193.57:0/3205723265 >> v1:10.20.193.82:6789/0 conn(0x7f8378185070 legacy=0x7f83781a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f837d682640 1 -- 10.20.193.57:0/3205723265 >> v1:10.20.193.82:6789/0 conn(0x7f8378185070 legacy=0x7f83781a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 monclient: found mon.noname-a 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 -- 10.20.193.57:0/3205723265 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837805cf80 con 0x7f83780906d0 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 -- 10.20.193.57:0/3205723265 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8368003150 con 0x7f83780906d0 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: dump: 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.236 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.237 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.237 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.237 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.237 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f837f10c640 5 monclient: authenticate success, global_id 4269 2026-02-12T17:28:20.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f837f10c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 1 Processor -- start 2026-02-12T17:28:20.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 1 -- start start 2026-02-12T17:28:20.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f8626f54640 10 monclient: init 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f715b2cc640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f715b2cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f715b2cc640 10 monclient: monmap: 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.206683+0000 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.206683+0000 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.238 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 -- 10.20.193.57:0/3205723265 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f83680033a0 con 0x7f83780906d0 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 1 -- 10.20.193.57:0/3205723265 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8368004b10 con 0x7f83780906d0 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f836f7fe640 10 monclient: dump: 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.239 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f837f10c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.205+0000 7f837f10c640 4 set_mon_vals no callback set 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:20.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 10 monclient(hunting): picked mon.noname-b con 0x7f862008f2a0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d6d334640 1 -- 10.20.193.57:0/1783526968 >> v1:10.20.193.57:6789/0 conn(0x7f1d68185070 legacy=0x7f1d681a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 10 monclient(hunting): picked mon.noname-a con 0x7f862008f670 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 10 monclient(hunting): picked mon.noname-c con 0x7f862008fa40 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8620133740 con 0x7f862008f670 2026-02-12T17:28:20.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8620133d00 con 0x7f862008f2a0 2026-02-12T17:28:20.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f862008cba0 con 0x7f862008fa40 2026-02-12T17:28:20.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8626f54640 10 monclient(hunting): authenticate will time out at 580.025241s 2026-02-12T17:28:20.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 1 Processor -- start 2026-02-12T17:28:20.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5ffff640 1 -- 10.20.193.57:0/1783526968 >> v1:10.20.193.57:6790/0 conn(0x7f1d680911b0 legacy=0x7f1d68183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8617fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f862008f670 0x7f8620193a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38556/0 (socket says 10.20.193.57:38556) 2026-02-12T17:28:20.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f8617fff640 1 -- 10.20.193.57:0/2660252103 learned_addr learned my addr 10.20.193.57:0/2660252103 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 1 -- start start 2026-02-12T17:28:20.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 10 monclient: init 2026-02-12T17:28:20.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d6cb33640 1 -- 10.20.193.57:0/1783526968 >> v1:10.20.193.82:6789/0 conn(0x7f1d680906d0 legacy=0x7f1d68090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589478557 0 0) 0x7f1d68092360 con 0x7f1d680911b0 2026-02-12T17:28:20.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient(hunting): my global_id is 4244 2026-02-12T17:28:20.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d540035e0 con 0x7f1d680911b0 2026-02-12T17:28:20.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f837f10c640 10 monclient: shutdown 2026-02-12T17:28:20.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4234896988 0 0) 0x7f1d68090100 con 0x7f1d68185070 2026-02-12T17:28:20.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f837f10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f837f10c640 1 -- 10.20.193.57:0/3205723265 >> v1:10.20.193.57:6789/0 conn(0x7f83780906d0 legacy=0x7f8378090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f114bfff640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f11540911b0 0x7f1154183950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:43652/0 (socket says 10.20.193.57:43652) 2026-02-12T17:28:20.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f114bfff640 1 -- 10.20.193.57:0/1555541611 learned_addr learned my addr 10.20.193.57:0/1555541611 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient(hunting): my global_id is 4272 2026-02-12T17:28:20.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d68092360 con 0x7f1d68185070 2026-02-12T17:28:20.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f837f10c640 1 -- 10.20.193.57:0/3205723265 shutdown_connections 2026-02-12T17:28:20.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f837f10c640 1 -- 10.20.193.57:0/3205723265 >> 10.20.193.57:0/3205723265 conn(0x7f8378054330 msgr2=0x7f8378054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f837f10c640 1 -- 10.20.193.57:0/3205723265 shutdown_connections 2026-02-12T17:28:20.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f837f10c640 1 -- 10.20.193.57:0/3205723265 wait complete. 2026-02-12T17:28:20.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:20.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 38125517 0 0) 0x7f1d540035e0 con 0x7f1d680911b0 2026-02-12T17:28:20.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 >> v1:10.20.193.82:6789/0 conn(0x7f1d680906d0 legacy=0x7f1d68090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 >> v1:10.20.193.57:6789/0 conn(0x7f1d68185070 legacy=0x7f1d681a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 10 monclient(hunting): picked mon.noname-a con 0x7f71540906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 10 monclient(hunting): picked mon.noname-b con 0x7f71540911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 monclient: found mon.noname-b 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6805cf80 con 0x7f1d680911b0 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 10 monclient(hunting): picked mon.noname-c con 0x7f7154185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7154090100 con 0x7f71540906d0 2026-02-12T17:28:20.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7154091a70 con 0x7f7154185070 2026-02-12T17:28:20.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1d50003120 con 0x7f1d680911b0 2026-02-12T17:28:20.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d6edbe640 5 monclient: authenticate success, global_id 4244 2026-02-12T17:28:20.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7154092360 con 0x7f71540911b0 2026-02-12T17:28:20.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f715b2cc640 10 monclient(hunting): authenticate will time out at 580.025621s 2026-02-12T17:28:20.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d6edbe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: dump: 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d6edbe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f7159041640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f71540906d0 0x7f7154090aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38558/0 (socket says 10.20.193.57:38558) 2026-02-12T17:28:20.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f7159041640 1 -- 10.20.193.57:0/3877040032 learned_addr learned my addr 10.20.193.57:0/3877040032 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d500033b0 con 0x7f1d680911b0 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d6edbe640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d6edbe640 4 set_mon_vals no callback set 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 1 -- 10.20.193.57:0/1783526968 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1d50003880 con 0x7f1d680911b0 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f1d5f7fe640 10 monclient: dump: 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.250 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f837f10c640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7f837f10c640 10 monclient: monmap: 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.206+0000 7fdb9bfff640 1 -- 10.20.193.57:0/3896282236 >> v1:10.20.193.57:6790/0 conn(0x7fdb9c08c250 legacy=0x7fdb9c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 10 monclient: shutdown 2026-02-12T17:28:20.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 1 -- 10.20.193.57:0/1783526968 >> v1:10.20.193.57:6790/0 conn(0x7f1d680911b0 legacy=0x7f1d68183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 1 -- 10.20.193.57:0/1783526968 shutdown_connections 2026-02-12T17:28:20.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 1 -- 10.20.193.57:0/1783526968 >> 10.20.193.57:0/1783526968 conn(0x7f1d68054330 msgr2=0x7f1d68054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 1 -- 10.20.193.57:0/1783526968 shutdown_connections 2026-02-12T17:28:20.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 1 Processor -- start 2026-02-12T17:28:20.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 1 -- 10.20.193.57:0/1783526968 wait complete. 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 1 -- start start 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 10 monclient: init 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 10 monclient(hunting): picked mon.noname-c con 0x7f83780906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 10 monclient(hunting): picked mon.noname-b con 0x7f83780911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 10 monclient(hunting): picked mon.noname-a con 0x7f8378185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837808b630 con 0x7f8378185070 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8378133b40 con 0x7f83780911b0 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8378130bd0 con 0x7f83780906d0 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f837f10c640 10 monclient(hunting): authenticate will time out at 580.026576s 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 10 monclient: monmap: 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 1 Processor -- start 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 1 -- start start 2026-02-12T17:28:20.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.207+0000 7f1d6edbe640 10 monclient: init 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 10 monclient(hunting): picked mon.noname-a con 0x7f1d680906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 10 monclient(hunting): picked mon.noname-c con 0x7f1d680911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 10 monclient(hunting): picked mon.noname-b con 0x7f1d68185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d68133cd0 con 0x7f1d680906d0 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6808b860 con 0x7f1d68185070 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d68132e60 con 0x7f1d680911b0 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6edbe640 10 monclient(hunting): authenticate will time out at 580.027225s 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7fdb9b7fe640 1 -- 10.20.193.57:0/3896282236 >> v1:10.20.193.57:6789/0 conn(0x7fdb9c08c620 legacy=0x7fdb9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f8617fff640 1 -- 10.20.193.57:0/2660252103 >> v1:10.20.193.57:6789/0 conn(0x7f862008f670 legacy=0x7f8620193a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7fdba0dc8640 1 -- 10.20.193.57:0/3896282236 >> v1:10.20.193.82:6789/0 conn(0x7fdb9c182cc0 legacy=0x7fdb9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722359871 0 0) 0x7f8620133740 con 0x7f862008f670 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f86157fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f86157fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f86157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f86157fa640 10 monclient(hunting): my global_id is 4278 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f00035e0 con 0x7f862008f670 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f114bfff640 1 -- 10.20.193.57:0/1555541611 >> v1:10.20.193.82:6789/0 conn(0x7f11540911b0 legacy=0x7f1154183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f8617fff640 1 --1- 10.20.193.57:0/2660252103 >> v1:10.20.193.57:6789/0 conn(0x7f862008f670 0x7f8620193a00 :-1 s=OPENED pgs=82 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f85f00035e0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3074554158 0 0) 0x7f85f00035e0 con 0x7f862008f670 2026-02-12T17:28:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8620133740 con 0x7f862008f670 2026-02-12T17:28:20.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f7159041640 1 -- 10.20.193.57:0/3877040032 >> v1:10.20.193.57:6789/0 conn(0x7f71540906d0 legacy=0x7f7154090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f7159842640 1 -- 10.20.193.57:0/3877040032 >> v1:10.20.193.82:6789/0 conn(0x7f7154185070 legacy=0x7f71541a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f836ffff640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f83780911b0 0x7f83781304c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:43686/0 (socket says 10.20.193.57:43686) 2026-02-12T17:28:20.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f836ffff640 1 -- 10.20.193.57:0/3166028475 learned_addr learned my addr 10.20.193.57:0/3166028475 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6d334640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f1d68185070 0x7f1d68174c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:43702/0 (socket says 10.20.193.57:43702) 2026-02-12T17:28:20.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.208+0000 7f1d6d334640 1 -- 10.20.193.57:0/4268149896 learned_addr learned my addr 10.20.193.57:0/4268149896 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2546373845 0 0) 0x7f1154091a70 con 0x7f11540911b0 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f114b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f114b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f114b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f114b7fe640 10 monclient(hunting): my global_id is 4231 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11400035e0 con 0x7f11540911b0 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86254ca640 1 -- 10.20.193.57:0/2660252103 >> v1:10.20.193.57:6790/0 conn(0x7f862008fa40 legacy=0x7f8620195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322589104 0 0) 0x7f7154091a70 con 0x7f7154185070 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f7143fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f7143fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f7143fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f115933d640 1 -- 10.20.193.57:0/1555541611 >> v1:10.20.193.57:6790/0 conn(0x7f1154185070 legacy=0x7f11541a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f7143fff640 10 monclient(hunting): my global_id is 4234 2026-02-12T17:28:20.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f713c0035e0 con 0x7f7154185070 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 -- 10.20.193.57:0/3896282236 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3409773827 0 0) 0x7fdb9c089730 con 0x7fdb9c08c250 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient(hunting): my global_id is 4247 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 -- 10.20.193.57:0/3896282236 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb800035e0 con 0x7fdb9c08c250 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909788967 0 0) 0x7f862008cba0 con 0x7f862008fa40 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient(hunting): my global_id is 4253 2026-02-12T17:28:20.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f00035e0 con 0x7f862008fa40 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 -- 10.20.193.57:0/3896282236 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1255304127 0 0) 0x7fdb800035e0 con 0x7fdb9c08c250 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 -- 10.20.193.57:0/3896282236 >> v1:10.20.193.82:6789/0 conn(0x7fdb9c182cc0 legacy=0x7fdb9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 -- 10.20.193.57:0/3896282236 >> v1:10.20.193.57:6789/0 conn(0x7fdb9c08c620 legacy=0x7fdb9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 monclient: found mon.noname-b 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 -- 10.20.193.57:0/3896282236 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9c089a10 con 0x7fdb9c08c250 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 -- 10.20.193.57:0/3896282236 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdb880030d0 con 0x7fdb9c08c250 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: dump: 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 5 monclient: authenticate success, global_id 4247 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 923415306 0 0) 0x7f85f00035e0 con 0x7f862008fa40 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f862008cba0 con 0x7f862008fa40 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f861c004470 con 0x7f862008fa40 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:20.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient(hunting): dump: 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 -- 10.20.193.57:0/3896282236 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb880033d0 con 0x7fdb9c08c250 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 1 -- 10.20.193.57:0/3896282236 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdb88004b10 con 0x7fdb9c08c250 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdb9affd640 10 monclient: dump: 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.262 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 4 set_mon_vals no callback set 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1021809673 0 0) 0x7f862008cba0 con 0x7f862008fa40 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 >> v1:10.20.193.82:6789/0 conn(0x7f862008f2a0 legacy=0x7f8620152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 >> v1:10.20.193.57:6789/0 conn(0x7f862008f670 legacy=0x7f8620193a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 monclient: found mon.c 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86201319a0 con 0x7f862008fa40 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f86080036d0 con 0x7f862008f670 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f8626f54640 5 monclient: authenticate success, global_id 4253 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f8626f54640 10 monclient: _renew_subs 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f8626f54640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8620133460 con 0x7f862008fa40 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f8626f54640 10 monclient: _renew_subs 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f8626f54640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8620132500 con 0x7f862008fa40 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 10 monclient: shutdown 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 1 -- 10.20.193.57:0/3896282236 >> v1:10.20.193.57:6790/0 conn(0x7fdb9c08c250 legacy=0x7fdb9c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f861c005c30 con 0x7f862008fa40 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f861c005f80 con 0x7f862008fa40 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f86157fa640 10 monclient: dump: 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7f8616ffd640 4 set_mon_vals no callback set 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 1 -- 10.20.193.57:0/3896282236 shutdown_connections 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 1 -- 10.20.193.57:0/3896282236 >> 10.20.193.57:0/3896282236 conn(0x7fdb9c0916b0 msgr2=0x7fdb9c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 1 -- 10.20.193.57:0/3896282236 shutdown_connections 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.209+0000 7fdba2852640 1 -- 10.20.193.57:0/3896282236 wait complete. 2026-02-12T17:28:20.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f8626f54640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f86201327b0 con 0x7f862008fa40 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7fdba2852640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f861c012d20 con 0x7f862008fa40 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7fdba2852640 10 monclient: monmap: 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f1158b3c640 1 -- 10.20.193.57:0/1555541611 >> v1:10.20.193.57:6789/0 conn(0x7f11540906d0 legacy=0x7f1154090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7fdba2852640 1 Processor -- start 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f861c04fb10 con 0x7f862008fa40 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183862746 0 0) 0x7f1154090100 con 0x7f11540906d0 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 10 monclient(hunting): my global_id is 4284 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1154091a70 con 0x7f11540906d0 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6808/3129121469 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85f00862a0 con 0x7f85f0064600 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f8624cc9640 10 monclient: get_auth_request con 0x7f85f003f9d0 auth_method 0 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f861c014800 con 0x7f862008fa40 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f86157fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7fdba2852640 1 -- start start 2026-02-12T17:28:20.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7fdba2852640 10 monclient: init 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f8617fff640 10 monclient: get_auth_request con 0x7f85f0064600 auth_method 0 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3411250246 0 0) 0x7f1154091a70 con 0x7f11540906d0 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 >> v1:10.20.193.57:6790/0 conn(0x7f1154185070 legacy=0x7f11541a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 >> v1:10.20.193.82:6789/0 conn(0x7f11540911b0 legacy=0x7f1154183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 1 monclient: found mon.noname-a 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.210+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115405cf80 con 0x7f11540906d0 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1144003120 con 0x7f11540906d0 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 10 monclient: dump: 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.268 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 5 monclient: authenticate success, global_id 4284 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 10 monclient(hunting): picked mon.noname-b con 0x7fdb9c08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11440033b0 con 0x7f11540906d0 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 1 -- 10.20.193.57:0/1555541611 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1144003550 con 0x7f11540906d0 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 10 monclient(hunting): picked mon.noname-c con 0x7fdb9c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f114b7fe640 10 monclient: dump: 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 4 set_mon_vals no callback set 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 10 monclient(hunting): picked mon.noname-a con 0x7fdb9c182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9c05bbc0 con 0x7fdb9c182cc0 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9c1993c0 con 0x7fdb9c08c250 2026-02-12T17:28:20.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d6cb33640 1 -- 10.20.193.57:0/4268149896 >> v1:10.20.193.57:6789/0 conn(0x7f1d680906d0 legacy=0x7f1d6812feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9c13e900 con 0x7fdb9c08c620 2026-02-12T17:28:20.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836ffff640 1 -- 10.20.193.57:0/3166028475 >> v1:10.20.193.82:6789/0 conn(0x7f83780911b0 legacy=0x7f83781304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdb9b7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fdb9c08c620 0x7fdb9c198cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42550/0 (socket says 10.20.193.57:42550) 2026-02-12T17:28:20.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdb9b7fe640 1 -- 10.20.193.57:0/1132913044 learned_addr learned my addr 10.20.193.57:0/1132913044 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7fdba2852640 10 monclient(hunting): authenticate will time out at 580.030215s 2026-02-12T17:28:20.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d6d334640 1 -- 10.20.193.57:0/4268149896 >> v1:10.20.193.82:6789/0 conn(0x7f1d68185070 legacy=0x7f1d68174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f837d682640 1 -- 10.20.193.57:0/3166028475 >> v1:10.20.193.57:6789/0 conn(0x7f8378185070 legacy=0x7f8378174a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671986318 0 0) 0x7f7154090100 con 0x7f71540906d0 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883630124 0 0) 0x7f1d68133cd0 con 0x7f1d680906d0 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): my global_id is 4287 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d380035e0 con 0x7f1d680906d0 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f837ce81640 1 -- 10.20.193.57:0/3166028475 >> v1:10.20.193.57:6790/0 conn(0x7f83780906d0 legacy=0x7f837812fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414779831 0 0) 0x7f8378133b40 con 0x7f83780911b0 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): my global_id is 4240 2026-02-12T17:28:20.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83480035e0 con 0x7f83780911b0 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient(hunting): my global_id is 4281 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7154091a70 con 0x7f71540906d0 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 10 monclient: shutdown 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 1 -- 10.20.193.57:0/1555541611 >> v1:10.20.193.57:6789/0 conn(0x7f11540906d0 legacy=0x7f1154090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514856550 0 0) 0x7f1d6808b860 con 0x7f1d68185070 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): my global_id is 4243 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d68133cd0 con 0x7f1d68185070 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7158840640 1 -- 10.20.193.57:0/3877040032 >> v1:10.20.193.57:6790/0 conn(0x7f71540911b0 legacy=0x7f7154183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296592311 0 0) 0x7f7154092360 con 0x7f71540911b0 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 1 -- 10.20.193.57:0/1555541611 shutdown_connections 2026-02-12T17:28:20.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 1 -- 10.20.193.57:0/1555541611 >> 10.20.193.57:0/1555541611 conn(0x7f1154054330 msgr2=0x7f1154054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260348303 0 0) 0x7f837808b630 con 0x7f8378185070 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 1 -- 10.20.193.57:0/1555541611 shutdown_connections 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): my global_id is 4290 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8378133b40 con 0x7f8378185070 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489419731 0 0) 0x7f8378130bd0 con 0x7f83780906d0 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): my global_id is 4256 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 1 -- 10.20.193.57:0/1555541611 wait complete. 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f837808b630 con 0x7f83780906d0 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 776560494 0 0) 0x7f83480035e0 con 0x7f83780911b0 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8378130bd0 con 0x7f83780911b0 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f83600043b0 con 0x7f83780911b0 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): dump: 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient(hunting): my global_id is 4259 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7154090100 con 0x7f71540911b0 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 397260791 0 0) 0x7f713c0035e0 con 0x7f7154185070 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 >> v1:10.20.193.57:6790/0 conn(0x7f71540911b0 legacy=0x7f7154183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 >> v1:10.20.193.57:6789/0 conn(0x7f71540906d0 legacy=0x7f7154090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 monclient: found mon.noname-c 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 230166303 0 0) 0x7f8378130bd0 con 0x7f83780911b0 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 >> v1:10.20.193.57:6790/0 conn(0x7f83780906d0 legacy=0x7f837812fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715405cf80 con 0x7f7154185070 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 >> v1:10.20.193.57:6789/0 conn(0x7f8378185070 legacy=0x7f8378174a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 monclient: found mon.b 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8378062bb0 con 0x7f83780911b0 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f837f10c640 5 monclient: authenticate success, global_id 4240 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f837f10c640 10 monclient: _renew_subs 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f837f10c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8378132cd0 con 0x7f83780911b0 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d6d334640 1 --1- 10.20.193.57:0/4268149896 >> v1:10.20.193.82:6789/0 conn(0x7f1d68185070 0x7f1d68174c80 :-1 s=OPENED pgs=80 gs=3 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f1d68133cd0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2542586233 0 0) 0x7f1d68133cd0 con 0x7f1d68185070 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f837f10c640 10 monclient: _renew_subs 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f837f10c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8378133860 con 0x7f83780911b0 2026-02-12T17:28:20.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d6808b860 con 0x7f1d68185070 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7150004200 con 0x7f7154185070 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8360002950 con 0x7f83780911b0 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8360002ca0 con 0x7f83780911b0 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836effd640 4 set_mon_vals no callback set 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f836d7fa640 10 monclient: dump: 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.278 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3609587324 0 0) 0x7f1d380035e0 con 0x7f1d680906d0 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d68133cd0 con 0x7f1d680906d0 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1d58003340 con 0x7f1d680906d0 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): dump: 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: dump: 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.279 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1d64004380 con 0x7f1d68185070 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f1d5d7fa640 10 monclient(hunting): dump: 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f715b2cc640 5 monclient: authenticate success, global_id 4234 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f715b2cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7150004490 con 0x7f7154185070 2026-02-12T17:28:20.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 1 -- 10.20.193.57:0/3877040032 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7150004630 con 0x7f7154185070 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f7143fff640 10 monclient: dump: 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.211+0000 7f115adc7640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 10 monclient: monmap: 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 312106714 0 0) 0x7f1d68133cd0 con 0x7f1d680906d0 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 >> v1:10.20.193.57:6790/0 conn(0x7f1d680911b0 legacy=0x7f1d681305c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 >> v1:10.20.193.82:6789/0 conn(0x7f1d68185070 legacy=0x7f1d68174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 1 Processor -- start 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 1 monclient: found mon.a 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d68131970 con 0x7f1d680906d0 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 4 set_mon_vals no callback set 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3348461619 0 0) 0x7f1d6808b860 con 0x7f1d68185070 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d6edbe640 5 monclient: authenticate success, global_id 4287 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d6edbe640 10 monclient: _renew_subs 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d6edbe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1d68062bb0 con 0x7f1d680906d0 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 1 -- start start 2026-02-12T17:28:20.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 10 monclient: init 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d6edbe640 10 monclient: _renew_subs 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d6edbe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1d68130cd0 con 0x7f1d680906d0 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f837f10c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.82:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f837805c950 con 0x7f83780911b0 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d58003980 con 0x7f1d680906d0 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1d58003ca0 con 0x7f1d680906d0 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5effd640 4 set_mon_vals no callback set 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 10 monclient: dump: 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 10 monclient: shutdown 2026-02-12T17:28:20.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 1 -- 10.20.193.57:0/3877040032 >> v1:10.20.193.82:6789/0 conn(0x7f7154185070 legacy=0x7f71541a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 1 -- 10.20.193.57:0/3877040032 shutdown_connections 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 1 -- 10.20.193.57:0/3877040032 >> 10.20.193.57:0/3877040032 conn(0x7f7154054330 msgr2=0x7f7154054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 1 -- 10.20.193.57:0/3877040032 shutdown_connections 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 10 monclient(hunting): picked mon.noname-a con 0x7f11540906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 1 -- 10.20.193.57:0/3877040032 wait complete. 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 10 monclient(hunting): picked mon.noname-b con 0x7f11540911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 10 monclient(hunting): picked mon.noname-c con 0x7f1154185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115408b700 con 0x7f11540906d0 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11541381a0 con 0x7f11540911b0 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1154062bb0 con 0x7f1154185070 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f115adc7640 10 monclient(hunting): authenticate will time out at 580.031603s 2026-02-12T17:28:20.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f8360002ef0 con 0x7f83780911b0 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1158b3c640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f11540906d0 0x7f1154142760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38600/0 (socket says 10.20.193.57:38600) 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1158b3c640 1 -- 10.20.193.57:0/2820513315 learned_addr learned my addr 10.20.193.57:0/2820513315 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d6edbe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.57:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f1d6805c950 con 0x7f1d680906d0 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f836004ea40 con 0x7f83780911b0 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1d58003f30 con 0x7f1d680906d0 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.57:6803/521925997 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8348086210 con 0x7f8348064570 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f836004edf0 con 0x7f83780911b0 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f836d7fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f837ce81640 10 monclient: get_auth_request con 0x7f834803f990 auth_method 0 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f837d682640 10 monclient: get_auth_request con 0x7f8348064570 auth_method 0 2026-02-12T17:28:20.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.212+0000 7f715b2cc640 10 monclient: monmap: 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f1d5804ea80 con 0x7f1d680906d0 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.82:6801/634754599 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d380862b0 con 0x7f1d38064610 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f1d5804ee30 con 0x7f1d680906d0 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f1d5d7fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 1 Processor -- start 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 1 -- start start 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 10 monclient: init 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb9b7fe640 1 -- 10.20.193.57:0/1132913044 >> v1:10.20.193.57:6790/0 conn(0x7fdb9c08c620 legacy=0x7fdb9c198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 10 monclient(hunting): picked mon.noname-b con 0x7f71540906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 10 monclient(hunting): picked mon.noname-c con 0x7f71540911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f1d6d334640 10 monclient: get_auth_request con 0x7f1d38064610 auth_method 0 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdba0dc8640 1 -- 10.20.193.57:0/1132913044 >> v1:10.20.193.57:6789/0 conn(0x7fdb9c182cc0 legacy=0x7fdb9c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 10 monclient(hunting): picked mon.noname-a con 0x7f7154185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715408de50 con 0x7f7154185070 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715414eba0 con 0x7f71540906d0 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71541202d0 con 0x7f71540911b0 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f715b2cc640 10 monclient(hunting): authenticate will time out at 580.032521s 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb9bfff640 1 -- 10.20.193.57:0/1132913044 >> v1:10.20.193.82:6789/0 conn(0x7fdb9c08c250 legacy=0x7fdb9c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 111569592 0 0) 0x7fdb9c13e900 con 0x7fdb9c08c620 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): my global_id is 4262 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb6c0035e0 con 0x7fdb9c08c620 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f7159842640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f7154185070 0x7f7154170b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38610/0 (socket says 10.20.193.57:38610) 2026-02-12T17:28:20.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7f7159842640 1 -- 10.20.193.57:0/447368318 learned_addr learned my addr 10.20.193.57:0/447368318 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910679696 0 0) 0x7fdb9c05bbc0 con 0x7fdb9c182cc0 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): my global_id is 4293 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb9c13e900 con 0x7fdb9c182cc0 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498047063 0 0) 0x7fdb9c1993c0 con 0x7fdb9c08c250 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): my global_id is 4246 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb9c05bbc0 con 0x7fdb9c08c250 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 76770715 0 0) 0x7fdb6c0035e0 con 0x7fdb9c08c620 2026-02-12T17:28:20.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb9c1993c0 con 0x7fdb9c08c620 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdb8c0033e0 con 0x7fdb9c08c620 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): dump: 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2197451616 0 0) 0x7fdb9c1993c0 con 0x7fdb9c08c620 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 >> v1:10.20.193.82:6789/0 conn(0x7fdb9c08c250 legacy=0x7fdb9c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 >> v1:10.20.193.57:6789/0 conn(0x7fdb9c182cc0 legacy=0x7fdb9c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 monclient: found mon.c 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9c0888a0 con 0x7fdb9c08c620 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdb98ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdba2852640 5 monclient: authenticate success, global_id 4262 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdba2852640 10 monclient: _renew_subs 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdba2852640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9c05c260 con 0x7fdb9c08c620 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdba2852640 10 monclient: _renew_subs 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdba2852640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.213+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb9c05ac50 con 0x7fdb9c08c620 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdba2852640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.57:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdb9c05ba50 con 0x7fdb9c08c620 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb8c003980 con 0x7fdb9c08c620 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdb98ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdb8c003cd0 con 0x7fdb9c08c620 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdb98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdb98ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdb9a7fc640 4 set_mon_vals no callback set 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdb98ff9640 10 monclient: dump: 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.289 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fdb8c003e60 con 0x7fdb9c08c620 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7f1158b3c640 1 -- 10.20.193.57:0/2820513315 >> v1:10.20.193.57:6789/0 conn(0x7f11540906d0 legacy=0x7f1154142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7fdb8c04ea10 con 0x7fdb9c08c620 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289648575 0 0) 0x7f115405cf80 con 0x7f11540906d0 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7f11497fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7f11497fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7f11497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7f11497fa640 10 monclient(hunting): my global_id is 4296 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.214+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11240035e0 con 0x7f11540906d0 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.82:6805/687524042 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb6c086330 con 0x7fdb6c064690 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7fdb8c04edc0 con 0x7fdb9c08c620 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7fdb98ff9640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f114bfff640 1 -- 10.20.193.57:0/2820513315 >> v1:10.20.193.82:6789/0 conn(0x7f11540911b0 legacy=0x7f1154177e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1901443366 0 0) 0x7f11240035e0 con 0x7f11540906d0 2026-02-12T17:28:20.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f115405cf80 con 0x7f11540906d0 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1144002b20 con 0x7f11540906d0 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient(hunting): dump: 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7fdba0dc8640 10 monclient: get_auth_request con 0x7fdb6c064690 auth_method 0 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f1d5ffff640 10 monclient: get_auth_request con 0x7f1d3803f9e0 auth_method 0 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7fdb9bfff640 10 monclient: get_auth_request con 0x7fdb6c03fa30 auth_method 0 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3446849358 0 0) 0x7f115405cf80 con 0x7f11540906d0 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 >> v1:10.20.193.57:6790/0 conn(0x7f1154185070 legacy=0x7f1154179540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 >> v1:10.20.193.82:6789/0 conn(0x7f11540911b0 legacy=0x7f1154177e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 monclient: found mon.a 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1154135e40 con 0x7f11540906d0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f115adc7640 5 monclient: authenticate success, global_id 4296 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f115adc7640 10 monclient: _renew_subs 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f115adc7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1154137900 con 0x7f11540906d0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f115adc7640 10 monclient: _renew_subs 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f115adc7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1154136c00 con 0x7f11540906d0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1144003d50 con 0x7f11540906d0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f11440040e0 con 0x7f11540906d0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 10 monclient: dump: 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f114affd640 4 set_mon_vals no callback set 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== osd.2 v1:10.20.193.57:6808/3129121469 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f85f00862a0 con 0x7f85f0064600 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f7159842640 1 -- 10.20.193.57:0/447368318 >> v1:10.20.193.57:6789/0 conn(0x7f7154185070 legacy=0x7f7154170b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f115adc7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 --> v1:10.20.193.57:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f115405c950 con 0x7f11540906d0 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425374465 0 0) 0x7f715408de50 con 0x7f7154185070 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f7141ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f7141ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f7141ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f7141ffb640 10 monclient(hunting): my global_id is 4299 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1144004370 con 0x7f11540906d0 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.215+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71240035e0 con 0x7f7154185070 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f114404eaf0 con 0x7f11540906d0 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2599370246 0 0) 0x7f71240035e0 con 0x7f7154185070 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f715408de50 con 0x7f7154185070 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7150003c60 con 0x7f7154185070 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient(hunting): dump: 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.293 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 --> v1:10.20.193.57:6800/3025704390 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1124085f30 con 0x7f1124064290 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f114404eea0 con 0x7f11540906d0 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f11497fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f114bfff640 10 monclient: get_auth_request con 0x7f112403f660 auth_method 0 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2417077006 0 0) 0x7f715408de50 con 0x7f7154185070 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 >> v1:10.20.193.57:6790/0 conn(0x7f71540911b0 legacy=0x7f715416f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 >> v1:10.20.193.82:6789/0 conn(0x7f71540906d0 legacy=0x7f715411fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 monclient: found mon.a 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f115933d640 10 monclient: get_auth_request con 0x7f1124064290 auth_method 0 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7154062bb0 con 0x7f7154185070 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f715b2cc640 5 monclient: authenticate success, global_id 4299 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f715b2cc640 10 monclient: _renew_subs 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f715b2cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f715410c570 con 0x7f7154185070 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f715b2cc640 10 monclient: _renew_subs 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f715b2cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f715408e9b0 con 0x7f7154185070 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7150004e20 con 0x7f7154185070 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7150005180 con 0x7f7154185070 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f71437fe640 4 set_mon_vals no callback set 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f7141ffb640 10 monclient: dump: 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f715b2cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.216+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 --> v1:10.20.193.57:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f7154058440 con 0x7f7154185070 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.217+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f7150005360 con 0x7f7154185070 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.217+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f715004fd20 con 0x7f7154185070 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.217+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 --> v1:10.20.193.82:6809/1303150362 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7124085f60 con 0x7f71240642c0 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.217+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f71500500d0 con 0x7f7154185070 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.217+0000 7f7141ffb640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T17:28:20.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.217+0000 7f7158840640 10 monclient: get_auth_request con 0x7f71240642c0 auth_method 0 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.217+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== osd.0 v1:10.20.193.57:6803/521925997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f8348086210 con 0x7f8348064570 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.218+0000 7f7159041640 10 monclient: get_auth_request con 0x7f712403f610 auth_method 0 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.218+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== osd.3 v1:10.20.193.82:6801/634754599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f1d380862b0 con 0x7f1d38064610 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.220+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== osd.4 v1:10.20.193.82:6805/687524042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7fdb6c086330 con 0x7fdb6c064690 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.221+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== osd.1 v1:10.20.193.57:6800/3025704390 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f1124085f30 con 0x7f1124064290 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.222+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== osd.5 v1:10.20.193.82:6809/1303150362 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f7124085f60 con 0x7f71240642c0 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 --> v1:10.20.193.57:6808/3129121469 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8620130f40 con 0x7f85f0064600 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f86157fa640 1 -- 10.20.193.57:0/2660252103 <== osd.2 v1:10.20.193.57:6808/3129121469 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 654699149) 0x7f8620130f40 con 0x7f85f0064600 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 >> v1:10.20.193.57:6808/3129121469 conn(0x7f85f0064600 legacy=0x7f85f0084a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 >> v1:10.20.193.82:6800/2441377515 conn(0x7f85f003f9d0 legacy=0x7f85f005fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 10 monclient: shutdown 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 >> v1:10.20.193.57:6790/0 conn(0x7f862008fa40 legacy=0x7f8620195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f86254ca640 1 -- 10.20.193.57:0/2660252103 reap_dead start 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 shutdown_connections 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 >> 10.20.193.57:0/2660252103 conn(0x7f862005daa0 msgr2=0x7f8620095940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 shutdown_connections 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.223+0000 7f8626f54640 1 -- 10.20.193.57:0/2660252103 wait complete. 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.225+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 --> v1:10.20.193.57:6803/521925997 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83781434e0 con 0x7f8348064570 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.226+0000 7f836d7fa640 1 -- 10.20.193.57:0/3166028475 <== osd.0 v1:10.20.193.57:6803/521925997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 654699149) 0x7f83781434e0 con 0x7f8348064570 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.226+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 >> v1:10.20.193.57:6803/521925997 conn(0x7f8348064570 legacy=0x7f83480849a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.226+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 >> v1:10.20.193.82:6800/2441377515 conn(0x7f834803f990 legacy=0x7f834805fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.226+0000 7f837f10c640 10 monclient: shutdown 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.226+0000 7f837f10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.226+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 >> v1:10.20.193.82:6789/0 conn(0x7f83780911b0 legacy=0x7f83781304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.226+0000 7f837d682640 1 -- 10.20.193.57:0/3166028475 reap_dead start 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.227+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 shutdown_connections 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.227+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 >> 10.20.193.57:0/3166028475 conn(0x7f8378054330 msgr2=0x7f837808f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.227+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 shutdown_connections 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.227+0000 7f837f10c640 1 -- 10.20.193.57:0/3166028475 wait complete. 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.227+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 --> v1:10.20.193.82:6801/634754599 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1d6808f510 con 0x7f1d38064610 2026-02-12T17:28:20.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d5d7fa640 1 -- 10.20.193.57:0/4268149896 <== osd.3 v1:10.20.193.82:6801/634754599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 654699149) 0x7f1d6808f510 con 0x7f1d38064610 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 --> v1:10.20.193.82:6805/687524042 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdb9c08a820 con 0x7fdb6c064690 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7fdb98ff9640 1 -- 10.20.193.57:0/1132913044 <== osd.4 v1:10.20.193.82:6805/687524042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7fdb9c08a820 con 0x7fdb6c064690 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 >> v1:10.20.193.82:6801/634754599 conn(0x7f1d38064610 legacy=0x7f1d38084a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 >> v1:10.20.193.82:6800/2441377515 conn(0x7f1d3803f9e0 legacy=0x7f1d3805fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6edbe640 10 monclient: shutdown 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6edbe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 >> v1:10.20.193.57:6789/0 conn(0x7f1d680906d0 legacy=0x7f1d6812feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6d334640 1 -- 10.20.193.57:0/4268149896 reap_dead start 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 shutdown_connections 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 >> 10.20.193.57:0/4268149896 conn(0x7f1d68054330 msgr2=0x7f1d6808cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 shutdown_connections 2026-02-12T17:28:20.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7f1d6edbe640 1 -- 10.20.193.57:0/4268149896 wait complete. 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.228+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 >> v1:10.20.193.82:6805/687524042 conn(0x7fdb6c064690 legacy=0x7fdb6c084ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 >> v1:10.20.193.82:6800/2441377515 conn(0x7fdb6c03fa30 legacy=0x7fdb6c05fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7fdba2852640 10 monclient: shutdown 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7fdba2852640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 >> v1:10.20.193.57:6790/0 conn(0x7fdb9c08c620 legacy=0x7fdb9c198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7fdba0dc8640 1 -- 10.20.193.57:0/1132913044 reap_dead start 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 shutdown_connections 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 >> 10.20.193.57:0/1132913044 conn(0x7fdb9c0916b0 msgr2=0x7fdb9c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 shutdown_connections 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7fdba2852640 1 -- 10.20.193.57:0/1132913044 wait complete. 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 --> v1:10.20.193.57:6800/3025704390 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f115408b700 con 0x7f1124064290 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.229+0000 7f11497fa640 1 -- 10.20.193.57:0/2820513315 <== osd.1 v1:10.20.193.57:6800/3025704390 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 654699149) 0x7f115408b700 con 0x7f1124064290 2026-02-12T17:28:20.299 INFO:teuthology.orchestra.run.trial057.stdout:47244640260 2026-02-12T17:28:20.299 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 >> v1:10.20.193.57:6800/3025704390 conn(0x7f1124064290 legacy=0x7f11240846c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 >> v1:10.20.193.82:6800/2441377515 conn(0x7f112403f660 legacy=0x7f112405fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115adc7640 10 monclient: shutdown 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115adc7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 >> v1:10.20.193.57:6789/0 conn(0x7f11540906d0 legacy=0x7f1154142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115933d640 1 -- 10.20.193.57:0/2820513315 reap_dead start 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 shutdown_connections 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 >> 10.20.193.57:0/2820513315 conn(0x7f1154054330 msgr2=0x7f115408f830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 shutdown_connections 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.230+0000 7f115adc7640 1 -- 10.20.193.57:0/2820513315 wait complete. 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.231+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 --> v1:10.20.193.82:6809/1303150362 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f715408fb50 con 0x7f71240642c0 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.231+0000 7f7141ffb640 1 -- 10.20.193.57:0/447368318 <== osd.5 v1:10.20.193.82:6809/1303150362 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f715408fb50 con 0x7f71240642c0 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 >> v1:10.20.193.82:6809/1303150362 conn(0x7f71240642c0 legacy=0x7f71240846f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 >> v1:10.20.193.82:6800/2441377515 conn(0x7f712403f610 legacy=0x7f712405fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f715b2cc640 10 monclient: shutdown 2026-02-12T17:28:20.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f715b2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 >> v1:10.20.193.57:6789/0 conn(0x7f7154185070 legacy=0x7f7154170b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f7159842640 1 -- 10.20.193.57:0/447368318 reap_dead start 2026-02-12T17:28:20.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 shutdown_connections 2026-02-12T17:28:20.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 >> 10.20.193.57:0/447368318 conn(0x7f7154054330 msgr2=0x7f7154059a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 shutdown_connections 2026-02-12T17:28:20.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.232+0000 7f715b2cc640 1 -- 10.20.193.57:0/447368318 wait complete. 2026-02-12T17:28:20.301 INFO:teuthology.orchestra.run.trial057.stdout:47244640260 2026-02-12T17:28:20.301 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T17:28:20.301 INFO:teuthology.orchestra.run.trial057.stdout:47244640259 2026-02-12T17:28:20.301 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-12T17:28:20.302 INFO:teuthology.orchestra.run.trial057.stdout:47244640260 2026-02-12T17:28:20.302 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T17:28:20.302 INFO:teuthology.orchestra.run.trial057.stdout:47244640260 2026-02-12T17:28:20.302 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T17:28:20.302 INFO:teuthology.orchestra.run.trial057.stdout:47244640259 2026-02-12T17:28:20.302 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.410+0000 7f1845785640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.410+0000 7f1845785640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.410+0000 7f1845785640 10 monclient: monmap: 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.411421+0000 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.411421+0000 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.408 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.410+0000 7fa35fb0c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.410+0000 7fa35fb0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.410+0000 7fa35fb0c640 10 monclient: monmap: 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.411465+0000 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.411465+0000 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.409 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.410+0000 7efc9c5a5640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.410+0000 7efc9c5a5640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.410+0000 7efc9c5a5640 10 monclient: monmap: 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.411435+0000 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.411435+0000 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.410 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 1 Processor -- start 2026-02-12T17:28:20.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 1 -- start start 2026-02-12T17:28:20.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 10 monclient: init 2026-02-12T17:28:20.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 1 Processor -- start 2026-02-12T17:28:20.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 1 -- start start 2026-02-12T17:28:20.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 10 monclient: init 2026-02-12T17:28:20.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 1 Processor -- start 2026-02-12T17:28:20.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 1 -- start start 2026-02-12T17:28:20.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 10 monclient: init 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 10 monclient(hunting): picked mon.noname-a con 0x7fa3580906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 10 monclient(hunting): picked mon.noname-c con 0x7fa3580911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 10 monclient(hunting): picked mon.noname-b con 0x7fa358185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa358090100 con 0x7fa3580906d0 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa358091a70 con 0x7fa3580911b0 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa358092360 con 0x7fa358185070 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35fb0c640 10 monclient(hunting): authenticate will time out at 580.230388s 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f7db0aaf640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f7db0aaf640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f7db0aaf640 10 monclient: monmap: 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.412223+0000 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.412223+0000 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.413 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:20.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 10 monclient(hunting): picked mon.noname-b con 0x7efc940906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 10 monclient(hunting): picked mon.noname-c con 0x7efc940911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35e082640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fa358185070 0x7fa3581a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42578/0 (socket says 10.20.193.57:42578) 2026-02-12T17:28:20.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7fa35e082640 1 -- 10.20.193.57:0/3411468896 learned_addr learned my addr 10.20.193.57:0/3411468896 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 10 monclient(hunting): picked mon.noname-a con 0x7efc94185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc94090100 con 0x7efc94185070 2026-02-12T17:28:20.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc94091a70 con 0x7efc940911b0 2026-02-12T17:28:20.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc94092360 con 0x7efc940906d0 2026-02-12T17:28:20.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9c5a5640 10 monclient(hunting): authenticate will time out at 580.230537s 2026-02-12T17:28:20.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:20.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 10 monclient(hunting): picked mon.noname-a con 0x7f184008f2a0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9ab1b640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7efc94185070 0x7efc941a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38630/0 (socket says 10.20.193.57:38630) 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7efc9ab1b640 1 -- 10.20.193.57:0/2206944966 learned_addr learned my addr 10.20.193.57:0/2206944966 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 10 monclient(hunting): picked mon.noname-b con 0x7f184008f670 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 10 monclient(hunting): picked mon.noname-c con 0x7f184008fa40 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f184008fe80 con 0x7f184008f2a0 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1840091a40 con 0x7f184008fa40 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1840091630 con 0x7f184008f670 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f1845785640 10 monclient(hunting): authenticate will time out at 580.230665s 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f183effd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f184008f2a0 0x7f1840090890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38640/0 (socket says 10.20.193.57:38640) 2026-02-12T17:28:20.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f183effd640 1 -- 10.20.193.57:0/2772237303 learned_addr learned my addr 10.20.193.57:0/2772237303 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f7db0aaf640 1 Processor -- start 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f7db0aaf640 1 -- start start 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.411+0000 7f7db0aaf640 10 monclient: init 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 10 monclient(hunting): picked mon.noname-c con 0x7f7dac0906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 10 monclient(hunting): picked mon.noname-b con 0x7f7dac0911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 10 monclient(hunting): picked mon.noname-a con 0x7f7dac185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dac090100 con 0x7f7dac185070 2026-02-12T17:28:20.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dac091a70 con 0x7f7dac0906d0 2026-02-12T17:28:20.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dac092360 con 0x7f7dac0911b0 2026-02-12T17:28:20.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7f7db0aaf640 10 monclient(hunting): authenticate will time out at 580.231311s 2026-02-12T17:28:20.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7fc512175640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7fc512175640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.412+0000 7fc512175640 10 monclient: monmap: 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.413512+0000 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.413512+0000 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 1 Processor -- start 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 1 -- start start 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 10 monclient: init 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 10 monclient(hunting): picked mon.noname-b con 0x7fc50c08acb0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 10 monclient(hunting): picked mon.noname-a con 0x7fc50c08e8c0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 10 monclient(hunting): picked mon.noname-c con 0x7fc50c08ed00 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c08c4d0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c08b5d0 con 0x7fc50c08ed00 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c08fa50 con 0x7fc50c08acb0 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc512175640 10 monclient(hunting): authenticate will time out at 580.232569s 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35e082640 1 -- 10.20.193.57:0/3411468896 >> v1:10.20.193.57:6790/0 conn(0x7fa358185070 legacy=0x7fa3581a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35d881640 1 -- 10.20.193.57:0/3411468896 >> v1:10.20.193.57:6789/0 conn(0x7fa3580906d0 legacy=0x7fa358090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7f7da9d74640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f7dac0911b0 0x7f7dac183950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42600/0 (socket says 10.20.193.57:42600) 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7f7da9d74640 1 -- 10.20.193.57:0/4180295938 learned_addr learned my addr 10.20.193.57:0/4180295938 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc50b7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fc50c08acb0 0x7fc50c08e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42610/0 (socket says 10.20.193.57:42610) 2026-02-12T17:28:20.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fc50b7fe640 1 -- 10.20.193.57:0/1748213162 learned_addr learned my addr 10.20.193.57:0/1748213162 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7efc9ab1b640 1 -- 10.20.193.57:0/2206944966 >> v1:10.20.193.57:6789/0 conn(0x7efc94185070 legacy=0x7efc941a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35d080640 1 -- 10.20.193.57:0/3411468896 >> v1:10.20.193.82:6789/0 conn(0x7fa3580911b0 legacy=0x7fa358183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573545920 0 0) 0x7fa358090100 con 0x7fa3580906d0 2026-02-12T17:28:20.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 10 monclient(hunting): my global_id is 4302 2026-02-12T17:28:20.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3400035e0 con 0x7fa3580906d0 2026-02-12T17:28:20.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7f183effd640 1 -- 10.20.193.57:0/2772237303 >> v1:10.20.193.57:6789/0 conn(0x7f184008f2a0 legacy=0x7f1840090890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889672442 0 0) 0x7efc94090100 con 0x7efc94185070 2026-02-12T17:28:20.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7efc99318640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7efc99318640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7efc99318640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7efc99318640 10 monclient(hunting): my global_id is 4305 2026-02-12T17:28:20.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7efc99b19640 1 -- 10.20.193.57:0/2206944966 >> v1:10.20.193.82:6789/0 conn(0x7efc940911b0 legacy=0x7efc94183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc7c0035e0 con 0x7efc94185070 2026-02-12T17:28:20.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1629143000 0 0) 0x7fa358091a70 con 0x7fa3580911b0 2026-02-12T17:28:20.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 10 monclient(hunting): my global_id is 4252 2026-02-12T17:28:20.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.413+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa358090100 con 0x7fa3580911b0 2026-02-12T17:28:20.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183f7fe640 1 -- 10.20.193.57:0/2772237303 >> v1:10.20.193.82:6789/0 conn(0x7f184008fa40 legacy=0x7f18401a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3131886263 0 0) 0x7fa3400035e0 con 0x7fa3580906d0 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 >> v1:10.20.193.57:6790/0 conn(0x7fa358185070 legacy=0x7fa3581a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 >> v1:10.20.193.82:6789/0 conn(0x7fa3580911b0 legacy=0x7fa358183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 1 monclient: found mon.noname-a 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35805cf80 con 0x7fa3580906d0 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa3480030d0 con 0x7fa3580906d0 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35fb0c640 5 monclient: authenticate success, global_id 4302 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35fb0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35c87f640 10 monclient: dump: 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.424 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7fa35fb0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 -- 10.20.193.57:0/2772237303 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2879291585 0 0) 0x7f1834002c20 con 0x7f184008f2a0 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient(hunting): my global_id is 4308 2026-02-12T17:28:20.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 -- 10.20.193.57:0/2772237303 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f182c0035e0 con 0x7f184008f2a0 2026-02-12T17:28:20.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257354430 0 0) 0x7efc94091a70 con 0x7efc940911b0 2026-02-12T17:28:20.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7efc99318640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7efc99318640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7efc99318640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7efc99318640 10 monclient(hunting): my global_id is 4255 2026-02-12T17:28:20.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc94090100 con 0x7efc940911b0 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183f7fe640 1 -- 10.20.193.57:0/2772237303 >> v1:10.20.193.82:6789/0 conn(0x7f184008fa40 legacy=0x7f18401a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183f7fe640 1 -- 10.20.193.57:0/2772237303 >> v1:10.20.193.82:6789/0 conn(0x7f184008fa40 legacy=0x7f18401a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183f7fe640 1 --1- 10.20.193.57:0/2772237303 >> v1:10.20.193.82:6789/0 conn(0x7f184008fa40 0x7f18401a5050 :-1 s=OPENED pgs=86 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183f7fe640 1 --1- 10.20.193.57:0/2772237303 >> v1:10.20.193.82:6789/0 conn(0x7f184008fa40 0x7f18401a5050 :-1 s=OPENED pgs=86 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.82:6789/0 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 -- 10.20.193.57:0/2772237303 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2215991350 0 0) 0x7f182c0035e0 con 0x7f184008f2a0 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 -- 10.20.193.57:0/2772237303 >> v1:10.20.193.57:6790/0 conn(0x7f184008f670 legacy=0x7f1840183920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 -- 10.20.193.57:0/2772237303 >> v1:10.20.193.82:6789/0 conn(0x7f184008fa40 legacy=0x7f18401a5050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 monclient: found mon.noname-a 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 -- 10.20.193.57:0/2772237303 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184008d5d0 con 0x7f184008f2a0 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 -- 10.20.193.57:0/2772237303 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1834003260 con 0x7f184008f2a0 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: dump: 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 5 monclient: authenticate success, global_id 4308 2026-02-12T17:28:20.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 -- 10.20.193.57:0/2772237303 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f18340034f0 con 0x7f184008f2a0 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 1 -- 10.20.193.57:0/2772237303 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1834004b10 con 0x7f184008f2a0 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 4 set_mon_vals no callback set 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f183dffb640 10 monclient: dump: 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 10 monclient: shutdown 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 1 -- 10.20.193.57:0/2772237303 >> v1:10.20.193.57:6789/0 conn(0x7f184008f2a0 legacy=0x7f1840090890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 1 -- 10.20.193.57:0/2772237303 shutdown_connections 2026-02-12T17:28:20.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 1 -- 10.20.193.57:0/2772237303 >> 10.20.193.57:0/2772237303 conn(0x7f184005daa0 msgr2=0x7f184005dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 1 -- 10.20.193.57:0/2772237303 shutdown_connections 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.414+0000 7f1845785640 1 -- 10.20.193.57:0/2772237303 wait complete. 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient: monmap: 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f24c1ccc640 10 monclient: get_monmap_and_config 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f24c1ccc640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f24c1ccc640 10 monclient: monmap: 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.430 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:20.416074+0000 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:20.416074+0000 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 1 Processor -- start 2026-02-12T17:28:20.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 1 -- start start 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient: init 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient(hunting): picked mon.noname-c con 0x7f184008f2a0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient(hunting): picked mon.noname-a con 0x7f184008f670 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient(hunting): picked mon.noname-b con 0x7f184008fa40 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1840059170 con 0x7f184008f670 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f184008cba0 con 0x7f184008fa40 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f184012ef90 con 0x7f184008f2a0 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f1845785640 10 monclient(hunting): authenticate will time out at 580.234618s 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f24c1ccc640 1 Processor -- start 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f183e7fc640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f184008f670 0x7f18401288d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38668/0 (socket says 10.20.193.57:38668) 2026-02-12T17:28:20.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f183e7fc640 1 -- 10.20.193.57:0/2197293053 learned_addr learned my addr 10.20.193.57:0/2197293053 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f24c1ccc640 1 -- start start 2026-02-12T17:28:20.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f24c1ccc640 10 monclient: init 2026-02-12T17:28:20.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7efc9a31a640 1 -- 10.20.193.57:0/2206944966 >> v1:10.20.193.57:6790/0 conn(0x7efc940906d0 legacy=0x7efc94090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f7da9d74640 1 -- 10.20.193.57:0/4180295938 >> v1:10.20.193.57:6790/0 conn(0x7f7dac0911b0 legacy=0x7f7dac183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f24c1ccc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f24c1ccc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.415+0000 7f24c1ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f24bc08f2a0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f24c1ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f24bc08f670 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f24c1ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f24bc08fa40 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f24c1ccc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24bc08fe80 con 0x7f24bc08f670 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f24c1ccc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24bc091a40 con 0x7f24bc08fa40 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f24c1ccc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24bc091630 con 0x7f24bc08f2a0 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f24c1ccc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f24c1ccc640 10 monclient(hunting): authenticate will time out at 580.235068s 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f24bb7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f24bc08f2a0 0x7f24bc090890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42622/0 (socket says 10.20.193.57:42622) 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f24bb7fe640 1 -- 10.20.193.57:0/1225587331 learned_addr learned my addr 10.20.193.57:0/1225587331 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463847528 0 0) 0x7f7dac092360 con 0x7f7dac0911b0 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): my global_id is 4268 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d980035e0 con 0x7f7dac0911b0 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50affd640 1 -- 10.20.193.57:0/1748213162 >> v1:10.20.193.57:6789/0 conn(0x7fc50c08e8c0 legacy=0x7fc50c181b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 986945205 0 0) 0x7efc7c0035e0 con 0x7efc94185070 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 >> v1:10.20.193.57:6790/0 conn(0x7efc940906d0 legacy=0x7efc94090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7daad76640 1 -- 10.20.193.57:0/4180295938 >> v1:10.20.193.57:6789/0 conn(0x7f7dac185070 legacy=0x7f7dac1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7daa575640 1 -- 10.20.193.57:0/4180295938 >> v1:10.20.193.82:6789/0 conn(0x7f7dac0906d0 legacy=0x7f7dac090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 >> v1:10.20.193.82:6789/0 conn(0x7efc940911b0 legacy=0x7efc94183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa348003320 con 0x7fa3580906d0 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35c87f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35c87f640 1 -- 10.20.193.57:0/3411468896 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa3480036d0 con 0x7fa3580906d0 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35fb0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35fb0c640 4 set_mon_vals no callback set 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35c87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35c87f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35c87f640 10 monclient: dump: 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 1 monclient: found mon.noname-a 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9405cf80 con 0x7efc94185070 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50bfff640 1 -- 10.20.193.57:0/1748213162 >> v1:10.20.193.82:6789/0 conn(0x7fc50c08ed00 legacy=0x7fc50c1a3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 5 monclient: authenticate success, global_id 4305 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc900041b0 con 0x7efc94185070 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: dump: 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.438 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 -- 10.20.193.57:0/1748213162 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693861939 0 0) 0x7fc50c08c4d0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient(hunting): my global_id is 4311 2026-02-12T17:28:20.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 -- 10.20.193.57:0/1748213162 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4f00035e0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657704550 0 0) 0x7f7dac090100 con 0x7f7dac185070 2026-02-12T17:28:20.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): my global_id is 4314 2026-02-12T17:28:20.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc90004440 con 0x7efc94185070 2026-02-12T17:28:20.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dac092360 con 0x7f7dac185070 2026-02-12T17:28:20.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 1 -- 10.20.193.57:0/2206944966 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc90005a40 con 0x7efc94185070 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 4 set_mon_vals no callback set 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc99318640 10 monclient: dump: 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.441 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 -- 10.20.193.57:0/1748213162 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3813656622 0 0) 0x7fc4f00035e0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 -- 10.20.193.57:0/1748213162 >> v1:10.20.193.57:6790/0 conn(0x7fc50c08acb0 legacy=0x7fc50c08e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 -- 10.20.193.57:0/1748213162 >> v1:10.20.193.82:6789/0 conn(0x7fc50c08ed00 legacy=0x7fc50c1a3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 monclient: found mon.noname-a 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 -- 10.20.193.57:0/1748213162 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c08b080 con 0x7fc50c08e8c0 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1978665034 0 0) 0x7f7dac091a70 con 0x7f7dac0906d0 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 -- 10.20.193.57:0/1748213162 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc4fc003120 con 0x7fc50c08e8c0 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient(hunting): my global_id is 4261 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dac090100 con 0x7f7dac0906d0 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: dump: 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc512175640 5 monclient: authenticate success, global_id 4311 2026-02-12T17:28:20.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc512175640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35fb0c640 10 monclient: shutdown 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35fb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35fb0c640 1 -- 10.20.193.57:0/3411468896 >> v1:10.20.193.57:6789/0 conn(0x7fa3580906d0 legacy=0x7fa358090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 764340756 0 0) 0x7f7dac092360 con 0x7f7dac185070 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 >> v1:10.20.193.57:6790/0 conn(0x7f7dac0911b0 legacy=0x7f7dac183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 >> v1:10.20.193.82:6789/0 conn(0x7f7dac0906d0 legacy=0x7f7dac090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 monclient: found mon.noname-a 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac05cf80 con 0x7f7dac185070 2026-02-12T17:28:20.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7d9c004200 con 0x7f7dac185070 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: dump: 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7db0aaf640 5 monclient: authenticate success, global_id 4314 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7db0aaf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35fb0c640 1 -- 10.20.193.57:0/3411468896 shutdown_connections 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35fb0c640 1 -- 10.20.193.57:0/3411468896 >> 10.20.193.57:0/3411468896 conn(0x7fa358054330 msgr2=0x7fa358054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35fb0c640 1 -- 10.20.193.57:0/3411468896 shutdown_connections 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 -- 10.20.193.57:0/1748213162 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4fc003420 con 0x7fc50c08e8c0 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 1 -- 10.20.193.57:0/1748213162 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc4fc003880 con 0x7fc50c08e8c0 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc50a7fc640 10 monclient: dump: 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.446 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc512175640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fc512175640 4 set_mon_vals no callback set 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7fa35fb0c640 1 -- 10.20.193.57:0/3411468896 wait complete. 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d9c004490 con 0x7f7dac185070 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 1 -- 10.20.193.57:0/4180295938 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7d9c004630 con 0x7f7dac185070 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7da9573640 10 monclient: dump: 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.447 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7db0aaf640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7f7db0aaf640 4 set_mon_vals no callback set 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 10 monclient: shutdown 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 1 -- 10.20.193.57:0/2206944966 >> v1:10.20.193.57:6789/0 conn(0x7efc94185070 legacy=0x7efc941a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 1 -- 10.20.193.57:0/2206944966 shutdown_connections 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 1 -- 10.20.193.57:0/2206944966 >> 10.20.193.57:0/2206944966 conn(0x7efc94054330 msgr2=0x7efc94054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 1 -- 10.20.193.57:0/2206944966 shutdown_connections 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.416+0000 7efc9c5a5640 1 -- 10.20.193.57:0/2206944966 wait complete. 2026-02-12T17:28:20.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 10 monclient: shutdown 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 1 -- 10.20.193.57:0/4180295938 >> v1:10.20.193.57:6789/0 conn(0x7f7dac185070 legacy=0x7f7dac1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 10 monclient: shutdown 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 1 -- 10.20.193.57:0/1748213162 >> v1:10.20.193.57:6789/0 conn(0x7fc50c08e8c0 legacy=0x7fc50c181b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient: monmap: 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.449 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 1 -- 10.20.193.57:0/4180295938 shutdown_connections 2026-02-12T17:28:20.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 1 -- 10.20.193.57:0/4180295938 >> 10.20.193.57:0/4180295938 conn(0x7f7dac054330 msgr2=0x7f7dac054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 1 -- 10.20.193.57:0/1748213162 shutdown_connections 2026-02-12T17:28:20.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 1 -- 10.20.193.57:0/1748213162 >> 10.20.193.57:0/1748213162 conn(0x7fc50c056980 msgr2=0x7fc50c0937b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 1 -- 10.20.193.57:0/4180295938 shutdown_connections 2026-02-12T17:28:20.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 1 -- 10.20.193.57:0/1748213162 shutdown_connections 2026-02-12T17:28:20.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 1 -- 10.20.193.57:0/1748213162 wait complete. 2026-02-12T17:28:20.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 1 -- 10.20.193.57:0/4180295938 wait complete. 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 1 Processor -- start 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 1 -- start start 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient: init 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7efc9c5a5640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7efc9c5a5640 10 monclient: monmap: 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.451 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 10 monclient: monmap: 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 10 monclient: monmap: 2026-02-12T17:28:20.452 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient(hunting): picked mon.noname-b con 0x7fa3580906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient(hunting): picked mon.noname-c con 0x7fa3580911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient(hunting): picked mon.noname-a con 0x7fa358185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35812f800 con 0x7fa358185070 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35812d150 con 0x7fa3580906d0 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35812d4a0 con 0x7fa3580911b0 2026-02-12T17:28:20.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7efc9c5a5640 1 Processor -- start 2026-02-12T17:28:20.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fa35fb0c640 10 monclient(hunting): authenticate will time out at 580.236588s 2026-02-12T17:28:20.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 1 Processor -- start 2026-02-12T17:28:20.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 1 Processor -- start 2026-02-12T17:28:20.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7efc9c5a5640 1 -- start start 2026-02-12T17:28:20.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7efc9c5a5640 10 monclient: init 2026-02-12T17:28:20.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 1 -- start start 2026-02-12T17:28:20.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f7db0aaf640 10 monclient: init 2026-02-12T17:28:20.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 1 -- start start 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f183e7fc640 1 -- 10.20.193.57:0/2197293053 >> v1:10.20.193.57:6789/0 conn(0x7f184008f670 legacy=0x7f18401288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7fc512175640 10 monclient: init 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4222642040 0 0) 0x7f1840059170 con 0x7f184008f670 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f181f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f181f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f181f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f181f7fe640 10 monclient(hunting): my global_id is 4317 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f180c0035e0 con 0x7f184008f670 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.417+0000 7efc9c5a5640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9c5a5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:20.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fa35e082640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fa358185070 0x7fa358170a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38684/0 (socket says 10.20.193.57:38684) 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fa35e082640 1 -- 10.20.193.57:0/18802858 learned_addr learned my addr 10.20.193.57:0/18802858 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9c5a5640 10 monclient(hunting): picked mon.noname-a con 0x7efc940906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9c5a5640 10 monclient(hunting): picked mon.noname-c con 0x7efc940911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9c5a5640 10 monclient(hunting): picked mon.noname-b con 0x7efc94185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9c5a5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc94062bb0 con 0x7efc940906d0 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9c5a5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc941432e0 con 0x7efc94185070 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9c5a5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc94133480 con 0x7efc940911b0 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9c5a5640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9c5a5640 10 monclient(hunting): authenticate will time out at 580.237065s 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 10 monclient(hunting): picked mon.noname-c con 0x7f7dac0906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f183effd640 1 -- 10.20.193.57:0/2197293053 >> v1:10.20.193.57:6790/0 conn(0x7f184008f2a0 legacy=0x7f1840118480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 10 monclient(hunting): picked mon.noname-a con 0x7f7dac0911b0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 10 monclient(hunting): picked mon.noname-b con 0x7f7dac185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dac143520 con 0x7f7dac0911b0 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dac133580 con 0x7f7dac185070 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dac133860 con 0x7f7dac0906d0 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7db0aaf640 10 monclient(hunting): authenticate will time out at 580.237207s 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f24bb7fe640 1 -- 10.20.193.57:0/1225587331 >> v1:10.20.193.57:6790/0 conn(0x7f24bc08f2a0 legacy=0x7f24bc090890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382576105 0 0) 0x7f184012ef90 con 0x7f184008f2a0 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient(hunting): my global_id is 4274 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1840059170 con 0x7f184008f2a0 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f183f7fe640 1 -- 10.20.193.57:0/2197293053 >> v1:10.20.193.82:6789/0 conn(0x7f184008fa40 legacy=0x7f18401a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3521728916 0 0) 0x7f180c0035e0 con 0x7f184008f670 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 10 monclient(hunting): picked mon.noname-b con 0x7fc50c08acb0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9ab1b640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7efc94185070 0x7efc941754b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:43806/0 (socket says 10.20.193.57:43806) 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7efc9ab1b640 1 -- 10.20.193.57:0/125009355 learned_addr learned my addr 10.20.193.57:0/125009355 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 10 monclient(hunting): picked mon.noname-c con 0x7fc50c08e8c0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f184012ef90 con 0x7f184008f670 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f18280043b0 con 0x7f184008f670 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient(hunting): dump: 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.458 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 10 monclient(hunting): picked mon.noname-a con 0x7fc50c08ed00 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c05e030 con 0x7fc50c08ed00 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c13cf50 con 0x7fc50c08acb0 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 589282422 0 0) 0x7f184012ef90 con 0x7f184008f670 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 >> v1:10.20.193.57:6790/0 conn(0x7f184008f2a0 legacy=0x7f1840118480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 >> v1:10.20.193.82:6789/0 conn(0x7f184008fa40 legacy=0x7f18401a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 monclient: found mon.a 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1840128fe0 con 0x7f184008f670 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f181f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 5 monclient: authenticate success, global_id 4317 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 10 monclient: _renew_subs 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f184012fb90 con 0x7f184008f670 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7daad76640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f7dac185070 0x7f7dac174c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:43812/0 (socket says 10.20.193.57:43812) 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f7daad76640 1 -- 10.20.193.57:0/3798896021 learned_addr learned my addr 10.20.193.57:0/3798896021 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc50bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fc50c08ed00 0x7fc50c193830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38702/0 (socket says 10.20.193.57:38702) 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc50bfff640 1 -- 10.20.193.57:0/1585186357 learned_addr learned my addr 10.20.193.57:0/1585186357 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc50c13ea10 con 0x7fc50c08e8c0 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7fc512175640 10 monclient(hunting): authenticate will time out at 580.237457s 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 10 monclient: _renew_subs 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1840130a50 con 0x7f184008f670 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.418+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18400008d0 con 0x7f184008f670 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa35e082640 1 -- 10.20.193.57:0/18802858 >> v1:10.20.193.57:6789/0 conn(0x7fa358185070 legacy=0x7fa358170a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f24baffd640 1 -- 10.20.193.57:0/1225587331 >> v1:10.20.193.57:6789/0 conn(0x7f24bc08f670 legacy=0x7f24bc183920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa35d881640 1 -- 10.20.193.57:0/18802858 >> v1:10.20.193.82:6789/0 conn(0x7fa3580906d0 legacy=0x7fa35812c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f24bbfff640 1 -- 10.20.193.57:0/1225587331 >> v1:10.20.193.82:6789/0 conn(0x7f24bc08fa40 legacy=0x7f24bc1a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc50b7fe640 1 -- 10.20.193.57:0/1585186357 >> v1:10.20.193.82:6789/0 conn(0x7fc50c08acb0 legacy=0x7fc50c150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc50b7fe640 1 -- 10.20.193.57:0/1585186357 >> v1:10.20.193.82:6789/0 conn(0x7fc50c08acb0 legacy=0x7fc50c150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc50b7fe640 1 --1- 10.20.193.57:0/1585186357 >> v1:10.20.193.82:6789/0 conn(0x7fc50c08acb0 0x7fc50c150e40 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=1 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc50b7fe640 1 --1- 10.20.193.57:0/1585186357 >> v1:10.20.193.82:6789/0 conn(0x7fc50c08acb0 0x7fc50c150e40 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=1 cs=0 l=1).fault on lossy channel, failing 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc4e7fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.82:6789/0 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc50bfff640 1 -- 10.20.193.57:0/1585186357 >> v1:10.20.193.57:6789/0 conn(0x7fc50c08ed00 legacy=0x7fc50c193830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7efc99b19640 1 -- 10.20.193.57:0/125009355 >> v1:10.20.193.57:6790/0 conn(0x7efc940911b0 legacy=0x7efc94173d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc50affd640 1 -- 10.20.193.57:0/1585186357 >> v1:10.20.193.57:6790/0 conn(0x7fc50c08e8c0 legacy=0x7fc50c192110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f7daad76640 1 -- 10.20.193.57:0/3798896021 >> v1:10.20.193.82:6789/0 conn(0x7f7dac185070 legacy=0x7f7dac174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f24ba7fc640 1 -- 10.20.193.57:0/1225587331 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005850177 0 0) 0x7f24bc091630 con 0x7f24bc08f2a0 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f24ba7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f24ba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f24ba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f24ba7fc640 10 monclient(hunting): my global_id is 4277 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f24ba7fc640 1 -- 10.20.193.57:0/1225587331 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24a00035e0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029284780 0 0) 0x7fa35812d150 con 0x7fa3580906d0 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa3467fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa3467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa3467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa3467fc640 10 monclient(hunting): my global_id is 4270 2026-02-12T17:28:20.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3280035e0 con 0x7fa3580906d0 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193634212 0 0) 0x7fc50c08b5d0 con 0x7fc50c08ed00 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc4e7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc4e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc4e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc4e7fff640 10 monclient(hunting): my global_id is 4323 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1828002950 con 0x7f184008f670 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f181f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1828002c70 con 0x7f184008f670 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f181f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4dc0035e0 con 0x7fc50c08ed00 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f181f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f181f7fe640 10 monclient: dump: 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7f183d7fa640 4 set_mon_vals no callback set 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa35d080640 1 -- 10.20.193.57:0/18802858 >> v1:10.20.193.57:6790/0 conn(0x7fa3580911b0 legacy=0x7fa35812ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.420+0000 7fa35d881640 1 --1- 10.20.193.57:0/18802858 >> v1:10.20.193.82:6789/0 conn(0x7fa3580906d0 0x7fa35812c330 :-1 s=OPENED pgs=90 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fa3280035e0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 914600440 0 0) 0x7fa3280035e0 con 0x7fa3580906d0 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa35812d150 con 0x7fa3580906d0 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890095093 0 0) 0x7f7dac133580 con 0x7f7dac185070 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient(hunting): my global_id is 4273 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d780035e0 con 0x7f7dac185070 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2695702841 0 0) 0x7fc50c13ea10 con 0x7fc50c08e8c0 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient(hunting): my global_id is 4280 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc50c08b5d0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa3480036d0 con 0x7fa3580906d0 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fa3467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fa3467fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fa3467fc640 10 monclient(hunting): dump: 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fa3467fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 1 -- 10.20.193.57:0/1225587331 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 672585438 0 0) 0x7f24a00035e0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 1 -- 10.20.193.57:0/1225587331 >> v1:10.20.193.82:6789/0 conn(0x7f24bc08fa40 legacy=0x7f24bc1a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 1 -- 10.20.193.57:0/1225587331 >> v1:10.20.193.57:6789/0 conn(0x7f24bc08f670 legacy=0x7f24bc183920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 1 monclient: found mon.noname-b 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 1 -- 10.20.193.57:0/1225587331 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc08d5d0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 1 -- 10.20.193.57:0/1225587331 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f24a80030d0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: dump: 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24c1ccc640 5 monclient: authenticate success, global_id 4277 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24c1ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256599523 0 0) 0x7efc94133480 con 0x7efc940911b0 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient(hunting): my global_id is 4286 2026-02-12T17:28:20.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc640035e0 con 0x7efc940911b0 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1612751340 0 0) 0x7f7d780035e0 con 0x7f7dac185070 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7dac133580 con 0x7f7dac185070 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7d9c003c60 con 0x7f7dac185070 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3999507564 0 0) 0x7fc50c08b5d0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc50c13ea10 con 0x7fc50c08e8c0 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc4fc0032c0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 1 -- 10.20.193.57:0/1225587331 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f24a8003360 con 0x7f24bc08f2a0 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 1 -- 10.20.193.57:0/1225587331 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f24a8004960 con 0x7f24bc08f2a0 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24c1ccc640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24c1ccc640 4 set_mon_vals no callback set 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient(hunting): dump: 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24ba7fc640 10 monclient: dump: 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.468 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2686383926 0 0) 0x7efc640035e0 con 0x7efc940911b0 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc94133480 con 0x7efc940911b0 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc880033b0 con 0x7efc940911b0 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient(hunting): dump: 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1759918797 0 0) 0x7f7dac133580 con 0x7f7dac185070 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 >> v1:10.20.193.57:6790/0 conn(0x7f7dac0906d0 legacy=0x7f7dac12fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 >> v1:10.20.193.57:6789/0 conn(0x7f7dac0911b0 legacy=0x7f7dac130580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 monclient: found mon.b 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac130c90 con 0x7f7dac185070 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7db0aaf640 5 monclient: authenticate success, global_id 4273 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7db0aaf640 10 monclient: _renew_subs 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7db0aaf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac062bb0 con 0x7f7dac185070 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4152557819 0 0) 0x7fc50c13ea10 con 0x7fc50c08e8c0 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7db0aaf640 10 monclient: _renew_subs 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7db0aaf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7dac1317e0 con 0x7f7dac185070 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 >> v1:10.20.193.82:6789/0 conn(0x7fc50c08acb0 legacy=0x7fc50c150e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 >> v1:10.20.193.57:6789/0 conn(0x7fc50c08ed00 legacy=0x7fc50c193830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 monclient: found mon.c 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc50c08a9a0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc512175640 5 monclient: authenticate success, global_id 4280 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc512175640 10 monclient: _renew_subs 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc512175640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3200511737 0 0) 0x7efc94133480 con 0x7efc940911b0 2026-02-12T17:28:20.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 >> v1:10.20.193.82:6789/0 conn(0x7efc94185070 legacy=0x7efc941754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc50c089fc0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1828002e90 con 0x7f184008f670 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 >> v1:10.20.193.57:6789/0 conn(0x7efc940906d0 legacy=0x7efc94152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 monclient: found mon.c 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc941319c0 con 0x7efc940911b0 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc9c5a5640 5 monclient: authenticate success, global_id 4286 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc9c5a5640 10 monclient: _renew_subs 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc9c5a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efc94133d80 con 0x7efc940911b0 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc512175640 10 monclient: _renew_subs 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc512175640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc50c13dab0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24c1ccc640 10 monclient: shutdown 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24c1ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f24c1ccc640 1 -- 10.20.193.57:0/1225587331 >> v1:10.20.193.57:6790/0 conn(0x7f24bc08f2a0 legacy=0x7f24bc090890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc9c5a5640 10 monclient: _renew_subs 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc9c5a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efc94134880 con 0x7efc940911b0 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc88003980 con 0x7efc940911b0 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4fc003870 con 0x7fc50c08e8c0 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc4fc004010 con 0x7fc50c08e8c0 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc4e7fff640 10 monclient: dump: 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7fc509ffb640 4 set_mon_vals no callback set 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f182804eb00 con 0x7f184008f670 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc88003ca0 con 0x7efc940911b0 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc98b17640 4 set_mon_vals no callback set 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7efc7affd640 10 monclient: dump: 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f183effd640 10 monclient: get_auth_request con 0x7f180c03f850 auth_method 0 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d9c004e80 con 0x7f7dac185070 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7da8d72640 4 set_mon_vals no callback set 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7d9c005260 con 0x7f7dac185070 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.421+0000 7f7d92ffd640 10 monclient: dump: 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.473 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f7db0aaf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f7db0aaf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f7db0aaf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dac133ba0 con 0x7f7dac185070 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f24c1ccc640 1 -- 10.20.193.57:0/1225587331 shutdown_connections 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f24c1ccc640 1 -- 10.20.193.57:0/1225587331 >> 10.20.193.57:0/1225587331 conn(0x7f24bc05daa0 msgr2=0x7f24bc05dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f24c1ccc640 1 -- 10.20.193.57:0/1225587331 shutdown_connections 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f24c1ccc640 1 -- 10.20.193.57:0/1225587331 wait complete. 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fc512175640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fc512175640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fc512175640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912305028 0 0) 0x7fa35812f800 con 0x7fa358185070 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fa3467fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fa3467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fa3467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fa3467fc640 10 monclient(hunting): my global_id is 4320 2026-02-12T17:28:20.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50c0008d0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fc4fc0042a0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3280035e0 con 0x7fa358185070 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f7d9c005480 con 0x7f7dac185070 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7efc9c5a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7efc9c5a5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f24c1ccc640 10 monclient: build_initial_monmap 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f24c1ccc640 10 monclient: monmap: 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7efc9c5a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc94143500 con 0x7efc940911b0 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7fc4fc04eb90 con 0x7fc50c08e8c0 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f24c1ccc640 1 Processor -- start 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f7d9c04fe90 con 0x7f7dac185070 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f24c1ccc640 1 -- start start 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f24c1ccc640 10 monclient: init 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7fc50b7fe640 10 monclient: get_auth_request con 0x7fc4dc03f7e0 auth_method 0 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7efc88003f00 con 0x7efc940911b0 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.422+0000 7f7daa575640 10 monclient: get_auth_request con 0x7f7d7803f5c0 auth_method 0 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7efc8804eb90 con 0x7efc940911b0 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188206455 0 0) 0x7fa35812d4a0 con 0x7fa3580911b0 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient(hunting): my global_id is 4283 2026-02-12T17:28:20.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35812f800 con 0x7fa3580911b0 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f24bc08f2a0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f24bc08f670 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f24bc08fa40 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24bc08b3d0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24bc08cba0 con 0x7f24bc08f670 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24bc131ea0 con 0x7f24bc08fa40 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24c1ccc640 10 monclient(hunting): authenticate will time out at 580.242245s 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2082054719 0 0) 0x7fa3280035e0 con 0x7fa358185070 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa35812d4a0 con 0x7fa358185070 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa3540043e0 con 0x7fa358185070 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient(hunting): dump: 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24bbfff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f24bc08fa40 0x7f24bc195450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42672/0 (socket says 10.20.193.57:42672) 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24bb7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f24bc08f2a0 0x7f24bc142800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38708/0 (socket says 10.20.193.57:38708) 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f24bbfff640 1 -- 10.20.193.57:0/2331055918 learned_addr learned my addr 10.20.193.57:0/2331055918 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f1828017390 con 0x7f184008f670 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f181f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7f181f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1521340507 0 0) 0x7fa35812d4a0 con 0x7fa358185070 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 >> v1:10.20.193.57:6790/0 conn(0x7fa3580911b0 legacy=0x7fa35812ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 >> v1:10.20.193.82:6789/0 conn(0x7fa3580906d0 legacy=0x7fa35812c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 monclient: found mon.a 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35808b750 con 0x7fa358185070 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2533834603 0 0) 0x7fa35812d150 con 0x7fa3580906d0 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa35fb0c640 5 monclient: authenticate success, global_id 4320 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa35fb0c640 10 monclient: _renew_subs 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa35fb0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa35812e990 con 0x7fa358185070 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa35fb0c640 10 monclient: _renew_subs 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa35fb0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa35812f520 con 0x7fa358185070 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa354005c30 con 0x7fa358185070 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa354005f50 con 0x7fa358185070 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa3467fc640 10 monclient: dump: 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.423+0000 7fa347fff640 4 set_mon_vals no callback set 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.424+0000 7fa35fb0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.424+0000 7fa35fb0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.424+0000 7fa35fb0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.424+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3580008d0 con 0x7fa358185070 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.424+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fa354012bc0 con 0x7fa358185070 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.424+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7fa35404f960 con 0x7fa358185070 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7efc9a31a640 10 monclient: get_auth_request con 0x7efc6403f610 auth_method 0 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7fa35d881640 10 monclient: get_auth_request con 0x7fa32803fc70 auth_method 0 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fc4fc016e70 con 0x7fc50c08e8c0 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7fc4e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7fc4e7fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f7d9c0180b0 con 0x7f7dac185070 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7f7d92ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7f7d92ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7f24bb7fe640 1 -- 10.20.193.57:0/2331055918 >> v1:10.20.193.57:6789/0 conn(0x7f24bc08f2a0 legacy=0x7f24bc142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7f24bbfff640 1 -- 10.20.193.57:0/2331055918 >> v1:10.20.193.57:6790/0 conn(0x7f24bc08fa40 legacy=0x7f24bc195450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.425+0000 7f24baffd640 1 -- 10.20.193.57:0/2331055918 >> v1:10.20.193.82:6789/0 conn(0x7f24bc08f670 legacy=0x7f24bc193d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2118568957 0 0) 0x7f24bc08cba0 con 0x7f24bc08f670 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 10 monclient(hunting): my global_id is 4276 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f248c0035e0 con 0x7f24bc08f670 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959272965 0 0) 0x7f24bc08d5d0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 10 monclient(hunting): my global_id is 4326 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.426+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24bc08cba0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 225710111 0 0) 0x7f248c0035e0 con 0x7f24bc08f670 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24bc08d5d0 con 0x7f24bc08f670 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2093400809 0 0) 0x7f24bc08cba0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f248c0035e0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f24ac003340 con 0x7f24bc08f670 2026-02-12T17:28:20.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient(hunting): dump: 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f24a80034d0 con 0x7f24bc08f2a0 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient(hunting): dump: 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7efc88017420 con 0x7efc940911b0 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7efc7affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7efc7affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3871440453 0 0) 0x7f24bc08d5d0 con 0x7f24bc08f670 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 >> v1:10.20.193.57:6790/0 conn(0x7f24bc08fa40 legacy=0x7f24bc195450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 >> v1:10.20.193.57:6789/0 conn(0x7f24bc08f2a0 legacy=0x7f24bc142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 monclient: found mon.b 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc133f20 con 0x7f24bc08f670 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 5 monclient: authenticate success, global_id 4276 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 10 monclient: _renew_subs 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc134260 con 0x7f24bc08f670 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 10 monclient: _renew_subs 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa354014520 con 0x7fa358185070 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7fa3467fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7fa3467fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f24bc152c00 con 0x7f24bc08f670 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f24ac003980 con 0x7f24bc08f670 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f24ac003cd0 con 0x7f24bc08f670 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24b9ffb640 4 set_mon_vals no callback set 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f2497fff640 10 monclient: dump: 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.427+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24bc152f00 con 0x7f24bc08f670 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.428+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f24ac003e70 con 0x7f24bc08f670 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.428+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f24ac04e900 con 0x7f24bc08f670 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.428+0000 7f24bb7fe640 10 monclient: get_auth_request con 0x7f248c03fb70 auth_method 0 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.430+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f24ac004320 con 0x7f24bc08f670 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.430+0000 7f2497fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:20.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.430+0000 7f2497fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:20.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.535+0000 7f1845785640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T17:28:20.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.535+0000 7f1845785640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T17:28:20.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.535+0000 7f1845785640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.535+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1840093890 con 0x7f184008f670 2026-02-12T17:28:20.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.535+0000 7f181f7fe640 1 -- 10.20.193.57:0/2197293053 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 847495621) 0x7f182804ba60 con 0x7f184008f670 2026-02-12T17:28:20.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.535+0000 7f181f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T17:28:20.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.535+0000 7f181f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:20.532 INFO:teuthology.orchestra.run.trial057.stdout:47244640259 2026-02-12T17:28:20.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.535+0000 7fc512175640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T17:28:20.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7fc512175640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T17:28:20.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7fc512175640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc50c13ebc0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7fc4e7fff640 1 -- 10.20.193.57:0/1585186357 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 555833778) 0x7fc50c13ebc0 con 0x7fc50c08e8c0 2026-02-12T17:28:20.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7fc4e7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T17:28:20.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7fc4e7fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:20.533 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:20.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7f7db0aaf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T17:28:20.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7f7db0aaf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T17:28:20.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7f7db0aaf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7dac055340 con 0x7f7dac185070 2026-02-12T17:28:20.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7f7d92ffd640 1 -- 10.20.193.57:0/3798896021 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 555833778) 0x7f7d9c017ed0 con 0x7f7dac185070 2026-02-12T17:28:20.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7f7d92ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T17:28:20.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.536+0000 7f7d92ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:20.535 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:20.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.537+0000 7fa35fb0c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T17:28:20.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.537+0000 7fa35fb0c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T17:28:20.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.537+0000 7fa35fb0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:20.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.537+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa358092c50 con 0x7fa358185070 2026-02-12T17:28:20.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.537+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 >> v1:10.20.193.82:6800/2441377515 conn(0x7f180c03f850 legacy=0x7f180c05fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.537+0000 7f1845785640 10 monclient: shutdown 2026-02-12T17:28:20.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.537+0000 7f1845785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.537+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 >> v1:10.20.193.57:6789/0 conn(0x7f184008f670 legacy=0x7f18401288d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.537+0000 7fa3467fc640 1 -- 10.20.193.57:0/18802858 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 555833778) 0x7fa354017a00 con 0x7fa358185070 2026-02-12T17:28:20.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.538+0000 7fa3467fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T17:28:20.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.538+0000 7fa3467fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:20.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.538+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 shutdown_connections 2026-02-12T17:28:20.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.538+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 >> 10.20.193.57:0/2197293053 conn(0x7f184005daa0 msgr2=0x7f1840096130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.536 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.538+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 shutdown_connections 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.538+0000 7f1845785640 1 -- 10.20.193.57:0/2197293053 wait complete. 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 >> v1:10.20.193.82:6800/2441377515 conn(0x7fc4dc03f7e0 legacy=0x7fc4dc05fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7fc512175640 10 monclient: shutdown 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7fc512175640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 >> v1:10.20.193.57:6790/0 conn(0x7fc50c08e8c0 legacy=0x7fc50c192110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 shutdown_connections 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 >> 10.20.193.57:0/1585186357 conn(0x7fc50c056980 msgr2=0x7fc50c08d600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 shutdown_connections 2026-02-12T17:28:20.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7fc512175640 1 -- 10.20.193.57:0/1585186357 wait complete. 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 >> v1:10.20.193.82:6800/2441377515 conn(0x7f7d7803f5c0 legacy=0x7f7d7805fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7f7db0aaf640 10 monclient: shutdown 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7f7db0aaf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 >> v1:10.20.193.82:6789/0 conn(0x7f7dac185070 legacy=0x7f7dac174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 shutdown_connections 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 >> 10.20.193.57:0/3798896021 conn(0x7f7dac054330 msgr2=0x7f7dac08f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 shutdown_connections 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7f7db0aaf640 1 -- 10.20.193.57:0/3798896021 wait complete. 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7efc9c5a5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7efc9c5a5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7efc9c5a5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7efc94055340 con 0x7efc940911b0 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.539+0000 7efc7affd640 1 -- 10.20.193.57:0/125009355 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 555833778) 0x7efc880153b0 con 0x7efc940911b0 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7efc7affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T17:28:20.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7efc7affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:20.539 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:20.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 >> v1:10.20.193.82:6800/2441377515 conn(0x7fa32803fc70 legacy=0x7fa328060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7fa35fb0c640 10 monclient: shutdown 2026-02-12T17:28:20.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7fa35fb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 >> v1:10.20.193.57:6789/0 conn(0x7fa358185070 legacy=0x7fa358170a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 shutdown_connections 2026-02-12T17:28:20.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 >> 10.20.193.57:0/18802858 conn(0x7fa358054330 msgr2=0x7fa35808a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 shutdown_connections 2026-02-12T17:28:20.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.540+0000 7fa35fb0c640 1 -- 10.20.193.57:0/18802858 wait complete. 2026-02-12T17:28:20.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.542+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 >> v1:10.20.193.82:6800/2441377515 conn(0x7efc6403f610 legacy=0x7efc6405fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.542+0000 7efc9c5a5640 10 monclient: shutdown 2026-02-12T17:28:20.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.542+0000 7efc9c5a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.542+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 >> v1:10.20.193.57:6790/0 conn(0x7efc940911b0 legacy=0x7efc94173d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.542+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 shutdown_connections 2026-02-12T17:28:20.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.542+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 >> 10.20.193.57:0/125009355 conn(0x7efc94054330 msgr2=0x7efc9408ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.542+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 shutdown_connections 2026-02-12T17:28:20.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.542+0000 7efc9c5a5640 1 -- 10.20.193.57:0/125009355 wait complete. 2026-02-12T17:28:20.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.545+0000 7f24c1ccc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T17:28:20.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.545+0000 7f24c1ccc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T17:28:20.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.545+0000 7f24c1ccc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:20.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.545+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f24bc08fe80 con 0x7f24bc08f670 2026-02-12T17:28:20.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.545+0000 7f2497fff640 1 -- 10.20.193.57:0/2331055918 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 555833778) 0x7f24bc08fe80 con 0x7f24bc08f670 2026-02-12T17:28:20.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.545+0000 7f2497fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T17:28:20.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.545+0000 7f2497fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:20.544 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:20.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2026-02-12T17:28:20.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640258 for osd.1 2026-02-12T17:28:20.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-12T17:28:20.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.548+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 >> v1:10.20.193.82:6800/2441377515 conn(0x7f248c03fb70 legacy=0x7f248c060020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.548+0000 7f24c1ccc640 10 monclient: shutdown 2026-02-12T17:28:20.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.548+0000 7f24c1ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:20.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.548+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 >> v1:10.20.193.82:6789/0 conn(0x7f24bc08f670 legacy=0x7f24bc193d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:20.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.548+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 shutdown_connections 2026-02-12T17:28:20.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.548+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 >> 10.20.193.57:0/2331055918 conn(0x7f24bc05daa0 msgr2=0x7f24bc096130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:20.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.548+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 shutdown_connections 2026-02-12T17:28:20.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:20.548+0000 7f24c1ccc640 1 -- 10.20.193.57:0/2331055918 wait complete. 2026-02-12T17:28:20.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640258 for osd.2 2026-02-12T17:28:20.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640258 for osd.0 2026-02-12T17:28:20.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2026-02-12T17:28:21.545 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T17:28:21.546 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T17:28:21.546 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-12T17:28:21.548 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T17:28:21.550 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T17:28:21.555 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-12T17:28:21.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.617+0000 7fbb3497e640 10 monclient: get_monmap_and_config 2026-02-12T17:28:21.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.617+0000 7fbb3497e640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.617+0000 7fbb3497e640 10 monclient: monmap: 2026-02-12T17:28:21.615 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.615 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.615 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:21.618111+0000 2026-02-12T17:28:21.615 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:21.618111+0000 2026-02-12T17:28:21.615 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.616 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.616 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.616 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:21.616 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:21.616 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.617+0000 7fbb3497e640 1 Processor -- start 2026-02-12T17:28:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.617+0000 7fbb3497e640 1 -- start start 2026-02-12T17:28:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.617+0000 7fbb3497e640 10 monclient: init 2026-02-12T17:28:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 10 monclient(hunting): picked mon.noname-b con 0x7fbb2c0906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 10 monclient(hunting): picked mon.noname-c con 0x7fbb2c0911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 10 monclient(hunting): picked mon.noname-a con 0x7fbb2c185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2c090100 con 0x7fbb2c185070 2026-02-12T17:28:21.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2c091a70 con 0x7fbb2c0911b0 2026-02-12T17:28:21.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2c092360 con 0x7fbb2c0906d0 2026-02-12T17:28:21.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb3497e640 10 monclient(hunting): authenticate will time out at 581.437092s 2026-02-12T17:28:21.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb32ef4640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbb2c185070 0x7fbb2c1a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38712/0 (socket says 10.20.193.57:38712) 2026-02-12T17:28:21.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb326f3640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbb2c0906d0 0x7fbb2c090aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42678/0 (socket says 10.20.193.57:42678) 2026-02-12T17:28:21.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7fbb32ef4640 1 -- 10.20.193.57:0/3793417427 learned_addr learned my addr 10.20.193.57:0/3793417427 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7ff5332cc640 10 monclient: get_monmap_and_config 2026-02-12T17:28:21.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7ff5332cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7ff5332cc640 10 monclient: monmap: 2026-02-12T17:28:21.620 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:21.619119+0000 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:21.619119+0000 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7ff5332cc640 1 Processor -- start 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7ff5332cc640 1 -- start start 2026-02-12T17:28:21.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7ff5332cc640 10 monclient: init 2026-02-12T17:28:21.622 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7f09f3c1b640 10 monclient: get_monmap_and_config 2026-02-12T17:28:21.622 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7f09f3c1b640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.622 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7f09f3c1b640 10 monclient: monmap: 2026-02-12T17:28:21.622 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.622 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.622 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:21.619621+0000 2026-02-12T17:28:21.623 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:21.619621+0000 2026-02-12T17:28:21.623 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.623 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.623 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.623 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:21.623 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:21.623 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7ff5332cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7ff5332cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:21.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.618+0000 7ff5332cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff52c054330 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7ff5332cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff52c054e10 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7ff5332cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff52c08e420 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7ff5332cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c08da40 con 0x7ff52c054330 2026-02-12T17:28:21.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7ff5332cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c08efc0 con 0x7ff52c054e10 2026-02-12T17:28:21.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7ff5332cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c05de10 con 0x7ff52c08e420 2026-02-12T17:28:21.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7ff5332cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7ff5332cc640 10 monclient(hunting): authenticate will time out at 581.438047s 2026-02-12T17:28:21.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7ff531041640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff52c054330 0x7ff52c054700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38728/0 (socket says 10.20.193.57:38728) 2026-02-12T17:28:21.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7ff531041640 1 -- 10.20.193.57:0/1130463625 learned_addr learned my addr 10.20.193.57:0/1130463625 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 1 Processor -- start 2026-02-12T17:28:21.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 1 -- start start 2026-02-12T17:28:21.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 10 monclient: init 2026-02-12T17:28:21.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:21.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 10 monclient(hunting): picked mon.noname-b con 0x7f09ec085720 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 10 monclient(hunting): picked mon.noname-a con 0x7f09ec086ea0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 10 monclient(hunting): picked mon.noname-c con 0x7f09ec086200 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ec088220 con 0x7f09ec086ea0 2026-02-12T17:28:21.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ec089500 con 0x7f09ec086200 2026-02-12T17:28:21.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ec087f40 con 0x7f09ec085720 2026-02-12T17:28:21.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f3c1b640 10 monclient(hunting): authenticate will time out at 581.438521s 2026-02-12T17:28:21.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f118f640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f09ec086ea0 0x7f09ec180a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38730/0 (socket says 10.20.193.57:38730) 2026-02-12T17:28:21.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.619+0000 7f09f118f640 1 -- 10.20.193.57:0/476071989 learned_addr learned my addr 10.20.193.57:0/476071989 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb32ef4640 1 -- 10.20.193.57:0/3793417427 >> v1:10.20.193.57:6789/0 conn(0x7fbb2c185070 legacy=0x7fbb2c1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb326f3640 1 -- 10.20.193.57:0/3793417427 >> v1:10.20.193.57:6790/0 conn(0x7fbb2c0906d0 legacy=0x7fbb2c090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073518439 0 0) 0x7fbb2c090100 con 0x7fbb2c185070 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient(hunting): my global_id is 4329 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb1c0035e0 con 0x7fbb2c185070 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3939383314 0 0) 0x7fbb2c092360 con 0x7fbb2c0906d0 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient(hunting): my global_id is 4289 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb2c090100 con 0x7fbb2c0906d0 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb31ef2640 1 -- 10.20.193.57:0/3793417427 >> v1:10.20.193.82:6789/0 conn(0x7fbb2c0911b0 legacy=0x7fbb2c183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2776690941 0 0) 0x7fbb2c090100 con 0x7fbb2c0906d0 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 >> v1:10.20.193.82:6789/0 conn(0x7fbb2c0911b0 legacy=0x7fbb2c183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 >> v1:10.20.193.57:6789/0 conn(0x7fbb2c185070 legacy=0x7fbb2c1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 monclient: found mon.noname-b 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2c05cf80 con 0x7fbb2c0906d0 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbb240030d0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb3497e640 5 monclient: authenticate success, global_id 4289 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb3497e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: dump: 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.633 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb3497e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb24003360 con 0x7fbb2c0906d0 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 1 -- 10.20.193.57:0/3793417427 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbb240048a0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb316f1640 10 monclient: dump: 2026-02-12T17:28:21.634 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb3497e640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.620+0000 7fbb3497e640 4 set_mon_vals no callback set 2026-02-12T17:28:21.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 10 monclient: shutdown 2026-02-12T17:28:21.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 1 -- 10.20.193.57:0/3793417427 >> v1:10.20.193.57:6790/0 conn(0x7fbb2c0906d0 legacy=0x7fbb2c090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 1 -- 10.20.193.57:0/3793417427 shutdown_connections 2026-02-12T17:28:21.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 1 -- 10.20.193.57:0/3793417427 >> 10.20.193.57:0/3793417427 conn(0x7fbb2c054330 msgr2=0x7fbb2c054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 1 -- 10.20.193.57:0/3793417427 shutdown_connections 2026-02-12T17:28:21.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 1 -- 10.20.193.57:0/3793417427 wait complete. 2026-02-12T17:28:21.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff531041640 1 -- 10.20.193.57:0/1130463625 >> v1:10.20.193.57:6789/0 conn(0x7ff52c054330 legacy=0x7ff52c054700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 -- 10.20.193.57:0/1130463625 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997394616 0 0) 0x7ff52c08da40 con 0x7ff52c054330 2026-02-12T17:28:21.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient(hunting): my global_id is 4332 2026-02-12T17:28:21.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 -- 10.20.193.57:0/1130463625 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5140035e0 con 0x7ff52c054330 2026-02-12T17:28:21.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 -- 10.20.193.57:0/1130463625 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 701428481 0 0) 0x7ff5140035e0 con 0x7ff52c054330 2026-02-12T17:28:21.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 -- 10.20.193.57:0/1130463625 >> v1:10.20.193.57:6790/0 conn(0x7ff52c08e420 legacy=0x7ff52c1a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:21.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 -- 10.20.193.57:0/1130463625 >> v1:10.20.193.82:6789/0 conn(0x7ff52c054e10 legacy=0x7ff52c183d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:21.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 monclient: found mon.noname-a 2026-02-12T17:28:21.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 10 monclient: monmap: 2026-02-12T17:28:21.639 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.639 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:21.639 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:21.639 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:21.639 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.639 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:21.640 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.640 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:21.640 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:21.640 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 -- 10.20.193.57:0/1130463625 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c08d1a0 con 0x7ff52c054330 2026-02-12T17:28:21.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 -- 10.20.193.57:0/1130463625 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff51c0030d0 con 0x7ff52c054330 2026-02-12T17:28:21.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff5332cc640 5 monclient: authenticate success, global_id 4332 2026-02-12T17:28:21.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff5332cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:21.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: dump: 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff5332cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:21.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7f09f118f640 1 -- 10.20.193.57:0/476071989 >> v1:10.20.193.57:6789/0 conn(0x7f09ec086ea0 legacy=0x7f09ec180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 -- 10.20.193.57:0/1130463625 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff51c003360 con 0x7ff52c054330 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff5332cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 1 -- 10.20.193.57:0/1130463625 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff51c004960 con 0x7ff52c054330 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff5332cc640 4 set_mon_vals no callback set 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7ff51bfff640 10 monclient: dump: 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.644 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.645 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.645 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.645 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.645 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.645 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.645 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 1 Processor -- start 2026-02-12T17:28:21.645 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7f09f2191640 1 -- 10.20.193.57:0/476071989 >> v1:10.20.193.82:6789/0 conn(0x7f09ec086200 legacy=0x7f09ec1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 1 -- start start 2026-02-12T17:28:21.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7fbb3497e640 10 monclient: init 2026-02-12T17:28:21.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3833326205 0 0) 0x7f09ec088220 con 0x7f09ec086ea0 2026-02-12T17:28:21.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7f09f098e640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7f09f098e640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7f09f098e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7f09f098e640 10 monclient(hunting): my global_id is 4335 2026-02-12T17:28:21.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.621+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09d40035e0 con 0x7f09ec086ea0 2026-02-12T17:28:21.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 10 monclient: shutdown 2026-02-12T17:28:21.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 1 -- 10.20.193.57:0/1130463625 >> v1:10.20.193.57:6789/0 conn(0x7ff52c054330 legacy=0x7ff52c054700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529238151 0 0) 0x7f09ec089500 con 0x7f09ec086200 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient(hunting): my global_id is 4282 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09ec088220 con 0x7f09ec086200 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1751277494 0 0) 0x7f09d40035e0 con 0x7f09ec086ea0 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 >> v1:10.20.193.57:6790/0 conn(0x7f09ec085720 legacy=0x7f09ec085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 >> v1:10.20.193.82:6789/0 conn(0x7f09ec086200 legacy=0x7f09ec1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 monclient: found mon.noname-a 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec0867e0 con 0x7f09ec086ea0 2026-02-12T17:28:21.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09e00030d0 con 0x7f09ec086ea0 2026-02-12T17:28:21.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 1 -- 10.20.193.57:0/1130463625 shutdown_connections 2026-02-12T17:28:21.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 1 -- 10.20.193.57:0/1130463625 >> 10.20.193.57:0/1130463625 conn(0x7ff52c08fa00 msgr2=0x7ff52c0906a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: dump: 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.651 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 5 monclient: authenticate success, global_id 4335 2026-02-12T17:28:21.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:21.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 1 -- 10.20.193.57:0/1130463625 shutdown_connections 2026-02-12T17:28:21.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 1 -- 10.20.193.57:0/1130463625 wait complete. 2026-02-12T17:28:21.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:21.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 10 monclient(hunting): picked mon.noname-c con 0x7fbb2c0906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09e00032e0 con 0x7f09ec086ea0 2026-02-12T17:28:21.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:21.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 4 set_mon_vals no callback set 2026-02-12T17:28:21.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 10 monclient(hunting): picked mon.noname-a con 0x7fbb2c0911b0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 10 monclient(hunting): picked mon.noname-b con 0x7fbb2c185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2c08f390 con 0x7fbb2c0911b0 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2c1341c0 con 0x7fbb2c185070 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 1 -- 10.20.193.57:0/476071989 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09e0004960 con 0x7f09ec086ea0 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f098e640 10 monclient: dump: 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.654 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2c1339e0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb3497e640 10 monclient(hunting): authenticate will time out at 581.441237s 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb326f3640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbb2c0906d0 0x7fbb2c12fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42700/0 (socket says 10.20.193.57:42700) 2026-02-12T17:28:21.655 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7fbb326f3640 1 -- 10.20.193.57:0/1893593044 learned_addr learned my addr 10.20.193.57:0/1893593044 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 10 monclient: shutdown 2026-02-12T17:28:21.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 1 -- 10.20.193.57:0/476071989 >> v1:10.20.193.57:6789/0 conn(0x7f09ec086ea0 legacy=0x7f09ec180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 1 -- 10.20.193.57:0/476071989 shutdown_connections 2026-02-12T17:28:21.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 1 -- 10.20.193.57:0/476071989 >> 10.20.193.57:0/476071989 conn(0x7f09ec0916b0 msgr2=0x7f09ec091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 1 -- 10.20.193.57:0/476071989 shutdown_connections 2026-02-12T17:28:21.656 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 1 -- 10.20.193.57:0/476071989 wait complete. 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 10 monclient: monmap: 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:21.657 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7f09f3c1b640 10 monclient: monmap: 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:21.658 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 1 Processor -- start 2026-02-12T17:28:21.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 1 -- start start 2026-02-12T17:28:21.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.622+0000 7ff5332cc640 10 monclient: init 2026-02-12T17:28:21.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 1 Processor -- start 2026-02-12T17:28:21.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 1 -- start start 2026-02-12T17:28:21.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 10 monclient: init 2026-02-12T17:28:21.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:21.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff52c054330 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff52c054e10 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff52c08e420 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c088c30 con 0x7ff52c054330 2026-02-12T17:28:21.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c08b760 con 0x7ff52c08e420 2026-02-12T17:28:21.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52c089990 con 0x7ff52c054e10 2026-02-12T17:28:21.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff5332cc640 10 monclient(hunting): authenticate will time out at 581.442196s 2026-02-12T17:28:21.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff531041640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff52c054330 0x7ff52c153170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38750/0 (socket says 10.20.193.57:38750) 2026-02-12T17:28:21.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7ff531041640 1 -- 10.20.193.57:0/710976545 learned_addr learned my addr 10.20.193.57:0/710976545 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 10 monclient(hunting): picked mon.noname-a con 0x7f09ec085720 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 10 monclient(hunting): picked mon.noname-b con 0x7f09ec086200 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 10 monclient(hunting): picked mon.noname-c con 0x7f09ec086ea0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ec13f320 con 0x7f09ec085720 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ec13ed60 con 0x7f09ec086200 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ec058ba0 con 0x7f09ec086ea0 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f3c1b640 10 monclient(hunting): authenticate will time out at 581.442370s 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f1990640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f09ec085720 0x7f09ec13b550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38762/0 (socket says 10.20.193.57:38762) 2026-02-12T17:28:21.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.623+0000 7f09f1990640 1 -- 10.20.193.57:0/3141494844 learned_addr learned my addr 10.20.193.57:0/3141494844 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb326f3640 1 -- 10.20.193.57:0/1893593044 >> v1:10.20.193.57:6790/0 conn(0x7fbb2c0906d0 legacy=0x7fbb2c12fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb31ef2640 1 -- 10.20.193.57:0/1893593044 >> v1:10.20.193.57:6789/0 conn(0x7fbb2c0911b0 legacy=0x7fbb2c1305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2796598812 0 0) 0x7fbb2c1339e0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient(hunting): my global_id is 4292 2026-02-12T17:28:21.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbafc0035e0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb31ef2640 1 --1- 10.20.193.57:0/1893593044 >> v1:10.20.193.57:6789/0 conn(0x7fbb2c0911b0 0x7fbb2c1305b0 :-1 s=OPENED pgs=105 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fbb2c091a70 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb32ef4640 1 -- 10.20.193.57:0/1893593044 >> v1:10.20.193.82:6789/0 conn(0x7fbb2c185070 legacy=0x7fbb2c174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1597471278 0 0) 0x7fbafc0035e0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb2c1339e0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbb240034d0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 738525072 0 0) 0x7fbb2c1339e0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 >> v1:10.20.193.82:6789/0 conn(0x7fbb2c185070 legacy=0x7fbb2c174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 >> v1:10.20.193.57:6789/0 conn(0x7fbb2c0911b0 legacy=0x7fbb2c1305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 monclient: found mon.c 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2c130cc0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370594944 0 0) 0x7fbb2c091a70 con 0x7fbb2c0911b0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb3497e640 5 monclient: authenticate success, global_id 4292 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb3497e640 10 monclient: _renew_subs 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb3497e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2c133cc0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb16ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb3497e640 10 monclient: _renew_subs 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb3497e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.624+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb2c08b6c0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb24004e00 con 0x7fbb2c0906d0 2026-02-12T17:28:21.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb16ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbb24005120 con 0x7fbb2c0906d0 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb16ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb16ffd640 10 monclient: dump: 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb30ef0640 4 set_mon_vals no callback set 2026-02-12T17:28:21.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff531041640 1 -- 10.20.193.57:0/710976545 >> v1:10.20.193.57:6789/0 conn(0x7ff52c054330 legacy=0x7ff52c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973159851 0 0) 0x7ff52c088c30 con 0x7ff52c054330 2026-02-12T17:28:21.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): my global_id is 4341 2026-02-12T17:28:21.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7f09f1990640 1 -- 10.20.193.57:0/3141494844 >> v1:10.20.193.57:6789/0 conn(0x7f09ec085720 legacy=0x7f09ec13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4fc0035e0 con 0x7ff52c054330 2026-02-12T17:28:21.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff531842640 1 -- 10.20.193.57:0/710976545 >> v1:10.20.193.82:6789/0 conn(0x7ff52c08e420 legacy=0x7ff52c195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb3497e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb3497e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fbb240053b0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb3497e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb2c0008d0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1631183280 0 0) 0x7ff52c08b760 con 0x7ff52c08e420 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): my global_id is 4288 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff52c088c30 con 0x7ff52c08e420 2026-02-12T17:28:21.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2867498670 0 0) 0x7ff4fc0035e0 con 0x7ff52c054330 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7f09f118f640 1 -- 10.20.193.57:0/3141494844 >> v1:10.20.193.82:6789/0 conn(0x7f09ec086200 legacy=0x7f09ec13bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841616988 0 0) 0x7f09ec13f320 con 0x7f09ec085720 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7f09da7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff52c08b760 con 0x7ff52c054330 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff51c002b30 con 0x7ff52c054330 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7f09da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7f09da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7f09da7fc640 10 monclient(hunting): my global_id is 4344 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:21.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): dump: 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09bc0035e0 con 0x7f09ec085720 2026-02-12T17:28:21.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7fbb2404ec40 con 0x7fbb2c0906d0 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4036234727 0 0) 0x7ff52c088c30 con 0x7ff52c08e420 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4fc0035e0 con 0x7ff52c08e420 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3926710598 0 0) 0x7ff52c08b760 con 0x7ff52c054330 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 >> v1:10.20.193.57:6790/0 conn(0x7ff52c054e10 legacy=0x7ff52c194230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 >> v1:10.20.193.82:6789/0 conn(0x7ff52c08e420 legacy=0x7ff52c195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 monclient: found mon.a 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c081ca0 con 0x7ff52c054330 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.625+0000 7ff519ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 5 monclient: authenticate success, global_id 4341 2026-02-12T17:28:21.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 674842176 0 0) 0x7f09bc0035e0 con 0x7f09ec085720 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 10 monclient: _renew_subs 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09ec13f320 con 0x7f09ec085720 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09dc004310 con 0x7f09ec085720 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient(hunting): dump: 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.673 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff52c0819c0 con 0x7ff52c054330 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490785581 0 0) 0x7f09ec13ed60 con 0x7f09ec086200 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient(hunting): my global_id is 4291 2026-02-12T17:28:21.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09bc0035e0 con 0x7f09ec086200 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 10 monclient: _renew_subs 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff51c004f40 con 0x7ff52c054330 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff52c07eee0 con 0x7ff52c054330 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff519ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff51c005260 con 0x7ff52c054330 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff519ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff519ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff519ffb640 10 monclient: dump: 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.675 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.676 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff51b7fe640 4 set_mon_vals no callback set 2026-02-12T17:28:21.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7fbb31ef2640 10 monclient: get_auth_request con 0x7fbafc03f660 auth_method 0 2026-02-12T17:28:21.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4225126026 0 0) 0x7f09ec13f320 con 0x7f09ec085720 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 >> v1:10.20.193.57:6790/0 conn(0x7f09ec086ea0 legacy=0x7f09ec194fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 >> v1:10.20.193.82:6789/0 conn(0x7f09ec086200 legacy=0x7f09ec13bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 monclient: found mon.a 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec13c370 con 0x7f09ec085720 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 5 monclient: authenticate success, global_id 4344 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 10 monclient: _renew_subs 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec13f040 con 0x7f09ec085720 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 10 monclient: _renew_subs 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f09ec13eb30 con 0x7f09ec085720 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09dc002950 con 0x7f09ec085720 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09dbfff640 4 set_mon_vals no callback set 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52c057410 con 0x7ff52c054330 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09dc002c70 con 0x7f09ec085720 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09da7fc640 10 monclient: dump: 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.678 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.626+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ec090810 con 0x7f09ec085720 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.627+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff51c011ed0 con 0x7ff52c054330 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.627+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7ff51c04eb60 con 0x7ff52c054330 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.627+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f09dc002ec0 con 0x7f09ec085720 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.627+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f09dc04ea90 con 0x7f09ec085720 2026-02-12T17:28:21.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.627+0000 7ff530840640 10 monclient: get_auth_request con 0x7ff4fc03fab0 auth_method 0 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.627+0000 7f09f118f640 10 monclient: get_auth_request con 0x7f09bc03f6d0 auth_method 0 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.628+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fbb240175f0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.628+0000 7fbb16ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.628+0000 7fbb16ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.629+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff51c0136e0 con 0x7ff52c054330 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.629+0000 7ff519ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.629+0000 7ff519ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.631+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f09dc016d20 con 0x7f09ec085720 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.631+0000 7f09da7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.631+0000 7f09da7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient: get_monmap_and_config 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient: monmap: 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:21.662049+0000 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:21.662049+0000 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 1 Processor -- start 2026-02-12T17:28:21.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 1 -- start start 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient: init 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient(hunting): picked mon.noname-b con 0x7f3fd4085720 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient(hunting): picked mon.noname-a con 0x7f3fd4086ea0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient(hunting): picked mon.noname-c con 0x7f3fd4086200 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd4088220 con 0x7f3fd4086ea0 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd4089500 con 0x7f3fd4086200 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd4087f40 con 0x7f3fd4085720 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.661+0000 7f3fd9683640 10 monclient(hunting): authenticate will time out at 581.480931s 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.662+0000 7f3fd2ffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3fd4085720 0x7f3fd4085af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42736/0 (socket says 10.20.193.57:42736) 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.662+0000 7f3fd27fc640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f3fd4086ea0 0x7f3fd4180a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38766/0 (socket says 10.20.193.57:38766) 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.662+0000 7f3fd2ffd640 1 -- 10.20.193.57:0/3865488095 learned_addr learned my addr 10.20.193.57:0/3865488095 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.662+0000 7f31d59ed640 10 monclient: get_monmap_and_config 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.662+0000 7f31d59ed640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.662+0000 7f31d59ed640 10 monclient: monmap: 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:21.663469+0000 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:21.663469+0000 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 1 Processor -- start 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 1 -- start start 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 10 monclient: init 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 10 monclient(hunting): picked mon.noname-a con 0x7f31d00906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 10 monclient(hunting): picked mon.noname-c con 0x7f31d00911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 10 monclient(hunting): picked mon.noname-b con 0x7f31d0185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d0090100 con 0x7f31d00906d0 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d0091a70 con 0x7f31d00911b0 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d0092360 con 0x7f31d0185070 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31d59ed640 10 monclient(hunting): authenticate will time out at 581.482505s 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31cf7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f31d0185070 0x7f31d01a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42750/0 (socket says 10.20.193.57:42750) 2026-02-12T17:28:21.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.663+0000 7f31cf7fe640 1 -- 10.20.193.57:0/1662002969 learned_addr learned my addr 10.20.193.57:0/1662002969 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd2ffd640 1 -- 10.20.193.57:0/3865488095 >> v1:10.20.193.57:6790/0 conn(0x7f3fd4085720 legacy=0x7f3fd4085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd27fc640 1 -- 10.20.193.57:0/3865488095 >> v1:10.20.193.57:6789/0 conn(0x7f3fd4086ea0 legacy=0x7f3fd4180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041064585 0 0) 0x7f3fd4087f40 con 0x7f3fd4085720 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient(hunting): my global_id is 4295 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd37fe640 1 -- 10.20.193.57:0/3865488095 >> v1:10.20.193.82:6789/0 conn(0x7f3fd4086200 legacy=0x7f3fd41a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fc00035e0 con 0x7f3fd4085720 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155728763 0 0) 0x7f3fd4089500 con 0x7f3fd4086200 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient(hunting): my global_id is 4294 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd4087f40 con 0x7f3fd4086200 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 542952220 0 0) 0x7f3fc00035e0 con 0x7f3fd4085720 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 >> v1:10.20.193.82:6789/0 conn(0x7f3fd4086200 legacy=0x7f3fd41a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 >> v1:10.20.193.57:6789/0 conn(0x7f3fd4086ea0 legacy=0x7f3fd4180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 monclient: found mon.noname-b 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd40867e0 con 0x7f3fd4085720 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3fc80030d0 con 0x7f3fd4085720 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: dump: 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 5 monclient: authenticate success, global_id 4295 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fc8003360 con 0x7f3fd4085720 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 1 -- 10.20.193.57:0/3865488095 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3fc8004960 con 0x7f3fd4085720 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 4 set_mon_vals no callback set 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd1ffb640 10 monclient: dump: 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.686 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 10 monclient: shutdown 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 1 -- 10.20.193.57:0/3865488095 >> v1:10.20.193.57:6790/0 conn(0x7f3fd4085720 legacy=0x7f3fd4085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 1 -- 10.20.193.57:0/3865488095 shutdown_connections 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 1 -- 10.20.193.57:0/3865488095 >> 10.20.193.57:0/3865488095 conn(0x7f3fd40916b0 msgr2=0x7f3fd4091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 1 -- 10.20.193.57:0/3865488095 shutdown_connections 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.664+0000 7f3fd9683640 1 -- 10.20.193.57:0/3865488095 wait complete. 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient: monmap: 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 1 Processor -- start 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 1 -- start start 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient: init 2026-02-12T17:28:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cf7fe640 1 -- 10.20.193.57:0/1662002969 >> v1:10.20.193.57:6790/0 conn(0x7f31d0185070 legacy=0x7f31d01a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient(hunting): picked mon.noname-b con 0x7f3fd4085720 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 1 -- 10.20.193.57:0/1662002969 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474988792 0 0) 0x7f31d0092360 con 0x7f31d0185070 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 10 monclient(hunting): my global_id is 4298 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient(hunting): picked mon.noname-c con 0x7f3fd4086200 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 1 -- 10.20.193.57:0/1662002969 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31bc0035e0 con 0x7f31d0185070 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient(hunting): picked mon.noname-a con 0x7f3fd4086ea0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd413ddd0 con 0x7f3fd4086ea0 2026-02-12T17:28:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd408aea0 con 0x7f3fd4085720 2026-02-12T17:28:21.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31ce7fc640 1 -- 10.20.193.57:0/1662002969 >> v1:10.20.193.82:6789/0 conn(0x7f31d00911b0 legacy=0x7f31d0183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd41403f0 con 0x7f3fd4086200 2026-02-12T17:28:21.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd9683640 10 monclient(hunting): authenticate will time out at 581.484856s 2026-02-12T17:28:21.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd27fc640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3fd4086200 0x7f3fd421ad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42764/0 (socket says 10.20.193.57:42764) 2026-02-12T17:28:21.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f3fd27fc640 1 -- 10.20.193.57:0/422462094 learned_addr learned my addr 10.20.193.57:0/422462094 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 1 -- 10.20.193.57:0/1662002969 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1980479753 0 0) 0x7f31bc0035e0 con 0x7f31d0185070 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 1 -- 10.20.193.57:0/1662002969 >> v1:10.20.193.82:6789/0 conn(0x7f31d00911b0 legacy=0x7f31d0183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 1 -- 10.20.193.57:0/1662002969 >> v1:10.20.193.57:6789/0 conn(0x7f31d00906d0 legacy=0x7f31d0090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 1 monclient: found mon.noname-b 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 1 -- 10.20.193.57:0/1662002969 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d005cf80 con 0x7f31d0185070 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.665+0000 7f31cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 1 -- 10.20.193.57:0/1662002969 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f31c00041b0 con 0x7f31d0185070 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 10 monclient: dump: 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.690 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 5 monclient: authenticate success, global_id 4298 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 1 -- 10.20.193.57:0/1662002969 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31c0004440 con 0x7f31d0185070 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 1 -- 10.20.193.57:0/1662002969 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f31c0005a40 con 0x7f31d0185070 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31cdffb640 10 monclient: dump: 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 4 set_mon_vals no callback set 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 10 monclient: shutdown 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 1 -- 10.20.193.57:0/1662002969 >> v1:10.20.193.57:6790/0 conn(0x7f31d0185070 legacy=0x7f31d01a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 1 -- 10.20.193.57:0/1662002969 shutdown_connections 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 1 -- 10.20.193.57:0/1662002969 >> 10.20.193.57:0/1662002969 conn(0x7f31d0054330 msgr2=0x7f31d0054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 1 -- 10.20.193.57:0/1662002969 shutdown_connections 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 1 -- 10.20.193.57:0/1662002969 wait complete. 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.666+0000 7f31d59ed640 10 monclient: monmap: 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 1 Processor -- start 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 1 -- start start 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 10 monclient: init 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 10 monclient(hunting): picked mon.noname-a con 0x7f31d00906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 10 monclient(hunting): picked mon.noname-c con 0x7f31d00911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 10 monclient(hunting): picked mon.noname-b con 0x7f31d0185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d0134120 con 0x7f31d00906d0 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d0133940 con 0x7f31d0185070 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d0133c20 con 0x7f31d00911b0 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31d59ed640 10 monclient(hunting): authenticate will time out at 581.486527s 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31ce7fc640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f31d00911b0 0x7f31d0130560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42768/0 (socket says 10.20.193.57:42768) 2026-02-12T17:28:21.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f31ce7fc640 1 -- 10.20.193.57:0/744564566 learned_addr learned my addr 10.20.193.57:0/744564566 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.667+0000 7f3fd27fc640 1 -- 10.20.193.57:0/422462094 >> v1:10.20.193.57:6790/0 conn(0x7f3fd4086200 legacy=0x7f3fd421ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd37fe640 1 -- 10.20.193.57:0/422462094 >> v1:10.20.193.57:6789/0 conn(0x7f3fd4086ea0 legacy=0x7f3fd423c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909739296 0 0) 0x7f3fd41403f0 con 0x7f3fd4086200 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): my global_id is 4301 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa00035e0 con 0x7f3fd4086200 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3295212812 0 0) 0x7f3fd413ddd0 con 0x7f3fd4086ea0 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): my global_id is 4350 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd41403f0 con 0x7f3fd4086ea0 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd2ffd640 1 -- 10.20.193.57:0/422462094 >> v1:10.20.193.82:6789/0 conn(0x7f3fd4085720 legacy=0x7f3fd41d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2649897322 0 0) 0x7f3fa00035e0 con 0x7f3fd4086200 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fd413ddd0 con 0x7f3fd4086200 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3fbc003390 con 0x7f3fd4086200 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): dump: 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:21.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054837329 0 0) 0x7f3fd408aea0 con 0x7f3fd4085720 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): my global_id is 4300 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa00035e0 con 0x7f3fd4085720 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3926607519 0 0) 0x7f3fd41403f0 con 0x7f3fd4086ea0 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fd408aea0 con 0x7f3fd4086ea0 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3fc4004490 con 0x7f3fd4086ea0 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient(hunting): dump: 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2834334145 0 0) 0x7f3fd413ddd0 con 0x7f3fd4086200 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 >> v1:10.20.193.82:6789/0 conn(0x7f3fd4085720 legacy=0x7f3fd41d6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 >> v1:10.20.193.57:6789/0 conn(0x7f3fd4086ea0 legacy=0x7f3fd423c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 monclient: found mon.c 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd413f2f0 con 0x7f3fd4086200 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 5 monclient: authenticate success, global_id 4301 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 10 monclient: _renew_subs 2026-02-12T17:28:21.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd413f5d0 con 0x7f3fd4086200 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 10 monclient: _renew_subs 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3fd413e290 con 0x7f3fd4086200 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fbc004b50 con 0x7f3fd4086200 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3fbc004e70 con 0x7f3fd4086200 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fb37fe640 10 monclient: dump: 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd17fa640 4 set_mon_vals no callback set 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.668+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd413f130 con 0x7f3fd4086200 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3fbc0050c0 con 0x7f3fd4086200 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f3fbc04eb40 con 0x7f3fd4086200 2026-02-12T17:28:21.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f3fd2ffd640 10 monclient: get_auth_request con 0x7f3fa003fcc0 auth_method 0 2026-02-12T17:28:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31ce7fc640 1 -- 10.20.193.57:0/744564566 >> v1:10.20.193.57:6790/0 conn(0x7f31d00911b0 legacy=0x7f31d0130560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31ceffd640 1 -- 10.20.193.57:0/744564566 >> v1:10.20.193.57:6789/0 conn(0x7f31d00906d0 legacy=0x7f31d012fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31cf7fe640 1 -- 10.20.193.57:0/744564566 >> v1:10.20.193.82:6789/0 conn(0x7f31d0185070 legacy=0x7f31d0174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213098617 0 0) 0x7f31d0134120 con 0x7f31d00906d0 2026-02-12T17:28:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 10 monclient(hunting): my global_id is 4353 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31a00035e0 con 0x7f31d00906d0 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744213722 0 0) 0x7f31d0133940 con 0x7f31d0185070 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 10 monclient(hunting): my global_id is 4303 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31d0134120 con 0x7f31d0185070 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.669+0000 7f31ceffd640 1 --1- 10.20.193.57:0/744564566 >> v1:10.20.193.57:6789/0 conn(0x7f31d00906d0 0x7f31d012fe50 :-1 s=OPENED pgs=111 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f31c40042f0 mon_map magic: 0 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2896583292 0 0) 0x7f31a00035e0 con 0x7f31d00906d0 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31d0133940 con 0x7f31d00906d0 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f31c40042f0 con 0x7f31d00906d0 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient(hunting): dump: 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3471636859 0 0) 0x7f31d0134120 con 0x7f31d0185070 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31a00035e0 con 0x7f31d0185070 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f31c00045b0 con 0x7f31d0185070 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient(hunting): dump: 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.698 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1373928936 0 0) 0x7f31a00035e0 con 0x7f31d0185070 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 >> v1:10.20.193.57:6790/0 conn(0x7f31d00911b0 legacy=0x7f31d0130560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 >> v1:10.20.193.57:6789/0 conn(0x7f31d00906d0 legacy=0x7f31d012fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 monclient: found mon.b 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d0130c70 con 0x7f31d0185070 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3790070146 0 0) 0x7f31d0133940 con 0x7f31d00906d0 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 5 monclient: authenticate success, global_id 4303 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 10 monclient: _renew_subs 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f31d008f320 con 0x7f31d0185070 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 10 monclient: _renew_subs 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f31d0132db0 con 0x7f31d0185070 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31c00059a0 con 0x7f31d0185070 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f31c00061d0 con 0x7f31d0185070 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31a7fff640 10 monclient: dump: 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.699 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31cd7fa640 4 set_mon_vals no callback set 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.670+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d00008d0 con 0x7f31d0185070 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.671+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f31c0012e40 con 0x7f31d0185070 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.671+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f31c004fa80 con 0x7f31d0185070 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.671+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3fbc0053a0 con 0x7f3fd4086200 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.671+0000 7f3fb37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.671+0000 7f3fb37fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.671+0000 7f31ceffd640 10 monclient: get_auth_request con 0x7f31a003fae0 auth_method 0 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.673+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f31c0017d60 con 0x7f31d0185070 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.673+0000 7f31a7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.673+0000 7f31a7fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:21.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.684+0000 7f5f4d1c7640 10 monclient: get_monmap_and_config 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.684+0000 7f5f4d1c7640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.684+0000 7f5f4d1c7640 10 monclient: monmap: 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:21.685442+0000 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:21.685442+0000 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.684+0000 7f5f4d1c7640 1 Processor -- start 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 1 -- start start 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 10 monclient: init 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 10 monclient(hunting): picked mon.noname-a con 0x7f5f4808e290 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 10 monclient(hunting): picked mon.noname-c con 0x7f5f4808f500 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 10 monclient(hunting): picked mon.noname-b con 0x7f5f4808ed70 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f4808fbd0 con 0x7f5f4808e290 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f48056250 con 0x7f5f4808f500 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f48056530 con 0x7f5f4808ed70 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f4d1c7640 10 monclient(hunting): authenticate will time out at 581.504319s 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f47577640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f5f4808ed70 0x7f5f481a5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42770/0 (socket says 10.20.193.57:42770) 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.685+0000 7f5f47577640 1 -- 10.20.193.57:0/626345482 learned_addr learned my addr 10.20.193.57:0/626345482 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f47577640 1 -- 10.20.193.57:0/626345482 >> v1:10.20.193.57:6790/0 conn(0x7f5f4808ed70 legacy=0x7f5f481a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f46d76640 1 -- 10.20.193.57:0/626345482 >> v1:10.20.193.57:6789/0 conn(0x7f5f4808e290 legacy=0x7f5f4808e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f46575640 1 -- 10.20.193.57:0/626345482 >> v1:10.20.193.82:6789/0 conn(0x7f5f4808f500 legacy=0x7f5f48183f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632061024 0 0) 0x7f5f48056530 con 0x7f5f4808ed70 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): my global_id is 4304 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f340035e0 con 0x7f5f4808ed70 2026-02-12T17:28:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4030029652 0 0) 0x7f5f4808fbd0 con 0x7f5f4808e290 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): my global_id is 4356 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f48056530 con 0x7f5f4808e290 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112311889 0 0) 0x7f5f48056250 con 0x7f5f4808f500 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient(hunting): my global_id is 4306 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f4808fbd0 con 0x7f5f4808f500 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2405467982 0 0) 0x7f5f340035e0 con 0x7f5f4808ed70 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 >> v1:10.20.193.82:6789/0 conn(0x7f5f4808f500 legacy=0x7f5f48183f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 >> v1:10.20.193.57:6789/0 conn(0x7f5f4808e290 legacy=0x7f5f4808e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 monclient: found mon.noname-b 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f48056810 con 0x7f5f4808ed70 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f380041b0 con 0x7f5f4808ed70 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f4d1c7640 5 monclient: authenticate success, global_id 4304 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f4d1c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f45d74640 10 monclient: dump: 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.687+0000 7f5f4d1c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f380044b0 con 0x7f5f4808ed70 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f45d74640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f45d74640 1 -- 10.20.193.57:0/626345482 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f38005bf0 con 0x7f5f4808ed70 2026-02-12T17:28:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f45d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f45d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f45d74640 10 monclient: dump: 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 4 set_mon_vals no callback set 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 10 monclient: shutdown 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/626345482 >> v1:10.20.193.57:6790/0 conn(0x7f5f4808ed70 legacy=0x7f5f481a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/626345482 shutdown_connections 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/626345482 >> 10.20.193.57:0/626345482 conn(0x7f5f48054b30 msgr2=0x7f5f48093890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/626345482 shutdown_connections 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/626345482 wait complete. 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 10 monclient: build_initial_monmap 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 10 monclient: monmap: 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.688+0000 7f5f4d1c7640 1 Processor -- start 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 1 -- start start 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 10 monclient: init 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 10 monclient(hunting): picked mon.noname-b con 0x7f5f4808e290 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 10 monclient(hunting): picked mon.noname-c con 0x7f5f4808ed70 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 10 monclient(hunting): picked mon.noname-a con 0x7f5f4808f500 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f48140300 con 0x7f5f4808f500 2026-02-12T17:28:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f4813f620 con 0x7f5f4808e290 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f4813e100 con 0x7f5f4808ed70 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f4d1c7640 10 monclient(hunting): authenticate will time out at 581.508278s 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f46575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f5f4808ed70 0x7f5f481945f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42784/0 (socket says 10.20.193.57:42784) 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.689+0000 7f5f46575640 1 -- 10.20.193.57:0/2525355221 learned_addr learned my addr 10.20.193.57:0/2525355221 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f46575640 1 -- 10.20.193.57:0/2525355221 >> v1:10.20.193.57:6790/0 conn(0x7f5f4808ed70 legacy=0x7f5f481945f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f47577640 1 -- 10.20.193.57:0/2525355221 >> v1:10.20.193.57:6789/0 conn(0x7f5f4808f500 legacy=0x7f5f48195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3175777910 0 0) 0x7f5f4813e100 con 0x7f5f4808ed70 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): my global_id is 4307 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f140035e0 con 0x7f5f4808ed70 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150535720 0 0) 0x7f5f48140300 con 0x7f5f4808f500 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): my global_id is 4359 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f4813e100 con 0x7f5f4808f500 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f46d76640 1 -- 10.20.193.57:0/2525355221 >> v1:10.20.193.82:6789/0 conn(0x7f5f4808e290 legacy=0x7f5f48153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3064632492 0 0) 0x7f5f140035e0 con 0x7f5f4808ed70 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f48140300 con 0x7f5f4808ed70 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f30003450 con 0x7f5f4808ed70 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): dump: 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2112914598 0 0) 0x7f5f4813e100 con 0x7f5f4808f500 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f140035e0 con 0x7f5f4808f500 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f38005b30 con 0x7f5f4808f500 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): dump: 2026-02-12T17:28:21.706 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695955701 0 0) 0x7f5f4813f620 con 0x7f5f4808e290 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient(hunting): my global_id is 4309 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f4813e100 con 0x7f5f4808e290 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4034176801 0 0) 0x7f5f48140300 con 0x7f5f4808ed70 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 >> v1:10.20.193.82:6789/0 conn(0x7f5f4808e290 legacy=0x7f5f48153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 >> v1:10.20.193.57:6789/0 conn(0x7f5f4808f500 legacy=0x7f5f48195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 monclient: found mon.c 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4813f900 con 0x7f5f4808ed70 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f4d1c7640 5 monclient: authenticate success, global_id 4307 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f4d1c7640 10 monclient: _renew_subs 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f4d1c7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.691+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5f48141fe0 con 0x7f5f4808ed70 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f4d1c7640 10 monclient: _renew_subs 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f4d1c7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5f4813f340 con 0x7f5f4808ed70 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f30003b80 con 0x7f5f4808ed70 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f277fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f30003750 con 0x7f5f4808ed70 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f277fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f45573640 4 set_mon_vals no callback set 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f277fe640 10 monclient: dump: 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.707 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f4d1c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f4d1c7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f4d1c7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4808f2e0 con 0x7f5f4808ed70 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5f30004040 con 0x7f5f4808ed70 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.692+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f5f3004eb60 con 0x7f5f4808ed70 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.693+0000 7f5f46d76640 10 monclient: get_auth_request con 0x7f5f1403fcc0 auth_method 0 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.694+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f5f300173f0 con 0x7f5f4808ed70 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.694+0000 7f5f277fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.694+0000 7f5f277fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:21.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.740+0000 7fbb3497e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T17:28:21.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.740+0000 7fbb3497e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T17:28:21.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.740+0000 7fbb3497e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.740+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbb2c092c50 con 0x7fbb2c0906d0 2026-02-12T17:28:21.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.740+0000 7fbb16ffd640 1 -- 10.20.193.57:0/1893593044 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 555833778) 0x7fbb24016da0 con 0x7fbb2c0906d0 2026-02-12T17:28:21.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.740+0000 7fbb16ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T17:28:21.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.740+0000 7fbb16ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:21.738 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:21.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7f09f3c1b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7f09f3c1b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7f09f3c1b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f09ec08f590 con 0x7f09ec085720 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7ff5332cc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7ff5332cc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7ff5332cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff52c0561b0 con 0x7ff52c054330 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7f09da7fc640 1 -- 10.20.193.57:0/3141494844 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 555833778) 0x7f09dc016b40 con 0x7f09ec085720 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7f09da7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7f09da7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:21.740 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7ff519ffb640 1 -- 10.20.193.57:0/710976545 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 847495621) 0x7ff51c016c00 con 0x7ff52c054330 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7ff519ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.742+0000 7ff519ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stdout:47244640259 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.743+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 >> v1:10.20.193.82:6800/2441377515 conn(0x7fbafc03f660 legacy=0x7fbafc05fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.743+0000 7fbb3497e640 10 monclient: shutdown 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.743+0000 7fbb3497e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.743+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 >> v1:10.20.193.57:6790/0 conn(0x7fbb2c0906d0 legacy=0x7fbb2c12fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.743+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 shutdown_connections 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.743+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 >> 10.20.193.57:0/1893593044 conn(0x7fbb2c054330 msgr2=0x7fbb2c08c900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.743+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 shutdown_connections 2026-02-12T17:28:21.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.743+0000 7fbb3497e640 1 -- 10.20.193.57:0/1893593044 wait complete. 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 >> v1:10.20.193.82:6800/2441377515 conn(0x7f09bc03f6d0 legacy=0x7f09bc05fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7f09f3c1b640 10 monclient: shutdown 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7f09f3c1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 >> v1:10.20.193.57:6789/0 conn(0x7f09ec085720 legacy=0x7f09ec13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 shutdown_connections 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 >> 10.20.193.57:0/3141494844 conn(0x7f09ec0916b0 msgr2=0x7f09ec0572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 shutdown_connections 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7f09f3c1b640 1 -- 10.20.193.57:0/3141494844 wait complete. 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff4fc03fab0 legacy=0x7ff4fc05ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7ff5332cc640 10 monclient: shutdown 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7ff5332cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 >> v1:10.20.193.57:6789/0 conn(0x7ff52c054330 legacy=0x7ff52c153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 shutdown_connections 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 >> 10.20.193.57:0/710976545 conn(0x7ff52c08fa00 msgr2=0x7ff52c089160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 shutdown_connections 2026-02-12T17:28:21.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.745+0000 7ff5332cc640 1 -- 10.20.193.57:0/710976545 wait complete. 2026-02-12T17:28:21.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-12T17:28:21.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2026-02-12T17:28:21.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640258 for osd.1 2026-02-12T17:28:21.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.780+0000 7f3fd9683640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T17:28:21.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.780+0000 7f3fd9683640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T17:28:21.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.780+0000 7f3fd9683640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.780+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3fd4090810 con 0x7f3fd4086200 2026-02-12T17:28:21.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.780+0000 7f3fb37fe640 1 -- 10.20.193.57:0/422462094 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 555833778) 0x7f3fbc016b20 con 0x7f3fd4086200 2026-02-12T17:28:21.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.780+0000 7f3fb37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T17:28:21.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.780+0000 7f3fb37fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:21.779 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:21.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.783+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 >> v1:10.20.193.82:6800/2441377515 conn(0x7f3fa003fcc0 legacy=0x7f3fa0060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.783+0000 7f3fd9683640 10 monclient: shutdown 2026-02-12T17:28:21.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.783+0000 7f3fd9683640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.783+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 >> v1:10.20.193.57:6790/0 conn(0x7f3fd4086200 legacy=0x7f3fd421ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.783+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 shutdown_connections 2026-02-12T17:28:21.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.783+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 >> 10.20.193.57:0/422462094 conn(0x7f3fd40916b0 msgr2=0x7f3fd4057e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.783+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 shutdown_connections 2026-02-12T17:28:21.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.783+0000 7f3fd9683640 1 -- 10.20.193.57:0/422462094 wait complete. 2026-02-12T17:28:21.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.785+0000 7f31d59ed640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T17:28:21.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.785+0000 7f31d59ed640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T17:28:21.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.785+0000 7f31d59ed640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:21.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.785+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f31d0092c50 con 0x7f31d0185070 2026-02-12T17:28:21.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.785+0000 7f31a7fff640 1 -- 10.20.193.57:0/744564566 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 555833778) 0x7f31c0017b80 con 0x7f31d0185070 2026-02-12T17:28:21.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.785+0000 7f31a7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T17:28:21.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.785+0000 7f31a7fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:21.784 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:21.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.787+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 >> v1:10.20.193.82:6800/2441377515 conn(0x7f31a003fae0 legacy=0x7f31a005ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.787+0000 7f31d59ed640 10 monclient: shutdown 2026-02-12T17:28:21.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.787+0000 7f31d59ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.787+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 >> v1:10.20.193.82:6789/0 conn(0x7f31d0185070 legacy=0x7f31d0174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.787+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 shutdown_connections 2026-02-12T17:28:21.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.788+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 >> 10.20.193.57:0/744564566 conn(0x7f31d0054330 msgr2=0x7f31d008c970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.788+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 shutdown_connections 2026-02-12T17:28:21.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.788+0000 7f31d59ed640 1 -- 10.20.193.57:0/744564566 wait complete. 2026-02-12T17:28:21.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640258 for osd.2 2026-02-12T17:28:21.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640258 for osd.0 2026-02-12T17:28:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.803+0000 7f5f4d1c7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T17:28:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.803+0000 7f5f4d1c7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T17:28:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.803+0000 7f5f4d1c7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.803+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5f4805ee00 con 0x7f5f4808ed70 2026-02-12T17:28:21.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.804+0000 7f5f277fe640 1 -- 10.20.193.57:0/2525355221 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 555833778) 0x7f5f30016ba0 con 0x7f5f4808ed70 2026-02-12T17:28:21.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.804+0000 7f5f277fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T17:28:21.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.804+0000 7f5f277fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:21.802 INFO:teuthology.orchestra.run.trial057.stdout:47244640258 2026-02-12T17:28:21.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.806+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 >> v1:10.20.193.82:6800/2441377515 conn(0x7f5f1403fcc0 legacy=0x7f5f14060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.806+0000 7f5f4d1c7640 10 monclient: shutdown 2026-02-12T17:28:21.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.806+0000 7f5f4d1c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:21.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.806+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 >> v1:10.20.193.57:6790/0 conn(0x7f5f4808ed70 legacy=0x7f5f481945f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:21.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.806+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 shutdown_connections 2026-02-12T17:28:21.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.806+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 >> 10.20.193.57:0/2525355221 conn(0x7f5f48054b30 msgr2=0x7f5f48088ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:21.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.806+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 shutdown_connections 2026-02-12T17:28:21.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:21.806+0000 7f5f4d1c7640 1 -- 10.20.193.57:0/2525355221 wait complete. 2026-02-12T17:28:21.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2026-02-12T17:28:22.751 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-12T17:28:22.752 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T17:28:22.752 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T17:28:22.790 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T17:28:22.794 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T17:28:22.813 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-12T17:28:22.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f18f6379640 10 monclient: get_monmap_and_config 2026-02-12T17:28:22.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f18f6379640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f18f6379640 10 monclient: monmap: 2026-02-12T17:28:22.821 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.821 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.821 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:22.824199+0000 2026-02-12T17:28:22.822 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:22.824199+0000 2026-02-12T17:28:22.822 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.822 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.822 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.822 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:22.822 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:22.822 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f9097083640 10 monclient: get_monmap_and_config 2026-02-12T17:28:22.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f9097083640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f9097083640 10 monclient: monmap: 2026-02-12T17:28:22.823 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.823 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.823 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:22.824193+0000 2026-02-12T17:28:22.823 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:22.824193+0000 2026-02-12T17:28:22.824 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.824 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.824 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.824 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:22.824 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:22.824 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f51b0c12640 10 monclient: get_monmap_and_config 2026-02-12T17:28:22.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f51b0c12640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f51b0c12640 10 monclient: monmap: 2026-02-12T17:28:22.825 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.825 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.825 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:22.824359+0000 2026-02-12T17:28:22.825 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:22.824359+0000 2026-02-12T17:28:22.825 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.825 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.825 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.826 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:22.826 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:22.826 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f9097083640 1 Processor -- start 2026-02-12T17:28:22.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f18f6379640 1 Processor -- start 2026-02-12T17:28:22.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f9097083640 1 -- start start 2026-02-12T17:28:22.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f9097083640 10 monclient: init 2026-02-12T17:28:22.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f51b0c12640 1 Processor -- start 2026-02-12T17:28:22.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f18f6379640 1 -- start start 2026-02-12T17:28:22.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f18f6379640 10 monclient: init 2026-02-12T17:28:22.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f51b0c12640 1 -- start start 2026-02-12T17:28:22.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.823+0000 7f51b0c12640 10 monclient: init 2026-02-12T17:28:22.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:22.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 10 monclient(hunting): picked mon.noname-b con 0x7f909008d1a0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 10 monclient(hunting): picked mon.noname-a con 0x7f909008b360 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:22.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 10 monclient(hunting): picked mon.noname-c con 0x7f51ac08ad90 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 10 monclient(hunting): picked mon.noname-c con 0x7f909008dc80 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 10 monclient(hunting): picked mon.noname-a con 0x7f51ac08e9a0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 10 monclient(hunting): picked mon.noname-b con 0x7f51ac08edb0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac08b510 con 0x7f51ac08e9a0 2026-02-12T17:28:22.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:22.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac08bf60 con 0x7f51ac08ad90 2026-02-12T17:28:22.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909008e630 con 0x7f909008b360 2026-02-12T17:28:22.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909008e3b0 con 0x7f909008dc80 2026-02-12T17:28:22.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac08b160 con 0x7f51ac08edb0 2026-02-12T17:28:22.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51b0c12640 10 monclient(hunting): authenticate will time out at 582.643314s 2026-02-12T17:28:22.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 10 monclient(hunting): picked mon.noname-a con 0x7f18f00906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 10 monclient(hunting): picked mon.noname-b con 0x7f18f00911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909005eca0 con 0x7f909008d1a0 2026-02-12T17:28:22.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 10 monclient(hunting): picked mon.noname-c con 0x7f18f0185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9097083640 10 monclient(hunting): authenticate will time out at 582.643341s 2026-02-12T17:28:22.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f0090100 con 0x7f18f00906d0 2026-02-12T17:28:22.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f0091a70 con 0x7f18f0185070 2026-02-12T17:28:22.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f0092360 con 0x7f18f00911b0 2026-02-12T17:28:22.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18f6379640 10 monclient(hunting): authenticate will time out at 582.643363s 2026-02-12T17:28:22.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9087fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f909008b360 0x7f9090181ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38834/0 (socket says 10.20.193.57:38834) 2026-02-12T17:28:22.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f9087fff640 1 -- 10.20.193.57:0/3355413961 learned_addr learned my addr 10.20.193.57:0/3355413961 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51a9d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f51ac08e9a0 0x7f51ac181c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38838/0 (socket says 10.20.193.57:38838) 2026-02-12T17:28:22.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51a9d74640 1 -- 10.20.193.57:0/2766699326 learned_addr learned my addr 10.20.193.57:0/2766699326 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f51aad76640 1 --1- 10.20.193.57:0/2766699326 >> v1:10.20.193.57:6790/0 conn(0x7f51ac08edb0 0x7f51ac1a3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42796/0 (socket says 10.20.193.57:42796) 2026-02-12T17:28:22.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18effff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f18f00906d0 0x7f18f0090aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38840/0 (socket says 10.20.193.57:38840) 2026-02-12T17:28:22.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.824+0000 7f18effff640 1 -- 10.20.193.57:0/1353285864 learned_addr learned my addr 10.20.193.57:0/1353285864 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18effff640 1 -- 10.20.193.57:0/1353285864 >> v1:10.20.193.57:6789/0 conn(0x7f18f00906d0 legacy=0x7f18f0090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f9087fff640 1 -- 10.20.193.57:0/3355413961 >> v1:10.20.193.57:6789/0 conn(0x7f909008b360 legacy=0x7f9090181ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51aad76640 1 -- 10.20.193.57:0/2766699326 >> v1:10.20.193.57:6790/0 conn(0x7f51ac08edb0 legacy=0x7f51ac1a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f9094df8640 1 -- 10.20.193.57:0/3355413961 >> v1:10.20.193.57:6790/0 conn(0x7f909008d1a0 legacy=0x7f909008d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f9094df8640 1 -- 10.20.193.57:0/3355413961 >> v1:10.20.193.57:6790/0 conn(0x7f909008d1a0 legacy=0x7f909008d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-12T17:28:22.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f9094df8640 1 -- 10.20.193.57:0/3355413961 >> v1:10.20.193.57:6790/0 conn(0x7f909008d1a0 legacy=0x7f909008d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:28:22.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f9094df8640 1 --1- 10.20.193.57:0/3355413961 >> v1:10.20.193.57:6790/0 conn(0x7f909008d1a0 0x7f909008d570 :-1 s=OPENED pgs=118 gs=1 cs=1 l=1).handle_message read tag failed 2026-02-12T17:28:22.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f9094df8640 1 --1- 10.20.193.57:0/3355413961 >> v1:10.20.193.57:6790/0 conn(0x7f909008d1a0 0x7f909008d570 :-1 s=OPENED pgs=118 gs=1 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:28:22.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f90877fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.57:6790/0 2026-02-12T17:28:22.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 1 -- 10.20.193.57:0/1353285864 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4280870633 0 0) 0x7f18f0090100 con 0x7f18f00906d0 2026-02-12T17:28:22.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.841 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51aa575640 1 -- 10.20.193.57:0/2766699326 >> v1:10.20.193.82:6789/0 conn(0x7f51ac08ad90 legacy=0x7f51ac08e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient(hunting): my global_id is 4362 2026-02-12T17:28:22.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 1 -- 10.20.193.57:0/1353285864 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d40035e0 con 0x7f18f00906d0 2026-02-12T17:28:22.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609348416 0 0) 0x7f51ac08b160 con 0x7f51ac08edb0 2026-02-12T17:28:22.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 10 monclient(hunting): my global_id is 4310 2026-02-12T17:28:22.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51980035e0 con 0x7f51ac08edb0 2026-02-12T17:28:22.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f90955f9640 1 -- 10.20.193.57:0/3355413961 >> v1:10.20.193.82:6789/0 conn(0x7f909008dc80 legacy=0x7f90901a32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.844 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18f48ef640 1 -- 10.20.193.57:0/1353285864 >> v1:10.20.193.82:6789/0 conn(0x7f18f0185070 legacy=0x7f18f01a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 1 -- 10.20.193.57:0/1353285864 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3098719649 0 0) 0x7f18d40035e0 con 0x7f18f00906d0 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 1 -- 10.20.193.57:0/1353285864 >> v1:10.20.193.57:6790/0 conn(0x7f18f00911b0 legacy=0x7f18f0183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 1 -- 10.20.193.57:0/1353285864 >> v1:10.20.193.82:6789/0 conn(0x7f18f0185070 legacy=0x7f18f01a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 1 monclient: found mon.noname-a 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 1 -- 10.20.193.57:0/1353285864 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f005cf80 con 0x7f18f00906d0 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.845 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 1 -- 10.20.193.57:0/1353285864 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f18dc003150 con 0x7f18f00906d0 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18eeffd640 10 monclient: dump: 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.846 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.847 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.847 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18f6379640 5 monclient: authenticate success, global_id 4362 2026-02-12T17:28:22.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f18f6379640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:22.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3801139761 0 0) 0x7f51980035e0 con 0x7f51ac08edb0 2026-02-12T17:28:22.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 >> v1:10.20.193.82:6789/0 conn(0x7f51ac08ad90 legacy=0x7f51ac08e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 >> v1:10.20.193.57:6789/0 conn(0x7f51ac08e9a0 legacy=0x7f51ac181c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:28:22.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 1 monclient: found mon.noname-b 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.826+0000 7f51a9573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac08c490 con 0x7f51ac08edb0 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f519c0041b0 con 0x7f51ac08edb0 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 5 monclient: authenticate success, global_id 4310 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:22.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: dump: 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:22.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331153625 0 0) 0x7f51ac08bf60 con 0x7f51ac08ad90 2026-02-12T17:28:22.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:22.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18eeffd640 1 -- 10.20.193.57:0/1353285864 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f18dc0033a0 con 0x7f18f00906d0 2026-02-12T17:28:22.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18eeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18f6379640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18eeffd640 1 -- 10.20.193.57:0/1353285864 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f18dc004b10 con 0x7f18f00906d0 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18f6379640 4 set_mon_vals no callback set 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18eeffd640 10 monclient: dump: 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.852 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.853 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.853 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.853 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 -- 10.20.193.57:0/3355413961 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193163919 0 0) 0x7f909008e3b0 con 0x7f909008dc80 2026-02-12T17:28:22.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient(hunting): my global_id is 4315 2026-02-12T17:28:22.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 -- 10.20.193.57:0/3355413961 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f907c0035e0 con 0x7f909008dc80 2026-02-12T17:28:22.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f519c004440 con 0x7f51ac08edb0 2026-02-12T17:28:22.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 1 -- 10.20.193.57:0/2766699326 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f519c005980 con 0x7f51ac08edb0 2026-02-12T17:28:22.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51a9573640 10 monclient: dump: 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:22.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 4 set_mon_vals no callback set 2026-02-12T17:28:22.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 -- 10.20.193.57:0/3355413961 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3326850482 0 0) 0x7f907c0035e0 con 0x7f909008dc80 2026-02-12T17:28:22.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 -- 10.20.193.57:0/3355413961 >> v1:10.20.193.57:6790/0 conn(0x7f909008d1a0 legacy=0x7f909008d570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:22.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 -- 10.20.193.57:0/3355413961 >> v1:10.20.193.57:6789/0 conn(0x7f909008b360 legacy=0x7f9090181ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 monclient: found mon.noname-c 2026-02-12T17:28:22.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 -- 10.20.193.57:0/3355413961 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909008b7c0 con 0x7f909008dc80 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 -- 10.20.193.57:0/3355413961 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f908c004200 con 0x7f909008dc80 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f9097083640 5 monclient: authenticate success, global_id 4315 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f9097083640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18f6379640 10 monclient: shutdown 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18f6379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18f6379640 1 -- 10.20.193.57:0/1353285864 >> v1:10.20.193.57:6789/0 conn(0x7f18f00906d0 legacy=0x7f18f0090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: dump: 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.858 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.859 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.859 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f9097083640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:22.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18f6379640 1 -- 10.20.193.57:0/1353285864 shutdown_connections 2026-02-12T17:28:22.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18f6379640 1 -- 10.20.193.57:0/1353285864 >> 10.20.193.57:0/1353285864 conn(0x7f18f0054330 msgr2=0x7f18f0054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 10 monclient: shutdown 2026-02-12T17:28:22.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 1 -- 10.20.193.57:0/2766699326 >> v1:10.20.193.57:6790/0 conn(0x7f51ac08edb0 legacy=0x7f51ac1a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18f6379640 1 -- 10.20.193.57:0/1353285864 shutdown_connections 2026-02-12T17:28:22.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f18f6379640 1 -- 10.20.193.57:0/1353285864 wait complete. 2026-02-12T17:28:22.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 -- 10.20.193.57:0/3355413961 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f908c004500 con 0x7f909008dc80 2026-02-12T17:28:22.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 1 -- 10.20.193.57:0/3355413961 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f908c004960 con 0x7f909008dc80 2026-02-12T17:28:22.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f9097083640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 1 -- 10.20.193.57:0/2766699326 shutdown_connections 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f9097083640 4 set_mon_vals no callback set 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f90877fe640 10 monclient: dump: 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.861 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.862 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.862 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.862 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.862 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 1 -- 10.20.193.57:0/2766699326 >> 10.20.193.57:0/2766699326 conn(0x7f51ac054b30 msgr2=0x7f51ac093890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 1 -- 10.20.193.57:0/2766699326 shutdown_connections 2026-02-12T17:28:22.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f51b0c12640 1 -- 10.20.193.57:0/2766699326 wait complete. 2026-02-12T17:28:22.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f9097083640 10 monclient: shutdown 2026-02-12T17:28:22.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f9097083640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f9097083640 1 -- 10.20.193.57:0/3355413961 >> v1:10.20.193.82:6789/0 conn(0x7f909008dc80 legacy=0x7f90901a32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.827+0000 7f9097083640 1 -- 10.20.193.57:0/3355413961 shutdown_connections 2026-02-12T17:28:22.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f9097083640 1 -- 10.20.193.57:0/3355413961 >> 10.20.193.57:0/3355413961 conn(0x7f9090092d10 msgr2=0x7f9090093110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f9097083640 1 -- 10.20.193.57:0/3355413961 shutdown_connections 2026-02-12T17:28:22.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient: monmap: 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f9097083640 1 -- 10.20.193.57:0/3355413961 wait complete. 2026-02-12T17:28:22.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 1 Processor -- start 2026-02-12T17:28:22.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 1 -- start start 2026-02-12T17:28:22.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient: init 2026-02-12T17:28:22.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient: monmap: 2026-02-12T17:28:22.865 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.865 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:22.865 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:22.865 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f9097083640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f9097083640 10 monclient: monmap: 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient(hunting): picked mon.noname-b con 0x7f18f00906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient(hunting): picked mon.noname-c con 0x7f18f00911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient(hunting): picked mon.noname-a con 0x7f18f0185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f008b650 con 0x7f18f0185070 2026-02-12T17:28:22.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f0134040 con 0x7f18f00906d0 2026-02-12T17:28:22.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 1 Processor -- start 2026-02-12T17:28:22.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f0133b90 con 0x7f18f00911b0 2026-02-12T17:28:22.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f6379640 10 monclient(hunting): authenticate will time out at 582.647516s 2026-02-12T17:28:22.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 1 -- start start 2026-02-12T17:28:22.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient: init 2026-02-12T17:28:22.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f48ef640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f18f0185070 0x7f18f0174a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38844/0 (socket says 10.20.193.57:38844) 2026-02-12T17:28:22.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f18f48ef640 1 -- 10.20.193.57:0/3722986526 learned_addr learned my addr 10.20.193.57:0/3722986526 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f9097083640 1 Processor -- start 2026-02-12T17:28:22.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f9097083640 1 -- start start 2026-02-12T17:28:22.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f9097083640 10 monclient: init 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient(hunting): picked mon.noname-c con 0x7f51ac08ad90 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient(hunting): picked mon.noname-a con 0x7f51ac08e9a0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient(hunting): picked mon.noname-b con 0x7f51ac08edb0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac056580 con 0x7f51ac08e9a0 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac07a8b0 con 0x7f51ac08edb0 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51ac089d30 con 0x7f51ac08ad90 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.828+0000 7f51b0c12640 10 monclient(hunting): authenticate will time out at 582.647950s 2026-02-12T17:28:22.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f51aad76640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f51ac08edb0 0x7f51ac23c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:43998/0 (socket says 10.20.193.57:43998) 2026-02-12T17:28:22.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f51aad76640 1 -- 10.20.193.57:0/1001859411 learned_addr learned my addr 10.20.193.57:0/1001859411 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 10 monclient(hunting): picked mon.noname-c con 0x7f909008b360 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 10 monclient(hunting): picked mon.noname-a con 0x7f909008d1a0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 10 monclient(hunting): picked mon.noname-b con 0x7f909008dc80 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90901a3b50 con 0x7f909008d1a0 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f909007ac60 con 0x7f909008dc80 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9090087f90 con 0x7f909008b360 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f9097083640 10 monclient(hunting): authenticate will time out at 582.648179s 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f90955f9640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f909008dc80 0x7f9090239f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:44004/0 (socket says 10.20.193.57:44004) 2026-02-12T17:28:22.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.829+0000 7f90955f9640 1 -- 10.20.193.57:0/1787354268 learned_addr learned my addr 10.20.193.57:0/1787354268 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.830+0000 7f18f48ef640 1 -- 10.20.193.57:0/3722986526 >> v1:10.20.193.57:6789/0 conn(0x7f18f0185070 legacy=0x7f18f0174a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.830+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895930610 0 0) 0x7f18f008b650 con 0x7f18f0185070 2026-02-12T17:28:22.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.830+0000 7f18ecff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.830+0000 7f18ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.830+0000 7f18ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.830+0000 7f18ecff9640 10 monclient(hunting): my global_id is 4368 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.830+0000 7f18effff640 1 -- 10.20.193.57:0/3722986526 >> v1:10.20.193.82:6789/0 conn(0x7f18f00906d0 legacy=0x7f18f012fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.830+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18c00035e0 con 0x7f18f0185070 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4029499277 0 0) 0x7f18c00035e0 con 0x7f18f0185070 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18f008b650 con 0x7f18f0185070 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f18e40044c0 con 0x7f18f0185070 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ef7fe640 1 -- 10.20.193.57:0/3722986526 >> v1:10.20.193.57:6790/0 conn(0x7f18f00911b0 legacy=0x7f18f01304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient(hunting): dump: 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880689213 0 0) 0x7f18f0134040 con 0x7f18f00906d0 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient(hunting): my global_id is 4321 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18c00035e0 con 0x7f18f00906d0 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3307679229 0 0) 0x7f18f008b650 con 0x7f18f0185070 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 >> v1:10.20.193.57:6790/0 conn(0x7f18f00911b0 legacy=0x7f18f01304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 >> v1:10.20.193.82:6789/0 conn(0x7f18f00906d0 legacy=0x7f18f012fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 monclient: found mon.a 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f0130be0 con 0x7f18f0185070 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 5 monclient: authenticate success, global_id 4368 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 10 monclient: _renew_subs 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f18f0062bb0 con 0x7f18f0185070 2026-02-12T17:28:22.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 10 monclient: _renew_subs 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f18f01338b0 con 0x7f18f0185070 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f51aad76640 1 -- 10.20.193.57:0/1001859411 >> v1:10.20.193.82:6789/0 conn(0x7f51ac08edb0 legacy=0x7f51ac23c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f18e4004a60 con 0x7f18f0185070 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f18e4004db0 con 0x7f18f0185070 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 10 monclient: dump: 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.876 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ee7fc640 4 set_mon_vals no callback set 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268285118 0 0) 0x7f51ac07a8b0 con 0x7f51ac08edb0 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient(hunting): my global_id is 4324 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51780035e0 con 0x7f51ac08edb0 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90955f9640 1 -- 10.20.193.57:0/1787354268 >> v1:10.20.193.82:6789/0 conn(0x7f909008dc80 legacy=0x7f9090239f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 863130967 0 0) 0x7f51780035e0 con 0x7f51ac08edb0 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51ac07a8b0 con 0x7f51ac08edb0 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f519c0045b0 con 0x7f51ac08edb0 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.878 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192313576 0 0) 0x7f909007ac60 con 0x7f909008dc80 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 10 monclient(hunting): my global_id is 4327 2026-02-12T17:28:22.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90600035e0 con 0x7f909008dc80 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f18e4005000 con 0x7f18f0185070 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2373035806 0 0) 0x7f51ac07a8b0 con 0x7f51ac08edb0 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 >> v1:10.20.193.57:6790/0 conn(0x7f51ac08ad90 legacy=0x7f51ac1d9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 >> v1:10.20.193.57:6789/0 conn(0x7f51ac08e9a0 legacy=0x7f51ac21abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 monclient: found mon.b 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac057c70 con 0x7f51ac08edb0 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f5192ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f51b0c12640 5 monclient: authenticate success, global_id 4324 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f51b0c12640 10 monclient: _renew_subs 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f51b0c12640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac057f50 con 0x7f51ac08edb0 2026-02-12T17:28:22.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 183248739 0 0) 0x7f90600035e0 con 0x7f909008dc80 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f0143530 con 0x7f18f0185070 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f909007ac60 con 0x7f909008dc80 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f908c0047b0 con 0x7f909008dc80 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f51b0c12640 10 monclient: _renew_subs 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f51b0c12640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f51ac057990 con 0x7f51ac08edb0 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 10 monclient(hunting): dump: 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.882 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.831+0000 7f90857fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f519c005f60 con 0x7f51ac08edb0 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f5192ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f519c0062c0 con 0x7f51ac08edb0 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f5192ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f5192ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f5192ffd640 10 monclient: dump: 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.883 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f51a8d72640 4 set_mon_vals no callback set 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2489795 0 0) 0x7f909007ac60 con 0x7f909008dc80 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 >> v1:10.20.193.57:6790/0 conn(0x7f909008b360 legacy=0x7f90901d7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 >> v1:10.20.193.57:6789/0 conn(0x7f909008d1a0 legacy=0x7f90901d8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 1 monclient: found mon.b 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9090089990 con 0x7f909008dc80 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f9097083640 5 monclient: authenticate success, global_id 4327 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f9097083640 10 monclient: _renew_subs 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f9097083640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f909007a980 con 0x7f909008dc80 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f18e404fb00 con 0x7f18f0185070 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f908c004f40 con 0x7f909008dc80 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f908c0052d0 con 0x7f909008dc80 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f9086ffd640 4 set_mon_vals no callback set 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:22.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 10 monclient: dump: 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f18effff640 10 monclient: get_auth_request con 0x7f18c003f880 auth_method 0 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f9097083640 10 monclient: _renew_subs 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f9097083640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f909005c2a0 con 0x7f909008dc80 2026-02-12T17:28:22.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f51b0c12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f51b0c12640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f51b0c12640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ac05a0c0 con 0x7f51ac08edb0 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f908c005470 con 0x7f909008dc80 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.832+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f519c006550 con 0x7f51ac08edb0 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.833+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f908c04fd10 con 0x7f909008dc80 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.833+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7f519c04fd30 con 0x7f51ac08edb0 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.833+0000 7f9097083640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.833+0000 7f9097083640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.833+0000 7f9097083640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.833+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f909007b5d0 con 0x7f909008dc80 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.833+0000 7f9094df8640 10 monclient: get_auth_request con 0x7f906003f640 auth_method 0 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.833+0000 7f51aa575640 10 monclient: get_auth_request con 0x7f517803f610 auth_method 0 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.834+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f18e40183f0 con 0x7f18f0185070 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.834+0000 7f18ecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.834+0000 7f18ecff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.834+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f519c0185d0 con 0x7f51ac08edb0 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.834+0000 7f5192ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.834+0000 7f5192ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.836+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f909007b5d0 con 0x7f909008dc80 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.836+0000 7f90857fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.836+0000 7f90857fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient: get_monmap_and_config 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient: monmap: 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:22.868901+0000 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:22.868901+0000 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fc595d0c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fc595d0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fc595d0c640 10 monclient: monmap: 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:22.869112+0000 2026-02-12T17:28:22.889 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:22.869112+0000 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 1 Processor -- start 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 1 -- start start 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient: init 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient(hunting): picked mon.noname-a con 0x7fe390085720 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient(hunting): picked mon.noname-b con 0x7fe390086ea0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient(hunting): picked mon.noname-c con 0x7fe390086200 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe390088220 con 0x7fe390085720 2026-02-12T17:28:22.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe390089500 con 0x7fe390086200 2026-02-12T17:28:22.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe390087f40 con 0x7fe390086ea0 2026-02-12T17:28:22.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fc595d0c640 1 Processor -- start 2026-02-12T17:28:22.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe3984cc640 10 monclient(hunting): authenticate will time out at 582.687823s 2026-02-12T17:28:22.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fc595d0c640 1 -- start start 2026-02-12T17:28:22.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fc595d0c640 10 monclient: init 2026-02-12T17:28:22.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe396241640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe390085720 0x7fe390085af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38858/0 (socket says 10.20.193.57:38858) 2026-02-12T17:28:22.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe395a40640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe390086ea0 0x7fe390180a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42850/0 (socket says 10.20.193.57:42850) 2026-02-12T17:28:22.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.868+0000 7fe396241640 1 -- 10.20.193.57:0/342575603 learned_addr learned my addr 10.20.193.57:0/342575603 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 10 monclient(hunting): picked mon.noname-c con 0x7fc59008e290 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 10 monclient(hunting): picked mon.noname-b con 0x7fc59008f500 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 10 monclient(hunting): picked mon.noname-a con 0x7fc59008ed70 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc59008fbd0 con 0x7fc59008ed70 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc590056250 con 0x7fc59008e290 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc590056530 con 0x7fc59008f500 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.869+0000 7fc595d0c640 10 monclient(hunting): authenticate will time out at 582.688178s 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe396241640 1 -- 10.20.193.57:0/342575603 >> v1:10.20.193.57:6789/0 conn(0x7fe390085720 legacy=0x7fe390085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe395a40640 1 -- 10.20.193.57:0/342575603 >> v1:10.20.193.57:6790/0 conn(0x7fe390086ea0 legacy=0x7fe390180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fc58ffff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fc59008ed70 0x7fc5901a5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38868/0 (socket says 10.20.193.57:38868) 2026-02-12T17:28:22.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fc58ffff640 1 -- 10.20.193.57:0/3998520302 learned_addr learned my addr 10.20.193.57:0/3998520302 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820402841 0 0) 0x7fe390087f40 con 0x7fe390086ea0 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe39523f640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe39523f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe39523f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe39523f640 10 monclient(hunting): my global_id is 4316 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3780035e0 con 0x7fe390086ea0 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe396a42640 1 -- 10.20.193.57:0/342575603 >> v1:10.20.193.82:6789/0 conn(0x7fe390086200 legacy=0x7fe3901a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe395a40640 1 -- 10.20.193.57:0/342575603 >> v1:10.20.193.57:6790/0 conn(0x7fe390086ea0 legacy=0x7fe390180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe395a40640 1 -- 10.20.193.57:0/342575603 >> v1:10.20.193.57:6790/0 conn(0x7fe390086ea0 legacy=0x7fe390180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe395a40640 1 --1- 10.20.193.57:0/342575603 >> v1:10.20.193.57:6790/0 conn(0x7fe390086ea0 0x7fe390180a50 :-1 s=OPENED pgs=124 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe395a40640 1 --1- 10.20.193.57:0/342575603 >> v1:10.20.193.57:6790/0 conn(0x7fe390086ea0 0x7fe390180a50 :-1 s=OPENED pgs=124 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.871+0000 7fe39523f640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.57:6790/0 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58effd640 1 -- 10.20.193.57:0/3998520302 >> v1:10.20.193.57:6790/0 conn(0x7fc59008f500 legacy=0x7fc590183f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58ffff640 1 -- 10.20.193.57:0/3998520302 >> v1:10.20.193.57:6789/0 conn(0x7fc59008ed70 legacy=0x7fc5901a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698941467 0 0) 0x7fe390088220 con 0x7fe390085720 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient(hunting): my global_id is 4371 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe390087f40 con 0x7fe390085720 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1612864626 0 0) 0x7fc590056530 con 0x7fc59008f500 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient(hunting): my global_id is 4319 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5740035e0 con 0x7fc59008f500 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169712590 0 0) 0x7fc59008fbd0 con 0x7fc59008ed70 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient(hunting): my global_id is 4374 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc590056530 con 0x7fc59008ed70 2026-02-12T17:28:22.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58f7fe640 1 -- 10.20.193.57:0/3998520302 >> v1:10.20.193.82:6789/0 conn(0x7fc59008e290 legacy=0x7fc59008e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3313097982 0 0) 0x7fe390087f40 con 0x7fe390085720 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 >> v1:10.20.193.57:6790/0 conn(0x7fe390086ea0 legacy=0x7fe390180a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 >> v1:10.20.193.82:6789/0 conn(0x7fe390086200 legacy=0x7fe3901a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 monclient: found mon.noname-a 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3900867e0 con 0x7fe390085720 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe3800030d0 con 0x7fe390085720 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe3984cc640 5 monclient: authenticate success, global_id 4371 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe3984cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: dump: 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.895 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2883312880 0 0) 0x7fc590056530 con 0x7fc59008ed70 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 >> v1:10.20.193.57:6790/0 conn(0x7fc59008f500 legacy=0x7fc590183f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe3984cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 >> v1:10.20.193.82:6789/0 conn(0x7fc59008e290 legacy=0x7fc59008e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 monclient: found mon.noname-a 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc590056810 con 0x7fc59008ed70 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc5840041b0 con 0x7fc59008ed70 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient: dump: 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc595d0c640 5 monclient: authenticate success, global_id 4374 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc595d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe380003360 con 0x7fe390085720 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe3984cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe3984cc640 4 set_mon_vals no callback set 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 1 -- 10.20.193.57:0/342575603 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe380004b10 con 0x7fe390085720 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fe39523f640 10 monclient: dump: 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.897 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58ffff640 1 --1- 10.20.193.57:0/3998520302 >> v1:10.20.193.57:6789/0 conn(0x7fc59008ed70 0x7fc5901a5630 :-1 s=OPENED pgs=122 gs=3 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fc584005bf0 mon_map magic: 0 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5840044b0 con 0x7fc59008ed70 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc58e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc595d0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.873+0000 7fc595d0c640 4 set_mon_vals no callback set 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient: shutdown 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 -- 10.20.193.57:0/342575603 >> v1:10.20.193.57:6789/0 conn(0x7fe390085720 legacy=0x7fe390085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 -- 10.20.193.57:0/342575603 shutdown_connections 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 -- 10.20.193.57:0/342575603 >> 10.20.193.57:0/342575603 conn(0x7fe3900916b0 msgr2=0x7fe390091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 -- 10.20.193.57:0/342575603 shutdown_connections 2026-02-12T17:28:22.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 -- 10.20.193.57:0/342575603 wait complete. 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 10 monclient: shutdown 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 1 -- 10.20.193.57:0/3998520302 >> v1:10.20.193.57:6789/0 conn(0x7fc59008ed70 legacy=0x7fc5901a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc58e7fc640 1 -- 10.20.193.57:0/3998520302 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc584005bf0 con 0x7fc59008ed70 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc58e7fc640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 1 -- 10.20.193.57:0/3998520302 shutdown_connections 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 1 -- 10.20.193.57:0/3998520302 >> 10.20.193.57:0/3998520302 conn(0x7fc590054b30 msgr2=0x7fc590093890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 1 -- 10.20.193.57:0/3998520302 shutdown_connections 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 1 -- 10.20.193.57:0/3998520302 wait complete. 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient: monmap: 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 Processor -- start 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 10 monclient: monmap: 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 -- start start 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient: init 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 1 Processor -- start 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 1 -- start start 2026-02-12T17:28:22.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fc595d0c640 10 monclient: init 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient(hunting): picked mon.noname-a con 0x7fe390085720 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient(hunting): picked mon.noname-b con 0x7fe390086200 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient(hunting): picked mon.noname-c con 0x7fe390086ea0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39008acf0 con 0x7fe390085720 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39011c1b0 con 0x7fe390086200 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3900888a0 con 0x7fe390086ea0 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.874+0000 7fe3984cc640 10 monclient(hunting): authenticate will time out at 582.693952s 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fe396241640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe390085720 0x7fe39005afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38876/0 (socket says 10.20.193.57:38876) 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fe396241640 1 -- 10.20.193.57:0/2042862209 learned_addr learned my addr 10.20.193.57:0/2042862209 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 10 monclient(hunting): picked mon.noname-b con 0x7fc59008e290 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 10 monclient(hunting): picked mon.noname-a con 0x7fc59008ed70 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 10 monclient(hunting): picked mon.noname-c con 0x7fc59008f500 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc590142350 con 0x7fc59008ed70 2026-02-12T17:28:22.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc59013f5e0 con 0x7fc59008e290 2026-02-12T17:28:22.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc59013f8c0 con 0x7fc59008f500 2026-02-12T17:28:22.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.875+0000 7fc595d0c640 10 monclient(hunting): authenticate will time out at 582.694128s 2026-02-12T17:28:22.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe396241640 1 -- 10.20.193.57:0/2042862209 >> v1:10.20.193.57:6789/0 conn(0x7fe390085720 legacy=0x7fe39005afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe396a42640 1 -- 10.20.193.57:0/2042862209 >> v1:10.20.193.57:6790/0 conn(0x7fe390086ea0 legacy=0x7fe39005bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fc58effd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fc59008ed70 0x7fc5901944d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38890/0 (socket says 10.20.193.57:38890) 2026-02-12T17:28:22.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fc58effd640 1 -- 10.20.193.57:0/3783891391 learned_addr learned my addr 10.20.193.57:0/3783891391 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475094267 0 0) 0x7fe39008acf0 con 0x7fe390085720 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): my global_id is 4377 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3600035e0 con 0x7fe390085720 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 896312419 0 0) 0x7fe3900888a0 con 0x7fe390086ea0 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): my global_id is 4322 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe395a40640 1 -- 10.20.193.57:0/2042862209 >> v1:10.20.193.82:6789/0 conn(0x7fe390086200 legacy=0x7fe39005b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe39008acf0 con 0x7fe390086ea0 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2027269395 0 0) 0x7fe39008acf0 con 0x7fe390086ea0 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3900888a0 con 0x7fe390086ea0 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe38c0043a0 con 0x7fe390086ea0 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.903 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 980117248 0 0) 0x7fe3900888a0 con 0x7fe390086ea0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 >> v1:10.20.193.82:6789/0 conn(0x7fe390086200 legacy=0x7fe39005b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 >> v1:10.20.193.57:6789/0 conn(0x7fe390085720 legacy=0x7fe39005afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 monclient: found mon.c 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe390121110 con 0x7fe390086ea0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe3984cc640 5 monclient: authenticate success, global_id 4322 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe3984cc640 10 monclient: _renew_subs 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe3984cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe39005c800 con 0x7fe390086ea0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe3984cc640 10 monclient: _renew_subs 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe3984cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3901405a0 con 0x7fe390086ea0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe38c004a60 con 0x7fe390086ea0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe38c004db0 con 0x7fe390086ea0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe376ffd640 10 monclient: dump: 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.877+0000 7fe394a3e640 4 set_mon_vals no callback set 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.878+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe38c004fc0 con 0x7fe390086ea0 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.878+0000 7fe3984cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.878+0000 7fe3984cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.878+0000 7fe3984cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:22.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.878+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe390090810 con 0x7fe390086ea0 2026-02-12T17:28:22.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.878+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7fe38c04fa30 con 0x7fe390086ea0 2026-02-12T17:28:22.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.878+0000 7fe396241640 10 monclient: get_auth_request con 0x7fe36003f8c0 auth_method 0 2026-02-12T17:28:22.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc58effd640 1 -- 10.20.193.57:0/3783891391 >> v1:10.20.193.57:6789/0 conn(0x7fc59008ed70 legacy=0x7fc5901944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc58ffff640 1 -- 10.20.193.57:0/3783891391 >> v1:10.20.193.57:6790/0 conn(0x7fc59008f500 legacy=0x7fc590195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260452704 0 0) 0x7fc590142350 con 0x7fc59008ed70 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient(hunting): my global_id is 4380 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5600035e0 con 0x7fc59008ed70 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc58f7fe640 1 -- 10.20.193.57:0/3783891391 >> v1:10.20.193.82:6789/0 conn(0x7fc59008e290 legacy=0x7fc590153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 487797768 0 0) 0x7fc5600035e0 con 0x7fc59008ed70 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc590142350 con 0x7fc59008ed70 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc5800036d0 con 0x7fc59008ed70 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient(hunting): dump: 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2154342822 0 0) 0x7fc590142350 con 0x7fc59008ed70 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 >> v1:10.20.193.57:6790/0 conn(0x7fc59008f500 legacy=0x7fc590195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 >> v1:10.20.193.82:6789/0 conn(0x7fc59008e290 legacy=0x7fc590153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 monclient: found mon.a 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59013eaa0 con 0x7fc59008ed70 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc56bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc595d0c640 5 monclient: authenticate success, global_id 4380 2026-02-12T17:28:22.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc595d0c640 10 monclient: _renew_subs 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc595d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc590089e80 con 0x7fc59008ed70 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc595d0c640 10 monclient: _renew_subs 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc595d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.879+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc59013cd90 con 0x7fc59008ed70 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc580003c10 con 0x7fc59008ed70 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc56bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc580003f70 con 0x7fc59008ed70 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc56bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc56bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc56bfff640 10 monclient: dump: 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc58dffb640 4 set_mon_vals no callback set 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc595d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fc580004110 con 0x7fc59008ed70 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc595d0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc595d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc59008f2e0 con 0x7fc59008ed70 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7fc58004ebd0 con 0x7fc59008ed70 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.880+0000 7fc58f7fe640 10 monclient: get_auth_request con 0x7fc56003f6b0 auth_method 0 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.881+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe38c018320 con 0x7fe390086ea0 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.881+0000 7fe376ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.881+0000 7fe376ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:22.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.884+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fc5800043f0 con 0x7fc59008ed70 2026-02-12T17:28:22.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.884+0000 7fc56bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.884+0000 7fc56bfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.891+0000 7fa35c6cc640 10 monclient: get_monmap_and_config 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.891+0000 7fa35c6cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.891+0000 7fa35c6cc640 10 monclient: monmap: 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:22.892326+0000 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:22.892326+0000 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.891+0000 7fa35c6cc640 1 Processor -- start 2026-02-12T17:28:22.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.891+0000 7fa35c6cc640 1 -- start start 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.891+0000 7fa35c6cc640 10 monclient: init 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 10 monclient(hunting): picked mon.noname-c con 0x7fa354085720 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa354086ea0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa354086200 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa354088220 con 0x7fa354086200 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa354089500 con 0x7fa354085720 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa354087f40 con 0x7fa354086ea0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa35c6cc640 10 monclient(hunting): authenticate will time out at 582.711336s 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa359c40640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fa354086ea0 0x7fa354180a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42894/0 (socket says 10.20.193.57:42894) 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.892+0000 7fa359c40640 1 -- 10.20.193.57:0/3792306197 learned_addr learned my addr 10.20.193.57:0/3792306197 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35ac42640 1 -- 10.20.193.57:0/3792306197 >> v1:10.20.193.57:6789/0 conn(0x7fa354086200 legacy=0x7fa3541a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa359c40640 1 -- 10.20.193.57:0/3792306197 >> v1:10.20.193.57:6790/0 conn(0x7fa354086ea0 legacy=0x7fa354180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005552199 0 0) 0x7fa354088220 con 0x7fa354086200 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient(hunting): my global_id is 4383 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa33c005870 con 0x7fa354086200 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412075320 0 0) 0x7fa354087f40 con 0x7fa354086ea0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient(hunting): my global_id is 4325 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa354088220 con 0x7fa354086ea0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35a441640 1 -- 10.20.193.57:0/3792306197 >> v1:10.20.193.82:6789/0 conn(0x7fa354085720 legacy=0x7fa354085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1861791173 0 0) 0x7fa33c005870 con 0x7fa354086200 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 >> v1:10.20.193.57:6790/0 conn(0x7fa354086ea0 legacy=0x7fa354180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 >> v1:10.20.193.82:6789/0 conn(0x7fa354085720 legacy=0x7fa354085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 monclient: found mon.noname-a 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3540867e0 con 0x7fa354086200 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa350004280 con 0x7fa354086200 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:22.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35943f640 10 monclient: dump: 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35c6cc640 5 monclient: authenticate success, global_id 4383 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.894+0000 7fa35c6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3500044d0 con 0x7fa354086200 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35943f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35c6cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35c6cc640 4 set_mon_vals no callback set 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35943f640 1 -- 10.20.193.57:0/3792306197 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa350004960 con 0x7fa354086200 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35943f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35943f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35943f640 10 monclient: dump: 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35c6cc640 10 monclient: shutdown 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35c6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35c6cc640 1 -- 10.20.193.57:0/3792306197 >> v1:10.20.193.57:6789/0 conn(0x7fa354086200 legacy=0x7fa3541a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35c6cc640 1 -- 10.20.193.57:0/3792306197 shutdown_connections 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35c6cc640 1 -- 10.20.193.57:0/3792306197 >> 10.20.193.57:0/3792306197 conn(0x7fa3540916b0 msgr2=0x7fa354091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35c6cc640 1 -- 10.20.193.57:0/3792306197 shutdown_connections 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.895+0000 7fa35c6cc640 1 -- 10.20.193.57:0/3792306197 wait complete. 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient: monmap: 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:22.912 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 1 Processor -- start 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 1 -- start start 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient: init 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa354085720 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient(hunting): picked mon.noname-c con 0x7fa354086200 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa354086ea0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35411c080 con 0x7fa354085720 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35405c2e0 con 0x7fa354086ea0 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa35408ad60 con 0x7fa354086200 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35c6cc640 10 monclient(hunting): authenticate will time out at 582.715561s 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35a441640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fa354085720 0x7fa35405a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38910/0 (socket says 10.20.193.57:38910) 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.896+0000 7fa35a441640 1 -- 10.20.193.57:0/1769494025 learned_addr learned my addr 10.20.193.57:0/1769494025 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa35a441640 1 -- 10.20.193.57:0/1769494025 >> v1:10.20.193.57:6789/0 conn(0x7fa354085720 legacy=0x7fa35405a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa359c40640 1 -- 10.20.193.57:0/1769494025 >> v1:10.20.193.57:6790/0 conn(0x7fa354086200 legacy=0x7fa35405b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa35ac42640 1 -- 10.20.193.57:0/1769494025 >> v1:10.20.193.82:6789/0 conn(0x7fa354086ea0 legacy=0x7fa35405b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274167539 0 0) 0x7fa35411c080 con 0x7fa354085720 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 10 monclient(hunting): my global_id is 4386 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3240035e0 con 0x7fa354085720 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282344909 0 0) 0x7fa35408ad60 con 0x7fa354086200 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 10 monclient(hunting): my global_id is 4328 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.898+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35411c080 con 0x7fa354086200 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015153182 0 0) 0x7fa35405c2e0 con 0x7fa354086ea0 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): my global_id is 4345 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa35408ad60 con 0x7fa354086ea0 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2643399899 0 0) 0x7fa3240035e0 con 0x7fa354085720 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa35405c2e0 con 0x7fa354085720 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 875126215 0 0) 0x7fa35411c080 con 0x7fa354086200 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3240035e0 con 0x7fa354086200 2026-02-12T17:28:22.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa348003510 con 0x7fa354086200 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): dump: 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa344003460 con 0x7fa354085720 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): dump: 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2769363350 0 0) 0x7fa35408ad60 con 0x7fa354086ea0 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa35411c080 con 0x7fa354086ea0 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa350004280 con 0x7fa354086ea0 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient(hunting): dump: 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.914 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3856267314 0 0) 0x7fa35405c2e0 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 >> v1:10.20.193.57:6790/0 conn(0x7fa354086200 legacy=0x7fa35405b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 >> v1:10.20.193.82:6789/0 conn(0x7fa354086ea0 legacy=0x7fa35405b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 monclient: found mon.a 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3540888a0 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient: _finish_auth 0 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa35c6cc640 5 monclient: authenticate success, global_id 4386 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa35c6cc640 10 monclient: _renew_subs 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa35c6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa35411bac0 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa35c6cc640 10 monclient: _renew_subs 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa35c6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa35405c780 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa344003980 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa344003cd0 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa33affd640 10 monclient: dump: 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.899+0000 7fa358c3e640 4 set_mon_vals no callback set 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.900+0000 7fa35c6cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.900+0000 7fa35c6cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.900+0000 7fa35c6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.900+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa354090810 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.900+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fa344003e70 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.900+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7fa34404ea80 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.900+0000 7fa359c40640 10 monclient: get_auth_request con 0x7fa32403ff90 auth_method 0 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.902+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa344004510 con 0x7fa354085720 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.902+0000 7fa33affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:22.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.902+0000 7fa33affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:22.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.943+0000 7f18f6379640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T17:28:22.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.943+0000 7f18f6379640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T17:28:22.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.943+0000 7f18f6379640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.943+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f18f0055340 con 0x7f18f0185070 2026-02-12T17:28:22.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.944+0000 7f18ecff9640 1 -- 10.20.193.57:0/3722986526 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 1444633209) 0x7f18e4017ba0 con 0x7f18f0185070 2026-02-12T17:28:22.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.944+0000 7f18ecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T17:28:22.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.944+0000 7f18ecff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:22.941 INFO:teuthology.orchestra.run.trial057.stdout:47244640260 2026-02-12T17:28:22.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.946+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 >> v1:10.20.193.82:6800/2441377515 conn(0x7f18c003f880 legacy=0x7f18c005fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.946+0000 7f18f6379640 10 monclient: shutdown 2026-02-12T17:28:22.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.946+0000 7f18f6379640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.946+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 >> v1:10.20.193.57:6789/0 conn(0x7f18f0185070 legacy=0x7f18f0174a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.946+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 shutdown_connections 2026-02-12T17:28:22.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.946+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 >> 10.20.193.57:0/3722986526 conn(0x7f18f0054330 msgr2=0x7f18f008f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.946+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 shutdown_connections 2026-02-12T17:28:22.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.946+0000 7f18f6379640 1 -- 10.20.193.57:0/3722986526 wait complete. 2026-02-12T17:28:22.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.950+0000 7f51b0c12640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T17:28:22.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.950+0000 7f51b0c12640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T17:28:22.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.950+0000 7f51b0c12640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.950+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f51ac055340 con 0x7f51ac08edb0 2026-02-12T17:28:22.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.951+0000 7f5192ffd640 1 -- 10.20.193.57:0/1001859411 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1444633209) 0x7f519c04cc90 con 0x7f51ac08edb0 2026-02-12T17:28:22.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.951+0000 7f5192ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T17:28:22.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.951+0000 7f5192ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:22.948 INFO:teuthology.orchestra.run.trial057.stdout:47244640260 2026-02-12T17:28:22.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.952+0000 7f9097083640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T17:28:22.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.952+0000 7f9097083640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T17:28:22.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.952+0000 7f9097083640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:22.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.952+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f909007b5d0 con 0x7f909008dc80 2026-02-12T17:28:22.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.952+0000 7f90857fa640 1 -- 10.20.193.57:0/1787354268 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 1169801742) 0x7f909007b5d0 con 0x7f909008dc80 2026-02-12T17:28:22.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.952+0000 7f90857fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T17:28:22.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.952+0000 7f90857fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:22.950 INFO:teuthology.orchestra.run.trial057.stdout:47244640261 2026-02-12T17:28:22.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.953+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 >> v1:10.20.193.82:6800/2441377515 conn(0x7f517803f610 legacy=0x7f517805fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.953+0000 7f51b0c12640 10 monclient: shutdown 2026-02-12T17:28:22.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.953+0000 7f51b0c12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.953+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 >> v1:10.20.193.82:6789/0 conn(0x7f51ac08edb0 legacy=0x7f51ac23c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.953+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 shutdown_connections 2026-02-12T17:28:22.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.953+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 >> 10.20.193.57:0/1001859411 conn(0x7f51ac054b30 msgr2=0x7f51ac088fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.953+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 shutdown_connections 2026-02-12T17:28:22.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.953+0000 7f51b0c12640 1 -- 10.20.193.57:0/1001859411 wait complete. 2026-02-12T17:28:22.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.1 2026-02-12T17:28:22.953 DEBUG:teuthology.parallel:result is None 2026-02-12T17:28:22.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.955+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 >> v1:10.20.193.82:6800/2441377515 conn(0x7f906003f640 legacy=0x7f906005faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.955+0000 7f9097083640 10 monclient: shutdown 2026-02-12T17:28:22.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.955+0000 7f9097083640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.955+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 >> v1:10.20.193.82:6789/0 conn(0x7f909008dc80 legacy=0x7f9090239f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.955+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 shutdown_connections 2026-02-12T17:28:22.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.955+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 >> 10.20.193.57:0/1787354268 conn(0x7f9090092d10 msgr2=0x7f9090087300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.955+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 shutdown_connections 2026-02-12T17:28:22.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.955+0000 7f9097083640 1 -- 10.20.193.57:0/1787354268 wait complete. 2026-02-12T17:28:22.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.4 2026-02-12T17:28:22.959 DEBUG:teuthology.parallel:result is None 2026-02-12T17:28:22.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640261 for osd.3 2026-02-12T17:28:22.961 DEBUG:teuthology.parallel:result is None 2026-02-12T17:28:22.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fe3984cc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T17:28:22.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fe3984cc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T17:28:22.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fe3984cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:22.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe390122840 con 0x7fe390086ea0 2026-02-12T17:28:22.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fc595d0c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T17:28:22.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fc595d0c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T17:28:22.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fc595d0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:22.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc59005ee00 con 0x7fc59008ed70 2026-02-12T17:28:22.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fe376ffd640 1 -- 10.20.193.57:0/2042862209 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 1444633209) 0x7fe38c017ad0 con 0x7fe390086ea0 2026-02-12T17:28:22.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fe376ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T17:28:22.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fe376ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:22.993 INFO:teuthology.orchestra.run.trial057.stdout:47244640260 2026-02-12T17:28:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fc56bfff640 1 -- 10.20.193.57:0/3783891391 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 1444633209) 0x7fc580016c10 con 0x7fc59008ed70 2026-02-12T17:28:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fc56bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T17:28:22.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.994+0000 7fc56bfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:22.994 INFO:teuthology.orchestra.run.trial057.stdout:47244640260 2026-02-12T17:28:22.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.996+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe36003f8c0 legacy=0x7fe36005fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.996+0000 7fe3984cc640 10 monclient: shutdown 2026-02-12T17:28:22.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.996+0000 7fe3984cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.996+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 >> v1:10.20.193.57:6790/0 conn(0x7fe390086ea0 legacy=0x7fe39005bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.996+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 shutdown_connections 2026-02-12T17:28:22.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.996+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 >> 10.20.193.57:0/2042862209 conn(0x7fe3900916b0 msgr2=0x7fe39008e190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 shutdown_connections 2026-02-12T17:28:22.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fe3984cc640 1 -- 10.20.193.57:0/2042862209 wait complete. 2026-02-12T17:28:22.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 >> v1:10.20.193.82:6800/2441377515 conn(0x7fc56003f6b0 legacy=0x7fc56005fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fc595d0c640 10 monclient: shutdown 2026-02-12T17:28:22.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fc595d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:22.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 >> v1:10.20.193.57:6789/0 conn(0x7fc59008ed70 legacy=0x7fc5901944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:22.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 shutdown_connections 2026-02-12T17:28:22.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 >> 10.20.193.57:0/3783891391 conn(0x7fc590054b30 msgr2=0x7fc590088d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:22.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 shutdown_connections 2026-02-12T17:28:22.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:22.997+0000 7fc595d0c640 1 -- 10.20.193.57:0/3783891391 wait complete. 2026-02-12T17:28:23.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.0 2026-02-12T17:28:23.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.2 2026-02-12T17:28:23.003 DEBUG:teuthology.parallel:result is None 2026-02-12T17:28:23.003 DEBUG:teuthology.parallel:result is None 2026-02-12T17:28:23.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.019+0000 7fa35c6cc640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T17:28:23.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.019+0000 7fa35c6cc640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T17:28:23.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.019+0000 7fa35c6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:23.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.019+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa35405d580 con 0x7fa354085720 2026-02-12T17:28:23.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.019+0000 7fa33affd640 1 -- 10.20.193.57:0/1769494025 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1444633209) 0x7fa344016b20 con 0x7fa354085720 2026-02-12T17:28:23.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.019+0000 7fa33affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T17:28:23.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.019+0000 7fa33affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:23.018 INFO:teuthology.orchestra.run.trial057.stdout:47244640260 2026-02-12T17:28:23.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.021+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 >> v1:10.20.193.82:6800/2441377515 conn(0x7fa32403ff90 legacy=0x7fa324060440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.021+0000 7fa35c6cc640 10 monclient: shutdown 2026-02-12T17:28:23.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.021+0000 7fa35c6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.021+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 >> v1:10.20.193.57:6789/0 conn(0x7fa354085720 legacy=0x7fa35405a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.021+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 shutdown_connections 2026-02-12T17:28:23.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.021+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 >> 10.20.193.57:0/1769494025 conn(0x7fa3540916b0 msgr2=0x7fa35408e190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.022+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 shutdown_connections 2026-02-12T17:28:23.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.022+0000 7fa35c6cc640 1 -- 10.20.193.57:0/1769494025 wait complete. 2026-02-12T17:28:23.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.5 2026-02-12T17:28:23.029 DEBUG:teuthology.parallel:result is None 2026-02-12T17:28:23.029 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T17:28:23.029 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:28:23.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient: monmap: 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:23.137007+0000 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:23.137007+0000 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.134 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:23.135 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:23.135 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 1 Processor -- start 2026-02-12T17:28:23.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 1 -- start start 2026-02-12T17:28:23.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient: init 2026-02-12T17:28:23.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:23.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient(hunting): picked mon.noname-c con 0x7fda7408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient(hunting): picked mon.noname-a con 0x7fda7408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient(hunting): picked mon.noname-b con 0x7fda7408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda7408d600 con 0x7fda7408c730 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda7408b1f0 con 0x7fda7408ae20 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda7408d1f0 con 0x7fda7408cb30 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.136+0000 7fda7a28c640 10 monclient(hunting): authenticate will time out at 582.955907s 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.137+0000 7fda78802640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fda7408cb30 0x7fda741a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45584/0 (socket says 10.20.193.57:45584) 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.137+0000 7fda78802640 1 -- 10.20.193.57:0/3471585370 learned_addr learned my addr 10.20.193.57:0/3471585370 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.137+0000 7fda737fe640 1 --1- 10.20.193.57:0/3471585370 >> v1:10.20.193.57:6789/0 conn(0x7fda7408c730 0x7fda74181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36118/0 (socket says 10.20.193.57:36118) 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda78802640 1 -- 10.20.193.57:0/3471585370 >> v1:10.20.193.57:6790/0 conn(0x7fda7408cb30 legacy=0x7fda741a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda737fe640 1 -- 10.20.193.57:0/3471585370 >> v1:10.20.193.57:6789/0 conn(0x7fda7408c730 legacy=0x7fda74181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810365001 0 0) 0x7fda7408d1f0 con 0x7fda7408cb30 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): my global_id is 4331 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda73fff640 1 -- 10.20.193.57:0/3471585370 >> v1:10.20.193.82:6789/0 conn(0x7fda7408ae20 legacy=0x7fda7408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda580035e0 con 0x7fda7408cb30 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721253654 0 0) 0x7fda7408d600 con 0x7fda7408c730 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): my global_id is 4389 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda7408d1f0 con 0x7fda7408c730 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797961993 0 0) 0x7fda7408b1f0 con 0x7fda7408ae20 2026-02-12T17:28:23.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient(hunting): my global_id is 4348 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda7408d600 con 0x7fda7408ae20 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4226613333 0 0) 0x7fda580035e0 con 0x7fda7408cb30 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 >> v1:10.20.193.82:6789/0 conn(0x7fda7408ae20 legacy=0x7fda7408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 >> v1:10.20.193.57:6789/0 conn(0x7fda7408c730 legacy=0x7fda74181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 monclient: found mon.noname-b 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda74057320 con 0x7fda7408cb30 2026-02-12T17:28:23.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda7a28c640 5 monclient: authenticate success, global_id 4331 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fda68004220 con 0x7fda7408cb30 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda7a28c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient: dump: 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.148 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda7a28c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda78802640 1 --1- 10.20.193.57:0/3471585370 >> v1:10.20.193.57:6790/0 conn(0x7fda7408cb30 0x7fda741a3310 :-1 s=OPENED pgs=130 gs=3 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fda68005bf0 mon_map magic: 0 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda68004470 con 0x7fda7408cb30 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda7a28c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda7a28c640 4 set_mon_vals no callback set 2026-02-12T17:28:23.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda7a28c640 10 monclient: shutdown 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda7a28c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda7a28c640 1 -- 10.20.193.57:0/3471585370 >> v1:10.20.193.57:6790/0 conn(0x7fda7408cb30 legacy=0x7fda741a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 1 -- 10.20.193.57:0/3471585370 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fda68005bf0 con 0x7fda7408cb30 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.139+0000 7fda72ffd640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 1 -- 10.20.193.57:0/3471585370 shutdown_connections 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 1 -- 10.20.193.57:0/3471585370 >> 10.20.193.57:0/3471585370 conn(0x7fda74091620 msgr2=0x7fda74091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 1 -- 10.20.193.57:0/3471585370 shutdown_connections 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 1 -- 10.20.193.57:0/3471585370 wait complete. 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient: monmap: 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:23.150 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 1 Processor -- start 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 1 -- start start 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient: init 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:23.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient(hunting): picked mon.noname-a con 0x7fda7408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient(hunting): picked mon.noname-c con 0x7fda7408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient(hunting): picked mon.noname-b con 0x7fda7408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda7408d9c0 con 0x7fda7408ae20 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda7411ab10 con 0x7fda7408cb30 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda74088810 con 0x7fda7408c730 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.140+0000 7fda7a28c640 10 monclient(hunting): authenticate will time out at 582.959982s 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.141+0000 7fda737fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fda7408c730 0x7fda74118360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45590/0 (socket says 10.20.193.57:45590) 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.141+0000 7fda737fe640 1 -- 10.20.193.57:0/4255391463 learned_addr learned my addr 10.20.193.57:0/4255391463 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda737fe640 1 -- 10.20.193.57:0/4255391463 >> v1:10.20.193.57:6790/0 conn(0x7fda7408c730 legacy=0x7fda74118360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda73fff640 1 -- 10.20.193.57:0/4255391463 >> v1:10.20.193.57:6789/0 conn(0x7fda7408ae20 legacy=0x7fda74117c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057049581 0 0) 0x7fda74088810 con 0x7fda7408c730 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): my global_id is 4334 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda440035e0 con 0x7fda7408c730 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470106209 0 0) 0x7fda7408d9c0 con 0x7fda7408ae20 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): my global_id is 4392 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda74088810 con 0x7fda7408ae20 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda78802640 1 -- 10.20.193.57:0/4255391463 >> v1:10.20.193.82:6789/0 conn(0x7fda7408cb30 legacy=0x7fda741a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2447536773 0 0) 0x7fda440035e0 con 0x7fda7408c730 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda7408d9c0 con 0x7fda7408c730 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fda640033e0 con 0x7fda7408c730 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): dump: 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.154 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3248009484 0 0) 0x7fda74088810 con 0x7fda7408ae20 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda440035e0 con 0x7fda7408ae20 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fda600032f0 con 0x7fda7408ae20 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): dump: 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.155 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3628755606 0 0) 0x7fda7411ab10 con 0x7fda7408cb30 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient(hunting): my global_id is 4351 2026-02-12T17:28:23.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda74088810 con 0x7fda7408cb30 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 325070832 0 0) 0x7fda7408d9c0 con 0x7fda7408c730 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 >> v1:10.20.193.82:6789/0 conn(0x7fda7408cb30 legacy=0x7fda741a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 >> v1:10.20.193.57:6789/0 conn(0x7fda7408ae20 legacy=0x7fda74117c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 monclient: found mon.c 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda74118fd0 con 0x7fda7408c730 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda7a28c640 5 monclient: authenticate success, global_id 4334 2026-02-12T17:28:23.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda7a28c640 10 monclient: _renew_subs 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda7a28c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda74119620 con 0x7fda7408c730 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda7a28c640 10 monclient: _renew_subs 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda7a28c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fda7411ba30 con 0x7fda7408c730 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda64004b50 con 0x7fda7408c730 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fda64004eb0 con 0x7fda7408c730 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda70ff9640 10 monclient: dump: 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.158 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.143+0000 7fda727fc640 4 set_mon_vals no callback set 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.144+0000 7fda7a28c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.144+0000 7fda7a28c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.144+0000 7fda7a28c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.144+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda740008d0 con 0x7fda7408c730 2026-02-12T17:28:23.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.144+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fda64005140 con 0x7fda7408c730 2026-02-12T17:28:23.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.144+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7fda6404eb60 con 0x7fda7408c730 2026-02-12T17:28:23.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.144+0000 7fda73fff640 10 monclient: get_auth_request con 0x7fda4403fce0 auth_method 0 2026-02-12T17:28:23.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.146+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fda64017390 con 0x7fda7408c730 2026-02-12T17:28:23.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.146+0000 7fda70ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.146+0000 7fda70ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:23.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.255+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda7408d840 con 0x7fda4403fce0 2026-02-12T17:28:23.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.256+0000 7fda70ff9640 1 -- 10.20.193.57:0/4255391463 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34112 (unknown 2965378022 0 945856403) 0x7fda600079b0 con 0x7fda4403fce0 2026-02-12T17:28:23.254 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:23.255 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:28:23.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.257+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 >> v1:10.20.193.82:6800/2441377515 conn(0x7fda4403fce0 legacy=0x7fda44060190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.257+0000 7fda7a28c640 10 monclient: shutdown 2026-02-12T17:28:23.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.257+0000 7fda7a28c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.257+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 >> v1:10.20.193.57:6790/0 conn(0x7fda7408c730 legacy=0x7fda74118360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.257+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 shutdown_connections 2026-02-12T17:28:23.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.257+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 >> 10.20.193.57:0/4255391463 conn(0x7fda74091620 msgr2=0x7fda740597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.257+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 shutdown_connections 2026-02-12T17:28:23.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.257+0000 7fda7a28c640 1 -- 10.20.193.57:0/4255391463 wait complete. 2026-02-12T17:28:23.263 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-12T17:28:21.827773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163704,"kb_used_data":1944,"kb_used_omap":48,"kb_used_meta":161615,"kb_avail":566067336,"statfs":{"total":579820584960,"available":579652952064,"internally_reserved":0,"allocated":1990656,"data_stored":1342726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50048,"internal_metadata":165493888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.797651"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724309+0000","last_change":"2026-02-12T17:28:19.724309+0000","last_active":"2026-02-12T17:28:19.724309+0000","last_peered":"2026-02-12T17:28:19.724309+0000","last_clean":"2026-02-12T17:28:19.724309+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:28:19.724309+0000","last_undegraded":"2026-02-12T17:28:19.724309+0000","last_fullsized":"2026-02-12T17:28:19.724309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:21:16.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.289150+0000","last_change":"2026-02-12T17:28:19.289150+0000","last_active":"2026-02-12T17:28:19.289150+0000","last_peered":"2026-02-12T17:28:19.289150+0000","last_clean":"2026-02-12T17:28:19.289150+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:28:19.289150+0000","last_undegraded":"2026-02-12T17:28:19.289150+0000","last_fullsized":"2026-02-12T17:28:19.289150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:34:03.582232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724251+0000","last_change":"2026-02-12T17:28:19.724251+0000","last_active":"2026-02-12T17:28:19.724251+0000","last_peered":"2026-02-12T17:28:19.724251+0000","last_clean":"2026-02-12T17:28:19.724251+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:28:19.724251+0000","last_undegraded":"2026-02-12T17:28:19.724251+0000","last_fullsized":"2026-02-12T17:28:19.724251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:31:06.358030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.289250+0000","last_change":"2026-02-12T17:28:19.289250+0000","last_active":"2026-02-12T17:28:19.289250+0000","last_peered":"2026-02-12T17:28:19.289250+0000","last_clean":"2026-02-12T17:28:19.289250+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:28:19.289250+0000","last_undegraded":"2026-02-12T17:28:19.289250+0000","last_fullsized":"2026-02-12T17:28:19.289250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:19:32.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.284665+0000","last_change":"2026-02-12T17:28:19.283404+0000","last_active":"2026-02-12T17:28:19.284665+0000","last_peered":"2026-02-12T17:28:19.284665+0000","last_clean":"2026-02-12T17:28:19.284665+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:28:19.284665+0000","last_undegraded":"2026-02-12T17:28:19.284665+0000","last_fullsized":"2026-02-12T17:28:19.284665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:24:22.204036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.286905+0000","last_change":"2026-02-12T17:28:19.286905+0000","last_active":"2026-02-12T17:28:19.286905+0000","last_peered":"2026-02-12T17:28:19.286905+0000","last_clean":"2026-02-12T17:28:19.286905+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:28:19.286905+0000","last_undegraded":"2026-02-12T17:28:19.286905+0000","last_fullsized":"2026-02-12T17:28:19.286905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:35.531511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724210+0000","last_change":"2026-02-12T17:28:19.724210+0000","last_active":"2026-02-12T17:28:19.724210+0000","last_peered":"2026-02-12T17:28:19.724210+0000","last_clean":"2026-02-12T17:28:19.724210+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:28:19.724210+0000","last_undegraded":"2026-02-12T17:28:19.724210+0000","last_fullsized":"2026-02-12T17:28:19.724210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:54.193528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.283491+0000","last_change":"2026-02-12T17:28:19.283491+0000","last_active":"2026-02-12T17:28:19.283491+0000","last_peered":"2026-02-12T17:28:19.283491+0000","last_clean":"2026-02-12T17:28:19.283491+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:28:19.283491+0000","last_undegraded":"2026-02-12T17:28:19.283491+0000","last_fullsized":"2026-02-12T17:28:19.283491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:53.711374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.723942+0000","last_change":"2026-02-12T17:28:13.575533+0000","last_active":"2026-02-12T17:28:19.723942+0000","last_peered":"2026-02-12T17:28:19.723942+0000","last_clean":"2026-02-12T17:28:19.723942+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:28:19.723942+0000","last_undegraded":"2026-02-12T17:28:19.723942+0000","last_fullsized":"2026-02-12T17:28:19.723942+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_clean_scrub_stamp":"2026-02-12T17:28:11.958332+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:10:01.188074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":44720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":672,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":688128,"data_stored":577776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":664,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":679936,"data_stored":573648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:28:23.264 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:28:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.331+0000 7ffb9110c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.331+0000 7ffb9110c640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.331+0000 7ffb9110c640 10 monclient: monmap: 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:23.332309+0000 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:23.332309+0000 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.331+0000 7ffb9110c640 1 Processor -- start 2026-02-12T17:28:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.331+0000 7ffb9110c640 1 -- start start 2026-02-12T17:28:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.331+0000 7ffb9110c640 10 monclient: init 2026-02-12T17:28:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 10 monclient(hunting): picked mon.noname-a con 0x7ffb8c08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 10 monclient(hunting): picked mon.noname-c con 0x7ffb8c08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 10 monclient(hunting): picked mon.noname-b con 0x7ffb8c08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c08d600 con 0x7ffb8c08ae20 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c08b1f0 con 0x7ffb8c08c730 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c08d1f0 con 0x7ffb8c08cb30 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb9110c640 10 monclient(hunting): authenticate will time out at 583.151223s 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb8b577640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ffb8c08cb30 0x7ffb8c1a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45606/0 (socket says 10.20.193.57:45606) 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.332+0000 7ffb8b577640 1 -- 10.20.193.57:0/2232876741 learned_addr learned my addr 10.20.193.57:0/2232876741 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb8b577640 1 -- 10.20.193.57:0/2232876741 >> v1:10.20.193.57:6790/0 conn(0x7ffb8c08cb30 legacy=0x7ffb8c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb8ad76640 1 -- 10.20.193.57:0/2232876741 >> v1:10.20.193.57:6789/0 conn(0x7ffb8c08ae20 legacy=0x7ffb8c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937712473 0 0) 0x7ffb8c08d1f0 con 0x7ffb8c08cb30 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient(hunting): my global_id is 4337 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb780035e0 con 0x7ffb8c08cb30 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570733233 0 0) 0x7ffb8c08d600 con 0x7ffb8c08ae20 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient(hunting): my global_id is 4395 2026-02-12T17:28:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb8c08d1f0 con 0x7ffb8c08ae20 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb8a575640 1 -- 10.20.193.57:0/2232876741 >> v1:10.20.193.82:6789/0 conn(0x7ffb8c08c730 legacy=0x7ffb8c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1743019377 0 0) 0x7ffb780035e0 con 0x7ffb8c08cb30 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 >> v1:10.20.193.82:6789/0 conn(0x7ffb8c08c730 legacy=0x7ffb8c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 >> v1:10.20.193.57:6789/0 conn(0x7ffb8c08ae20 legacy=0x7ffb8c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 monclient: found mon.noname-b 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c057320 con 0x7ffb8c08cb30 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffb7c0041a0 con 0x7ffb8c08cb30 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb9110c640 5 monclient: authenticate success, global_id 4337 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb9110c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb89d74640 10 monclient: dump: 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.343 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.334+0000 7ffb9110c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb7c004430 con 0x7ffb8c08cb30 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb89d74640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb89d74640 1 -- 10.20.193.57:0/2232876741 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffb7c005a40 con 0x7ffb8c08cb30 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 4 set_mon_vals no callback set 2026-02-12T17:28:23.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb89d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb89d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb89d74640 10 monclient: dump: 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.345 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 10 monclient: shutdown 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 1 -- 10.20.193.57:0/2232876741 >> v1:10.20.193.57:6790/0 conn(0x7ffb8c08cb30 legacy=0x7ffb8c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 1 -- 10.20.193.57:0/2232876741 shutdown_connections 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 1 -- 10.20.193.57:0/2232876741 >> 10.20.193.57:0/2232876741 conn(0x7ffb8c091620 msgr2=0x7ffb8c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 1 -- 10.20.193.57:0/2232876741 shutdown_connections 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 1 -- 10.20.193.57:0/2232876741 wait complete. 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 10 monclient: monmap: 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:23.346 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.335+0000 7ffb9110c640 1 Processor -- start 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 1 -- start start 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 10 monclient: init 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 10 monclient(hunting): picked mon.noname-c con 0x7ffb8c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 10 monclient(hunting): picked mon.noname-a con 0x7ffb8c08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 10 monclient(hunting): picked mon.noname-b con 0x7ffb8c08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c08d9c0 con 0x7ffb8c08c730 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c088810 con 0x7ffb8c08cb30 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8c07a500 con 0x7ffb8c08ae20 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb9110c640 10 monclient(hunting): authenticate will time out at 583.155284s 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb8ad76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ffb8c08ae20 0x7ffb8c086aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45616/0 (socket says 10.20.193.57:45616) 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.336+0000 7ffb8ad76640 1 -- 10.20.193.57:0/82215975 learned_addr learned my addr 10.20.193.57:0/82215975 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb8ad76640 1 -- 10.20.193.57:0/82215975 >> v1:10.20.193.57:6790/0 conn(0x7ffb8c08ae20 legacy=0x7ffb8c086aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb8a575640 1 -- 10.20.193.57:0/82215975 >> v1:10.20.193.57:6789/0 conn(0x7ffb8c08c730 legacy=0x7ffb8c194230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489567672 0 0) 0x7ffb8c07a500 con 0x7ffb8c08ae20 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): my global_id is 4340 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb580035e0 con 0x7ffb8c08ae20 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4055314280 0 0) 0x7ffb8c08d9c0 con 0x7ffb8c08c730 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): my global_id is 4398 2026-02-12T17:28:23.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb8c07a500 con 0x7ffb8c08c730 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb8b577640 1 -- 10.20.193.57:0/82215975 >> v1:10.20.193.82:6789/0 conn(0x7ffb8c08cb30 legacy=0x7ffb8c195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2325252699 0 0) 0x7ffb580035e0 con 0x7ffb8c08ae20 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb8c08d9c0 con 0x7ffb8c08ae20 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffb80003330 con 0x7ffb8c08ae20 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): dump: 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.350 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2252133426 0 0) 0x7ffb8c07a500 con 0x7ffb8c08c730 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb580035e0 con 0x7ffb8c08c730 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffb74003340 con 0x7ffb8c08c730 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient(hunting): dump: 2026-02-12T17:28:23.351 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1605461725 0 0) 0x7ffb8c08d9c0 con 0x7ffb8c08ae20 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 >> v1:10.20.193.82:6789/0 conn(0x7ffb8c08cb30 legacy=0x7ffb8c195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 >> v1:10.20.193.57:6789/0 conn(0x7ffb8c08c730 legacy=0x7ffb8c194230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 monclient: found mon.c 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8c05ac30 con 0x7ffb8c08ae20 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb9110c640 5 monclient: authenticate success, global_id 4340 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb9110c640 10 monclient: _renew_subs 2026-02-12T17:28:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb9110c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8c153580 con 0x7ffb8c08ae20 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb9110c640 10 monclient: _renew_subs 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb9110c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ffb8c08aa00 con 0x7ffb8c08ae20 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.338+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb80003980 con 0x7ffb8c08ae20 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb6b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffb80003ca0 con 0x7ffb8c08ae20 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb6b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb89573640 4 set_mon_vals no callback set 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb6b7fe640 10 monclient: dump: 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.354 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb9110c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb9110c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb9110c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb8c05be40 con 0x7ffb8c08ae20 2026-02-12T17:28:23.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ffb80003e00 con 0x7ffb8c08ae20 2026-02-12T17:28:23.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 2155223665 0 0) 0x7ffb8004ea90 con 0x7ffb8c08ae20 2026-02-12T17:28:23.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.339+0000 7ffb8a575640 10 monclient: get_auth_request con 0x7ffb5803fb30 auth_method 0 2026-02-12T17:28:23.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.341+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ffb80017320 con 0x7ffb8c08ae20 2026-02-12T17:28:23.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.341+0000 7ffb6b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.341+0000 7ffb6b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:23.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.444+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb8c08d840 con 0x7ffb5803fb30 2026-02-12T17:28:23.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.445+0000 7ffb6b7fe640 1 -- 10.20.193.57:0/82215975 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34112 (unknown 2965378022 0 945856403) 0x7ffb740079b0 con 0x7ffb5803fb30 2026-02-12T17:28:23.443 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:23.444 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:28:23.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.446+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 >> v1:10.20.193.82:6800/2441377515 conn(0x7ffb5803fb30 legacy=0x7ffb5805ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.446+0000 7ffb9110c640 10 monclient: shutdown 2026-02-12T17:28:23.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.446+0000 7ffb9110c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.446+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 >> v1:10.20.193.57:6790/0 conn(0x7ffb8c08ae20 legacy=0x7ffb8c086aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.446+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 shutdown_connections 2026-02-12T17:28:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.446+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 >> 10.20.193.57:0/82215975 conn(0x7ffb8c091620 msgr2=0x7ffb8c088050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.446+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 shutdown_connections 2026-02-12T17:28:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.446+0000 7ffb9110c640 1 -- 10.20.193.57:0/82215975 wait complete. 2026-02-12T17:28:23.451 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-12T17:28:21.827773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163704,"kb_used_data":1944,"kb_used_omap":48,"kb_used_meta":161615,"kb_avail":566067336,"statfs":{"total":579820584960,"available":579652952064,"internally_reserved":0,"allocated":1990656,"data_stored":1342726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50048,"internal_metadata":165493888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.797651"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724309+0000","last_change":"2026-02-12T17:28:19.724309+0000","last_active":"2026-02-12T17:28:19.724309+0000","last_peered":"2026-02-12T17:28:19.724309+0000","last_clean":"2026-02-12T17:28:19.724309+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:28:19.724309+0000","last_undegraded":"2026-02-12T17:28:19.724309+0000","last_fullsized":"2026-02-12T17:28:19.724309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:21:16.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.289150+0000","last_change":"2026-02-12T17:28:19.289150+0000","last_active":"2026-02-12T17:28:19.289150+0000","last_peered":"2026-02-12T17:28:19.289150+0000","last_clean":"2026-02-12T17:28:19.289150+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:28:19.289150+0000","last_undegraded":"2026-02-12T17:28:19.289150+0000","last_fullsized":"2026-02-12T17:28:19.289150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:34:03.582232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724251+0000","last_change":"2026-02-12T17:28:19.724251+0000","last_active":"2026-02-12T17:28:19.724251+0000","last_peered":"2026-02-12T17:28:19.724251+0000","last_clean":"2026-02-12T17:28:19.724251+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:28:19.724251+0000","last_undegraded":"2026-02-12T17:28:19.724251+0000","last_fullsized":"2026-02-12T17:28:19.724251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:31:06.358030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.289250+0000","last_change":"2026-02-12T17:28:19.289250+0000","last_active":"2026-02-12T17:28:19.289250+0000","last_peered":"2026-02-12T17:28:19.289250+0000","last_clean":"2026-02-12T17:28:19.289250+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:28:19.289250+0000","last_undegraded":"2026-02-12T17:28:19.289250+0000","last_fullsized":"2026-02-12T17:28:19.289250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:19:32.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.284665+0000","last_change":"2026-02-12T17:28:19.283404+0000","last_active":"2026-02-12T17:28:19.284665+0000","last_peered":"2026-02-12T17:28:19.284665+0000","last_clean":"2026-02-12T17:28:19.284665+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:28:19.284665+0000","last_undegraded":"2026-02-12T17:28:19.284665+0000","last_fullsized":"2026-02-12T17:28:19.284665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:24:22.204036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.286905+0000","last_change":"2026-02-12T17:28:19.286905+0000","last_active":"2026-02-12T17:28:19.286905+0000","last_peered":"2026-02-12T17:28:19.286905+0000","last_clean":"2026-02-12T17:28:19.286905+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:28:19.286905+0000","last_undegraded":"2026-02-12T17:28:19.286905+0000","last_fullsized":"2026-02-12T17:28:19.286905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:35.531511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724210+0000","last_change":"2026-02-12T17:28:19.724210+0000","last_active":"2026-02-12T17:28:19.724210+0000","last_peered":"2026-02-12T17:28:19.724210+0000","last_clean":"2026-02-12T17:28:19.724210+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:28:19.724210+0000","last_undegraded":"2026-02-12T17:28:19.724210+0000","last_fullsized":"2026-02-12T17:28:19.724210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:54.193528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.283491+0000","last_change":"2026-02-12T17:28:19.283491+0000","last_active":"2026-02-12T17:28:19.283491+0000","last_peered":"2026-02-12T17:28:19.283491+0000","last_clean":"2026-02-12T17:28:19.283491+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:28:19.283491+0000","last_undegraded":"2026-02-12T17:28:19.283491+0000","last_fullsized":"2026-02-12T17:28:19.283491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:53.711374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.723942+0000","last_change":"2026-02-12T17:28:13.575533+0000","last_active":"2026-02-12T17:28:19.723942+0000","last_peered":"2026-02-12T17:28:19.723942+0000","last_clean":"2026-02-12T17:28:19.723942+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:28:19.723942+0000","last_undegraded":"2026-02-12T17:28:19.723942+0000","last_fullsized":"2026-02-12T17:28:19.723942+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_clean_scrub_stamp":"2026-02-12T17:28:11.958332+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:10:01.188074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":44720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":672,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":688128,"data_stored":577776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":664,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":679936,"data_stored":573648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:28:23.452 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T17:28:23.453 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T17:28:23.453 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T17:28:23.453 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T17:28:23.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.521+0000 7fe6ef14c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:23.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.521+0000 7fe6ef14c640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.521+0000 7fe6ef14c640 10 monclient: monmap: 2026-02-12T17:28:23.519 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.519 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.519 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:23.522175+0000 2026-02-12T17:28:23.519 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:23.522175+0000 2026-02-12T17:28:23.519 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.520 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.520 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.520 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:23.520 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:23.520 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.521+0000 7fe6ef14c640 1 Processor -- start 2026-02-12T17:28:23.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.521+0000 7fe6ef14c640 1 -- start start 2026-02-12T17:28:23.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.521+0000 7fe6ef14c640 10 monclient: init 2026-02-12T17:28:23.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:23.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 10 monclient(hunting): picked mon.noname-c con 0x7fe6e808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 10 monclient(hunting): picked mon.noname-a con 0x7fe6e808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 10 monclient(hunting): picked mon.noname-b con 0x7fe6e808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e808d600 con 0x7fe6e808c730 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e808b1f0 con 0x7fe6e808ae20 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e808d1f0 con 0x7fe6e808cb30 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ef14c640 10 monclient(hunting): authenticate will time out at 583.341133s 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6dffff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe6e808c730 0x7fe6e8181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36146/0 (socket says 10.20.193.57:36146) 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6dffff640 1 -- 10.20.193.57:0/344790997 learned_addr learned my addr 10.20.193.57:0/344790997 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.522+0000 7fe6ed6c2640 1 --1- 10.20.193.57:0/344790997 >> v1:10.20.193.57:6790/0 conn(0x7fe6e808cb30 0x7fe6e81a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45620/0 (socket says 10.20.193.57:45620) 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6ed6c2640 1 -- 10.20.193.57:0/344790997 >> v1:10.20.193.57:6790/0 conn(0x7fe6e808cb30 legacy=0x7fe6e81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6dffff640 1 -- 10.20.193.57:0/344790997 >> v1:10.20.193.57:6789/0 conn(0x7fe6e808c730 legacy=0x7fe6e8181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233506952 0 0) 0x7fe6e808d1f0 con 0x7fe6e808cb30 2026-02-12T17:28:23.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient(hunting): my global_id is 4343 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6ecec1640 1 -- 10.20.193.57:0/344790997 >> v1:10.20.193.82:6789/0 conn(0x7fe6e808ae20 legacy=0x7fe6e808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d40035e0 con 0x7fe6e808cb30 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209229934 0 0) 0x7fe6e808d600 con 0x7fe6e808c730 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient(hunting): my global_id is 4401 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6e808d1f0 con 0x7fe6e808c730 2026-02-12T17:28:23.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4131389900 0 0) 0x7fe6d40035e0 con 0x7fe6e808cb30 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 >> v1:10.20.193.82:6789/0 conn(0x7fe6e808ae20 legacy=0x7fe6e808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 >> v1:10.20.193.57:6789/0 conn(0x7fe6e808c730 legacy=0x7fe6e8181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 monclient: found mon.noname-b 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e8057320 con 0x7fe6e808cb30 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe6e4004220 con 0x7fe6e808cb30 2026-02-12T17:28:23.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: dump: 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6ef14c640 5 monclient: authenticate success, global_id 4343 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6ef14c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6e4004380 con 0x7fe6e808cb30 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6ef14c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6ef14c640 4 set_mon_vals no callback set 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 1 -- 10.20.193.57:0/344790997 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe6e4005980 con 0x7fe6e808cb30 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.524+0000 7fe6df7fe640 10 monclient: dump: 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.534 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient: shutdown 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 -- 10.20.193.57:0/344790997 >> v1:10.20.193.57:6790/0 conn(0x7fe6e808cb30 legacy=0x7fe6e81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 -- 10.20.193.57:0/344790997 shutdown_connections 2026-02-12T17:28:23.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 -- 10.20.193.57:0/344790997 >> 10.20.193.57:0/344790997 conn(0x7fe6e8091620 msgr2=0x7fe6e8091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 -- 10.20.193.57:0/344790997 shutdown_connections 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 -- 10.20.193.57:0/344790997 wait complete. 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient: monmap: 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:23.536 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 Processor -- start 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 -- start start 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient: init 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient(hunting): picked mon.noname-c con 0x7fe6e808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient(hunting): picked mon.noname-a con 0x7fe6e808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient(hunting): picked mon.noname-b con 0x7fe6e808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e808d9c0 con 0x7fe6e808c730 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e805af20 con 0x7fe6e808cb30 2026-02-12T17:28:23.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e811bb40 con 0x7fe6e808ae20 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.525+0000 7fe6ef14c640 10 monclient(hunting): authenticate will time out at 583.344988s 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.526+0000 7fe6ecec1640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe6e808ae20 0x7fe6e8119040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45628/0 (socket says 10.20.193.57:45628) 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.526+0000 7fe6ecec1640 1 -- 10.20.193.57:0/3912883814 learned_addr learned my addr 10.20.193.57:0/3912883814 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6ecec1640 1 -- 10.20.193.57:0/3912883814 >> v1:10.20.193.57:6790/0 conn(0x7fe6e808ae20 legacy=0x7fe6e8119040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dffff640 1 -- 10.20.193.57:0/3912883814 >> v1:10.20.193.57:6789/0 conn(0x7fe6e808c730 legacy=0x7fe6e8119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567017361 0 0) 0x7fe6e811bb40 con 0x7fe6e808ae20 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): my global_id is 4346 2026-02-12T17:28:23.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6b80035e0 con 0x7fe6e808ae20 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1018159595 0 0) 0x7fe6e808d9c0 con 0x7fe6e808c730 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): my global_id is 4404 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6e811bb40 con 0x7fe6e808c730 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6ed6c2640 1 -- 10.20.193.57:0/3912883814 >> v1:10.20.193.82:6789/0 conn(0x7fe6e808cb30 legacy=0x7fe6e8119e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1273264196 0 0) 0x7fe6b80035e0 con 0x7fe6e808ae20 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6e808d9c0 con 0x7fe6e808ae20 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe6d8003300 con 0x7fe6e808ae20 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:23.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): dump: 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017804319 0 0) 0x7fe6e805af20 con 0x7fe6e808cb30 2026-02-12T17:28:23.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): my global_id is 4363 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6b80035e0 con 0x7fe6e808cb30 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3913721002 0 0) 0x7fe6e811bb40 con 0x7fe6e808c730 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6e805af20 con 0x7fe6e808c730 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe6d0002d40 con 0x7fe6e808c730 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient(hunting): dump: 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.541 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2262224322 0 0) 0x7fe6e808d9c0 con 0x7fe6e808ae20 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 >> v1:10.20.193.82:6789/0 conn(0x7fe6e808cb30 legacy=0x7fe6e8119e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 >> v1:10.20.193.57:6789/0 conn(0x7fe6e808c730 legacy=0x7fe6e8119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 monclient: found mon.c 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e8088810 con 0x7fe6e808ae20 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6ef14c640 5 monclient: authenticate success, global_id 4346 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6ef14c640 10 monclient: _renew_subs 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6ef14c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e805ca60 con 0x7fe6e808ae20 2026-02-12T17:28:23.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6ef14c640 10 monclient: _renew_subs 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6ef14c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe6e811b4d0 con 0x7fe6e808ae20 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6d8003980 con 0x7fe6e808ae20 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe6d8003ca0 con 0x7fe6e808ae20 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6dd7fa640 10 monclient: dump: 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.544 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.528+0000 7fe6deffd640 4 set_mon_vals no callback set 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.529+0000 7fe6ef14c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.529+0000 7fe6ef14c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.529+0000 7fe6ef14c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.529+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e80008d0 con 0x7fe6e808ae20 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.529+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe6d8003f30 con 0x7fe6e808ae20 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.529+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7fe6d804ea60 con 0x7fe6e808ae20 2026-02-12T17:28:23.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.529+0000 7fe6dffff640 10 monclient: get_auth_request con 0x7fe6b803fd60 auth_method 0 2026-02-12T17:28:23.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.531+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe6d8016ca0 con 0x7fe6e808ae20 2026-02-12T17:28:23.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.531+0000 7fe6dd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.531+0000 7fe6dd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:23.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.661+0000 7fe6ef14c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-12T17:28:23.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.661+0000 7fe6ef14c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-12T17:28:23.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.661+0000 7fe6ef14c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.661+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe6e808f500 con 0x7fe6e808ae20 2026-02-12T17:28:23.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.661+0000 7fe6dd7fa640 1 -- 10.20.193.57:0/3912883814 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7fe6d8016ac0 con 0x7fe6e808ae20 2026-02-12T17:28:23.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.661+0000 7fe6dd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-12T17:28:23.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.661+0000 7fe6dd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:23.660 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:23.660 INFO:teuthology.orchestra.run.trial057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T17:28:23.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.662+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe6b803fd60 legacy=0x7fe6b8060210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.662+0000 7fe6ef14c640 10 monclient: shutdown 2026-02-12T17:28:23.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.662+0000 7fe6ef14c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.662+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 >> v1:10.20.193.57:6790/0 conn(0x7fe6e808ae20 legacy=0x7fe6e8119040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.662+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 shutdown_connections 2026-02-12T17:28:23.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.662+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 >> 10.20.193.57:0/3912883814 conn(0x7fe6e8091620 msgr2=0x7fe6e80597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.662+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 shutdown_connections 2026-02-12T17:28:23.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.662+0000 7fe6ef14c640 1 -- 10.20.193.57:0/3912883814 wait complete. 2026-02-12T17:28:23.668 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T17:28:23.668 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-12T17:28:23.692 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-12T17:28:23.693 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T17:28:23.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.760+0000 7ffa7c14c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:23.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.760+0000 7ffa7c14c640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.760+0000 7ffa7c14c640 10 monclient: monmap: 2026-02-12T17:28:23.758 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.758 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.758 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:23.761167+0000 2026-02-12T17:28:23.758 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:23.761167+0000 2026-02-12T17:28:23.759 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.759 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.759 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.759 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:23.759 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:23.759 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.760+0000 7ffa7c14c640 1 Processor -- start 2026-02-12T17:28:23.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.760+0000 7ffa7c14c640 1 -- start start 2026-02-12T17:28:23.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.760+0000 7ffa7c14c640 10 monclient: init 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.760+0000 7ffa7c14c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa7c14c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa7c14c640 10 monclient(hunting): picked mon.noname-c con 0x7ffa7408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa7c14c640 10 monclient(hunting): picked mon.noname-b con 0x7ffa7408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa7c14c640 10 monclient(hunting): picked mon.noname-a con 0x7ffa7408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa7c14c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7408d600 con 0x7ffa7408cb30 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa7c14c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7408b1f0 con 0x7ffa7408ae20 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa7c14c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7408d1f0 con 0x7ffa7408c730 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa7c14c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa7c14c640 10 monclient(hunting): authenticate will time out at 583.580060s 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa796c0640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ffa7408c730 0x7ffa74181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45640/0 (socket says 10.20.193.57:45640) 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.761+0000 7ffa796c0640 1 -- 10.20.193.57:0/3501458999 learned_addr learned my addr 10.20.193.57:0/3501458999 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa796c0640 1 -- 10.20.193.57:0/3501458999 >> v1:10.20.193.57:6790/0 conn(0x7ffa7408c730 legacy=0x7ffa74181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa7a6c2640 1 -- 10.20.193.57:0/3501458999 >> v1:10.20.193.57:6789/0 conn(0x7ffa7408cb30 legacy=0x7ffa741a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa79ec1640 1 -- 10.20.193.57:0/3501458999 >> v1:10.20.193.82:6789/0 conn(0x7ffa7408ae20 legacy=0x7ffa7408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688891386 0 0) 0x7ffa7408d1f0 con 0x7ffa7408c730 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient(hunting): my global_id is 4349 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa5c0035e0 con 0x7ffa7408c730 2026-02-12T17:28:23.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364738735 0 0) 0x7ffa7408d600 con 0x7ffa7408cb30 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient(hunting): my global_id is 4407 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa7408d1f0 con 0x7ffa7408cb30 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2535029390 0 0) 0x7ffa5c0035e0 con 0x7ffa7408c730 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 >> v1:10.20.193.82:6789/0 conn(0x7ffa7408ae20 legacy=0x7ffa7408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 >> v1:10.20.193.57:6789/0 conn(0x7ffa7408cb30 legacy=0x7ffa741a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 monclient: found mon.noname-b 2026-02-12T17:28:23.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa74057320 con 0x7ffa7408c730 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffa680030c0 con 0x7ffa7408c730 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa7c14c640 5 monclient: authenticate success, global_id 4349 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa7c14c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: dump: 2026-02-12T17:28:23.768 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa7c14c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa68003350 con 0x7ffa7408c730 2026-02-12T17:28:23.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa7c14c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa7c14c640 4 set_mon_vals no callback set 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 1 -- 10.20.193.57:0/3501458999 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffa68003570 con 0x7ffa7408c730 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.763+0000 7ffa78ebf640 10 monclient: dump: 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.770 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 10 monclient: shutdown 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3501458999 >> v1:10.20.193.57:6790/0 conn(0x7ffa7408c730 legacy=0x7ffa74181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3501458999 shutdown_connections 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3501458999 >> 10.20.193.57:0/3501458999 conn(0x7ffa74091620 msgr2=0x7ffa74091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3501458999 shutdown_connections 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3501458999 wait complete. 2026-02-12T17:28:23.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 10 monclient: monmap: 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 1 Processor -- start 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 1 -- start start 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.764+0000 7ffa7c14c640 10 monclient: init 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 10 monclient(hunting): picked mon.noname-a con 0x7ffa7408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 10 monclient(hunting): picked mon.noname-c con 0x7ffa7408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 10 monclient(hunting): picked mon.noname-b con 0x7ffa7408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7408d9c0 con 0x7ffa7408ae20 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7405afb0 con 0x7ffa7408cb30 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7411f400 con 0x7ffa7408c730 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa7c14c640 10 monclient(hunting): authenticate will time out at 583.584084s 2026-02-12T17:28:23.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa796c0640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ffa7408c730 0x7ffa74133740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45642/0 (socket says 10.20.193.57:45642) 2026-02-12T17:28:23.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.765+0000 7ffa796c0640 1 -- 10.20.193.57:0/3823455016 learned_addr learned my addr 10.20.193.57:0/3823455016 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa796c0640 1 -- 10.20.193.57:0/3823455016 >> v1:10.20.193.57:6790/0 conn(0x7ffa7408c730 legacy=0x7ffa74133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa79ec1640 1 -- 10.20.193.57:0/3823455016 >> v1:10.20.193.57:6789/0 conn(0x7ffa7408ae20 legacy=0x7ffa74133030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881121823 0 0) 0x7ffa7411f400 con 0x7ffa7408c730 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): my global_id is 4352 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa440035e0 con 0x7ffa7408c730 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168459713 0 0) 0x7ffa7408d9c0 con 0x7ffa7408ae20 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): my global_id is 4410 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa7a6c2640 1 -- 10.20.193.57:0/3823455016 >> v1:10.20.193.82:6789/0 conn(0x7ffa7408cb30 legacy=0x7ffa741a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa7411f400 con 0x7ffa7408ae20 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2074643727 0 0) 0x7ffa440035e0 con 0x7ffa7408c730 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa7408d9c0 con 0x7ffa7408c730 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffa680048a0 con 0x7ffa7408c730 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): dump: 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.779 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3893980036 0 0) 0x7ffa7411f400 con 0x7ffa7408ae20 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffa440035e0 con 0x7ffa7408ae20 2026-02-12T17:28:23.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffa640032a0 con 0x7ffa7408ae20 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): dump: 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.781 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798566017 0 0) 0x7ffa7405afb0 con 0x7ffa7408cb30 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient(hunting): my global_id is 4369 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa7411f400 con 0x7ffa7408cb30 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2192702207 0 0) 0x7ffa7408d9c0 con 0x7ffa7408c730 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 >> v1:10.20.193.82:6789/0 conn(0x7ffa7408cb30 legacy=0x7ffa741a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 >> v1:10.20.193.57:6789/0 conn(0x7ffa7408ae20 legacy=0x7ffa74133030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 monclient: found mon.c 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7411e530 con 0x7ffa7408c730 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa7c14c640 5 monclient: authenticate success, global_id 4352 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa7c14c640 10 monclient: _renew_subs 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa7c14c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffa74088810 con 0x7ffa7408c730 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa7c14c640 10 monclient: _renew_subs 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa7c14c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ffa7411edd0 con 0x7ffa7408c730 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffa68004f10 con 0x7ffa7408c730 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffa68005230 con 0x7ffa7408c730 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa63fff640 4 set_mon_vals no callback set 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.767+0000 7ffa627fc640 10 monclient: dump: 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.784 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.768+0000 7ffa7c14c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.768+0000 7ffa7c14c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.768+0000 7ffa7c14c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.768+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ffa68011ea0 con 0x7ffa7408c730 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.768+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa74123640 con 0x7ffa7408c730 2026-02-12T17:28:23.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.768+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7ffa6804ebc0 con 0x7ffa7408c730 2026-02-12T17:28:23.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.768+0000 7ffa79ec1640 10 monclient: get_auth_request con 0x7ffa4403fd00 auth_method 0 2026-02-12T17:28:23.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.770+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ffa68017470 con 0x7ffa7408c730 2026-02-12T17:28:23.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.770+0000 7ffa627fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.770+0000 7ffa627fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:23.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.876+0000 7ffa7c14c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:23.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.876+0000 7ffa7c14c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:23.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.876+0000 7ffa7c14c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:23.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.876+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa74133e50 con 0x7ffa7408c730 2026-02-12T17:28:23.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.877+0000 7ffa627fc640 1 -- 10.20.193.57:0/3823455016 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10780 (unknown 941590788 0 860509893) 0x7ffa68016c20 con 0x7ffa7408c730 2026-02-12T17:28:23.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.877+0000 7ffa627fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:28:23.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.877+0000 7ffa627fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:23.875 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:23.876 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":19,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","created":"2026-02-12T17:28:03.716456+0000","modified":"2026-02-12T17:28:23.472017+0000","last_up_change":"2026-02-12T17:28:09.951573+0000","last_in_change":"2026-02-12T17:28:06.940287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T17:28:11.851529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T17:28:14.923444+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08ee67d7-4cf0-452b-a362-8a5526fccd74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":521925997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":521925997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":521925997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":521925997}]},"public_addr":"10.20.193.57:6803/521925997","cluster_addr":"10.20.193.57:6805/521925997","heartbeat_back_addr":"10.20.193.57:6807/521925997","heartbeat_front_addr":"10.20.193.57:6806/521925997","state":["exists","up"]},{"osd":1,"uuid":"d2ec9481-5b72-4197-a3ed-b1029fb07580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6800","nonce":3025704390}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":3025704390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":3025704390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":3025704390}]},"public_addr":"10.20.193.57:6800/3025704390","cluster_addr":"10.20.193.57:6801/3025704390","heartbeat_back_addr":"10.20.193.57:6804/3025704390","heartbeat_front_addr":"10.20.193.57:6802/3025704390","state":["exists","up"]},{"osd":2,"uuid":"7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3129121469}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3129121469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3129121469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3129121469}]},"public_addr":"10.20.193.57:6808/3129121469","cluster_addr":"10.20.193.57:6809/3129121469","heartbeat_back_addr":"10.20.193.57:6811/3129121469","heartbeat_front_addr":"10.20.193.57:6810/3129121469","state":["exists","up"]},{"osd":3,"uuid":"108524be-58bc-4950-b88f-d85dfa77ef48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6801","nonce":634754599}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6802","nonce":634754599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6804","nonce":634754599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6803","nonce":634754599}]},"public_addr":"10.20.193.82:6801/634754599","cluster_addr":"10.20.193.82:6802/634754599","heartbeat_back_addr":"10.20.193.82:6804/634754599","heartbeat_front_addr":"10.20.193.82:6803/634754599","state":["exists","up"]},{"osd":4,"uuid":"e9bb983d-b2d5-4543-a960-f450bede62cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6805","nonce":687524042}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6806","nonce":687524042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6808","nonce":687524042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6807","nonce":687524042}]},"public_addr":"10.20.193.82:6805/687524042","cluster_addr":"10.20.193.82:6806/687524042","heartbeat_back_addr":"10.20.193.82:6808/687524042","heartbeat_front_addr":"10.20.193.82:6807/687524042","state":["exists","up"]},{"osd":5,"uuid":"047804d0-f125-4ef6-ac99-8f8ed7d594ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6809","nonce":1303150362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6810","nonce":1303150362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6812","nonce":1303150362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6811","nonce":1303150362}]},"public_addr":"10.20.193.82:6809/1303150362","cluster_addr":"10.20.193.82:6810/1303150362","heartbeat_back_addr":"10.20.193.82:6812/1303150362","heartbeat_front_addr":"10.20.193.82:6811/1303150362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T17:28:23.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.878+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 >> v1:10.20.193.82:6800/2441377515 conn(0x7ffa4403fd00 legacy=0x7ffa440601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.878+0000 7ffa7c14c640 10 monclient: shutdown 2026-02-12T17:28:23.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.878+0000 7ffa7c14c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.878+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 >> v1:10.20.193.57:6790/0 conn(0x7ffa7408c730 legacy=0x7ffa74133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.878+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 shutdown_connections 2026-02-12T17:28:23.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.878+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 >> 10.20.193.57:0/3823455016 conn(0x7ffa74091620 msgr2=0x7ffa74125c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.878+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 shutdown_connections 2026-02-12T17:28:23.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.878+0000 7ffa7c14c640 1 -- 10.20.193.57:0/3823455016 wait complete. 2026-02-12T17:28:23.885 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-12T17:28:11.851529+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-12T17:28:14.923444+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 18, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-12T17:28:23.885 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-12T17:28:23.953 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.955+0000 7f1f40b7e640 10 monclient: get_monmap_and_config 2026-02-12T17:28:23.953 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.955+0000 7f1f40b7e640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.953 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.955+0000 7f1f40b7e640 10 monclient: monmap: 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:23.956563+0000 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:23.956563+0000 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:23.954 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 1 Processor -- start 2026-02-12T17:28:23.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 1 -- start start 2026-02-12T17:28:23.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 10 monclient: init 2026-02-12T17:28:23.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:23.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 10 monclient(hunting): picked mon.noname-b con 0x7f1f3c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 10 monclient(hunting): picked mon.noname-a con 0x7f1f3c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 10 monclient(hunting): picked mon.noname-c con 0x7f1f3c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3c08a820 con 0x7f1f3c08c620 2026-02-12T17:28:23.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3c089450 con 0x7f1f3c182cc0 2026-02-12T17:28:23.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3c089730 con 0x7f1f3c08c250 2026-02-12T17:28:23.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f40b7e640 10 monclient(hunting): authenticate will time out at 583.775501s 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f3a575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f1f3c08c250 0x7f1f3c08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45652/0 (socket says 10.20.193.57:45652) 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.956+0000 7f1f3a575640 1 -- 10.20.193.57:0/2978806403 learned_addr learned my addr 10.20.193.57:0/2978806403 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f3a575640 1 -- 10.20.193.57:0/2978806403 >> v1:10.20.193.57:6790/0 conn(0x7f1f3c08c250 legacy=0x7f1f3c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39d74640 1 -- 10.20.193.57:0/2978806403 >> v1:10.20.193.57:6789/0 conn(0x7f1f3c08c620 legacy=0x7f1f3c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f3ad76640 1 -- 10.20.193.57:0/2978806403 >> v1:10.20.193.82:6789/0 conn(0x7f1f3c182cc0 legacy=0x7f1f3c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308010398 0 0) 0x7f1f24002c70 con 0x7f1f3c08c620 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 10 monclient(hunting): my global_id is 4413 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f280035e0 con 0x7f1f3c08c620 2026-02-12T17:28:23.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776903394 0 0) 0x7f1f3c089730 con 0x7f1f3c08c250 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 10 monclient(hunting): my global_id is 4355 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.958+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f24002c70 con 0x7f1f3c08c250 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2686315636 0 0) 0x7f1f280035e0 con 0x7f1f3c08c620 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 >> v1:10.20.193.57:6790/0 conn(0x7f1f3c08c250 legacy=0x7f1f3c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 >> v1:10.20.193.82:6789/0 conn(0x7f1f3c182cc0 legacy=0x7f1f3c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 1 monclient: found mon.noname-a 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c089a10 con 0x7f1f3c08c620 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1f24003330 con 0x7f1f3c08c620 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 5 monclient: authenticate success, global_id 4413 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: dump: 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.968 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f240036d0 con 0x7f1f3c08c620 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:23.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 1 -- 10.20.193.57:0/2978806403 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1f24003a60 con 0x7f1f3c08c620 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 4 set_mon_vals no callback set 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f39573640 10 monclient: dump: 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.970 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 10 monclient: shutdown 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 1 -- 10.20.193.57:0/2978806403 >> v1:10.20.193.57:6789/0 conn(0x7f1f3c08c620 legacy=0x7f1f3c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 1 -- 10.20.193.57:0/2978806403 shutdown_connections 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 1 -- 10.20.193.57:0/2978806403 >> 10.20.193.57:0/2978806403 conn(0x7f1f3c0916b0 msgr2=0x7f1f3c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 1 -- 10.20.193.57:0/2978806403 shutdown_connections 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 1 -- 10.20.193.57:0/2978806403 wait complete. 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 10 monclient: build_initial_monmap 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.959+0000 7f1f40b7e640 10 monclient: monmap: 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:23.971 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 1 Processor -- start 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 1 -- start start 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 10 monclient: init 2026-02-12T17:28:23.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 10 monclient(hunting): picked mon.noname-c con 0x7f1f3c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 10 monclient(hunting): picked mon.noname-a con 0x7f1f3c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 10 monclient(hunting): picked mon.noname-b con 0x7f1f3c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3c08ef60 con 0x7f1f3c08c620 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3c086000 con 0x7f1f3c182cc0 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f3c087090 con 0x7f1f3c08c250 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f40b7e640 10 monclient(hunting): authenticate will time out at 583.779356s 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f3a575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f1f3c08c250 0x7f1f3c191800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45654/0 (socket says 10.20.193.57:45654) 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.960+0000 7f1f3a575640 1 -- 10.20.193.57:0/3449300560 learned_addr learned my addr 10.20.193.57:0/3449300560 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f3a575640 1 -- 10.20.193.57:0/3449300560 >> v1:10.20.193.57:6790/0 conn(0x7f1f3c08c250 legacy=0x7f1f3c191800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f39d74640 1 -- 10.20.193.57:0/3449300560 >> v1:10.20.193.57:6789/0 conn(0x7f1f3c08c620 legacy=0x7f1f3c191f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166893127 0 0) 0x7f1f3c087090 con 0x7f1f3c08c250 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): my global_id is 4358 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f080035e0 con 0x7f1f3c08c250 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f3ad76640 1 -- 10.20.193.57:0/3449300560 >> v1:10.20.193.82:6789/0 conn(0x7f1f3c182cc0 legacy=0x7f1f3c194cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661664671 0 0) 0x7f1f3c089a10 con 0x7f1f3c08c620 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): my global_id is 4416 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f3c087090 con 0x7f1f3c08c620 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2605764471 0 0) 0x7f1f080035e0 con 0x7f1f3c08c250 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f3c089a10 con 0x7f1f3c08c250 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1f300032a0 con 0x7f1f3c08c250 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.975 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794600707 0 0) 0x7f1f3c086000 con 0x7f1f3c182cc0 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): my global_id is 4375 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f080035e0 con 0x7f1f3c182cc0 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2406956545 0 0) 0x7f1f3c087090 con 0x7f1f3c08c620 2026-02-12T17:28:23.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f3c086000 con 0x7f1f3c08c620 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1f24003330 con 0x7f1f3c08c620 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.962+0000 7f1f22ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.977 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 555519132 0 0) 0x7f1f3c086000 con 0x7f1f3c08c620 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 >> v1:10.20.193.57:6790/0 conn(0x7f1f3c08c250 legacy=0x7f1f3c191800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 >> v1:10.20.193.82:6789/0 conn(0x7f1f3c182cc0 legacy=0x7f1f3c194cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 1 monclient: found mon.a 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c087370 con 0x7f1f3c08c620 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:23.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 5 monclient: authenticate success, global_id 4416 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 10 monclient: _renew_subs 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3c192680 con 0x7f1f3c08c620 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 10 monclient: _renew_subs 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1f3c085720 con 0x7f1f3c08c620 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f24002f50 con 0x7f1f3c08c620 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1f240041f0 con 0x7f1f3c08c620 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f38d72640 4 set_mon_vals no callback set 2026-02-12T17:28:23.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 10 monclient: dump: 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:23.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3c090810 con 0x7f1f3c08c620 2026-02-12T17:28:23.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1f24004350 con 0x7f1f3c08c620 2026-02-12T17:28:23.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.963+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f1f2404e980 con 0x7f1f3c08c620 2026-02-12T17:28:23.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.964+0000 7f1f3a575640 10 monclient: get_auth_request con 0x7f1f0803fc40 auth_method 0 2026-02-12T17:28:23.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.965+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f1f240172f0 con 0x7f1f3c08c620 2026-02-12T17:28:23.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.965+0000 7f1f22ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:23.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:23.965+0000 7f1f22ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:24.071 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.073+0000 7f1f40b7e640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-12T17:28:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.073+0000 7f1f40b7e640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-12T17:28:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.073+0000 7f1f40b7e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.073+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1f3c08a820 con 0x7f1f3c08c620 2026-02-12T17:28:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.073+0000 7f1f22ffd640 1 -- 10.20.193.57:0/3449300560 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (unknown 4170632370 0 2170607528) 0x7f1f3c08a820 con 0x7f1f3c08c620 2026-02-12T17:28:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.073+0000 7f1f22ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-12T17:28:24.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.073+0000 7f1f22ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:24.072 INFO:teuthology.orchestra.run.trial057.stdout:pg_num: 1 2026-02-12T17:28:24.073 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.074+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 >> v1:10.20.193.82:6800/2441377515 conn(0x7f1f0803fc40 legacy=0x7f1f080600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.074+0000 7f1f40b7e640 10 monclient: shutdown 2026-02-12T17:28:24.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.074+0000 7f1f40b7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.074+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 >> v1:10.20.193.57:6789/0 conn(0x7f1f3c08c620 legacy=0x7f1f3c191f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.074+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 shutdown_connections 2026-02-12T17:28:24.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.074+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 >> 10.20.193.57:0/3449300560 conn(0x7f1f3c0916b0 msgr2=0x7f1f3c18e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.074+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 shutdown_connections 2026-02-12T17:28:24.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.074+0000 7f1f40b7e640 1 -- 10.20.193.57:0/3449300560 wait complete. 2026-02-12T17:28:24.081 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-12T17:28:24.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.149+0000 7fdb97a52640 10 monclient: get_monmap_and_config 2026-02-12T17:28:24.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.149+0000 7fdb97a52640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.149+0000 7fdb97a52640 10 monclient: monmap: 2026-02-12T17:28:24.147 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.147 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.147 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:24.150090+0000 2026-02-12T17:28:24.147 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:24.150090+0000 2026-02-12T17:28:24.147 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.147 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.148 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.148 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:24.148 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:24.148 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.149+0000 7fdb97a52640 1 Processor -- start 2026-02-12T17:28:24.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.149+0000 7fdb97a52640 1 -- start start 2026-02-12T17:28:24.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.149+0000 7fdb97a52640 10 monclient: init 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 10 monclient(hunting): picked mon.noname-b con 0x7fdb90085720 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 10 monclient(hunting): picked mon.noname-c con 0x7fdb90086ea0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 10 monclient(hunting): picked mon.noname-a con 0x7fdb90086200 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb90088220 con 0x7fdb90086200 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb90089500 con 0x7fdb90086ea0 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb90087f40 con 0x7fdb90085720 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb97a52640 10 monclient(hunting): authenticate will time out at 583.969258s 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb957c7640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fdb90085720 0x7fdb90085af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45670/0 (socket says 10.20.193.57:45670) 2026-02-12T17:28:24.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.150+0000 7fdb957c7640 1 -- 10.20.193.57:0/3108457789 learned_addr learned my addr 10.20.193.57:0/3108457789 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb957c7640 1 -- 10.20.193.57:0/3108457789 >> v1:10.20.193.57:6790/0 conn(0x7fdb90085720 legacy=0x7fdb90085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb95fc8640 1 -- 10.20.193.57:0/3108457789 >> v1:10.20.193.57:6789/0 conn(0x7fdb90086200 legacy=0x7fdb901a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 976254710 0 0) 0x7fdb90087f40 con 0x7fdb90085720 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): my global_id is 4361 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb780035e0 con 0x7fdb90085720 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb94fc6640 1 -- 10.20.193.57:0/3108457789 >> v1:10.20.193.82:6789/0 conn(0x7fdb90086ea0 legacy=0x7fdb90180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868530865 0 0) 0x7fdb90088220 con 0x7fdb90086200 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): my global_id is 4419 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb90087f40 con 0x7fdb90086200 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385084 0 0) 0x7fdb90089500 con 0x7fdb90086ea0 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient(hunting): my global_id is 4378 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb90088220 con 0x7fdb90086ea0 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 520090130 0 0) 0x7fdb780035e0 con 0x7fdb90085720 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 >> v1:10.20.193.82:6789/0 conn(0x7fdb90086ea0 legacy=0x7fdb90180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 >> v1:10.20.193.57:6789/0 conn(0x7fdb90086200 legacy=0x7fdb901a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 monclient: found mon.noname-b 2026-02-12T17:28:24.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb900867e0 con 0x7fdb90085720 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdb80003150 con 0x7fdb90085720 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb97a52640 5 monclient: authenticate success, global_id 4361 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb97a52640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient: dump: 2026-02-12T17:28:24.161 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb97a52640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb800033a0 con 0x7fdb90085720 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb7ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb957c7640 1 --1- 10.20.193.57:0/3108457789 >> v1:10.20.193.57:6790/0 conn(0x7fdb90085720 0x7fdb90085af0 :-1 s=OPENED pgs=140 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fdb80004b10 mon_map magic: 0 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb97a52640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.152+0000 7fdb97a52640 4 set_mon_vals no callback set 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 10 monclient: shutdown 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 1 -- 10.20.193.57:0/3108457789 >> v1:10.20.193.57:6790/0 conn(0x7fdb90085720 legacy=0x7fdb90085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb7ffff640 1 -- 10.20.193.57:0/3108457789 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdb80004b10 con 0x7fdb90085720 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb7ffff640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 1 -- 10.20.193.57:0/3108457789 shutdown_connections 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 1 -- 10.20.193.57:0/3108457789 >> 10.20.193.57:0/3108457789 conn(0x7fdb900916b0 msgr2=0x7fdb90091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 1 -- 10.20.193.57:0/3108457789 shutdown_connections 2026-02-12T17:28:24.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 1 -- 10.20.193.57:0/3108457789 wait complete. 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 10 monclient: monmap: 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:24.164 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 1 Processor -- start 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 1 -- start start 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.153+0000 7fdb97a52640 10 monclient: init 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 10 monclient(hunting): picked mon.noname-c con 0x7fdb90085720 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 10 monclient(hunting): picked mon.noname-b con 0x7fdb90086200 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 10 monclient(hunting): picked mon.noname-a con 0x7fdb90086ea0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9013f180 con 0x7fdb90086ea0 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9013f460 con 0x7fdb90086200 2026-02-12T17:28:24.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9005d850 con 0x7fdb90085720 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb97a52640 10 monclient(hunting): authenticate will time out at 583.973234s 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb957c7640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fdb90085720 0x7fdb901d6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45686/0 (socket says 10.20.193.57:45686) 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.154+0000 7fdb957c7640 1 -- 10.20.193.57:0/3352868896 learned_addr learned my addr 10.20.193.57:0/3352868896 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb957c7640 1 -- 10.20.193.57:0/3352868896 >> v1:10.20.193.57:6790/0 conn(0x7fdb90085720 legacy=0x7fdb901d6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb95fc8640 1 -- 10.20.193.57:0/3352868896 >> v1:10.20.193.57:6789/0 conn(0x7fdb90086ea0 legacy=0x7fdb9023c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb94fc6640 1 -- 10.20.193.57:0/3352868896 >> v1:10.20.193.82:6789/0 conn(0x7fdb90086200 legacy=0x7fdb9021ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216672831 0 0) 0x7fdb9013f180 con 0x7fdb90086ea0 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): my global_id is 4422 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb600035e0 con 0x7fdb90086ea0 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141511700 0 0) 0x7fdb9005d850 con 0x7fdb90085720 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): my global_id is 4364 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb9013f180 con 0x7fdb90085720 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528260713 0 0) 0x7fdb9013f460 con 0x7fdb90086200 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): my global_id is 4381 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb9005d850 con 0x7fdb90086200 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1786358626 0 0) 0x7fdb600035e0 con 0x7fdb90086ea0 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb9013f460 con 0x7fdb90086ea0 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdb8c0044c0 con 0x7fdb90086ea0 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): dump: 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.168 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2959346052 0 0) 0x7fdb9013f180 con 0x7fdb90085720 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb600035e0 con 0x7fdb90085720 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdb80002fa0 con 0x7fdb90085720 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient(hunting): dump: 2026-02-12T17:28:24.169 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2761259128 0 0) 0x7fdb9013f460 con 0x7fdb90086ea0 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 >> v1:10.20.193.57:6790/0 conn(0x7fdb90085720 legacy=0x7fdb901d6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 >> v1:10.20.193.82:6789/0 conn(0x7fdb90086200 legacy=0x7fdb9021ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 monclient: found mon.a 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9008b010 con 0x7fdb90086ea0 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb97a52640 5 monclient: authenticate success, global_id 4422 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb97a52640 10 monclient: _renew_subs 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb97a52640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9013eea0 con 0x7fdb90086ea0 2026-02-12T17:28:24.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb97a52640 10 monclient: _renew_subs 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb97a52640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.156+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb9013fe70 con 0x7fdb90086ea0 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb8c004a60 con 0x7fdb90086ea0 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb7dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdb8c004db0 con 0x7fdb90086ea0 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb7f7fe640 4 set_mon_vals no callback set 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb7dffb640 10 monclient: dump: 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.172 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb97a52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb97a52640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb97a52640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb90090810 con 0x7fdb90086ea0 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fdb8c004fc0 con 0x7fdb90086ea0 2026-02-12T17:28:24.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7fdb8c04fad0 con 0x7fdb90086ea0 2026-02-12T17:28:24.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.157+0000 7fdb957c7640 10 monclient: get_auth_request con 0x7fdb6003fba0 auth_method 0 2026-02-12T17:28:24.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.159+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fdb8c017d10 con 0x7fdb90086ea0 2026-02-12T17:28:24.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.159+0000 7fdb7dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.159+0000 7fdb7dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:24.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.265+0000 7fdb97a52640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-12T17:28:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.265+0000 7fdb97a52640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-12T17:28:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.265+0000 7fdb97a52640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.265+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7fdb90140120 con 0x7fdb90086ea0 2026-02-12T17:28:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.265+0000 7fdb7dffb640 1 -- 10.20.193.57:0/3352868896 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) ==== 92+0+10 (unknown 1398289234 0 265718887) 0x7fdb8c017d10 con 0x7fdb90086ea0 2026-02-12T17:28:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.265+0000 7fdb7dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-12T17:28:24.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.265+0000 7fdb7dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:24.265 INFO:teuthology.orchestra.run.trial057.stdout:pg_num: 8 2026-02-12T17:28:24.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.266+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 >> v1:10.20.193.82:6800/2441377515 conn(0x7fdb6003fba0 legacy=0x7fdb60060050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.266+0000 7fdb97a52640 10 monclient: shutdown 2026-02-12T17:28:24.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.266+0000 7fdb97a52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.266+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 >> v1:10.20.193.57:6789/0 conn(0x7fdb90086ea0 legacy=0x7fdb9023c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.266+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 shutdown_connections 2026-02-12T17:28:24.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.267+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 >> 10.20.193.57:0/3352868896 conn(0x7fdb900916b0 msgr2=0x7fdb90057e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.267+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 shutdown_connections 2026-02-12T17:28:24.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.267+0000 7fdb97a52640 1 -- 10.20.193.57:0/3352868896 wait complete. 2026-02-12T17:28:24.272 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-12T17:28:24.272 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:28:24.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.337+0000 7f91a2407640 10 monclient: get_monmap_and_config 2026-02-12T17:28:24.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.337+0000 7f91a2407640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.337+0000 7f91a2407640 10 monclient: monmap: 2026-02-12T17:28:24.336 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.336 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.336 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:24.338491+0000 2026-02-12T17:28:24.336 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:24.338491+0000 2026-02-12T17:28:24.336 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.336 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.336 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.336 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:24.337 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:24.337 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 1 Processor -- start 2026-02-12T17:28:24.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 1 -- start start 2026-02-12T17:28:24.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 10 monclient: init 2026-02-12T17:28:24.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:24.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 10 monclient(hunting): picked mon.noname-a con 0x7f919c08c020 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 10 monclient(hunting): picked mon.noname-c con 0x7f919c08adb0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 10 monclient(hunting): picked mon.noname-b con 0x7f919c182bf0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919c08b7a0 con 0x7f919c08c020 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919c08c3f0 con 0x7f919c08adb0 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919c08d760 con 0x7f919c182bf0 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f91a2407640 10 monclient(hunting): authenticate will time out at 584.157565s 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f919bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f919c08c020 0x7f919c08c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36214/0 (socket says 10.20.193.57:36214) 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.338+0000 7f919bfff640 1 -- 10.20.193.57:0/2188575314 learned_addr learned my addr 10.20.193.57:0/2188575314 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919bfff640 1 -- 10.20.193.57:0/2188575314 >> v1:10.20.193.57:6789/0 conn(0x7f919c08c020 legacy=0x7f919c08c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f91a097d640 1 -- 10.20.193.57:0/2188575314 >> v1:10.20.193.57:6790/0 conn(0x7f919c182bf0 legacy=0x7f919c1a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117675474 0 0) 0x7f919c08d760 con 0x7f919c182bf0 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 10 monclient(hunting): my global_id is 4367 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91800035e0 con 0x7f919c182bf0 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4276290726 0 0) 0x7f919c08b7a0 con 0x7f919c08c020 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.340+0000 7f919affd640 10 monclient(hunting): my global_id is 4425 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f919c08d760 con 0x7f919c08c020 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919b7fe640 1 -- 10.20.193.57:0/2188575314 >> v1:10.20.193.82:6789/0 conn(0x7f919c08adb0 legacy=0x7f919c08d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3026389052 0 0) 0x7f91800035e0 con 0x7f919c182bf0 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 >> v1:10.20.193.82:6789/0 conn(0x7f919c08adb0 legacy=0x7f919c08d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 >> v1:10.20.193.57:6789/0 conn(0x7f919c08c020 legacy=0x7f919c08c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 1 monclient: found mon.noname-b 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c08b9d0 con 0x7f919c182bf0 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9190004200 con 0x7f919c182bf0 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 5 monclient: authenticate success, global_id 4367 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:24.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: dump: 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:24.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9190004500 con 0x7f919c182bf0 2026-02-12T17:28:24.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 1 -- 10.20.193.57:0/2188575314 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9190004960 con 0x7f919c182bf0 2026-02-12T17:28:24.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:24.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f919affd640 10 monclient: dump: 2026-02-12T17:28:24.350 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.350 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.350 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 4 set_mon_vals no callback set 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 10 monclient: shutdown 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 1 -- 10.20.193.57:0/2188575314 >> v1:10.20.193.57:6790/0 conn(0x7f919c182bf0 legacy=0x7f919c1a2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 1 -- 10.20.193.57:0/2188575314 shutdown_connections 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 1 -- 10.20.193.57:0/2188575314 >> 10.20.193.57:0/2188575314 conn(0x7f919c091620 msgr2=0x7f919c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 1 -- 10.20.193.57:0/2188575314 shutdown_connections 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.341+0000 7f91a2407640 1 -- 10.20.193.57:0/2188575314 wait complete. 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient: monmap: 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:24.352 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 1 Processor -- start 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 1 -- start start 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient: init 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient(hunting): picked mon.noname-b con 0x7f919c08adb0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient(hunting): picked mon.noname-a con 0x7f919c08c020 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient(hunting): picked mon.noname-c con 0x7f919c182bf0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919c0574a0 con 0x7f919c08c020 2026-02-12T17:28:24.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919c088810 con 0x7f919c08adb0 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919c13c430 con 0x7f919c182bf0 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f91a2407640 10 monclient(hunting): authenticate will time out at 584.161603s 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f919b7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f919c08c020 0x7f919c1395d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36220/0 (socket says 10.20.193.57:36220) 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.342+0000 7f919b7fe640 1 -- 10.20.193.57:0/2086081663 learned_addr learned my addr 10.20.193.57:0/2086081663 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f919b7fe640 1 -- 10.20.193.57:0/2086081663 >> v1:10.20.193.57:6789/0 conn(0x7f919c08c020 legacy=0x7f919c1395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f91a097d640 1 -- 10.20.193.57:0/2086081663 >> v1:10.20.193.57:6790/0 conn(0x7f919c182bf0 legacy=0x7f919c1934f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f919bfff640 1 -- 10.20.193.57:0/2086081663 >> v1:10.20.193.82:6789/0 conn(0x7f919c08adb0 legacy=0x7f919c138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f91a097d640 1 --1- 10.20.193.57:0/2086081663 >> v1:10.20.193.57:6790/0 conn(0x7f919c182bf0 0x7f919c1934f0 :-1 s=OPENED pgs=143 gs=3 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f919c13c430 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668729351 0 0) 0x7f919c0574a0 con 0x7f919c08c020 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f9198ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f9198ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f9198ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f9198ff9640 10 monclient(hunting): my global_id is 4428 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.344+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f916c0035e0 con 0x7f919c08c020 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914704556 0 0) 0x7f919c088810 con 0x7f919c08adb0 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): my global_id is 4387 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f919c0574a0 con 0x7f919c08adb0 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1750049656 0 0) 0x7f916c0035e0 con 0x7f919c08c020 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f919c088810 con 0x7f919c08c020 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f918c003340 con 0x7f919c08c020 2026-02-12T17:28:24.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): dump: 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3966985663 0 0) 0x7f919c0574a0 con 0x7f919c08adb0 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f916c0035e0 con 0x7f919c08adb0 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f91880031b0 con 0x7f919c08adb0 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient(hunting): dump: 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.357 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3750969981 0 0) 0x7f919c088810 con 0x7f919c08c020 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 >> v1:10.20.193.57:6790/0 conn(0x7f919c182bf0 legacy=0x7f919c1934f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 >> v1:10.20.193.82:6789/0 conn(0x7f919c08adb0 legacy=0x7f919c138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 monclient: found mon.a 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c1408a0 con 0x7f919c08c020 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419562706 0 0) 0x7f919c13c430 con 0x7f919c182bf0 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 5 monclient: authenticate success, global_id 4428 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 10 monclient: _renew_subs 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f919c13cc40 con 0x7f919c08c020 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 10 monclient: _renew_subs 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f919c13b440 con 0x7f919c08c020 2026-02-12T17:28:24.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f918c003980 con 0x7f919c08c020 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f918c003ca0 con 0x7f919c08c020 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f9198ff9640 10 monclient: dump: 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.360 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f919a7fc640 4 set_mon_vals no callback set 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.345+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919c057300 con 0x7f919c08c020 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.346+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f918c003ef0 con 0x7f919c08c020 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.346+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f918c04ea30 con 0x7f919c08c020 2026-02-12T17:28:24.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.346+0000 7f919bfff640 10 monclient: get_auth_request con 0x7f916c03fae0 auth_method 0 2026-02-12T17:28:24.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.348+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f919c057300 con 0x7f919c08c020 2026-02-12T17:28:24.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.348+0000 7f9198ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.348+0000 7f9198ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:24.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.450+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f919c13be80 con 0x7f916c03fae0 2026-02-12T17:28:24.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.451+0000 7f9198ff9640 1 -- 10.20.193.57:0/2086081663 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34112 (unknown 2965378022 0 167459296) 0x7f919c13be80 con 0x7f916c03fae0 2026-02-12T17:28:24.449 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:24.450 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:28:24.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.452+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 >> v1:10.20.193.82:6800/2441377515 conn(0x7f916c03fae0 legacy=0x7f916c05ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.452+0000 7f91a2407640 10 monclient: shutdown 2026-02-12T17:28:24.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.452+0000 7f91a2407640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.452+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 >> v1:10.20.193.57:6789/0 conn(0x7f919c08c020 legacy=0x7f919c1395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.452+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 shutdown_connections 2026-02-12T17:28:24.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.452+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 >> 10.20.193.57:0/2086081663 conn(0x7f919c091620 msgr2=0x7f919c059420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.452+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 shutdown_connections 2026-02-12T17:28:24.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.452+0000 7f91a2407640 1 -- 10.20.193.57:0/2086081663 wait complete. 2026-02-12T17:28:24.458 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-12T17:28:23.827960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163704,"kb_used_data":1944,"kb_used_omap":48,"kb_used_meta":161615,"kb_avail":566067336,"statfs":{"total":579820584960,"available":579652952064,"internally_reserved":0,"allocated":1990656,"data_stored":1342726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50048,"internal_metadata":165493888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000488"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724309+0000","last_change":"2026-02-12T17:28:19.724309+0000","last_active":"2026-02-12T17:28:19.724309+0000","last_peered":"2026-02-12T17:28:19.724309+0000","last_clean":"2026-02-12T17:28:19.724309+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:28:19.724309+0000","last_undegraded":"2026-02-12T17:28:19.724309+0000","last_fullsized":"2026-02-12T17:28:19.724309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:21:16.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.289150+0000","last_change":"2026-02-12T17:28:19.289150+0000","last_active":"2026-02-12T17:28:19.289150+0000","last_peered":"2026-02-12T17:28:19.289150+0000","last_clean":"2026-02-12T17:28:19.289150+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:28:19.289150+0000","last_undegraded":"2026-02-12T17:28:19.289150+0000","last_fullsized":"2026-02-12T17:28:19.289150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:34:03.582232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724251+0000","last_change":"2026-02-12T17:28:19.724251+0000","last_active":"2026-02-12T17:28:19.724251+0000","last_peered":"2026-02-12T17:28:19.724251+0000","last_clean":"2026-02-12T17:28:19.724251+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:28:19.724251+0000","last_undegraded":"2026-02-12T17:28:19.724251+0000","last_fullsized":"2026-02-12T17:28:19.724251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:31:06.358030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.289250+0000","last_change":"2026-02-12T17:28:19.289250+0000","last_active":"2026-02-12T17:28:19.289250+0000","last_peered":"2026-02-12T17:28:19.289250+0000","last_clean":"2026-02-12T17:28:19.289250+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:28:19.289250+0000","last_undegraded":"2026-02-12T17:28:19.289250+0000","last_fullsized":"2026-02-12T17:28:19.289250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:19:32.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.284665+0000","last_change":"2026-02-12T17:28:19.283404+0000","last_active":"2026-02-12T17:28:19.284665+0000","last_peered":"2026-02-12T17:28:19.284665+0000","last_clean":"2026-02-12T17:28:19.284665+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:28:19.284665+0000","last_undegraded":"2026-02-12T17:28:19.284665+0000","last_fullsized":"2026-02-12T17:28:19.284665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:24:22.204036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.286905+0000","last_change":"2026-02-12T17:28:19.286905+0000","last_active":"2026-02-12T17:28:19.286905+0000","last_peered":"2026-02-12T17:28:19.286905+0000","last_clean":"2026-02-12T17:28:19.286905+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:28:19.286905+0000","last_undegraded":"2026-02-12T17:28:19.286905+0000","last_fullsized":"2026-02-12T17:28:19.286905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:35.531511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724210+0000","last_change":"2026-02-12T17:28:19.724210+0000","last_active":"2026-02-12T17:28:19.724210+0000","last_peered":"2026-02-12T17:28:19.724210+0000","last_clean":"2026-02-12T17:28:19.724210+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:28:19.724210+0000","last_undegraded":"2026-02-12T17:28:19.724210+0000","last_fullsized":"2026-02-12T17:28:19.724210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:54.193528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.283491+0000","last_change":"2026-02-12T17:28:19.283491+0000","last_active":"2026-02-12T17:28:19.283491+0000","last_peered":"2026-02-12T17:28:19.283491+0000","last_clean":"2026-02-12T17:28:19.283491+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:28:19.283491+0000","last_undegraded":"2026-02-12T17:28:19.283491+0000","last_fullsized":"2026-02-12T17:28:19.283491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:53.711374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.723942+0000","last_change":"2026-02-12T17:28:13.575533+0000","last_active":"2026-02-12T17:28:19.723942+0000","last_peered":"2026-02-12T17:28:19.723942+0000","last_clean":"2026-02-12T17:28:19.723942+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:28:19.723942+0000","last_undegraded":"2026-02-12T17:28:19.723942+0000","last_fullsized":"2026-02-12T17:28:19.723942+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_clean_scrub_stamp":"2026-02-12T17:28:11.958332+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:10:01.188074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":44720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":672,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":688128,"data_stored":577776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":664,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":679936,"data_stored":573648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:28:24.459 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:28:24.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient: get_monmap_and_config 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient: monmap: 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:24.527986+0000 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:24.527986+0000 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.526 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 1 Processor -- start 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 1 -- start start 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient: init 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f87b408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f87b408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f87b408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b408d600 con 0x7f87b408cb30 2026-02-12T17:28:24.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b408b1f0 con 0x7f87b408ae20 2026-02-12T17:28:24.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b408d1f0 con 0x7f87b408c730 2026-02-12T17:28:24.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.527+0000 7f87b8ccc640 10 monclient(hunting): authenticate will time out at 584.346910s 2026-02-12T17:28:24.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.528+0000 7f87b2d76640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f87b408cb30 0x7f87b41a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36224/0 (socket says 10.20.193.57:36224) 2026-02-12T17:28:24.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.528+0000 7f87b1d74640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f87b408c730 0x7f87b4181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45696/0 (socket says 10.20.193.57:45696) 2026-02-12T17:28:24.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.528+0000 7f87b2d76640 1 -- 10.20.193.57:0/458069393 learned_addr learned my addr 10.20.193.57:0/458069393 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1d74640 1 -- 10.20.193.57:0/458069393 >> v1:10.20.193.57:6790/0 conn(0x7f87b408c730 legacy=0x7f87b4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b2d76640 1 -- 10.20.193.57:0/458069393 >> v1:10.20.193.57:6789/0 conn(0x7f87b408cb30 legacy=0x7f87b41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317629539 0 0) 0x7f87b408d600 con 0x7f87b408cb30 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient(hunting): my global_id is 4431 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87a00035e0 con 0x7f87b408cb30 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094093459 0 0) 0x7f87b408d1f0 con 0x7f87b408c730 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient(hunting): my global_id is 4373 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87b408d600 con 0x7f87b408c730 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b2575640 1 -- 10.20.193.57:0/458069393 >> v1:10.20.193.82:6789/0 conn(0x7f87b408ae20 legacy=0x7f87b408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 722449471 0 0) 0x7f87a00035e0 con 0x7f87b408cb30 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 >> v1:10.20.193.57:6790/0 conn(0x7f87b408c730 legacy=0x7f87b4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 >> v1:10.20.193.82:6789/0 conn(0x7f87b408ae20 legacy=0x7f87b408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 monclient: found mon.noname-a 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b4057320 con 0x7f87b408cb30 2026-02-12T17:28:24.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f87a40041b0 con 0x7f87b408cb30 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: dump: 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.537 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b8ccc640 5 monclient: authenticate success, global_id 4431 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b8ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87a4004440 con 0x7f87b408cb30 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b8ccc640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b8ccc640 4 set_mon_vals no callback set 2026-02-12T17:28:24.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 1 -- 10.20.193.57:0/458069393 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f87a4005bf0 con 0x7f87b408cb30 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.530+0000 7f87b1573640 10 monclient: dump: 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.539 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient: shutdown 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 -- 10.20.193.57:0/458069393 >> v1:10.20.193.57:6789/0 conn(0x7f87b408cb30 legacy=0x7f87b41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 -- 10.20.193.57:0/458069393 shutdown_connections 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 -- 10.20.193.57:0/458069393 >> 10.20.193.57:0/458069393 conn(0x7f87b4091620 msgr2=0x7f87b4091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 -- 10.20.193.57:0/458069393 shutdown_connections 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 -- 10.20.193.57:0/458069393 wait complete. 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient: monmap: 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:24.540 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 Processor -- start 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 -- start start 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient: init 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f87b408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient(hunting): picked mon.noname-c con 0x7f87b408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient(hunting): picked mon.noname-b con 0x7f87b408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b408d9c0 con 0x7f87b408ae20 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b411d350 con 0x7f87b408cb30 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b405afb0 con 0x7f87b408c730 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b8ccc640 10 monclient(hunting): authenticate will time out at 584.350876s 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b2575640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f87b408ae20 0x7f87b41332f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36240/0 (socket says 10.20.193.57:36240) 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.531+0000 7f87b2575640 1 -- 10.20.193.57:0/1566364013 learned_addr learned my addr 10.20.193.57:0/1566364013 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b2575640 1 -- 10.20.193.57:0/1566364013 >> v1:10.20.193.57:6789/0 conn(0x7f87b408ae20 legacy=0x7f87b41332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b1d74640 1 -- 10.20.193.57:0/1566364013 >> v1:10.20.193.57:6790/0 conn(0x7f87b408c730 legacy=0x7f87b41a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b2575640 1 --1- 10.20.193.57:0/1566364013 >> v1:10.20.193.57:6789/0 conn(0x7f87b408ae20 0x7f87b41332f0 :-1 s=OPENED pgs=142 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f87b408d9c0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:24.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 598001222 0 0) 0x7f87b405afb0 con 0x7f87b408c730 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): my global_id is 4376 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b2d76640 1 -- 10.20.193.57:0/1566364013 >> v1:10.20.193.82:6789/0 conn(0x7f87b408cb30 legacy=0x7f87b41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87800035e0 con 0x7f87b408c730 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933908975 0 0) 0x7f87b411d350 con 0x7f87b408cb30 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): my global_id is 4393 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87b405afb0 con 0x7f87b408cb30 2026-02-12T17:28:24.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1249755499 0 0) 0x7f87800035e0 con 0x7f87b408c730 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87b411d350 con 0x7f87b408c730 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f879c002e10 con 0x7f87b408c730 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): dump: 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.544 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3263635286 0 0) 0x7f87b411d350 con 0x7f87b408c730 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 >> v1:10.20.193.82:6789/0 conn(0x7f87b408cb30 legacy=0x7f87b41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 >> v1:10.20.193.57:6789/0 conn(0x7f87b408ae20 legacy=0x7f87b41332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 monclient: found mon.c 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b405cb50 con 0x7f87b408c730 2026-02-12T17:28:24.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1091935765 0 0) 0x7f87b408d9c0 con 0x7f87b408ae20 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b8ccc640 5 monclient: authenticate success, global_id 4376 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b8ccc640 10 monclient: _renew_subs 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b8ccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f87b411eb80 con 0x7f87b408c730 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b8ccc640 10 monclient: _renew_subs 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b8ccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f87b4123670 con 0x7f87b408c730 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f879c003020 con 0x7f87b408c730 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f879c004d00 con 0x7f87b408c730 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f879affd640 10 monclient: dump: 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.547 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.534+0000 7f87b0d72640 4 set_mon_vals no callback set 2026-02-12T17:28:24.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.535+0000 7f87b8ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.535+0000 7f87b8ccc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.535+0000 7f87b8ccc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.535+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b4126b90 con 0x7f87b408c730 2026-02-12T17:28:24.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.535+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f879c011a60 con 0x7f87b408c730 2026-02-12T17:28:24.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.535+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f879c04ea00 con 0x7f87b408c730 2026-02-12T17:28:24.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.535+0000 7f87b2575640 10 monclient: get_auth_request con 0x7f878003f7a0 auth_method 0 2026-02-12T17:28:24.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.537+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f879c0172b0 con 0x7f87b408c730 2026-02-12T17:28:24.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.537+0000 7f879affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.537+0000 7f879affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:24.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.639+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87b408d840 con 0x7f878003f7a0 2026-02-12T17:28:24.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.640+0000 7f879affd640 1 -- 10.20.193.57:0/1566364013 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34112 (unknown 2965378022 0 167459296) 0x7f87a80031b0 con 0x7f878003f7a0 2026-02-12T17:28:24.638 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:28:24.639 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:28:24.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.641+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 >> v1:10.20.193.82:6800/2441377515 conn(0x7f878003f7a0 legacy=0x7f878005fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.641+0000 7f87b8ccc640 10 monclient: shutdown 2026-02-12T17:28:24.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.641+0000 7f87b8ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.641+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 >> v1:10.20.193.57:6790/0 conn(0x7f87b408c730 legacy=0x7f87b41a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.641+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 shutdown_connections 2026-02-12T17:28:24.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.641+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 >> 10.20.193.57:0/1566364013 conn(0x7f87b4091620 msgr2=0x7f87b4125cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.641+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 shutdown_connections 2026-02-12T17:28:24.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.641+0000 7f87b8ccc640 1 -- 10.20.193.57:0/1566364013 wait complete. 2026-02-12T17:28:24.646 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-12T17:28:23.827960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163704,"kb_used_data":1944,"kb_used_omap":48,"kb_used_meta":161615,"kb_avail":566067336,"statfs":{"total":579820584960,"available":579652952064,"internally_reserved":0,"allocated":1990656,"data_stored":1342726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50048,"internal_metadata":165493888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000488"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724309+0000","last_change":"2026-02-12T17:28:19.724309+0000","last_active":"2026-02-12T17:28:19.724309+0000","last_peered":"2026-02-12T17:28:19.724309+0000","last_clean":"2026-02-12T17:28:19.724309+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:28:19.724309+0000","last_undegraded":"2026-02-12T17:28:19.724309+0000","last_fullsized":"2026-02-12T17:28:19.724309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:21:16.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.289150+0000","last_change":"2026-02-12T17:28:19.289150+0000","last_active":"2026-02-12T17:28:19.289150+0000","last_peered":"2026-02-12T17:28:19.289150+0000","last_clean":"2026-02-12T17:28:19.289150+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:28:19.289150+0000","last_undegraded":"2026-02-12T17:28:19.289150+0000","last_fullsized":"2026-02-12T17:28:19.289150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:34:03.582232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724251+0000","last_change":"2026-02-12T17:28:19.724251+0000","last_active":"2026-02-12T17:28:19.724251+0000","last_peered":"2026-02-12T17:28:19.724251+0000","last_clean":"2026-02-12T17:28:19.724251+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:28:19.724251+0000","last_undegraded":"2026-02-12T17:28:19.724251+0000","last_fullsized":"2026-02-12T17:28:19.724251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:31:06.358030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.289250+0000","last_change":"2026-02-12T17:28:19.289250+0000","last_active":"2026-02-12T17:28:19.289250+0000","last_peered":"2026-02-12T17:28:19.289250+0000","last_clean":"2026-02-12T17:28:19.289250+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:28:19.289250+0000","last_undegraded":"2026-02-12T17:28:19.289250+0000","last_fullsized":"2026-02-12T17:28:19.289250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:19:32.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.284665+0000","last_change":"2026-02-12T17:28:19.283404+0000","last_active":"2026-02-12T17:28:19.284665+0000","last_peered":"2026-02-12T17:28:19.284665+0000","last_clean":"2026-02-12T17:28:19.284665+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:28:19.284665+0000","last_undegraded":"2026-02-12T17:28:19.284665+0000","last_fullsized":"2026-02-12T17:28:19.284665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:24:22.204036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.286905+0000","last_change":"2026-02-12T17:28:19.286905+0000","last_active":"2026-02-12T17:28:19.286905+0000","last_peered":"2026-02-12T17:28:19.286905+0000","last_clean":"2026-02-12T17:28:19.286905+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:28:19.286905+0000","last_undegraded":"2026-02-12T17:28:19.286905+0000","last_fullsized":"2026-02-12T17:28:19.286905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:35.531511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.724210+0000","last_change":"2026-02-12T17:28:19.724210+0000","last_active":"2026-02-12T17:28:19.724210+0000","last_peered":"2026-02-12T17:28:19.724210+0000","last_clean":"2026-02-12T17:28:19.724210+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:28:19.724210+0000","last_undegraded":"2026-02-12T17:28:19.724210+0000","last_fullsized":"2026-02-12T17:28:19.724210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:54.193528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.283491+0000","last_change":"2026-02-12T17:28:19.283491+0000","last_active":"2026-02-12T17:28:19.283491+0000","last_peered":"2026-02-12T17:28:19.283491+0000","last_clean":"2026-02-12T17:28:19.283491+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:28:19.283491+0000","last_undegraded":"2026-02-12T17:28:19.283491+0000","last_fullsized":"2026-02-12T17:28:19.283491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:53.711374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T17:28:19.723942+0000","last_change":"2026-02-12T17:28:13.575533+0000","last_active":"2026-02-12T17:28:19.723942+0000","last_peered":"2026-02-12T17:28:19.723942+0000","last_clean":"2026-02-12T17:28:19.723942+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:28:19.723942+0000","last_undegraded":"2026-02-12T17:28:19.723942+0000","last_fullsized":"2026-02-12T17:28:19.723942+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_clean_scrub_stamp":"2026-02-12T17:28:11.958332+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:10:01.188074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":44720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":672,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":688128,"data_stored":577776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":664,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":679936,"data_stored":573648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:28:24.647 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-12T17:28:24.648 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_netsplit_grace_period 30 2026-02-12T17:28:24.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.716+0000 7f337a388640 10 monclient: get_monmap_and_config 2026-02-12T17:28:24.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.716+0000 7f337a388640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.716+0000 7f337a388640 10 monclient: monmap: 2026-02-12T17:28:24.716 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.716 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.716 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:24.717779+0000 2026-02-12T17:28:24.716 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:24.717779+0000 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 1 Processor -- start 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 1 -- start start 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 10 monclient: init 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 10 monclient(hunting): picked mon.noname-a con 0x7f337408c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 10 monclient(hunting): picked mon.noname-c con 0x7f337408c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 10 monclient(hunting): picked mon.noname-b con 0x7f3374182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337408a820 con 0x7f337408c250 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3374089450 con 0x7f337408c620 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3374089730 con 0x7f3374182cc0 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f337a388640 10 monclient(hunting): authenticate will time out at 584.536667s 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f3373fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f337408c250 0x7f337408a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36250/0 (socket says 10.20.193.57:36250) 2026-02-12T17:28:24.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.717+0000 7f3373fff640 1 -- 10.20.193.57:0/768142371 learned_addr learned my addr 10.20.193.57:0/768142371 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.719+0000 7f33788fe640 1 -- 10.20.193.57:0/768142371 >> v1:10.20.193.57:6790/0 conn(0x7f3374182cc0 legacy=0x7f33741a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.719+0000 7f3373fff640 1 -- 10.20.193.57:0/768142371 >> v1:10.20.193.57:6789/0 conn(0x7f337408c250 legacy=0x7f337408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f33737fe640 1 -- 10.20.193.57:0/768142371 >> v1:10.20.193.82:6789/0 conn(0x7f337408c620 legacy=0x7f337408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402956824 0 0) 0x7f3360002b50 con 0x7f337408c250 2026-02-12T17:28:24.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): my global_id is 4437 2026-02-12T17:28:24.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33580035e0 con 0x7f337408c250 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426574263 0 0) 0x7f3374089730 con 0x7f3374182cc0 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): my global_id is 4379 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3360002b50 con 0x7f3374182cc0 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1003354723 0 0) 0x7f3374089450 con 0x7f337408c620 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient(hunting): my global_id is 4396 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3374089730 con 0x7f337408c620 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3453357074 0 0) 0x7f33580035e0 con 0x7f337408c250 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 >> v1:10.20.193.57:6790/0 conn(0x7f3374182cc0 legacy=0x7f33741a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 >> v1:10.20.193.82:6789/0 conn(0x7f337408c620 legacy=0x7f337408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 monclient: found mon.noname-a 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3374089a10 con 0x7f337408c250 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3360003210 con 0x7f337408c250 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: dump: 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.730 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 5 monclient: authenticate success, global_id 4437 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3360003460 con 0x7f337408c250 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 1 -- 10.20.193.57:0/768142371 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3360004b10 con 0x7f337408c250 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f3372ffd640 10 monclient: dump: 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.731 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 4 set_mon_vals no callback set 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 10 monclient: shutdown 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 1 -- 10.20.193.57:0/768142371 >> v1:10.20.193.57:6789/0 conn(0x7f337408c250 legacy=0x7f337408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 1 -- 10.20.193.57:0/768142371 shutdown_connections 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 1 -- 10.20.193.57:0/768142371 >> 10.20.193.57:0/768142371 conn(0x7f33740916b0 msgr2=0x7f3374091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 1 -- 10.20.193.57:0/768142371 shutdown_connections 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.720+0000 7f337a388640 1 -- 10.20.193.57:0/768142371 wait complete. 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient: monmap: 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.733 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 1 Processor -- start 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 1 -- start start 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient: init 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient(hunting): picked mon.noname-b con 0x7f337408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient(hunting): picked mon.noname-a con 0x7f337408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient(hunting): picked mon.noname-c con 0x7f3374182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337405db00 con 0x7f337408c620 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3374086540 con 0x7f337408c250 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337413e900 con 0x7f3374182cc0 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f337a388640 10 monclient(hunting): authenticate will time out at 584.540733s 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f33737fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f337408c620 0x7f3374085e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36264/0 (socket says 10.20.193.57:36264) 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.721+0000 7f33737fe640 1 -- 10.20.193.57:0/4194218407 learned_addr learned my addr 10.20.193.57:0/4194218407 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.723+0000 7f33737fe640 1 -- 10.20.193.57:0/4194218407 >> v1:10.20.193.57:6789/0 conn(0x7f337408c620 legacy=0x7f3374085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.723+0000 7f33788fe640 1 -- 10.20.193.57:0/4194218407 >> v1:10.20.193.57:6790/0 conn(0x7f3374182cc0 legacy=0x7f3374195460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.723+0000 7f3373fff640 1 -- 10.20.193.57:0/4194218407 >> v1:10.20.193.82:6789/0 conn(0x7f337408c250 legacy=0x7f3374085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3765158317 0 0) 0x7f337405db00 con 0x7f337408c620 2026-02-12T17:28:24.735 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): my global_id is 4440 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33440035e0 con 0x7f337408c620 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1084417776 0 0) 0x7f337413e900 con 0x7f3374182cc0 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): my global_id is 4382 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337405db00 con 0x7f3374182cc0 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266509629 0 0) 0x7f3374086540 con 0x7f337408c250 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): my global_id is 4399 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f337413e900 con 0x7f337408c250 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3430871860 0 0) 0x7f337405db00 con 0x7f3374182cc0 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3374086540 con 0x7f3374182cc0 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f33680047b0 con 0x7f3374182cc0 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): dump: 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.737 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2563208560 0 0) 0x7f33440035e0 con 0x7f337408c620 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f337405db00 con 0x7f337408c620 2026-02-12T17:28:24.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f33640033b0 con 0x7f337408c620 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): dump: 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.739 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1315940003 0 0) 0x7f337413e900 con 0x7f337408c250 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33440035e0 con 0x7f337408c250 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3360003060 con 0x7f337408c250 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient(hunting): dump: 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.740 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1030542766 0 0) 0x7f3374086540 con 0x7f3374182cc0 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 >> v1:10.20.193.82:6789/0 conn(0x7f337408c250 legacy=0x7f3374085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 >> v1:10.20.193.57:6789/0 conn(0x7f337408c620 legacy=0x7f3374085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 monclient: found mon.c 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337413ed30 con 0x7f3374182cc0 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f337a388640 5 monclient: authenticate success, global_id 4382 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f337a388640 10 monclient: _renew_subs 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f337a388640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f33740888a0 con 0x7f3374182cc0 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f337a388640 10 monclient: _renew_subs 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f337a388640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f337413e3a0 con 0x7f3374182cc0 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3368004c00 con 0x7f3374182cc0 2026-02-12T17:28:24.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3368004f90 con 0x7f3374182cc0 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f3370ff9640 10 monclient: dump: 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.743 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f33727fc640 4 set_mon_vals no callback set 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.724+0000 7f337a388640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.725+0000 7f337a388640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.725+0000 7f337a388640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.725+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3374090810 con 0x7f3374182cc0 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.725+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3368005130 con 0x7f3374182cc0 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.725+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f336804fa20 con 0x7f3374182cc0 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.725+0000 7f3373fff640 10 monclient: get_auth_request con 0x7f3344040020 auth_method 0 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.728+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3368017c60 con 0x7f3374182cc0 2026-02-12T17:28:24.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.728+0000 7f3370ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:24.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.728+0000 7f3370ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:24.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.832+0000 7f337a388640 10 start_mon_command cmd=[{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-12T17:28:24.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.832+0000 7f337a388640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-12T17:28:24.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.832+0000 7f337a388640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.832+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 --> v1:10.20.193.57:6790/0 -- mon_command([{prefix=config set, name=mon_netsplit_grace_period}] v 0) -- 0x7f3374086930 con 0x7f3374182cc0 2026-02-12T17:28:24.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.835+0000 7f3370ff9640 1 -- 10.20.193.57:0/4194218407 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{prefix=config set, name=mon_netsplit_grace_period}]=0 v2)=0 v2) ==== 124+0+0 (unknown 948039188 0 0) 0x7f3368017a80 con 0x7f3374182cc0 2026-02-12T17:28:24.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.835+0000 7f3370ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-12T17:28:24.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.835+0000 7f3370ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:24.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.836+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 >> v1:10.20.193.82:6800/2441377515 conn(0x7f3344040020 legacy=0x7f33440604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.836+0000 7f337a388640 10 monclient: shutdown 2026-02-12T17:28:24.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.836+0000 7f337a388640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.836+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 >> v1:10.20.193.57:6790/0 conn(0x7f3374182cc0 legacy=0x7f3374195460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.836+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 shutdown_connections 2026-02-12T17:28:24.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.836+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 >> 10.20.193.57:0/4194218407 conn(0x7f33740916b0 msgr2=0x7f337408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.836+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 shutdown_connections 2026-02-12T17:28:24.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.836+0000 7f337a388640 1 -- 10.20.193.57:0/4194218407 wait complete. 2026-02-12T17:28:24.843 DEBUG:tasks.mon_thrash:Yielding 2026-02-12T17:28:24.843 INFO:teuthology.run_tasks:Running task rados... 2026-02-12T17:28:24.866 INFO:tasks.rados:Beginning rados... 2026-02-12T17:28:24.866 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-12T17:28:24.866 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-yuri4-testing-2026-02-11-2126'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore debug onode segmentation random': True, 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)'], 'mon_bind_msgr2': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2026-02-11-2126', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-12T17:28:24.866 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-12T17:28:24.867 DEBUG:teuthology.run_tasks:Unwinding manager rados 2026-02-12T17:28:24.882 INFO:tasks.rados:joining rados 2026-02-12T17:28:24.882 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-12T17:28:24.882 INFO:tasks.mon_thrash.mon_thrasher:seed: 1770917304, revive delay: 90.0, thrash delay: 1.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-12T17:28:24.883 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:28:24.883 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:28:24.883 INFO:tasks.rados:clients are ['client.0'] 2026-02-12T17:28:24.884 INFO:tasks.rados:starting run 0 out of 1 2026-02-12T17:28:24.884 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-12T17:28:24.884 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-12T17:28:24.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.951+0000 7f15faa8c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:24.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.951+0000 7f15faa8c640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.951+0000 7f15faa8c640 10 monclient: monmap: 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:24.952166+0000 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:24.952166+0000 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:24.951 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.951+0000 7f15faa8c640 1 Processor -- start 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.951+0000 7f15faa8c640 1 -- start start 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.951+0000 7f15faa8c640 10 monclient: init 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 10 monclient(hunting): picked mon.noname-a con 0x7f15f408c8d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 10 monclient(hunting): picked mon.noname-b con 0x7f15f408d3b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 10 monclient(hunting): picked mon.noname-c con 0x7f15f408b320 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f4088fe0 con 0x7f15f408c8d0 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f408a3f0 con 0x7f15f408b320 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f408b7a0 con 0x7f15f408d3b0 2026-02-12T17:28:24.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.953 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15faa8c640 10 monclient(hunting): authenticate will time out at 584.771075s 2026-02-12T17:28:24.953 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15ebfff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f15f408d3b0 0x7f15f4183d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45726/0 (socket says 10.20.193.57:45726) 2026-02-12T17:28:24.953 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15ebfff640 1 -- 10.20.193.57:0/2241246868 learned_addr learned my addr 10.20.193.57:0/2241246868 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.953 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.952+0000 7f15f8801640 1 --1- 10.20.193.57:0/2241246868 >> v1:10.20.193.57:6789/0 conn(0x7f15f408c8d0 0x7f15f408cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36278/0 (socket says 10.20.193.57:36278) 2026-02-12T17:28:24.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.953+0000 7fad5bf65640 10 monclient: get_monmap_and_config 2026-02-12T17:28:24.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.953+0000 7fad5bf65640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.953+0000 7fad5bf65640 10 monclient: monmap: 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:24.954170+0000 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:24.954170+0000 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:24.955 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.953+0000 7fad5bf65640 1 Processor -- start 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.953+0000 7fad5bf65640 1 -- start start 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.953+0000 7fad5bf65640 10 monclient: init 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 10 monclient(hunting): picked mon.noname-a con 0x7fad540906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 10 monclient(hunting): picked mon.noname-c con 0x7fad540911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 10 monclient(hunting): picked mon.noname-b con 0x7fad54185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad54090100 con 0x7fad540906d0 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad54091a70 con 0x7fad540911b0 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad54092360 con 0x7fad54185070 2026-02-12T17:28:24.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad5bf65640 10 monclient(hunting): authenticate will time out at 584.773223s 2026-02-12T17:28:24.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15ebfff640 1 -- 10.20.193.57:0/2241246868 >> v1:10.20.193.57:6790/0 conn(0x7f15f408d3b0 legacy=0x7f15f4183d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15f8801640 1 -- 10.20.193.57:0/2241246868 >> v1:10.20.193.57:6789/0 conn(0x7f15f408c8d0 legacy=0x7f15f408cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad594d9640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7fad540911b0 0x7fad54183950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:40158/0 (socket says 10.20.193.57:40158) 2026-02-12T17:28:24.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad594d9640 1 -- 10.20.193.57:0/790034361 learned_addr learned my addr 10.20.193.57:0/790034361 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7fad59cda640 1 --1- 10.20.193.57:0/790034361 >> v1:10.20.193.57:6789/0 conn(0x7fad540906d0 0x7fad54090aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36280/0 (socket says 10.20.193.57:36280) 2026-02-12T17:28:24.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15f9002640 1 -- 10.20.193.57:0/2241246868 >> v1:10.20.193.82:6789/0 conn(0x7f15f408b320 legacy=0x7f15f41a5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 -- 10.20.193.57:0/2241246868 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156898368 0 0) 0x7f15f408b7a0 con 0x7f15f408d3b0 2026-02-12T17:28:24.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient(hunting): my global_id is 4385 2026-02-12T17:28:24.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 -- 10.20.193.57:0/2241246868 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e00035e0 con 0x7f15f408d3b0 2026-02-12T17:28:24.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 -- 10.20.193.57:0/2241246868 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1260542953 0 0) 0x7f15e00035e0 con 0x7f15f408d3b0 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 -- 10.20.193.57:0/2241246868 >> v1:10.20.193.82:6789/0 conn(0x7f15f408b320 legacy=0x7f15f41a5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 -- 10.20.193.57:0/2241246868 >> v1:10.20.193.57:6789/0 conn(0x7f15f408c8d0 legacy=0x7f15f408cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 monclient: found mon.noname-b 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 -- 10.20.193.57:0/2241246868 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40885d0 con 0x7f15f408d3b0 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 -- 10.20.193.57:0/2241246868 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f15dc003150 con 0x7f15f408d3b0 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: dump: 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.963 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15faa8c640 5 monclient: authenticate success, global_id 4385 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15faa8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 -- 10.20.193.57:0/2241246868 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15dc003390 con 0x7f15f408d3b0 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 1 -- 10.20.193.57:0/2241246868 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f15dc004b10 con 0x7f15f408d3b0 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15eb7fe640 10 monclient: dump: 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.964 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15faa8c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15faa8c640 4 set_mon_vals no callback set 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15faa8c640 10 monclient: shutdown 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15faa8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.954+0000 7f15faa8c640 1 -- 10.20.193.57:0/2241246868 >> v1:10.20.193.57:6790/0 conn(0x7f15f408d3b0 legacy=0x7f15f4183d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 1 -- 10.20.193.57:0/2241246868 shutdown_connections 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 1 -- 10.20.193.57:0/2241246868 >> 10.20.193.57:0/2241246868 conn(0x7f15f4091620 msgr2=0x7f15f4091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 1 -- 10.20.193.57:0/2241246868 shutdown_connections 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 1 -- 10.20.193.57:0/2241246868 wait complete. 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient: monmap: 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.966 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 1 Processor -- start 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 1 -- start start 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient: init 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient(hunting): picked mon.noname-a con 0x7f15f408b320 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient(hunting): picked mon.noname-b con 0x7f15f408c8d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient(hunting): picked mon.noname-c con 0x7f15f408d3b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f407f840 con 0x7f15f408b320 2026-02-12T17:28:24.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f4088810 con 0x7f15f408c8d0 2026-02-12T17:28:24.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f407e350 con 0x7f15f408d3b0 2026-02-12T17:28:24.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15faa8c640 10 monclient(hunting): authenticate will time out at 584.774842s 2026-02-12T17:28:24.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15f8801640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f15f408b320 0x7f15f407c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36286/0 (socket says 10.20.193.57:36286) 2026-02-12T17:28:24.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.955+0000 7f15f8801640 1 -- 10.20.193.57:0/338233434 learned_addr learned my addr 10.20.193.57:0/338233434 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad59cda640 1 -- 10.20.193.57:0/790034361 >> v1:10.20.193.57:6789/0 conn(0x7fad540906d0 legacy=0x7fad54090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad594d9640 1 -- 10.20.193.57:0/790034361 >> v1:10.20.193.82:6789/0 conn(0x7fad540911b0 legacy=0x7fad54183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad5a4db640 1 -- 10.20.193.57:0/790034361 >> v1:10.20.193.57:6790/0 conn(0x7fad54185070 legacy=0x7fad541a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115426037 0 0) 0x7fad54090100 con 0x7fad540906d0 2026-02-12T17:28:24.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient(hunting): my global_id is 4446 2026-02-12T17:28:24.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad3c0035e0 con 0x7fad540906d0 2026-02-12T17:28:24.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122394346 0 0) 0x7fad54091a70 con 0x7fad540911b0 2026-02-12T17:28:24.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient(hunting): my global_id is 4405 2026-02-12T17:28:24.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad54090100 con 0x7fad540911b0 2026-02-12T17:28:24.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1502402883 0 0) 0x7fad3c0035e0 con 0x7fad540906d0 2026-02-12T17:28:24.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 >> v1:10.20.193.57:6790/0 conn(0x7fad54185070 legacy=0x7fad541a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 >> v1:10.20.193.82:6789/0 conn(0x7fad540911b0 legacy=0x7fad54183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 monclient: found mon.noname-a 2026-02-12T17:28:24.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5405cf80 con 0x7fad540906d0 2026-02-12T17:28:24.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fad44003150 con 0x7fad540906d0 2026-02-12T17:28:24.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:24.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: dump: 2026-02-12T17:28:24.978 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.978 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.978 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.979 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.979 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.979 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.979 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.979 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.979 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.979 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad5bf65640 5 monclient: authenticate success, global_id 4446 2026-02-12T17:28:24.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad5bf65640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:24.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad440033a0 con 0x7fad540906d0 2026-02-12T17:28:24.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:24.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad5bf65640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:24.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad5bf65640 4 set_mon_vals no callback set 2026-02-12T17:28:24.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 1 -- 10.20.193.57:0/790034361 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fad44004a50 con 0x7fad540906d0 2026-02-12T17:28:24.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:24.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:24.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.956+0000 7fad58cd8640 10 monclient: dump: 2026-02-12T17:28:24.981 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.981 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.981 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.982 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.982 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.982 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.982 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.982 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.982 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.982 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 10 monclient: shutdown 2026-02-12T17:28:24.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:24.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 1 -- 10.20.193.57:0/790034361 >> v1:10.20.193.57:6789/0 conn(0x7fad540906d0 legacy=0x7fad54090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 1 -- 10.20.193.57:0/790034361 shutdown_connections 2026-02-12T17:28:24.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 1 -- 10.20.193.57:0/790034361 >> 10.20.193.57:0/790034361 conn(0x7fad54054330 msgr2=0x7fad54054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:24.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 1 -- 10.20.193.57:0/790034361 shutdown_connections 2026-02-12T17:28:24.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 1 -- 10.20.193.57:0/790034361 wait complete. 2026-02-12T17:28:24.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 10 monclient: build_initial_monmap 2026-02-12T17:28:24.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 10 monclient: monmap: 2026-02-12T17:28:24.984 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:24.984 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:24.984 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:24.984 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:24.984 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:24.985 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:24.985 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:24.985 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:24.985 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:24.985 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7f15f9002640 1 -- 10.20.193.57:0/338233434 >> v1:10.20.193.57:6790/0 conn(0x7f15f408d3b0 legacy=0x7f15f407d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.957+0000 7fad5bf65640 1 Processor -- start 2026-02-12T17:28:24.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15f8801640 1 -- 10.20.193.57:0/338233434 >> v1:10.20.193.57:6789/0 conn(0x7f15f408b320 legacy=0x7f15f407c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 1 -- start start 2026-02-12T17:28:24.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 10 monclient: init 2026-02-12T17:28:24.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682285104 0 0) 0x7f15f407f840 con 0x7f15f408b320 2026-02-12T17:28:24.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): my global_id is 4449 2026-02-12T17:28:24.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c40035e0 con 0x7f15f408b320 2026-02-12T17:28:24.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15ebfff640 1 -- 10.20.193.57:0/338233434 >> v1:10.20.193.82:6789/0 conn(0x7f15f408c8d0 legacy=0x7f15f407d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:24.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:24.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:24.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 10 monclient(hunting): picked mon.noname-b con 0x7fad540906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:24.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 10 monclient(hunting): picked mon.noname-a con 0x7fad540911b0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:24.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 10 monclient(hunting): picked mon.noname-c con 0x7fad54185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:24.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad54134190 con 0x7fad540911b0 2026-02-12T17:28:24.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad541339b0 con 0x7fad540906d0 2026-02-12T17:28:24.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad54130c90 con 0x7fad54185070 2026-02-12T17:28:24.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:24.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5bf65640 10 monclient(hunting): authenticate will time out at 584.777321s 2026-02-12T17:28:24.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4290831101 0 0) 0x7f15c40035e0 con 0x7f15f408b320 2026-02-12T17:28:24.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15f407f840 con 0x7f15f408b320 2026-02-12T17:28:24.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f15e4003390 con 0x7f15f408b320 2026-02-12T17:28:24.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:24.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5a4db640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fad54185070 0x7fad54174c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45770/0 (socket says 10.20.193.57:45770) 2026-02-12T17:28:24.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7fad5a4db640 1 -- 10.20.193.57:0/3338203984 learned_addr learned my addr 10.20.193.57:0/3338203984 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:24.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:24.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): dump: 2026-02-12T17:28:24.996 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:24.996 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:24.996 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.996 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:24.996 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:24.996 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:24.996 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:24.996 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:24.997 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:24.997 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:24.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:24.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733057792 0 0) 0x7f15f4088810 con 0x7f15f408c8d0 2026-02-12T17:28:24.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:24.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:24.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:24.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient(hunting): my global_id is 4408 2026-02-12T17:28:24.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c40035e0 con 0x7f15f408c8d0 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 986662224 0 0) 0x7f15f407f840 con 0x7f15f408b320 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 >> v1:10.20.193.57:6790/0 conn(0x7f15f408d3b0 legacy=0x7f15f407d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 >> v1:10.20.193.82:6789/0 conn(0x7f15f408c8d0 legacy=0x7f15f407d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 monclient: found mon.a 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40806b0 con 0x7f15f408b320 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:24.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15faa8c640 5 monclient: authenticate success, global_id 4449 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15faa8c640 10 monclient: _renew_subs 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15faa8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f15f407fe10 con 0x7f15f408b320 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15faa8c640 10 monclient: _renew_subs 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15faa8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f15f407f050 con 0x7f15f408b320 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15e4004b50 con 0x7f15f408b320 2026-02-12T17:28:24.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f15e4004e70 con 0x7f15f408b320 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15eaffd640 4 set_mon_vals no callback set 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15e97fa640 10 monclient: dump: 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.000 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.958+0000 7f15faa8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.959+0000 7f15faa8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.959+0000 7f15faa8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.959+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f40008d0 con 0x7f15f408b320 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.959+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f15e40050c0 con 0x7f15f408b320 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.959+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f15e404eba0 con 0x7f15f408b320 2026-02-12T17:28:25.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.959+0000 7f15ebfff640 10 monclient: get_auth_request con 0x7f15c403f8a0 auth_method 0 2026-02-12T17:28:25.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad594d9640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6789/0 conn(0x7fad540911b0 legacy=0x7fad54130580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad5a4db640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6790/0 conn(0x7fad54185070 legacy=0x7fad54174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380867998 0 0) 0x7fad54130c90 con 0x7fad54185070 2026-02-12T17:28:25.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): my global_id is 4388 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad240035e0 con 0x7fad54185070 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad59cda640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.82:6789/0 conn(0x7fad540906d0 legacy=0x7fad5412fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 643952789 0 0) 0x7fad240035e0 con 0x7fad54185070 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad54130c90 con 0x7fad54185070 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fad500044c0 con 0x7fad54185070 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): dump: 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.005 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603061251 0 0) 0x7fad541339b0 con 0x7fad540906d0 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 10 monclient(hunting): my global_id is 4411 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad240035e0 con 0x7fad540906d0 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.960+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2266938215 0 0) 0x7fad54130c90 con 0x7fad54185070 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.82:6789/0 conn(0x7fad540906d0 legacy=0x7fad5412fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6789/0 conn(0x7fad540911b0 legacy=0x7fad54130580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 1 monclient: found mon.c 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad54133c90 con 0x7fad54185070 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:25.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 5 monclient: authenticate success, global_id 4388 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 10 monclient: _renew_subs 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad5408f400 con 0x7fad54185070 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 10 monclient: _renew_subs 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fad54132e20 con 0x7fad54185070 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad50004a60 con 0x7fad54185070 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fad50004db0 con 0x7fad54185070 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 10 monclient: dump: 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad43fff640 4 set_mon_vals no callback set 2026-02-12T17:28:25.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f15e40055e0 con 0x7f15f408b320 2026-02-12T17:28:25.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7f15e97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7f15e97fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad540008d0 con 0x7fad54185070 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.961+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fad50004f10 con 0x7fad54185070 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.962+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7fad5004faf0 con 0x7fad54185070 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.962+0000 7fad59cda640 10 monclient: get_auth_request con 0x7fad2403f880 auth_method 0 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.964+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fad500055b0 con 0x7fad54185070 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.964+0000 7fad427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:24.964+0000 7fad427fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:25.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.070+0000 7fad5bf65640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-12T17:28:25.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.070+0000 7fad5bf65640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-12T17:28:25.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.070+0000 7fad5bf65640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.070+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} v 0) -- 0x7fad54092c50 con 0x7fad54185070 2026-02-12T17:28:25.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.106+0000 7f15faa8c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:28:25.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.106+0000 7f15faa8c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:28:25.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.106+0000 7f15faa8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:25.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.106+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f15f408c280 con 0x7f15f408b320 2026-02-12T17:28:25.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.106+0000 7f15e97fa640 1 -- 10.20.193.57:0/338233434 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 1521126158) 0x7f15e4016c00 con 0x7f15f408b320 2026-02-12T17:28:25.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.106+0000 7f15e97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:28:25.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.106+0000 7f15e97fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:25.105 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:28:25.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.107+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 >> v1:10.20.193.82:6800/2441377515 conn(0x7f15c403f8a0 legacy=0x7f15c405fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.107+0000 7f15faa8c640 10 monclient: shutdown 2026-02-12T17:28:25.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.107+0000 7f15faa8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:25.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.107+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 >> v1:10.20.193.57:6789/0 conn(0x7f15f408b320 legacy=0x7f15f407c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.107+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 shutdown_connections 2026-02-12T17:28:25.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.107+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 >> 10.20.193.57:0/338233434 conn(0x7f15f4091620 msgr2=0x7f15f4126af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:25.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.108+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 shutdown_connections 2026-02-12T17:28:25.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.108+0000 7f15faa8c640 1 -- 10.20.193.57:0/338233434 wait complete. 2026-02-12T17:28:25.114 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:28:25.114 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:28:25.114 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:28:25.114 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.222+0000 7fbccb65b640 10 monclient: get_monmap_and_config 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.222+0000 7fbccb65b640 10 monclient: build_initial_monmap 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.222+0000 7fbccb65b640 10 monclient: monmap: 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:25.223192+0000 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:25.223192+0000 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.220 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:25.221 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:25.221 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:25.221 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.222+0000 7fbccb65b640 1 Processor -- start 2026-02-12T17:28:25.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.222+0000 7fbccb65b640 1 -- start start 2026-02-12T17:28:25.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.222+0000 7fbccb65b640 10 monclient: init 2026-02-12T17:28:25.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.222+0000 7fbccb65b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:25.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbccb65b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:25.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbccb65b640 10 monclient(hunting): picked mon.noname-c con 0x7fbcc408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:25.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbccb65b640 10 monclient(hunting): picked mon.noname-a con 0x7fbcc408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:25.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbccb65b640 10 monclient(hunting): picked mon.noname-b con 0x7fbcc4182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:25.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbccb65b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc408a820 con 0x7fbcc408c620 2026-02-12T17:28:25.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbccb65b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc4089450 con 0x7fbcc408c250 2026-02-12T17:28:25.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbccb65b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc4089730 con 0x7fbcc4182cc0 2026-02-12T17:28:25.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbccb65b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:25.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbccb65b640 10 monclient(hunting): authenticate will time out at 585.042058s 2026-02-12T17:28:25.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbcc9bd1640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbcc4182cc0 0x7fbcc41a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45776/0 (socket says 10.20.193.57:45776) 2026-02-12T17:28:25.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.223+0000 7fbcc9bd1640 1 -- 10.20.193.57:0/1652875339 learned_addr learned my addr 10.20.193.57:0/1652875339 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcc9bd1640 1 -- 10.20.193.57:0/1652875339 >> v1:10.20.193.57:6790/0 conn(0x7fbcc4182cc0 legacy=0x7fbcc41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcc8bcf640 1 -- 10.20.193.57:0/1652875339 >> v1:10.20.193.57:6789/0 conn(0x7fbcc408c620 legacy=0x7fbcc408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcc93d0640 1 -- 10.20.193.57:0/1652875339 >> v1:10.20.193.82:6789/0 conn(0x7fbcc408c250 legacy=0x7fbcc408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314675640 0 0) 0x7fbcc4089730 con 0x7fbcc4182cc0 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): my global_id is 4391 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcac0035e0 con 0x7fbcc4182cc0 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520801811 0 0) 0x7fbcb8002c70 con 0x7fbcc408c620 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): my global_id is 4452 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc4089730 con 0x7fbcc408c620 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520980490 0 0) 0x7fbcc4089450 con 0x7fbcc408c250 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient(hunting): my global_id is 4414 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb8002c70 con 0x7fbcc408c250 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2364253472 0 0) 0x7fbcb8002c70 con 0x7fbcc408c250 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 >> v1:10.20.193.57:6790/0 conn(0x7fbcc4182cc0 legacy=0x7fbcc41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 >> v1:10.20.193.57:6789/0 conn(0x7fbcc408c620 legacy=0x7fbcc408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 monclient: found mon.noname-c 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4089a10 con 0x7fbcc408c250 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:25.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbccb65b640 5 monclient: authenticate success, global_id 4414 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbcb4003080 con 0x7fbcc408c250 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbccb65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: dump: 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbccb65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcb4003380 con 0x7fbcc408c250 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbccb65b640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 1 -- 10.20.193.57:0/1652875339 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbcb4003880 con 0x7fbcc408c250 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbccb65b640 4 set_mon_vals no callback set 2026-02-12T17:28:25.228 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.225+0000 7fbcb3fff640 10 monclient: dump: 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 10 monclient: shutdown 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 1 -- 10.20.193.57:0/1652875339 >> v1:10.20.193.82:6789/0 conn(0x7fbcc408c250 legacy=0x7fbcc408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 1 -- 10.20.193.57:0/1652875339 shutdown_connections 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 1 -- 10.20.193.57:0/1652875339 >> 10.20.193.57:0/1652875339 conn(0x7fbcc40916b0 msgr2=0x7fbcc4091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 1 -- 10.20.193.57:0/1652875339 shutdown_connections 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 1 -- 10.20.193.57:0/1652875339 wait complete. 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 10 monclient: build_initial_monmap 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 10 monclient: monmap: 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:25.229 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 1 Processor -- start 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 1 -- start start 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 10 monclient: init 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 10 monclient(hunting): picked mon.noname-a con 0x7fbcc408c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.226+0000 7fbccb65b640 10 monclient(hunting): picked mon.noname-c con 0x7fbcc408c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.227+0000 7fbccb65b640 10 monclient(hunting): picked mon.noname-b con 0x7fbcc4182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.227+0000 7fbccb65b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc413a710 con 0x7fbcc408c250 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.227+0000 7fbccb65b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc413ba10 con 0x7fbcc4182cc0 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.227+0000 7fbccb65b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc413a4f0 con 0x7fbcc408c620 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.227+0000 7fbccb65b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:25.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.227+0000 7fbccb65b640 10 monclient(hunting): authenticate will time out at 585.046019s 2026-02-12T17:28:25.231 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.227+0000 7fbcc93d0640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbcc408c250 0x7fbcc4138010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36308/0 (socket says 10.20.193.57:36308) 2026-02-12T17:28:25.231 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.227+0000 7fbcc93d0640 1 -- 10.20.193.57:0/1683804391 learned_addr learned my addr 10.20.193.57:0/1683804391 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:25.231 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.227+0000 7fbcc8bcf640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbcc408c620 0x7fbcc4138720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45786/0 (socket says 10.20.193.57:45786) 2026-02-12T17:28:25.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcc8bcf640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6790/0 conn(0x7fbcc408c620 legacy=0x7fbcc4138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcc93d0640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6789/0 conn(0x7fbcc408c250 legacy=0x7fbcc4138010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499291677 0 0) 0x7fbcc413a4f0 con 0x7fbcc408c620 2026-02-12T17:28:25.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): my global_id is 4394 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc940035e0 con 0x7fbcc408c620 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455438926 0 0) 0x7fbcc413a710 con 0x7fbcc408c250 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): my global_id is 4455 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc413a4f0 con 0x7fbcc408c250 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3554458825 0 0) 0x7fbc940035e0 con 0x7fbcc408c620 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcc413a710 con 0x7fbcc408c620 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbcb8003540 con 0x7fbcc408c620 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcc9bd1640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.82:6789/0 conn(0x7fbcc4182cc0 legacy=0x7fbcc4138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): dump: 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.234 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3171189825 0 0) 0x7fbcc413a4f0 con 0x7fbcc408c250 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc940035e0 con 0x7fbcc408c250 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbcb4003c10 con 0x7fbcc408c250 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient(hunting): dump: 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 556382144 0 0) 0x7fbcc413a710 con 0x7fbcc408c620 2026-02-12T17:28:25.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.82:6789/0 conn(0x7fbcc4182cc0 legacy=0x7fbcc4138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6789/0 conn(0x7fbcc408c250 legacy=0x7fbcc4138010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 monclient: found mon.c 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc413bcf0 con 0x7fbcc408c620 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbccb65b640 5 monclient: authenticate success, global_id 4394 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbccb65b640 10 monclient: _renew_subs 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbccb65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc408ef50 con 0x7fbcc408c620 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbccb65b640 10 monclient: _renew_subs 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbccb65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbcc413b730 con 0x7fbcc408c620 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcb8003980 con 0x7fbcc408c620 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbcb8003ca0 con 0x7fbcc408c620 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:25.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb1ffb640 10 monclient: dump: 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.229+0000 7fbcb37fe640 4 set_mon_vals no callback set 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.230+0000 7fbccb65b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.230+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcc4090810 con 0x7fbcc4085720 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.230+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fbcb8003ef0 con 0x7fbcc408c620 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.230+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7fbcb804e940 con 0x7fbcc408c620 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.230+0000 7fbcc9bd1640 10 monclient: get_auth_request con 0x7fbc9403fb30 auth_method 0 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcc93d0640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6789/0 conn(0x7fbcc4085720 legacy=0x7fbcc4085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446413325 0 0) 0x7fbcc4090810 con 0x7fbcc4085720 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 10 monclient(hunting): my global_id is 4458 2026-02-12T17:28:25.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc413a710 con 0x7fbcc4085720 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2725389268 0 0) 0x7fbcc413a710 con 0x7fbcc4085720 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcc4090810 con 0x7fbcc4085720 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbcb4002f20 con 0x7fbcc4085720 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.232+0000 7fbcb1ffb640 10 monclient: dump: 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.233+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1722584428 0 0) 0x7fbcc4090810 con 0x7fbcc4085720 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.233+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcc408f5b0 con 0x7fbcc4085720 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.233+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fbcb4004020 con 0x7fbcc4085720 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.233+0000 7fbcb1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.233+0000 7fbcb1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:25.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.233+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6789/0 conn(0x7fbcc4085720 legacy=0x7fbcc4085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.233+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6789/0 conn(0x7fbcc4085720 legacy=0x7fbcc4085af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:25.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.236+0000 7fbccb65b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.236+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcc408a820 con 0x7fbcc4086200 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.238+0000 7fbcc93d0640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6789/0 conn(0x7fbcc4086200 legacy=0x7fbcc4197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.238+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420044634 0 0) 0x7fbc940035e0 con 0x7fbcc4086200 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.238+0000 7fbcb1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.238+0000 7fbcb1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.238+0000 7fbcb1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.238+0000 7fbcb1ffb640 10 monclient(hunting): my global_id is 4461 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.238+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc4090810 con 0x7fbcc4086200 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1401322927 0 0) 0x7fbcc4090810 con 0x7fbcc4086200 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc940035e0 con 0x7fbcc4086200 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbcb4005880 con 0x7fbcc4086200 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 10 monclient: dump: 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.240 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1849071753 0 0) 0x7fbc940035e0 con 0x7fbcc4086200 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbcc4055340 con 0x7fbcc4086200 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4506 (unknown 0 0 523382096) 0x7fbcb4005b90 con 0x7fbcc4086200 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6789/0 conn(0x7fbcc4086200 legacy=0x7fbcc4197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcb1ffb640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6789/0 conn(0x7fbcc4086200 legacy=0x7fbcc4197500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:28:25.241 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 8, 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 26771, 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 21, 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:25.242 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:25.243 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:28:25.244 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:25.245 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:28:25.246 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:28:25.247 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:25.248 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:28:25.249 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:28:25.250 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.251 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:28:25.252 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:28:25.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.82:6800/2441377515 conn(0x7fbc9403fb30 legacy=0x7fbc9405ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbccb65b640 10 monclient: shutdown 2026-02-12T17:28:25.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbccb65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:25.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 >> v1:10.20.193.57:6790/0 conn(0x7fbcc408c620 legacy=0x7fbcc4138720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbcc9bd1640 1 -- 10.20.193.57:0/1683804391 reap_dead start 2026-02-12T17:28:25.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 shutdown_connections 2026-02-12T17:28:25.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 >> 10.20.193.57:0/1683804391 conn(0x7fbcc40916b0 msgr2=0x7fbcc408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:25.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 shutdown_connections 2026-02-12T17:28:25.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.239+0000 7fbccb65b640 1 -- 10.20.193.57:0/1683804391 wait complete. 2026-02-12T17:28:25.253 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:28:25.253 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:28:25.254 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:28:25.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.320+0000 7f5df8e12640 10 monclient: get_monmap_and_config 2026-02-12T17:28:25.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.320+0000 7f5df8e12640 10 monclient: build_initial_monmap 2026-02-12T17:28:25.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.320+0000 7f5df8e12640 10 monclient: monmap: 2026-02-12T17:28:25.318 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:25.319 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.319 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:25.321623+0000 2026-02-12T17:28:25.319 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:25.321623+0000 2026-02-12T17:28:25.319 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:25.319 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.319 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:25.319 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:25.319 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:25.319 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 1 Processor -- start 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 1 -- start start 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 10 monclient: init 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 10 monclient(hunting): picked mon.noname-c con 0x7f5df408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 10 monclient(hunting): picked mon.noname-b con 0x7f5df408c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 10 monclient(hunting): picked mon.noname-a con 0x7f5df4182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df408a820 con 0x7f5df4182cc0 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df4089450 con 0x7f5df408c250 2026-02-12T17:28:25.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df4089730 con 0x7f5df408c620 2026-02-12T17:28:25.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:25.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df8e12640 10 monclient(hunting): authenticate will time out at 585.140498s 2026-02-12T17:28:25.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df1d74640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f5df408c620 0x7f5df408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45794/0 (socket says 10.20.193.57:45794) 2026-02-12T17:28:25.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.321+0000 7f5df1d74640 1 -- 10.20.193.57:0/4199832924 learned_addr learned my addr 10.20.193.57:0/4199832924 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:25.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1d74640 1 -- 10.20.193.57:0/4199832924 >> v1:10.20.193.57:6790/0 conn(0x7f5df408c620 legacy=0x7f5df408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df2d76640 1 -- 10.20.193.57:0/4199832924 >> v1:10.20.193.57:6789/0 conn(0x7f5df4182cc0 legacy=0x7f5df41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df2575640 1 -- 10.20.193.57:0/4199832924 >> v1:10.20.193.82:6789/0 conn(0x7f5df408c250 legacy=0x7f5df408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513842928 0 0) 0x7f5df4089730 con 0x7f5df408c620 2026-02-12T17:28:25.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 10 monclient(hunting): my global_id is 4397 2026-02-12T17:28:25.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de00035e0 con 0x7f5df408c620 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131243980 0 0) 0x7f5de4003d50 con 0x7f5df4182cc0 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 10 monclient(hunting): my global_id is 4464 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df4089730 con 0x7f5df4182cc0 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.323+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133303842 0 0) 0x7f5df4089450 con 0x7f5df408c250 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient(hunting): my global_id is 4420 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de4003d50 con 0x7f5df408c250 2026-02-12T17:28:25.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3361421219 0 0) 0x7f5de00035e0 con 0x7f5df408c620 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 >> v1:10.20.193.82:6789/0 conn(0x7f5df408c250 legacy=0x7f5df408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 >> v1:10.20.193.57:6789/0 conn(0x7f5df4182cc0 legacy=0x7f5df41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: _finish_hunting 0 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 1 monclient: found mon.noname-b 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df4089a10 con 0x7f5df408c620 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: _finish_auth 0 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: _check_auth_tickets 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5ddc003150 con 0x7f5df408c620 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:28:25.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: dump: 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 5 monclient: authenticate success, global_id 4397 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:25.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ddc003320 con 0x7f5df408c620 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 1 -- 10.20.193.57:0/4199832924 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5ddc004960 con 0x7f5df408c620 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df1573640 10 monclient: dump: 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.334 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 4 set_mon_vals no callback set 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 10 monclient: shutdown 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 1 -- 10.20.193.57:0/4199832924 >> v1:10.20.193.57:6790/0 conn(0x7f5df408c620 legacy=0x7f5df408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 1 -- 10.20.193.57:0/4199832924 shutdown_connections 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 1 -- 10.20.193.57:0/4199832924 >> 10.20.193.57:0/4199832924 conn(0x7f5df40916b0 msgr2=0x7f5df4091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 1 -- 10.20.193.57:0/4199832924 shutdown_connections 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 1 -- 10.20.193.57:0/4199832924 wait complete. 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 10 monclient: build_initial_monmap 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.324+0000 7f5df8e12640 10 monclient: monmap: 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:25.335 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 1 Processor -- start 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 1 -- start start 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 10 monclient: init 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:25.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 10 monclient(hunting): picked mon.noname-b con 0x7f5df408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 10 monclient(hunting): picked mon.noname-c con 0x7f5df408c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 10 monclient(hunting): picked mon.noname-a con 0x7f5df4182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df4137a10 con 0x7f5df4182cc0 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df4139210 con 0x7f5df408c250 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df413eae0 con 0x7f5df408c620 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df8e12640 10 monclient(hunting): authenticate will time out at 585.144387s 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df1d74640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f5df408c620 0x7f5df4136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45800/0 (socket says 10.20.193.57:45800) 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.325+0000 7f5df1d74640 1 -- 10.20.193.57:0/536903021 learned_addr learned my addr 10.20.193.57:0/536903021 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5df1d74640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6790/0 conn(0x7f5df408c620 legacy=0x7f5df4136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5df2d76640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6789/0 conn(0x7f5df4182cc0 legacy=0x7f5df4193320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194264433 0 0) 0x7f5df413eae0 con 0x7f5df408c620 2026-02-12T17:28:25.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): my global_id is 4400 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc00035e0 con 0x7f5df408c620 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578774638 0 0) 0x7f5df4137a10 con 0x7f5df4182cc0 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5df2575640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.82:6789/0 conn(0x7f5df408c250 legacy=0x7f5df4136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): my global_id is 4467 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df413eae0 con 0x7f5df4182cc0 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3092799640 0 0) 0x7f5dc00035e0 con 0x7f5df408c620 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5df4137a10 con 0x7f5df408c620 2026-02-12T17:28:25.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5ddc003490 con 0x7f5df408c620 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): dump: 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.339 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188612332 0 0) 0x7f5df4139210 con 0x7f5df408c250 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): my global_id is 4423 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc00035e0 con 0x7f5df408c250 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 581357498 0 0) 0x7f5df413eae0 con 0x7f5df4182cc0 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5df4139210 con 0x7f5df4182cc0 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5de4004960 con 0x7f5df4182cc0 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.327+0000 7f5ddaffd640 10 monclient(hunting): dump: 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.340 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4272751239 0 0) 0x7f5df4137a10 con 0x7f5df408c620 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.82:6789/0 conn(0x7f5df408c250 legacy=0x7f5df4136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6789/0 conn(0x7f5df4182cc0 legacy=0x7f5df4193320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 1 monclient: found mon.c 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df40888a0 con 0x7f5df408c620 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df8e12640 5 monclient: authenticate success, global_id 4400 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df8e12640 10 monclient: _renew_subs 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df8e12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5df408ee30 con 0x7f5df408c620 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df8e12640 10 monclient: _renew_subs 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df8e12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5df4138c50 con 0x7f5df408c620 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ddc004f40 con 0x7f5df408c620 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5ddc0052a0 con 0x7f5df408c620 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 10 monclient: dump: 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df0d72640 4 set_mon_vals no callback set 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df8e12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5df4090810 con 0x7f5df4138e40 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5ddc005500 con 0x7f5df408c620 2026-02-12T17:28:25.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.328+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f5ddc04ed60 con 0x7f5df408c620 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.329+0000 7f5df2d76640 10 monclient: get_auth_request con 0x7f5dc003fd10 auth_method 0 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.330+0000 7f5df2575640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6790/0 conn(0x7f5df4138e40 legacy=0x7f5df40582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.330+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281788789 0 0) 0x7f5df4090810 con 0x7f5df4138e40 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.330+0000 7f5ddaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.330+0000 7f5ddaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.330+0000 7f5ddaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.330+0000 7f5ddaffd640 10 monclient(hunting): my global_id is 4403 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.330+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df4137a10 con 0x7f5df4138e40 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3186070258 0 0) 0x7f5df4137a10 con 0x7f5df4138e40 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5df4090810 con 0x7f5df4138e40 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5de80031f0 con 0x7f5df4138e40 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 10 monclient: dump: 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.344 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3786015851 0 0) 0x7f5df4090810 con 0x7f5df4138e40 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5df405dc20 con 0x7f5df4138e40 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5de8005880 con 0x7f5df4138e40 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6790/0 conn(0x7f5df4138e40 legacy=0x7f5df40582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.331+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6790/0 conn(0x7f5df4138e40 legacy=0x7f5df40582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:25.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.334+0000 7f5df8e12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:28:25.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.334+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5df405d510 con 0x7f5df405d140 2026-02-12T17:28:25.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df2575640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6790/0 conn(0x7f5df405d140 legacy=0x7f5df40589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514946312 0 0) 0x7f5df405d510 con 0x7f5df405d140 2026-02-12T17:28:25.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 10 monclient(hunting): my global_id is 4406 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df4090810 con 0x7f5df405d140 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 68467228 0 0) 0x7f5df4090810 con 0x7f5df405d140 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5df405d510 con 0x7f5df405d140 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5de8003b80 con 0x7f5df405d140 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 10 monclient: dump: 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.348 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2067271209 0 0) 0x7f5df405d510 con 0x7f5df405d140 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5df408f580 con 0x7f5df405d140 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4337 (unknown 0 0 271614764) 0x7f5de8005a90 con 0x7f5df405d140 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6790/0 conn(0x7f5df405d140 legacy=0x7f5df40589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5ddaffd640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6790/0 conn(0x7f5df405d140 legacy=0x7f5df40589d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:28:25.349 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 8, 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 26868, 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 21, 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:25.350 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:25.351 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:28:25.352 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:25.353 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:28:25.354 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:28:25.355 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.356 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.357 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:28:25.358 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:28:25.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.82:6800/2441377515 conn(0x7f5dc003fd10 legacy=0x7f5dc00601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df8e12640 10 monclient: shutdown 2026-02-12T17:28:25.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df8e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:25.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 >> v1:10.20.193.57:6790/0 conn(0x7f5df408c620 legacy=0x7f5df4136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df2d76640 1 -- 10.20.193.57:0/536903021 reap_dead start 2026-02-12T17:28:25.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df2d76640 1 -- 10.20.193.57:0/536903021 reap_dead start 2026-02-12T17:28:25.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 shutdown_connections 2026-02-12T17:28:25.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 >> 10.20.193.57:0/536903021 conn(0x7f5df40916b0 msgr2=0x7f5df408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:25.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.337+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 shutdown_connections 2026-02-12T17:28:25.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.338+0000 7f5df8e12640 1 -- 10.20.193.57:0/536903021 wait complete. 2026-02-12T17:28:25.360 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:28:25.360 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:28:25.360 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.429+0000 7f2dd485b640 10 monclient: get_monmap_and_config 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.429+0000 7f2dd485b640 10 monclient: build_initial_monmap 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.429+0000 7f2dd485b640 10 monclient: monmap: 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:25.430378+0000 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:25.430378+0000 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:25.427 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.429+0000 7f2dd485b640 1 Processor -- start 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 1 -- start start 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 10 monclient: init 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 10 monclient(hunting): picked mon.noname-c con 0x7f2dcc0906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 10 monclient(hunting): picked mon.noname-a con 0x7f2dcc0911b0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 10 monclient(hunting): picked mon.noname-b con 0x7f2dcc185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc090100 con 0x7f2dcc0911b0 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc091a70 con 0x7f2dcc0906d0 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc092360 con 0x7f2dcc185070 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd485b640 10 monclient(hunting): authenticate will time out at 585.249508s 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd1dcf640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f2dcc0911b0 0x7f2dcc183950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36358/0 (socket says 10.20.193.57:36358) 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd1dcf640 1 -- 10.20.193.57:0/658604813 learned_addr learned my addr 10.20.193.57:0/658604813 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:25.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.430+0000 7f2dd2dd1640 1 --1- 10.20.193.57:0/658604813 >> v1:10.20.193.57:6790/0 conn(0x7f2dcc185070 0x7f2dcc1a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45826/0 (socket says 10.20.193.57:45826) 2026-02-12T17:28:25.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd1dcf640 1 -- 10.20.193.57:0/658604813 >> v1:10.20.193.57:6789/0 conn(0x7f2dcc0911b0 legacy=0x7f2dcc183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd2dd1640 1 -- 10.20.193.57:0/658604813 >> v1:10.20.193.57:6790/0 conn(0x7f2dcc185070 legacy=0x7f2dcc1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975422818 0 0) 0x7f2dcc090100 con 0x7f2dcc0911b0 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 10 monclient(hunting): my global_id is 4470 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dbc0035e0 con 0x7f2dcc0911b0 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd25d0640 1 -- 10.20.193.57:0/658604813 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc0906d0 legacy=0x7f2dcc090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521080409 0 0) 0x7f2dcc092360 con 0x7f2dcc185070 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 10 monclient(hunting): my global_id is 4409 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.432+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dcc090100 con 0x7f2dcc185070 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2050337853 0 0) 0x7f2dbc0035e0 con 0x7f2dcc0911b0 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 >> v1:10.20.193.57:6790/0 conn(0x7f2dcc185070 legacy=0x7f2dcc1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc0906d0 legacy=0x7f2dcc090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: _finish_hunting 0 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 1 monclient: found mon.noname-a 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:25.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc05cf80 con 0x7f2dcc0911b0 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: _finish_auth 0 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: _check_auth_tickets 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2db80030d0 con 0x7f2dcc0911b0 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 5 monclient: authenticate success, global_id 4470 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: dump: 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2db8003360 con 0x7f2dcc0911b0 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 4 set_mon_vals no callback set 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 1 -- 10.20.193.57:0/658604813 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2db8004b10 con 0x7f2dcc0911b0 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd15ce640 10 monclient: dump: 2026-02-12T17:28:25.432 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 10 monclient: shutdown 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 1 -- 10.20.193.57:0/658604813 >> v1:10.20.193.57:6789/0 conn(0x7f2dcc0911b0 legacy=0x7f2dcc183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 1 -- 10.20.193.57:0/658604813 shutdown_connections 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 1 -- 10.20.193.57:0/658604813 >> 10.20.193.57:0/658604813 conn(0x7f2dcc054330 msgr2=0x7f2dcc054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 1 -- 10.20.193.57:0/658604813 shutdown_connections 2026-02-12T17:28:25.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 1 -- 10.20.193.57:0/658604813 wait complete. 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 10 monclient: build_initial_monmap 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.433+0000 7f2dd485b640 10 monclient: monmap: 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 1 Processor -- start 2026-02-12T17:28:25.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 1 -- start start 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 10 monclient: init 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 10 monclient(hunting): picked mon.noname-b con 0x7f2dcc0906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 10 monclient(hunting): picked mon.noname-c con 0x7f2dcc0911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 10 monclient(hunting): picked mon.noname-a con 0x7f2dcc185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc133d80 con 0x7f2dcc185070 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc062bb0 con 0x7f2dcc0906d0 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dcc08b8f0 con 0x7f2dcc0911b0 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd485b640 10 monclient(hunting): authenticate will time out at 585.253466s 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd1dcf640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f2dcc0911b0 0x7f2dcc173e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45830/0 (socket says 10.20.193.57:45830) 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.434+0000 7f2dd1dcf640 1 -- 10.20.193.57:0/3563209336 learned_addr learned my addr 10.20.193.57:0/3563209336 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2dd1dcf640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.57:6790/0 conn(0x7f2dcc0911b0 legacy=0x7f2dcc173e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2dd2dd1640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.57:6789/0 conn(0x7f2dcc185070 legacy=0x7f2dcc175520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3572926185 0 0) 0x7f2dcc08b8f0 con 0x7f2dcc0911b0 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): my global_id is 4412 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d9c0035e0 con 0x7f2dcc0911b0 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310299277 0 0) 0x7f2dcc133d80 con 0x7f2dcc185070 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): my global_id is 4473 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dcc08b8f0 con 0x7f2dcc185070 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2dd25d0640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc0906d0 legacy=0x7f2dcc152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3739809372 0 0) 0x7f2d9c0035e0 con 0x7f2dcc0911b0 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2dcc133d80 con 0x7f2dcc0911b0 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1520076775 0 0) 0x7f2dcc08b8f0 con 0x7f2dcc185070 2026-02-12T17:28:25.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d9c0035e0 con 0x7f2dcc185070 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2db8004a50 con 0x7f2dcc0911b0 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.436+0000 7f2db6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2dc0004370 con 0x7f2dcc185070 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707393958 0 0) 0x7f2dcc062bb0 con 0x7f2dcc0906d0 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient(hunting): my global_id is 4429 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dcc08b8f0 con 0x7f2dcc0906d0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2930759421 0 0) 0x7f2dcc133d80 con 0x7f2dcc0911b0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc0906d0 legacy=0x7f2dcc152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.57:6789/0 conn(0x7f2dcc185070 legacy=0x7f2dcc175520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 monclient: found mon.c 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dcc143340 con 0x7f2dcc0911b0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd485b640 5 monclient: authenticate success, global_id 4412 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd485b640 10 monclient: _renew_subs 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd485b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2dcc131a20 con 0x7f2dcc0911b0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd485b640 10 monclient: _renew_subs 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd485b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2dcc132580 con 0x7f2dcc0911b0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2db8004bb0 con 0x7f2dcc0911b0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd0dcd640 4 set_mon_vals no callback set 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2db8005220 con 0x7f2dcc0911b0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 10 monclient: dump: 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.438 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd485b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2dcc08c5d0 con 0x7f2dcc131030 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.437+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f2db8011e90 con 0x7f2dcc0911b0 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.438+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f2db804ed00 con 0x7f2dcc0911b0 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.438+0000 7f2dd2dd1640 10 monclient: get_auth_request con 0x7f2d9c03fbc0 auth_method 0 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.439+0000 7f2dd25d0640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc131030 legacy=0x7f2dcc12c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508737213 0 0) 0x7f2dcc08c5d0 con 0x7f2dcc131030 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 10 monclient(hunting): my global_id is 4432 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dcc133d80 con 0x7f2dcc131030 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3134022856 0 0) 0x7f2dcc133d80 con 0x7f2dcc131030 2026-02-12T17:28:25.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2dcc08c5d0 con 0x7f2dcc131030 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2dc4003220 con 0x7f2dcc131030 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 10 monclient: dump: 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1047457565 0 0) 0x7f2dcc08c5d0 con 0x7f2dcc131030 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2dcc05c950 con 0x7f2dcc131030 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2dc4005880 con 0x7f2dcc131030 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc131030 legacy=0x7f2dcc12c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.440+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc131030 legacy=0x7f2dcc12c330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:25.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.444+0000 7f2dd485b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:28:25.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.444+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2dcc092c50 con 0x7f2dcc153460 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2dd25d0640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc153460 legacy=0x7f2dcc12ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120680417 0 0) 0x7f2dcc092c50 con 0x7f2dcc153460 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 10 monclient(hunting): my global_id is 4435 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dcc08c5d0 con 0x7f2dcc153460 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2505068431 0 0) 0x7f2dcc08c5d0 con 0x7f2dcc153460 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2dcc092c50 con 0x7f2dcc153460 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2dc4003d10 con 0x7f2dcc153460 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.446+0000 7f2db6ffd640 10 monclient: dump: 2026-02-12T17:28:25.444 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1588490638 0 0) 0x7f2dcc092c50 con 0x7f2dcc153460 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2dcc092de0 con 0x7f2dcc153460 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4671 (unknown 0 0 3914960456) 0x7f2dc40059f0 con 0x7f2dcc153460 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2db6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2db6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc153460 legacy=0x7f2dcc12ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2db6ffd640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.82:6789/0 conn(0x7f2dcc153460 legacy=0x7f2dcc12ca40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:28:25.445 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 8, 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 26944, 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 21, 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:28:25.446 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:25.447 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:25.448 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.449 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:25.450 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.82:6800/2441377515 conn(0x7f2d9c03fbc0 legacy=0x7f2d9c060070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2dd485b640 10 monclient: shutdown 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2dd485b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 >> v1:10.20.193.57:6790/0 conn(0x7f2dcc0911b0 legacy=0x7f2dcc173e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2dd2dd1640 1 -- 10.20.193.57:0/3563209336 reap_dead start 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 shutdown_connections 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 >> 10.20.193.57:0/3563209336 conn(0x7f2dcc054330 msgr2=0x7f2dcc08a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 shutdown_connections 2026-02-12T17:28:25.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.447+0000 7f2dd485b640 1 -- 10.20.193.57:0/3563209336 wait complete. 2026-02-12T17:28:25.452 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:28:25.452 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-12T17:28:25.452 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T17:28:25.452 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-12T17:28:25.452 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-12T17:28:25.452 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T17:28:25.452 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad5a4db640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6790/0 conn(0x7fad54185070 legacy=0x7fad54174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad5a4db640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6790/0 conn(0x7fad54185070 legacy=0x7fad54174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad5a4db640 1 --1- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6790/0 conn(0x7fad54185070 0x7fad54174c80 :-1 s=OPENED pgs=151 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad5a4db640 1 --1- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6790/0 conn(0x7fad54185070 0x7fad54174c80 :-1 s=OPENED pgs=151 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 10 monclient: ms_handle_reset current mon v1:10.20.193.57:6790/0 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6790/0 conn(0x7fad54185070 legacy=0x7fad54174c80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 10 monclient(hunting): picked mon.c con 0x7fad240642d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 10 monclient(hunting): picked mon.a con 0x7fad540911b0 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 10 monclient(hunting): picked mon.b con 0x7fad540906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:25.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad594d9640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6790/0 conn(0x7fad240642d0 legacy=0x7fad240846b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:25.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad54130c90 con 0x7fad540911b0 2026-02-12T17:28:25.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad541339b0 con 0x7fad540906d0 2026-02-12T17:28:25.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad240cb910 con 0x7fad240642d0 2026-02-12T17:28:25.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.457+0000 7fad427fc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:25.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad5a4db640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6789/0 conn(0x7fad540911b0 legacy=0x7fad240a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2129911374 0 0) 0x7fad54130c90 con 0x7fad540911b0 2026-02-12T17:28:25.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:28:25.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad59cda640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.82:6789/0 conn(0x7fad540906d0 legacy=0x7fad240c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.57:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fad240c98b0 con 0x7fad540911b0 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503068037 0 0) 0x7fad541339b0 con 0x7fad540906d0 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.82:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fad54130c90 con 0x7fad540906d0 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 3234125042 0 0) 0x7fad54130c90 con 0x7fad540906d0 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6790/0 conn(0x7fad240642d0 legacy=0x7fad240846b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.57:6789/0 conn(0x7fad540911b0 legacy=0x7fad240a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 monclient: found mon.b 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7fad240ccb70 con 0x7fad540906d0 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-12T17:28:25.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16} v 0) -- 0x7fad240cb910 con 0x7fad540906d0 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fad44003150 con 0x7fad540906d0 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.460+0000 7fad427fc640 10 monclient: dump: 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.461+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad44005d10 con 0x7fad540906d0 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.461+0000 7fad427fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.461+0000 7fad43fff640 4 set_mon_vals no callback set 2026-02-12T17:28:25.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.461+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fad44005e80 con 0x7fad540906d0 2026-02-12T17:28:25.460 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T17:28:25.460 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:28:25.460 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:28:25.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.567+0000 7f1ec4e5b640 10 monclient: get_monmap_and_config 2026-02-12T17:28:25.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.567+0000 7f1ec4e5b640 10 monclient: build_initial_monmap 2026-02-12T17:28:25.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.567+0000 7f1ec4e5b640 10 monclient: monmap: 2026-02-12T17:28:25.565 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:25.565 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.566 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:25.568626+0000 2026-02-12T17:28:25.566 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:25.568626+0000 2026-02-12T17:28:25.566 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:25.566 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.566 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:25.566 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:25.566 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:25.566 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 1 Processor -- start 2026-02-12T17:28:25.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 1 -- start start 2026-02-12T17:28:25.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 10 monclient: init 2026-02-12T17:28:25.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:25.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:25.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 10 monclient(hunting): picked mon.noname-a con 0x7f1ec008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 10 monclient(hunting): picked mon.noname-c con 0x7f1ec008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 10 monclient(hunting): picked mon.noname-b con 0x7f1ec008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec008d600 con 0x7f1ec008ae20 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec008b1f0 con 0x7f1ec008c730 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec008d1f0 con 0x7f1ec008cb30 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ec4e5b640 10 monclient(hunting): authenticate will time out at 585.387521s 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ebed76640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f1ec008cb30 legacy=0x7f1ec01a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ebe575640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1ec008ae20 0x7f1ec008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36378/0 (socket says 10.20.193.57:36378) 2026-02-12T17:28:25.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.568+0000 7f1ebe575640 1 -- 10.20.193.57:0/1490956292 learned_addr learned my addr 10.20.193.57:0/1490956292 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.570+0000 7f1ebe575640 1 -- 10.20.193.57:0/1490956292 >> v1:10.20.193.57:6789/0 conn(0x7f1ec008ae20 legacy=0x7f1ec008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.570+0000 7f1ebdd74640 1 -- 10.20.193.57:0/1490956292 >> v1:10.20.193.82:6789/0 conn(0x7f1ec008c730 legacy=0x7f1ec0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.570+0000 7f1ebd573640 1 -- 10.20.193.57:0/1490956292 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920380938 0 0) 0x7f1ec008d600 con 0x7f1ec008ae20 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.570+0000 7f1ebd573640 10 monclient(hunting): _negotiate 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.570+0000 7f1ebd573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.570+0000 7f1ebd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.570+0000 7f1ebd573640 10 monclient(hunting): my global_id is 4476 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.570+0000 7f1ebd573640 1 -- 10.20.193.57:0/1490956292 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1eac0035e0 con 0x7f1ec008ae20 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 1 -- 10.20.193.57:0/1490956292 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1489776832 0 0) 0x7f1eac0035e0 con 0x7f1ec008ae20 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 1 -- 10.20.193.57:0/1490956292 >> v1:10.20.193.57:6790/0 conn(0x7f1ec008cb30 legacy=0x7f1ec01a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 1 -- 10.20.193.57:0/1490956292 >> v1:10.20.193.82:6789/0 conn(0x7f1ec008c730 legacy=0x7f1ec0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: _finish_hunting 0 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 1 monclient: found mon.noname-a 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 1 -- 10.20.193.57:0/1490956292 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec0057320 con 0x7f1ec008ae20 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: _finish_auth 0 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: _check_auth_tickets 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 1 -- 10.20.193.57:0/1490956292 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1eb40030d0 con 0x7f1ec008ae20 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: dump: 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.573 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 5 monclient: authenticate success, global_id 4476 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 1 -- 10.20.193.57:0/1490956292 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1eb4003360 con 0x7f1ec008ae20 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:25.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 4 set_mon_vals no callback set 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 1 -- 10.20.193.57:0/1490956292 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1eb4004b10 con 0x7f1ec008ae20 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ebd573640 10 monclient: dump: 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:25.575 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 10 monclient: shutdown 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/1490956292 >> v1:10.20.193.57:6789/0 conn(0x7f1ec008ae20 legacy=0x7f1ec008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/1490956292 shutdown_connections 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/1490956292 >> 10.20.193.57:0/1490956292 conn(0x7f1ec0091620 msgr2=0x7f1ec0091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/1490956292 shutdown_connections 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.571+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/1490956292 wait complete. 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient: build_initial_monmap 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient: monmap: 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:25.576 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 1 Processor -- start 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 1 -- start start 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient: init 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient(hunting): picked mon.noname-a con 0x7f1ec008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient(hunting): picked mon.noname-c con 0x7f1ec008c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:25.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient(hunting): picked mon.noname-b con 0x7f1ec008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:25.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec008d9c0 con 0x7f1ec008ae20 2026-02-12T17:28:25.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec0141570 con 0x7f1ec008cb30 2026-02-12T17:28:25.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec013d7d0 con 0x7f1ec008c730 2026-02-12T17:28:25.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:25.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ec4e5b640 10 monclient(hunting): authenticate will time out at 585.391565s 2026-02-12T17:28:25.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ebdd74640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f1ec008c730 legacy=0x7f1ec0190010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:25.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ebe575640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1ec008ae20 0x7f1ec014ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36388/0 (socket says 10.20.193.57:36388) 2026-02-12T17:28:25.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.572+0000 7f1ebe575640 1 -- 10.20.193.57:0/2280114044 learned_addr learned my addr 10.20.193.57:0/2280114044 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:25.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.574+0000 7f1ebe575640 1 -- 10.20.193.57:0/2280114044 >> v1:10.20.193.57:6789/0 conn(0x7f1ec008ae20 legacy=0x7f1ec014ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.574+0000 7f1ebe575640 1 --1- 10.20.193.57:0/2280114044 >> v1:10.20.193.57:6789/0 conn(0x7f1ec008ae20 0x7f1ec014ef50 :-1 s=OPENED pgs=162 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f1ec008d9c0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:28:25.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.575+0000 7f1ebed76640 1 -- 10.20.193.57:0/2280114044 >> v1:10.20.193.82:6789/0 conn(0x7f1ec008cb30 legacy=0x7f1ec0191730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:25.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:25.773+0000 7f1ebdd74640 1 -- 10.20.193.57:0/2280114044 >> v1:10.20.193.57:6790/0 conn(0x7f1ec008c730 legacy=0x7f1ec0190010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:26.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.174+0000 7f1ebdd74640 1 -- 10.20.193.57:0/2280114044 >> v1:10.20.193.57:6790/0 conn(0x7f1ec008c730 legacy=0x7f1ec0190010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:26.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256380632 0 0) 0x7f1ec008d9c0 con 0x7f1ec008ae20 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 10 monclient(hunting): my global_id is 4479 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e8c0035e0 con 0x7f1ec008ae20 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1757679620 0 0) 0x7f1e8c0035e0 con 0x7f1ec008ae20 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ec008d9c0 con 0x7f1ec008ae20 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1eb40048a0 con 0x7f1ec008ae20 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:26.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 10 monclient(hunting): dump: 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:26.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.198+0000 7f1ea6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1329688876 0 0) 0x7f1ec008d9c0 con 0x7f1ec008ae20 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 >> v1:10.20.193.57:6790/0 conn(0x7f1ec008c730 legacy=0x7f1ec0190010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 >> v1:10.20.193.82:6789/0 conn(0x7f1ec008cb30 legacy=0x7f1ec0191730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 1 monclient: found mon.a 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec0088810 con 0x7f1ec008ae20 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:26.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ec4e5b640 5 monclient: authenticate success, global_id 4479 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ec4e5b640 10 monclient: _renew_subs 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ec4e5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec013bd70 con 0x7f1ec008ae20 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ec4e5b640 10 monclient: _renew_subs 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ec4e5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1ec013ea80 con 0x7f1ec008ae20 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1eb4004d30 con 0x7f1ec008ae20 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1eb40050c0 con 0x7f1ec008ae20 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:26.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ea6ffd640 10 monclient: dump: 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ebcd72640 4 set_mon_vals no callback set 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.199+0000 7f1ec4e5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:26.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.200+0000 7f1ec4e5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:26.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.200+0000 7f1ec4e5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:26.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.200+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec0141790 con 0x7f1ec008ae20 2026-02-12T17:28:26.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.200+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1eb4005350 con 0x7f1ec008ae20 2026-02-12T17:28:26.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.201+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f1eb404eb90 con 0x7f1ec008ae20 2026-02-12T17:28:26.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.201+0000 7f1ebdd74640 10 monclient: get_auth_request con 0x7f1e8c03f5e0 auth_method 0 2026-02-12T17:28:26.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.203+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f1eb4017440 con 0x7f1ec008ae20 2026-02-12T17:28:26.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.203+0000 7f1ea6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:26.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.203+0000 7f1ea6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:26.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.356+0000 7f1ec4e5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:28:26.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.356+0000 7f1ec4e5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:28:26.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.356+0000 7f1ec4e5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:26.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.356+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1ec0055340 con 0x7f1ec008ae20 2026-02-12T17:28:26.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.356+0000 7f1ea6ffd640 1 -- 10.20.193.57:0/2280114044 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 671271633) 0x7f1eb4016bf0 con 0x7f1ec008ae20 2026-02-12T17:28:26.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.356+0000 7f1ea6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:28:26.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.356+0000 7f1ea6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:26.355 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:28:26.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.357+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 >> v1:10.20.193.82:6800/2441377515 conn(0x7f1e8c03f5e0 legacy=0x7f1e8c05fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:26.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.357+0000 7f1ec4e5b640 10 monclient: shutdown 2026-02-12T17:28:26.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.357+0000 7f1ec4e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:26.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.357+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 >> v1:10.20.193.57:6789/0 conn(0x7f1ec008ae20 legacy=0x7f1ec014ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:26.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.357+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 shutdown_connections 2026-02-12T17:28:26.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.357+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 >> 10.20.193.57:0/2280114044 conn(0x7f1ec0091620 msgr2=0x7f1ec005c230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:26.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.357+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 shutdown_connections 2026-02-12T17:28:26.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:26.357+0000 7f1ec4e5b640 1 -- 10.20.193.57:0/2280114044 wait complete. 2026-02-12T17:28:27.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:27.958+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:27.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:27.958+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:27.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:27.958+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:27.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:27.958+0000 7fad417fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:28.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:28.958+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:28.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:28.958+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:28.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:28.958+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:29.364 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:28:29.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.434+0000 7f1e9425b640 10 monclient: get_monmap_and_config 2026-02-12T17:28:29.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.434+0000 7f1e9425b640 10 monclient: build_initial_monmap 2026-02-12T17:28:29.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.434+0000 7f1e9425b640 10 monclient: monmap: 2026-02-12T17:28:29.432 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:29.432 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:29.432 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:29.435110+0000 2026-02-12T17:28:29.432 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:29.435110+0000 2026-02-12T17:28:29.432 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:29.433 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:29.433 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:29.433 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:29.433 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:29.433 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.434+0000 7f1e9425b640 1 Processor -- start 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.434+0000 7f1e9425b640 1 -- start start 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.434+0000 7f1e9425b640 10 monclient: init 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.434+0000 7f1e9425b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.434+0000 7f1e9425b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e9425b640 10 monclient(hunting): picked mon.noname-b con 0x7f1e8c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e9425b640 10 monclient(hunting): picked mon.noname-a con 0x7f1e8c08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e9425b640 10 monclient(hunting): picked mon.noname-c con 0x7f1e8c08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e9425b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8c08d600 con 0x7f1e8c08c730 2026-02-12T17:28:29.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e91fd0640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f1e8c08ae20 legacy=0x7f1e8c08c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e9425b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8c08b1f0 con 0x7f1e8c08cb30 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e9425b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8c08d1f0 con 0x7f1e8c08ae20 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e9425b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e9425b640 10 monclient(hunting): authenticate will time out at 589.254108s 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e917cf640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1e8c08c730 0x7f1e8c181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36398/0 (socket says 10.20.193.57:36398) 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.435+0000 7f1e917cf640 1 -- 10.20.193.57:0/2901784980 learned_addr learned my addr 10.20.193.57:0/2901784980 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e917cf640 1 -- 10.20.193.57:0/2901784980 >> v1:10.20.193.57:6789/0 conn(0x7f1e8c08c730 legacy=0x7f1e8c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 -- 10.20.193.57:0/2901784980 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2499405866 0 0) 0x7f1e8c08d600 con 0x7f1e8c08c730 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient(hunting): _negotiate 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:29.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient(hunting): my global_id is 4482 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 -- 10.20.193.57:0/2901784980 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e740035e0 con 0x7f1e8c08c730 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e927d1640 1 -- 10.20.193.57:0/2901784980 >> v1:10.20.193.82:6789/0 conn(0x7f1e8c08cb30 legacy=0x7f1e8c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 -- 10.20.193.57:0/2901784980 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 650599103 0 0) 0x7f1e740035e0 con 0x7f1e8c08c730 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 -- 10.20.193.57:0/2901784980 >> v1:10.20.193.57:6790/0 conn(0x7f1e8c08ae20 legacy=0x7f1e8c08c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 -- 10.20.193.57:0/2901784980 >> v1:10.20.193.82:6789/0 conn(0x7f1e8c08cb30 legacy=0x7f1e8c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: _finish_hunting 0 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 monclient: found mon.noname-a 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 -- 10.20.193.57:0/2901784980 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8c057320 con 0x7f1e8c08c730 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: _finish_auth 0 2026-02-12T17:28:29.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: _check_auth_tickets 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 -- 10.20.193.57:0/2901784980 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e80003150 con 0x7f1e8c08c730 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: dump: 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:29.441 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e9425b640 5 monclient: authenticate success, global_id 4482 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e9425b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 -- 10.20.193.57:0/2901784980 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e800033a0 con 0x7f1e8c08c730 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e9425b640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e9425b640 4 set_mon_vals no callback set 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 1 -- 10.20.193.57:0/2901784980 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e80004b10 con 0x7f1e8c08c730 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:29.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.437+0000 7f1e90fce640 10 monclient: dump: 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:29.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 10 monclient: shutdown 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 1 -- 10.20.193.57:0/2901784980 >> v1:10.20.193.57:6789/0 conn(0x7f1e8c08c730 legacy=0x7f1e8c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 1 -- 10.20.193.57:0/2901784980 shutdown_connections 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 1 -- 10.20.193.57:0/2901784980 >> 10.20.193.57:0/2901784980 conn(0x7f1e8c091620 msgr2=0x7f1e8c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 1 -- 10.20.193.57:0/2901784980 shutdown_connections 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 1 -- 10.20.193.57:0/2901784980 wait complete. 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 10 monclient: build_initial_monmap 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 10 monclient: monmap: 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:29.444 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 1 Processor -- start 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 1 -- start start 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 10 monclient: init 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.438+0000 7f1e9425b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e9425b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:29.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e9425b640 10 monclient(hunting): picked mon.noname-b con 0x7f1e8c08ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e9425b640 10 monclient(hunting): picked mon.noname-a con 0x7f1e8c08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e9425b640 10 monclient(hunting): picked mon.noname-c con 0x7f1e8c08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e9425b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8c08d9c0 con 0x7f1e8c08c730 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e9425b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8c05ae90 con 0x7f1e8c08ae20 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e9425b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e8c122800 con 0x7f1e8c08cb30 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e9425b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e9425b640 10 monclient(hunting): authenticate will time out at 589.258045s 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e927d1640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f1e8c08cb30 legacy=0x7f1e8c1a2c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e917cf640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1e8c08c730 0x7f1e8c119430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36410/0 (socket says 10.20.193.57:36410) 2026-02-12T17:28:29.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.439+0000 7f1e917cf640 1 -- 10.20.193.57:0/900929998 learned_addr learned my addr 10.20.193.57:0/900929998 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:29.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e917cf640 1 -- 10.20.193.57:0/900929998 >> v1:10.20.193.57:6789/0 conn(0x7f1e8c08c730 legacy=0x7f1e8c119430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:29.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172394209 0 0) 0x7f1e8c08d9c0 con 0x7f1e8c08c730 2026-02-12T17:28:29.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:29.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:29.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:29.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient(hunting): my global_id is 4485 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e5c0035e0 con 0x7f1e8c08c730 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e91fd0640 1 -- 10.20.193.57:0/900929998 >> v1:10.20.193.82:6789/0 conn(0x7f1e8c08ae20 legacy=0x7f1e8c118d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4049088521 0 0) 0x7f1e5c0035e0 con 0x7f1e8c08c730 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e8c08d9c0 con 0x7f1e8c08c730 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e80004a50 con 0x7f1e8c08c730 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient(hunting): dump: 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:29.451 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4122214587 0 0) 0x7f1e8c08d9c0 con 0x7f1e8c08c730 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 >> v1:10.20.193.57:6790/0 conn(0x7f1e8c08cb30 legacy=0x7f1e8c1a2c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 >> v1:10.20.193.82:6789/0 conn(0x7f1e8c08ae20 legacy=0x7f1e8c118d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:29.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 monclient: found mon.a 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8c11caa0 con 0x7f1e8c08c730 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e9425b640 5 monclient: authenticate success, global_id 4485 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e9425b640 10 monclient: _renew_subs 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e9425b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8c119b40 con 0x7f1e8c08c730 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e9425b640 10 monclient: _renew_subs 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e9425b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:29.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1e8c11c200 con 0x7f1e8c08c730 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e800050b0 con 0x7f1e8c08c730 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e80002d50 con 0x7f1e8c08c730 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7bfff640 4 set_mon_vals no callback set 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.441+0000 7f1e7a7fc640 10 monclient: dump: 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:29.454 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.442+0000 7f1e9425b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.442+0000 7f1e9425b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.442+0000 7f1e9425b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.442+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e8c0008d0 con 0x7f1e8c08c730 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.442+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1e80011ee0 con 0x7f1e8c08c730 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.442+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f1e8004ed30 con 0x7f1e8c08c730 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.442+0000 7f1e91fd0640 10 monclient: get_auth_request con 0x7f1e5c03f660 auth_method 0 2026-02-12T17:28:29.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.444+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f1e80017640 con 0x7f1e8c08c730 2026-02-12T17:28:29.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.444+0000 7f1e7a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:29.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.444+0000 7f1e7a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:29.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.589+0000 7f1e9425b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:28:29.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.589+0000 7f1e9425b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:28:29.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.589+0000 7f1e9425b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:29.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.589+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1e8c08f520 con 0x7f1e8c08c730 2026-02-12T17:28:29.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.589+0000 7f1e7a7fc640 1 -- 10.20.193.57:0/900929998 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 529638517) 0x7f1e80016df0 con 0x7f1e8c08c730 2026-02-12T17:28:29.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.589+0000 7f1e7a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:28:29.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.589+0000 7f1e7a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:29.588 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:28:29.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.590+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 >> v1:10.20.193.82:6800/2441377515 conn(0x7f1e5c03f660 legacy=0x7f1e5c05fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:29.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.590+0000 7f1e9425b640 10 monclient: shutdown 2026-02-12T17:28:29.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.590+0000 7f1e9425b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:29.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.590+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 >> v1:10.20.193.57:6789/0 conn(0x7f1e8c08c730 legacy=0x7f1e8c119430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:29.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.590+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 shutdown_connections 2026-02-12T17:28:29.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.590+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 >> 10.20.193.57:0/900929998 conn(0x7f1e8c091620 msgr2=0x7f1e8c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:29.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.590+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 shutdown_connections 2026-02-12T17:28:29.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.590+0000 7f1e9425b640 1 -- 10.20.193.57:0/900929998 wait complete. 2026-02-12T17:28:29.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.959+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:29.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.959+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:29.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:29.959+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:30.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:30.959+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:30.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:30.959+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:30.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:30.959+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:31.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:31.958+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:31.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:31.958+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:31.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:31.958+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:32.597 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:28:32.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.665+0000 7fe38db0c640 10 monclient: get_monmap_and_config 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.665+0000 7fe38db0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.665+0000 7fe38db0c640 10 monclient: monmap: 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:32.666250+0000 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:32.666250+0000 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.665+0000 7fe38db0c640 1 Processor -- start 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.665+0000 7fe38db0c640 1 -- start start 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.665+0000 7fe38db0c640 10 monclient: init 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 10 monclient(hunting): picked mon.noname-b con 0x7fe38808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:32.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 10 monclient(hunting): picked mon.noname-c con 0x7fe38808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:32.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 10 monclient(hunting): picked mon.noname-a con 0x7fe38808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:32.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38808d600 con 0x7fe38808cb30 2026-02-12T17:28:32.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38808b1f0 con 0x7fe38808c730 2026-02-12T17:28:32.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38808d1f0 con 0x7fe38808ae20 2026-02-12T17:28:32.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:32.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe38db0c640 10 monclient(hunting): authenticate will time out at 592.485169s 2026-02-12T17:28:32.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe3877fe640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe38808c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:32.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe387fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe38808cb30 0x7fe3881a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36418/0 (socket says 10.20.193.57:36418) 2026-02-12T17:28:32.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.666+0000 7fe387fff640 1 -- 10.20.193.57:0/3234019837 learned_addr learned my addr 10.20.193.57:0/3234019837 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:32.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.668+0000 7fe387fff640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6789/0 conn(0x7fe38808cb30 legacy=0x7fe3881a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:32.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.668+0000 7fe386ffd640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.82:6789/0 conn(0x7fe38808c730 legacy=0x7fe388181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.868+0000 7fe3877fe640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe38808c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:32.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.958+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:32.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.958+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:32.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:32.958+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:33.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:33.270+0000 7fe3877fe640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe38808c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:33.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:33.959+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:33.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:33.959+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:33.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:33.959+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:34.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:34.072+0000 7fe3877fe640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe38808c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:34.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:34.958+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:34.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:34.958+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:34.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:34.958+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:34.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:34.963+0000 7fad42ffd640 10 monclient: _renew_subs 2026-02-12T17:28:34.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:34.963+0000 7fad42ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:28:34.961 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:34.963+0000 7fad42ffd640 1 -- 10.20.193.57:0/3338203984 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=20}) -- 0x7fad30003560 con 0x7fad540906d0 2026-02-12T17:28:35.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 10 monclient(hunting): tick 2026-02-12T17:28:35.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:28:35.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 1 monclient(hunting): continuing hunt 2026-02-12T17:28:35.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:28:35.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe38808c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:28:35.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.82:6789/0 conn(0x7fe38808c730 legacy=0x7fe388181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:35.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6789/0 conn(0x7fe38808cb30 legacy=0x7fe3881a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:35.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:35.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 10 monclient(hunting): picked mon.noname-c con 0x7fe38808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:35.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 10 monclient(hunting): picked mon.noname-a con 0x7fe38808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:35.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 10 monclient(hunting): picked mon.noname-b con 0x7fe38808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:35.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe388057320 con 0x7fe38808cb30 2026-02-12T17:28:35.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38808d1f0 con 0x7fe38808c730 2026-02-12T17:28:35.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe387fff640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe3640668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:35.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe36406a0d0 con 0x7fe38808ae20 2026-02-12T17:28:35.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.666+0000 7fe3857fa640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:35.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.668+0000 7fe386ffd640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6789/0 conn(0x7fe38808cb30 legacy=0x7fe364045080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:35.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.668+0000 7fe3877fe640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.82:6789/0 conn(0x7fe38808c730 legacy=0x7fe364023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:35.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.867+0000 7fe387fff640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe3640668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:35.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.958+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:35.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.958+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:35.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:35.958+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:36.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:36.268+0000 7fe387fff640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe3640668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:36.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:36.958+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:36.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:36.958+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:36.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:36.958+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:37.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:37.069+0000 7fe387fff640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe3640668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:37.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:37.959+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:37.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:37.959+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:37.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:37.959+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:37.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:37.959+0000 7fad417fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:38.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 10 monclient(hunting): tick 2026-02-12T17:28:38.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:28:38.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 1 monclient(hunting): continuing hunt 2026-02-12T17:28:38.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe3640668b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.82:6789/0 conn(0x7fe38808c730 legacy=0x7fe364023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6789/0 conn(0x7fe38808cb30 legacy=0x7fe364045080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 10 monclient(hunting): picked mon.noname-b con 0x7fe38808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 10 monclient(hunting): picked mon.noname-a con 0x7fe38808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 10 monclient(hunting): picked mon.noname-c con 0x7fe38808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe36406b3f0 con 0x7fe38808cb30 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe36406a0d0 con 0x7fe38808c730 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3877fe640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe3640668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:38.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 1 -- 10.20.193.57:0/3234019837 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe36406a480 con 0x7fe38808ae20 2026-02-12T17:28:38.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.666+0000 7fe3857fa640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:38.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.668+0000 7fe386ffd640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6789/0 conn(0x7fe38808cb30 legacy=0x7fe364045060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:38.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.668+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:28:38.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.669+0000 7fe387fff640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.82:6789/0 conn(0x7fe38808c730 legacy=0x7fe364023840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:38.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.867+0000 7fe3877fe640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe3640668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:38.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.959+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:38.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.959+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:38.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:38.959+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:39.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.268+0000 7fe3877fe640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe3640668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:39.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433311096 0 0) 0x7fe36406a0d0 con 0x7fe38808c730 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient(hunting): my global_id is 4438 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe36c0035e0 con 0x7fe38808c730 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337055976 0 0) 0x7fe36406b3f0 con 0x7fe38808cb30 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient(hunting): _negotiate 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:39.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient(hunting): my global_id is 4488 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe36406a0d0 con 0x7fe38808cb30 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4048490726 0 0) 0x7fe36c0035e0 con 0x7fe38808c730 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe3640668b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.57:6789/0 conn(0x7fe38808cb30 legacy=0x7fe364045060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: _finish_hunting 0 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 monclient: found mon.noname-c 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36406a6b0 con 0x7fe38808c730 2026-02-12T17:28:39.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: _finish_auth 0 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: _check_auth_tickets 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe37c0041e0 con 0x7fe38808c730 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: dump: 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:39.856 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe38db0c640 5 monclient: authenticate success, global_id 4438 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe38db0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe37c0044e0 con 0x7fe38808c730 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 1 -- 10.20.193.57:0/3234019837 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe37c005bf0 con 0x7fe38808c730 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:39.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe3867fc640 10 monclient: dump: 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:39.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe38db0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.851+0000 7fe38db0c640 4 set_mon_vals no callback set 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.852+0000 7fe38db0c640 10 monclient: shutdown 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.852+0000 7fe38db0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.852+0000 7fe38db0c640 1 -- 10.20.193.57:0/3234019837 >> v1:10.20.193.82:6789/0 conn(0x7fe38808c730 legacy=0x7fe364023840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.852+0000 7fe38db0c640 1 -- 10.20.193.57:0/3234019837 shutdown_connections 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.852+0000 7fe38db0c640 1 -- 10.20.193.57:0/3234019837 >> 10.20.193.57:0/3234019837 conn(0x7fe388091620 msgr2=0x7fe388091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.852+0000 7fe38db0c640 1 -- 10.20.193.57:0/3234019837 shutdown_connections 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.852+0000 7fe38db0c640 1 -- 10.20.193.57:0/3234019837 wait complete. 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient: build_initial_monmap 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient: monmap: 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:39.859 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 1 Processor -- start 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 1 -- start start 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient: init 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:39.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient(hunting): picked mon.noname-c con 0x7fe38808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient(hunting): picked mon.noname-a con 0x7fe38808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe3877fe640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe388086b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient(hunting): picked mon.noname-b con 0x7fe38808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38808d9c0 con 0x7fe38808c730 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe388087f10 con 0x7fe38808cb30 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3880832e0 con 0x7fe38808ae20 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe38db0c640 10 monclient(hunting): authenticate will time out at 599.672654s 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe386ffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe38808c730 0x7fe38821ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:57938/0 (socket says 10.20.193.57:57938) 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.853+0000 7fe386ffd640 1 -- 10.20.193.57:0/2884155003 learned_addr learned my addr 10.20.193.57:0/2884155003 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:39.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.855+0000 7fe386ffd640 1 -- 10.20.193.57:0/2884155003 >> v1:10.20.193.57:6789/0 conn(0x7fe38808c730 legacy=0x7fe38821ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:39.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.856+0000 7fe387fff640 1 -- 10.20.193.57:0/2884155003 >> v1:10.20.193.82:6789/0 conn(0x7fe38808cb30 legacy=0x7fe38823c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:39.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.856+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246137858 0 0) 0x7fe38808d9c0 con 0x7fe38808c730 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.856+0000 7fe363fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.856+0000 7fe363fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.856+0000 7fe363fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.856+0000 7fe363fff640 10 monclient(hunting): my global_id is 4491 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.856+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3580035e0 con 0x7fe38808c730 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362066888 0 0) 0x7fe388087f10 con 0x7fe38808cb30 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:39.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient(hunting): my global_id is 4441 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe38808d9c0 con 0x7fe38808cb30 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2295304818 0 0) 0x7fe3580035e0 con 0x7fe38808c730 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe388087f10 con 0x7fe38808c730 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe378003310 con 0x7fe38808c730 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient(hunting): dump: 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:39.867 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3888699000 0 0) 0x7fe388087f10 con 0x7fe38808c730 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 >> v1:10.20.193.57:6790/0 conn(0x7fe38808ae20 legacy=0x7fe388086b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 >> v1:10.20.193.82:6789/0 conn(0x7fe38808cb30 legacy=0x7fe38823c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:39.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 monclient: found mon.a 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe388088810 con 0x7fe38808c730 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe38db0c640 5 monclient: authenticate success, global_id 4491 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe38db0c640 10 monclient: _renew_subs 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe38db0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3881da0b0 con 0x7fe38808c730 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe38db0c640 10 monclient: _renew_subs 2026-02-12T17:28:39.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe38db0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe388083e40 con 0x7fe38808c730 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3780034f0 con 0x7fe38808c730 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe378003bb0 con 0x7fe38808c730 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe385ffb640 4 set_mon_vals no callback set 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.857+0000 7fe363fff640 10 monclient: dump: 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:39.870 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.858+0000 7fe38db0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.858+0000 7fe38db0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.858+0000 7fe38db0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.858+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3880008d0 con 0x7fe38808c730 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.858+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe378003dd0 con 0x7fe38808c730 2026-02-12T17:28:39.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.858+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7fe37804eae0 con 0x7fe38808c730 2026-02-12T17:28:39.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.858+0000 7fe3877fe640 10 monclient: get_auth_request con 0x7fe35803f620 auth_method 0 2026-02-12T17:28:39.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.861+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe3780044c0 con 0x7fe38808c730 2026-02-12T17:28:39.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.861+0000 7fe363fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:39.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.861+0000 7fe363fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:39.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.959+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:39.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.959+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:39.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:39.959+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:40.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.005+0000 7fe38db0c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:28:40.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.005+0000 7fe38db0c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:28:40.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.005+0000 7fe38db0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:40.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.005+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe38808f520 con 0x7fe38808c730 2026-02-12T17:28:40.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.005+0000 7fe363fff640 1 -- 10.20.193.57:0/2884155003 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 713409414) 0x7fe378016ae0 con 0x7fe38808c730 2026-02-12T17:28:40.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.005+0000 7fe363fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:28:40.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.005+0000 7fe363fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:40.004 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":12,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:28:40.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.006+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe35803f620 legacy=0x7fe35805fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.006+0000 7fe38db0c640 10 monclient: shutdown 2026-02-12T17:28:40.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.006+0000 7fe38db0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:40.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.006+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 >> v1:10.20.193.57:6789/0 conn(0x7fe38808c730 legacy=0x7fe38821ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.006+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 shutdown_connections 2026-02-12T17:28:40.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.006+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 >> 10.20.193.57:0/2884155003 conn(0x7fe388091620 msgr2=0x7fe38805a050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:40.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.006+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 shutdown_connections 2026-02-12T17:28:40.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.006+0000 7fe38db0c640 1 -- 10.20.193.57:0/2884155003 wait complete. 2026-02-12T17:28:40.012 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:28:40.012 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-12T17:28:40.013 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:28:40.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.082+0000 7fb2d705b640 10 monclient: get_monmap_and_config 2026-02-12T17:28:40.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.082+0000 7fb2d705b640 10 monclient: build_initial_monmap 2026-02-12T17:28:40.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.082+0000 7fb2d705b640 10 monclient: monmap: 2026-02-12T17:28:40.080 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:40.081 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.081 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:40.083403+0000 2026-02-12T17:28:40.081 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:40.083403+0000 2026-02-12T17:28:40.081 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:40.081 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.081 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:40.081 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:40.081 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:40.081 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.082+0000 7fb2d705b640 1 Processor -- start 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.082+0000 7fb2d705b640 1 -- start start 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 10 monclient: init 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 10 monclient(hunting): picked mon.noname-c con 0x7fb2d0087e30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 10 monclient(hunting): picked mon.noname-a con 0x7fb2d0085920 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 10 monclient(hunting): picked mon.noname-b con 0x7fb2d0088200 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d005ed40 con 0x7fb2d0085920 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d0085da0 con 0x7fb2d0087e30 2026-02-12T17:28:40.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d0087400 con 0x7fb2d0088200 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d705b640 10 monclient(hunting): authenticate will time out at 599.902291s 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2d55d1640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fb2d0088200 legacy=0x7fb2d01a51b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2c7fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fb2d0085920 0x7fb2d0183a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:57942/0 (socket says 10.20.193.57:57942) 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.083+0000 7fb2c7fff640 1 -- 10.20.193.57:0/2165526062 learned_addr learned my addr 10.20.193.57:0/2165526062 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c7fff640 1 -- 10.20.193.57:0/2165526062 >> v1:10.20.193.57:6789/0 conn(0x7fb2d0085920 legacy=0x7fb2d0183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2d4dd0640 1 -- 10.20.193.57:0/2165526062 >> v1:10.20.193.82:6789/0 conn(0x7fb2d0087e30 legacy=0x7fb2d0142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873213688 0 0) 0x7fb2d005ed40 con 0x7fb2d0085920 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient(hunting): my global_id is 4494 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2bc0035e0 con 0x7fb2d0085920 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878035346 0 0) 0x7fb2d0085da0 con 0x7fb2d0087e30 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient(hunting): my global_id is 4444 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d005ed40 con 0x7fb2d0087e30 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3047310132 0 0) 0x7fb2bc0035e0 con 0x7fb2d0085920 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 >> v1:10.20.193.57:6790/0 conn(0x7fb2d0088200 legacy=0x7fb2d01a51b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 >> v1:10.20.193.82:6789/0 conn(0x7fb2d0087e30 legacy=0x7fb2d0142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient: _finish_hunting 0 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 monclient: found mon.noname-a 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d01434a0 con 0x7fb2d0085920 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient: _finish_auth 0 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient: _check_auth_tickets 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2b8003150 con 0x7fb2d0085920 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2c77fe640 10 monclient: dump: 2026-02-12T17:28:40.090 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2d705b640 5 monclient: authenticate success, global_id 4494 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.085+0000 7fb2d705b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2b8003410 con 0x7fb2d0085920 2026-02-12T17:28:40.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2c77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2c77fe640 1 -- 10.20.193.57:0/2165526062 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2b8004b10 con 0x7fb2d0085920 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2c77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2c77fe640 10 monclient: dump: 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.092 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 4 set_mon_vals no callback set 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 10 monclient: shutdown 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 1 -- 10.20.193.57:0/2165526062 >> v1:10.20.193.57:6789/0 conn(0x7fb2d0085920 legacy=0x7fb2d0183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 1 -- 10.20.193.57:0/2165526062 shutdown_connections 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 1 -- 10.20.193.57:0/2165526062 >> 10.20.193.57:0/2165526062 conn(0x7fb2d00916b0 msgr2=0x7fb2d0091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 1 -- 10.20.193.57:0/2165526062 shutdown_connections 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 1 -- 10.20.193.57:0/2165526062 wait complete. 2026-02-12T17:28:40.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 10 monclient: build_initial_monmap 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.086+0000 7fb2d705b640 10 monclient: monmap: 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 1 Processor -- start 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 1 -- start start 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 10 monclient: init 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 10 monclient(hunting): picked mon.noname-c con 0x7fb2d0085920 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 10 monclient(hunting): picked mon.noname-b con 0x7fb2d0087e30 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 10 monclient(hunting): picked mon.noname-a con 0x7fb2d0088200 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d005e3a0 con 0x7fb2d0088200 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d013b9f0 con 0x7fb2d0087e30 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d4dd0640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fb2d0085920 legacy=0x7fb2d0152b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d00888a0 con 0x7fb2d0085920 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:40.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d705b640 10 monclient(hunting): authenticate will time out at 599.906427s 2026-02-12T17:28:40.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d55d1640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fb2d0088200 0x7fb2d01954b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:57952/0 (socket says 10.20.193.57:57952) 2026-02-12T17:28:40.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.087+0000 7fb2d55d1640 1 -- 10.20.193.57:0/1138723422 learned_addr learned my addr 10.20.193.57:0/1138723422 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:40.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2d55d1640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.57:6789/0 conn(0x7fb2d0088200 legacy=0x7fb2d01954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1177181239 0 0) 0x7fb2d005e3a0 con 0x7fb2d0088200 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 10 monclient(hunting): my global_id is 4497 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a00035e0 con 0x7fb2d0088200 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c7fff640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.82:6789/0 conn(0x7fb2d0087e30 legacy=0x7fb2d0193d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 246329187 0 0) 0x7fb2a00035e0 con 0x7fb2d0088200 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2d005e3a0 con 0x7fb2d0088200 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2cc0054c0 con 0x7fb2d0088200 2026-02-12T17:28:40.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.089+0000 7fb2c57fa640 10 monclient(hunting): dump: 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.103 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 963123365 0 0) 0x7fb2d013b9f0 con 0x7fb2d0087e30 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient(hunting): my global_id is 4447 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a00035e0 con 0x7fb2d0087e30 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1426858319 0 0) 0x7fb2d005e3a0 con 0x7fb2d0088200 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.57:6790/0 conn(0x7fb2d0085920 legacy=0x7fb2d0152b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.82:6789/0 conn(0x7fb2d0087e30 legacy=0x7fb2d0193d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient: _finish_hunting 0 2026-02-12T17:28:40.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 monclient: found mon.a 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d0139f30 con 0x7fb2d0088200 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient: _finish_auth 0 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2d705b640 5 monclient: authenticate success, global_id 4497 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2d705b640 10 monclient: _renew_subs 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2d705b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d013aa90 con 0x7fb2d0088200 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2d705b640 10 monclient: _renew_subs 2026-02-12T17:28:40.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2d705b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2d01406a0 con 0x7fb2d0088200 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2cc0057c0 con 0x7fb2d0088200 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2cc005ae0 con 0x7fb2d0088200 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 10 monclient: dump: 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.106 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c6ffd640 4 set_mon_vals no callback set 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2d705b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb2d0090810 con 0x7fb2d01a6ae0 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.090+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fb2cc005d70 con 0x7fb2d0088200 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.091+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7fb2cc04fab0 con 0x7fb2d0088200 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.091+0000 7fb2c7fff640 10 monclient: get_auth_request con 0x7fb2a003f7c0 auth_method 0 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.092+0000 7fb2d4dd0640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.57:6789/0 conn(0x7fb2d01a6ae0 legacy=0x7fb2d0089ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151435555 0 0) 0x7fb2d0090810 con 0x7fb2d01a6ae0 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 10 monclient(hunting): my global_id is 4500 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d005e3a0 con 0x7fb2d01a6ae0 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2125128790 0 0) 0x7fb2d005e3a0 con 0x7fb2d01a6ae0 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2d0090810 con 0x7fb2d01a6ae0 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2c0003270 con 0x7fb2d01a6ae0 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 10 monclient: dump: 2026-02-12T17:28:40.108 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3225382254 0 0) 0x7fb2d0090810 con 0x7fb2d01a6ae0 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2d008f5b0 con 0x7fb2d01a6ae0 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb2c0005880 con 0x7fb2d01a6ae0 2026-02-12T17:28:40.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.57:6789/0 conn(0x7fb2d01a6ae0 legacy=0x7fb2d0089ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.093+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.57:6789/0 conn(0x7fb2d01a6ae0 legacy=0x7fb2d0089ac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.097+0000 7fb2d705b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.097+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb2d0139940 con 0x7fb2d0139540 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2d4dd0640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.57:6789/0 conn(0x7fb2d0139540 legacy=0x7fb2d008a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579153782 0 0) 0x7fb2d0139940 con 0x7fb2d0139540 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 10 monclient(hunting): my global_id is 4503 2026-02-12T17:28:40.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d0090810 con 0x7fb2d0139540 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2847326733 0 0) 0x7fb2d0090810 con 0x7fb2d0139540 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2d0139940 con 0x7fb2d0139540 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2c0003a70 con 0x7fb2d0139540 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 10 monclient: dump: 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.111 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1966055224 0 0) 0x7fb2d0139940 con 0x7fb2d0139540 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb2d008a8e0 con 0x7fb2d0139540 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4495 (unknown 0 0 3366893371) 0x7fb2c0005aa0 con 0x7fb2d0139540 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.57:6789/0 conn(0x7fb2d0139540 legacy=0x7fb2d008a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2c57fa640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.57:6789/0 conn(0x7fb2d0139540 legacy=0x7fb2d008a1d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:40.113 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:28:40.113 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:28:40.113 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:28:40.113 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:28:40.113 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 12, 2026-02-12T17:28:40.113 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 41631, 2026-02-12T17:28:40.113 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:28:40.113 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:40.114 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:40.115 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:28:40.116 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:40.117 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:40.118 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:40.119 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:40.120 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.121 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:40.122 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:40.123 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:28:40.124 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:28:40.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.099+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.82:6800/2441377515 conn(0x7fb2a003f7c0 legacy=0x7fb2a005fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.100+0000 7fb2d705b640 10 monclient: shutdown 2026-02-12T17:28:40.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.100+0000 7fb2d705b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:40.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.100+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 >> v1:10.20.193.57:6789/0 conn(0x7fb2d0088200 legacy=0x7fb2d01954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.100+0000 7fb2d55d1640 1 -- 10.20.193.57:0/1138723422 reap_dead start 2026-02-12T17:28:40.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.100+0000 7fb2d55d1640 1 -- 10.20.193.57:0/1138723422 reap_dead start 2026-02-12T17:28:40.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.100+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 shutdown_connections 2026-02-12T17:28:40.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.100+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 >> 10.20.193.57:0/1138723422 conn(0x7fb2d00916b0 msgr2=0x7fb2d005c670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:40.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.100+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 shutdown_connections 2026-02-12T17:28:40.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.100+0000 7fb2d705b640 1 -- 10.20.193.57:0/1138723422 wait complete. 2026-02-12T17:28:40.126 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:28:40.126 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:28:40.127 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:28:40.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.194+0000 7f5ffe6cc640 10 monclient: get_monmap_and_config 2026-02-12T17:28:40.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.194+0000 7f5ffe6cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:40.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.194+0000 7f5ffe6cc640 10 monclient: monmap: 2026-02-12T17:28:40.192 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:40.193 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.193 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:40.195666+0000 2026-02-12T17:28:40.193 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:40.195666+0000 2026-02-12T17:28:40.193 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:40.193 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.193 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:40.193 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:40.193 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:40.193 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 1 Processor -- start 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 1 -- start start 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 10 monclient: init 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f5ff808c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f5ff808c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f5ff8182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff808a820 con 0x7f5ff808c620 2026-02-12T17:28:40.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff8089450 con 0x7f5ff808c250 2026-02-12T17:28:40.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff8089730 con 0x7f5ff8182cc0 2026-02-12T17:28:40.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:40.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffe6cc640 10 monclient(hunting): authenticate will time out at 600.014581s 2026-02-12T17:28:40.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ffcc42640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f5ff8182cc0 legacy=0x7f5ff81a30a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:40.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ff77fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f5ff808c620 0x7f5ff808caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:57968/0 (socket says 10.20.193.57:57968) 2026-02-12T17:28:40.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.195+0000 7f5ff77fe640 1 -- 10.20.193.57:0/1813039721 learned_addr learned my addr 10.20.193.57:0/1813039721 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:40.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.197+0000 7f5ff77fe640 1 -- 10.20.193.57:0/1813039721 >> v1:10.20.193.57:6789/0 conn(0x7f5ff808c620 legacy=0x7f5ff808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.197+0000 7f5ff7fff640 1 -- 10.20.193.57:0/1813039721 >> v1:10.20.193.82:6789/0 conn(0x7f5ff808c250 legacy=0x7f5ff808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.197+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 50523935 0 0) 0x7f5fe8002c20 con 0x7f5ff808c620 2026-02-12T17:28:40.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.197+0000 7f5ff6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.197+0000 7f5ff6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.197+0000 7f5ff6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.197+0000 7f5ff6ffd640 10 monclient(hunting): my global_id is 4506 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fdc0035e0 con 0x7f5ff808c620 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669885790 0 0) 0x7f5ff8089450 con 0x7f5ff808c250 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient(hunting): my global_id is 4450 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fe8002c20 con 0x7f5ff808c250 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2665462281 0 0) 0x7f5fdc0035e0 con 0x7f5ff808c620 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 >> v1:10.20.193.57:6790/0 conn(0x7f5ff8182cc0 legacy=0x7f5ff81a30a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 >> v1:10.20.193.82:6789/0 conn(0x7f5ff808c250 legacy=0x7f5ff808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 monclient: found mon.noname-a 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff8089a10 con 0x7f5ff808c620 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: _finish_auth 0 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5fe8003260 con 0x7f5ff808c620 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: dump: 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.204 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 5 monclient: authenticate success, global_id 4506 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fe8004960 con 0x7f5ff808c620 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 1 -- 10.20.193.57:0/1813039721 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5fe8004cb0 con 0x7f5ff808c620 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ff6ffd640 10 monclient: dump: 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:40.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 4 set_mon_vals no callback set 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 10 monclient: shutdown 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/1813039721 >> v1:10.20.193.57:6789/0 conn(0x7f5ff808c620 legacy=0x7f5ff808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/1813039721 shutdown_connections 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/1813039721 >> 10.20.193.57:0/1813039721 conn(0x7f5ff80916b0 msgr2=0x7f5ff8091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/1813039721 shutdown_connections 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.198+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/1813039721 wait complete. 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient: monmap: 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:40.207 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 1 Processor -- start 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 1 -- start start 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient: init 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f5ff808c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f5ff808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f5ff8182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:40.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff813a760 con 0x7f5ff808c250 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff808ef40 con 0x7f5ff808c620 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ff8139070 con 0x7f5ff8182cc0 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffe6cc640 10 monclient(hunting): authenticate will time out at 600.018619s 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ffcc42640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f5ff8182cc0 legacy=0x7f5ff81953d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ff7fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f5ff808c250 0x7f5ff8136c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:57972/0 (socket says 10.20.193.57:57972) 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.199+0000 7f5ff7fff640 1 -- 10.20.193.57:0/2158148523 learned_addr learned my addr 10.20.193.57:0/2158148523 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.201+0000 7f5ff7fff640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.57:6789/0 conn(0x7f5ff808c250 legacy=0x7f5ff8136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.201+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970271412 0 0) 0x7f5ff813a760 con 0x7f5ff808c250 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.201+0000 7f5ff4ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.201+0000 7f5ff4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.201+0000 7f5ff4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.201+0000 7f5ff4ff9640 10 monclient(hunting): my global_id is 4509 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.201+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fc80035e0 con 0x7f5ff808c250 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff77fe640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.82:6789/0 conn(0x7f5ff808c620 legacy=0x7f5ff8137380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2400057818 0 0) 0x7f5fc80035e0 con 0x7f5ff808c250 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ff813a760 con 0x7f5ff808c250 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5fe40036d0 con 0x7f5ff808c250 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient(hunting): dump: 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.210 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186870215 0 0) 0x7f5ff808ef40 con 0x7f5ff808c620 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient(hunting): my global_id is 4453 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fc80035e0 con 0x7f5ff808c620 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1768300191 0 0) 0x7f5ff813a760 con 0x7f5ff808c250 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.57:6790/0 conn(0x7f5ff8182cc0 legacy=0x7f5ff81953d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:28:40.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.82:6789/0 conn(0x7f5ff808c620 legacy=0x7f5ff8137380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 monclient: found mon.a 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff80888a0 con 0x7f5ff808c250 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient: _finish_auth 0 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ffe6cc640 5 monclient: authenticate success, global_id 4509 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ffe6cc640 10 monclient: _renew_subs 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ffe6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff813a4e0 con 0x7f5ff808c250 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ffe6cc640 10 monclient: _renew_subs 2026-02-12T17:28:40.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ffe6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5ff813aa40 con 0x7f5ff808c250 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fe4003c10 con 0x7f5ff808c250 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5fe4003fa0 con 0x7f5ff808c250 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff67fc640 4 set_mon_vals no callback set 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ff4ff9640 10 monclient: dump: 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.213 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.214 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.214 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.214 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.214 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.202+0000 7f5ffe6cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:40.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.203+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5ff818deb0 con 0x7f5ff818dae0 2026-02-12T17:28:40.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.203+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5fe4004140 con 0x7f5ff808c250 2026-02-12T17:28:40.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.203+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 389782217 0 0) 0x7f5fe404eb20 con 0x7f5ff808c250 2026-02-12T17:28:40.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.203+0000 7f5ffcc42640 10 monclient: get_auth_request con 0x7f5fc803f720 auth_method 0 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff77fe640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.82:6789/0 conn(0x7f5ff818dae0 legacy=0x7f5ff805b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211088188 0 0) 0x7f5ff818deb0 con 0x7f5ff818dae0 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 10 monclient(hunting): my global_id is 4456 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff813a760 con 0x7f5ff818dae0 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 471420921 0 0) 0x7f5ff813a760 con 0x7f5ff818dae0 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ff818deb0 con 0x7f5ff818dae0 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5fe8003260 con 0x7f5ff818dae0 2026-02-12T17:28:40.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 10 monclient: dump: 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1882344209 0 0) 0x7f5ff818deb0 con 0x7f5ff818dae0 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.205+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ff8090810 con 0x7f5ff818dae0 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.206+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5fe80051d0 con 0x7f5ff818dae0 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.206+0000 7f5ff4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.206+0000 7f5ff4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.206+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.82:6789/0 conn(0x7f5ff818dae0 legacy=0x7f5ff805b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.206+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.82:6789/0 conn(0x7f5ff818dae0 legacy=0x7f5ff805b7c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.209+0000 7f5ffe6cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.209+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5ff808f580 con 0x7f5ff805bed0 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.211+0000 7f5ff77fe640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.82:6789/0 conn(0x7f5ff805bed0 legacy=0x7f5ff8197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 111546418 0 0) 0x7f5ff808f580 con 0x7f5ff805bed0 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 10 monclient(hunting): my global_id is 4459 2026-02-12T17:28:40.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ff818deb0 con 0x7f5ff805bed0 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2577739029 0 0) 0x7f5ff818deb0 con 0x7f5ff805bed0 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ff808f580 con 0x7f5ff805bed0 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5fe8005810 con 0x7f5ff805bed0 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 10 monclient: dump: 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:40.220 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2957865522 0 0) 0x7f5ff808f580 con 0x7f5ff805bed0 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ff8055340 con 0x7f5ff805bed0 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4660 (unknown 0 0 548530453) 0x7f5fe8007ce0 con 0x7f5ff805bed0 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.82:6789/0 conn(0x7f5ff805bed0 legacy=0x7f5ff8197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ff4ff9640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.82:6789/0 conn(0x7f5ff805bed0 legacy=0x7f5ff8197b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:28:40.221 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 12, 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 41708, 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:28:40.222 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.223 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.224 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:28:40.225 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:28:40.226 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.227 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.228 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:28:40.229 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.230 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:28:40.231 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:28:40.232 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:28:40.232 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:28:40.232 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:28:40.232 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:28:40.232 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:28:40.232 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:28:40.232 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:28:40.232 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:28:40.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.82:6800/2441377515 conn(0x7f5fc803f720 legacy=0x7f5fc805fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffe6cc640 10 monclient: shutdown 2026-02-12T17:28:40.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffe6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:40.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 >> v1:10.20.193.57:6789/0 conn(0x7f5ff808c250 legacy=0x7f5ff8136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:40.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffcc42640 1 -- 10.20.193.57:0/2158148523 reap_dead start 2026-02-12T17:28:40.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffcc42640 1 -- 10.20.193.57:0/2158148523 reap_dead start 2026-02-12T17:28:40.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 shutdown_connections 2026-02-12T17:28:40.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 >> 10.20.193.57:0/2158148523 conn(0x7f5ff80916b0 msgr2=0x7f5ff808a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:40.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 shutdown_connections 2026-02-12T17:28:40.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.212+0000 7f5ffe6cc640 1 -- 10.20.193.57:0/2158148523 wait complete. 2026-02-12T17:28:40.234 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:28:40.234 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:28:40.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.959+0000 7fad417fa640 10 monclient: tick 2026-02-12T17:28:40.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.959+0000 7fad417fa640 10 monclient: _check_auth_tickets 2026-02-12T17:28:40.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:40.959+0000 7fad417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:41.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.414+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.1 v1:10.20.193.82:6789/0 6 ==== osd_map(20..20 src has 1..20) ==== 793+0+0 (unknown 2557596223 0 0) 0x7fad440240c0 con 0x7fad540906d0 2026-02-12T17:28:41.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.416+0000 7fad427fc640 1 -- 10.20.193.57:0/3338203984 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}]=0 pool 'unique_pool_0' created v20) ==== 130+0+0 (unknown 3098031066 0 0) 0x7fad4404f760 con 0x7fad540906d0 2026-02-12T17:28:41.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.416+0000 7fad427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16}] 2026-02-12T17:28:41.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.416+0000 7fad427fc640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' created 2026-02-12T17:28:41.414 INFO:teuthology.orchestra.run.trial057.stderr:pool 'unique_pool_0' created 2026-02-12T17:28:41.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.419+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.82:6800/2441377515 conn(0x7fad2403f880 legacy=0x7fad2405fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:41.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.419+0000 7fad5bf65640 10 monclient: shutdown 2026-02-12T17:28:41.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.419+0000 7fad5bf65640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:41.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.419+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 >> v1:10.20.193.82:6789/0 conn(0x7fad540906d0 legacy=0x7fad240c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:41.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.419+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 shutdown_connections 2026-02-12T17:28:41.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.419+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 >> 10.20.193.57:0/3338203984 conn(0x7fad54054330 msgr2=0x7fad5408ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:41.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.419+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 shutdown_connections 2026-02-12T17:28:41.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.419+0000 7fad5bf65640 1 -- 10.20.193.57:0/3338203984 wait complete. 2026-02-12T17:28:41.425 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-12T17:28:41.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.496+0000 7f044b6cc640 10 monclient: get_monmap_and_config 2026-02-12T17:28:41.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.496+0000 7f044b6cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:41.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.496+0000 7f044b6cc640 10 monclient: monmap: 2026-02-12T17:28:41.494 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:41.495 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:41.495 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:28:41.497402+0000 2026-02-12T17:28:41.495 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:28:41.497402+0000 2026-02-12T17:28:41.495 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:41.495 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:41.495 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:41.495 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:28:41.495 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:28:41.495 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:41.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.496+0000 7f044b6cc640 1 Processor -- start 2026-02-12T17:28:41.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.496+0000 7f044b6cc640 1 -- start start 2026-02-12T17:28:41.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.496+0000 7f044b6cc640 10 monclient: init 2026-02-12T17:28:41.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:41.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:28:41.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f044408b530 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:41.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f044405e770 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:41.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f0444189730 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:41.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0444083140 con 0x7f044405e770 2026-02-12T17:28:41.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f044408b900 con 0x7f0444189730 2026-02-12T17:28:41.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f044408cd30 con 0x7f044408b530 2026-02-12T17:28:41.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:41.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f044b6cc640 10 monclient(hunting): authenticate will time out at 601.316299s 2026-02-12T17:28:41.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f0449441640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f044408b530 legacy=0x7f044408bf10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:41.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f0448c40640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f044405e770 0x7f044408c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:57974/0 (socket says 10.20.193.57:57974) 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.497+0000 7f0448c40640 1 -- 10.20.193.57:0/2441426995 learned_addr learned my addr 10.20.193.57:0/2441426995 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0448c40640 1 -- 10.20.193.57:0/2441426995 >> v1:10.20.193.57:6789/0 conn(0x7f044405e770 legacy=0x7f044408c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 1 -- 10.20.193.57:0/2441426995 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382320644 0 0) 0x7f0444083140 con 0x7f044405e770 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient(hunting): _negotiate 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient(hunting): my global_id is 4512 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 1 -- 10.20.193.57:0/2441426995 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f042c0035e0 con 0x7f044405e770 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0449c42640 1 -- 10.20.193.57:0/2441426995 >> v1:10.20.193.82:6789/0 conn(0x7f0444189730 legacy=0x7f04441a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 1 -- 10.20.193.57:0/2441426995 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3784438495 0 0) 0x7f042c0035e0 con 0x7f044405e770 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 1 -- 10.20.193.57:0/2441426995 >> v1:10.20.193.57:6790/0 conn(0x7f044408b530 legacy=0x7f044408bf10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 1 -- 10.20.193.57:0/2441426995 >> v1:10.20.193.82:6789/0 conn(0x7f0444189730 legacy=0x7f04441a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:41.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient: _finish_hunting 0 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 1 monclient: found mon.noname-a 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 1 -- 10.20.193.57:0/2441426995 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0444084f10 con 0x7f044405e770 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient: _finish_auth 0 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient: _check_auth_tickets 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 1 -- 10.20.193.57:0/2441426995 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f04380030d0 con 0x7f044405e770 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f044b6cc640 5 monclient: authenticate success, global_id 4512 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f044b6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:41.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f0433fff640 10 monclient: dump: 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:41.504 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.499+0000 7f044b6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f0433fff640 1 -- 10.20.193.57:0/2441426995 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04380033d0 con 0x7f044405e770 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f0433fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f0433fff640 1 -- 10.20.193.57:0/2441426995 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0438004b10 con 0x7f044405e770 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f0433fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f0433fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f0433fff640 10 monclient: dump: 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:41.505 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 4 set_mon_vals no callback set 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 10 monclient: shutdown 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 1 -- 10.20.193.57:0/2441426995 >> v1:10.20.193.57:6789/0 conn(0x7f044405e770 legacy=0x7f044408c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 1 -- 10.20.193.57:0/2441426995 shutdown_connections 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 1 -- 10.20.193.57:0/2441426995 >> 10.20.193.57:0/2441426995 conn(0x7f0444091510 msgr2=0x7f0444091910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:41.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 1 -- 10.20.193.57:0/2441426995 shutdown_connections 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 1 -- 10.20.193.57:0/2441426995 wait complete. 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 10 monclient: build_initial_monmap 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 10 monclient: monmap: 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:28:41.507 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.500+0000 7f044b6cc640 1 Processor -- start 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 1 -- start start 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 10 monclient: init 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 10 monclient(hunting): picked mon.noname-b con 0x7f044405e770 addr v1:10.20.193.82:6789/0 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f044408b530 addr v1:10.20.193.57:6790/0 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f0444189730 addr v1:10.20.193.57:6789/0 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0444088700 con 0x7f0444189730 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04441a0d80 con 0x7f044405e770 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f044405da20 con 0x7f044408b530 2026-02-12T17:28:41.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:28:41.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f044b6cc640 10 monclient(hunting): authenticate will time out at 601.320257s 2026-02-12T17:28:41.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f0448c40640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f044408b530 legacy=0x7f0444176600 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:28:41.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f0449c42640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f0444189730 0x7f0444177d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:57984/0 (socket says 10.20.193.57:57984) 2026-02-12T17:28:41.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.501+0000 7f0449c42640 1 -- 10.20.193.57:0/3423415922 learned_addr learned my addr 10.20.193.57:0/3423415922 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0449c42640 1 -- 10.20.193.57:0/3423415922 >> v1:10.20.193.57:6789/0 conn(0x7f0444189730 legacy=0x7f0444177d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2601601090 0 0) 0x7f0444088700 con 0x7f0444189730 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): my global_id is 4515 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0449441640 1 -- 10.20.193.57:0/3423415922 >> v1:10.20.193.82:6789/0 conn(0x7f044405e770 legacy=0x7f04441aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04140035e0 con 0x7f0444189730 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2394495708 0 0) 0x7f04140035e0 con 0x7f0444189730 2026-02-12T17:28:41.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0444088700 con 0x7f0444189730 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f04400044c0 con 0x7f0444189730 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): dump: 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:41.514 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447784712 0 0) 0x7f04441a0d80 con 0x7f044405e770 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient(hunting): my global_id is 4465 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04140035e0 con 0x7f044405e770 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4035331899 0 0) 0x7f0444088700 con 0x7f0444189730 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 >> v1:10.20.193.57:6790/0 conn(0x7f044408b530 legacy=0x7f0444176600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:28:41.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 >> v1:10.20.193.82:6789/0 conn(0x7f044405e770 legacy=0x7f04441aa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 monclient: found mon.a 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044405cec0 con 0x7f0444189730 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient: _finish_auth 0 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f0431ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f044b6cc640 5 monclient: authenticate success, global_id 4515 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f044b6cc640 10 monclient: _renew_subs 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f044b6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f044405c460 con 0x7f0444189730 2026-02-12T17:28:41.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f044b6cc640 10 monclient: _renew_subs 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f044b6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.503+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f04441a04e0 con 0x7f0444189730 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0440004a60 con 0x7f0444189730 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f0431ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0440004db0 con 0x7f0444189730 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f0431ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f0431ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f04337fe640 4 set_mon_vals no callback set 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f0431ffb640 10 monclient: dump: 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:41.517 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f044b6cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f044b6cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f044b6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04440008d0 con 0x7f0444189730 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0440004f10 con 0x7f0444189730 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.504+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3858+0+0 (unknown 3480739382 0 0) 0x7f044004fd00 con 0x7f0444189730 2026-02-12T17:28:41.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.505+0000 7f0449441640 10 monclient: get_auth_request con 0x7f041403f7c0 auth_method 0 2026-02-12T17:28:41.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.506+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f04400055b0 con 0x7f0444189730 2026-02-12T17:28:41.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.506+0000 7f0431ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:28:41.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.506+0000 7f0431ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:28:41.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.611+0000 7f044b6cc640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-12T17:28:41.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.611+0000 7f044b6cc640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-12T17:28:41.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.611+0000 7f044b6cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:28:41.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:41.611+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true} v 0) -- 0x7f044419e440 con 0x7f0444189730 2026-02-12T17:28:42.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.418+0000 7f0431ffb640 1 -- 10.20.193.57:0/3423415922 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]=0 enabled application 'rados' on pool 'unique_pool_0' v21) ==== 197+0+0 (unknown 555284988 0 0) 0x7f0440017c10 con 0x7f0444189730 2026-02-12T17:28:42.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.418+0000 7f0431ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}] 2026-02-12T17:28:42.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.418+0000 7f0431ffb640 10 monclient: _finish_command 2 = system:0 enabled application 'rados' on pool 'unique_pool_0' 2026-02-12T17:28:42.415 INFO:teuthology.orchestra.run.trial057.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-12T17:28:42.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.422+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 >> v1:10.20.193.82:6800/2441377515 conn(0x7f041403f7c0 legacy=0x7f041405fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:42.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.422+0000 7f044b6cc640 10 monclient: shutdown 2026-02-12T17:28:42.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.422+0000 7f044b6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:28:42.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.422+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 >> v1:10.20.193.57:6789/0 conn(0x7f0444189730 legacy=0x7f0444177d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:28:42.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.422+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 shutdown_connections 2026-02-12T17:28:42.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.422+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 >> 10.20.193.57:0/3423415922 conn(0x7f0444091510 msgr2=0x7f0444087d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:28:42.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.422+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 shutdown_connections 2026-02-12T17:28:42.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:28:42.422+0000 7f044b6cc640 1 -- 10.20.193.57:0/3423415922 wait complete. 2026-02-12T17:28:43.429 DEBUG:teuthology.orchestra.run.trial082:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0 2026-02-12T17:28:43.471 INFO:tasks.rados.rados.0.trial082.stdout:adding op weight read -> 100 2026-02-12T17:28:43.471 INFO:tasks.rados.rados.0.trial082.stdout:adding op weight write -> 50 2026-02-12T17:28:43.471 INFO:tasks.rados.rados.0.trial082.stdout:adding op weight delete -> 50 2026-02-12T17:28:43.471 INFO:tasks.rados.rados.0.trial082.stdout:adding op weight snap_create -> 50 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout:adding op weight snap_remove -> 50 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout:adding op weight rollback -> 50 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout:adding op weight copy_from -> 50 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout:adding op weight write_excl -> 50 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout:ceph version 20.3.0-5230-gafefaa40 (afefaa40503a4bf024e96f97dd7f852b75f00ad6) tentacle (dev - RelWithDebInfo) 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout:Configuration: 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout: Number of operations: 4000 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout: Number of objects: 50 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout: Max in flight operations: 16 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout: Object size (in bytes): 4000000 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout: Write stride min: 400000 2026-02-12T17:28:43.472 INFO:tasks.rados.rados.0.trial082.stdout: Write stride max: 800000 2026-02-12T17:28:44.474 INFO:tasks.rados.rados.0.trial082.stdout:1: write initial oid 1 2026-02-12T17:28:44.474 INFO:tasks.rados.rados.0.trial082.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2026-02-12T17:28:44.477 INFO:tasks.rados.rados.0.trial082.stdout:1: writing trial08226312-1 from 416807 to 892056 tid 1 2026-02-12T17:28:44.481 INFO:tasks.rados.rados.0.trial082.stdout:1: writing trial08226312-1 from 1542129 to 2016807 tid 2 2026-02-12T17:28:44.482 INFO:tasks.rados.rados.0.trial082.stdout:2: write initial oid 2 2026-02-12T17:28:44.482 INFO:tasks.rados.rados.0.trial082.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2026-02-12T17:28:44.485 INFO:tasks.rados.rados.0.trial082.stdout:2: writing trial08226312-2 from 416807 to 892056 tid 1 2026-02-12T17:28:44.489 INFO:tasks.rados.rados.0.trial082.stdout:2: writing trial08226312-2 from 1542129 to 2016807 tid 2 2026-02-12T17:28:44.489 INFO:tasks.rados.rados.0.trial082.stdout:3: write initial oid 3 2026-02-12T17:28:44.489 INFO:tasks.rados.rados.0.trial082.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2026-02-12T17:28:44.493 INFO:tasks.rados.rados.0.trial082.stdout:3: writing trial08226312-3 from 433614 to 984112 tid 1 2026-02-12T17:28:44.497 INFO:tasks.rados.rados.0.trial082.stdout:3: writing trial08226312-3 from 1600611 to 2033614 tid 2 2026-02-12T17:28:44.497 INFO:tasks.rados.rados.0.trial082.stdout:4: write initial oid 4 2026-02-12T17:28:44.497 INFO:tasks.rados.rados.0.trial082.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2026-02-12T17:28:44.501 INFO:tasks.rados.rados.0.trial082.stdout:4: writing trial08226312-4 from 450421 to 1076168 tid 1 2026-02-12T17:28:44.505 INFO:tasks.rados.rados.0.trial082.stdout:4: writing trial08226312-4 from 1659093 to 2050421 tid 2 2026-02-12T17:28:44.505 INFO:tasks.rados.rados.0.trial082.stdout:5: write initial oid 5 2026-02-12T17:28:44.505 INFO:tasks.rados.rados.0.trial082.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2026-02-12T17:28:44.509 INFO:tasks.rados.rados.0.trial082.stdout:5: writing trial08226312-5 from 467228 to 1168224 tid 1 2026-02-12T17:28:44.512 INFO:tasks.rados.rados.0.trial082.stdout:5: writing trial08226312-5 from 1717575 to 2067228 tid 2 2026-02-12T17:28:44.512 INFO:tasks.rados.rados.0.trial082.stdout:6: write initial oid 6 2026-02-12T17:28:44.512 INFO:tasks.rados.rados.0.trial082.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2026-02-12T17:28:44.517 INFO:tasks.rados.rados.0.trial082.stdout:6: writing trial08226312-6 from 484035 to 1260280 tid 1 2026-02-12T17:28:44.520 INFO:tasks.rados.rados.0.trial082.stdout:6: writing trial08226312-6 from 2059704 to 2084035 tid 2 2026-02-12T17:28:44.520 INFO:tasks.rados.rados.0.trial082.stdout:7: write initial oid 7 2026-02-12T17:28:44.520 INFO:tasks.rados.rados.0.trial082.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2026-02-12T17:28:44.523 INFO:tasks.rados.rados.0.trial082.stdout:7: writing trial08226312-7 from 500842 to 952336 tid 1 2026-02-12T17:28:44.528 INFO:tasks.rados.rados.0.trial082.stdout:7: writing trial08226312-7 from 1718186 to 2100842 tid 2 2026-02-12T17:28:44.528 INFO:tasks.rados.rados.0.trial082.stdout:8: write initial oid 8 2026-02-12T17:28:44.528 INFO:tasks.rados.rados.0.trial082.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2026-02-12T17:28:44.531 INFO:tasks.rados.rados.0.trial082.stdout:8: writing trial08226312-8 from 517649 to 1044392 tid 1 2026-02-12T17:28:44.536 INFO:tasks.rados.rados.0.trial082.stdout:8: writing trial08226312-8 from 1776668 to 2117649 tid 2 2026-02-12T17:28:44.536 INFO:tasks.rados.rados.0.trial082.stdout:9: write initial oid 9 2026-02-12T17:28:44.536 INFO:tasks.rados.rados.0.trial082.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2026-02-12T17:28:44.540 INFO:tasks.rados.rados.0.trial082.stdout:9: writing trial08226312-9 from 534456 to 1252801 tid 1 2026-02-12T17:28:44.543 INFO:tasks.rados.rados.0.trial082.stdout:9: writing trial08226312-9 from 1951503 to 2134456 tid 2 2026-02-12T17:28:44.544 INFO:tasks.rados.rados.0.trial082.stdout:10: write initial oid 10 2026-02-12T17:28:44.544 INFO:tasks.rados.rados.0.trial082.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2026-02-12T17:28:44.549 INFO:tasks.rados.rados.0.trial082.stdout:10: writing trial08226312-10 from 551263 to 1344857 tid 1 2026-02-12T17:28:44.552 INFO:tasks.rados.rados.0.trial082.stdout:10: writing trial08226312-10 from 1893632 to 2151263 tid 2 2026-02-12T17:28:44.552 INFO:tasks.rados.rados.0.trial082.stdout:11: write initial oid 11 2026-02-12T17:28:44.552 INFO:tasks.rados.rados.0.trial082.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2026-02-12T17:28:44.555 INFO:tasks.rados.rados.0.trial082.stdout:11: writing trial08226312-11 from 568070 to 1036913 tid 1 2026-02-12T17:28:44.560 INFO:tasks.rados.rados.0.trial082.stdout:11: writing trial08226312-11 from 1552114 to 2168070 tid 2 2026-02-12T17:28:44.560 INFO:tasks.rados.rados.0.trial082.stdout:12: write initial oid 12 2026-02-12T17:28:44.560 INFO:tasks.rados.rados.0.trial082.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2026-02-12T17:28:44.564 INFO:tasks.rados.rados.0.trial082.stdout:12: writing trial08226312-12 from 584877 to 1128969 tid 1 2026-02-12T17:28:44.568 INFO:tasks.rados.rados.0.trial082.stdout:12: writing trial08226312-12 from 1610596 to 2172599 tid 2 2026-02-12T17:28:44.568 INFO:tasks.rados.rados.0.trial082.stdout:13: write initial oid 13 2026-02-12T17:28:44.568 INFO:tasks.rados.rados.0.trial082.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2026-02-12T17:28:44.573 INFO:tasks.rados.rados.0.trial082.stdout:13: writing trial08226312-13 from 601684 to 1221025 tid 1 2026-02-12T17:28:44.576 INFO:tasks.rados.rados.0.trial082.stdout:13: writing trial08226312-13 from 1669078 to 2201684 tid 2 2026-02-12T17:28:44.577 INFO:tasks.rados.rados.0.trial082.stdout:14: write initial oid 14 2026-02-12T17:28:44.577 INFO:tasks.rados.rados.0.trial082.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2026-02-12T17:28:44.581 INFO:tasks.rados.rados.0.trial082.stdout:14: writing trial08226312-14 from 618491 to 1313081 tid 1 2026-02-12T17:28:44.585 INFO:tasks.rados.rados.0.trial082.stdout:14: writing trial08226312-14 from 2011207 to 2218491 tid 2 2026-02-12T17:28:44.585 INFO:tasks.rados.rados.0.trial082.stdout:15: write initial oid 15 2026-02-12T17:28:44.585 INFO:tasks.rados.rados.0.trial082.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2026-02-12T17:28:44.590 INFO:tasks.rados.rados.0.trial082.stdout:15: writing trial08226312-15 from 635298 to 1405137 tid 1 2026-02-12T17:28:44.593 INFO:tasks.rados.rados.0.trial082.stdout:15: writing trial08226312-15 from 2069689 to 2235298 tid 2 2026-02-12T17:28:44.594 INFO:tasks.rados.rados.0.trial082.stdout:16: write initial oid 16 2026-02-12T17:28:44.594 INFO:tasks.rados.rados.0.trial082.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2026-02-12T17:28:44.597 INFO:tasks.rados.rados.0.trial082.stdout:16: writing trial08226312-16 from 652105 to 1097193 tid 1 2026-02-12T17:28:44.602 INFO:tasks.rados.rados.0.trial082.stdout:16: writing trial08226312-16 from 1728171 to 2181159 tid 2 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:1: finishing write tid 1 to trial08226312-1 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:1: finishing write tid 2 to trial08226312-1 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:1: finishing write tid 3 to trial08226312-1 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:1: finishing write tid 4 to trial08226312-1 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:1: oid 1 updating version 0 to 1 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:1: oid 1 updating version 1 to 2 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:1: oid 1 updating version 2 to 3 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:2: finishing write tid 1 to trial08226312-2 2026-02-12T17:28:44.603 INFO:tasks.rados.rados.0.trial082.stdout:2: finishing write tid 2 to trial08226312-2 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:2: finishing write tid 3 to trial08226312-2 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:2: finishing write tid 4 to trial08226312-2 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:2: oid 2 updating version 0 to 1 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:2: oid 2 updating version 1 to 3 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:2: oid 2 version 3 is already newer than 2 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:3: finishing write tid 1 to trial08226312-3 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:3: finishing write tid 2 to trial08226312-3 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:3: finishing write tid 3 to trial08226312-3 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:1: done (15 left) 2026-02-12T17:28:44.604 INFO:tasks.rados.rados.0.trial082.stdout:2: done (14 left) 2026-02-12T17:28:44.605 INFO:tasks.rados.rados.0.trial082.stdout:17: write initial oid 17 2026-02-12T17:28:44.605 INFO:tasks.rados.rados.0.trial082.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2026-02-12T17:28:44.606 INFO:tasks.rados.rados.0.trial082.stdout:17: writing trial08226312-17 from 668912 to 1305602 tid 1 2026-02-12T17:28:44.610 INFO:tasks.rados.rados.0.trial082.stdout:17: writing trial08226312-17 from 1903006 to 2268912 tid 2 2026-02-12T17:28:44.610 INFO:tasks.rados.rados.0.trial082.stdout:18: write initial oid 18 2026-02-12T17:28:44.610 INFO:tasks.rados.rados.0.trial082.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2026-02-12T17:28:44.615 INFO:tasks.rados.rados.0.trial082.stdout:18: writing trial08226312-18 from 685719 to 1397658 tid 1 2026-02-12T17:28:44.619 INFO:tasks.rados.rados.0.trial082.stdout:18: writing trial08226312-18 from 1845135 to 2285719 tid 2 2026-02-12T17:28:44.619 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.619 INFO:tasks.rados.rados.0.trial082.stdout:3: finishing write tid 4 to trial08226312-3 2026-02-12T17:28:44.619 INFO:tasks.rados.rados.0.trial082.stdout:3: oid 3 updating version 0 to 1 2026-02-12T17:28:44.619 INFO:tasks.rados.rados.0.trial082.stdout:3: oid 3 updating version 1 to 2 2026-02-12T17:28:44.619 INFO:tasks.rados.rados.0.trial082.stdout:3: oid 3 updating version 2 to 3 2026-02-12T17:28:44.620 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-12T17:28:44.620 INFO:tasks.rados.rados.0.trial082.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2026-02-12T17:28:44.620 INFO:tasks.rados.rados.0.trial082.stdout:4: finishing write tid 1 to trial08226312-4 2026-02-12T17:28:44.620 INFO:tasks.rados.rados.0.trial082.stdout:4: finishing write tid 2 to trial08226312-4 2026-02-12T17:28:44.620 INFO:tasks.rados.rados.0.trial082.stdout:3: done (15 left) 2026-02-12T17:28:44.620 INFO:tasks.rados.rados.0.trial082.stdout:19: write initial oid 19 2026-02-12T17:28:44.620 INFO:tasks.rados.rados.0.trial082.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2026-02-12T17:28:44.624 INFO:tasks.rados.rados.0.trial082.stdout:19: writing trial08226312-19 from 702526 to 1489714 tid 1 2026-02-12T17:28:44.628 INFO:tasks.rados.rados.0.trial082.stdout:19: writing trial08226312-19 from 1903617 to 2302526 tid 2 2026-02-12T17:28:44.628 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.628 INFO:tasks.rados.rados.0.trial082.stdout:4: finishing write tid 3 to trial08226312-4 2026-02-12T17:28:44.628 INFO:tasks.rados.rados.0.trial082.stdout:4: finishing write tid 4 to trial08226312-4 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:4: oid 4 updating version 0 to 3 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:4: oid 4 version 3 is already newer than 1 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:4: oid 4 version 3 is already newer than 2 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:5: finishing write tid 1 to trial08226312-5 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:5: finishing write tid 2 to trial08226312-5 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:5: finishing write tid 3 to trial08226312-5 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:5: finishing write tid 4 to trial08226312-5 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:5: oid 5 updating version 0 to 4 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:5: oid 5 updating version 4 to 6 2026-02-12T17:28:44.629 INFO:tasks.rados.rados.0.trial082.stdout:5: oid 5 version 6 is already newer than 5 2026-02-12T17:28:44.630 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 6 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-12T17:28:44.630 INFO:tasks.rados.rados.0.trial082.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2026-02-12T17:28:44.630 INFO:tasks.rados.rados.0.trial082.stdout:6: finishing write tid 1 to trial08226312-6 2026-02-12T17:28:44.630 INFO:tasks.rados.rados.0.trial082.stdout:6: finishing write tid 2 to trial08226312-6 2026-02-12T17:28:44.630 INFO:tasks.rados.rados.0.trial082.stdout:6: finishing write tid 3 to trial08226312-6 2026-02-12T17:28:44.630 INFO:tasks.rados.rados.0.trial082.stdout:4: done (15 left) 2026-02-12T17:28:44.630 INFO:tasks.rados.rados.0.trial082.stdout:5: done (14 left) 2026-02-12T17:28:44.630 INFO:tasks.rados.rados.0.trial082.stdout:20: write initial oid 20 2026-02-12T17:28:44.630 INFO:tasks.rados.rados.0.trial082.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2026-02-12T17:28:44.632 INFO:tasks.rados.rados.0.trial082.stdout:20: writing trial08226312-20 from 719333 to 1181770 tid 1 2026-02-12T17:28:44.637 INFO:tasks.rados.rados.0.trial082.stdout:20: writing trial08226312-20 from 1962099 to 2319333 tid 2 2026-02-12T17:28:44.637 INFO:tasks.rados.rados.0.trial082.stdout:21: write initial oid 21 2026-02-12T17:28:44.637 INFO:tasks.rados.rados.0.trial082.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2026-02-12T17:28:44.641 INFO:tasks.rados.rados.0.trial082.stdout:21: writing trial08226312-21 from 736140 to 1273826 tid 1 2026-02-12T17:28:44.646 INFO:tasks.rados.rados.0.trial082.stdout:21: writing trial08226312-21 from 2020581 to 2336140 tid 2 2026-02-12T17:28:44.646 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.646 INFO:tasks.rados.rados.0.trial082.stdout:6: finishing write tid 4 to trial08226312-6 2026-02-12T17:28:44.646 INFO:tasks.rados.rados.0.trial082.stdout:6: oid 6 updating version 0 to 2 2026-02-12T17:28:44.646 INFO:tasks.rados.rados.0.trial082.stdout:6: oid 6 version 2 is already newer than 1 2026-02-12T17:28:44.647 INFO:tasks.rados.rados.0.trial082.stdout:6: oid 6 updating version 2 to 3 2026-02-12T17:28:44.647 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-12T17:28:44.647 INFO:tasks.rados.rados.0.trial082.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2026-02-12T17:28:44.647 INFO:tasks.rados.rados.0.trial082.stdout:7: finishing write tid 1 to trial08226312-7 2026-02-12T17:28:44.647 INFO:tasks.rados.rados.0.trial082.stdout:7: finishing write tid 2 to trial08226312-7 2026-02-12T17:28:44.647 INFO:tasks.rados.rados.0.trial082.stdout:7: finishing write tid 3 to trial08226312-7 2026-02-12T17:28:44.647 INFO:tasks.rados.rados.0.trial082.stdout:6: done (15 left) 2026-02-12T17:28:44.647 INFO:tasks.rados.rados.0.trial082.stdout:22: write initial oid 22 2026-02-12T17:28:44.647 INFO:tasks.rados.rados.0.trial082.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2026-02-12T17:28:44.650 INFO:tasks.rados.rados.0.trial082.stdout:22: writing trial08226312-22 from 752947 to 1365882 tid 1 2026-02-12T17:28:44.655 INFO:tasks.rados.rados.0.trial082.stdout:22: writing trial08226312-22 from 1962710 to 2352947 tid 2 2026-02-12T17:28:44.655 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.655 INFO:tasks.rados.rados.0.trial082.stdout:7: finishing write tid 4 to trial08226312-7 2026-02-12T17:28:44.655 INFO:tasks.rados.rados.0.trial082.stdout:7: oid 7 updating version 0 to 1 2026-02-12T17:28:44.655 INFO:tasks.rados.rados.0.trial082.stdout:7: oid 7 updating version 1 to 2 2026-02-12T17:28:44.655 INFO:tasks.rados.rados.0.trial082.stdout:7: oid 7 updating version 2 to 3 2026-02-12T17:28:44.655 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 3 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-12T17:28:44.655 INFO:tasks.rados.rados.0.trial082.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2026-02-12T17:28:44.655 INFO:tasks.rados.rados.0.trial082.stdout:8: finishing write tid 1 to trial08226312-8 2026-02-12T17:28:44.656 INFO:tasks.rados.rados.0.trial082.stdout:7: done (15 left) 2026-02-12T17:28:44.656 INFO:tasks.rados.rados.0.trial082.stdout:23: write initial oid 23 2026-02-12T17:28:44.656 INFO:tasks.rados.rados.0.trial082.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2026-02-12T17:28:44.660 INFO:tasks.rados.rados.0.trial082.stdout:23: writing trial08226312-23 from 769754 to 1457938 tid 1 2026-02-12T17:28:44.664 INFO:tasks.rados.rados.0.trial082.stdout:23: writing trial08226312-23 from 2021192 to 2369754 tid 2 2026-02-12T17:28:44.664 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.664 INFO:tasks.rados.rados.0.trial082.stdout:8: finishing write tid 2 to trial08226312-8 2026-02-12T17:28:44.664 INFO:tasks.rados.rados.0.trial082.stdout:8: finishing write tid 3 to trial08226312-8 2026-02-12T17:28:44.664 INFO:tasks.rados.rados.0.trial082.stdout:8: finishing write tid 4 to trial08226312-8 2026-02-12T17:28:44.664 INFO:tasks.rados.rados.0.trial082.stdout:8: oid 8 updating version 0 to 6 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:8: oid 8 version 6 is already newer than 4 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:8: oid 8 version 6 is already newer than 5 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:9: finishing write tid 1 to trial08226312-9 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:9: finishing write tid 2 to trial08226312-9 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:9: finishing write tid 3 to trial08226312-9 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:9: finishing write tid 4 to trial08226312-9 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:9: oid 9 updating version 0 to 5 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:9: oid 9 updating version 5 to 6 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:9: oid 9 version 6 is already newer than 4 2026-02-12T17:28:44.665 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 6 (ObjNum 8 snap 0 seq_num 8) dirty exists 2026-02-12T17:28:44.666 INFO:tasks.rados.rados.0.trial082.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2026-02-12T17:28:44.666 INFO:tasks.rados.rados.0.trial082.stdout:10: finishing write tid 1 to trial08226312-10 2026-02-12T17:28:44.666 INFO:tasks.rados.rados.0.trial082.stdout:8: done (15 left) 2026-02-12T17:28:44.666 INFO:tasks.rados.rados.0.trial082.stdout:9: done (14 left) 2026-02-12T17:28:44.666 INFO:tasks.rados.rados.0.trial082.stdout:24: write initial oid 24 2026-02-12T17:28:44.666 INFO:tasks.rados.rados.0.trial082.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2026-02-12T17:28:44.668 INFO:tasks.rados.rados.0.trial082.stdout:24: writing trial08226312-24 from 786561 to 1266347 tid 1 2026-02-12T17:28:44.672 INFO:tasks.rados.rados.0.trial082.stdout:24: writing trial08226312-24 from 1796027 to 2263691 tid 2 2026-02-12T17:28:44.672 INFO:tasks.rados.rados.0.trial082.stdout:25: write initial oid 25 2026-02-12T17:28:44.672 INFO:tasks.rados.rados.0.trial082.stdout:10: finishing write tid 2 to trial08226312-10 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:10: finishing write tid 3 to trial08226312-10 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:10: finishing write tid 4 to trial08226312-10 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:10: oid 10 updating version 0 to 2 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:10: oid 10 version 2 is already newer than 1 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:10: oid 10 updating version 2 to 3 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 3 (ObjNum 9 snap 0 seq_num 9) dirty exists 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:11: finishing write tid 1 to trial08226312-11 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:11: finishing write tid 2 to trial08226312-11 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:11: finishing write tid 3 to trial08226312-11 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:11: finishing write tid 4 to trial08226312-11 2026-02-12T17:28:44.673 INFO:tasks.rados.rados.0.trial082.stdout:11: oid 11 updating version 0 to 1 2026-02-12T17:28:44.674 INFO:tasks.rados.rados.0.trial082.stdout:11: oid 11 updating version 1 to 2 2026-02-12T17:28:44.674 INFO:tasks.rados.rados.0.trial082.stdout:11: oid 11 updating version 2 to 3 2026-02-12T17:28:44.674 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 3 (ObjNum 10 snap 0 seq_num 10) dirty exists 2026-02-12T17:28:44.674 INFO:tasks.rados.rados.0.trial082.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2026-02-12T17:28:44.674 INFO:tasks.rados.rados.0.trial082.stdout:12: finishing write tid 1 to trial08226312-12 2026-02-12T17:28:44.674 INFO:tasks.rados.rados.0.trial082.stdout:12: finishing write tid 2 to trial08226312-12 2026-02-12T17:28:44.674 INFO:tasks.rados.rados.0.trial082.stdout:12: finishing write tid 3 to trial08226312-12 2026-02-12T17:28:44.674 INFO:tasks.rados.rados.0.trial082.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2026-02-12T17:28:44.675 INFO:tasks.rados.rados.0.trial082.stdout:25: writing trial08226312-25 from 403368 to 958403 tid 1 2026-02-12T17:28:44.680 INFO:tasks.rados.rados.0.trial082.stdout:25: writing trial08226312-25 from 1454509 to 2182184 tid 2 2026-02-12T17:28:44.680 INFO:tasks.rados.rados.0.trial082.stdout:10: done (15 left) 2026-02-12T17:28:44.680 INFO:tasks.rados.rados.0.trial082.stdout:11: done (14 left) 2026-02-12T17:28:44.680 INFO:tasks.rados.rados.0.trial082.stdout:26: write initial oid 26 2026-02-12T17:28:44.680 INFO:tasks.rados.rados.0.trial082.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2026-02-12T17:28:44.684 INFO:tasks.rados.rados.0.trial082.stdout:26: writing trial08226312-26 from 420175 to 1050459 tid 1 2026-02-12T17:28:44.688 INFO:tasks.rados.rados.0.trial082.stdout:26: writing trial08226312-26 from 1796638 to 2267971 tid 2 2026-02-12T17:28:44.688 INFO:tasks.rados.rados.0.trial082.stdout:27: write initial oid 27 2026-02-12T17:28:44.688 INFO:tasks.rados.rados.0.trial082.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2026-02-12T17:28:44.692 INFO:tasks.rados.rados.0.trial082.stdout:27: writing trial08226312-27 from 436982 to 1142515 tid 1 2026-02-12T17:28:44.698 INFO:tasks.rados.rados.0.trial082.stdout:27: writing trial08226312-27 from 1855120 to 2436982 tid 2 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:12: finishing write tid 4 to trial08226312-12 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:12: oid 12 updating version 0 to 2 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:12: oid 12 version 2 is already newer than 1 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:12: oid 12 updating version 2 to 3 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 3 (ObjNum 11 snap 0 seq_num 11) dirty exists 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:13: finishing write tid 1 to trial08226312-13 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:13: finishing write tid 2 to trial08226312-13 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:13: finishing write tid 3 to trial08226312-13 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:13: finishing write tid 4 to trial08226312-13 2026-02-12T17:28:44.699 INFO:tasks.rados.rados.0.trial082.stdout:13: oid 13 updating version 0 to 1 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:13: oid 13 updating version 1 to 2 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:13: oid 13 updating version 2 to 3 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 3 (ObjNum 12 snap 0 seq_num 12) dirty exists 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:14: finishing write tid 1 to trial08226312-14 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:14: finishing write tid 2 to trial08226312-14 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:14: finishing write tid 3 to trial08226312-14 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:14: finishing write tid 4 to trial08226312-14 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:14: oid 14 updating version 0 to 8 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:14: oid 14 updating version 8 to 9 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:14: oid 14 version 9 is already newer than 7 2026-02-12T17:28:44.700 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 9 (ObjNum 13 snap 0 seq_num 13) dirty exists 2026-02-12T17:28:44.701 INFO:tasks.rados.rados.0.trial082.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2026-02-12T17:28:44.701 INFO:tasks.rados.rados.0.trial082.stdout:15: finishing write tid 1 to trial08226312-15 2026-02-12T17:28:44.701 INFO:tasks.rados.rados.0.trial082.stdout:15: finishing write tid 2 to trial08226312-15 2026-02-12T17:28:44.701 INFO:tasks.rados.rados.0.trial082.stdout:12: done (15 left) 2026-02-12T17:28:44.701 INFO:tasks.rados.rados.0.trial082.stdout:13: done (14 left) 2026-02-12T17:28:44.701 INFO:tasks.rados.rados.0.trial082.stdout:14: done (13 left) 2026-02-12T17:28:44.701 INFO:tasks.rados.rados.0.trial082.stdout:28: write initial oid 28 2026-02-12T17:28:44.701 INFO:tasks.rados.rados.0.trial082.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2026-02-12T17:28:44.702 INFO:tasks.rados.rados.0.trial082.stdout:28: writing trial08226312-28 from 453789 to 1234571 tid 1 2026-02-12T17:28:44.706 INFO:tasks.rados.rados.0.trial082.stdout:28: writing trial08226312-28 from 1913602 to 2388604 tid 2 2026-02-12T17:28:44.707 INFO:tasks.rados.rados.0.trial082.stdout:29: write initial oid 29 2026-02-12T17:28:44.707 INFO:tasks.rados.rados.0.trial082.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2026-02-12T17:28:44.710 INFO:tasks.rados.rados.0.trial082.stdout:29: writing trial08226312-29 from 470596 to 926627 tid 1 2026-02-12T17:28:44.715 INFO:tasks.rados.rados.0.trial082.stdout:29: writing trial08226312-29 from 1572084 to 2190744 tid 2 2026-02-12T17:28:44.715 INFO:tasks.rados.rados.0.trial082.stdout:30: write initial oid 30 2026-02-12T17:28:44.715 INFO:tasks.rados.rados.0.trial082.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2026-02-12T17:28:44.718 INFO:tasks.rados.rados.0.trial082.stdout:30: writing trial08226312-30 from 487403 to 1018683 tid 1 2026-02-12T17:28:44.722 INFO:tasks.rados.rados.0.trial082.stdout:30: writing trial08226312-30 from 1514213 to 1992884 tid 2 2026-02-12T17:28:44.722 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:15: finishing write tid 3 to trial08226312-15 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:15: finishing write tid 4 to trial08226312-15 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:15: oid 15 updating version 0 to 11 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:15: oid 15 version 11 is already newer than 10 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:15: oid 15 updating version 11 to 12 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 12 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:16: finishing write tid 1 to trial08226312-16 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:15: done (15 left) 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:31: write initial oid 31 2026-02-12T17:28:44.723 INFO:tasks.rados.rados.0.trial082.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2026-02-12T17:28:44.726 INFO:tasks.rados.rados.0.trial082.stdout:31: writing trial08226312-31 from 504210 to 1110739 tid 1 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout:31: writing trial08226312-31 from 1572695 to 2195024 tid 2 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout:16: finishing write tid 2 to trial08226312-16 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout:16: finishing write tid 3 to trial08226312-16 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout:16: finishing write tid 4 to trial08226312-16 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout:16: oid 16 updating version 0 to 7 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout:16: oid 16 updating version 7 to 8 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout:16: oid 16 updating version 8 to 9 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 9 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-12T17:28:44.731 INFO:tasks.rados.rados.0.trial082.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2026-02-12T17:28:44.732 INFO:tasks.rados.rados.0.trial082.stdout:17: finishing write tid 1 to trial08226312-17 2026-02-12T17:28:44.732 INFO:tasks.rados.rados.0.trial082.stdout:16: done (15 left) 2026-02-12T17:28:44.732 INFO:tasks.rados.rados.0.trial082.stdout:32: write initial oid 32 2026-02-12T17:28:44.732 INFO:tasks.rados.rados.0.trial082.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2026-02-12T17:28:44.735 INFO:tasks.rados.rados.0.trial082.stdout:32: writing trial08226312-32 from 521017 to 1319148 tid 1 2026-02-12T17:28:44.739 INFO:tasks.rados.rados.0.trial082.stdout:32: writing trial08226312-32 from 1747530 to 2229870 tid 2 2026-02-12T17:28:44.739 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.739 INFO:tasks.rados.rados.0.trial082.stdout:17: finishing write tid 2 to trial08226312-17 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:17: finishing write tid 3 to trial08226312-17 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:17: finishing write tid 4 to trial08226312-17 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:17: oid 17 updating version 0 to 9 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:17: oid 17 version 9 is already newer than 8 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:17: oid 17 version 9 is already newer than 7 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 9 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:18: finishing write tid 1 to trial08226312-18 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:18: finishing write tid 2 to trial08226312-18 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:18: finishing write tid 3 to trial08226312-18 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:18: finishing write tid 4 to trial08226312-18 2026-02-12T17:28:44.740 INFO:tasks.rados.rados.0.trial082.stdout:18: oid 18 updating version 0 to 2 2026-02-12T17:28:44.741 INFO:tasks.rados.rados.0.trial082.stdout:18: oid 18 version 2 is already newer than 1 2026-02-12T17:28:44.741 INFO:tasks.rados.rados.0.trial082.stdout:18: oid 18 updating version 2 to 3 2026-02-12T17:28:44.741 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 3 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-12T17:28:44.741 INFO:tasks.rados.rados.0.trial082.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2026-02-12T17:28:44.741 INFO:tasks.rados.rados.0.trial082.stdout:19: finishing write tid 1 to trial08226312-19 2026-02-12T17:28:44.741 INFO:tasks.rados.rados.0.trial082.stdout:17: done (15 left) 2026-02-12T17:28:44.741 INFO:tasks.rados.rados.0.trial082.stdout:18: done (14 left) 2026-02-12T17:28:44.741 INFO:tasks.rados.rados.0.trial082.stdout:33: write initial oid 33 2026-02-12T17:28:44.741 INFO:tasks.rados.rados.0.trial082.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2026-02-12T17:28:44.742 INFO:tasks.rados.rados.0.trial082.stdout:33: writing trial08226312-33 from 537824 to 1011204 tid 1 2026-02-12T17:28:44.748 INFO:tasks.rados.rados.0.trial082.stdout:33: writing trial08226312-33 from 1806012 to 2432010 tid 2 2026-02-12T17:28:44.748 INFO:tasks.rados.rados.0.trial082.stdout:34: write initial oid 34 2026-02-12T17:28:44.748 INFO:tasks.rados.rados.0.trial082.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2026-02-12T17:28:44.751 INFO:tasks.rados.rados.0.trial082.stdout:34: writing trial08226312-34 from 554631 to 1103260 tid 1 2026-02-12T17:28:44.756 INFO:tasks.rados.rados.0.trial082.stdout:34: writing trial08226312-34 from 1748141 to 2234150 tid 2 2026-02-12T17:28:44.756 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.756 INFO:tasks.rados.rados.0.trial082.stdout:19: finishing write tid 2 to trial08226312-19 2026-02-12T17:28:44.756 INFO:tasks.rados.rados.0.trial082.stdout:19: finishing write tid 3 to trial08226312-19 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:19: finishing write tid 4 to trial08226312-19 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:19: oid 19 updating version 0 to 12 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:19: oid 19 version 12 is already newer than 10 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:19: oid 19 version 12 is already newer than 11 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 12 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:20: finishing write tid 1 to trial08226312-20 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:20: finishing write tid 2 to trial08226312-20 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:19: done (15 left) 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:35: write initial oid 35 2026-02-12T17:28:44.757 INFO:tasks.rados.rados.0.trial082.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2026-02-12T17:28:44.760 INFO:tasks.rados.rados.0.trial082.stdout:35: writing trial08226312-35 from 571438 to 1195316 tid 1 2026-02-12T17:28:44.765 INFO:tasks.rados.rados.0.trial082.stdout:35: writing trial08226312-35 from 1806623 to 2436290 tid 2 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:20: finishing write tid 3 to trial08226312-20 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:20: finishing write tid 4 to trial08226312-20 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:20: oid 20 updating version 0 to 14 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:20: oid 20 version 14 is already newer than 13 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:20: oid 20 updating version 14 to 15 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 15 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:21: finishing write tid 1 to trial08226312-21 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:21: finishing write tid 2 to trial08226312-21 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:21: finishing write tid 3 to trial08226312-21 2026-02-12T17:28:44.766 INFO:tasks.rados.rados.0.trial082.stdout:21: finishing write tid 4 to trial08226312-21 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:21: oid 21 updating version 0 to 4 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:21: oid 21 updating version 4 to 5 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:21: oid 21 updating version 5 to 6 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 6 (ObjNum 20 snap 0 seq_num 20) dirty exists 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:22: finishing write tid 1 to trial08226312-22 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:22: finishing write tid 2 to trial08226312-22 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:22: finishing write tid 3 to trial08226312-22 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:20: done (15 left) 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:21: done (14 left) 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:36: write initial oid 36 2026-02-12T17:28:44.767 INFO:tasks.rados.rados.0.trial082.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2026-02-12T17:28:44.770 INFO:tasks.rados.rados.0.trial082.stdout:36: writing trial08226312-36 from 588245 to 1287372 tid 1 2026-02-12T17:28:44.774 INFO:tasks.rados.rados.0.trial082.stdout:36: writing trial08226312-36 from 1865105 to 2354783 tid 2 2026-02-12T17:28:44.774 INFO:tasks.rados.rados.0.trial082.stdout:37: write initial oid 37 2026-02-12T17:28:44.774 INFO:tasks.rados.rados.0.trial082.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2026-02-12T17:28:44.779 INFO:tasks.rados.rados.0.trial082.stdout:37: writing trial08226312-37 from 605052 to 1379428 tid 1 2026-02-12T17:28:44.783 INFO:tasks.rados.rados.0.trial082.stdout:37: writing trial08226312-37 from 1923587 to 2556923 tid 2 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:22: finishing write tid 4 to trial08226312-22 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:22: oid 22 updating version 0 to 8 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:22: oid 22 updating version 8 to 9 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:22: oid 22 version 9 is already newer than 7 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 9 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:23: finishing write tid 1 to trial08226312-23 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:22: done (15 left) 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:38: write initial oid 38 2026-02-12T17:28:44.784 INFO:tasks.rados.rados.0.trial082.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2026-02-12T17:28:44.787 INFO:tasks.rados.rados.0.trial082.stdout:38: writing trial08226312-38 from 621859 to 1071484 tid 1 2026-02-12T17:28:44.793 INFO:tasks.rados.rados.0.trial082.stdout:38: writing trial08226312-38 from 1865716 to 2621859 tid 2 2026-02-12T17:28:44.793 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.793 INFO:tasks.rados.rados.0.trial082.stdout:23: finishing write tid 2 to trial08226312-23 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:23: finishing write tid 3 to trial08226312-23 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:23: finishing write tid 4 to trial08226312-23 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:23: oid 23 updating version 0 to 1 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:23: oid 23 updating version 1 to 2 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:23: oid 23 updating version 2 to 3 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 3 (ObjNum 22 snap 0 seq_num 22) dirty exists 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:24: finishing write tid 1 to trial08226312-24 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:23: done (15 left) 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:39: write initial oid 39 2026-02-12T17:28:44.794 INFO:tasks.rados.rados.0.trial082.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2026-02-12T17:28:44.797 INFO:tasks.rados.rados.0.trial082.stdout:39: writing trial08226312-39 from 638666 to 1163540 tid 1 2026-02-12T17:28:44.803 INFO:tasks.rados.rados.0.trial082.stdout:39: writing trial08226312-39 from 1924198 to 2561203 tid 2 2026-02-12T17:28:44.803 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.803 INFO:tasks.rados.rados.0.trial082.stdout:24: finishing write tid 2 to trial08226312-24 2026-02-12T17:28:44.803 INFO:tasks.rados.rados.0.trial082.stdout:24: finishing write tid 3 to trial08226312-24 2026-02-12T17:28:44.803 INFO:tasks.rados.rados.0.trial082.stdout:24: finishing write tid 4 to trial08226312-24 2026-02-12T17:28:44.803 INFO:tasks.rados.rados.0.trial082.stdout:24: oid 24 updating version 0 to 17 2026-02-12T17:28:44.803 INFO:tasks.rados.rados.0.trial082.stdout:24: oid 24 updating version 17 to 18 2026-02-12T17:28:44.803 INFO:tasks.rados.rados.0.trial082.stdout:24: oid 24 version 18 is already newer than 16 2026-02-12T17:28:44.804 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 18 (ObjNum 23 snap 0 seq_num 23) dirty exists 2026-02-12T17:28:44.804 INFO:tasks.rados.rados.0.trial082.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2026-02-12T17:28:44.804 INFO:tasks.rados.rados.0.trial082.stdout:25: finishing write tid 1 to trial08226312-25 2026-02-12T17:28:44.804 INFO:tasks.rados.rados.0.trial082.stdout:25: finishing write tid 2 to trial08226312-25 2026-02-12T17:28:44.804 INFO:tasks.rados.rados.0.trial082.stdout:25: finishing write tid 3 to trial08226312-25 2026-02-12T17:28:44.804 INFO:tasks.rados.rados.0.trial082.stdout:24: done (15 left) 2026-02-12T17:28:44.804 INFO:tasks.rados.rados.0.trial082.stdout:40: write initial oid 40 2026-02-12T17:28:44.804 INFO:tasks.rados.rados.0.trial082.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2026-02-12T17:28:44.807 INFO:tasks.rados.rados.0.trial082.stdout:40: writing trial08226312-40 from 655473 to 1371949 tid 1 2026-02-12T17:28:44.813 INFO:tasks.rados.rados.0.trial082.stdout:40: writing trial08226312-40 from 2099033 to 2655473 tid 2 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:25: finishing write tid 4 to trial08226312-25 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:25: oid 25 updating version 0 to 6 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:25: oid 25 version 6 is already newer than 5 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:25: oid 25 version 6 is already newer than 4 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 6 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:26: finishing write tid 1 to trial08226312-26 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:26: finishing write tid 2 to trial08226312-26 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:26: finishing write tid 3 to trial08226312-26 2026-02-12T17:28:44.814 INFO:tasks.rados.rados.0.trial082.stdout:26: finishing write tid 4 to trial08226312-26 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:26: oid 26 updating version 0 to 5 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:26: oid 26 version 5 is already newer than 4 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:26: oid 26 updating version 5 to 6 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 6 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:27: finishing write tid 1 to trial08226312-27 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:27: finishing write tid 2 to trial08226312-27 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:27: finishing write tid 3 to trial08226312-27 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:27: finishing write tid 4 to trial08226312-27 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:27: oid 27 updating version 0 to 1 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:27: oid 27 updating version 1 to 2 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:27: oid 27 updating version 2 to 3 2026-02-12T17:28:44.815 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 3 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:28: finishing write tid 1 to trial08226312-28 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:28: finishing write tid 2 to trial08226312-28 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:28: finishing write tid 3 to trial08226312-28 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:28: finishing write tid 4 to trial08226312-28 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:28: oid 28 updating version 0 to 12 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:28: oid 28 version 12 is already newer than 11 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:28: oid 28 version 12 is already newer than 10 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 12 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:29: finishing write tid 1 to trial08226312-29 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:30: finishing write tid 1 to trial08226312-30 2026-02-12T17:28:44.816 INFO:tasks.rados.rados.0.trial082.stdout:30: finishing write tid 2 to trial08226312-30 2026-02-12T17:28:44.817 INFO:tasks.rados.rados.0.trial082.stdout:30: finishing write tid 3 to trial08226312-30 2026-02-12T17:28:44.817 INFO:tasks.rados.rados.0.trial082.stdout:25: done (15 left) 2026-02-12T17:28:44.817 INFO:tasks.rados.rados.0.trial082.stdout:26: done (14 left) 2026-02-12T17:28:44.817 INFO:tasks.rados.rados.0.trial082.stdout:27: done (13 left) 2026-02-12T17:28:44.817 INFO:tasks.rados.rados.0.trial082.stdout:28: done (12 left) 2026-02-12T17:28:44.817 INFO:tasks.rados.rados.0.trial082.stdout:41: write initial oid 41 2026-02-12T17:28:44.817 INFO:tasks.rados.rados.0.trial082.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2026-02-12T17:28:44.818 INFO:tasks.rados.rados.0.trial082.stdout:41: writing trial08226312-41 from 672280 to 1464005 tid 1 2026-02-12T17:28:44.822 INFO:tasks.rados.rados.0.trial082.stdout:41: writing trial08226312-41 from 2157515 to 2672280 tid 2 2026-02-12T17:28:44.823 INFO:tasks.rados.rados.0.trial082.stdout:42: write initial oid 42 2026-02-12T17:28:44.823 INFO:tasks.rados.rados.0.trial082.stdout:30: finishing write tid 4 to trial08226312-30 2026-02-12T17:28:44.823 INFO:tasks.rados.rados.0.trial082.stdout:30: oid 30 updating version 0 to 11 2026-02-12T17:28:44.823 INFO:tasks.rados.rados.0.trial082.stdout:30: oid 30 version 11 is already newer than 10 2026-02-12T17:28:44.823 INFO:tasks.rados.rados.0.trial082.stdout:30: oid 30 updating version 11 to 12 2026-02-12T17:28:44.823 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 12 (ObjNum 29 snap 0 seq_num 29) dirty exists 2026-02-12T17:28:44.823 INFO:tasks.rados.rados.0.trial082.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2026-02-12T17:28:44.823 INFO:tasks.rados.rados.0.trial082.stdout:29: finishing write tid 2 to trial08226312-29 2026-02-12T17:28:44.823 INFO:tasks.rados.rados.0.trial082.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2026-02-12T17:28:44.826 INFO:tasks.rados.rados.0.trial082.stdout:42: writing trial08226312-42 from 689087 to 1156061 tid 1 2026-02-12T17:28:44.832 INFO:tasks.rados.rados.0.trial082.stdout:42: writing trial08226312-42 from 1699644 to 2483976 tid 2 2026-02-12T17:28:44.832 INFO:tasks.rados.rados.0.trial082.stdout:30: done (13 left) 2026-02-12T17:28:44.832 INFO:tasks.rados.rados.0.trial082.stdout:43: write initial oid 43 2026-02-12T17:28:44.832 INFO:tasks.rados.rados.0.trial082.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2026-02-12T17:28:44.836 INFO:tasks.rados.rados.0.trial082.stdout:43: writing trial08226312-43 from 705894 to 1248117 tid 1 2026-02-12T17:28:44.841 INFO:tasks.rados.rados.0.trial082.stdout:43: writing trial08226312-43 from 1758126 to 2402469 tid 2 2026-02-12T17:28:44.841 INFO:tasks.rados.rados.0.trial082.stdout:44: write initial oid 44 2026-02-12T17:28:44.841 INFO:tasks.rados.rados.0.trial082.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2026-02-12T17:28:44.846 INFO:tasks.rados.rados.0.trial082.stdout:44: writing trial08226312-44 from 722701 to 1340173 tid 1 2026-02-12T17:28:44.850 INFO:tasks.rados.rados.0.trial082.stdout:44: writing trial08226312-44 from 1816608 to 2604609 tid 2 2026-02-12T17:28:44.851 INFO:tasks.rados.rados.0.trial082.stdout:45: write initial oid 45 2026-02-12T17:28:44.851 INFO:tasks.rados.rados.0.trial082.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2026-02-12T17:28:44.856 INFO:tasks.rados.rados.0.trial082.stdout:45: writing trial08226312-45 from 739508 to 1432229 tid 1 2026-02-12T17:28:44.860 INFO:tasks.rados.rados.0.trial082.stdout:45: writing trial08226312-45 from 1875090 to 2523102 tid 2 2026-02-12T17:28:44.860 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.860 INFO:tasks.rados.rados.0.trial082.stdout:29: finishing write tid 3 to trial08226312-29 2026-02-12T17:28:44.860 INFO:tasks.rados.rados.0.trial082.stdout:29: finishing write tid 4 to trial08226312-29 2026-02-12T17:28:44.861 INFO:tasks.rados.rados.0.trial082.stdout:29: oid 29 updating version 0 to 6 2026-02-12T17:28:44.861 INFO:tasks.rados.rados.0.trial082.stdout:29: oid 29 version 6 is already newer than 4 2026-02-12T17:28:44.861 INFO:tasks.rados.rados.0.trial082.stdout:29: oid 29 version 6 is already newer than 5 2026-02-12T17:28:44.861 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 6 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-12T17:28:44.861 INFO:tasks.rados.rados.0.trial082.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2026-02-12T17:28:44.861 INFO:tasks.rados.rados.0.trial082.stdout:31: finishing write tid 1 to trial08226312-31 2026-02-12T17:28:44.861 INFO:tasks.rados.rados.0.trial082.stdout:29: done (15 left) 2026-02-12T17:28:44.861 INFO:tasks.rados.rados.0.trial082.stdout:46: write initial oid 46 2026-02-12T17:28:44.861 INFO:tasks.rados.rados.0.trial082.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2026-02-12T17:28:44.865 INFO:tasks.rados.rados.0.trial082.stdout:46: writing trial08226312-46 from 756315 to 1524285 tid 1 2026-02-12T17:28:44.870 INFO:tasks.rados.rados.0.trial082.stdout:46: writing trial08226312-46 from 1933572 to 2725242 tid 2 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:31: finishing write tid 2 to trial08226312-31 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:31: finishing write tid 3 to trial08226312-31 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:31: finishing write tid 4 to trial08226312-31 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:31: oid 31 updating version 0 to 5 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:31: oid 31 version 5 is already newer than 4 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:31: oid 31 updating version 5 to 6 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 6 (ObjNum 30 snap 0 seq_num 30) dirty exists 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:32: finishing write tid 1 to trial08226312-32 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:32: finishing write tid 2 to trial08226312-32 2026-02-12T17:28:44.871 INFO:tasks.rados.rados.0.trial082.stdout:32: finishing write tid 3 to trial08226312-32 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:32: finishing write tid 4 to trial08226312-32 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:32: oid 32 updating version 0 to 1 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:32: oid 32 updating version 1 to 2 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:32: oid 32 updating version 2 to 3 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 3 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:33: finishing write tid 1 to trial08226312-33 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:31: done (15 left) 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:32: done (14 left) 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:47: write initial oid 47 2026-02-12T17:28:44.872 INFO:tasks.rados.rados.0.trial082.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2026-02-12T17:28:44.875 INFO:tasks.rados.rados.0.trial082.stdout:47: writing trial08226312-47 from 773122 to 1332694 tid 1 2026-02-12T17:28:44.880 INFO:tasks.rados.rados.0.trial082.stdout:47: writing trial08226312-47 from 1992054 to 2643735 tid 2 2026-02-12T17:28:44.880 INFO:tasks.rados.rados.0.trial082.stdout:48: write initial oid 48 2026-02-12T17:28:44.880 INFO:tasks.rados.rados.0.trial082.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2026-02-12T17:28:44.885 INFO:tasks.rados.rados.0.trial082.stdout:48: writing trial08226312-48 from 789929 to 1424750 tid 1 2026-02-12T17:28:44.891 INFO:tasks.rados.rados.0.trial082.stdout:48: writing trial08226312-48 from 2050536 to 2789929 tid 2 2026-02-12T17:28:44.891 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 16 2026-02-12T17:28:44.891 INFO:tasks.rados.rados.0.trial082.stdout:33: finishing write tid 2 to trial08226312-33 2026-02-12T17:28:44.891 INFO:tasks.rados.rados.0.trial082.stdout:33: finishing write tid 3 to trial08226312-33 2026-02-12T17:28:44.891 INFO:tasks.rados.rados.0.trial082.stdout:33: finishing write tid 4 to trial08226312-33 2026-02-12T17:28:44.891 INFO:tasks.rados.rados.0.trial082.stdout:33: oid 33 updating version 0 to 5 2026-02-12T17:28:44.891 INFO:tasks.rados.rados.0.trial082.stdout:33: oid 33 version 5 is already newer than 4 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:33: oid 33 updating version 5 to 6 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 6 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:34: finishing write tid 1 to trial08226312-34 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:34: finishing write tid 2 to trial08226312-34 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:34: finishing write tid 3 to trial08226312-34 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:34: finishing write tid 4 to trial08226312-34 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:34: oid 34 updating version 0 to 4 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:34: oid 34 updating version 4 to 6 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:34: oid 34 version 6 is already newer than 5 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 6 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-12T17:28:44.892 INFO:tasks.rados.rados.0.trial082.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:35: finishing write tid 1 to trial08226312-35 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:35: finishing write tid 2 to trial08226312-35 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:35: finishing write tid 3 to trial08226312-35 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:35: finishing write tid 4 to trial08226312-35 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:35: oid 35 updating version 0 to 8 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:35: oid 35 updating version 8 to 9 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:35: oid 35 version 9 is already newer than 7 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 9 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:36: finishing write tid 1 to trial08226312-36 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:33: done (15 left) 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:34: done (14 left) 2026-02-12T17:28:44.893 INFO:tasks.rados.rados.0.trial082.stdout:35: done (13 left) 2026-02-12T17:28:44.894 INFO:tasks.rados.rados.0.trial082.stdout:49: write initial oid 49 2026-02-12T17:28:44.894 INFO:tasks.rados.rados.0.trial082.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2026-02-12T17:28:44.894 INFO:tasks.rados.rados.0.trial082.stdout:49: writing trial08226312-49 from 406736 to 1116806 tid 1 2026-02-12T17:28:44.899 INFO:tasks.rados.rados.0.trial082.stdout:49: writing trial08226312-49 from 1709018 to 2364368 tid 2 2026-02-12T17:28:44.899 INFO:tasks.rados.rados.0.trial082.stdout:50: write initial oid 50 2026-02-12T17:28:44.899 INFO:tasks.rados.rados.0.trial082.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2026-02-12T17:28:44.903 INFO:tasks.rados.rados.0.trial082.stdout:50: writing trial08226312-50 from 423543 to 1208862 tid 1 2026-02-12T17:28:44.911 INFO:tasks.rados.rados.0.trial082.stdout:50: writing trial08226312-50 from 1767500 to 2566508 tid 2 2026-02-12T17:28:44.911 INFO:tasks.rados.rados.0.trial082.stdout:51: snap_create 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:36: finishing write tid 2 to trial08226312-36 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:36: finishing write tid 3 to trial08226312-36 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:36: finishing write tid 4 to trial08226312-36 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:36: oid 36 updating version 0 to 11 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:36: oid 36 updating version 11 to 12 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:36: oid 36 version 12 is already newer than 10 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 12 (ObjNum 35 snap 0 seq_num 35) dirty exists 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:37: finishing write tid 1 to trial08226312-37 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:37: finishing write tid 2 to trial08226312-37 2026-02-12T17:28:44.912 INFO:tasks.rados.rados.0.trial082.stdout:37: finishing write tid 3 to trial08226312-37 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:37: finishing write tid 4 to trial08226312-37 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:37: oid 37 updating version 0 to 9 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:37: oid 37 version 9 is already newer than 8 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:37: oid 37 version 9 is already newer than 7 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 9 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:38: finishing write tid 1 to trial08226312-38 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:38: finishing write tid 2 to trial08226312-38 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:38: finishing write tid 3 to trial08226312-38 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:38: finishing write tid 4 to trial08226312-38 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:38: oid 38 updating version 0 to 4 2026-02-12T17:28:44.913 INFO:tasks.rados.rados.0.trial082.stdout:38: oid 38 updating version 4 to 5 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:38: oid 38 updating version 5 to 6 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 6 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:39: finishing write tid 1 to trial08226312-39 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:40: finishing write tid 1 to trial08226312-40 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:39: finishing write tid 2 to trial08226312-39 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:39: finishing write tid 3 to trial08226312-39 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:39: finishing write tid 4 to trial08226312-39 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:39: oid 39 updating version 0 to 5 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:39: oid 39 updating version 5 to 6 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:39: oid 39 version 6 is already newer than 4 2026-02-12T17:28:44.914 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 6 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:40: finishing write tid 2 to trial08226312-40 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:40: finishing write tid 3 to trial08226312-40 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:40: finishing write tid 4 to trial08226312-40 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:40: oid 40 updating version 0 to 15 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:40: oid 40 version 15 is already newer than 13 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:40: oid 40 version 15 is already newer than 14 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 15 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:41: finishing write tid 1 to trial08226312-41 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:41: finishing write tid 2 to trial08226312-41 2026-02-12T17:28:44.915 INFO:tasks.rados.rados.0.trial082.stdout:41: finishing write tid 3 to trial08226312-41 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:41: finishing write tid 4 to trial08226312-41 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:41: oid 41 updating version 0 to 10 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:41: oid 41 updating version 10 to 12 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:41: oid 41 version 12 is already newer than 11 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 12 (ObjNum 40 snap 0 seq_num 40) dirty exists 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:42: finishing write tid 1 to trial08226312-42 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:42: finishing write tid 2 to trial08226312-42 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:42: finishing write tid 3 to trial08226312-42 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:42: finishing write tid 4 to trial08226312-42 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:42: oid 42 updating version 0 to 17 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:42: oid 42 updating version 17 to 18 2026-02-12T17:28:44.916 INFO:tasks.rados.rados.0.trial082.stdout:42: oid 42 version 18 is already newer than 16 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 18 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:43: finishing write tid 1 to trial08226312-43 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:43: finishing write tid 2 to trial08226312-43 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:43: finishing write tid 3 to trial08226312-43 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:43: finishing write tid 4 to trial08226312-43 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:43: oid 43 updating version 0 to 14 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:43: oid 43 version 14 is already newer than 13 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:43: oid 43 updating version 14 to 15 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 15 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:28:44.917 INFO:tasks.rados.rados.0.trial082.stdout:44: finishing write tid 1 to trial08226312-44 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:44: finishing write tid 2 to trial08226312-44 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:44: finishing write tid 3 to trial08226312-44 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:44: finishing write tid 4 to trial08226312-44 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:44: oid 44 updating version 0 to 14 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:44: oid 44 updating version 14 to 15 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:44: oid 44 version 15 is already newer than 13 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 15 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:45: finishing write tid 1 to trial08226312-45 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:45: finishing write tid 2 to trial08226312-45 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:45: finishing write tid 3 to trial08226312-45 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:45: finishing write tid 4 to trial08226312-45 2026-02-12T17:28:44.918 INFO:tasks.rados.rados.0.trial082.stdout:45: oid 45 updating version 0 to 18 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:45: oid 45 version 18 is already newer than 17 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:45: oid 45 version 18 is already newer than 16 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 18 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:46: finishing write tid 1 to trial08226312-46 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:46: finishing write tid 2 to trial08226312-46 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:46: finishing write tid 3 to trial08226312-46 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:46: finishing write tid 4 to trial08226312-46 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:46: oid 46 updating version 0 to 4 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:46: oid 46 updating version 4 to 6 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:46: oid 46 version 6 is already newer than 5 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 6 (ObjNum 45 snap 0 seq_num 45) dirty exists 2026-02-12T17:28:44.919 INFO:tasks.rados.rados.0.trial082.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:47: finishing write tid 1 to trial08226312-47 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:47: finishing write tid 2 to trial08226312-47 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:47: finishing write tid 3 to trial08226312-47 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:47: finishing write tid 4 to trial08226312-47 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:47: oid 47 updating version 0 to 19 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:47: oid 47 updating version 19 to 21 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:47: oid 47 version 21 is already newer than 20 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 21 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:48: finishing write tid 1 to trial08226312-48 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:48: finishing write tid 2 to trial08226312-48 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:48: finishing write tid 3 to trial08226312-48 2026-02-12T17:28:44.920 INFO:tasks.rados.rados.0.trial082.stdout:48: finishing write tid 4 to trial08226312-48 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:48: oid 48 updating version 0 to 3 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:48: oid 48 version 3 is already newer than 1 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:48: oid 48 version 3 is already newer than 2 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 3 (ObjNum 47 snap 0 seq_num 47) dirty exists 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:49: finishing write tid 1 to trial08226312-49 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:49: finishing write tid 2 to trial08226312-49 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:49: finishing write tid 3 to trial08226312-49 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:49: finishing write tid 4 to trial08226312-49 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:49: oid 49 updating version 0 to 8 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:49: oid 49 updating version 8 to 9 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:49: oid 49 version 9 is already newer than 7 2026-02-12T17:28:44.921 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:50: finishing write tid 1 to trial08226312-50 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:50: finishing write tid 2 to trial08226312-50 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:50: finishing write tid 3 to trial08226312-50 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:50: finishing write tid 4 to trial08226312-50 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:50: oid 50 updating version 0 to 9 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:50: oid 50 version 9 is already newer than 7 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:50: oid 50 version 9 is already newer than 8 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 9 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-12T17:28:44.922 INFO:tasks.rados.rados.0.trial082.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2026-02-12T17:28:45.708 INFO:tasks.rados.rados.0.trial082.stdout:36: done (15 left) 2026-02-12T17:28:45.708 INFO:tasks.rados.rados.0.trial082.stdout:37: done (14 left) 2026-02-12T17:28:45.708 INFO:tasks.rados.rados.0.trial082.stdout:38: done (13 left) 2026-02-12T17:28:45.708 INFO:tasks.rados.rados.0.trial082.stdout:39: done (12 left) 2026-02-12T17:28:45.708 INFO:tasks.rados.rados.0.trial082.stdout:40: done (11 left) 2026-02-12T17:28:45.708 INFO:tasks.rados.rados.0.trial082.stdout:41: done (10 left) 2026-02-12T17:28:45.708 INFO:tasks.rados.rados.0.trial082.stdout:42: done (9 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:43: done (8 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:44: done (7 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:45: done (6 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:46: done (5 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:47: done (4 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:48: done (3 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:49: done (2 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:50: done (1 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:51: done (0 left) 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:52: write oid 31 current snap is 1 2026-02-12T17:28:45.709 INFO:tasks.rados.rados.0.trial082.stdout:52: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2026-02-12T17:28:45.710 INFO:tasks.rados.rados.0.trial082.stdout:52: writing trial08226312-31 from 440350 to 900918 tid 1 2026-02-12T17:28:45.714 INFO:tasks.rados.rados.0.trial082.stdout:52: writing trial08226312-31 from 1309629 to 1852295 tid 2 2026-02-12T17:28:45.718 INFO:tasks.rados.rados.0.trial082.stdout:52: writing trial08226312-31 from 2323973 to 2840350 tid 3 2026-02-12T17:28:45.718 INFO:tasks.rados.rados.0.trial082.stdout:53: delete oid 39 current snap is 1 2026-02-12T17:28:45.718 INFO:tasks.rados.rados.0.trial082.stdout:52: finishing write tid 1 to trial08226312-31 2026-02-12T17:28:45.718 INFO:tasks.rados.rados.0.trial082.stdout:52: finishing write tid 2 to trial08226312-31 2026-02-12T17:28:45.720 INFO:tasks.rados.rados.0.trial082.stdout:52: finishing write tid 3 to trial08226312-31 2026-02-12T17:28:45.720 INFO:tasks.rados.rados.0.trial082.stdout:52: finishing write tid 4 to trial08226312-31 2026-02-12T17:28:45.720 INFO:tasks.rados.rados.0.trial082.stdout:52: finishing write tid 5 to trial08226312-31 2026-02-12T17:28:45.720 INFO:tasks.rados.rados.0.trial082.stdout:52: oid 31 updating version 0 to 11 2026-02-12T17:28:45.720 INFO:tasks.rados.rados.0.trial082.stdout:52: oid 31 version 11 is already newer than 8 2026-02-12T17:28:45.720 INFO:tasks.rados.rados.0.trial082.stdout:52: oid 31 version 11 is already newer than 10 2026-02-12T17:28:45.720 INFO:tasks.rados.rados.0.trial082.stdout:52: oid 31 version 11 is already newer than 9 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 11 (ObjNum 50 snap 1 seq_num 50) dirty exists 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:52: left oid 31 (ObjNum 50 snap 1 seq_num 50) 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:52: done (1 left) 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:53: done (0 left) 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:54: read oid 49 snap -1 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:54: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:55: read oid 17 snap -1 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:55: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:56: copy_from oid 35 from oid 1 current snap is 1 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:57: copy_from oid 21 from oid 15 current snap is 1 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:58: write oid 9 current snap is 1 2026-02-12T17:28:45.721 INFO:tasks.rados.rados.0.trial082.stdout:58: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2026-02-12T17:28:45.724 INFO:tasks.rados.rados.0.trial082.stdout:58: writing trial08226312-9 from 473964 to 1085030 tid 1 2026-02-12T17:28:45.728 INFO:tasks.rados.rados.0.trial082.stdout:58: writing trial08226312-9 from 1826593 to 2372928 tid 2 2026-02-12T17:28:45.731 INFO:tasks.rados.rados.0.trial082.stdout:58: writing trial08226312-9 from 2778819 to 2873964 tid 3 2026-02-12T17:28:45.731 INFO:tasks.rados.rados.0.trial082.stdout:59: read oid 46 snap -1 2026-02-12T17:28:45.731 INFO:tasks.rados.rados.0.trial082.stdout:59: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-12T17:28:45.731 INFO:tasks.rados.rados.0.trial082.stdout:60: copy_from oid 33 from oid 26 current snap is 1 2026-02-12T17:28:45.731 INFO:tasks.rados.rados.0.trial082.stdout:55: expect (ObjNum 16 snap 0 seq_num 16) 2026-02-12T17:28:45.731 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:45.748 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:45.776 INFO:tasks.rados.rados.0.trial082.stdout:54: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-12T17:28:45.798 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1436067 2026-02-12T17:28:45.811 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:45.832 INFO:tasks.rados.rados.0.trial082.stdout:58: finishing write tid 1 to trial08226312-9 2026-02-12T17:28:45.832 INFO:tasks.rados.rados.0.trial082.stdout:56: finishing copy_from racing read to trial08226312-35 2026-02-12T17:28:45.832 INFO:tasks.rados.rados.0.trial082.stdout:56: finishing copy_from to trial08226312-35 2026-02-12T17:28:45.832 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2026-02-12T17:28:45.832 INFO:tasks.rados.rados.0.trial082.stdout:58: finishing write tid 2 to trial08226312-9 2026-02-12T17:28:45.832 INFO:tasks.rados.rados.0.trial082.stdout:58: finishing write tid 3 to trial08226312-9 2026-02-12T17:28:45.832 INFO:tasks.rados.rados.0.trial082.stdout:54: done (6 left) 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:55: done (5 left) 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:56: done (4 left) 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:61: write oid 17 current snap is 1 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:57: finishing copy_from racing read to trial08226312-21 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:58: finishing write tid 4 to trial08226312-9 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:58: finishing write tid 5 to trial08226312-9 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:58: oid 9 updating version 0 to 20 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:58: oid 9 updating version 20 to 21 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:58: oid 9 updating version 21 to 22 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:58: oid 9 updating version 22 to 23 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 23 (ObjNum 52 snap 1 seq_num 52) dirty exists 2026-02-12T17:28:45.833 INFO:tasks.rados.rados.0.trial082.stdout:58: left oid 9 (ObjNum 52 snap 1 seq_num 52) 2026-02-12T17:28:45.834 INFO:tasks.rados.rados.0.trial082.stdout:57: finishing copy_from to trial08226312-21 2026-02-12T17:28:45.834 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 12 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-12T17:28:45.834 INFO:tasks.rados.rados.0.trial082.stdout:59: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-12T17:28:45.843 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:45.879 INFO:tasks.rados.rados.0.trial082.stdout:60: finishing copy_from racing read to trial08226312-33 2026-02-12T17:28:45.879 INFO:tasks.rados.rados.0.trial082.stdout:61: seq_num 53 ranges {490771=686315,1885075=406346} 2026-02-12T17:28:45.883 INFO:tasks.rados.rados.0.trial082.stdout:61: writing trial08226312-17 from 490771 to 1177086 tid 1 2026-02-12T17:28:45.888 INFO:tasks.rados.rados.0.trial082.stdout:61: writing trial08226312-17 from 1885075 to 2291421 tid 2 2026-02-12T17:28:45.889 INFO:tasks.rados.rados.0.trial082.stdout:57: done (4 left) 2026-02-12T17:28:45.889 INFO:tasks.rados.rados.0.trial082.stdout:58: done (3 left) 2026-02-12T17:28:45.889 INFO:tasks.rados.rados.0.trial082.stdout:59: done (2 left) 2026-02-12T17:28:45.889 INFO:tasks.rados.rados.0.trial082.stdout:62: read oid 9 snap -1 2026-02-12T17:28:45.889 INFO:tasks.rados.rados.0.trial082.stdout:62: expect (ObjNum 52 snap 1 seq_num 52) 2026-02-12T17:28:45.889 INFO:tasks.rados.rados.0.trial082.stdout:63: copy_from oid 42 from oid 6 current snap is 1 2026-02-12T17:28:45.889 INFO:tasks.rados.rados.0.trial082.stdout:60: finishing copy_from to trial08226312-33 2026-02-12T17:28:45.889 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 6 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-12T17:28:45.890 INFO:tasks.rados.rados.0.trial082.stdout:61: finishing write tid 1 to trial08226312-17 2026-02-12T17:28:45.890 INFO:tasks.rados.rados.0.trial082.stdout:60: done (3 left) 2026-02-12T17:28:45.890 INFO:tasks.rados.rados.0.trial082.stdout:64: copy_from oid 19 from oid 43 current snap is 1 2026-02-12T17:28:45.890 INFO:tasks.rados.rados.0.trial082.stdout:65: read oid 46 snap -1 2026-02-12T17:28:45.890 INFO:tasks.rados.rados.0.trial082.stdout:65: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-12T17:28:45.890 INFO:tasks.rados.rados.0.trial082.stdout:66: snap_remove snap 0 2026-02-12T17:28:46.710 INFO:tasks.rados.rados.0.trial082.stdout:66: done (5 left) 2026-02-12T17:28:46.711 INFO:tasks.rados.rados.0.trial082.stdout:67: rollback oid 25 current snap is 1 2026-02-12T17:28:46.711 INFO:tasks.rados.rados.0.trial082.stdout:67: done (5 left) 2026-02-12T17:28:46.711 INFO:tasks.rados.rados.0.trial082.stdout:68: read oid 1 snap -1 2026-02-12T17:28:46.711 INFO:tasks.rados.rados.0.trial082.stdout:68: expect (ObjNum 0 snap 0 seq_num 0) 2026-02-12T17:28:46.711 INFO:tasks.rados.rados.0.trial082.stdout:69: write (excl) oid 24 current snap is 1 2026-02-12T17:28:46.711 INFO:tasks.rados.rados.0.trial082.stdout:69: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2026-02-12T17:28:46.714 INFO:tasks.rados.rados.0.trial082.stdout:69: writing trial08226312-24 from 507578 to 985495 tid 1 2026-02-12T17:28:46.718 INFO:tasks.rados.rados.0.trial082.stdout:69: writing trial08226312-24 from 1543557 to 2093561 tid 2 2026-02-12T17:28:46.722 INFO:tasks.rados.rados.0.trial082.stdout:69: writing trial08226312-24 from 2833665 to 2907578 tid 3 2026-02-12T17:28:46.722 INFO:tasks.rados.rados.0.trial082.stdout:70: read oid 41 snap -1 2026-02-12T17:28:46.722 INFO:tasks.rados.rados.0.trial082.stdout:70: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-12T17:28:46.722 INFO:tasks.rados.rados.0.trial082.stdout:71: write oid 22 current snap is 1 2026-02-12T17:28:46.722 INFO:tasks.rados.rados.0.trial082.stdout:61: finishing write tid 2 to trial08226312-17 2026-02-12T17:28:46.722 INFO:tasks.rados.rados.0.trial082.stdout:61: finishing write tid 3 to trial08226312-17 2026-02-12T17:28:46.723 INFO:tasks.rados.rados.0.trial082.stdout:61: finishing write tid 4 to trial08226312-17 2026-02-12T17:28:46.723 INFO:tasks.rados.rados.0.trial082.stdout:61: oid 17 updating version 0 to 25 2026-02-12T17:28:46.723 INFO:tasks.rados.rados.0.trial082.stdout:61: oid 17 version 25 is already newer than 23 2026-02-12T17:28:46.723 INFO:tasks.rados.rados.0.trial082.stdout:61: oid 17 version 25 is already newer than 24 2026-02-12T17:28:46.723 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 25 (ObjNum 53 snap 1 seq_num 53) dirty exists 2026-02-12T17:28:46.723 INFO:tasks.rados.rados.0.trial082.stdout:61: left oid 17 (ObjNum 53 snap 1 seq_num 53) 2026-02-12T17:28:46.723 INFO:tasks.rados.rados.0.trial082.stdout:65: expect (ObjNum 45 snap 0 seq_num 45) 2026-02-12T17:28:46.725 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1913539 2026-02-12T17:28:46.765 INFO:tasks.rados.rados.0.trial082.stdout:62: expect (ObjNum 52 snap 1 seq_num 52) 2026-02-12T17:28:46.818 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:46.847 INFO:tasks.rados.rados.0.trial082.stdout:64: finishing copy_from racing read to trial08226312-19 2026-02-12T17:28:46.848 INFO:tasks.rados.rados.0.trial082.stdout:64: finishing copy_from to trial08226312-19 2026-02-12T17:28:46.848 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 15 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:28:46.848 INFO:tasks.rados.rados.0.trial082.stdout:63: finishing copy_from racing read to trial08226312-42 2026-02-12T17:28:46.848 INFO:tasks.rados.rados.0.trial082.stdout:63: finishing copy_from to trial08226312-42 2026-02-12T17:28:46.848 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-12T17:28:46.848 INFO:tasks.rados.rados.0.trial082.stdout:68: expect (ObjNum 0 snap 0 seq_num 0) 2026-02-12T17:28:46.855 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:46.884 INFO:tasks.rados.rados.0.trial082.stdout:69: finishing write tid 1 to trial08226312-24 2026-02-12T17:28:46.884 INFO:tasks.rados.rados.0.trial082.stdout:69: finishing write tid 2 to trial08226312-24 2026-02-12T17:28:46.884 INFO:tasks.rados.rados.0.trial082.stdout:69: finishing write tid 3 to trial08226312-24 2026-02-12T17:28:46.884 INFO:tasks.rados.rados.0.trial082.stdout:71: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2026-02-12T17:28:46.888 INFO:tasks.rados.rados.0.trial082.stdout:71: writing trial08226312-22 from 524385 to 1077551 tid 1 2026-02-12T17:28:46.891 INFO:tasks.rados.rados.0.trial082.stdout:71: writing trial08226312-22 from 1602039 to 2012054 tid 2 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:71: writing trial08226312-22 from 2577441 to 2924385 tid 3 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:61: done (8 left) 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:62: done (7 left) 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:63: done (6 left) 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:64: done (5 left) 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:65: done (4 left) 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:68: done (3 left) 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:72: copy_from oid 18 from oid 5 current snap is 1 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:69: finishing write tid 4 to trial08226312-24 2026-02-12T17:28:46.896 INFO:tasks.rados.rados.0.trial082.stdout:69: finishing write tid 5 to trial08226312-24 2026-02-12T17:28:46.897 INFO:tasks.rados.rados.0.trial082.stdout:69: oid 24 updating version 0 to 34 2026-02-12T17:28:46.897 INFO:tasks.rados.rados.0.trial082.stdout:69: oid 24 version 34 is already newer than 32 2026-02-12T17:28:46.897 INFO:tasks.rados.rados.0.trial082.stdout:69: oid 24 version 34 is already newer than 33 2026-02-12T17:28:46.897 INFO:tasks.rados.rados.0.trial082.stdout:69: oid 24 updating version 34 to 35 2026-02-12T17:28:46.897 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 35 (ObjNum 54 snap 1 seq_num 54) dirty exists 2026-02-12T17:28:46.897 INFO:tasks.rados.rados.0.trial082.stdout:69: left oid 24 (ObjNum 54 snap 1 seq_num 54) 2026-02-12T17:28:46.897 INFO:tasks.rados.rados.0.trial082.stdout:70: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-12T17:28:46.899 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 942371 2026-02-12T17:28:46.929 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1160249 2026-02-12T17:28:46.940 INFO:tasks.rados.rados.0.trial082.stdout:71: finishing write tid 1 to trial08226312-22 2026-02-12T17:28:46.940 INFO:tasks.rados.rados.0.trial082.stdout:71: finishing write tid 2 to trial08226312-22 2026-02-12T17:28:46.940 INFO:tasks.rados.rados.0.trial082.stdout:71: finishing write tid 3 to trial08226312-22 2026-02-12T17:28:46.940 INFO:tasks.rados.rados.0.trial082.stdout:71: finishing write tid 4 to trial08226312-22 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:69: done (3 left) 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:70: done (2 left) 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:73: snap_create 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:71: finishing write tid 5 to trial08226312-22 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:71: oid 22 updating version 0 to 22 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:71: oid 22 version 22 is already newer than 20 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:71: oid 22 version 22 is already newer than 21 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:71: oid 22 updating version 22 to 23 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 23 (ObjNum 55 snap 1 seq_num 55) dirty exists 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:71: left oid 22 (ObjNum 55 snap 1 seq_num 55) 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:72: finishing copy_from racing read to trial08226312-18 2026-02-12T17:28:46.941 INFO:tasks.rados.rados.0.trial082.stdout:72: finishing copy_from to trial08226312-18 2026-02-12T17:28:46.942 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 6 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-12T17:28:47.715 INFO:tasks.rados.rados.0.trial082.stdout:71: done (2 left) 2026-02-12T17:28:47.716 INFO:tasks.rados.rados.0.trial082.stdout:72: done (1 left) 2026-02-12T17:28:47.716 INFO:tasks.rados.rados.0.trial082.stdout:73: done (0 left) 2026-02-12T17:28:47.716 INFO:tasks.rados.rados.0.trial082.stdout:74: read oid 20 snap -1 2026-02-12T17:28:47.716 INFO:tasks.rados.rados.0.trial082.stdout:74: expect (ObjNum 19 snap 0 seq_num 19) 2026-02-12T17:28:47.716 INFO:tasks.rados.rados.0.trial082.stdout:75: rollback oid 24 current snap is 2 2026-02-12T17:28:47.716 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 1 2026-02-12T17:28:47.716 INFO:tasks.rados.rados.0.trial082.stdout:76: write (excl) oid 23 current snap is 2 2026-02-12T17:28:47.716 INFO:tasks.rados.rados.0.trial082.stdout:76: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2026-02-12T17:28:47.719 INFO:tasks.rados.rados.0.trial082.stdout:76: writing trial08226312-23 from 541192 to 1169607 tid 1 2026-02-12T17:28:47.723 INFO:tasks.rados.rados.0.trial082.stdout:76: writing trial08226312-23 from 1660521 to 2214194 tid 2 2026-02-12T17:28:47.726 INFO:tasks.rados.rados.0.trial082.stdout:76: writing trial08226312-23 from 2888511 to 2941192 tid 3 2026-02-12T17:28:47.727 INFO:tasks.rados.rados.0.trial082.stdout:77: write oid 7 current snap is 2 2026-02-12T17:28:47.727 INFO:tasks.rados.rados.0.trial082.stdout:77: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2026-02-12T17:28:47.731 INFO:tasks.rados.rados.0.trial082.stdout:77: writing trial08226312-7 from 557999 to 1261663 tid 1 2026-02-12T17:28:47.734 INFO:tasks.rados.rados.0.trial082.stdout:77: writing trial08226312-7 from 1719003 to 2132687 tid 2 2026-02-12T17:28:47.737 INFO:tasks.rados.rados.0.trial082.stdout:77: writing trial08226312-7 from 2632287 to 2957999 tid 3 2026-02-12T17:28:47.737 INFO:tasks.rados.rados.0.trial082.stdout:78: rollback oid 45 current snap is 2 2026-02-12T17:28:47.737 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 1 2026-02-12T17:28:47.737 INFO:tasks.rados.rados.0.trial082.stdout:74: expect (ObjNum 19 snap 0 seq_num 19) 2026-02-12T17:28:47.737 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:47.755 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:47.773 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 449479 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:75: finishing rollback tid 0 to trial08226312-24 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:75: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:75: finishing rollback tid 2 to trial08226312-24 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 39 (ObjNum 54 snap 1 seq_num 54) dirty exists 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:76: finishing write tid 1 to trial08226312-23 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:76: finishing write tid 2 to trial08226312-23 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:76: finishing write tid 3 to trial08226312-23 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:74: done (4 left) 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:75: done (3 left) 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:79: write (excl) oid 4 current snap is 2 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:76: finishing write tid 4 to trial08226312-23 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:76: finishing write tid 5 to trial08226312-23 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:76: oid 23 updating version 0 to 26 2026-02-12T17:28:47.789 INFO:tasks.rados.rados.0.trial082.stdout:76: oid 23 version 26 is already newer than 25 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:76: oid 23 updating version 26 to 27 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:76: oid 23 version 27 is already newer than 24 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 27 (ObjNum 56 snap 2 seq_num 56) dirty exists 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:76: left oid 23 (ObjNum 56 snap 2 seq_num 56) 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: finishing write tid 1 to trial08226312-7 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: finishing write tid 2 to trial08226312-7 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: finishing write tid 3 to trial08226312-7 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:78: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: finishing write tid 4 to trial08226312-7 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:78: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:78: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 31 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: finishing write tid 5 to trial08226312-7 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: oid 7 updating version 0 to 34 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: oid 7 version 34 is already newer than 31 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: oid 7 version 34 is already newer than 32 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: oid 7 version 34 is already newer than 33 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 34 (ObjNum 57 snap 2 seq_num 57) dirty exists 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:77: left oid 7 (ObjNum 57 snap 2 seq_num 57) 2026-02-12T17:28:47.790 INFO:tasks.rados.rados.0.trial082.stdout:79: seq_num 58 ranges {574806=778913,2061132=557342} 2026-02-12T17:28:47.794 INFO:tasks.rados.rados.0.trial082.stdout:79: writing trial08226312-4 from 574806 to 1353719 tid 1 2026-02-12T17:28:47.799 INFO:tasks.rados.rados.0.trial082.stdout:79: writing trial08226312-4 from 2061132 to 2618474 tid 2 2026-02-12T17:28:47.799 INFO:tasks.rados.rados.0.trial082.stdout:76: done (3 left) 2026-02-12T17:28:47.799 INFO:tasks.rados.rados.0.trial082.stdout:77: done (2 left) 2026-02-12T17:28:47.799 INFO:tasks.rados.rados.0.trial082.stdout:78: done (1 left) 2026-02-12T17:28:47.799 INFO:tasks.rados.rados.0.trial082.stdout:80: rollback oid 15 current snap is 2 2026-02-12T17:28:47.799 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 15 to 1 2026-02-12T17:28:47.799 INFO:tasks.rados.rados.0.trial082.stdout:79: finishing write tid 1 to trial08226312-4 2026-02-12T17:28:47.799 INFO:tasks.rados.rados.0.trial082.stdout:81: write (excl) oid 3 current snap is 2 2026-02-12T17:28:47.799 INFO:tasks.rados.rados.0.trial082.stdout:81: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2026-02-12T17:28:47.803 INFO:tasks.rados.rados.0.trial082.stdout:81: writing trial08226312-3 from 591613 to 1045775 tid 1 2026-02-12T17:28:47.807 INFO:tasks.rados.rados.0.trial082.stdout:81: writing trial08226312-3 from 1719614 to 2136967 tid 2 2026-02-12T17:28:47.810 INFO:tasks.rados.rados.0.trial082.stdout:81: writing trial08226312-3 from 2570780 to 2991613 tid 3 2026-02-12T17:28:47.810 INFO:tasks.rados.rados.0.trial082.stdout:82: read oid 21 snap -1 2026-02-12T17:28:47.810 INFO:tasks.rados.rados.0.trial082.stdout:82: expect (ObjNum 14 snap 0 seq_num 14) 2026-02-12T17:28:47.810 INFO:tasks.rados.rados.0.trial082.stdout:83: read oid 10 snap -1 2026-02-12T17:28:47.810 INFO:tasks.rados.rados.0.trial082.stdout:83: expect (ObjNum 9 snap 0 seq_num 9) 2026-02-12T17:28:47.810 INFO:tasks.rados.rados.0.trial082.stdout:84: write (excl) oid 49 current snap is 2 2026-02-12T17:28:47.810 INFO:tasks.rados.rados.0.trial082.stdout:84: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2026-02-12T17:28:47.814 INFO:tasks.rados.rados.0.trial082.stdout:84: writing trial08226312-49 from 608420 to 1137831 tid 1 2026-02-12T17:28:47.818 INFO:tasks.rados.rados.0.trial082.stdout:84: writing trial08226312-49 from 1778096 to 2339107 tid 2 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:84: writing trial08226312-49 from 2881850 to 3008420 tid 3 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:85: write (excl) oid 47 current snap is 2 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:79: finishing write tid 2 to trial08226312-4 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:79: finishing write tid 3 to trial08226312-4 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:79: finishing write tid 4 to trial08226312-4 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:79: oid 4 updating version 0 to 42 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:79: oid 4 updating version 42 to 43 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:79: oid 4 version 43 is already newer than 41 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 43 (ObjNum 58 snap 2 seq_num 58) dirty exists 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:79: left oid 4 (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:80: finishing rollback tid 0 to trial08226312-15 2026-02-12T17:28:47.821 INFO:tasks.rados.rados.0.trial082.stdout:85: seq_num 61 ranges {625227=721013,1952931=704669} 2026-02-12T17:28:47.826 INFO:tasks.rados.rados.0.trial082.stdout:85: writing trial08226312-47 from 625227 to 1346240 tid 1 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:85: writing trial08226312-47 from 1952931 to 2657600 tid 2 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:79: done (6 left) 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:86: snap_create 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:80: finishing rollback tid 1 to trial08226312-15 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:80: finishing rollback tid 2 to trial08226312-15 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 16 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: finishing write tid 1 to trial08226312-3 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: finishing write tid 2 to trial08226312-3 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: finishing write tid 3 to trial08226312-3 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: finishing write tid 4 to trial08226312-3 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: finishing write tid 5 to trial08226312-3 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: oid 3 updating version 0 to 19 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: oid 3 updating version 19 to 20 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: oid 3 version 20 is already newer than 18 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: oid 3 updating version 20 to 21 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 21 (ObjNum 59 snap 2 seq_num 59) dirty exists 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:81: left oid 3 (ObjNum 59 snap 2 seq_num 59) 2026-02-12T17:28:47.831 INFO:tasks.rados.rados.0.trial082.stdout:82: expect (ObjNum 14 snap 0 seq_num 14) 2026-02-12T17:28:47.851 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1206459 2026-02-12T17:28:47.873 INFO:tasks.rados.rados.0.trial082.stdout:83: expect (ObjNum 9 snap 0 seq_num 9) 2026-02-12T17:28:47.889 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1739433 2026-02-12T17:28:47.896 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: finishing write tid 1 to trial08226312-49 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: finishing write tid 2 to trial08226312-49 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: finishing write tid 3 to trial08226312-49 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: finishing write tid 4 to trial08226312-49 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: finishing write tid 5 to trial08226312-49 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: oid 49 updating version 0 to 15 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: oid 49 version 15 is already newer than 13 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: oid 49 version 15 is already newer than 12 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: oid 49 version 15 is already newer than 14 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 15 (ObjNum 60 snap 2 seq_num 60) dirty exists 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:84: left oid 49 (ObjNum 60 snap 2 seq_num 60) 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:85: finishing write tid 1 to trial08226312-47 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:85: finishing write tid 2 to trial08226312-47 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:85: finishing write tid 3 to trial08226312-47 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:85: finishing write tid 4 to trial08226312-47 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:85: oid 47 updating version 0 to 46 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:85: oid 47 version 46 is already newer than 45 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:85: oid 47 updating version 46 to 47 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 47 (ObjNum 61 snap 2 seq_num 61) dirty exists 2026-02-12T17:28:47.911 INFO:tasks.rados.rados.0.trial082.stdout:85: left oid 47 (ObjNum 61 snap 2 seq_num 61) 2026-02-12T17:28:48.716 INFO:tasks.rados.rados.0.trial082.stdout:80: done (6 left) 2026-02-12T17:28:48.717 INFO:tasks.rados.rados.0.trial082.stdout:81: done (5 left) 2026-02-12T17:28:48.717 INFO:tasks.rados.rados.0.trial082.stdout:82: done (4 left) 2026-02-12T17:28:48.717 INFO:tasks.rados.rados.0.trial082.stdout:83: done (3 left) 2026-02-12T17:28:48.717 INFO:tasks.rados.rados.0.trial082.stdout:84: done (2 left) 2026-02-12T17:28:48.717 INFO:tasks.rados.rados.0.trial082.stdout:85: done (1 left) 2026-02-12T17:28:48.717 INFO:tasks.rados.rados.0.trial082.stdout:86: done (0 left) 2026-02-12T17:28:48.717 INFO:tasks.rados.rados.0.trial082.stdout:87: write oid 28 current snap is 3 2026-02-12T17:28:48.717 INFO:tasks.rados.rados.0.trial082.stdout:87: seq_num 62 ranges {642034=796262,1895060=564680} 2026-02-12T17:28:48.721 INFO:tasks.rados.rados.0.trial082.stdout:87: writing trial08226312-28 from 642034 to 1438296 tid 1 2026-02-12T17:28:48.726 INFO:tasks.rados.rados.0.trial082.stdout:87: writing trial08226312-28 from 1895060 to 2459740 tid 2 2026-02-12T17:28:48.726 INFO:tasks.rados.rados.0.trial082.stdout:88: read oid 6 snap -1 2026-02-12T17:28:48.726 INFO:tasks.rados.rados.0.trial082.stdout:88: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-12T17:28:48.726 INFO:tasks.rados.rados.0.trial082.stdout:89: read oid 23 snap 1 2026-02-12T17:28:48.726 INFO:tasks.rados.rados.0.trial082.stdout:89: expect (ObjNum 22 snap 0 seq_num 22) 2026-02-12T17:28:48.726 INFO:tasks.rados.rados.0.trial082.stdout:90: snap_create 2026-02-12T17:28:48.726 INFO:tasks.rados.rados.0.trial082.stdout:88: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-12T17:28:48.754 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2043489 2026-02-12T17:28:48.760 INFO:tasks.rados.rados.0.trial082.stdout:87: finishing write tid 1 to trial08226312-28 2026-02-12T17:28:48.760 INFO:tasks.rados.rados.0.trial082.stdout:89: expect (ObjNum 22 snap 0 seq_num 22) 2026-02-12T17:28:48.801 INFO:tasks.rados.rados.0.trial082.stdout:87: finishing write tid 2 to trial08226312-28 2026-02-12T17:28:48.801 INFO:tasks.rados.rados.0.trial082.stdout:87: finishing write tid 3 to trial08226312-28 2026-02-12T17:28:48.801 INFO:tasks.rados.rados.0.trial082.stdout:87: finishing write tid 4 to trial08226312-28 2026-02-12T17:28:48.801 INFO:tasks.rados.rados.0.trial082.stdout:87: oid 28 updating version 0 to 36 2026-02-12T17:28:48.801 INFO:tasks.rados.rados.0.trial082.stdout:87: oid 28 updating version 36 to 38 2026-02-12T17:28:48.801 INFO:tasks.rados.rados.0.trial082.stdout:87: oid 28 version 38 is already newer than 37 2026-02-12T17:28:48.801 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 38 (ObjNum 62 snap 3 seq_num 62) dirty exists 2026-02-12T17:28:48.801 INFO:tasks.rados.rados.0.trial082.stdout:87: left oid 28 (ObjNum 62 snap 3 seq_num 62) 2026-02-12T17:28:49.721 INFO:tasks.rados.rados.0.trial082.stdout:87: done (3 left) 2026-02-12T17:28:49.721 INFO:tasks.rados.rados.0.trial082.stdout:88: done (2 left) 2026-02-12T17:28:49.721 INFO:tasks.rados.rados.0.trial082.stdout:89: done (1 left) 2026-02-12T17:28:49.721 INFO:tasks.rados.rados.0.trial082.stdout:90: done (0 left) 2026-02-12T17:28:49.722 INFO:tasks.rados.rados.0.trial082.stdout:91: read oid 39 snap 2 2026-02-12T17:28:49.722 INFO:tasks.rados.rados.0.trial082.stdout:91: expect deleted 2026-02-12T17:28:49.722 INFO:tasks.rados.rados.0.trial082.stdout:92: copy_from oid 10 from oid 50 current snap is 4 2026-02-12T17:28:49.722 INFO:tasks.rados.rados.0.trial082.stdout:93: snap_create 2026-02-12T17:28:49.729 INFO:tasks.rados.rados.0.trial082.stdout:92: finishing copy_from racing read to trial08226312-10 2026-02-12T17:28:49.731 INFO:tasks.rados.rados.0.trial082.stdout:92: finishing copy_from to trial08226312-10 2026-02-12T17:28:49.731 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 9 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-12T17:28:50.722 INFO:tasks.rados.rados.0.trial082.stdout:91: done (2 left) 2026-02-12T17:28:50.722 INFO:tasks.rados.rados.0.trial082.stdout:92: done (1 left) 2026-02-12T17:28:50.722 INFO:tasks.rados.rados.0.trial082.stdout:93: done (0 left) 2026-02-12T17:28:50.722 INFO:tasks.rados.rados.0.trial082.stdout:94: snap_create 2026-02-12T17:28:51.830 INFO:tasks.rados.rados.0.trial082.stdout:94: done (0 left) 2026-02-12T17:28:51.830 INFO:tasks.rados.rados.0.trial082.stdout:95: snap_create 2026-02-12T17:28:52.728 INFO:tasks.rados.rados.0.trial082.stdout:95: done (0 left) 2026-02-12T17:28:52.728 INFO:tasks.rados.rados.0.trial082.stdout:96: snap_remove snap 2 2026-02-12T17:28:53.473 INFO:tasks.rados.rados.0.trial082.stdout:96: done (0 left) 2026-02-12T17:28:53.473 INFO:tasks.rados.rados.0.trial082.stdout:97: delete oid 30 current snap is 7 2026-02-12T17:28:53.478 INFO:tasks.rados.rados.0.trial082.stdout:97: done (0 left) 2026-02-12T17:28:53.478 INFO:tasks.rados.rados.0.trial082.stdout:98: read oid 45 snap -1 2026-02-12T17:28:53.478 INFO:tasks.rados.rados.0.trial082.stdout:98: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-12T17:28:53.478 INFO:tasks.rados.rados.0.trial082.stdout:99: write oid 39 current snap is 7 2026-02-12T17:28:53.478 INFO:tasks.rados.rados.0.trial082.stdout:99: seq_num 64 ranges {675648=546760,2012024=568349} 2026-02-12T17:28:53.482 INFO:tasks.rados.rados.0.trial082.stdout:99: writing trial08226312-39 from 675648 to 1222408 tid 1 2026-02-12T17:28:53.488 INFO:tasks.rados.rados.0.trial082.stdout:99: writing trial08226312-39 from 2012024 to 2580373 tid 2 2026-02-12T17:28:53.488 INFO:tasks.rados.rados.0.trial082.stdout:100: read oid 47 snap 4 2026-02-12T17:28:53.488 INFO:tasks.rados.rados.0.trial082.stdout:100: expect (ObjNum 61 snap 2 seq_num 61) 2026-02-12T17:28:53.488 INFO:tasks.rados.rados.0.trial082.stdout:101: snap_create 2026-02-12T17:28:53.488 INFO:tasks.rados.rados.0.trial082.stdout:98: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-12T17:28:53.488 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:53.542 INFO:tasks.rados.rados.0.trial082.stdout:99: finishing write tid 1 to trial08226312-39 2026-02-12T17:28:53.542 INFO:tasks.rados.rados.0.trial082.stdout:99: finishing write tid 2 to trial08226312-39 2026-02-12T17:28:53.542 INFO:tasks.rados.rados.0.trial082.stdout:99: finishing write tid 3 to trial08226312-39 2026-02-12T17:28:53.542 INFO:tasks.rados.rados.0.trial082.stdout:99: finishing write tid 4 to trial08226312-39 2026-02-12T17:28:53.542 INFO:tasks.rados.rados.0.trial082.stdout:99: oid 39 updating version 0 to 13 2026-02-12T17:28:53.542 INFO:tasks.rados.rados.0.trial082.stdout:99: oid 39 version 13 is already newer than 11 2026-02-12T17:28:53.542 INFO:tasks.rados.rados.0.trial082.stdout:99: oid 39 version 13 is already newer than 12 2026-02-12T17:28:53.543 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 13 (ObjNum 64 snap 7 seq_num 64) dirty exists 2026-02-12T17:28:53.543 INFO:tasks.rados.rados.0.trial082.stdout:99: left oid 39 (ObjNum 64 snap 7 seq_num 64) 2026-02-12T17:28:53.543 INFO:tasks.rados.rados.0.trial082.stdout:100: expect (ObjNum 61 snap 2 seq_num 61) 2026-02-12T17:28:53.543 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:53.574 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:54.477 INFO:tasks.rados.rados.0.trial082.stdout:98: done (3 left) 2026-02-12T17:28:54.477 INFO:tasks.rados.rados.0.trial082.stdout:99: done (2 left) 2026-02-12T17:28:54.477 INFO:tasks.rados.rados.0.trial082.stdout:100: done (1 left) 2026-02-12T17:28:54.477 INFO:tasks.rados.rados.0.trial082.stdout:101: done (0 left) 2026-02-12T17:28:54.477 INFO:tasks.rados.rados.0.trial082.stdout:102: rollback oid 32 current snap is 8 2026-02-12T17:28:54.477 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 7 2026-02-12T17:28:54.477 INFO:tasks.rados.rados.0.trial082.stdout:103: read oid 28 snap -1 2026-02-12T17:28:54.477 INFO:tasks.rados.rados.0.trial082.stdout:103: expect (ObjNum 62 snap 3 seq_num 62) 2026-02-12T17:28:54.477 INFO:tasks.rados.rados.0.trial082.stdout:104: write oid 17 current snap is 8 2026-02-12T17:28:54.478 INFO:tasks.rados.rados.0.trial082.stdout:104: seq_num 65 ranges {692455=622009,2070506=712007} 2026-02-12T17:28:54.481 INFO:tasks.rados.rados.0.trial082.stdout:104: writing trial08226312-17 from 692455 to 1314464 tid 1 2026-02-12T17:28:54.487 INFO:tasks.rados.rados.0.trial082.stdout:104: writing trial08226312-17 from 2070506 to 2782513 tid 2 2026-02-12T17:28:54.487 INFO:tasks.rados.rados.0.trial082.stdout:105: copy_from oid 30 from oid 44 current snap is 8 2026-02-12T17:28:54.488 INFO:tasks.rados.rados.0.trial082.stdout:102: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:28:54.488 INFO:tasks.rados.rados.0.trial082.stdout:102: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:28:54.488 INFO:tasks.rados.rados.0.trial082.stdout:102: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:28:54.488 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 10 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-12T17:28:54.488 INFO:tasks.rados.rados.0.trial082.stdout:103: expect (ObjNum 62 snap 3 seq_num 62) 2026-02-12T17:28:54.488 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:54.549 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:54.580 INFO:tasks.rados.rados.0.trial082.stdout:104: finishing write tid 1 to trial08226312-17 2026-02-12T17:28:54.580 INFO:tasks.rados.rados.0.trial082.stdout:102: done (3 left) 2026-02-12T17:28:54.580 INFO:tasks.rados.rados.0.trial082.stdout:103: done (2 left) 2026-02-12T17:28:54.580 INFO:tasks.rados.rados.0.trial082.stdout:106: read oid 26 snap -1 2026-02-12T17:28:54.580 INFO:tasks.rados.rados.0.trial082.stdout:106: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-12T17:28:54.580 INFO:tasks.rados.rados.0.trial082.stdout:107: snap_remove snap 4 2026-02-12T17:28:55.476 INFO:tasks.rados.rados.0.trial082.stdout:107: done (3 left) 2026-02-12T17:28:55.477 INFO:tasks.rados.rados.0.trial082.stdout:108: snap_remove snap 5 2026-02-12T17:28:56.480 INFO:tasks.rados.rados.0.trial082.stdout:108: done (3 left) 2026-02-12T17:28:56.480 INFO:tasks.rados.rados.0.trial082.stdout:109: rollback oid 23 current snap is 8 2026-02-12T17:28:56.480 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 23 to 3 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:104: finishing write tid 2 to trial08226312-17 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:104: finishing write tid 3 to trial08226312-17 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:104: finishing write tid 4 to trial08226312-17 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:104: oid 17 updating version 0 to 49 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:104: oid 17 updating version 49 to 51 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:104: oid 17 version 51 is already newer than 50 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 51 (ObjNum 65 snap 8 seq_num 65) dirty exists 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:104: left oid 17 (ObjNum 65 snap 8 seq_num 65) 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:105: finishing copy_from racing read to trial08226312-30 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:105: finishing copy_from to trial08226312-30 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 15 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-12T17:28:56.481 INFO:tasks.rados.rados.0.trial082.stdout:106: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-12T17:28:56.531 INFO:tasks.rados.rados.0.trial082.stdout:109: finishing rollback tid 0 to trial08226312-23 2026-02-12T17:28:56.531 INFO:tasks.rados.rados.0.trial082.stdout:109: finishing rollback tid 1 to trial08226312-23 2026-02-12T17:28:56.531 INFO:tasks.rados.rados.0.trial082.stdout:104: done (3 left) 2026-02-12T17:28:56.531 INFO:tasks.rados.rados.0.trial082.stdout:105: done (2 left) 2026-02-12T17:28:56.531 INFO:tasks.rados.rados.0.trial082.stdout:106: done (1 left) 2026-02-12T17:28:56.531 INFO:tasks.rados.rados.0.trial082.stdout:110: delete oid 11 current snap is 8 2026-02-12T17:28:56.531 INFO:tasks.rados.rados.0.trial082.stdout:109: finishing rollback tid 2 to trial08226312-23 2026-02-12T17:28:56.531 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 35 (ObjNum 56 snap 2 seq_num 56) dirty exists 2026-02-12T17:28:56.534 INFO:tasks.rados.rados.0.trial082.stdout:109: done (1 left) 2026-02-12T17:28:56.534 INFO:tasks.rados.rados.0.trial082.stdout:110: done (0 left) 2026-02-12T17:28:56.534 INFO:tasks.rados.rados.0.trial082.stdout:111: copy_from oid 18 from oid 28 current snap is 8 2026-02-12T17:28:56.534 INFO:tasks.rados.rados.0.trial082.stdout:112: copy_from oid 3 from oid 25 current snap is 8 2026-02-12T17:28:56.534 INFO:tasks.rados.rados.0.trial082.stdout:113: write (excl) oid 46 current snap is 8 2026-02-12T17:28:56.534 INFO:tasks.rados.rados.0.trial082.stdout:113: seq_num 67 ranges {726069=772507,2071117=715676} 2026-02-12T17:28:56.539 INFO:tasks.rados.rados.0.trial082.stdout:113: writing trial08226312-46 from 726069 to 1498576 tid 1 2026-02-12T17:28:56.544 INFO:tasks.rados.rados.0.trial082.stdout:113: writing trial08226312-46 from 2071117 to 2786793 tid 2 2026-02-12T17:28:56.544 INFO:tasks.rados.rados.0.trial082.stdout:114: read oid 7 snap -1 2026-02-12T17:28:56.544 INFO:tasks.rados.rados.0.trial082.stdout:114: expect (ObjNum 57 snap 2 seq_num 57) 2026-02-12T17:28:56.544 INFO:tasks.rados.rados.0.trial082.stdout:115: read oid 37 snap -1 2026-02-12T17:28:56.544 INFO:tasks.rados.rados.0.trial082.stdout:115: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-12T17:28:56.544 INFO:tasks.rados.rados.0.trial082.stdout:116: snap_remove snap 6 2026-02-12T17:28:57.484 INFO:tasks.rados.rados.0.trial082.stdout:116: done (5 left) 2026-02-12T17:28:57.485 INFO:tasks.rados.rados.0.trial082.stdout:117: delete oid 16 current snap is 8 2026-02-12T17:28:57.485 INFO:tasks.rados.rados.0.trial082.stdout:111: finishing copy_from racing read to trial08226312-18 2026-02-12T17:28:57.485 INFO:tasks.rados.rados.0.trial082.stdout:112: finishing copy_from racing read to trial08226312-3 2026-02-12T17:28:57.485 INFO:tasks.rados.rados.0.trial082.stdout:113: finishing write tid 1 to trial08226312-46 2026-02-12T17:28:57.485 INFO:tasks.rados.rados.0.trial082.stdout:115: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-12T17:28:57.499 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 716811 2026-02-12T17:28:57.524 INFO:tasks.rados.rados.0.trial082.stdout:114: expect (ObjNum 57 snap 2 seq_num 57) 2026-02-12T17:28:57.524 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:57.596 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2479045 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:113: finishing write tid 2 to trial08226312-46 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:113: finishing write tid 3 to trial08226312-46 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:113: finishing write tid 4 to trial08226312-46 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:113: oid 46 updating version 0 to 10 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:113: oid 46 updating version 10 to 11 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:113: oid 46 updating version 11 to 12 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 12 (ObjNum 67 snap 8 seq_num 67) dirty exists 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:113: left oid 46 (ObjNum 67 snap 8 seq_num 67) 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:111: finishing copy_from to trial08226312-18 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 38 (ObjNum 62 snap 3 seq_num 62) dirty exists 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:112: finishing copy_from to trial08226312-3 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 6 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:111: done (5 left) 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:112: done (4 left) 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:113: done (3 left) 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:114: done (2 left) 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:115: done (1 left) 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:117: done (0 left) 2026-02-12T17:28:57.602 INFO:tasks.rados.rados.0.trial082.stdout:118: delete oid 6 current snap is 8 2026-02-12T17:28:57.605 INFO:tasks.rados.rados.0.trial082.stdout:118: done (0 left) 2026-02-12T17:28:57.605 INFO:tasks.rados.rados.0.trial082.stdout:119: read oid 44 snap -1 2026-02-12T17:28:57.605 INFO:tasks.rados.rados.0.trial082.stdout:119: expect (ObjNum 43 snap 0 seq_num 43) 2026-02-12T17:28:57.605 INFO:tasks.rados.rados.0.trial082.stdout:120: snap_create 2026-02-12T17:28:57.608 INFO:tasks.rados.rados.0.trial082.stdout:119: expect (ObjNum 43 snap 0 seq_num 43) 2026-02-12T17:28:57.616 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2000084 2026-02-12T17:28:57.620 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:57.642 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1601344 2026-02-12T17:28:58.487 INFO:tasks.rados.rados.0.trial082.stdout:119: done (1 left) 2026-02-12T17:28:58.487 INFO:tasks.rados.rados.0.trial082.stdout:120: done (0 left) 2026-02-12T17:28:58.487 INFO:tasks.rados.rados.0.trial082.stdout:121: snap_remove snap 7 2026-02-12T17:28:59.488 INFO:tasks.rados.rados.0.trial082.stdout:121: done (0 left) 2026-02-12T17:28:59.488 INFO:tasks.rados.rados.0.trial082.stdout:122: copy_from oid 7 from oid 48 current snap is 9 2026-02-12T17:28:59.488 INFO:tasks.rados.rados.0.trial082.stdout:123: delete oid 13 current snap is 9 2026-02-12T17:28:59.490 INFO:tasks.rados.rados.0.trial082.stdout:123: done (1 left) 2026-02-12T17:28:59.490 INFO:tasks.rados.rados.0.trial082.stdout:124: read oid 41 snap 3 2026-02-12T17:28:59.490 INFO:tasks.rados.rados.0.trial082.stdout:124: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-12T17:28:59.490 INFO:tasks.rados.rados.0.trial082.stdout:125: snap_create 2026-02-12T17:28:59.498 INFO:tasks.rados.rados.0.trial082.stdout:122: finishing copy_from racing read to trial08226312-7 2026-02-12T17:28:59.500 INFO:tasks.rados.rados.0.trial082.stdout:122: finishing copy_from to trial08226312-7 2026-02-12T17:28:59.500 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 3 (ObjNum 47 snap 0 seq_num 47) dirty exists 2026-02-12T17:28:59.508 INFO:tasks.rados.rados.0.trial082.stdout:124: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-12T17:28:59.508 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:28:59.527 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 129551 2026-02-12T17:28:59.546 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 12966 2026-02-12T17:29:00.493 INFO:tasks.rados.rados.0.trial082.stdout:122: done (2 left) 2026-02-12T17:29:00.493 INFO:tasks.rados.rados.0.trial082.stdout:124: done (1 left) 2026-02-12T17:29:00.493 INFO:tasks.rados.rados.0.trial082.stdout:125: done (0 left) 2026-02-12T17:29:00.493 INFO:tasks.rados.rados.0.trial082.stdout:126: snap_create 2026-02-12T17:29:01.494 INFO:tasks.rados.rados.0.trial082.stdout:126: done (0 left) 2026-02-12T17:29:01.494 INFO:tasks.rados.rados.0.trial082.stdout:127: write (excl) oid 28 current snap is 11 2026-02-12T17:29:01.494 INFO:tasks.rados.rados.0.trial082.stdout:127: seq_num 71 ranges {793297=789856,2305045=723014} 2026-02-12T17:29:01.500 INFO:tasks.rados.rados.0.trial082.stdout:127: writing trial08226312-28 from 793297 to 1583153 tid 1 2026-02-12T17:29:01.506 INFO:tasks.rados.rados.0.trial082.stdout:127: writing trial08226312-28 from 2305045 to 3028059 tid 2 2026-02-12T17:29:01.506 INFO:tasks.rados.rados.0.trial082.stdout:128: write oid 18 current snap is 11 2026-02-12T17:29:01.506 INFO:tasks.rados.rados.0.trial082.stdout:128: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2026-02-12T17:29:01.509 INFO:tasks.rados.rados.0.trial082.stdout:128: writing trial08226312-18 from 410104 to 875209 tid 1 2026-02-12T17:29:01.513 INFO:tasks.rados.rados.0.trial082.stdout:128: writing trial08226312-18 from 1563527 to 2146552 tid 2 2026-02-12T17:29:01.518 INFO:tasks.rados.rados.0.trial082.stdout:128: writing trial08226312-18 from 2810926 to 3210104 tid 3 2026-02-12T17:29:01.518 INFO:tasks.rados.rados.0.trial082.stdout:129: copy_from oid 49 from oid 43 current snap is 11 2026-02-12T17:29:01.518 INFO:tasks.rados.rados.0.trial082.stdout:127: finishing write tid 1 to trial08226312-28 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:127: finishing write tid 2 to trial08226312-28 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:127: finishing write tid 3 to trial08226312-28 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:127: finishing write tid 4 to trial08226312-28 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:127: oid 28 updating version 0 to 48 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:127: oid 28 updating version 48 to 49 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:127: oid 28 updating version 49 to 50 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 50 (ObjNum 71 snap 11 seq_num 71) dirty exists 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:127: left oid 28 (ObjNum 71 snap 11 seq_num 71) 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:128: finishing write tid 1 to trial08226312-18 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:128: finishing write tid 2 to trial08226312-18 2026-02-12T17:29:01.519 INFO:tasks.rados.rados.0.trial082.stdout:127: done (2 left) 2026-02-12T17:29:01.520 INFO:tasks.rados.rados.0.trial082.stdout:130: read oid 35 snap -1 2026-02-12T17:29:01.520 INFO:tasks.rados.rados.0.trial082.stdout:130: expect (ObjNum 0 snap 0 seq_num 0) 2026-02-12T17:29:01.520 INFO:tasks.rados.rados.0.trial082.stdout:131: snap_create 2026-02-12T17:29:01.521 INFO:tasks.rados.rados.0.trial082.stdout:128: finishing write tid 3 to trial08226312-18 2026-02-12T17:29:01.521 INFO:tasks.rados.rados.0.trial082.stdout:128: finishing write tid 4 to trial08226312-18 2026-02-12T17:29:01.521 INFO:tasks.rados.rados.0.trial082.stdout:128: finishing write tid 5 to trial08226312-18 2026-02-12T17:29:01.521 INFO:tasks.rados.rados.0.trial082.stdout:128: oid 18 updating version 0 to 41 2026-02-12T17:29:01.521 INFO:tasks.rados.rados.0.trial082.stdout:128: oid 18 updating version 41 to 42 2026-02-12T17:29:01.521 INFO:tasks.rados.rados.0.trial082.stdout:128: oid 18 version 42 is already newer than 39 2026-02-12T17:29:01.521 INFO:tasks.rados.rados.0.trial082.stdout:128: oid 18 version 42 is already newer than 40 2026-02-12T17:29:01.521 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 42 (ObjNum 72 snap 11 seq_num 72) dirty exists 2026-02-12T17:29:01.521 INFO:tasks.rados.rados.0.trial082.stdout:128: left oid 18 (ObjNum 72 snap 11 seq_num 72) 2026-02-12T17:29:01.522 INFO:tasks.rados.rados.0.trial082.stdout:130: expect (ObjNum 0 snap 0 seq_num 0) 2026-02-12T17:29:01.537 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 866343 2026-02-12T17:29:01.548 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 827959 2026-02-12T17:29:01.557 INFO:tasks.rados.rados.0.trial082.stdout:129: finishing copy_from racing read to trial08226312-49 2026-02-12T17:29:01.557 INFO:tasks.rados.rados.0.trial082.stdout:129: finishing copy_from to trial08226312-49 2026-02-12T17:29:01.557 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 15 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:29:02.498 INFO:tasks.rados.rados.0.trial082.stdout:128: done (3 left) 2026-02-12T17:29:02.498 INFO:tasks.rados.rados.0.trial082.stdout:129: done (2 left) 2026-02-12T17:29:02.498 INFO:tasks.rados.rados.0.trial082.stdout:130: done (1 left) 2026-02-12T17:29:02.498 INFO:tasks.rados.rados.0.trial082.stdout:131: done (0 left) 2026-02-12T17:29:02.498 INFO:tasks.rados.rados.0.trial082.stdout:132: snap_create 2026-02-12T17:29:03.474 INFO:tasks.rados.rados.0.trial082.stdout:132: done (0 left) 2026-02-12T17:29:03.475 INFO:tasks.rados.rados.0.trial082.stdout:133: write oid 38 current snap is 13 2026-02-12T17:29:03.475 INFO:tasks.rados.rados.0.trial082.stdout:133: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2026-02-12T17:29:03.479 INFO:tasks.rados.rados.0.trial082.stdout:133: writing trial08226312-38 from 426911 to 967265 tid 1 2026-02-12T17:29:03.484 INFO:tasks.rados.rados.0.trial082.stdout:133: writing trial08226312-38 from 1622009 to 2348692 tid 2 2026-02-12T17:29:03.488 INFO:tasks.rados.rados.0.trial082.stdout:133: writing trial08226312-38 from 3121996 to 3226911 tid 3 2026-02-12T17:29:03.488 INFO:tasks.rados.rados.0.trial082.stdout:134: snap_remove snap 8 2026-02-12T17:29:04.477 INFO:tasks.rados.rados.0.trial082.stdout:134: done (1 left) 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:135: read oid 49 snap -1 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:135: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:136: write (excl) oid 11 current snap is 13 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:133: finishing write tid 1 to trial08226312-38 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:133: finishing write tid 2 to trial08226312-38 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:133: finishing write tid 3 to trial08226312-38 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:133: finishing write tid 4 to trial08226312-38 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:133: finishing write tid 5 to trial08226312-38 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:133: oid 38 updating version 0 to 23 2026-02-12T17:29:04.478 INFO:tasks.rados.rados.0.trial082.stdout:133: oid 38 version 23 is already newer than 22 2026-02-12T17:29:04.479 INFO:tasks.rados.rados.0.trial082.stdout:133: oid 38 version 23 is already newer than 21 2026-02-12T17:29:04.479 INFO:tasks.rados.rados.0.trial082.stdout:133: oid 38 version 23 is already newer than 20 2026-02-12T17:29:04.479 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 23 (ObjNum 73 snap 13 seq_num 73) dirty exists 2026-02-12T17:29:04.479 INFO:tasks.rados.rados.0.trial082.stdout:133: left oid 38 (ObjNum 73 snap 13 seq_num 73) 2026-02-12T17:29:04.479 INFO:tasks.rados.rados.0.trial082.stdout:136: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2026-02-12T17:29:04.481 INFO:tasks.rados.rados.0.trial082.stdout:136: writing trial08226312-11 from 443718 to 1059321 tid 1 2026-02-12T17:29:04.485 INFO:tasks.rados.rados.0.trial082.stdout:136: writing trial08226312-11 from 1564138 to 2034479 tid 2 2026-02-12T17:29:04.490 INFO:tasks.rados.rados.0.trial082.stdout:136: writing trial08226312-11 from 2633066 to 3243718 tid 3 2026-02-12T17:29:04.491 INFO:tasks.rados.rados.0.trial082.stdout:133: done (2 left) 2026-02-12T17:29:04.491 INFO:tasks.rados.rados.0.trial082.stdout:137: snap_create 2026-02-12T17:29:04.491 INFO:tasks.rados.rados.0.trial082.stdout:135: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:29:04.525 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1265677 2026-02-12T17:29:04.537 INFO:tasks.rados.rados.0.trial082.stdout:136: finishing write tid 1 to trial08226312-11 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:136: finishing write tid 2 to trial08226312-11 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:136: finishing write tid 3 to trial08226312-11 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:136: finishing write tid 4 to trial08226312-11 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:136: finishing write tid 5 to trial08226312-11 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:136: oid 11 updating version 0 to 23 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:136: oid 11 updating version 23 to 24 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:136: oid 11 version 24 is already newer than 21 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:136: oid 11 version 24 is already newer than 22 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 24 (ObjNum 74 snap 13 seq_num 74) dirty exists 2026-02-12T17:29:04.538 INFO:tasks.rados.rados.0.trial082.stdout:136: left oid 11 (ObjNum 74 snap 13 seq_num 74) 2026-02-12T17:29:05.478 INFO:tasks.rados.rados.0.trial082.stdout:135: done (2 left) 2026-02-12T17:29:05.478 INFO:tasks.rados.rados.0.trial082.stdout:136: done (1 left) 2026-02-12T17:29:05.478 INFO:tasks.rados.rados.0.trial082.stdout:137: done (0 left) 2026-02-12T17:29:05.478 INFO:tasks.rados.rados.0.trial082.stdout:138: delete oid 34 current snap is 14 2026-02-12T17:29:05.480 INFO:tasks.rados.rados.0.trial082.stdout:138: done (0 left) 2026-02-12T17:29:05.480 INFO:tasks.rados.rados.0.trial082.stdout:139: snap_create 2026-02-12T17:29:06.481 INFO:tasks.rados.rados.0.trial082.stdout:139: done (0 left) 2026-02-12T17:29:06.481 INFO:tasks.rados.rados.0.trial082.stdout:140: delete oid 16 current snap is 15 2026-02-12T17:29:06.483 INFO:tasks.rados.rados.0.trial082.stdout:140: done (0 left) 2026-02-12T17:29:06.484 INFO:tasks.rados.rados.0.trial082.stdout:141: read oid 19 snap -1 2026-02-12T17:29:06.484 INFO:tasks.rados.rados.0.trial082.stdout:141: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:29:06.484 INFO:tasks.rados.rados.0.trial082.stdout:142: write (excl) oid 20 current snap is 15 2026-02-12T17:29:06.484 INFO:tasks.rados.rados.0.trial082.stdout:142: seq_num 77 ranges {494139=557703,1455937=734021,2948041=346098} 2026-02-12T17:29:06.487 INFO:tasks.rados.rados.0.trial082.stdout:142: writing trial08226312-20 from 494139 to 1051842 tid 1 2026-02-12T17:29:06.491 INFO:tasks.rados.rados.0.trial082.stdout:142: writing trial08226312-20 from 1455937 to 2189958 tid 2 2026-02-12T17:29:06.496 INFO:tasks.rados.rados.0.trial082.stdout:142: writing trial08226312-20 from 2948041 to 3294139 tid 3 2026-02-12T17:29:06.496 INFO:tasks.rados.rados.0.trial082.stdout:143: copy_from oid 8 from oid 4 current snap is 15 2026-02-12T17:29:06.496 INFO:tasks.rados.rados.0.trial082.stdout:141: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:29:06.515 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:06.535 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:06.555 INFO:tasks.rados.rados.0.trial082.stdout:142: finishing write tid 1 to trial08226312-20 2026-02-12T17:29:06.555 INFO:tasks.rados.rados.0.trial082.stdout:142: finishing write tid 2 to trial08226312-20 2026-02-12T17:29:06.555 INFO:tasks.rados.rados.0.trial082.stdout:141: done (2 left) 2026-02-12T17:29:06.555 INFO:tasks.rados.rados.0.trial082.stdout:144: delete oid 24 current snap is 15 2026-02-12T17:29:06.555 INFO:tasks.rados.rados.0.trial082.stdout:142: finishing write tid 3 to trial08226312-20 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:142: finishing write tid 4 to trial08226312-20 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:142: finishing write tid 5 to trial08226312-20 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:142: oid 20 updating version 0 to 62 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:142: oid 20 version 62 is already newer than 61 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:142: oid 20 updating version 62 to 64 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:142: oid 20 version 64 is already newer than 63 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 64 (ObjNum 77 snap 15 seq_num 77) dirty exists 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:142: left oid 20 (ObjNum 77 snap 15 seq_num 77) 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:143: finishing copy_from racing read to trial08226312-8 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:143: finishing copy_from to trial08226312-8 2026-02-12T17:29:06.556 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 43 (ObjNum 58 snap 2 seq_num 58) dirty exists 2026-02-12T17:29:06.557 INFO:tasks.rados.rados.0.trial082.stdout:142: done (2 left) 2026-02-12T17:29:06.557 INFO:tasks.rados.rados.0.trial082.stdout:143: done (1 left) 2026-02-12T17:29:06.558 INFO:tasks.rados.rados.0.trial082.stdout:144: done (0 left) 2026-02-12T17:29:06.558 INFO:tasks.rados.rados.0.trial082.stdout:145: rollback oid 40 current snap is 15 2026-02-12T17:29:06.558 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 40 to 12 2026-02-12T17:29:06.558 INFO:tasks.rados.rados.0.trial082.stdout:146: rollback oid 21 current snap is 15 2026-02-12T17:29:06.558 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 10 2026-02-12T17:29:06.558 INFO:tasks.rados.rados.0.trial082.stdout:147: delete oid 35 current snap is 15 2026-02-12T17:29:06.558 INFO:tasks.rados.rados.0.trial082.stdout:147: done (2 left) 2026-02-12T17:29:06.558 INFO:tasks.rados.rados.0.trial082.stdout:148: write oid 2 current snap is 15 2026-02-12T17:29:06.558 INFO:tasks.rados.rados.0.trial082.stdout:148: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2026-02-12T17:29:06.563 INFO:tasks.rados.rados.0.trial082.stdout:148: writing trial08226312-2 from 544560 to 1328010 tid 1 2026-02-12T17:29:06.567 INFO:tasks.rados.rados.0.trial082.stdout:148: writing trial08226312-2 from 1915030 to 2396378 tid 2 2026-02-12T17:29:06.570 INFO:tasks.rados.rados.0.trial082.stdout:148: writing trial08226312-2 from 2797604 to 3277365 tid 3 2026-02-12T17:29:06.570 INFO:tasks.rados.rados.0.trial082.stdout:149: snap_create 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:146: finishing rollback tid 0 to trial08226312-21 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:146: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:146: finishing rollback tid 2 to trial08226312-21 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 40 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:145: finishing rollback tid 0 to trial08226312-40 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:145: finishing rollback tid 1 to trial08226312-40 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:145: finishing rollback tid 2 to trial08226312-40 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 59 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:148: finishing write tid 1 to trial08226312-2 2026-02-12T17:29:06.571 INFO:tasks.rados.rados.0.trial082.stdout:148: finishing write tid 2 to trial08226312-2 2026-02-12T17:29:06.572 INFO:tasks.rados.rados.0.trial082.stdout:148: finishing write tid 3 to trial08226312-2 2026-02-12T17:29:06.572 INFO:tasks.rados.rados.0.trial082.stdout:148: finishing write tid 4 to trial08226312-2 2026-02-12T17:29:06.572 INFO:tasks.rados.rados.0.trial082.stdout:148: finishing write tid 5 to trial08226312-2 2026-02-12T17:29:06.573 INFO:tasks.rados.rados.0.trial082.stdout:148: oid 2 updating version 0 to 17 2026-02-12T17:29:06.573 INFO:tasks.rados.rados.0.trial082.stdout:148: oid 2 updating version 17 to 18 2026-02-12T17:29:06.573 INFO:tasks.rados.rados.0.trial082.stdout:148: oid 2 version 18 is already newer than 15 2026-02-12T17:29:06.573 INFO:tasks.rados.rados.0.trial082.stdout:148: oid 2 version 18 is already newer than 16 2026-02-12T17:29:06.573 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 18 (ObjNum 80 snap 15 seq_num 80) dirty exists 2026-02-12T17:29:06.573 INFO:tasks.rados.rados.0.trial082.stdout:148: left oid 2 (ObjNum 80 snap 15 seq_num 80) 2026-02-12T17:29:07.484 INFO:tasks.rados.rados.0.trial082.stdout:145: done (3 left) 2026-02-12T17:29:07.484 INFO:tasks.rados.rados.0.trial082.stdout:146: done (2 left) 2026-02-12T17:29:07.484 INFO:tasks.rados.rados.0.trial082.stdout:148: done (1 left) 2026-02-12T17:29:07.484 INFO:tasks.rados.rados.0.trial082.stdout:149: done (0 left) 2026-02-12T17:29:07.484 INFO:tasks.rados.rados.0.trial082.stdout:150: delete oid 13 current snap is 16 2026-02-12T17:29:07.485 INFO:tasks.rados.rados.0.trial082.stdout:150: done (0 left) 2026-02-12T17:29:07.485 INFO:tasks.rados.rados.0.trial082.stdout:151: read oid 9 snap -1 2026-02-12T17:29:07.485 INFO:tasks.rados.rados.0.trial082.stdout:151: expect (ObjNum 52 snap 1 seq_num 52) 2026-02-12T17:29:07.485 INFO:tasks.rados.rados.0.trial082.stdout:152: snap_remove snap 11 2026-02-12T17:29:08.475 INFO:tasks.rados.rados.0.trial082.stdout:152: done (1 left) 2026-02-12T17:29:08.476 INFO:tasks.rados.rados.0.trial082.stdout:153: copy_from oid 42 from oid 2 current snap is 16 2026-02-12T17:29:08.476 INFO:tasks.rados.rados.0.trial082.stdout:151: expect (ObjNum 52 snap 1 seq_num 52) 2026-02-12T17:29:08.522 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2523589 2026-02-12T17:29:08.557 INFO:tasks.rados.rados.0.trial082.stdout:153: finishing copy_from racing read to trial08226312-42 2026-02-12T17:29:08.557 INFO:tasks.rados.rados.0.trial082.stdout:153: finishing copy_from to trial08226312-42 2026-02-12T17:29:08.557 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 18 (ObjNum 80 snap 15 seq_num 80) dirty exists 2026-02-12T17:29:08.557 INFO:tasks.rados.rados.0.trial082.stdout:151: done (1 left) 2026-02-12T17:29:08.557 INFO:tasks.rados.rados.0.trial082.stdout:153: done (0 left) 2026-02-12T17:29:08.557 INFO:tasks.rados.rados.0.trial082.stdout:154: rollback oid 28 current snap is 16 2026-02-12T17:29:08.558 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 1 2026-02-12T17:29:08.558 INFO:tasks.rados.rados.0.trial082.stdout:155: read oid 36 snap 15 2026-02-12T17:29:08.558 INFO:tasks.rados.rados.0.trial082.stdout:155: expect (ObjNum 35 snap 0 seq_num 35) 2026-02-12T17:29:08.558 INFO:tasks.rados.rados.0.trial082.stdout:156: read oid 18 snap -1 2026-02-12T17:29:08.558 INFO:tasks.rados.rados.0.trial082.stdout:156: expect (ObjNum 72 snap 11 seq_num 72) 2026-02-12T17:29:08.558 INFO:tasks.rados.rados.0.trial082.stdout:157: rollback oid 8 current snap is 16 2026-02-12T17:29:08.558 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 9 2026-02-12T17:29:08.558 INFO:tasks.rados.rados.0.trial082.stdout:158: snap_remove snap 3 2026-02-12T17:29:09.488 INFO:tasks.rados.rados.0.trial082.stdout:158: done (4 left) 2026-02-12T17:29:09.489 INFO:tasks.rados.rados.0.trial082.stdout:159: read oid 35 snap -1 2026-02-12T17:29:09.489 INFO:tasks.rados.rados.0.trial082.stdout:159: expect deleted 2026-02-12T17:29:09.489 INFO:tasks.rados.rados.0.trial082.stdout:160: rollback oid 26 current snap is 16 2026-02-12T17:29:09.489 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 26 to 1 2026-02-12T17:29:09.489 INFO:tasks.rados.rados.0.trial082.stdout:157: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:29:09.489 INFO:tasks.rados.rados.0.trial082.stdout:157: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:29:09.489 INFO:tasks.rados.rados.0.trial082.stdout:157: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:29:09.489 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 78 (ObjNum 7 snap 0 seq_num 7) dirty exists 2026-02-12T17:29:09.489 INFO:tasks.rados.rados.0.trial082.stdout:154: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:29:09.490 INFO:tasks.rados.rados.0.trial082.stdout:154: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:29:09.490 INFO:tasks.rados.rados.0.trial082.stdout:154: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:29:09.490 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 67 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-12T17:29:09.490 INFO:tasks.rados.rados.0.trial082.stdout:155: expect (ObjNum 35 snap 0 seq_num 35) 2026-02-12T17:29:09.490 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:09.536 INFO:tasks.rados.rados.0.trial082.stdout:156: expect (ObjNum 72 snap 11 seq_num 72) 2026-02-12T17:29:09.574 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:09.647 INFO:tasks.rados.rados.0.trial082.stdout:154: done (5 left) 2026-02-12T17:29:09.647 INFO:tasks.rados.rados.0.trial082.stdout:155: done (4 left) 2026-02-12T17:29:09.648 INFO:tasks.rados.rados.0.trial082.stdout:156: done (3 left) 2026-02-12T17:29:09.648 INFO:tasks.rados.rados.0.trial082.stdout:157: done (2 left) 2026-02-12T17:29:09.648 INFO:tasks.rados.rados.0.trial082.stdout:159: done (1 left) 2026-02-12T17:29:09.648 INFO:tasks.rados.rados.0.trial082.stdout:161: write oid 43 current snap is 16 2026-02-12T17:29:09.648 INFO:tasks.rados.rados.0.trial082.stdout:161: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2026-02-12T17:29:09.651 INFO:tasks.rados.rados.0.trial082.stdout:161: writing trial08226312-43 from 578174 to 1112122 tid 1 2026-02-12T17:29:09.655 INFO:tasks.rados.rados.0.trial082.stdout:161: writing trial08226312-43 from 1515641 to 2000658 tid 2 2026-02-12T17:29:09.660 INFO:tasks.rados.rados.0.trial082.stdout:161: writing trial08226312-43 from 2736097 to 3238402 tid 3 2026-02-12T17:29:09.660 INFO:tasks.rados.rados.0.trial082.stdout:162: snap_remove snap 10 2026-02-12T17:29:10.491 INFO:tasks.rados.rados.0.trial082.stdout:162: done (2 left) 2026-02-12T17:29:10.491 INFO:tasks.rados.rados.0.trial082.stdout:163: read oid 4 snap -1 2026-02-12T17:29:10.491 INFO:tasks.rados.rados.0.trial082.stdout:163: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:29:10.491 INFO:tasks.rados.rados.0.trial082.stdout:164: write (excl) oid 47 current snap is 16 2026-02-12T17:29:10.492 INFO:tasks.rados.rados.0.trial082.stdout:164: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2026-02-12T17:29:10.496 INFO:tasks.rados.rados.0.trial082.stdout:164: writing trial08226312-47 from 594981 to 1204178 tid 1 2026-02-12T17:29:10.502 INFO:tasks.rados.rados.0.trial082.stdout:164: writing trial08226312-47 from 1974123 to 2719151 tid 2 2026-02-12T17:29:10.506 INFO:tasks.rados.rados.0.trial082.stdout:164: writing trial08226312-47 from 3279873 to 3394981 tid 3 2026-02-12T17:29:10.506 INFO:tasks.rados.rados.0.trial082.stdout:165: snap_create 2026-02-12T17:29:10.506 INFO:tasks.rados.rados.0.trial082.stdout:160: finishing rollback tid 0 to trial08226312-26 2026-02-12T17:29:10.506 INFO:tasks.rados.rados.0.trial082.stdout:160: finishing rollback tid 1 to trial08226312-26 2026-02-12T17:29:10.506 INFO:tasks.rados.rados.0.trial082.stdout:160: finishing rollback tid 2 to trial08226312-26 2026-02-12T17:29:10.506 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 47 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-12T17:29:10.506 INFO:tasks.rados.rados.0.trial082.stdout:161: finishing write tid 1 to trial08226312-43 2026-02-12T17:29:10.506 INFO:tasks.rados.rados.0.trial082.stdout:161: finishing write tid 2 to trial08226312-43 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:161: finishing write tid 3 to trial08226312-43 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:161: finishing write tid 4 to trial08226312-43 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:161: finishing write tid 5 to trial08226312-43 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:161: oid 43 updating version 0 to 53 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:161: oid 43 version 53 is already newer than 52 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:161: oid 43 version 53 is already newer than 51 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:161: oid 43 version 53 is already newer than 50 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 53 (ObjNum 82 snap 16 seq_num 82) dirty exists 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:161: left oid 43 (ObjNum 82 snap 16 seq_num 82) 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:163: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:29:10.507 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:10.563 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 466044 2026-02-12T17:29:10.588 INFO:tasks.rados.rados.0.trial082.stdout:164: finishing write tid 1 to trial08226312-47 2026-02-12T17:29:10.589 INFO:tasks.rados.rados.0.trial082.stdout:164: finishing write tid 2 to trial08226312-47 2026-02-12T17:29:10.589 INFO:tasks.rados.rados.0.trial082.stdout:164: finishing write tid 3 to trial08226312-47 2026-02-12T17:29:10.589 INFO:tasks.rados.rados.0.trial082.stdout:164: finishing write tid 4 to trial08226312-47 2026-02-12T17:29:10.589 INFO:tasks.rados.rados.0.trial082.stdout:164: finishing write tid 5 to trial08226312-47 2026-02-12T17:29:10.589 INFO:tasks.rados.rados.0.trial082.stdout:164: oid 47 updating version 0 to 97 2026-02-12T17:29:10.589 INFO:tasks.rados.rados.0.trial082.stdout:164: oid 47 version 97 is already newer than 96 2026-02-12T17:29:10.589 INFO:tasks.rados.rados.0.trial082.stdout:164: oid 47 version 97 is already newer than 94 2026-02-12T17:29:10.589 INFO:tasks.rados.rados.0.trial082.stdout:164: oid 47 version 97 is already newer than 95 2026-02-12T17:29:10.590 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 97 (ObjNum 83 snap 16 seq_num 83) dirty exists 2026-02-12T17:29:10.590 INFO:tasks.rados.rados.0.trial082.stdout:164: left oid 47 (ObjNum 83 snap 16 seq_num 83) 2026-02-12T17:29:11.493 INFO:tasks.rados.rados.0.trial082.stdout:160: done (4 left) 2026-02-12T17:29:11.493 INFO:tasks.rados.rados.0.trial082.stdout:161: done (3 left) 2026-02-12T17:29:11.494 INFO:tasks.rados.rados.0.trial082.stdout:163: done (2 left) 2026-02-12T17:29:11.494 INFO:tasks.rados.rados.0.trial082.stdout:164: done (1 left) 2026-02-12T17:29:11.494 INFO:tasks.rados.rados.0.trial082.stdout:165: done (0 left) 2026-02-12T17:29:11.494 INFO:tasks.rados.rados.0.trial082.stdout:166: read oid 34 snap -1 2026-02-12T17:29:11.494 INFO:tasks.rados.rados.0.trial082.stdout:166: expect deleted 2026-02-12T17:29:11.494 INFO:tasks.rados.rados.0.trial082.stdout:167: delete oid 14 current snap is 17 2026-02-12T17:29:11.495 INFO:tasks.rados.rados.0.trial082.stdout:166: done (1 left) 2026-02-12T17:29:11.496 INFO:tasks.rados.rados.0.trial082.stdout:167: done (0 left) 2026-02-12T17:29:11.496 INFO:tasks.rados.rados.0.trial082.stdout:168: rollback oid 39 current snap is 17 2026-02-12T17:29:11.496 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 39 to 12 2026-02-12T17:29:11.496 INFO:tasks.rados.rados.0.trial082.stdout:169: write oid 33 current snap is 17 2026-02-12T17:29:11.496 INFO:tasks.rados.rados.0.trial082.stdout:169: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2026-02-12T17:29:11.500 INFO:tasks.rados.rados.0.trial082.stdout:169: writing trial08226312-33 from 628595 to 1104643 tid 1 2026-02-12T17:29:11.505 INFO:tasks.rados.rados.0.trial082.stdout:169: writing trial08226312-33 from 1807440 to 2439784 tid 2 2026-02-12T17:29:11.509 INFO:tasks.rados.rados.0.trial082.stdout:169: writing trial08226312-33 from 2934719 to 3387193 tid 3 2026-02-12T17:29:11.510 INFO:tasks.rados.rados.0.trial082.stdout:170: write (excl) oid 27 current snap is 17 2026-02-12T17:29:11.510 INFO:tasks.rados.rados.0.trial082.stdout:168: finishing rollback tid 0 to trial08226312-39 2026-02-12T17:29:11.510 INFO:tasks.rados.rados.0.trial082.stdout:168: finishing rollback tid 1 to trial08226312-39 2026-02-12T17:29:11.510 INFO:tasks.rados.rados.0.trial082.stdout:168: finishing rollback tid 2 to trial08226312-39 2026-02-12T17:29:11.510 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 28 (ObjNum 64 snap 7 seq_num 64) dirty exists 2026-02-12T17:29:11.510 INFO:tasks.rados.rados.0.trial082.stdout:169: finishing write tid 1 to trial08226312-33 2026-02-12T17:29:11.510 INFO:tasks.rados.rados.0.trial082.stdout:169: finishing write tid 2 to trial08226312-33 2026-02-12T17:29:11.510 INFO:tasks.rados.rados.0.trial082.stdout:170: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2026-02-12T17:29:11.513 INFO:tasks.rados.rados.0.trial082.stdout:170: writing trial08226312-27 from 645402 to 1196699 tid 1 2026-02-12T17:29:11.517 INFO:tasks.rados.rados.0.trial082.stdout:170: writing trial08226312-27 from 1749569 to 2241924 tid 2 2026-02-12T17:29:11.522 INFO:tasks.rados.rados.0.trial082.stdout:170: writing trial08226312-27 from 2845789 to 3445402 tid 3 2026-02-12T17:29:11.522 INFO:tasks.rados.rados.0.trial082.stdout:168: done (2 left) 2026-02-12T17:29:11.522 INFO:tasks.rados.rados.0.trial082.stdout:171: write (excl) oid 8 current snap is 17 2026-02-12T17:29:11.522 INFO:tasks.rados.rados.0.trial082.stdout:171: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2026-02-12T17:29:11.527 INFO:tasks.rados.rados.0.trial082.stdout:171: writing trial08226312-8 from 662209 to 1288755 tid 1 2026-02-12T17:29:11.531 INFO:tasks.rados.rados.0.trial082.stdout:171: writing trial08226312-8 from 1808051 to 2444064 tid 2 2026-02-12T17:29:11.536 INFO:tasks.rados.rados.0.trial082.stdout:171: writing trial08226312-8 from 2873212 to 3462209 tid 3 2026-02-12T17:29:11.536 INFO:tasks.rados.rados.0.trial082.stdout:172: write (excl) oid 5 current snap is 17 2026-02-12T17:29:11.536 INFO:tasks.rados.rados.0.trial082.stdout:172: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2026-02-12T17:29:11.541 INFO:tasks.rados.rados.0.trial082.stdout:172: writing trial08226312-5 from 679016 to 1380811 tid 1 2026-02-12T17:29:11.544 INFO:tasks.rados.rados.0.trial082.stdout:172: writing trial08226312-5 from 1866533 to 2362557 tid 2 2026-02-12T17:29:11.549 INFO:tasks.rados.rados.0.trial082.stdout:172: writing trial08226312-5 from 2900635 to 3303278 tid 3 2026-02-12T17:29:11.549 INFO:tasks.rados.rados.0.trial082.stdout:173: rollback oid 30 current snap is 17 2026-02-12T17:29:11.549 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 12 2026-02-12T17:29:11.549 INFO:tasks.rados.rados.0.trial082.stdout:169: finishing write tid 3 to trial08226312-33 2026-02-12T17:29:11.549 INFO:tasks.rados.rados.0.trial082.stdout:169: finishing write tid 4 to trial08226312-33 2026-02-12T17:29:11.549 INFO:tasks.rados.rados.0.trial082.stdout:169: finishing write tid 5 to trial08226312-33 2026-02-12T17:29:11.549 INFO:tasks.rados.rados.0.trial082.stdout:169: oid 33 updating version 0 to 19 2026-02-12T17:29:11.549 INFO:tasks.rados.rados.0.trial082.stdout:169: oid 33 updating version 19 to 20 2026-02-12T17:29:11.549 INFO:tasks.rados.rados.0.trial082.stdout:169: oid 33 version 20 is already newer than 18 2026-02-12T17:29:11.550 INFO:tasks.rados.rados.0.trial082.stdout:169: oid 33 updating version 20 to 21 2026-02-12T17:29:11.550 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 21 (ObjNum 85 snap 17 seq_num 85) dirty exists 2026-02-12T17:29:11.550 INFO:tasks.rados.rados.0.trial082.stdout:169: left oid 33 (ObjNum 85 snap 17 seq_num 85) 2026-02-12T17:29:11.550 INFO:tasks.rados.rados.0.trial082.stdout:170: finishing write tid 1 to trial08226312-27 2026-02-12T17:29:11.550 INFO:tasks.rados.rados.0.trial082.stdout:170: finishing write tid 2 to trial08226312-27 2026-02-12T17:29:11.550 INFO:tasks.rados.rados.0.trial082.stdout:170: finishing write tid 3 to trial08226312-27 2026-02-12T17:29:11.550 INFO:tasks.rados.rados.0.trial082.stdout:169: done (4 left) 2026-02-12T17:29:11.550 INFO:tasks.rados.rados.0.trial082.stdout:174: write oid 19 current snap is 17 2026-02-12T17:29:11.550 INFO:tasks.rados.rados.0.trial082.stdout:174: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2026-02-12T17:29:11.553 INFO:tasks.rados.rados.0.trial082.stdout:174: writing trial08226312-19 from 695823 to 1472867 tid 1 2026-02-12T17:29:11.557 INFO:tasks.rados.rados.0.trial082.stdout:174: writing trial08226312-19 from 1925015 to 2564697 tid 2 2026-02-12T17:29:11.562 INFO:tasks.rados.rados.0.trial082.stdout:174: writing trial08226312-19 from 3328058 to 3495823 tid 3 2026-02-12T17:29:11.562 INFO:tasks.rados.rados.0.trial082.stdout:175: read oid 20 snap -1 2026-02-12T17:29:11.562 INFO:tasks.rados.rados.0.trial082.stdout:175: expect (ObjNum 77 snap 15 seq_num 77) 2026-02-12T17:29:11.562 INFO:tasks.rados.rados.0.trial082.stdout:176: copy_from oid 46 from oid 18 current snap is 17 2026-02-12T17:29:11.562 INFO:tasks.rados.rados.0.trial082.stdout:170: finishing write tid 4 to trial08226312-27 2026-02-12T17:29:11.562 INFO:tasks.rados.rados.0.trial082.stdout:170: finishing write tid 5 to trial08226312-27 2026-02-12T17:29:11.562 INFO:tasks.rados.rados.0.trial082.stdout:170: oid 27 updating version 0 to 18 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:170: oid 27 version 18 is already newer than 17 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:170: oid 27 version 18 is already newer than 16 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:170: oid 27 version 18 is already newer than 15 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 18 (ObjNum 86 snap 17 seq_num 86) dirty exists 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:170: left oid 27 (ObjNum 86 snap 17 seq_num 86) 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:171: finishing write tid 1 to trial08226312-8 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:171: finishing write tid 2 to trial08226312-8 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:171: finishing write tid 3 to trial08226312-8 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:171: finishing write tid 4 to trial08226312-8 2026-02-12T17:29:11.563 INFO:tasks.rados.rados.0.trial082.stdout:171: finishing write tid 5 to trial08226312-8 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:171: oid 8 updating version 0 to 100 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:171: oid 8 version 100 is already newer than 99 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:171: oid 8 updating version 100 to 102 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:171: oid 8 version 102 is already newer than 101 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 102 (ObjNum 87 snap 17 seq_num 87) dirty exists 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:171: left oid 8 (ObjNum 87 snap 17 seq_num 87) 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:172: finishing write tid 1 to trial08226312-5 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:170: done (6 left) 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:171: done (5 left) 2026-02-12T17:29:11.564 INFO:tasks.rados.rados.0.trial082.stdout:177: snap_remove snap 9 2026-02-12T17:29:12.497 INFO:tasks.rados.rados.0.trial082.stdout:177: done (5 left) 2026-02-12T17:29:12.497 INFO:tasks.rados.rados.0.trial082.stdout:178: delete oid 29 current snap is 17 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:172: finishing write tid 2 to trial08226312-5 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:172: finishing write tid 3 to trial08226312-5 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:172: finishing write tid 4 to trial08226312-5 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:172: finishing write tid 5 to trial08226312-5 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:172: oid 5 updating version 0 to 36 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:172: oid 5 version 36 is already newer than 34 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:172: oid 5 version 36 is already newer than 35 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:172: oid 5 version 36 is already newer than 33 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 36 (ObjNum 88 snap 17 seq_num 88) dirty exists 2026-02-12T17:29:12.498 INFO:tasks.rados.rados.0.trial082.stdout:172: left oid 5 (ObjNum 88 snap 17 seq_num 88) 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:173: finishing rollback tid 0 to trial08226312-30 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:173: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:173: finishing rollback tid 2 to trial08226312-30 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 61 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:174: finishing write tid 1 to trial08226312-19 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:174: finishing write tid 2 to trial08226312-19 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:174: finishing write tid 3 to trial08226312-19 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:174: finishing write tid 4 to trial08226312-19 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:174: finishing write tid 5 to trial08226312-19 2026-02-12T17:29:12.499 INFO:tasks.rados.rados.0.trial082.stdout:174: oid 19 updating version 0 to 106 2026-02-12T17:29:12.500 INFO:tasks.rados.rados.0.trial082.stdout:174: oid 19 version 106 is already newer than 105 2026-02-12T17:29:12.500 INFO:tasks.rados.rados.0.trial082.stdout:174: oid 19 version 106 is already newer than 104 2026-02-12T17:29:12.500 INFO:tasks.rados.rados.0.trial082.stdout:174: oid 19 updating version 106 to 107 2026-02-12T17:29:12.500 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 107 (ObjNum 89 snap 17 seq_num 89) dirty exists 2026-02-12T17:29:12.500 INFO:tasks.rados.rados.0.trial082.stdout:174: left oid 19 (ObjNum 89 snap 17 seq_num 89) 2026-02-12T17:29:12.500 INFO:tasks.rados.rados.0.trial082.stdout:175: expect (ObjNum 77 snap 15 seq_num 77) 2026-02-12T17:29:12.500 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:12.557 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:12.588 INFO:tasks.rados.rados.0.trial082.stdout:176: finishing copy_from racing read to trial08226312-46 2026-02-12T17:29:12.588 INFO:tasks.rados.rados.0.trial082.stdout:176: finishing copy_from to trial08226312-46 2026-02-12T17:29:12.588 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 42 (ObjNum 72 snap 11 seq_num 72) dirty exists 2026-02-12T17:29:12.588 INFO:tasks.rados.rados.0.trial082.stdout:172: done (5 left) 2026-02-12T17:29:12.588 INFO:tasks.rados.rados.0.trial082.stdout:173: done (4 left) 2026-02-12T17:29:12.588 INFO:tasks.rados.rados.0.trial082.stdout:174: done (3 left) 2026-02-12T17:29:12.588 INFO:tasks.rados.rados.0.trial082.stdout:175: done (2 left) 2026-02-12T17:29:12.588 INFO:tasks.rados.rados.0.trial082.stdout:176: done (1 left) 2026-02-12T17:29:12.588 INFO:tasks.rados.rados.0.trial082.stdout:178: done (0 left) 2026-02-12T17:29:12.589 INFO:tasks.rados.rados.0.trial082.stdout:179: read oid 24 snap -1 2026-02-12T17:29:12.589 INFO:tasks.rados.rados.0.trial082.stdout:179: expect deleted 2026-02-12T17:29:12.589 INFO:tasks.rados.rados.0.trial082.stdout:180: snap_remove snap 13 2026-02-12T17:29:13.476 INFO:tasks.rados.rados.0.trial082.stdout:180: done (1 left) 2026-02-12T17:29:13.477 INFO:tasks.rados.rados.0.trial082.stdout:181: rollback oid 32 current snap is 17 2026-02-12T17:29:13.477 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 15 2026-02-12T17:29:13.477 INFO:tasks.rados.rados.0.trial082.stdout:179: done (1 left) 2026-02-12T17:29:13.477 INFO:tasks.rados.rados.0.trial082.stdout:182: write oid 10 current snap is 17 2026-02-12T17:29:13.477 INFO:tasks.rados.rados.0.trial082.stdout:182: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2026-02-12T17:29:13.482 INFO:tasks.rados.rados.0.trial082.stdout:182: writing trial08226312-10 from 729437 to 1256979 tid 1 2026-02-12T17:29:13.486 INFO:tasks.rados.rados.0.trial082.stdout:182: writing trial08226312-10 from 1925626 to 2568977 tid 2 2026-02-12T17:29:13.490 INFO:tasks.rados.rados.0.trial082.stdout:182: writing trial08226312-10 from 3266551 to 3529437 tid 3 2026-02-12T17:29:13.490 INFO:tasks.rados.rados.0.trial082.stdout:183: snap_remove snap 16 2026-02-12T17:29:14.479 INFO:tasks.rados.rados.0.trial082.stdout:183: done (2 left) 2026-02-12T17:29:14.480 INFO:tasks.rados.rados.0.trial082.stdout:184: write oid 23 current snap is 17 2026-02-12T17:29:14.480 INFO:tasks.rados.rados.0.trial082.stdout:184: seq_num 92 ranges {746244=719144,2100461=503362,3126680=419564} 2026-02-12T17:29:14.485 INFO:tasks.rados.rados.0.trial082.stdout:184: writing trial08226312-23 from 746244 to 1465388 tid 1 2026-02-12T17:29:14.490 INFO:tasks.rados.rados.0.trial082.stdout:184: writing trial08226312-23 from 2100461 to 2603823 tid 2 2026-02-12T17:29:14.494 INFO:tasks.rados.rados.0.trial082.stdout:184: writing trial08226312-23 from 3126680 to 3546244 tid 3 2026-02-12T17:29:14.494 INFO:tasks.rados.rados.0.trial082.stdout:185: read oid 50 snap -1 2026-02-12T17:29:14.494 INFO:tasks.rados.rados.0.trial082.stdout:185: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-12T17:29:14.494 INFO:tasks.rados.rados.0.trial082.stdout:186: write oid 24 current snap is 17 2026-02-12T17:29:14.494 INFO:tasks.rados.rados.0.trial082.stdout:181: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:29:14.494 INFO:tasks.rados.rados.0.trial082.stdout:181: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:29:14.494 INFO:tasks.rados.rados.0.trial082.stdout:181: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:29:14.494 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 39 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-12T17:29:14.495 INFO:tasks.rados.rados.0.trial082.stdout:182: finishing write tid 1 to trial08226312-10 2026-02-12T17:29:14.495 INFO:tasks.rados.rados.0.trial082.stdout:182: finishing write tid 2 to trial08226312-10 2026-02-12T17:29:14.495 INFO:tasks.rados.rados.0.trial082.stdout:182: finishing write tid 3 to trial08226312-10 2026-02-12T17:29:14.495 INFO:tasks.rados.rados.0.trial082.stdout:182: finishing write tid 4 to trial08226312-10 2026-02-12T17:29:14.495 INFO:tasks.rados.rados.0.trial082.stdout:186: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2026-02-12T17:29:14.499 INFO:tasks.rados.rados.0.trial082.stdout:186: writing trial08226312-24 from 763051 to 1557444 tid 1 2026-02-12T17:29:14.504 INFO:tasks.rados.rados.0.trial082.stdout:186: writing trial08226312-24 from 2158943 to 2805963 tid 2 2026-02-12T17:29:14.507 INFO:tasks.rados.rados.0.trial082.stdout:186: writing trial08226312-24 from 3437750 to 3563051 tid 3 2026-02-12T17:29:14.507 INFO:tasks.rados.rados.0.trial082.stdout:181: done (4 left) 2026-02-12T17:29:14.507 INFO:tasks.rados.rados.0.trial082.stdout:187: snap_create 2026-02-12T17:29:14.507 INFO:tasks.rados.rados.0.trial082.stdout:182: finishing write tid 5 to trial08226312-10 2026-02-12T17:29:14.507 INFO:tasks.rados.rados.0.trial082.stdout:182: oid 10 updating version 0 to 77 2026-02-12T17:29:14.508 INFO:tasks.rados.rados.0.trial082.stdout:182: oid 10 updating version 77 to 78 2026-02-12T17:29:14.508 INFO:tasks.rados.rados.0.trial082.stdout:182: oid 10 version 78 is already newer than 73 2026-02-12T17:29:14.508 INFO:tasks.rados.rados.0.trial082.stdout:182: oid 10 version 78 is already newer than 74 2026-02-12T17:29:14.508 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 78 (ObjNum 91 snap 17 seq_num 91) dirty exists 2026-02-12T17:29:14.508 INFO:tasks.rados.rados.0.trial082.stdout:182: left oid 10 (ObjNum 91 snap 17 seq_num 91) 2026-02-12T17:29:14.508 INFO:tasks.rados.rados.0.trial082.stdout:185: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-12T17:29:14.531 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:184: finishing write tid 1 to trial08226312-23 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:186: finishing write tid 1 to trial08226312-24 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:184: finishing write tid 2 to trial08226312-23 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:184: finishing write tid 3 to trial08226312-23 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:184: finishing write tid 4 to trial08226312-23 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:184: finishing write tid 5 to trial08226312-23 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:184: oid 23 updating version 0 to 67 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:184: oid 23 version 67 is already newer than 65 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:184: oid 23 updating version 67 to 68 2026-02-12T17:29:14.551 INFO:tasks.rados.rados.0.trial082.stdout:184: oid 23 version 68 is already newer than 66 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 68 (ObjNum 92 snap 17 seq_num 92) dirty exists 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:184: left oid 23 (ObjNum 92 snap 17 seq_num 92) 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:186: finishing write tid 2 to trial08226312-24 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:186: finishing write tid 3 to trial08226312-24 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:186: finishing write tid 4 to trial08226312-24 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:186: finishing write tid 5 to trial08226312-24 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:186: oid 24 updating version 0 to 132 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:186: oid 24 updating version 132 to 134 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:186: oid 24 version 134 is already newer than 133 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:186: oid 24 updating version 134 to 135 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 135 (ObjNum 93 snap 17 seq_num 93) dirty exists 2026-02-12T17:29:14.552 INFO:tasks.rados.rados.0.trial082.stdout:186: left oid 24 (ObjNum 93 snap 17 seq_num 93) 2026-02-12T17:29:15.498 INFO:tasks.rados.rados.0.trial082.stdout:182: done (4 left) 2026-02-12T17:29:15.498 INFO:tasks.rados.rados.0.trial082.stdout:184: done (3 left) 2026-02-12T17:29:15.498 INFO:tasks.rados.rados.0.trial082.stdout:185: done (2 left) 2026-02-12T17:29:15.498 INFO:tasks.rados.rados.0.trial082.stdout:186: done (1 left) 2026-02-12T17:29:15.498 INFO:tasks.rados.rados.0.trial082.stdout:187: done (0 left) 2026-02-12T17:29:15.498 INFO:tasks.rados.rados.0.trial082.stdout:188: snap_create 2026-02-12T17:29:16.499 INFO:tasks.rados.rados.0.trial082.stdout:188: done (0 left) 2026-02-12T17:29:16.499 INFO:tasks.rados.rados.0.trial082.stdout:189: rollback oid 34 current snap is 19 2026-02-12T17:29:16.499 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 14 2026-02-12T17:29:16.499 INFO:tasks.rados.rados.0.trial082.stdout:190: read oid 29 snap -1 2026-02-12T17:29:16.499 INFO:tasks.rados.rados.0.trial082.stdout:190: expect deleted 2026-02-12T17:29:16.499 INFO:tasks.rados.rados.0.trial082.stdout:191: read oid 32 snap -1 2026-02-12T17:29:16.499 INFO:tasks.rados.rados.0.trial082.stdout:191: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-12T17:29:16.500 INFO:tasks.rados.rados.0.trial082.stdout:192: copy_from oid 25 from oid 16 current snap is 19 2026-02-12T17:29:16.500 INFO:tasks.rados.rados.0.trial082.stdout:193: delete oid 36 current snap is 19 2026-02-12T17:29:16.502 INFO:tasks.rados.rados.0.trial082.stdout:190: done (4 left) 2026-02-12T17:29:16.502 INFO:tasks.rados.rados.0.trial082.stdout:193: done (3 left) 2026-02-12T17:29:16.502 INFO:tasks.rados.rados.0.trial082.stdout:194: delete oid 1 current snap is 19 2026-02-12T17:29:16.502 INFO:tasks.rados.rados.0.trial082.stdout:189: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:29:16.502 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 43 (ObjNum 81 snap 0 seq_num 1) dirty dne 2026-02-12T17:29:16.502 INFO:tasks.rados.rados.0.trial082.stdout:191: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-12T17:29:16.514 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:16.531 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:16.549 INFO:tasks.rados.rados.0.trial082.stdout:192: finishing copy_from to trial08226312-25 2026-02-12T17:29:16.549 INFO:tasks.rados.rados.0.trial082.stdout:192: got expected ENOENT (src dne) 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:192: finishing copy_from racing read to trial08226312-25 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:189: done (3 left) 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:191: done (2 left) 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:192: done (1 left) 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:194: done (0 left) 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:195: read oid 37 snap 17 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:195: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:196: read oid 6 snap -1 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:196: expect deleted 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:197: read oid 24 snap -1 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:197: expect (ObjNum 93 snap 17 seq_num 93) 2026-02-12T17:29:16.550 INFO:tasks.rados.rados.0.trial082.stdout:198: snap_create 2026-02-12T17:29:16.551 INFO:tasks.rados.rados.0.trial082.stdout:195: expect (ObjNum 36 snap 0 seq_num 36) 2026-02-12T17:29:16.553 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1572167 2026-02-12T17:29:16.589 INFO:tasks.rados.rados.0.trial082.stdout:197: expect (ObjNum 93 snap 17 seq_num 93) 2026-02-12T17:29:16.617 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1954113 2026-02-12T17:29:17.504 INFO:tasks.rados.rados.0.trial082.stdout:195: done (3 left) 2026-02-12T17:29:17.504 INFO:tasks.rados.rados.0.trial082.stdout:196: done (2 left) 2026-02-12T17:29:17.504 INFO:tasks.rados.rados.0.trial082.stdout:197: done (1 left) 2026-02-12T17:29:17.504 INFO:tasks.rados.rados.0.trial082.stdout:198: done (0 left) 2026-02-12T17:29:17.504 INFO:tasks.rados.rados.0.trial082.stdout:199: snap_remove snap 15 2026-02-12T17:29:18.477 INFO:tasks.rados.rados.0.trial082.stdout:199: done (0 left) 2026-02-12T17:29:18.477 INFO:tasks.rados.rados.0.trial082.stdout:200: read oid 12 snap -1 2026-02-12T17:29:18.477 INFO:tasks.rados.rados.0.trial082.stdout:200: expect (ObjNum 11 snap 0 seq_num 11) 2026-02-12T17:29:18.478 INFO:tasks.rados.rados.0.trial082.stdout:201: rollback oid 38 current snap is 20 2026-02-12T17:29:18.478 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 18 2026-02-12T17:29:18.478 INFO:tasks.rados.rados.0.trial082.stdout:202: read oid 33 snap -1 2026-02-12T17:29:18.478 INFO:tasks.rados.rados.0.trial082.stdout:202: expect (ObjNum 85 snap 17 seq_num 85) 2026-02-12T17:29:18.478 INFO:tasks.rados.rados.0.trial082.stdout:203: read oid 16 snap 19 2026-02-12T17:29:18.478 INFO:tasks.rados.rados.0.trial082.stdout:203: expect deleted 2026-02-12T17:29:18.478 INFO:tasks.rados.rados.0.trial082.stdout:204: delete oid 24 current snap is 20 2026-02-12T17:29:18.481 INFO:tasks.rados.rados.0.trial082.stdout:201: finishing rollback tid 0 to trial08226312-38 2026-02-12T17:29:18.482 INFO:tasks.rados.rados.0.trial082.stdout:201: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:29:18.482 INFO:tasks.rados.rados.0.trial082.stdout:201: finishing rollback tid 2 to trial08226312-38 2026-02-12T17:29:18.482 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 47 (ObjNum 73 snap 13 seq_num 73) dirty exists 2026-02-12T17:29:18.482 INFO:tasks.rados.rados.0.trial082.stdout:201: done (4 left) 2026-02-12T17:29:18.483 INFO:tasks.rados.rados.0.trial082.stdout:203: done (3 left) 2026-02-12T17:29:18.483 INFO:tasks.rados.rados.0.trial082.stdout:204: done (2 left) 2026-02-12T17:29:18.483 INFO:tasks.rados.rados.0.trial082.stdout:205: delete oid 13 current snap is 20 2026-02-12T17:29:18.484 INFO:tasks.rados.rados.0.trial082.stdout:205: done (2 left) 2026-02-12T17:29:18.484 INFO:tasks.rados.rados.0.trial082.stdout:206: read oid 20 snap -1 2026-02-12T17:29:18.484 INFO:tasks.rados.rados.0.trial082.stdout:206: expect (ObjNum 77 snap 15 seq_num 77) 2026-02-12T17:29:18.484 INFO:tasks.rados.rados.0.trial082.stdout:207: rollback oid 11 current snap is 20 2026-02-12T17:29:18.484 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 17 2026-02-12T17:29:18.484 INFO:tasks.rados.rados.0.trial082.stdout:208: copy_from oid 16 from oid 14 current snap is 20 2026-02-12T17:29:18.484 INFO:tasks.rados.rados.0.trial082.stdout:209: copy_from oid 1 from oid 15 current snap is 20 2026-02-12T17:29:18.484 INFO:tasks.rados.rados.0.trial082.stdout:210: write (excl) oid 44 current snap is 20 2026-02-12T17:29:18.484 INFO:tasks.rados.rados.0.trial082.stdout:210: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2026-02-12T17:29:18.487 INFO:tasks.rados.rados.0.trial082.stdout:210: writing trial08226312-44 from 447086 to 1217724 tid 1 2026-02-12T17:29:18.493 INFO:tasks.rados.rados.0.trial082.stdout:210: writing trial08226312-44 from 1935000 to 2733016 tid 2 2026-02-12T17:29:18.497 INFO:tasks.rados.rados.0.trial082.stdout:210: writing trial08226312-44 from 3458512 to 3647086 tid 3 2026-02-12T17:29:18.497 INFO:tasks.rados.rados.0.trial082.stdout:211: write oid 5 current snap is 20 2026-02-12T17:29:18.497 INFO:tasks.rados.rados.0.trial082.stdout:208: finishing copy_from to trial08226312-16 2026-02-12T17:29:18.497 INFO:tasks.rados.rados.0.trial082.stdout:208: got expected ENOENT (src dne) 2026-02-12T17:29:18.497 INFO:tasks.rados.rados.0.trial082.stdout:208: finishing copy_from racing read to trial08226312-16 2026-02-12T17:29:18.498 INFO:tasks.rados.rados.0.trial082.stdout:200: expect (ObjNum 11 snap 0 seq_num 11) 2026-02-12T17:29:18.508 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1243810 2026-02-12T17:29:18.517 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 311877 2026-02-12T17:29:18.530 INFO:tasks.rados.rados.0.trial082.stdout:206: expect (ObjNum 77 snap 15 seq_num 77) 2026-02-12T17:29:18.612 INFO:tasks.rados.rados.0.trial082.stdout:207: finishing rollback tid 0 to trial08226312-11 2026-02-12T17:29:18.613 INFO:tasks.rados.rados.0.trial082.stdout:207: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:29:18.613 INFO:tasks.rados.rados.0.trial082.stdout:207: finishing rollback tid 2 to trial08226312-11 2026-02-12T17:29:18.613 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 45 (ObjNum 74 snap 13 seq_num 74) dirty exists 2026-02-12T17:29:18.613 INFO:tasks.rados.rados.0.trial082.stdout:202: expect (ObjNum 85 snap 17 seq_num 85) 2026-02-12T17:29:18.613 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:18.677 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:18.714 INFO:tasks.rados.rados.0.trial082.stdout:210: finishing write tid 1 to trial08226312-44 2026-02-12T17:29:18.714 INFO:tasks.rados.rados.0.trial082.stdout:209: finishing copy_from racing read to trial08226312-1 2026-02-12T17:29:18.714 INFO:tasks.rados.rados.0.trial082.stdout:209: finishing copy_from to trial08226312-1 2026-02-12T17:29:18.714 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 16 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-12T17:29:18.714 INFO:tasks.rados.rados.0.trial082.stdout:210: finishing write tid 2 to trial08226312-44 2026-02-12T17:29:18.714 INFO:tasks.rados.rados.0.trial082.stdout:211: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2026-02-12T17:29:18.717 INFO:tasks.rados.rados.0.trial082.stdout:211: writing trial08226312-5 from 463893 to 1026133 tid 1 2026-02-12T17:29:18.722 INFO:tasks.rados.rados.0.trial082.stdout:211: writing trial08226312-5 from 1593482 to 2251509 tid 2 2026-02-12T17:29:18.726 INFO:tasks.rados.rados.0.trial082.stdout:211: writing trial08226312-5 from 2685935 to 3245276 tid 3 2026-02-12T17:29:18.726 INFO:tasks.rados.rados.0.trial082.stdout:200: done (7 left) 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:202: done (6 left) 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:206: done (5 left) 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:207: done (4 left) 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:208: done (3 left) 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:209: done (2 left) 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:212: read oid 2 snap -1 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:212: expect (ObjNum 80 snap 15 seq_num 80) 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:213: rollback oid 32 current snap is 20 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 1 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:210: finishing write tid 3 to trial08226312-44 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:210: finishing write tid 4 to trial08226312-44 2026-02-12T17:29:18.727 INFO:tasks.rados.rados.0.trial082.stdout:210: finishing write tid 5 to trial08226312-44 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:210: oid 44 updating version 0 to 80 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:210: oid 44 version 80 is already newer than 78 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:210: oid 44 version 80 is already newer than 79 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:210: oid 44 updating version 80 to 81 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 81 (ObjNum 98 snap 20 seq_num 98) dirty exists 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:210: left oid 44 (ObjNum 98 snap 20 seq_num 98) 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:211: finishing write tid 1 to trial08226312-5 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:211: finishing write tid 2 to trial08226312-5 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:210: done (3 left) 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:214: write oid 42 current snap is 20 2026-02-12T17:29:18.728 INFO:tasks.rados.rados.0.trial082.stdout:214: seq_num 100 ranges {480700=637489,1651964=401685,2713358=770613} 2026-02-12T17:29:18.730 INFO:tasks.rados.rados.0.trial082.stdout:214: writing trial08226312-42 from 480700 to 1118189 tid 1 2026-02-12T17:29:18.733 INFO:tasks.rados.rados.0.trial082.stdout:214: writing trial08226312-42 from 1651964 to 2053649 tid 2 2026-02-12T17:29:18.739 INFO:tasks.rados.rados.0.trial082.stdout:214: writing trial08226312-42 from 2713358 to 3483971 tid 3 2026-02-12T17:29:18.739 INFO:tasks.rados.rados.0.trial082.stdout:215: rollback oid 19 current snap is 20 2026-02-12T17:29:18.739 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 19 2026-02-12T17:29:18.739 INFO:tasks.rados.rados.0.trial082.stdout:211: finishing write tid 3 to trial08226312-5 2026-02-12T17:29:18.739 INFO:tasks.rados.rados.0.trial082.stdout:211: finishing write tid 4 to trial08226312-5 2026-02-12T17:29:18.739 INFO:tasks.rados.rados.0.trial082.stdout:211: finishing write tid 5 to trial08226312-5 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:211: oid 5 updating version 0 to 56 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:211: oid 5 updating version 56 to 57 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:211: oid 5 version 57 is already newer than 54 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:211: oid 5 version 57 is already newer than 55 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 57 (ObjNum 99 snap 20 seq_num 99) dirty exists 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:211: left oid 5 (ObjNum 99 snap 20 seq_num 99) 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:213: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:213: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:213: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 51 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-12T17:29:18.740 INFO:tasks.rados.rados.0.trial082.stdout:212: expect (ObjNum 80 snap 15 seq_num 80) 2026-02-12T17:29:18.741 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:18.778 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 805222 2026-02-12T17:29:18.835 INFO:tasks.rados.rados.0.trial082.stdout:214: finishing write tid 1 to trial08226312-42 2026-02-12T17:29:18.835 INFO:tasks.rados.rados.0.trial082.stdout:214: finishing write tid 2 to trial08226312-42 2026-02-12T17:29:18.835 INFO:tasks.rados.rados.0.trial082.stdout:215: finishing rollback tid 0 to trial08226312-19 2026-02-12T17:29:18.835 INFO:tasks.rados.rados.0.trial082.stdout:215: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:29:18.835 INFO:tasks.rados.rados.0.trial082.stdout:215: finishing rollback tid 2 to trial08226312-19 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 147 (ObjNum 89 snap 17 seq_num 89) dirty exists 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:214: finishing write tid 3 to trial08226312-42 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:211: done (4 left) 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:212: done (3 left) 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:213: done (2 left) 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:215: done (1 left) 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:216: delete oid 32 current snap is 20 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:214: finishing write tid 4 to trial08226312-42 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:214: finishing write tid 5 to trial08226312-42 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:214: oid 42 updating version 0 to 103 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:214: oid 42 version 103 is already newer than 101 2026-02-12T17:29:18.836 INFO:tasks.rados.rados.0.trial082.stdout:214: oid 42 updating version 103 to 104 2026-02-12T17:29:18.837 INFO:tasks.rados.rados.0.trial082.stdout:214: oid 42 version 104 is already newer than 102 2026-02-12T17:29:18.837 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 104 (ObjNum 100 snap 20 seq_num 100) dirty exists 2026-02-12T17:29:18.837 INFO:tasks.rados.rados.0.trial082.stdout:214: left oid 42 (ObjNum 100 snap 20 seq_num 100) 2026-02-12T17:29:18.837 INFO:tasks.rados.rados.0.trial082.stdout:214: done (1 left) 2026-02-12T17:29:18.837 INFO:tasks.rados.rados.0.trial082.stdout:216: done (0 left) 2026-02-12T17:29:18.838 INFO:tasks.rados.rados.0.trial082.stdout:217: delete oid 32 current snap is 20 2026-02-12T17:29:18.838 INFO:tasks.rados.rados.0.trial082.stdout:217: done (0 left) 2026-02-12T17:29:18.838 INFO:tasks.rados.rados.0.trial082.stdout:218: write oid 11 current snap is 20 2026-02-12T17:29:18.838 INFO:tasks.rados.rados.0.trial082.stdout:218: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2026-02-12T17:29:18.839 INFO:tasks.rados.rados.0.trial082.stdout:218: writing trial08226312-11 from 531121 to 994357 tid 1 2026-02-12T17:29:18.844 INFO:tasks.rados.rados.0.trial082.stdout:218: writing trial08226312-11 from 1711057 to 2376422 tid 2 2026-02-12T17:29:18.850 INFO:tasks.rados.rados.0.trial082.stdout:218: writing trial08226312-11 from 3079274 to 3731121 tid 3 2026-02-12T17:29:18.850 INFO:tasks.rados.rados.0.trial082.stdout:219: delete oid 12 current snap is 20 2026-02-12T17:29:18.850 INFO:tasks.rados.rados.0.trial082.stdout:218: finishing write tid 1 to trial08226312-11 2026-02-12T17:29:18.850 INFO:tasks.rados.rados.0.trial082.stdout:218: finishing write tid 2 to trial08226312-11 2026-02-12T17:29:18.852 INFO:tasks.rados.rados.0.trial082.stdout:219: done (1 left) 2026-02-12T17:29:18.852 INFO:tasks.rados.rados.0.trial082.stdout:220: copy_from oid 41 from oid 30 current snap is 20 2026-02-12T17:29:18.852 INFO:tasks.rados.rados.0.trial082.stdout:221: delete oid 18 current snap is 20 2026-02-12T17:29:18.852 INFO:tasks.rados.rados.0.trial082.stdout:218: finishing write tid 3 to trial08226312-11 2026-02-12T17:29:18.852 INFO:tasks.rados.rados.0.trial082.stdout:218: finishing write tid 4 to trial08226312-11 2026-02-12T17:29:18.852 INFO:tasks.rados.rados.0.trial082.stdout:218: finishing write tid 5 to trial08226312-11 2026-02-12T17:29:18.852 INFO:tasks.rados.rados.0.trial082.stdout:218: oid 11 updating version 0 to 46 2026-02-12T17:29:18.853 INFO:tasks.rados.rados.0.trial082.stdout:218: oid 11 updating version 46 to 47 2026-02-12T17:29:18.853 INFO:tasks.rados.rados.0.trial082.stdout:218: oid 11 updating version 47 to 49 2026-02-12T17:29:18.853 INFO:tasks.rados.rados.0.trial082.stdout:218: oid 11 version 49 is already newer than 48 2026-02-12T17:29:18.853 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 49 (ObjNum 103 snap 20 seq_num 103) dirty exists 2026-02-12T17:29:18.853 INFO:tasks.rados.rados.0.trial082.stdout:218: left oid 11 (ObjNum 103 snap 20 seq_num 103) 2026-02-12T17:29:18.854 INFO:tasks.rados.rados.0.trial082.stdout:218: done (2 left) 2026-02-12T17:29:18.854 INFO:tasks.rados.rados.0.trial082.stdout:221: done (1 left) 2026-02-12T17:29:18.854 INFO:tasks.rados.rados.0.trial082.stdout:222: rollback oid 16 current snap is 20 2026-02-12T17:29:18.854 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 1 2026-02-12T17:29:18.854 INFO:tasks.rados.rados.0.trial082.stdout:223: copy_from oid 19 from oid 28 current snap is 20 2026-02-12T17:29:18.854 INFO:tasks.rados.rados.0.trial082.stdout:224: snap_create 2026-02-12T17:29:18.858 INFO:tasks.rados.rados.0.trial082.stdout:222: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:29:18.858 INFO:tasks.rados.rados.0.trial082.stdout:222: finishing rollback tid 2 to trial08226312-16 2026-02-12T17:29:18.858 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 106 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-12T17:29:18.859 INFO:tasks.rados.rados.0.trial082.stdout:220: finishing copy_from racing read to trial08226312-41 2026-02-12T17:29:18.861 INFO:tasks.rados.rados.0.trial082.stdout:220: finishing copy_from to trial08226312-41 2026-02-12T17:29:18.862 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 61 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-12T17:29:18.865 INFO:tasks.rados.rados.0.trial082.stdout:223: finishing copy_from racing read to trial08226312-19 2026-02-12T17:29:18.866 INFO:tasks.rados.rados.0.trial082.stdout:223: finishing copy_from to trial08226312-19 2026-02-12T17:29:18.866 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 67 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-12T17:29:19.508 INFO:tasks.rados.rados.0.trial082.stdout:220: done (3 left) 2026-02-12T17:29:19.508 INFO:tasks.rados.rados.0.trial082.stdout:222: done (2 left) 2026-02-12T17:29:19.508 INFO:tasks.rados.rados.0.trial082.stdout:223: done (1 left) 2026-02-12T17:29:19.508 INFO:tasks.rados.rados.0.trial082.stdout:224: done (0 left) 2026-02-12T17:29:19.508 INFO:tasks.rados.rados.0.trial082.stdout:225: delete oid 12 current snap is 21 2026-02-12T17:29:19.510 INFO:tasks.rados.rados.0.trial082.stdout:225: done (0 left) 2026-02-12T17:29:19.510 INFO:tasks.rados.rados.0.trial082.stdout:226: delete oid 1 current snap is 21 2026-02-12T17:29:19.512 INFO:tasks.rados.rados.0.trial082.stdout:226: done (0 left) 2026-02-12T17:29:19.512 INFO:tasks.rados.rados.0.trial082.stdout:227: snap_remove snap 18 2026-02-12T17:29:20.632 INFO:tasks.rados.rados.0.trial082.stdout:227: done (0 left) 2026-02-12T17:29:20.632 INFO:tasks.rados.rados.0.trial082.stdout:228: write (excl) oid 10 current snap is 21 2026-02-12T17:29:20.632 INFO:tasks.rados.rados.0.trial082.stdout:228: seq_num 108 ranges {615156=555834,1603467=416361,2816389=693495} 2026-02-12T17:29:20.636 INFO:tasks.rados.rados.0.trial082.stdout:228: writing trial08226312-10 from 615156 to 1170990 tid 1 2026-02-12T17:29:20.639 INFO:tasks.rados.rados.0.trial082.stdout:228: writing trial08226312-10 from 1603467 to 2019828 tid 2 2026-02-12T17:29:20.646 INFO:tasks.rados.rados.0.trial082.stdout:228: writing trial08226312-10 from 2816389 to 3509884 tid 3 2026-02-12T17:29:20.646 INFO:tasks.rados.rados.0.trial082.stdout:229: read oid 36 snap 20 2026-02-12T17:29:20.646 INFO:tasks.rados.rados.0.trial082.stdout:229: expect deleted 2026-02-12T17:29:20.646 INFO:tasks.rados.rados.0.trial082.stdout:230: write oid 5 current snap is 21 2026-02-12T17:29:20.646 INFO:tasks.rados.rados.0.trial082.stdout:228: finishing write tid 1 to trial08226312-10 2026-02-12T17:29:20.646 INFO:tasks.rados.rados.0.trial082.stdout:228: finishing write tid 2 to trial08226312-10 2026-02-12T17:29:20.647 INFO:tasks.rados.rados.0.trial082.stdout:230: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2026-02-12T17:29:20.650 INFO:tasks.rados.rados.0.trial082.stdout:230: writing trial08226312-5 from 631963 to 1263046 tid 1 2026-02-12T17:29:20.655 INFO:tasks.rados.rados.0.trial082.stdout:230: writing trial08226312-5 from 2061949 to 2621968 tid 2 2026-02-12T17:29:20.661 INFO:tasks.rados.rados.0.trial082.stdout:230: writing trial08226312-5 from 3243812 to 3748579 tid 3 2026-02-12T17:29:20.661 INFO:tasks.rados.rados.0.trial082.stdout:231: rollback oid 18 current snap is 21 2026-02-12T17:29:20.661 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 1 2026-02-12T17:29:20.661 INFO:tasks.rados.rados.0.trial082.stdout:228: finishing write tid 3 to trial08226312-10 2026-02-12T17:29:20.661 INFO:tasks.rados.rados.0.trial082.stdout:229: done (3 left) 2026-02-12T17:29:20.661 INFO:tasks.rados.rados.0.trial082.stdout:232: rollback oid 46 current snap is 21 2026-02-12T17:29:20.661 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 46 to 1 2026-02-12T17:29:20.661 INFO:tasks.rados.rados.0.trial082.stdout:228: finishing write tid 4 to trial08226312-10 2026-02-12T17:29:20.661 INFO:tasks.rados.rados.0.trial082.stdout:228: finishing write tid 5 to trial08226312-10 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:228: oid 10 updating version 0 to 93 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:228: oid 10 version 93 is already newer than 90 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:228: oid 10 version 93 is already newer than 91 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:228: oid 10 version 93 is already newer than 92 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 93 (ObjNum 108 snap 21 seq_num 108) dirty exists 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:228: left oid 10 (ObjNum 108 snap 21 seq_num 108) 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:230: finishing write tid 1 to trial08226312-5 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:230: finishing write tid 2 to trial08226312-5 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:228: done (3 left) 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:233: write (excl) oid 19 current snap is 21 2026-02-12T17:29:20.662 INFO:tasks.rados.rados.0.trial082.stdout:233: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2026-02-12T17:29:20.665 INFO:tasks.rados.rados.0.trial082.stdout:233: writing trial08226312-19 from 648770 to 1355102 tid 1 2026-02-12T17:29:20.670 INFO:tasks.rados.rados.0.trial082.stdout:233: writing trial08226312-19 from 2120431 to 2540461 tid 2 2026-02-12T17:29:20.675 INFO:tasks.rados.rados.0.trial082.stdout:233: writing trial08226312-19 from 3271235 to 3703627 tid 3 2026-02-12T17:29:20.675 INFO:tasks.rados.rados.0.trial082.stdout:234: read oid 39 snap -1 2026-02-12T17:29:20.675 INFO:tasks.rados.rados.0.trial082.stdout:234: expect (ObjNum 64 snap 7 seq_num 64) 2026-02-12T17:29:20.675 INFO:tasks.rados.rados.0.trial082.stdout:235: rollback oid 32 current snap is 21 2026-02-12T17:29:20.675 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 17 2026-02-12T17:29:20.675 INFO:tasks.rados.rados.0.trial082.stdout:231: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:29:20.675 INFO:tasks.rados.rados.0.trial082.stdout:231: finishing rollback tid 2 to trial08226312-18 2026-02-12T17:29:20.675 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 63 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:230: finishing write tid 3 to trial08226312-5 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:230: finishing write tid 4 to trial08226312-5 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:230: finishing write tid 5 to trial08226312-5 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:230: oid 5 updating version 0 to 63 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:230: oid 5 version 63 is already newer than 61 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:230: oid 5 version 63 is already newer than 62 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:230: oid 5 updating version 63 to 64 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 64 (ObjNum 109 snap 21 seq_num 109) dirty exists 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:230: left oid 5 (ObjNum 109 snap 21 seq_num 109) 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:232: finishing rollback tid 0 to trial08226312-46 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:232: finishing rollback tid 1 to trial08226312-46 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:232: finishing rollback tid 2 to trial08226312-46 2026-02-12T17:29:20.676 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 52 (ObjNum 45 snap 0 seq_num 45) dirty exists 2026-02-12T17:29:20.677 INFO:tasks.rados.rados.0.trial082.stdout:233: finishing write tid 1 to trial08226312-19 2026-02-12T17:29:20.677 INFO:tasks.rados.rados.0.trial082.stdout:230: done (5 left) 2026-02-12T17:29:20.677 INFO:tasks.rados.rados.0.trial082.stdout:231: done (4 left) 2026-02-12T17:29:20.677 INFO:tasks.rados.rados.0.trial082.stdout:232: done (3 left) 2026-02-12T17:29:20.677 INFO:tasks.rados.rados.0.trial082.stdout:236: snap_remove snap 14 2026-02-12T17:29:21.646 INFO:tasks.rados.rados.0.trial082.stdout:236: done (3 left) 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:237: snap_create 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:233: finishing write tid 2 to trial08226312-19 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:233: finishing write tid 3 to trial08226312-19 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:233: finishing write tid 4 to trial08226312-19 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:233: finishing write tid 5 to trial08226312-19 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:233: oid 19 updating version 0 to 154 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:233: oid 19 updating version 154 to 155 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:233: oid 19 updating version 155 to 156 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:233: oid 19 updating version 156 to 157 2026-02-12T17:29:21.647 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 157 (ObjNum 110 snap 21 seq_num 110) dirty exists 2026-02-12T17:29:21.648 INFO:tasks.rados.rados.0.trial082.stdout:233: left oid 19 (ObjNum 110 snap 21 seq_num 110) 2026-02-12T17:29:21.648 INFO:tasks.rados.rados.0.trial082.stdout:235: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:29:21.648 INFO:tasks.rados.rados.0.trial082.stdout:235: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:29:21.648 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 55 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-12T17:29:21.648 INFO:tasks.rados.rados.0.trial082.stdout:234: expect (ObjNum 64 snap 7 seq_num 64) 2026-02-12T17:29:21.648 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 167740 2026-02-12T17:29:21.668 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 273214 2026-02-12T17:29:21.690 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:22.658 INFO:tasks.rados.rados.0.trial082.stdout:233: done (3 left) 2026-02-12T17:29:22.658 INFO:tasks.rados.rados.0.trial082.stdout:234: done (2 left) 2026-02-12T17:29:22.658 INFO:tasks.rados.rados.0.trial082.stdout:235: done (1 left) 2026-02-12T17:29:22.658 INFO:tasks.rados.rados.0.trial082.stdout:237: done (0 left) 2026-02-12T17:29:22.658 INFO:tasks.rados.rados.0.trial082.stdout:238: write (excl) oid 16 current snap is 22 2026-02-12T17:29:22.658 INFO:tasks.rados.rados.0.trial082.stdout:238: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2026-02-12T17:29:22.663 INFO:tasks.rados.rados.0.trial082.stdout:238: writing trial08226312-16 from 665577 to 1447158 tid 1 2026-02-12T17:29:22.668 INFO:tasks.rados.rados.0.trial082.stdout:238: writing trial08226312-16 from 2062560 to 2626248 tid 2 2026-02-12T17:29:22.673 INFO:tasks.rados.rados.0.trial082.stdout:238: writing trial08226312-16 from 3182305 to 3825969 tid 3 2026-02-12T17:29:22.673 INFO:tasks.rados.rados.0.trial082.stdout:239: snap_create 2026-02-12T17:29:22.673 INFO:tasks.rados.rados.0.trial082.stdout:238: finishing write tid 1 to trial08226312-16 2026-02-12T17:29:22.673 INFO:tasks.rados.rados.0.trial082.stdout:238: finishing write tid 2 to trial08226312-16 2026-02-12T17:29:22.675 INFO:tasks.rados.rados.0.trial082.stdout:238: finishing write tid 3 to trial08226312-16 2026-02-12T17:29:22.675 INFO:tasks.rados.rados.0.trial082.stdout:238: finishing write tid 4 to trial08226312-16 2026-02-12T17:29:22.675 INFO:tasks.rados.rados.0.trial082.stdout:238: finishing write tid 5 to trial08226312-16 2026-02-12T17:29:22.675 INFO:tasks.rados.rados.0.trial082.stdout:238: oid 16 updating version 0 to 119 2026-02-12T17:29:22.675 INFO:tasks.rados.rados.0.trial082.stdout:238: oid 16 version 119 is already newer than 117 2026-02-12T17:29:22.675 INFO:tasks.rados.rados.0.trial082.stdout:238: oid 16 version 119 is already newer than 116 2026-02-12T17:29:22.675 INFO:tasks.rados.rados.0.trial082.stdout:238: oid 16 version 119 is already newer than 118 2026-02-12T17:29:22.675 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 119 (ObjNum 111 snap 22 seq_num 111) dirty exists 2026-02-12T17:29:22.675 INFO:tasks.rados.rados.0.trial082.stdout:238: left oid 16 (ObjNum 111 snap 22 seq_num 111) 2026-02-12T17:29:23.488 INFO:tasks.rados.rados.0.trial082.stdout:238: done (1 left) 2026-02-12T17:29:23.488 INFO:tasks.rados.rados.0.trial082.stdout:239: done (0 left) 2026-02-12T17:29:23.489 INFO:tasks.rados.rados.0.trial082.stdout:240: delete oid 18 current snap is 23 2026-02-12T17:29:23.491 INFO:tasks.rados.rados.0.trial082.stdout:240: done (0 left) 2026-02-12T17:29:23.491 INFO:tasks.rados.rados.0.trial082.stdout:241: read oid 4 snap -1 2026-02-12T17:29:23.491 INFO:tasks.rados.rados.0.trial082.stdout:241: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:29:23.492 INFO:tasks.rados.rados.0.trial082.stdout:242: copy_from oid 32 from oid 31 current snap is 23 2026-02-12T17:29:23.492 INFO:tasks.rados.rados.0.trial082.stdout:243: copy_from oid 17 from oid 12 current snap is 23 2026-02-12T17:29:23.492 INFO:tasks.rados.rados.0.trial082.stdout:244: delete oid 8 current snap is 23 2026-02-12T17:29:23.497 INFO:tasks.rados.rados.0.trial082.stdout:241: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:29:23.526 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:23.555 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:23.585 INFO:tasks.rados.rados.0.trial082.stdout:243: finishing copy_from to trial08226312-17 2026-02-12T17:29:23.585 INFO:tasks.rados.rados.0.trial082.stdout:243: got expected ENOENT (src dne) 2026-02-12T17:29:23.586 INFO:tasks.rados.rados.0.trial082.stdout:243: finishing copy_from racing read to trial08226312-17 2026-02-12T17:29:23.586 INFO:tasks.rados.rados.0.trial082.stdout:242: finishing copy_from racing read to trial08226312-32 2026-02-12T17:29:23.586 INFO:tasks.rados.rados.0.trial082.stdout:242: finishing copy_from to trial08226312-32 2026-02-12T17:29:23.586 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 11 (ObjNum 50 snap 1 seq_num 50) dirty exists 2026-02-12T17:29:23.586 INFO:tasks.rados.rados.0.trial082.stdout:241: done (3 left) 2026-02-12T17:29:23.586 INFO:tasks.rados.rados.0.trial082.stdout:242: done (2 left) 2026-02-12T17:29:23.586 INFO:tasks.rados.rados.0.trial082.stdout:243: done (1 left) 2026-02-12T17:29:23.586 INFO:tasks.rados.rados.0.trial082.stdout:244: done (0 left) 2026-02-12T17:29:23.586 INFO:tasks.rados.rados.0.trial082.stdout:245: snap_create 2026-02-12T17:29:24.491 INFO:tasks.rados.rados.0.trial082.stdout:245: done (0 left) 2026-02-12T17:29:24.491 INFO:tasks.rados.rados.0.trial082.stdout:246: snap_remove snap 1 2026-02-12T17:29:25.492 INFO:tasks.rados.rados.0.trial082.stdout:246: done (0 left) 2026-02-12T17:29:25.492 INFO:tasks.rados.rados.0.trial082.stdout:247: snap_remove snap 19 2026-02-12T17:29:26.496 INFO:tasks.rados.rados.0.trial082.stdout:247: done (0 left) 2026-02-12T17:29:26.496 INFO:tasks.rados.rados.0.trial082.stdout:248: delete oid 41 current snap is 24 2026-02-12T17:29:26.499 INFO:tasks.rados.rados.0.trial082.stdout:248: done (0 left) 2026-02-12T17:29:26.499 INFO:tasks.rados.rados.0.trial082.stdout:249: snap_create 2026-02-12T17:29:27.499 INFO:tasks.rados.rados.0.trial082.stdout:249: done (0 left) 2026-02-12T17:29:27.499 INFO:tasks.rados.rados.0.trial082.stdout:250: write (excl) oid 26 current snap is 25 2026-02-12T17:29:27.499 INFO:tasks.rados.rados.0.trial082.stdout:250: seq_num 115 ranges {732805=798930,2296488=571026,3291997=405105} 2026-02-12T17:29:27.505 INFO:tasks.rados.rados.0.trial082.stdout:250: writing trial08226312-26 from 732805 to 1531735 tid 1 2026-02-12T17:29:27.510 INFO:tasks.rados.rados.0.trial082.stdout:250: writing trial08226312-26 from 2296488 to 2867514 tid 2 2026-02-12T17:29:27.514 INFO:tasks.rados.rados.0.trial082.stdout:250: writing trial08226312-26 from 3291997 to 3697102 tid 3 2026-02-12T17:29:27.514 INFO:tasks.rados.rados.0.trial082.stdout:251: snap_create 2026-02-12T17:29:27.514 INFO:tasks.rados.rados.0.trial082.stdout:250: finishing write tid 1 to trial08226312-26 2026-02-12T17:29:27.514 INFO:tasks.rados.rados.0.trial082.stdout:250: finishing write tid 2 to trial08226312-26 2026-02-12T17:29:27.515 INFO:tasks.rados.rados.0.trial082.stdout:250: finishing write tid 3 to trial08226312-26 2026-02-12T17:29:27.515 INFO:tasks.rados.rados.0.trial082.stdout:250: finishing write tid 4 to trial08226312-26 2026-02-12T17:29:27.516 INFO:tasks.rados.rados.0.trial082.stdout:250: finishing write tid 5 to trial08226312-26 2026-02-12T17:29:27.516 INFO:tasks.rados.rados.0.trial082.stdout:250: oid 26 updating version 0 to 112 2026-02-12T17:29:27.516 INFO:tasks.rados.rados.0.trial082.stdout:250: oid 26 version 112 is already newer than 111 2026-02-12T17:29:27.516 INFO:tasks.rados.rados.0.trial082.stdout:250: oid 26 updating version 112 to 113 2026-02-12T17:29:27.516 INFO:tasks.rados.rados.0.trial082.stdout:250: oid 26 updating version 113 to 114 2026-02-12T17:29:27.516 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 114 (ObjNum 115 snap 25 seq_num 115) dirty exists 2026-02-12T17:29:27.516 INFO:tasks.rados.rados.0.trial082.stdout:250: left oid 26 (ObjNum 115 snap 25 seq_num 115) 2026-02-12T17:29:28.478 INFO:tasks.rados.rados.0.trial082.stdout:250: done (1 left) 2026-02-12T17:29:28.478 INFO:tasks.rados.rados.0.trial082.stdout:251: done (0 left) 2026-02-12T17:29:28.478 INFO:tasks.rados.rados.0.trial082.stdout:252: snap_remove snap 25 2026-02-12T17:29:29.479 INFO:tasks.rados.rados.0.trial082.stdout:252: done (0 left) 2026-02-12T17:29:29.479 INFO:tasks.rados.rados.0.trial082.stdout:253: rollback oid 2 current snap is 26 2026-02-12T17:29:29.480 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 23 2026-02-12T17:29:29.480 INFO:tasks.rados.rados.0.trial082.stdout:254: copy_from oid 18 from oid 9 current snap is 26 2026-02-12T17:29:29.480 INFO:tasks.rados.rados.0.trial082.stdout:255: read oid 50 snap -1 2026-02-12T17:29:29.480 INFO:tasks.rados.rados.0.trial082.stdout:255: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-12T17:29:29.480 INFO:tasks.rados.rados.0.trial082.stdout:256: write oid 33 current snap is 26 2026-02-12T17:29:29.480 INFO:tasks.rados.rados.0.trial082.stdout:256: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2026-02-12T17:29:29.483 INFO:tasks.rados.rados.0.trial082.stdout:256: writing trial08226312-33 from 749612 to 1223791 tid 1 2026-02-12T17:29:29.488 INFO:tasks.rados.rados.0.trial082.stdout:256: writing trial08226312-33 from 1954970 to 2386007 tid 2 2026-02-12T17:29:29.492 INFO:tasks.rados.rados.0.trial082.stdout:256: writing trial08226312-33 from 2919420 to 3535797 tid 3 2026-02-12T17:29:29.492 INFO:tasks.rados.rados.0.trial082.stdout:257: read oid 42 snap 23 2026-02-12T17:29:29.493 INFO:tasks.rados.rados.0.trial082.stdout:257: expect (ObjNum 100 snap 20 seq_num 100) 2026-02-12T17:29:29.493 INFO:tasks.rados.rados.0.trial082.stdout:258: read oid 30 snap 21 2026-02-12T17:29:29.493 INFO:tasks.rados.rados.0.trial082.stdout:258: expect (ObjNum 43 snap 0 seq_num 43) 2026-02-12T17:29:29.493 INFO:tasks.rados.rados.0.trial082.stdout:259: snap_remove snap 12 2026-02-12T17:29:30.481 INFO:tasks.rados.rados.0.trial082.stdout:259: done (6 left) 2026-02-12T17:29:30.481 INFO:tasks.rados.rados.0.trial082.stdout:260: delete oid 23 current snap is 26 2026-02-12T17:29:30.481 INFO:tasks.rados.rados.0.trial082.stdout:253: finishing rollback tid 0 to trial08226312-2 2026-02-12T17:29:30.481 INFO:tasks.rados.rados.0.trial082.stdout:253: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:29:30.481 INFO:tasks.rados.rados.0.trial082.stdout:253: finishing rollback tid 2 to trial08226312-2 2026-02-12T17:29:30.481 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 50 (ObjNum 80 snap 15 seq_num 80) dirty exists 2026-02-12T17:29:30.481 INFO:tasks.rados.rados.0.trial082.stdout:255: expect (ObjNum 49 snap 0 seq_num 49) 2026-02-12T17:29:30.491 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:30.514 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 984482 2026-02-12T17:29:30.527 INFO:tasks.rados.rados.0.trial082.stdout:256: finishing write tid 1 to trial08226312-33 2026-02-12T17:29:30.527 INFO:tasks.rados.rados.0.trial082.stdout:254: finishing copy_from racing read to trial08226312-18 2026-02-12T17:29:30.527 INFO:tasks.rados.rados.0.trial082.stdout:254: finishing copy_from to trial08226312-18 2026-02-12T17:29:30.527 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 23 (ObjNum 52 snap 1 seq_num 52) dirty exists 2026-02-12T17:29:30.527 INFO:tasks.rados.rados.0.trial082.stdout:256: finishing write tid 2 to trial08226312-33 2026-02-12T17:29:30.527 INFO:tasks.rados.rados.0.trial082.stdout:256: finishing write tid 3 to trial08226312-33 2026-02-12T17:29:30.528 INFO:tasks.rados.rados.0.trial082.stdout:256: finishing write tid 4 to trial08226312-33 2026-02-12T17:29:30.528 INFO:tasks.rados.rados.0.trial082.stdout:256: finishing write tid 5 to trial08226312-33 2026-02-12T17:29:30.528 INFO:tasks.rados.rados.0.trial082.stdout:256: oid 33 updating version 0 to 66 2026-02-12T17:29:30.528 INFO:tasks.rados.rados.0.trial082.stdout:256: oid 33 version 66 is already newer than 63 2026-02-12T17:29:30.528 INFO:tasks.rados.rados.0.trial082.stdout:256: oid 33 version 66 is already newer than 65 2026-02-12T17:29:30.528 INFO:tasks.rados.rados.0.trial082.stdout:256: oid 33 version 66 is already newer than 64 2026-02-12T17:29:30.528 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 66 (ObjNum 116 snap 26 seq_num 116) dirty exists 2026-02-12T17:29:30.528 INFO:tasks.rados.rados.0.trial082.stdout:256: left oid 33 (ObjNum 116 snap 26 seq_num 116) 2026-02-12T17:29:30.528 INFO:tasks.rados.rados.0.trial082.stdout:258: expect (ObjNum 43 snap 0 seq_num 43) 2026-02-12T17:29:30.549 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1109110 2026-02-12T17:29:30.560 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:30.579 INFO:tasks.rados.rados.0.trial082.stdout:257: expect (ObjNum 100 snap 20 seq_num 100) 2026-02-12T17:29:30.579 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:30.677 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1324503 2026-02-12T17:29:30.710 INFO:tasks.rados.rados.0.trial082.stdout:253: done (6 left) 2026-02-12T17:29:30.710 INFO:tasks.rados.rados.0.trial082.stdout:254: done (5 left) 2026-02-12T17:29:30.711 INFO:tasks.rados.rados.0.trial082.stdout:255: done (4 left) 2026-02-12T17:29:30.711 INFO:tasks.rados.rados.0.trial082.stdout:256: done (3 left) 2026-02-12T17:29:30.711 INFO:tasks.rados.rados.0.trial082.stdout:257: done (2 left) 2026-02-12T17:29:30.711 INFO:tasks.rados.rados.0.trial082.stdout:258: done (1 left) 2026-02-12T17:29:30.711 INFO:tasks.rados.rados.0.trial082.stdout:260: done (0 left) 2026-02-12T17:29:30.711 INFO:tasks.rados.rados.0.trial082.stdout:261: read oid 23 snap -1 2026-02-12T17:29:30.711 INFO:tasks.rados.rados.0.trial082.stdout:261: expect deleted 2026-02-12T17:29:30.711 INFO:tasks.rados.rados.0.trial082.stdout:262: write oid 41 current snap is 26 2026-02-12T17:29:30.711 INFO:tasks.rados.rados.0.trial082.stdout:262: seq_num 118 ranges {783226=624677,2071934=434706,2974266=638921} 2026-02-12T17:29:30.715 INFO:tasks.rados.rados.0.trial082.stdout:262: writing trial08226312-41 from 783226 to 1407903 tid 1 2026-02-12T17:29:30.720 INFO:tasks.rados.rados.0.trial082.stdout:262: writing trial08226312-41 from 2071934 to 2506640 tid 2 2026-02-12T17:29:30.724 INFO:tasks.rados.rados.0.trial082.stdout:262: writing trial08226312-41 from 2974266 to 3613187 tid 3 2026-02-12T17:29:30.724 INFO:tasks.rados.rados.0.trial082.stdout:263: read oid 26 snap -1 2026-02-12T17:29:30.724 INFO:tasks.rados.rados.0.trial082.stdout:263: expect (ObjNum 115 snap 25 seq_num 115) 2026-02-12T17:29:30.724 INFO:tasks.rados.rados.0.trial082.stdout:264: snap_remove snap 24 2026-02-12T17:29:31.515 INFO:tasks.rados.rados.0.trial082.stdout:264: done (3 left) 2026-02-12T17:29:31.515 INFO:tasks.rados.rados.0.trial082.stdout:265: read oid 15 snap 17 2026-02-12T17:29:31.515 INFO:tasks.rados.rados.0.trial082.stdout:265: expect (ObjNum 14 snap 0 seq_num 14) 2026-02-12T17:29:31.515 INFO:tasks.rados.rados.0.trial082.stdout:266: snap_create 2026-02-12T17:29:31.515 INFO:tasks.rados.rados.0.trial082.stdout:262: finishing write tid 1 to trial08226312-41 2026-02-12T17:29:31.515 INFO:tasks.rados.rados.0.trial082.stdout:262: finishing write tid 2 to trial08226312-41 2026-02-12T17:29:31.515 INFO:tasks.rados.rados.0.trial082.stdout:262: finishing write tid 3 to trial08226312-41 2026-02-12T17:29:31.515 INFO:tasks.rados.rados.0.trial082.stdout:262: finishing write tid 4 to trial08226312-41 2026-02-12T17:29:31.516 INFO:tasks.rados.rados.0.trial082.stdout:262: finishing write tid 5 to trial08226312-41 2026-02-12T17:29:31.516 INFO:tasks.rados.rados.0.trial082.stdout:262: oid 41 updating version 0 to 70 2026-02-12T17:29:31.516 INFO:tasks.rados.rados.0.trial082.stdout:262: oid 41 version 70 is already newer than 68 2026-02-12T17:29:31.516 INFO:tasks.rados.rados.0.trial082.stdout:262: oid 41 updating version 70 to 71 2026-02-12T17:29:31.516 INFO:tasks.rados.rados.0.trial082.stdout:262: oid 41 version 71 is already newer than 69 2026-02-12T17:29:31.516 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 71 (ObjNum 118 snap 26 seq_num 118) dirty exists 2026-02-12T17:29:31.516 INFO:tasks.rados.rados.0.trial082.stdout:262: left oid 41 (ObjNum 118 snap 26 seq_num 118) 2026-02-12T17:29:31.516 INFO:tasks.rados.rados.0.trial082.stdout:263: expect (ObjNum 115 snap 25 seq_num 115) 2026-02-12T17:29:31.615 INFO:tasks.rados.rados.0.trial082.stdout:265: expect (ObjNum 14 snap 0 seq_num 14) 2026-02-12T17:29:31.620 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1265246 2026-02-12T17:29:31.640 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 389594 2026-02-12T17:29:32.505 INFO:tasks.rados.rados.0.trial082.stdout:261: done (4 left) 2026-02-12T17:29:32.505 INFO:tasks.rados.rados.0.trial082.stdout:262: done (3 left) 2026-02-12T17:29:32.506 INFO:tasks.rados.rados.0.trial082.stdout:263: done (2 left) 2026-02-12T17:29:32.506 INFO:tasks.rados.rados.0.trial082.stdout:265: done (1 left) 2026-02-12T17:29:32.506 INFO:tasks.rados.rados.0.trial082.stdout:266: done (0 left) 2026-02-12T17:29:32.506 INFO:tasks.rados.rados.0.trial082.stdout:267: read oid 23 snap -1 2026-02-12T17:29:32.506 INFO:tasks.rados.rados.0.trial082.stdout:267: expect deleted 2026-02-12T17:29:32.506 INFO:tasks.rados.rados.0.trial082.stdout:268: write oid 28 current snap is 27 2026-02-12T17:29:32.506 INFO:tasks.rados.rados.0.trial082.stdout:268: seq_num 119 ranges {400033=699926,1614063=385970} 2026-02-12T17:29:32.510 INFO:tasks.rados.rados.0.trial082.stdout:268: writing trial08226312-28 from 400033 to 1099959 tid 1 2026-02-12T17:29:32.514 INFO:tasks.rados.rados.0.trial082.stdout:268: writing trial08226312-28 from 1614063 to 2000033 tid 2 2026-02-12T17:29:32.514 INFO:tasks.rados.rados.0.trial082.stdout:269: copy_from oid 36 from oid 19 current snap is 27 2026-02-12T17:29:32.514 INFO:tasks.rados.rados.0.trial082.stdout:268: finishing write tid 1 to trial08226312-28 2026-02-12T17:29:32.514 INFO:tasks.rados.rados.0.trial082.stdout:267: done (2 left) 2026-02-12T17:29:32.514 INFO:tasks.rados.rados.0.trial082.stdout:270: read oid 7 snap -1 2026-02-12T17:29:32.514 INFO:tasks.rados.rados.0.trial082.stdout:270: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-12T17:29:32.514 INFO:tasks.rados.rados.0.trial082.stdout:271: read oid 10 snap -1 2026-02-12T17:29:32.514 INFO:tasks.rados.rados.0.trial082.stdout:271: expect (ObjNum 108 snap 21 seq_num 108) 2026-02-12T17:29:32.515 INFO:tasks.rados.rados.0.trial082.stdout:272: write (excl) oid 20 current snap is 27 2026-02-12T17:29:32.515 INFO:tasks.rados.rados.0.trial082.stdout:272: seq_num 120 ranges {416840=775175,1672545=344295} 2026-02-12T17:29:32.518 INFO:tasks.rados.rados.0.trial082.stdout:272: writing trial08226312-20 from 416840 to 1192015 tid 1 2026-02-12T17:29:32.521 INFO:tasks.rados.rados.0.trial082.stdout:272: writing trial08226312-20 from 1672545 to 2016840 tid 2 2026-02-12T17:29:32.521 INFO:tasks.rados.rados.0.trial082.stdout:273: delete oid 23 current snap is 27 2026-02-12T17:29:32.521 INFO:tasks.rados.rados.0.trial082.stdout:268: finishing write tid 2 to trial08226312-28 2026-02-12T17:29:32.522 INFO:tasks.rados.rados.0.trial082.stdout:268: finishing write tid 3 to trial08226312-28 2026-02-12T17:29:32.522 INFO:tasks.rados.rados.0.trial082.stdout:268: finishing write tid 4 to trial08226312-28 2026-02-12T17:29:32.522 INFO:tasks.rados.rados.0.trial082.stdout:268: oid 28 updating version 0 to 141 2026-02-12T17:29:32.522 INFO:tasks.rados.rados.0.trial082.stdout:268: oid 28 version 141 is already newer than 139 2026-02-12T17:29:32.522 INFO:tasks.rados.rados.0.trial082.stdout:268: oid 28 version 141 is already newer than 140 2026-02-12T17:29:32.522 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 141 (ObjNum 119 snap 27 seq_num 119) dirty exists 2026-02-12T17:29:32.522 INFO:tasks.rados.rados.0.trial082.stdout:268: left oid 28 (ObjNum 119 snap 27 seq_num 119) 2026-02-12T17:29:32.522 INFO:tasks.rados.rados.0.trial082.stdout:271: expect (ObjNum 108 snap 21 seq_num 108) 2026-02-12T17:29:32.522 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 155771 2026-02-12T17:29:32.627 INFO:tasks.rados.rados.0.trial082.stdout:270: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-12T17:29:32.629 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1750511 2026-02-12T17:29:32.639 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 338972 2026-02-12T17:29:32.657 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:32.678 INFO:tasks.rados.rados.0.trial082.stdout:272: finishing write tid 1 to trial08226312-20 2026-02-12T17:29:32.678 INFO:tasks.rados.rados.0.trial082.stdout:269: finishing copy_from racing read to trial08226312-36 2026-02-12T17:29:32.678 INFO:tasks.rados.rados.0.trial082.stdout:272: finishing write tid 2 to trial08226312-20 2026-02-12T17:29:32.678 INFO:tasks.rados.rados.0.trial082.stdout:272: finishing write tid 3 to trial08226312-20 2026-02-12T17:29:32.678 INFO:tasks.rados.rados.0.trial082.stdout:272: finishing write tid 4 to trial08226312-20 2026-02-12T17:29:32.678 INFO:tasks.rados.rados.0.trial082.stdout:272: oid 20 updating version 0 to 201 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:272: oid 20 updating version 201 to 203 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:272: oid 20 version 203 is already newer than 202 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 203 (ObjNum 120 snap 27 seq_num 120) dirty exists 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:272: left oid 20 (ObjNum 120 snap 27 seq_num 120) 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:269: finishing copy_from to trial08226312-36 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 157 (ObjNum 110 snap 21 seq_num 110) dirty exists 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:268: done (5 left) 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:269: done (4 left) 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:270: done (3 left) 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:271: done (2 left) 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:272: done (1 left) 2026-02-12T17:29:32.679 INFO:tasks.rados.rados.0.trial082.stdout:273: done (0 left) 2026-02-12T17:29:32.680 INFO:tasks.rados.rados.0.trial082.stdout:274: read oid 16 snap -1 2026-02-12T17:29:32.680 INFO:tasks.rados.rados.0.trial082.stdout:274: expect (ObjNum 111 snap 22 seq_num 111) 2026-02-12T17:29:32.680 INFO:tasks.rados.rados.0.trial082.stdout:275: snap_create 2026-02-12T17:29:32.681 INFO:tasks.rados.rados.0.trial082.stdout:274: expect (ObjNum 111 snap 22 seq_num 111) 2026-02-12T17:29:32.728 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2302473 2026-02-12T17:29:32.756 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1907835 2026-02-12T17:29:33.480 INFO:tasks.rados.rados.0.trial082.stdout:274: done (1 left) 2026-02-12T17:29:33.480 INFO:tasks.rados.rados.0.trial082.stdout:275: done (0 left) 2026-02-12T17:29:33.481 INFO:tasks.rados.rados.0.trial082.stdout:276: snap_remove snap 20 2026-02-12T17:29:34.485 INFO:tasks.rados.rados.0.trial082.stdout:276: done (0 left) 2026-02-12T17:29:34.485 INFO:tasks.rados.rados.0.trial082.stdout:277: read oid 11 snap -1 2026-02-12T17:29:34.485 INFO:tasks.rados.rados.0.trial082.stdout:277: expect (ObjNum 103 snap 20 seq_num 103) 2026-02-12T17:29:34.485 INFO:tasks.rados.rados.0.trial082.stdout:278: read oid 48 snap -1 2026-02-12T17:29:34.485 INFO:tasks.rados.rados.0.trial082.stdout:278: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-12T17:29:34.485 INFO:tasks.rados.rados.0.trial082.stdout:279: read oid 29 snap -1 2026-02-12T17:29:34.486 INFO:tasks.rados.rados.0.trial082.stdout:279: expect deleted 2026-02-12T17:29:34.486 INFO:tasks.rados.rados.0.trial082.stdout:280: write oid 38 current snap is 28 2026-02-12T17:29:34.486 INFO:tasks.rados.rados.0.trial082.stdout:280: seq_num 122 ranges {450454=642026,1505862=544592} 2026-02-12T17:29:34.489 INFO:tasks.rados.rados.0.trial082.stdout:280: writing trial08226312-38 from 450454 to 1092480 tid 1 2026-02-12T17:29:34.492 INFO:tasks.rados.rados.0.trial082.stdout:280: writing trial08226312-38 from 1505862 to 2050454 tid 2 2026-02-12T17:29:34.493 INFO:tasks.rados.rados.0.trial082.stdout:281: write (excl) oid 33 current snap is 28 2026-02-12T17:29:34.493 INFO:tasks.rados.rados.0.trial082.stdout:281: seq_num 123 ranges {467261=717275,1847991=219270} 2026-02-12T17:29:34.496 INFO:tasks.rados.rados.0.trial082.stdout:281: writing trial08226312-33 from 467261 to 1184536 tid 1 2026-02-12T17:29:34.500 INFO:tasks.rados.rados.0.trial082.stdout:281: writing trial08226312-33 from 1847991 to 2067261 tid 2 2026-02-12T17:29:34.500 INFO:tasks.rados.rados.0.trial082.stdout:282: write oid 18 current snap is 28 2026-02-12T17:29:34.500 INFO:tasks.rados.rados.0.trial082.stdout:282: seq_num 124 ranges {484068=792524,1906473=177595} 2026-02-12T17:29:34.505 INFO:tasks.rados.rados.0.trial082.stdout:282: writing trial08226312-18 from 484068 to 1276592 tid 1 2026-02-12T17:29:34.508 INFO:tasks.rados.rados.0.trial082.stdout:282: writing trial08226312-18 from 1906473 to 2084068 tid 2 2026-02-12T17:29:34.508 INFO:tasks.rados.rados.0.trial082.stdout:283: read oid 7 snap 17 2026-02-12T17:29:34.509 INFO:tasks.rados.rados.0.trial082.stdout:283: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-12T17:29:34.509 INFO:tasks.rados.rados.0.trial082.stdout:284: delete oid 3 current snap is 28 2026-02-12T17:29:34.509 INFO:tasks.rados.rados.0.trial082.stdout:278: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-12T17:29:34.534 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1006389 2026-02-12T17:29:34.545 INFO:tasks.rados.rados.0.trial082.stdout:277: expect (ObjNum 103 snap 20 seq_num 103) 2026-02-12T17:29:34.581 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:34.615 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:34.652 INFO:tasks.rados.rados.0.trial082.stdout:280: finishing write tid 1 to trial08226312-38 2026-02-12T17:29:34.652 INFO:tasks.rados.rados.0.trial082.stdout:280: finishing write tid 2 to trial08226312-38 2026-02-12T17:29:34.652 INFO:tasks.rados.rados.0.trial082.stdout:280: finishing write tid 3 to trial08226312-38 2026-02-12T17:29:34.652 INFO:tasks.rados.rados.0.trial082.stdout:280: finishing write tid 4 to trial08226312-38 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:280: oid 38 updating version 0 to 81 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:280: oid 38 version 81 is already newer than 79 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:280: oid 38 version 81 is already newer than 80 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 81 (ObjNum 122 snap 28 seq_num 122) dirty exists 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:280: left oid 38 (ObjNum 122 snap 28 seq_num 122) 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:281: finishing write tid 1 to trial08226312-33 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:277: done (7 left) 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:278: done (6 left) 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:279: done (5 left) 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:280: done (4 left) 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:284: done (3 left) 2026-02-12T17:29:34.653 INFO:tasks.rados.rados.0.trial082.stdout:285: read oid 3 snap -1 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:285: expect deleted 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:286: read oid 44 snap -1 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:286: expect (ObjNum 98 snap 20 seq_num 98) 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:287: read oid 32 snap -1 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:287: expect (ObjNum 50 snap 1 seq_num 50) 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:288: copy_from oid 31 from oid 42 current snap is 28 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:281: finishing write tid 2 to trial08226312-33 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:281: finishing write tid 3 to trial08226312-33 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:281: finishing write tid 4 to trial08226312-33 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:281: oid 33 updating version 0 to 80 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:281: oid 33 version 80 is already newer than 79 2026-02-12T17:29:34.654 INFO:tasks.rados.rados.0.trial082.stdout:281: oid 33 updating version 80 to 81 2026-02-12T17:29:34.655 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 81 (ObjNum 123 snap 28 seq_num 123) dirty exists 2026-02-12T17:29:34.655 INFO:tasks.rados.rados.0.trial082.stdout:281: left oid 33 (ObjNum 123 snap 28 seq_num 123) 2026-02-12T17:29:34.655 INFO:tasks.rados.rados.0.trial082.stdout:282: finishing write tid 1 to trial08226312-18 2026-02-12T17:29:34.655 INFO:tasks.rados.rados.0.trial082.stdout:281: done (6 left) 2026-02-12T17:29:34.655 INFO:tasks.rados.rados.0.trial082.stdout:289: read oid 40 snap 17 2026-02-12T17:29:34.655 INFO:tasks.rados.rados.0.trial082.stdout:289: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-12T17:29:34.655 INFO:tasks.rados.rados.0.trial082.stdout:290: write (excl) oid 19 current snap is 28 2026-02-12T17:29:34.655 INFO:tasks.rados.rados.0.trial082.stdout:282: finishing write tid 2 to trial08226312-18 2026-02-12T17:29:34.655 INFO:tasks.rados.rados.0.trial082.stdout:290: seq_num 126 ranges {517682=543022,1623437=494245} 2026-02-12T17:29:34.656 INFO:tasks.rados.rados.0.trial082.stdout:290: writing trial08226312-19 from 517682 to 1060704 tid 1 2026-02-12T17:29:34.659 INFO:tasks.rados.rados.0.trial082.stdout:290: writing trial08226312-19 from 1623437 to 2117682 tid 2 2026-02-12T17:29:34.659 INFO:tasks.rados.rados.0.trial082.stdout:291: write (excl) oid 39 current snap is 28 2026-02-12T17:29:34.659 INFO:tasks.rados.rados.0.trial082.stdout:291: seq_num 127 ranges {534489=618271,1565566=568923} 2026-02-12T17:29:34.663 INFO:tasks.rados.rados.0.trial082.stdout:291: writing trial08226312-39 from 534489 to 1152760 tid 1 2026-02-12T17:29:34.668 INFO:tasks.rados.rados.0.trial082.stdout:291: writing trial08226312-39 from 1565566 to 2134489 tid 2 2026-02-12T17:29:34.668 INFO:tasks.rados.rados.0.trial082.stdout:292: snap_create 2026-02-12T17:29:34.668 INFO:tasks.rados.rados.0.trial082.stdout:282: finishing write tid 3 to trial08226312-18 2026-02-12T17:29:34.668 INFO:tasks.rados.rados.0.trial082.stdout:282: finishing write tid 4 to trial08226312-18 2026-02-12T17:29:34.668 INFO:tasks.rados.rados.0.trial082.stdout:282: oid 18 updating version 0 to 82 2026-02-12T17:29:34.668 INFO:tasks.rados.rados.0.trial082.stdout:282: oid 18 updating version 82 to 83 2026-02-12T17:29:34.668 INFO:tasks.rados.rados.0.trial082.stdout:282: oid 18 updating version 83 to 84 2026-02-12T17:29:34.668 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 84 (ObjNum 124 snap 28 seq_num 124) dirty exists 2026-02-12T17:29:34.669 INFO:tasks.rados.rados.0.trial082.stdout:282: left oid 18 (ObjNum 124 snap 28 seq_num 124) 2026-02-12T17:29:34.669 INFO:tasks.rados.rados.0.trial082.stdout:283: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-12T17:29:34.669 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 159453 2026-02-12T17:29:34.686 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:34.705 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 510682 2026-02-12T17:29:34.722 INFO:tasks.rados.rados.0.trial082.stdout:286: expect (ObjNum 98 snap 20 seq_num 98) 2026-02-12T17:29:34.757 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:34.792 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:34.827 INFO:tasks.rados.rados.0.trial082.stdout:289: expect (ObjNum 39 snap 0 seq_num 39) 2026-02-12T17:29:34.846 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:34.873 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2284603 2026-02-12T17:29:34.875 INFO:tasks.rados.rados.0.trial082.stdout:290: finishing write tid 1 to trial08226312-19 2026-02-12T17:29:34.875 INFO:tasks.rados.rados.0.trial082.stdout:290: finishing write tid 2 to trial08226312-19 2026-02-12T17:29:34.875 INFO:tasks.rados.rados.0.trial082.stdout:290: finishing write tid 3 to trial08226312-19 2026-02-12T17:29:34.875 INFO:tasks.rados.rados.0.trial082.stdout:290: finishing write tid 4 to trial08226312-19 2026-02-12T17:29:34.875 INFO:tasks.rados.rados.0.trial082.stdout:290: oid 19 updating version 0 to 213 2026-02-12T17:29:34.876 INFO:tasks.rados.rados.0.trial082.stdout:290: oid 19 version 213 is already newer than 212 2026-02-12T17:29:34.876 INFO:tasks.rados.rados.0.trial082.stdout:290: oid 19 version 213 is already newer than 211 2026-02-12T17:29:34.876 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 213 (ObjNum 126 snap 28 seq_num 126) dirty exists 2026-02-12T17:29:34.876 INFO:tasks.rados.rados.0.trial082.stdout:290: left oid 19 (ObjNum 126 snap 28 seq_num 126) 2026-02-12T17:29:34.876 INFO:tasks.rados.rados.0.trial082.stdout:288: finishing copy_from racing read to trial08226312-31 2026-02-12T17:29:34.876 INFO:tasks.rados.rados.0.trial082.stdout:288: finishing copy_from to trial08226312-31 2026-02-12T17:29:34.876 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 104 (ObjNum 100 snap 20 seq_num 100) dirty exists 2026-02-12T17:29:34.876 INFO:tasks.rados.rados.0.trial082.stdout:287: expect (ObjNum 50 snap 1 seq_num 50) 2026-02-12T17:29:34.906 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 931812 2026-02-12T17:29:34.924 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 212175 2026-02-12T17:29:34.949 INFO:tasks.rados.rados.0.trial082.stdout:291: finishing write tid 1 to trial08226312-39 2026-02-12T17:29:34.949 INFO:tasks.rados.rados.0.trial082.stdout:291: finishing write tid 2 to trial08226312-39 2026-02-12T17:29:34.949 INFO:tasks.rados.rados.0.trial082.stdout:291: finishing write tid 3 to trial08226312-39 2026-02-12T17:29:34.949 INFO:tasks.rados.rados.0.trial082.stdout:291: finishing write tid 4 to trial08226312-39 2026-02-12T17:29:34.949 INFO:tasks.rados.rados.0.trial082.stdout:291: oid 39 updating version 0 to 61 2026-02-12T17:29:34.949 INFO:tasks.rados.rados.0.trial082.stdout:291: oid 39 updating version 61 to 62 2026-02-12T17:29:34.949 INFO:tasks.rados.rados.0.trial082.stdout:291: oid 39 version 62 is already newer than 60 2026-02-12T17:29:34.949 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 62 (ObjNum 127 snap 28 seq_num 127) dirty exists 2026-02-12T17:29:34.949 INFO:tasks.rados.rados.0.trial082.stdout:291: left oid 39 (ObjNum 127 snap 28 seq_num 127) 2026-02-12T17:29:35.508 INFO:tasks.rados.rados.0.trial082.stdout:282: done (9 left) 2026-02-12T17:29:35.508 INFO:tasks.rados.rados.0.trial082.stdout:283: done (8 left) 2026-02-12T17:29:35.508 INFO:tasks.rados.rados.0.trial082.stdout:285: done (7 left) 2026-02-12T17:29:35.508 INFO:tasks.rados.rados.0.trial082.stdout:286: done (6 left) 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:287: done (5 left) 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:288: done (4 left) 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:289: done (3 left) 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:290: done (2 left) 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:291: done (1 left) 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:292: done (0 left) 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:293: read oid 44 snap -1 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:293: expect (ObjNum 98 snap 20 seq_num 98) 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:294: write (excl) oid 3 current snap is 29 2026-02-12T17:29:35.509 INFO:tasks.rados.rados.0.trial082.stdout:294: seq_num 128 ranges {551296=693520,2024048=127248} 2026-02-12T17:29:35.512 INFO:tasks.rados.rados.0.trial082.stdout:294: writing trial08226312-3 from 551296 to 1244816 tid 1 2026-02-12T17:29:35.516 INFO:tasks.rados.rados.0.trial082.stdout:294: writing trial08226312-3 from 2024048 to 2151296 tid 2 2026-02-12T17:29:35.516 INFO:tasks.rados.rados.0.trial082.stdout:295: write oid 31 current snap is 29 2026-02-12T17:29:35.516 INFO:tasks.rados.rados.0.trial082.stdout:295: seq_num 129 ranges {568103=768769,2082530=85573} 2026-02-12T17:29:35.520 INFO:tasks.rados.rados.0.trial082.stdout:295: writing trial08226312-31 from 568103 to 1336872 tid 1 2026-02-12T17:29:35.524 INFO:tasks.rados.rados.0.trial082.stdout:295: writing trial08226312-31 from 2082530 to 2168103 tid 2 2026-02-12T17:29:35.524 INFO:tasks.rados.rados.0.trial082.stdout:296: write oid 14 current snap is 29 2026-02-12T17:29:35.524 INFO:tasks.rados.rados.0.trial082.stdout:296: seq_num 130 ranges {584910=560371,1857365=327545} 2026-02-12T17:29:35.528 INFO:tasks.rados.rados.0.trial082.stdout:296: writing trial08226312-14 from 584910 to 1145281 tid 1 2026-02-12T17:29:35.532 INFO:tasks.rados.rados.0.trial082.stdout:296: writing trial08226312-14 from 1857365 to 2184910 tid 2 2026-02-12T17:29:35.532 INFO:tasks.rados.rados.0.trial082.stdout:297: read oid 28 snap -1 2026-02-12T17:29:35.532 INFO:tasks.rados.rados.0.trial082.stdout:297: expect (ObjNum 119 snap 27 seq_num 119) 2026-02-12T17:29:35.532 INFO:tasks.rados.rados.0.trial082.stdout:298: snap_remove snap 28 2026-02-12T17:29:36.511 INFO:tasks.rados.rados.0.trial082.stdout:298: done (5 left) 2026-02-12T17:29:36.512 INFO:tasks.rados.rados.0.trial082.stdout:299: copy_from oid 35 from oid 17 current snap is 29 2026-02-12T17:29:36.512 INFO:tasks.rados.rados.0.trial082.stdout:293: expect (ObjNum 98 snap 20 seq_num 98) 2026-02-12T17:29:36.580 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1818560 2026-02-12T17:29:36.601 INFO:tasks.rados.rados.0.trial082.stdout:294: finishing write tid 1 to trial08226312-3 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:294: finishing write tid 2 to trial08226312-3 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:294: finishing write tid 3 to trial08226312-3 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:294: finishing write tid 4 to trial08226312-3 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:294: oid 3 updating version 0 to 87 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:294: oid 3 updating version 87 to 89 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:294: oid 3 version 89 is already newer than 88 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 89 (ObjNum 128 snap 29 seq_num 128) dirty exists 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:294: left oid 3 (ObjNum 128 snap 29 seq_num 128) 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:295: finishing write tid 1 to trial08226312-31 2026-02-12T17:29:36.602 INFO:tasks.rados.rados.0.trial082.stdout:293: done (5 left) 2026-02-12T17:29:36.603 INFO:tasks.rados.rados.0.trial082.stdout:294: done (4 left) 2026-02-12T17:29:36.603 INFO:tasks.rados.rados.0.trial082.stdout:300: write oid 42 current snap is 29 2026-02-12T17:29:36.603 INFO:tasks.rados.rados.0.trial082.stdout:295: finishing write tid 2 to trial08226312-31 2026-02-12T17:29:36.603 INFO:tasks.rados.rados.0.trial082.stdout:295: finishing write tid 3 to trial08226312-31 2026-02-12T17:29:36.603 INFO:tasks.rados.rados.0.trial082.stdout:300: seq_num 131 ranges {601717=635620,1799494=402223} 2026-02-12T17:29:36.606 INFO:tasks.rados.rados.0.trial082.stdout:300: writing trial08226312-42 from 601717 to 1237337 tid 1 2026-02-12T17:29:36.610 INFO:tasks.rados.rados.0.trial082.stdout:300: writing trial08226312-42 from 1799494 to 2201717 tid 2 2026-02-12T17:29:36.610 INFO:tasks.rados.rados.0.trial082.stdout:301: snap_create 2026-02-12T17:29:36.610 INFO:tasks.rados.rados.0.trial082.stdout:295: finishing write tid 4 to trial08226312-31 2026-02-12T17:29:36.610 INFO:tasks.rados.rados.0.trial082.stdout:295: oid 31 updating version 0 to 107 2026-02-12T17:29:36.610 INFO:tasks.rados.rados.0.trial082.stdout:295: oid 31 version 107 is already newer than 105 2026-02-12T17:29:36.610 INFO:tasks.rados.rados.0.trial082.stdout:295: oid 31 version 107 is already newer than 106 2026-02-12T17:29:36.610 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 107 (ObjNum 129 snap 29 seq_num 129) dirty exists 2026-02-12T17:29:36.610 INFO:tasks.rados.rados.0.trial082.stdout:295: left oid 31 (ObjNum 129 snap 29 seq_num 129) 2026-02-12T17:29:36.610 INFO:tasks.rados.rados.0.trial082.stdout:296: finishing write tid 1 to trial08226312-14 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:296: finishing write tid 2 to trial08226312-14 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:296: finishing write tid 3 to trial08226312-14 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:296: finishing write tid 4 to trial08226312-14 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:296: oid 14 updating version 0 to 91 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:296: oid 14 updating version 91 to 92 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:296: oid 14 version 92 is already newer than 90 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 92 (ObjNum 130 snap 29 seq_num 130) dirty exists 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:296: left oid 14 (ObjNum 130 snap 29 seq_num 130) 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:297: expect (ObjNum 119 snap 27 seq_num 119) 2026-02-12T17:29:36.611 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:36.644 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:36.662 INFO:tasks.rados.rados.0.trial082.stdout:299: finishing copy_from racing read to trial08226312-35 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:299: finishing copy_from to trial08226312-35 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 51 (ObjNum 65 snap 8 seq_num 65) dirty exists 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:300: finishing write tid 1 to trial08226312-42 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:300: finishing write tid 2 to trial08226312-42 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:300: finishing write tid 3 to trial08226312-42 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:300: finishing write tid 4 to trial08226312-42 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:300: oid 42 updating version 0 to 147 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:300: oid 42 updating version 147 to 148 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:300: oid 42 updating version 148 to 149 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 149 (ObjNum 131 snap 29 seq_num 131) dirty exists 2026-02-12T17:29:36.663 INFO:tasks.rados.rados.0.trial082.stdout:300: left oid 42 (ObjNum 131 snap 29 seq_num 131) 2026-02-12T17:29:37.515 INFO:tasks.rados.rados.0.trial082.stdout:295: done (5 left) 2026-02-12T17:29:37.515 INFO:tasks.rados.rados.0.trial082.stdout:296: done (4 left) 2026-02-12T17:29:37.515 INFO:tasks.rados.rados.0.trial082.stdout:297: done (3 left) 2026-02-12T17:29:37.515 INFO:tasks.rados.rados.0.trial082.stdout:299: done (2 left) 2026-02-12T17:29:37.515 INFO:tasks.rados.rados.0.trial082.stdout:300: done (1 left) 2026-02-12T17:29:37.515 INFO:tasks.rados.rados.0.trial082.stdout:301: done (0 left) 2026-02-12T17:29:37.515 INFO:tasks.rados.rados.0.trial082.stdout:302: snap_create 2026-02-12T17:29:38.480 INFO:tasks.rados.rados.0.trial082.stdout:302: done (0 left) 2026-02-12T17:29:38.480 INFO:tasks.rados.rados.0.trial082.stdout:303: delete oid 29 current snap is 31 2026-02-12T17:29:38.481 INFO:tasks.rados.rados.0.trial082.stdout:303: done (0 left) 2026-02-12T17:29:38.481 INFO:tasks.rados.rados.0.trial082.stdout:304: write (excl) oid 23 current snap is 31 2026-02-12T17:29:38.481 INFO:tasks.rados.rados.0.trial082.stdout:304: seq_num 133 ranges {635331=786118,1916458=318873} 2026-02-12T17:29:38.486 INFO:tasks.rados.rados.0.trial082.stdout:304: writing trial08226312-23 from 635331 to 1421449 tid 1 2026-02-12T17:29:38.489 INFO:tasks.rados.rados.0.trial082.stdout:304: writing trial08226312-23 from 1916458 to 2235331 tid 2 2026-02-12T17:29:38.489 INFO:tasks.rados.rados.0.trial082.stdout:305: write (excl) oid 7 current snap is 31 2026-02-12T17:29:38.490 INFO:tasks.rados.rados.0.trial082.stdout:305: seq_num 134 ranges {652138=461367,1574940=677198} 2026-02-12T17:29:38.493 INFO:tasks.rados.rados.0.trial082.stdout:305: writing trial08226312-7 from 652138 to 1113505 tid 1 2026-02-12T17:29:38.498 INFO:tasks.rados.rados.0.trial082.stdout:305: writing trial08226312-7 from 1574940 to 2252138 tid 2 2026-02-12T17:29:38.498 INFO:tasks.rados.rados.0.trial082.stdout:306: snap_remove snap 17 2026-02-12T17:29:39.483 INFO:tasks.rados.rados.0.trial082.stdout:306: done (2 left) 2026-02-12T17:29:39.483 INFO:tasks.rados.rados.0.trial082.stdout:307: copy_from oid 13 from oid 31 current snap is 31 2026-02-12T17:29:39.483 INFO:tasks.rados.rados.0.trial082.stdout:304: finishing write tid 1 to trial08226312-23 2026-02-12T17:29:39.483 INFO:tasks.rados.rados.0.trial082.stdout:304: finishing write tid 2 to trial08226312-23 2026-02-12T17:29:39.483 INFO:tasks.rados.rados.0.trial082.stdout:304: finishing write tid 3 to trial08226312-23 2026-02-12T17:29:39.483 INFO:tasks.rados.rados.0.trial082.stdout:304: finishing write tid 4 to trial08226312-23 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:304: oid 23 updating version 0 to 160 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:304: oid 23 version 160 is already newer than 158 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:304: oid 23 version 160 is already newer than 159 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 160 (ObjNum 133 snap 31 seq_num 133) dirty exists 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:304: left oid 23 (ObjNum 133 snap 31 seq_num 133) 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:305: finishing write tid 1 to trial08226312-7 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:305: finishing write tid 2 to trial08226312-7 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:305: finishing write tid 3 to trial08226312-7 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:304: done (2 left) 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:308: copy_from oid 50 from oid 22 current snap is 31 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:305: finishing write tid 4 to trial08226312-7 2026-02-12T17:29:39.484 INFO:tasks.rados.rados.0.trial082.stdout:305: oid 7 updating version 0 to 153 2026-02-12T17:29:39.485 INFO:tasks.rados.rados.0.trial082.stdout:305: oid 7 version 153 is already newer than 151 2026-02-12T17:29:39.485 INFO:tasks.rados.rados.0.trial082.stdout:305: oid 7 version 153 is already newer than 152 2026-02-12T17:29:39.485 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 153 (ObjNum 134 snap 31 seq_num 134) dirty exists 2026-02-12T17:29:39.485 INFO:tasks.rados.rados.0.trial082.stdout:305: left oid 7 (ObjNum 134 snap 31 seq_num 134) 2026-02-12T17:29:39.485 INFO:tasks.rados.rados.0.trial082.stdout:305: done (2 left) 2026-02-12T17:29:39.485 INFO:tasks.rados.rados.0.trial082.stdout:309: copy_from oid 12 from oid 20 current snap is 31 2026-02-12T17:29:39.485 INFO:tasks.rados.rados.0.trial082.stdout:310: snap_create 2026-02-12T17:29:39.492 INFO:tasks.rados.rados.0.trial082.stdout:309: finishing copy_from racing read to trial08226312-12 2026-02-12T17:29:39.493 INFO:tasks.rados.rados.0.trial082.stdout:309: finishing copy_from to trial08226312-12 2026-02-12T17:29:39.493 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 203 (ObjNum 120 snap 27 seq_num 120) dirty exists 2026-02-12T17:29:39.493 INFO:tasks.rados.rados.0.trial082.stdout:307: finishing copy_from racing read to trial08226312-13 2026-02-12T17:29:39.495 INFO:tasks.rados.rados.0.trial082.stdout:307: finishing copy_from to trial08226312-13 2026-02-12T17:29:39.495 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 107 (ObjNum 129 snap 29 seq_num 129) dirty exists 2026-02-12T17:29:39.495 INFO:tasks.rados.rados.0.trial082.stdout:308: finishing copy_from racing read to trial08226312-50 2026-02-12T17:29:39.506 INFO:tasks.rados.rados.0.trial082.stdout:308: finishing copy_from to trial08226312-50 2026-02-12T17:29:39.506 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 23 (ObjNum 55 snap 1 seq_num 55) dirty exists 2026-02-12T17:29:40.483 INFO:tasks.rados.rados.0.trial082.stdout:307: done (3 left) 2026-02-12T17:29:40.483 INFO:tasks.rados.rados.0.trial082.stdout:308: done (2 left) 2026-02-12T17:29:40.483 INFO:tasks.rados.rados.0.trial082.stdout:309: done (1 left) 2026-02-12T17:29:40.484 INFO:tasks.rados.rados.0.trial082.stdout:310: done (0 left) 2026-02-12T17:29:40.484 INFO:tasks.rados.rados.0.trial082.stdout:311: snap_create 2026-02-12T17:29:41.484 INFO:tasks.rados.rados.0.trial082.stdout:311: done (0 left) 2026-02-12T17:29:41.484 INFO:tasks.rados.rados.0.trial082.stdout:312: rollback oid 1 current snap is 33 2026-02-12T17:29:41.484 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 32 2026-02-12T17:29:41.485 INFO:tasks.rados.rados.0.trial082.stdout:313: rollback oid 26 current snap is 33 2026-02-12T17:29:41.485 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 26 to 22 2026-02-12T17:29:41.485 INFO:tasks.rados.rados.0.trial082.stdout:314: rollback oid 18 current snap is 33 2026-02-12T17:29:41.485 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 21 2026-02-12T17:29:41.485 INFO:tasks.rados.rados.0.trial082.stdout:315: rollback oid 16 current snap is 33 2026-02-12T17:29:41.485 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 31 2026-02-12T17:29:41.485 INFO:tasks.rados.rados.0.trial082.stdout:316: write (excl) oid 24 current snap is 33 2026-02-12T17:29:41.485 INFO:tasks.rados.rados.0.trial082.stdout:316: seq_num 135 ranges {668945=536616,1633422=491363} 2026-02-12T17:29:41.489 INFO:tasks.rados.rados.0.trial082.stdout:316: writing trial08226312-24 from 668945 to 1205561 tid 1 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:316: writing trial08226312-24 from 1633422 to 2124785 tid 2 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:317: delete oid 21 current snap is 33 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:312: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:313: finishing rollback tid 0 to trial08226312-26 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:313: finishing rollback tid 1 to trial08226312-26 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:313: finishing rollback tid 2 to trial08226312-26 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 163 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:315: finishing rollback tid 0 to trial08226312-16 2026-02-12T17:29:41.494 INFO:tasks.rados.rados.0.trial082.stdout:315: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:29:41.495 INFO:tasks.rados.rados.0.trial082.stdout:315: finishing rollback tid 2 to trial08226312-16 2026-02-12T17:29:41.495 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 163 (ObjNum 111 snap 22 seq_num 111) dirty exists 2026-02-12T17:29:41.495 INFO:tasks.rados.rados.0.trial082.stdout:314: finishing rollback tid 0 to trial08226312-18 2026-02-12T17:29:41.495 INFO:tasks.rados.rados.0.trial082.stdout:314: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:29:41.495 INFO:tasks.rados.rados.0.trial082.stdout:314: finishing rollback tid 2 to trial08226312-18 2026-02-12T17:29:41.495 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 90 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-12T17:29:41.495 INFO:tasks.rados.rados.0.trial082.stdout:316: finishing write tid 1 to trial08226312-24 2026-02-12T17:29:41.496 INFO:tasks.rados.rados.0.trial082.stdout:312: done (5 left) 2026-02-12T17:29:41.496 INFO:tasks.rados.rados.0.trial082.stdout:313: done (4 left) 2026-02-12T17:29:41.496 INFO:tasks.rados.rados.0.trial082.stdout:314: done (3 left) 2026-02-12T17:29:41.496 INFO:tasks.rados.rados.0.trial082.stdout:315: done (2 left) 2026-02-12T17:29:41.496 INFO:tasks.rados.rados.0.trial082.stdout:317: done (1 left) 2026-02-12T17:29:41.496 INFO:tasks.rados.rados.0.trial082.stdout:318: read oid 39 snap -1 2026-02-12T17:29:41.496 INFO:tasks.rados.rados.0.trial082.stdout:318: expect (ObjNum 127 snap 28 seq_num 127) 2026-02-12T17:29:41.497 INFO:tasks.rados.rados.0.trial082.stdout:319: snap_create 2026-02-12T17:29:41.497 INFO:tasks.rados.rados.0.trial082.stdout:318: expect (ObjNum 127 snap 28 seq_num 127) 2026-02-12T17:29:41.541 INFO:tasks.rados.rados.0.trial082.stdout:316: finishing write tid 2 to trial08226312-24 2026-02-12T17:29:41.541 INFO:tasks.rados.rados.0.trial082.stdout:316: finishing write tid 3 to trial08226312-24 2026-02-12T17:29:41.541 INFO:tasks.rados.rados.0.trial082.stdout:316: finishing write tid 4 to trial08226312-24 2026-02-12T17:29:41.541 INFO:tasks.rados.rados.0.trial082.stdout:316: oid 24 updating version 0 to 223 2026-02-12T17:29:41.541 INFO:tasks.rados.rados.0.trial082.stdout:316: oid 24 updating version 223 to 224 2026-02-12T17:29:41.541 INFO:tasks.rados.rados.0.trial082.stdout:316: oid 24 version 224 is already newer than 222 2026-02-12T17:29:41.542 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 224 (ObjNum 135 snap 33 seq_num 135) dirty exists 2026-02-12T17:29:41.542 INFO:tasks.rados.rados.0.trial082.stdout:316: left oid 24 (ObjNum 135 snap 33 seq_num 135) 2026-02-12T17:29:42.489 INFO:tasks.rados.rados.0.trial082.stdout:316: done (2 left) 2026-02-12T17:29:42.489 INFO:tasks.rados.rados.0.trial082.stdout:318: done (1 left) 2026-02-12T17:29:42.490 INFO:tasks.rados.rados.0.trial082.stdout:319: done (0 left) 2026-02-12T17:29:42.490 INFO:tasks.rados.rados.0.trial082.stdout:320: snap_remove snap 29 2026-02-12T17:29:43.489 INFO:tasks.rados.rados.0.trial082.stdout:320: done (0 left) 2026-02-12T17:29:43.489 INFO:tasks.rados.rados.0.trial082.stdout:321: delete oid 40 current snap is 34 2026-02-12T17:29:43.493 INFO:tasks.rados.rados.0.trial082.stdout:321: done (0 left) 2026-02-12T17:29:43.493 INFO:tasks.rados.rados.0.trial082.stdout:322: copy_from oid 6 from oid 1 current snap is 34 2026-02-12T17:29:43.493 INFO:tasks.rados.rados.0.trial082.stdout:323: copy_from oid 46 from oid 38 current snap is 34 2026-02-12T17:29:43.493 INFO:tasks.rados.rados.0.trial082.stdout:324: snap_remove snap 33 2026-02-12T17:29:44.495 INFO:tasks.rados.rados.0.trial082.stdout:324: done (2 left) 2026-02-12T17:29:44.495 INFO:tasks.rados.rados.0.trial082.stdout:325: snap_remove snap 23 2026-02-12T17:29:45.496 INFO:tasks.rados.rados.0.trial082.stdout:325: done (2 left) 2026-02-12T17:29:45.496 INFO:tasks.rados.rados.0.trial082.stdout:326: write oid 34 current snap is 34 2026-02-12T17:29:45.496 INFO:tasks.rados.rados.0.trial082.stdout:322: finishing copy_from to trial08226312-6 2026-02-12T17:29:45.496 INFO:tasks.rados.rados.0.trial082.stdout:322: got expected ENOENT (src dne) 2026-02-12T17:29:45.496 INFO:tasks.rados.rados.0.trial082.stdout:322: finishing copy_from racing read to trial08226312-6 2026-02-12T17:29:45.496 INFO:tasks.rados.rados.0.trial082.stdout:323: finishing copy_from racing read to trial08226312-46 2026-02-12T17:29:45.496 INFO:tasks.rados.rados.0.trial082.stdout:326: seq_num 138 ranges {719366=478716,1808868=510498} 2026-02-12T17:29:45.501 INFO:tasks.rados.rados.0.trial082.stdout:326: writing trial08226312-34 from 719366 to 1198082 tid 1 2026-02-12T17:29:45.506 INFO:tasks.rados.rados.0.trial082.stdout:326: writing trial08226312-34 from 1808868 to 2319366 tid 2 2026-02-12T17:29:45.506 INFO:tasks.rados.rados.0.trial082.stdout:322: done (2 left) 2026-02-12T17:29:45.506 INFO:tasks.rados.rados.0.trial082.stdout:327: read oid 10 snap -1 2026-02-12T17:29:45.506 INFO:tasks.rados.rados.0.trial082.stdout:327: expect (ObjNum 108 snap 21 seq_num 108) 2026-02-12T17:29:45.506 INFO:tasks.rados.rados.0.trial082.stdout:328: read oid 16 snap -1 2026-02-12T17:29:45.506 INFO:tasks.rados.rados.0.trial082.stdout:328: expect (ObjNum 111 snap 22 seq_num 111) 2026-02-12T17:29:45.506 INFO:tasks.rados.rados.0.trial082.stdout:329: delete oid 48 current snap is 34 2026-02-12T17:29:45.506 INFO:tasks.rados.rados.0.trial082.stdout:323: finishing copy_from to trial08226312-46 2026-02-12T17:29:45.507 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 81 (ObjNum 122 snap 28 seq_num 122) dirty exists 2026-02-12T17:29:45.507 INFO:tasks.rados.rados.0.trial082.stdout:326: finishing write tid 1 to trial08226312-34 2026-02-12T17:29:45.508 INFO:tasks.rados.rados.0.trial082.stdout:326: finishing write tid 2 to trial08226312-34 2026-02-12T17:29:45.508 INFO:tasks.rados.rados.0.trial082.stdout:326: finishing write tid 3 to trial08226312-34 2026-02-12T17:29:45.508 INFO:tasks.rados.rados.0.trial082.stdout:323: done (4 left) 2026-02-12T17:29:45.508 INFO:tasks.rados.rados.0.trial082.stdout:329: done (3 left) 2026-02-12T17:29:45.508 INFO:tasks.rados.rados.0.trial082.stdout:330: write (excl) oid 30 current snap is 34 2026-02-12T17:29:45.508 INFO:tasks.rados.rados.0.trial082.stdout:330: seq_num 140 ranges {752980=629214,1809479=543501} 2026-02-12T17:29:45.513 INFO:tasks.rados.rados.0.trial082.stdout:330: writing trial08226312-30 from 752980 to 1382194 tid 1 2026-02-12T17:29:45.517 INFO:tasks.rados.rados.0.trial082.stdout:330: writing trial08226312-30 from 1809479 to 2352980 tid 2 2026-02-12T17:29:45.517 INFO:tasks.rados.rados.0.trial082.stdout:331: write (excl) oid 14 current snap is 34 2026-02-12T17:29:45.517 INFO:tasks.rados.rados.0.trial082.stdout:331: seq_num 141 ranges {769787=704463,2267961=101826} 2026-02-12T17:29:45.522 INFO:tasks.rados.rados.0.trial082.stdout:331: writing trial08226312-14 from 769787 to 1474250 tid 1 2026-02-12T17:29:45.526 INFO:tasks.rados.rados.0.trial082.stdout:331: writing trial08226312-14 from 2267961 to 2369787 tid 2 2026-02-12T17:29:45.526 INFO:tasks.rados.rados.0.trial082.stdout:332: snap_remove snap 22 2026-02-12T17:29:46.500 INFO:tasks.rados.rados.0.trial082.stdout:332: done (5 left) 2026-02-12T17:29:46.501 INFO:tasks.rados.rados.0.trial082.stdout:333: copy_from oid 25 from oid 15 current snap is 34 2026-02-12T17:29:46.501 INFO:tasks.rados.rados.0.trial082.stdout:326: finishing write tid 4 to trial08226312-34 2026-02-12T17:29:46.501 INFO:tasks.rados.rados.0.trial082.stdout:326: oid 34 updating version 0 to 93 2026-02-12T17:29:46.501 INFO:tasks.rados.rados.0.trial082.stdout:326: oid 34 updating version 93 to 95 2026-02-12T17:29:46.501 INFO:tasks.rados.rados.0.trial082.stdout:326: oid 34 version 95 is already newer than 94 2026-02-12T17:29:46.501 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 95 (ObjNum 138 snap 34 seq_num 138) dirty exists 2026-02-12T17:29:46.501 INFO:tasks.rados.rados.0.trial082.stdout:326: left oid 34 (ObjNum 138 snap 34 seq_num 138) 2026-02-12T17:29:46.501 INFO:tasks.rados.rados.0.trial082.stdout:328: expect (ObjNum 111 snap 22 seq_num 111) 2026-02-12T17:29:46.542 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:46.582 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:46.621 INFO:tasks.rados.rados.0.trial082.stdout:327: expect (ObjNum 108 snap 21 seq_num 108) 2026-02-12T17:29:46.637 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2217983 2026-02-12T17:29:46.654 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 324486 2026-02-12T17:29:46.733 INFO:tasks.rados.rados.0.trial082.stdout:330: finishing write tid 1 to trial08226312-30 2026-02-12T17:29:46.734 INFO:tasks.rados.rados.0.trial082.stdout:330: finishing write tid 2 to trial08226312-30 2026-02-12T17:29:46.734 INFO:tasks.rados.rados.0.trial082.stdout:330: finishing write tid 3 to trial08226312-30 2026-02-12T17:29:46.734 INFO:tasks.rados.rados.0.trial082.stdout:330: finishing write tid 4 to trial08226312-30 2026-02-12T17:29:46.734 INFO:tasks.rados.rados.0.trial082.stdout:330: oid 30 updating version 0 to 132 2026-02-12T17:29:46.734 INFO:tasks.rados.rados.0.trial082.stdout:330: oid 30 version 132 is already newer than 131 2026-02-12T17:29:46.734 INFO:tasks.rados.rados.0.trial082.stdout:330: oid 30 updating version 132 to 133 2026-02-12T17:29:46.734 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 133 (ObjNum 140 snap 34 seq_num 140) dirty exists 2026-02-12T17:29:46.734 INFO:tasks.rados.rados.0.trial082.stdout:330: left oid 30 (ObjNum 140 snap 34 seq_num 140) 2026-02-12T17:29:46.734 INFO:tasks.rados.rados.0.trial082.stdout:331: finishing write tid 1 to trial08226312-14 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:331: finishing write tid 2 to trial08226312-14 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:331: finishing write tid 3 to trial08226312-14 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:331: finishing write tid 4 to trial08226312-14 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:331: oid 14 updating version 0 to 102 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:331: oid 14 version 102 is already newer than 100 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:331: oid 14 version 102 is already newer than 101 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 102 (ObjNum 141 snap 34 seq_num 141) dirty exists 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:331: left oid 14 (ObjNum 141 snap 34 seq_num 141) 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:333: finishing copy_from racing read to trial08226312-25 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:333: finishing copy_from to trial08226312-25 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 16 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-12T17:29:46.735 INFO:tasks.rados.rados.0.trial082.stdout:326: done (5 left) 2026-02-12T17:29:46.736 INFO:tasks.rados.rados.0.trial082.stdout:327: done (4 left) 2026-02-12T17:29:46.736 INFO:tasks.rados.rados.0.trial082.stdout:328: done (3 left) 2026-02-12T17:29:46.736 INFO:tasks.rados.rados.0.trial082.stdout:330: done (2 left) 2026-02-12T17:29:46.736 INFO:tasks.rados.rados.0.trial082.stdout:331: done (1 left) 2026-02-12T17:29:46.736 INFO:tasks.rados.rados.0.trial082.stdout:333: done (0 left) 2026-02-12T17:29:46.736 INFO:tasks.rados.rados.0.trial082.stdout:334: copy_from oid 20 from oid 6 current snap is 34 2026-02-12T17:29:46.736 INFO:tasks.rados.rados.0.trial082.stdout:335: snap_create 2026-02-12T17:29:46.738 INFO:tasks.rados.rados.0.trial082.stdout:334: finishing copy_from to trial08226312-20 2026-02-12T17:29:46.738 INFO:tasks.rados.rados.0.trial082.stdout:334: got expected ENOENT (src dne) 2026-02-12T17:29:46.738 INFO:tasks.rados.rados.0.trial082.stdout:334: finishing copy_from racing read to trial08226312-20 2026-02-12T17:29:47.500 INFO:tasks.rados.rados.0.trial082.stdout:334: done (1 left) 2026-02-12T17:29:47.501 INFO:tasks.rados.rados.0.trial082.stdout:335: done (0 left) 2026-02-12T17:29:47.501 INFO:tasks.rados.rados.0.trial082.stdout:336: delete oid 46 current snap is 35 2026-02-12T17:29:47.505 INFO:tasks.rados.rados.0.trial082.stdout:336: done (0 left) 2026-02-12T17:29:47.505 INFO:tasks.rados.rados.0.trial082.stdout:337: copy_from oid 23 from oid 7 current snap is 35 2026-02-12T17:29:47.505 INFO:tasks.rados.rados.0.trial082.stdout:338: read oid 10 snap -1 2026-02-12T17:29:47.505 INFO:tasks.rados.rados.0.trial082.stdout:338: expect (ObjNum 108 snap 21 seq_num 108) 2026-02-12T17:29:47.505 INFO:tasks.rados.rados.0.trial082.stdout:339: snap_remove snap 34 2026-02-12T17:29:48.482 INFO:tasks.rados.rados.0.trial082.stdout:339: done (2 left) 2026-02-12T17:29:48.482 INFO:tasks.rados.rados.0.trial082.stdout:340: delete oid 12 current snap is 35 2026-02-12T17:29:48.482 INFO:tasks.rados.rados.0.trial082.stdout:338: expect (ObjNum 108 snap 21 seq_num 108) 2026-02-12T17:29:48.522 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:48.561 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:48.601 INFO:tasks.rados.rados.0.trial082.stdout:337: finishing copy_from racing read to trial08226312-23 2026-02-12T17:29:48.602 INFO:tasks.rados.rados.0.trial082.stdout:337: finishing copy_from to trial08226312-23 2026-02-12T17:29:48.602 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 153 (ObjNum 134 snap 31 seq_num 134) dirty exists 2026-02-12T17:29:48.602 INFO:tasks.rados.rados.0.trial082.stdout:337: done (2 left) 2026-02-12T17:29:48.602 INFO:tasks.rados.rados.0.trial082.stdout:338: done (1 left) 2026-02-12T17:29:48.602 INFO:tasks.rados.rados.0.trial082.stdout:340: done (0 left) 2026-02-12T17:29:48.602 INFO:tasks.rados.rados.0.trial082.stdout:341: snap_create 2026-02-12T17:29:49.508 INFO:tasks.rados.rados.0.trial082.stdout:341: done (0 left) 2026-02-12T17:29:49.508 INFO:tasks.rados.rados.0.trial082.stdout:342: copy_from oid 10 from oid 9 current snap is 36 2026-02-12T17:29:49.508 INFO:tasks.rados.rados.0.trial082.stdout:343: write (excl) oid 29 current snap is 36 2026-02-12T17:29:49.508 INFO:tasks.rados.rados.0.trial082.stdout:343: seq_num 144 ranges {420208=530210,1527054=766050} 2026-02-12T17:29:49.512 INFO:tasks.rados.rados.0.trial082.stdout:343: writing trial08226312-29 from 420208 to 950418 tid 1 2026-02-12T17:29:49.517 INFO:tasks.rados.rados.0.trial082.stdout:343: writing trial08226312-29 from 1527054 to 2293104 tid 2 2026-02-12T17:29:49.517 INFO:tasks.rados.rados.0.trial082.stdout:344: snap_remove snap 26 2026-02-12T17:29:50.510 INFO:tasks.rados.rados.0.trial082.stdout:344: done (2 left) 2026-02-12T17:29:50.511 INFO:tasks.rados.rados.0.trial082.stdout:345: snap_remove snap 35 2026-02-12T17:29:51.513 INFO:tasks.rados.rados.0.trial082.stdout:345: done (2 left) 2026-02-12T17:29:51.513 INFO:tasks.rados.rados.0.trial082.stdout:346: rollback oid 31 current snap is 36 2026-02-12T17:29:51.513 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 31 to 27 2026-02-12T17:29:51.513 INFO:tasks.rados.rados.0.trial082.stdout:343: finishing write tid 1 to trial08226312-29 2026-02-12T17:29:51.513 INFO:tasks.rados.rados.0.trial082.stdout:343: finishing write tid 2 to trial08226312-29 2026-02-12T17:29:51.513 INFO:tasks.rados.rados.0.trial082.stdout:343: finishing write tid 3 to trial08226312-29 2026-02-12T17:29:51.513 INFO:tasks.rados.rados.0.trial082.stdout:343: finishing write tid 4 to trial08226312-29 2026-02-12T17:29:51.513 INFO:tasks.rados.rados.0.trial082.stdout:343: oid 29 updating version 0 to 41 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:343: oid 29 updating version 41 to 43 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:343: oid 29 version 43 is already newer than 42 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 43 (ObjNum 144 snap 36 seq_num 144) dirty exists 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:343: left oid 29 (ObjNum 144 snap 36 seq_num 144) 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:342: finishing copy_from racing read to trial08226312-10 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:342: finishing copy_from to trial08226312-10 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 23 (ObjNum 52 snap 1 seq_num 52) dirty exists 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:342: done (2 left) 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:343: done (1 left) 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:347: read oid 41 snap -1 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:347: expect (ObjNum 118 snap 26 seq_num 118) 2026-02-12T17:29:51.514 INFO:tasks.rados.rados.0.trial082.stdout:348: rollback oid 34 current snap is 36 2026-02-12T17:29:51.515 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 32 2026-02-12T17:29:51.515 INFO:tasks.rados.rados.0.trial082.stdout:349: write oid 44 current snap is 36 2026-02-12T17:29:51.515 INFO:tasks.rados.rados.0.trial082.stdout:349: seq_num 145 ranges {437015=721812,1701889=509708} 2026-02-12T17:29:51.516 INFO:tasks.rados.rados.0.trial082.stdout:349: writing trial08226312-44 from 437015 to 1158827 tid 1 2026-02-12T17:29:51.521 INFO:tasks.rados.rados.0.trial082.stdout:349: writing trial08226312-44 from 1701889 to 2211597 tid 2 2026-02-12T17:29:51.521 INFO:tasks.rados.rados.0.trial082.stdout:350: copy_from oid 46 from oid 28 current snap is 36 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:348: finishing rollback tid 0 to trial08226312-34 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:348: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 101 (ObjNum 177 snap 0 seq_num 1728032160) dirty dne 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:346: finishing rollback tid 0 to trial08226312-31 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:346: finishing rollback tid 1 to trial08226312-31 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:346: finishing rollback tid 2 to trial08226312-31 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 110 (ObjNum 50 snap 1 seq_num 50) dirty exists 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:349: finishing write tid 1 to trial08226312-44 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:346: done (4 left) 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:348: done (3 left) 2026-02-12T17:29:51.522 INFO:tasks.rados.rados.0.trial082.stdout:351: read oid 20 snap -1 2026-02-12T17:29:51.523 INFO:tasks.rados.rados.0.trial082.stdout:351: expect (ObjNum 120 snap 27 seq_num 120) 2026-02-12T17:29:51.523 INFO:tasks.rados.rados.0.trial082.stdout:352: read oid 23 snap -1 2026-02-12T17:29:51.523 INFO:tasks.rados.rados.0.trial082.stdout:352: expect (ObjNum 134 snap 31 seq_num 134) 2026-02-12T17:29:51.523 INFO:tasks.rados.rados.0.trial082.stdout:353: write (excl) oid 3 current snap is 36 2026-02-12T17:29:51.523 INFO:tasks.rados.rados.0.trial082.stdout:353: seq_num 146 ranges {453822=797061,1760371=653366} 2026-02-12T17:29:51.526 INFO:tasks.rados.rados.0.trial082.stdout:353: writing trial08226312-3 from 453822 to 1250883 tid 1 2026-02-12T17:29:51.530 INFO:tasks.rados.rados.0.trial082.stdout:353: writing trial08226312-3 from 1760371 to 2413737 tid 2 2026-02-12T17:29:51.530 INFO:tasks.rados.rados.0.trial082.stdout:354: snap_remove snap 21 2026-02-12T17:29:52.515 INFO:tasks.rados.rados.0.trial082.stdout:354: done (6 left) 2026-02-12T17:29:52.516 INFO:tasks.rados.rados.0.trial082.stdout:355: delete oid 10 current snap is 36 2026-02-12T17:29:52.516 INFO:tasks.rados.rados.0.trial082.stdout:347: expect (ObjNum 118 snap 26 seq_num 118) 2026-02-12T17:29:52.516 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:52.545 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:52.603 INFO:tasks.rados.rados.0.trial082.stdout:351: expect (ObjNum 120 snap 27 seq_num 120) 2026-02-12T17:29:52.619 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:52.642 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1087981 2026-02-12T17:29:52.655 INFO:tasks.rados.rados.0.trial082.stdout:350: finishing copy_from racing read to trial08226312-46 2026-02-12T17:29:52.655 INFO:tasks.rados.rados.0.trial082.stdout:347: done (6 left) 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:351: done (5 left) 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:355: done (4 left) 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:356: rollback oid 8 current snap is 36 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 30 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:349: finishing write tid 2 to trial08226312-44 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:349: finishing write tid 3 to trial08226312-44 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:349: finishing write tid 4 to trial08226312-44 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:349: oid 44 updating version 0 to 172 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:349: oid 44 version 172 is already newer than 170 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:349: oid 44 version 172 is already newer than 171 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 172 (ObjNum 145 snap 36 seq_num 145) dirty exists 2026-02-12T17:29:52.656 INFO:tasks.rados.rados.0.trial082.stdout:349: left oid 44 (ObjNum 145 snap 36 seq_num 145) 2026-02-12T17:29:52.657 INFO:tasks.rados.rados.0.trial082.stdout:352: expect (ObjNum 134 snap 31 seq_num 134) 2026-02-12T17:29:52.657 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 424509 2026-02-12T17:29:52.679 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1542838 2026-02-12T17:29:52.707 INFO:tasks.rados.rados.0.trial082.stdout:350: finishing copy_from to trial08226312-46 2026-02-12T17:29:52.707 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 141 (ObjNum 119 snap 27 seq_num 119) dirty exists 2026-02-12T17:29:52.707 INFO:tasks.rados.rados.0.trial082.stdout:353: finishing write tid 1 to trial08226312-3 2026-02-12T17:29:52.707 INFO:tasks.rados.rados.0.trial082.stdout:353: finishing write tid 2 to trial08226312-3 2026-02-12T17:29:52.707 INFO:tasks.rados.rados.0.trial082.stdout:353: finishing write tid 3 to trial08226312-3 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:353: finishing write tid 4 to trial08226312-3 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:353: oid 3 updating version 0 to 110 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:353: oid 3 version 110 is already newer than 108 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:353: oid 3 version 110 is already newer than 109 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 110 (ObjNum 146 snap 36 seq_num 146) dirty exists 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:353: left oid 3 (ObjNum 146 snap 36 seq_num 146) 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:356: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 0 (ObjNum 129 snap 0 seq_num 25553640) dirty dne 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:349: done (4 left) 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:350: done (3 left) 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:352: done (2 left) 2026-02-12T17:29:52.708 INFO:tasks.rados.rados.0.trial082.stdout:353: done (1 left) 2026-02-12T17:29:52.709 INFO:tasks.rados.rados.0.trial082.stdout:356: done (0 left) 2026-02-12T17:29:52.709 INFO:tasks.rados.rados.0.trial082.stdout:357: read oid 3 snap -1 2026-02-12T17:29:52.709 INFO:tasks.rados.rados.0.trial082.stdout:357: expect (ObjNum 146 snap 36 seq_num 146) 2026-02-12T17:29:52.709 INFO:tasks.rados.rados.0.trial082.stdout:358: rollback oid 14 current snap is 36 2026-02-12T17:29:52.709 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 14 to 27 2026-02-12T17:29:52.709 INFO:tasks.rados.rados.0.trial082.stdout:359: snap_remove snap 30 2026-02-12T17:29:53.483 INFO:tasks.rados.rados.0.trial082.stdout:359: done (2 left) 2026-02-12T17:29:53.483 INFO:tasks.rados.rados.0.trial082.stdout:360: snap_remove snap 31 2026-02-12T17:29:54.485 INFO:tasks.rados.rados.0.trial082.stdout:360: done (2 left) 2026-02-12T17:29:54.486 INFO:tasks.rados.rados.0.trial082.stdout:361: rollback oid 29 current snap is 36 2026-02-12T17:29:54.486 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 29 to 27 2026-02-12T17:29:54.486 INFO:tasks.rados.rados.0.trial082.stdout:357: expect (ObjNum 146 snap 36 seq_num 146) 2026-02-12T17:29:54.512 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1599796 2026-02-12T17:29:54.531 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 151811 2026-02-12T17:29:54.555 INFO:tasks.rados.rados.0.trial082.stdout:358: finishing rollback tid 0 to trial08226312-14 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:358: finishing rollback tid 1 to trial08226312-14 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 114 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:361: finishing rollback tid 0 to trial08226312-29 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:361: finishing rollback tid 1 to trial08226312-29 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 51 (ObjNum 33 snap 0 seq_num 27071908) dirty dne 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:357: done (2 left) 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:358: done (1 left) 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:361: done (0 left) 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:362: write oid 19 current snap is 36 2026-02-12T17:29:54.556 INFO:tasks.rados.rados.0.trial082.stdout:362: seq_num 148 ranges {487436=547559,1760982=657035} 2026-02-12T17:29:54.559 INFO:tasks.rados.rados.0.trial082.stdout:362: writing trial08226312-19 from 487436 to 1034995 tid 1 2026-02-12T17:29:54.565 INFO:tasks.rados.rados.0.trial082.stdout:362: writing trial08226312-19 from 1760982 to 2418017 tid 2 2026-02-12T17:29:54.565 INFO:tasks.rados.rados.0.trial082.stdout:363: snap_remove snap 32 2026-02-12T17:29:55.517 INFO:tasks.rados.rados.0.trial082.stdout:363: done (1 left) 2026-02-12T17:29:55.517 INFO:tasks.rados.rados.0.trial082.stdout:364: snap_remove snap 27 2026-02-12T17:29:56.558 INFO:tasks.rados.rados.0.trial082.stdout:364: done (1 left) 2026-02-12T17:29:56.558 INFO:tasks.rados.rados.0.trial082.stdout:365: write (excl) oid 42 current snap is 36 2026-02-12T17:29:56.558 INFO:tasks.rados.rados.0.trial082.stdout:365: seq_num 149 ranges {504243=622808,1819464=517046} 2026-02-12T17:29:56.562 INFO:tasks.rados.rados.0.trial082.stdout:365: writing trial08226312-42 from 504243 to 1127051 tid 1 2026-02-12T17:29:56.567 INFO:tasks.rados.rados.0.trial082.stdout:365: writing trial08226312-42 from 1819464 to 2336510 tid 2 2026-02-12T17:29:56.567 INFO:tasks.rados.rados.0.trial082.stdout:366: write oid 47 current snap is 36 2026-02-12T17:29:56.567 INFO:tasks.rados.rados.0.trial082.stdout:366: seq_num 150 ranges {521050=698057,1877946=643104} 2026-02-12T17:29:56.571 INFO:tasks.rados.rados.0.trial082.stdout:366: writing trial08226312-47 from 521050 to 1219107 tid 1 2026-02-12T17:29:56.576 INFO:tasks.rados.rados.0.trial082.stdout:366: writing trial08226312-47 from 1877946 to 2521050 tid 2 2026-02-12T17:29:56.576 INFO:tasks.rados.rados.0.trial082.stdout:367: read oid 30 snap -1 2026-02-12T17:29:56.576 INFO:tasks.rados.rados.0.trial082.stdout:367: expect (ObjNum 140 snap 34 seq_num 140) 2026-02-12T17:29:56.577 INFO:tasks.rados.rados.0.trial082.stdout:368: write oid 43 current snap is 36 2026-02-12T17:29:56.577 INFO:tasks.rados.rados.0.trial082.stdout:368: seq_num 151 ranges {537857=773306,1936428=520715} 2026-02-12T17:29:56.581 INFO:tasks.rados.rados.0.trial082.stdout:368: writing trial08226312-43 from 537857 to 1311163 tid 1 2026-02-12T17:29:56.586 INFO:tasks.rados.rados.0.trial082.stdout:368: writing trial08226312-43 from 1936428 to 2457143 tid 2 2026-02-12T17:29:56.586 INFO:tasks.rados.rados.0.trial082.stdout:369: copy_from oid 39 from oid 4 current snap is 36 2026-02-12T17:29:56.586 INFO:tasks.rados.rados.0.trial082.stdout:362: finishing write tid 1 to trial08226312-19 2026-02-12T17:29:56.586 INFO:tasks.rados.rados.0.trial082.stdout:362: finishing write tid 2 to trial08226312-19 2026-02-12T17:29:56.586 INFO:tasks.rados.rados.0.trial082.stdout:362: finishing write tid 3 to trial08226312-19 2026-02-12T17:29:56.586 INFO:tasks.rados.rados.0.trial082.stdout:370: snap_create 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:362: finishing write tid 4 to trial08226312-19 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:362: oid 19 updating version 0 to 248 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:362: oid 19 version 248 is already newer than 246 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:362: oid 19 version 248 is already newer than 247 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 248 (ObjNum 148 snap 36 seq_num 148) dirty exists 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:362: left oid 19 (ObjNum 148 snap 36 seq_num 148) 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:365: finishing write tid 1 to trial08226312-42 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:365: finishing write tid 2 to trial08226312-42 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:365: finishing write tid 3 to trial08226312-42 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:365: finishing write tid 4 to trial08226312-42 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:365: oid 42 updating version 0 to 234 2026-02-12T17:29:56.587 INFO:tasks.rados.rados.0.trial082.stdout:365: oid 42 updating version 234 to 235 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:365: oid 42 updating version 235 to 236 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 236 (ObjNum 149 snap 36 seq_num 149) dirty exists 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:365: left oid 42 (ObjNum 149 snap 36 seq_num 149) 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:366: finishing write tid 1 to trial08226312-47 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:366: finishing write tid 2 to trial08226312-47 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:366: finishing write tid 3 to trial08226312-47 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:366: finishing write tid 4 to trial08226312-47 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:366: oid 47 updating version 0 to 255 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:366: oid 47 version 255 is already newer than 253 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:366: oid 47 version 255 is already newer than 254 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 255 (ObjNum 150 snap 36 seq_num 150) dirty exists 2026-02-12T17:29:56.588 INFO:tasks.rados.rados.0.trial082.stdout:366: left oid 47 (ObjNum 150 snap 36 seq_num 150) 2026-02-12T17:29:56.589 INFO:tasks.rados.rados.0.trial082.stdout:367: expect (ObjNum 140 snap 34 seq_num 140) 2026-02-12T17:29:56.623 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:56.643 INFO:tasks.rados.rados.0.trial082.stdout:368: finishing write tid 1 to trial08226312-43 2026-02-12T17:29:56.643 INFO:tasks.rados.rados.0.trial082.stdout:368: finishing write tid 2 to trial08226312-43 2026-02-12T17:29:56.643 INFO:tasks.rados.rados.0.trial082.stdout:368: finishing write tid 3 to trial08226312-43 2026-02-12T17:29:56.643 INFO:tasks.rados.rados.0.trial082.stdout:368: finishing write tid 4 to trial08226312-43 2026-02-12T17:29:56.643 INFO:tasks.rados.rados.0.trial082.stdout:368: oid 43 updating version 0 to 180 2026-02-12T17:29:56.643 INFO:tasks.rados.rados.0.trial082.stdout:368: oid 43 version 180 is already newer than 179 2026-02-12T17:29:56.643 INFO:tasks.rados.rados.0.trial082.stdout:368: oid 43 updating version 180 to 181 2026-02-12T17:29:56.643 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 181 (ObjNum 151 snap 36 seq_num 151) dirty exists 2026-02-12T17:29:56.644 INFO:tasks.rados.rados.0.trial082.stdout:368: left oid 43 (ObjNum 151 snap 36 seq_num 151) 2026-02-12T17:29:56.644 INFO:tasks.rados.rados.0.trial082.stdout:369: finishing copy_from racing read to trial08226312-39 2026-02-12T17:29:56.644 INFO:tasks.rados.rados.0.trial082.stdout:369: finishing copy_from to trial08226312-39 2026-02-12T17:29:56.644 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 43 (ObjNum 58 snap 2 seq_num 58) dirty exists 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:362: done (6 left) 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:365: done (5 left) 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:366: done (4 left) 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:367: done (3 left) 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:368: done (2 left) 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:369: done (1 left) 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:370: done (0 left) 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:371: copy_from oid 35 from oid 47 current snap is 37 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:372: write oid 50 current snap is 37 2026-02-12T17:29:57.562 INFO:tasks.rados.rados.0.trial082.stdout:372: seq_num 152 ranges {554664=448555,1478557=664373} 2026-02-12T17:29:57.566 INFO:tasks.rados.rados.0.trial082.stdout:372: writing trial08226312-50 from 554664 to 1003219 tid 1 2026-02-12T17:29:57.570 INFO:tasks.rados.rados.0.trial082.stdout:372: writing trial08226312-50 from 1478557 to 2142930 tid 2 2026-02-12T17:29:57.570 INFO:tasks.rados.rados.0.trial082.stdout:373: snap_create 2026-02-12T17:29:57.570 INFO:tasks.rados.rados.0.trial082.stdout:372: finishing write tid 1 to trial08226312-50 2026-02-12T17:29:57.570 INFO:tasks.rados.rados.0.trial082.stdout:371: finishing copy_from racing read to trial08226312-35 2026-02-12T17:29:57.571 INFO:tasks.rados.rados.0.trial082.stdout:371: finishing copy_from to trial08226312-35 2026-02-12T17:29:57.571 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 255 (ObjNum 150 snap 36 seq_num 150) dirty exists 2026-02-12T17:29:57.575 INFO:tasks.rados.rados.0.trial082.stdout:372: finishing write tid 2 to trial08226312-50 2026-02-12T17:29:57.576 INFO:tasks.rados.rados.0.trial082.stdout:372: finishing write tid 3 to trial08226312-50 2026-02-12T17:29:57.576 INFO:tasks.rados.rados.0.trial082.stdout:372: finishing write tid 4 to trial08226312-50 2026-02-12T17:29:57.577 INFO:tasks.rados.rados.0.trial082.stdout:372: oid 50 updating version 0 to 55 2026-02-12T17:29:57.577 INFO:tasks.rados.rados.0.trial082.stdout:372: oid 50 updating version 55 to 57 2026-02-12T17:29:57.577 INFO:tasks.rados.rados.0.trial082.stdout:372: oid 50 version 57 is already newer than 56 2026-02-12T17:29:57.577 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 57 (ObjNum 152 snap 37 seq_num 152) dirty exists 2026-02-12T17:29:57.577 INFO:tasks.rados.rados.0.trial082.stdout:372: left oid 50 (ObjNum 152 snap 37 seq_num 152) 2026-02-12T17:29:58.483 INFO:tasks.rados.rados.0.trial082.stdout:371: done (2 left) 2026-02-12T17:29:58.483 INFO:tasks.rados.rados.0.trial082.stdout:372: done (1 left) 2026-02-12T17:29:58.483 INFO:tasks.rados.rados.0.trial082.stdout:373: done (0 left) 2026-02-12T17:29:58.483 INFO:tasks.rados.rados.0.trial082.stdout:374: snap_create 2026-02-12T17:29:59.483 INFO:tasks.rados.rados.0.trial082.stdout:374: done (0 left) 2026-02-12T17:29:59.484 INFO:tasks.rados.rados.0.trial082.stdout:375: write oid 7 current snap is 39 2026-02-12T17:29:59.484 INFO:tasks.rados.rados.0.trial082.stdout:375: seq_num 153 ranges {571471=640157,1653392=524384} 2026-02-12T17:29:59.488 INFO:tasks.rados.rados.0.trial082.stdout:375: writing trial08226312-7 from 571471 to 1211628 tid 1 2026-02-12T17:29:59.492 INFO:tasks.rados.rados.0.trial082.stdout:375: writing trial08226312-7 from 1653392 to 2177776 tid 2 2026-02-12T17:29:59.492 INFO:tasks.rados.rados.0.trial082.stdout:376: delete oid 9 current snap is 39 2026-02-12T17:29:59.493 INFO:tasks.rados.rados.0.trial082.stdout:375: finishing write tid 1 to trial08226312-7 2026-02-12T17:29:59.495 INFO:tasks.rados.rados.0.trial082.stdout:375: finishing write tid 2 to trial08226312-7 2026-02-12T17:29:59.495 INFO:tasks.rados.rados.0.trial082.stdout:375: finishing write tid 3 to trial08226312-7 2026-02-12T17:29:59.495 INFO:tasks.rados.rados.0.trial082.stdout:375: finishing write tid 4 to trial08226312-7 2026-02-12T17:29:59.495 INFO:tasks.rados.rados.0.trial082.stdout:375: oid 7 updating version 0 to 239 2026-02-12T17:29:59.495 INFO:tasks.rados.rados.0.trial082.stdout:375: oid 7 updating version 239 to 240 2026-02-12T17:29:59.496 INFO:tasks.rados.rados.0.trial082.stdout:375: oid 7 version 240 is already newer than 238 2026-02-12T17:29:59.496 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 240 (ObjNum 153 snap 39 seq_num 153) dirty exists 2026-02-12T17:29:59.496 INFO:tasks.rados.rados.0.trial082.stdout:375: left oid 7 (ObjNum 153 snap 39 seq_num 153) 2026-02-12T17:29:59.496 INFO:tasks.rados.rados.0.trial082.stdout:375: done (1 left) 2026-02-12T17:29:59.496 INFO:tasks.rados.rados.0.trial082.stdout:376: done (0 left) 2026-02-12T17:29:59.496 INFO:tasks.rados.rados.0.trial082.stdout:377: read oid 22 snap -1 2026-02-12T17:29:59.496 INFO:tasks.rados.rados.0.trial082.stdout:377: expect (ObjNum 55 snap 1 seq_num 55) 2026-02-12T17:29:59.496 INFO:tasks.rados.rados.0.trial082.stdout:378: delete oid 41 current snap is 39 2026-02-12T17:29:59.497 INFO:tasks.rados.rados.0.trial082.stdout:377: expect (ObjNum 55 snap 1 seq_num 55) 2026-02-12T17:29:59.497 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:29:59.578 INFO:tasks.rados.rados.0.trial082.stdout:377: done (1 left) 2026-02-12T17:29:59.578 INFO:tasks.rados.rados.0.trial082.stdout:378: done (0 left) 2026-02-12T17:29:59.578 INFO:tasks.rados.rados.0.trial082.stdout:379: delete oid 7 current snap is 39 2026-02-12T17:29:59.579 INFO:tasks.rados.rados.0.trial082.stdout:379: done (0 left) 2026-02-12T17:29:59.579 INFO:tasks.rados.rados.0.trial082.stdout:380: snap_create 2026-02-12T17:30:00.566 INFO:tasks.rados.rados.0.trial082.stdout:380: done (0 left) 2026-02-12T17:30:00.566 INFO:tasks.rados.rados.0.trial082.stdout:381: write oid 43 current snap is 40 2026-02-12T17:30:00.566 INFO:tasks.rados.rados.0.trial082.stdout:381: seq_num 157 ranges {638699=541153,1770967=531722} 2026-02-12T17:30:00.570 INFO:tasks.rados.rados.0.trial082.stdout:381: writing trial08226312-43 from 638699 to 1179852 tid 1 2026-02-12T17:30:00.575 INFO:tasks.rados.rados.0.trial082.stdout:381: writing trial08226312-43 from 1770967 to 2302689 tid 2 2026-02-12T17:30:00.575 INFO:tasks.rados.rados.0.trial082.stdout:382: rollback oid 7 current snap is 40 2026-02-12T17:30:00.575 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 7 to 36 2026-02-12T17:30:00.575 INFO:tasks.rados.rados.0.trial082.stdout:381: finishing write tid 1 to trial08226312-43 2026-02-12T17:30:00.575 INFO:tasks.rados.rados.0.trial082.stdout:383: snap_remove snap 38 2026-02-12T17:30:01.568 INFO:tasks.rados.rados.0.trial082.stdout:383: done (2 left) 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:384: delete oid 16 current snap is 40 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:382: finishing rollback tid 1 to trial08226312-7 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:382: finishing rollback tid 2 to trial08226312-7 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 245 (ObjNum 134 snap 31 seq_num 134) dirty exists 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:381: finishing write tid 2 to trial08226312-43 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:381: finishing write tid 3 to trial08226312-43 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:381: finishing write tid 4 to trial08226312-43 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:381: oid 43 updating version 0 to 183 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:381: oid 43 updating version 183 to 185 2026-02-12T17:30:01.569 INFO:tasks.rados.rados.0.trial082.stdout:381: oid 43 version 185 is already newer than 184 2026-02-12T17:30:01.570 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 185 (ObjNum 157 snap 40 seq_num 157) dirty exists 2026-02-12T17:30:01.570 INFO:tasks.rados.rados.0.trial082.stdout:381: left oid 43 (ObjNum 157 snap 40 seq_num 157) 2026-02-12T17:30:01.570 INFO:tasks.rados.rados.0.trial082.stdout:381: done (2 left) 2026-02-12T17:30:01.570 INFO:tasks.rados.rados.0.trial082.stdout:382: done (1 left) 2026-02-12T17:30:01.570 INFO:tasks.rados.rados.0.trial082.stdout:384: done (0 left) 2026-02-12T17:30:01.571 INFO:tasks.rados.rados.0.trial082.stdout:385: delete oid 37 current snap is 40 2026-02-12T17:30:01.571 INFO:tasks.rados.rados.0.trial082.stdout:385: done (0 left) 2026-02-12T17:30:01.572 INFO:tasks.rados.rados.0.trial082.stdout:386: copy_from oid 2 from oid 7 current snap is 40 2026-02-12T17:30:01.572 INFO:tasks.rados.rados.0.trial082.stdout:387: write oid 15 current snap is 40 2026-02-12T17:30:01.572 INFO:tasks.rados.rados.0.trial082.stdout:387: seq_num 160 ranges {689120=483253,1946413=679049} 2026-02-12T17:30:01.576 INFO:tasks.rados.rados.0.trial082.stdout:387: writing trial08226312-15 from 689120 to 1172373 tid 1 2026-02-12T17:30:01.583 INFO:tasks.rados.rados.0.trial082.stdout:387: writing trial08226312-15 from 1946413 to 2625462 tid 2 2026-02-12T17:30:01.583 INFO:tasks.rados.rados.0.trial082.stdout:388: read oid 8 snap -1 2026-02-12T17:30:01.583 INFO:tasks.rados.rados.0.trial082.stdout:388: expect deleted 2026-02-12T17:30:01.583 INFO:tasks.rados.rados.0.trial082.stdout:389: delete oid 38 current snap is 40 2026-02-12T17:30:01.583 INFO:tasks.rados.rados.0.trial082.stdout:386: finishing copy_from racing read to trial08226312-2 2026-02-12T17:30:01.583 INFO:tasks.rados.rados.0.trial082.stdout:387: finishing write tid 1 to trial08226312-15 2026-02-12T17:30:01.584 INFO:tasks.rados.rados.0.trial082.stdout:387: finishing write tid 2 to trial08226312-15 2026-02-12T17:30:01.584 INFO:tasks.rados.rados.0.trial082.stdout:387: finishing write tid 3 to trial08226312-15 2026-02-12T17:30:01.584 INFO:tasks.rados.rados.0.trial082.stdout:387: finishing write tid 4 to trial08226312-15 2026-02-12T17:30:01.585 INFO:tasks.rados.rados.0.trial082.stdout:387: oid 15 updating version 0 to 130 2026-02-12T17:30:01.585 INFO:tasks.rados.rados.0.trial082.stdout:387: oid 15 updating version 130 to 131 2026-02-12T17:30:01.585 INFO:tasks.rados.rados.0.trial082.stdout:387: oid 15 updating version 131 to 132 2026-02-12T17:30:01.585 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 132 (ObjNum 160 snap 40 seq_num 160) dirty exists 2026-02-12T17:30:01.585 INFO:tasks.rados.rados.0.trial082.stdout:387: left oid 15 (ObjNum 160 snap 40 seq_num 160) 2026-02-12T17:30:01.587 INFO:tasks.rados.rados.0.trial082.stdout:387: done (3 left) 2026-02-12T17:30:01.587 INFO:tasks.rados.rados.0.trial082.stdout:388: done (2 left) 2026-02-12T17:30:01.587 INFO:tasks.rados.rados.0.trial082.stdout:389: done (1 left) 2026-02-12T17:30:01.587 INFO:tasks.rados.rados.0.trial082.stdout:390: rollback oid 39 current snap is 40 2026-02-12T17:30:01.587 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 39 to 39 2026-02-12T17:30:01.587 INFO:tasks.rados.rados.0.trial082.stdout:391: write (excl) oid 22 current snap is 40 2026-02-12T17:30:01.587 INFO:tasks.rados.rados.0.trial082.stdout:391: seq_num 162 ranges {722734=633751,2063377=659357} 2026-02-12T17:30:01.592 INFO:tasks.rados.rados.0.trial082.stdout:391: writing trial08226312-22 from 722734 to 1356485 tid 1 2026-02-12T17:30:01.597 INFO:tasks.rados.rados.0.trial082.stdout:391: writing trial08226312-22 from 2063377 to 2722734 tid 2 2026-02-12T17:30:01.597 INFO:tasks.rados.rados.0.trial082.stdout:392: delete oid 11 current snap is 40 2026-02-12T17:30:01.597 INFO:tasks.rados.rados.0.trial082.stdout:386: finishing copy_from to trial08226312-2 2026-02-12T17:30:01.597 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 245 (ObjNum 134 snap 31 seq_num 134) dirty exists 2026-02-12T17:30:01.598 INFO:tasks.rados.rados.0.trial082.stdout:390: finishing rollback tid 0 to trial08226312-39 2026-02-12T17:30:01.598 INFO:tasks.rados.rados.0.trial082.stdout:390: finishing rollback tid 1 to trial08226312-39 2026-02-12T17:30:01.598 INFO:tasks.rados.rados.0.trial082.stdout:390: finishing rollback tid 2 to trial08226312-39 2026-02-12T17:30:01.598 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 248 (ObjNum 58 snap 2 seq_num 58) dirty exists 2026-02-12T17:30:01.598 INFO:tasks.rados.rados.0.trial082.stdout:391: finishing write tid 1 to trial08226312-22 2026-02-12T17:30:01.599 INFO:tasks.rados.rados.0.trial082.stdout:386: done (3 left) 2026-02-12T17:30:01.599 INFO:tasks.rados.rados.0.trial082.stdout:390: done (2 left) 2026-02-12T17:30:01.599 INFO:tasks.rados.rados.0.trial082.stdout:392: done (1 left) 2026-02-12T17:30:01.599 INFO:tasks.rados.rados.0.trial082.stdout:393: read oid 8 snap 37 2026-02-12T17:30:01.599 INFO:tasks.rados.rados.0.trial082.stdout:393: expect deleted 2026-02-12T17:30:01.599 INFO:tasks.rados.rados.0.trial082.stdout:394: write (excl) oid 32 current snap is 40 2026-02-12T17:30:01.599 INFO:tasks.rados.rados.0.trial082.stdout:394: seq_num 164 ranges {756348=784249,2063988=686387} 2026-02-12T17:30:01.605 INFO:tasks.rados.rados.0.trial082.stdout:394: writing trial08226312-32 from 756348 to 1540597 tid 1 2026-02-12T17:30:01.609 INFO:tasks.rados.rados.0.trial082.stdout:394: writing trial08226312-32 from 2063988 to 2750375 tid 2 2026-02-12T17:30:01.610 INFO:tasks.rados.rados.0.trial082.stdout:395: write oid 3 current snap is 40 2026-02-12T17:30:01.610 INFO:tasks.rados.rados.0.trial082.stdout:395: seq_num 165 ranges {773155=459498,1722470=430045,2648676=124479} 2026-02-12T17:30:01.614 INFO:tasks.rados.rados.0.trial082.stdout:395: writing trial08226312-3 from 773155 to 1232653 tid 1 2026-02-12T17:30:01.617 INFO:tasks.rados.rados.0.trial082.stdout:395: writing trial08226312-3 from 1722470 to 2152515 tid 2 2026-02-12T17:30:01.621 INFO:tasks.rados.rados.0.trial082.stdout:395: writing trial08226312-3 from 2648676 to 2773155 tid 3 2026-02-12T17:30:01.621 INFO:tasks.rados.rados.0.trial082.stdout:396: delete oid 37 current snap is 40 2026-02-12T17:30:01.621 INFO:tasks.rados.rados.0.trial082.stdout:391: finishing write tid 2 to trial08226312-22 2026-02-12T17:30:01.621 INFO:tasks.rados.rados.0.trial082.stdout:391: finishing write tid 3 to trial08226312-22 2026-02-12T17:30:01.621 INFO:tasks.rados.rados.0.trial082.stdout:391: finishing write tid 4 to trial08226312-22 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:391: oid 22 updating version 0 to 191 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:391: oid 22 version 191 is already newer than 189 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:391: oid 22 version 191 is already newer than 190 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 191 (ObjNum 162 snap 40 seq_num 162) dirty exists 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:391: left oid 22 (ObjNum 162 snap 40 seq_num 162) 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:394: finishing write tid 1 to trial08226312-32 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:394: finishing write tid 2 to trial08226312-32 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:394: finishing write tid 3 to trial08226312-32 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:394: finishing write tid 4 to trial08226312-32 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:394: oid 32 updating version 0 to 104 2026-02-12T17:30:01.622 INFO:tasks.rados.rados.0.trial082.stdout:394: oid 32 version 104 is already newer than 103 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:394: oid 32 updating version 104 to 105 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 105 (ObjNum 164 snap 40 seq_num 164) dirty exists 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:394: left oid 32 (ObjNum 164 snap 40 seq_num 164) 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:395: finishing write tid 1 to trial08226312-3 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:395: finishing write tid 2 to trial08226312-3 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:391: done (4 left) 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:393: done (3 left) 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:394: done (2 left) 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:396: done (1 left) 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:397: read oid 46 snap -1 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:397: expect (ObjNum 119 snap 27 seq_num 119) 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:398: snap_create 2026-02-12T17:30:01.623 INFO:tasks.rados.rados.0.trial082.stdout:395: finishing write tid 3 to trial08226312-3 2026-02-12T17:30:01.624 INFO:tasks.rados.rados.0.trial082.stdout:395: finishing write tid 4 to trial08226312-3 2026-02-12T17:30:01.624 INFO:tasks.rados.rados.0.trial082.stdout:395: finishing write tid 5 to trial08226312-3 2026-02-12T17:30:01.624 INFO:tasks.rados.rados.0.trial082.stdout:395: oid 3 updating version 0 to 137 2026-02-12T17:30:01.624 INFO:tasks.rados.rados.0.trial082.stdout:395: oid 3 version 137 is already newer than 136 2026-02-12T17:30:01.624 INFO:tasks.rados.rados.0.trial082.stdout:395: oid 3 version 137 is already newer than 134 2026-02-12T17:30:01.624 INFO:tasks.rados.rados.0.trial082.stdout:395: oid 3 version 137 is already newer than 135 2026-02-12T17:30:01.624 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 137 (ObjNum 165 snap 40 seq_num 165) dirty exists 2026-02-12T17:30:01.624 INFO:tasks.rados.rados.0.trial082.stdout:395: left oid 3 (ObjNum 165 snap 40 seq_num 165) 2026-02-12T17:30:01.625 INFO:tasks.rados.rados.0.trial082.stdout:397: expect (ObjNum 119 snap 27 seq_num 119) 2026-02-12T17:30:01.625 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:01.645 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 903588 2026-02-12T17:30:02.571 INFO:tasks.rados.rados.0.trial082.stdout:395: done (2 left) 2026-02-12T17:30:02.572 INFO:tasks.rados.rados.0.trial082.stdout:397: done (1 left) 2026-02-12T17:30:02.572 INFO:tasks.rados.rados.0.trial082.stdout:398: done (0 left) 2026-02-12T17:30:02.572 INFO:tasks.rados.rados.0.trial082.stdout:399: snap_create 2026-02-12T17:30:03.484 INFO:tasks.rados.rados.0.trial082.stdout:399: done (0 left) 2026-02-12T17:30:03.484 INFO:tasks.rados.rados.0.trial082.stdout:400: read oid 6 snap -1 2026-02-12T17:30:03.484 INFO:tasks.rados.rados.0.trial082.stdout:400: expect deleted 2026-02-12T17:30:03.484 INFO:tasks.rados.rados.0.trial082.stdout:401: rollback oid 42 current snap is 42 2026-02-12T17:30:03.484 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 42 to 41 2026-02-12T17:30:03.484 INFO:tasks.rados.rados.0.trial082.stdout:402: write (excl) oid 26 current snap is 42 2026-02-12T17:30:03.484 INFO:tasks.rados.rados.0.trial082.stdout:402: seq_num 167 ranges {406769=609996,1439434=433714,2303522=503247} 2026-02-12T17:30:03.488 INFO:tasks.rados.rados.0.trial082.stdout:402: writing trial08226312-26 from 406769 to 1016765 tid 1 2026-02-12T17:30:03.491 INFO:tasks.rados.rados.0.trial082.stdout:402: writing trial08226312-26 from 1439434 to 1873148 tid 2 2026-02-12T17:30:03.495 INFO:tasks.rados.rados.0.trial082.stdout:402: writing trial08226312-26 from 2303522 to 2806769 tid 3 2026-02-12T17:30:03.495 INFO:tasks.rados.rados.0.trial082.stdout:403: delete oid 35 current snap is 42 2026-02-12T17:30:03.495 INFO:tasks.rados.rados.0.trial082.stdout:401: finishing rollback tid 0 to trial08226312-42 2026-02-12T17:30:03.495 INFO:tasks.rados.rados.0.trial082.stdout:401: finishing rollback tid 1 to trial08226312-42 2026-02-12T17:30:03.495 INFO:tasks.rados.rados.0.trial082.stdout:401: finishing rollback tid 2 to trial08226312-42 2026-02-12T17:30:03.495 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 255 (ObjNum 149 snap 36 seq_num 149) dirty exists 2026-02-12T17:30:03.495 INFO:tasks.rados.rados.0.trial082.stdout:402: finishing write tid 1 to trial08226312-26 2026-02-12T17:30:03.495 INFO:tasks.rados.rados.0.trial082.stdout:402: finishing write tid 2 to trial08226312-26 2026-02-12T17:30:03.497 INFO:tasks.rados.rados.0.trial082.stdout:402: finishing write tid 3 to trial08226312-26 2026-02-12T17:30:03.497 INFO:tasks.rados.rados.0.trial082.stdout:402: finishing write tid 4 to trial08226312-26 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:402: finishing write tid 5 to trial08226312-26 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:402: oid 26 updating version 0 to 256 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:402: oid 26 updating version 256 to 258 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:402: oid 26 updating version 258 to 259 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:402: oid 26 version 259 is already newer than 257 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 259 (ObjNum 167 snap 42 seq_num 167) dirty exists 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:402: left oid 26 (ObjNum 167 snap 42 seq_num 167) 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:400: done (3 left) 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:401: done (2 left) 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:402: done (1 left) 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:403: done (0 left) 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:404: read oid 21 snap 36 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:404: expect deleted 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:405: read oid 29 snap -1 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:405: expect deleted 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:406: rollback oid 12 current snap is 42 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 41 2026-02-12T17:30:03.498 INFO:tasks.rados.rados.0.trial082.stdout:407: snap_remove snap 37 2026-02-12T17:30:04.487 INFO:tasks.rados.rados.0.trial082.stdout:407: done (3 left) 2026-02-12T17:30:04.487 INFO:tasks.rados.rados.0.trial082.stdout:408: write (excl) oid 27 current snap is 42 2026-02-12T17:30:04.487 INFO:tasks.rados.rados.0.trial082.stdout:408: seq_num 169 ranges {440383=476847,1556398=437383,2474721=365662} 2026-02-12T17:30:04.490 INFO:tasks.rados.rados.0.trial082.stdout:408: writing trial08226312-27 from 440383 to 917230 tid 1 2026-02-12T17:30:04.494 INFO:tasks.rados.rados.0.trial082.stdout:408: writing trial08226312-27 from 1556398 to 1993781 tid 2 2026-02-12T17:30:04.498 INFO:tasks.rados.rados.0.trial082.stdout:408: writing trial08226312-27 from 2474721 to 2840383 tid 3 2026-02-12T17:30:04.498 INFO:tasks.rados.rados.0.trial082.stdout:409: copy_from oid 3 from oid 17 current snap is 42 2026-02-12T17:30:04.498 INFO:tasks.rados.rados.0.trial082.stdout:406: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:30:04.498 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 0 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-12T17:30:04.498 INFO:tasks.rados.rados.0.trial082.stdout:408: finishing write tid 1 to trial08226312-27 2026-02-12T17:30:04.498 INFO:tasks.rados.rados.0.trial082.stdout:404: done (4 left) 2026-02-12T17:30:04.498 INFO:tasks.rados.rados.0.trial082.stdout:405: done (3 left) 2026-02-12T17:30:04.498 INFO:tasks.rados.rados.0.trial082.stdout:406: done (2 left) 2026-02-12T17:30:04.498 INFO:tasks.rados.rados.0.trial082.stdout:410: write oid 13 current snap is 42 2026-02-12T17:30:04.499 INFO:tasks.rados.rados.0.trial082.stdout:410: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2026-02-12T17:30:04.501 INFO:tasks.rados.rados.0.trial082.stdout:410: writing trial08226312-13 from 457190 to 1009286 tid 1 2026-02-12T17:30:04.505 INFO:tasks.rados.rados.0.trial082.stdout:410: writing trial08226312-13 from 1614880 to 2195921 tid 2 2026-02-12T17:30:04.508 INFO:tasks.rados.rados.0.trial082.stdout:410: writing trial08226312-13 from 2785791 to 2857190 tid 3 2026-02-12T17:30:04.508 INFO:tasks.rados.rados.0.trial082.stdout:411: write (excl) oid 21 current snap is 42 2026-02-12T17:30:04.508 INFO:tasks.rados.rados.0.trial082.stdout:411: seq_num 171 ranges {473997=627345,1673362=441052,2529567=344430} 2026-02-12T17:30:04.512 INFO:tasks.rados.rados.0.trial082.stdout:411: writing trial08226312-21 from 473997 to 1101342 tid 1 2026-02-12T17:30:04.516 INFO:tasks.rados.rados.0.trial082.stdout:411: writing trial08226312-21 from 1673362 to 2114414 tid 2 2026-02-12T17:30:04.520 INFO:tasks.rados.rados.0.trial082.stdout:411: writing trial08226312-21 from 2529567 to 2873997 tid 3 2026-02-12T17:30:04.520 INFO:tasks.rados.rados.0.trial082.stdout:412: snap_create 2026-02-12T17:30:04.520 INFO:tasks.rados.rados.0.trial082.stdout:408: finishing write tid 2 to trial08226312-27 2026-02-12T17:30:04.520 INFO:tasks.rados.rados.0.trial082.stdout:408: finishing write tid 3 to trial08226312-27 2026-02-12T17:30:04.520 INFO:tasks.rados.rados.0.trial082.stdout:408: finishing write tid 4 to trial08226312-27 2026-02-12T17:30:04.520 INFO:tasks.rados.rados.0.trial082.stdout:408: finishing write tid 5 to trial08226312-27 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:408: oid 27 updating version 0 to 112 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:408: oid 27 updating version 112 to 113 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:408: oid 27 updating version 113 to 114 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:408: oid 27 version 114 is already newer than 111 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 114 (ObjNum 169 snap 42 seq_num 169) dirty exists 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:408: left oid 27 (ObjNum 169 snap 42 seq_num 169) 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:410: finishing write tid 1 to trial08226312-13 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:410: finishing write tid 2 to trial08226312-13 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:409: finishing copy_from racing read to trial08226312-3 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:409: finishing copy_from to trial08226312-3 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 51 (ObjNum 65 snap 8 seq_num 65) dirty exists 2026-02-12T17:30:04.521 INFO:tasks.rados.rados.0.trial082.stdout:410: finishing write tid 3 to trial08226312-13 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:410: finishing write tid 4 to trial08226312-13 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:410: finishing write tid 5 to trial08226312-13 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:410: oid 13 updating version 0 to 110 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:410: oid 13 updating version 110 to 111 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:410: oid 13 version 111 is already newer than 109 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:410: oid 13 version 111 is already newer than 108 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 111 (ObjNum 170 snap 42 seq_num 170) dirty exists 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:410: left oid 13 (ObjNum 170 snap 42 seq_num 170) 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:411: finishing write tid 1 to trial08226312-21 2026-02-12T17:30:04.522 INFO:tasks.rados.rados.0.trial082.stdout:411: finishing write tid 2 to trial08226312-21 2026-02-12T17:30:04.523 INFO:tasks.rados.rados.0.trial082.stdout:411: finishing write tid 3 to trial08226312-21 2026-02-12T17:30:04.523 INFO:tasks.rados.rados.0.trial082.stdout:411: finishing write tid 4 to trial08226312-21 2026-02-12T17:30:04.523 INFO:tasks.rados.rados.0.trial082.stdout:411: finishing write tid 5 to trial08226312-21 2026-02-12T17:30:04.523 INFO:tasks.rados.rados.0.trial082.stdout:411: oid 21 updating version 0 to 198 2026-02-12T17:30:04.523 INFO:tasks.rados.rados.0.trial082.stdout:411: oid 21 updating version 198 to 199 2026-02-12T17:30:04.524 INFO:tasks.rados.rados.0.trial082.stdout:411: oid 21 version 199 is already newer than 197 2026-02-12T17:30:04.524 INFO:tasks.rados.rados.0.trial082.stdout:411: oid 21 version 199 is already newer than 196 2026-02-12T17:30:04.524 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 199 (ObjNum 171 snap 42 seq_num 171) dirty exists 2026-02-12T17:30:04.524 INFO:tasks.rados.rados.0.trial082.stdout:411: left oid 21 (ObjNum 171 snap 42 seq_num 171) 2026-02-12T17:30:05.487 INFO:tasks.rados.rados.0.trial082.stdout:408: done (4 left) 2026-02-12T17:30:05.488 INFO:tasks.rados.rados.0.trial082.stdout:409: done (3 left) 2026-02-12T17:30:05.488 INFO:tasks.rados.rados.0.trial082.stdout:410: done (2 left) 2026-02-12T17:30:05.488 INFO:tasks.rados.rados.0.trial082.stdout:411: done (1 left) 2026-02-12T17:30:05.488 INFO:tasks.rados.rados.0.trial082.stdout:412: done (0 left) 2026-02-12T17:30:05.488 INFO:tasks.rados.rados.0.trial082.stdout:413: write (excl) oid 13 current snap is 43 2026-02-12T17:30:05.488 INFO:tasks.rados.rados.0.trial082.stdout:413: seq_num 172 ranges {490804=702594,1615491=584710,2724284=166520} 2026-02-12T17:30:05.492 INFO:tasks.rados.rados.0.trial082.stdout:413: writing trial08226312-13 from 490804 to 1193398 tid 1 2026-02-12T17:30:05.495 INFO:tasks.rados.rados.0.trial082.stdout:413: writing trial08226312-13 from 1615491 to 2200201 tid 2 2026-02-12T17:30:05.498 INFO:tasks.rados.rados.0.trial082.stdout:413: writing trial08226312-13 from 2724284 to 2890804 tid 3 2026-02-12T17:30:05.499 INFO:tasks.rados.rados.0.trial082.stdout:414: copy_from oid 44 from oid 39 current snap is 43 2026-02-12T17:30:05.499 INFO:tasks.rados.rados.0.trial082.stdout:413: finishing write tid 1 to trial08226312-13 2026-02-12T17:30:05.499 INFO:tasks.rados.rados.0.trial082.stdout:413: finishing write tid 2 to trial08226312-13 2026-02-12T17:30:05.499 INFO:tasks.rados.rados.0.trial082.stdout:415: snap_remove snap 36 2026-02-12T17:30:06.490 INFO:tasks.rados.rados.0.trial082.stdout:415: done (2 left) 2026-02-12T17:30:06.490 INFO:tasks.rados.rados.0.trial082.stdout:416: snap_remove snap 42 2026-02-12T17:30:07.563 INFO:tasks.rados.rados.0.trial082.stdout:416: done (2 left) 2026-02-12T17:30:07.563 INFO:tasks.rados.rados.0.trial082.stdout:417: snap_remove snap 39 2026-02-12T17:30:08.485 INFO:tasks.rados.rados.0.trial082.stdout:417: done (2 left) 2026-02-12T17:30:08.485 INFO:tasks.rados.rados.0.trial082.stdout:418: write oid 32 current snap is 43 2026-02-12T17:30:08.485 INFO:tasks.rados.rados.0.trial082.stdout:418: seq_num 173 ranges {507611=777843,2073973=444721} 2026-02-12T17:30:08.490 INFO:tasks.rados.rados.0.trial082.stdout:418: writing trial08226312-32 from 507611 to 1285454 tid 1 2026-02-12T17:30:08.495 INFO:tasks.rados.rados.0.trial082.stdout:418: writing trial08226312-32 from 2073973 to 2518694 tid 2 2026-02-12T17:30:08.495 INFO:tasks.rados.rados.0.trial082.stdout:419: write (excl) oid 8 current snap is 43 2026-02-12T17:30:08.495 INFO:tasks.rados.rados.0.trial082.stdout:419: seq_num 174 ranges {524418=453092,1732455=588379,2779130=145288} 2026-02-12T17:30:08.499 INFO:tasks.rados.rados.0.trial082.stdout:419: writing trial08226312-8 from 524418 to 977510 tid 1 2026-02-12T17:30:08.504 INFO:tasks.rados.rados.0.trial082.stdout:419: writing trial08226312-8 from 1732455 to 2320834 tid 2 2026-02-12T17:30:08.507 INFO:tasks.rados.rados.0.trial082.stdout:419: writing trial08226312-8 from 2779130 to 2924418 tid 3 2026-02-12T17:30:08.507 INFO:tasks.rados.rados.0.trial082.stdout:420: write oid 14 current snap is 43 2026-02-12T17:30:08.507 INFO:tasks.rados.rados.0.trial082.stdout:413: finishing write tid 3 to trial08226312-13 2026-02-12T17:30:08.507 INFO:tasks.rados.rados.0.trial082.stdout:413: finishing write tid 4 to trial08226312-13 2026-02-12T17:30:08.507 INFO:tasks.rados.rados.0.trial082.stdout:413: finishing write tid 5 to trial08226312-13 2026-02-12T17:30:08.507 INFO:tasks.rados.rados.0.trial082.stdout:413: oid 13 updating version 0 to 115 2026-02-12T17:30:08.507 INFO:tasks.rados.rados.0.trial082.stdout:413: oid 13 version 115 is already newer than 114 2026-02-12T17:30:08.507 INFO:tasks.rados.rados.0.trial082.stdout:413: oid 13 version 115 is already newer than 112 2026-02-12T17:30:08.508 INFO:tasks.rados.rados.0.trial082.stdout:413: oid 13 version 115 is already newer than 113 2026-02-12T17:30:08.508 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 115 (ObjNum 172 snap 43 seq_num 172) dirty exists 2026-02-12T17:30:08.508 INFO:tasks.rados.rados.0.trial082.stdout:413: left oid 13 (ObjNum 172 snap 43 seq_num 172) 2026-02-12T17:30:08.508 INFO:tasks.rados.rados.0.trial082.stdout:414: finishing copy_from racing read to trial08226312-44 2026-02-12T17:30:08.508 INFO:tasks.rados.rados.0.trial082.stdout:414: finishing copy_from to trial08226312-44 2026-02-12T17:30:08.508 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 248 (ObjNum 58 snap 2 seq_num 58) dirty exists 2026-02-12T17:30:08.508 INFO:tasks.rados.rados.0.trial082.stdout:418: finishing write tid 1 to trial08226312-32 2026-02-12T17:30:08.508 INFO:tasks.rados.rados.0.trial082.stdout:418: finishing write tid 2 to trial08226312-32 2026-02-12T17:30:08.508 INFO:tasks.rados.rados.0.trial082.stdout:420: seq_num 175 ranges {541225=644694,1907290=448390} 2026-02-12T17:30:08.510 INFO:tasks.rados.rados.0.trial082.stdout:420: writing trial08226312-14 from 541225 to 1185919 tid 1 2026-02-12T17:30:08.516 INFO:tasks.rados.rados.0.trial082.stdout:420: writing trial08226312-14 from 1907290 to 2355680 tid 2 2026-02-12T17:30:08.516 INFO:tasks.rados.rados.0.trial082.stdout:413: done (4 left) 2026-02-12T17:30:08.516 INFO:tasks.rados.rados.0.trial082.stdout:414: done (3 left) 2026-02-12T17:30:08.516 INFO:tasks.rados.rados.0.trial082.stdout:421: read oid 3 snap 41 2026-02-12T17:30:08.516 INFO:tasks.rados.rados.0.trial082.stdout:421: expect (ObjNum 165 snap 40 seq_num 165) 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:422: copy_from oid 23 from oid 22 current snap is 43 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:418: finishing write tid 3 to trial08226312-32 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:418: finishing write tid 4 to trial08226312-32 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:418: oid 32 updating version 0 to 121 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:418: oid 32 version 121 is already newer than 119 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:418: oid 32 version 121 is already newer than 120 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 121 (ObjNum 173 snap 43 seq_num 173) dirty exists 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:418: left oid 32 (ObjNum 173 snap 43 seq_num 173) 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:419: finishing write tid 1 to trial08226312-8 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:419: finishing write tid 2 to trial08226312-8 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:418: done (4 left) 2026-02-12T17:30:08.517 INFO:tasks.rados.rados.0.trial082.stdout:423: copy_from oid 41 from oid 29 current snap is 43 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:419: finishing write tid 3 to trial08226312-8 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:419: finishing write tid 4 to trial08226312-8 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:419: finishing write tid 5 to trial08226312-8 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:419: oid 8 updating version 0 to 256 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:419: oid 8 updating version 256 to 259 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:419: oid 8 version 259 is already newer than 257 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:419: oid 8 version 259 is already newer than 258 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 259 (ObjNum 174 snap 43 seq_num 174) dirty exists 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:419: left oid 8 (ObjNum 174 snap 43 seq_num 174) 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:419: done (4 left) 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:424: read oid 37 snap -1 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:424: expect deleted 2026-02-12T17:30:08.518 INFO:tasks.rados.rados.0.trial082.stdout:425: rollback oid 8 current snap is 43 2026-02-12T17:30:08.519 INFO:tasks.rados.rados.0.trial082.stdout:420: finishing write tid 1 to trial08226312-14 2026-02-12T17:30:08.519 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 40 2026-02-12T17:30:08.519 INFO:tasks.rados.rados.0.trial082.stdout:426: delete oid 20 current snap is 43 2026-02-12T17:30:08.519 INFO:tasks.rados.rados.0.trial082.stdout:423: finishing copy_from to trial08226312-41 2026-02-12T17:30:08.519 INFO:tasks.rados.rados.0.trial082.stdout:423: got expected ENOENT (src dne) 2026-02-12T17:30:08.519 INFO:tasks.rados.rados.0.trial082.stdout:423: finishing copy_from racing read to trial08226312-41 2026-02-12T17:30:08.520 INFO:tasks.rados.rados.0.trial082.stdout:425: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:30:08.520 INFO:tasks.rados.rados.0.trial082.stdout:425: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:30:08.520 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 261 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-12T17:30:08.520 INFO:tasks.rados.rados.0.trial082.stdout:423: done (6 left) 2026-02-12T17:30:08.520 INFO:tasks.rados.rados.0.trial082.stdout:424: done (5 left) 2026-02-12T17:30:08.520 INFO:tasks.rados.rados.0.trial082.stdout:425: done (4 left) 2026-02-12T17:30:08.520 INFO:tasks.rados.rados.0.trial082.stdout:426: done (3 left) 2026-02-12T17:30:08.520 INFO:tasks.rados.rados.0.trial082.stdout:427: write (excl) oid 36 current snap is 43 2026-02-12T17:30:08.520 INFO:tasks.rados.rados.0.trial082.stdout:427: seq_num 177 ranges {574839=795192,1907901=452059} 2026-02-12T17:30:08.522 INFO:tasks.rados.rados.0.trial082.stdout:427: writing trial08226312-36 from 574839 to 1370031 tid 1 2026-02-12T17:30:08.526 INFO:tasks.rados.rados.0.trial082.stdout:427: writing trial08226312-36 from 1907901 to 2359960 tid 2 2026-02-12T17:30:08.526 INFO:tasks.rados.rados.0.trial082.stdout:428: snap_remove snap 40 2026-02-12T17:30:09.487 INFO:tasks.rados.rados.0.trial082.stdout:428: done (4 left) 2026-02-12T17:30:09.488 INFO:tasks.rados.rados.0.trial082.stdout:429: write (excl) oid 8 current snap is 43 2026-02-12T17:30:09.488 INFO:tasks.rados.rados.0.trial082.stdout:429: seq_num 178 ranges {591646=470441,1566383=595717,2888822=102824} 2026-02-12T17:30:09.492 INFO:tasks.rados.rados.0.trial082.stdout:429: writing trial08226312-8 from 591646 to 1062087 tid 1 2026-02-12T17:30:09.496 INFO:tasks.rados.rados.0.trial082.stdout:429: writing trial08226312-8 from 1566383 to 2162100 tid 2 2026-02-12T17:30:09.499 INFO:tasks.rados.rados.0.trial082.stdout:429: writing trial08226312-8 from 2888822 to 2991646 tid 3 2026-02-12T17:30:09.499 INFO:tasks.rados.rados.0.trial082.stdout:430: delete oid 41 current snap is 43 2026-02-12T17:30:09.499 INFO:tasks.rados.rados.0.trial082.stdout:420: finishing write tid 2 to trial08226312-14 2026-02-12T17:30:09.499 INFO:tasks.rados.rados.0.trial082.stdout:421: expect (ObjNum 165 snap 40 seq_num 165) 2026-02-12T17:30:09.525 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2478900 2026-02-12T17:30:09.541 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1851956 2026-02-12T17:30:09.591 INFO:tasks.rados.rados.0.trial082.stdout:420: finishing write tid 3 to trial08226312-14 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:420: finishing write tid 4 to trial08226312-14 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:420: oid 14 updating version 0 to 153 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:420: oid 14 updating version 153 to 154 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:420: oid 14 version 154 is already newer than 152 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 154 (ObjNum 175 snap 43 seq_num 175) dirty exists 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:420: left oid 14 (ObjNum 175 snap 43 seq_num 175) 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:422: finishing copy_from racing read to trial08226312-23 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:422: finishing copy_from to trial08226312-23 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 191 (ObjNum 162 snap 40 seq_num 162) dirty exists 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:427: finishing write tid 1 to trial08226312-36 2026-02-12T17:30:09.592 INFO:tasks.rados.rados.0.trial082.stdout:420: done (5 left) 2026-02-12T17:30:09.593 INFO:tasks.rados.rados.0.trial082.stdout:421: done (4 left) 2026-02-12T17:30:09.593 INFO:tasks.rados.rados.0.trial082.stdout:422: done (3 left) 2026-02-12T17:30:09.593 INFO:tasks.rados.rados.0.trial082.stdout:430: done (2 left) 2026-02-12T17:30:09.593 INFO:tasks.rados.rados.0.trial082.stdout:431: write (excl) oid 6 current snap is 43 2026-02-12T17:30:09.593 INFO:tasks.rados.rados.0.trial082.stdout:431: seq_num 180 ranges {625260=620939,1683347=599386,2943668=81592} 2026-02-12T17:30:09.596 INFO:tasks.rados.rados.0.trial082.stdout:431: writing trial08226312-6 from 625260 to 1246199 tid 1 2026-02-12T17:30:09.600 INFO:tasks.rados.rados.0.trial082.stdout:431: writing trial08226312-6 from 1683347 to 2282733 tid 2 2026-02-12T17:30:09.603 INFO:tasks.rados.rados.0.trial082.stdout:431: writing trial08226312-6 from 2943668 to 3025260 tid 3 2026-02-12T17:30:09.603 INFO:tasks.rados.rados.0.trial082.stdout:432: snap_create 2026-02-12T17:30:09.603 INFO:tasks.rados.rados.0.trial082.stdout:427: finishing write tid 2 to trial08226312-36 2026-02-12T17:30:09.603 INFO:tasks.rados.rados.0.trial082.stdout:427: finishing write tid 3 to trial08226312-36 2026-02-12T17:30:09.603 INFO:tasks.rados.rados.0.trial082.stdout:427: finishing write tid 4 to trial08226312-36 2026-02-12T17:30:09.603 INFO:tasks.rados.rados.0.trial082.stdout:427: oid 36 updating version 0 to 261 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:427: oid 36 updating version 261 to 263 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:427: oid 36 version 263 is already newer than 262 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 263 (ObjNum 177 snap 43 seq_num 177) dirty exists 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:427: left oid 36 (ObjNum 177 snap 43 seq_num 177) 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:429: finishing write tid 1 to trial08226312-8 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:429: finishing write tid 2 to trial08226312-8 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:429: finishing write tid 3 to trial08226312-8 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:429: finishing write tid 4 to trial08226312-8 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:429: finishing write tid 5 to trial08226312-8 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:429: oid 8 updating version 0 to 269 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:429: oid 8 version 269 is already newer than 264 2026-02-12T17:30:09.604 INFO:tasks.rados.rados.0.trial082.stdout:429: oid 8 version 269 is already newer than 268 2026-02-12T17:30:09.605 INFO:tasks.rados.rados.0.trial082.stdout:429: oid 8 version 269 is already newer than 267 2026-02-12T17:30:09.605 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 269 (ObjNum 178 snap 43 seq_num 178) dirty exists 2026-02-12T17:30:09.605 INFO:tasks.rados.rados.0.trial082.stdout:429: left oid 8 (ObjNum 178 snap 43 seq_num 178) 2026-02-12T17:30:09.605 INFO:tasks.rados.rados.0.trial082.stdout:431: finishing write tid 1 to trial08226312-6 2026-02-12T17:30:09.605 INFO:tasks.rados.rados.0.trial082.stdout:431: finishing write tid 2 to trial08226312-6 2026-02-12T17:30:09.606 INFO:tasks.rados.rados.0.trial082.stdout:431: finishing write tid 3 to trial08226312-6 2026-02-12T17:30:09.606 INFO:tasks.rados.rados.0.trial082.stdout:431: finishing write tid 4 to trial08226312-6 2026-02-12T17:30:09.606 INFO:tasks.rados.rados.0.trial082.stdout:431: finishing write tid 5 to trial08226312-6 2026-02-12T17:30:09.606 INFO:tasks.rados.rados.0.trial082.stdout:431: oid 6 updating version 0 to 62 2026-02-12T17:30:09.606 INFO:tasks.rados.rados.0.trial082.stdout:431: oid 6 updating version 62 to 63 2026-02-12T17:30:09.606 INFO:tasks.rados.rados.0.trial082.stdout:431: oid 6 version 63 is already newer than 61 2026-02-12T17:30:09.606 INFO:tasks.rados.rados.0.trial082.stdout:431: oid 6 version 63 is already newer than 60 2026-02-12T17:30:09.606 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 63 (ObjNum 180 snap 43 seq_num 180) dirty exists 2026-02-12T17:30:09.606 INFO:tasks.rados.rados.0.trial082.stdout:431: left oid 6 (ObjNum 180 snap 43 seq_num 180) 2026-02-12T17:30:10.234 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:30:10.234 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:30:10.235 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T17:30:10.235 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T17:30:10.248 INFO:tasks.ceph.mon.c:Started 2026-02-12T17:30:10.249 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:30:10.249 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:30:10.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.317+0000 7efe2310c640 10 monclient: get_monmap_and_config 2026-02-12T17:30:10.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.317+0000 7efe2310c640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.317+0000 7efe2310c640 10 monclient: monmap: 2026-02-12T17:30:10.317 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.317 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:10.318759+0000 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:10.318759+0000 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 1 Processor -- start 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 1 -- start start 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 10 monclient: init 2026-02-12T17:30:10.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 10 monclient(hunting): picked mon.noname-c con 0x7efe1c088b20 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 10 monclient(hunting): picked mon.noname-b con 0x7efe1c08a960 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 10 monclient(hunting): picked mon.noname-a con 0x7efe1c089600 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c08a0d0 con 0x7efe1c089600 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c08ba10 con 0x7efe1c088b20 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c08b170 con 0x7efe1c08a960 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe2310c640 10 monclient(hunting): authenticate will time out at 690.137656s 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe13fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7efe1c08a960 0x7efe1c1809c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:33902/0 (socket says 10.20.193.57:33902) 2026-02-12T17:30:10.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.318+0000 7efe13fff640 1 -- 10.20.193.57:0/1343994064 learned_addr learned my addr 10.20.193.57:0/1343994064 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.320+0000 7efe13fff640 1 -- 10.20.193.57:0/1343994064 >> v1:10.20.193.57:6790/0 conn(0x7efe1c08a960 legacy=0x7efe1c1809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.320+0000 7efe21682640 1 -- 10.20.193.57:0/1343994064 >> v1:10.20.193.57:6789/0 conn(0x7efe1c089600 legacy=0x7efe1c1a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 -- 10.20.193.57:0/1343994064 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597614216 0 0) 0x7efe1c08a0d0 con 0x7efe1c089600 2026-02-12T17:30:10.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient(hunting): my global_id is 4524 2026-02-12T17:30:10.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 -- 10.20.193.57:0/1343994064 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe08005870 con 0x7efe1c089600 2026-02-12T17:30:10.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 -- 10.20.193.57:0/1343994064 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2172204195 0 0) 0x7efe08005870 con 0x7efe1c089600 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 -- 10.20.193.57:0/1343994064 >> v1:10.20.193.57:6790/0 conn(0x7efe1c08a960 legacy=0x7efe1c1809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 -- 10.20.193.57:0/1343994064 >> v1:10.20.193.82:6789/0 conn(0x7efe1c088b20 legacy=0x7efe1c088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 monclient: found mon.noname-a 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 -- 10.20.193.57:0/1343994064 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c0574f0 con 0x7efe1c089600 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 -- 10.20.193.57:0/1343994064 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe18004200 con 0x7efe1c089600 2026-02-12T17:30:10.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: dump: 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.328 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 5 monclient: authenticate success, global_id 4524 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 -- 10.20.193.57:0/1343994064 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe18004500 con 0x7efe1c089600 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 1 -- 10.20.193.57:0/1343994064 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe18004960 con 0x7efe1c089600 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe137fe640 10 monclient: dump: 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.329 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 4 set_mon_vals no callback set 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 10 monclient: shutdown 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 1 -- 10.20.193.57:0/1343994064 >> v1:10.20.193.57:6789/0 conn(0x7efe1c089600 legacy=0x7efe1c1a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 1 -- 10.20.193.57:0/1343994064 shutdown_connections 2026-02-12T17:30:10.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 1 -- 10.20.193.57:0/1343994064 >> 10.20.193.57:0/1343994064 conn(0x7efe1c091620 msgr2=0x7efe1c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 1 -- 10.20.193.57:0/1343994064 shutdown_connections 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.321+0000 7efe2310c640 1 -- 10.20.193.57:0/1343994064 wait complete. 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient: monmap: 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:10.331 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 1 Processor -- start 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 1 -- start start 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient: init 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient(hunting): picked mon.noname-c con 0x7efe1c088b20 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient(hunting): picked mon.noname-b con 0x7efe1c089600 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient(hunting): picked mon.noname-a con 0x7efe1c08a960 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c088810 con 0x7efe1c08a960 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c058f90 con 0x7efe1c089600 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c13e100 con 0x7efe1c088b20 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe2310c640 10 monclient(hunting): authenticate will time out at 690.141806s 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe21682640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7efe1c08a960 0x7efe1c2382c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51232/0 (socket says 10.20.193.57:51232) 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe21682640 1 -- 10.20.193.57:0/2530718429 learned_addr learned my addr 10.20.193.57:0/2530718429 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.322+0000 7efe20e81640 1 --1- 10.20.193.57:0/2530718429 >> v1:10.20.193.57:6790/0 conn(0x7efe1c088b20 0x7efe1c1d5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:33916/0 (socket says 10.20.193.57:33916) 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.324+0000 7efe21682640 1 -- 10.20.193.57:0/2530718429 >> v1:10.20.193.57:6789/0 conn(0x7efe1c08a960 legacy=0x7efe1c2382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.324+0000 7efe20e81640 1 -- 10.20.193.57:0/2530718429 >> v1:10.20.193.57:6790/0 conn(0x7efe1c088b20 legacy=0x7efe1c1d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617151490 0 0) 0x7efe1c088810 con 0x7efe1c08a960 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient(hunting): my global_id is 4527 2026-02-12T17:30:10.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdec0035e0 con 0x7efe1c08a960 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2198902891 0 0) 0x7efdec0035e0 con 0x7efe1c08a960 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe1c088810 con 0x7efe1c08a960 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe180047b0 con 0x7efe1c08a960 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient(hunting): dump: 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.334 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 192024264 0 0) 0x7efe1c088810 con 0x7efe1c08a960 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 >> v1:10.20.193.57:6790/0 conn(0x7efe1c088b20 legacy=0x7efe1c1d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 >> v1:10.20.193.82:6789/0 conn(0x7efe1c089600 legacy=0x7efe1c216b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 monclient: found mon.a 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:10.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c13bda0 con 0x7efe1c08a960 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe2310c640 5 monclient: authenticate success, global_id 4527 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe2310c640 10 monclient: _renew_subs 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe2310c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c13de20 con 0x7efe1c08a960 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe2310c640 10 monclient: _renew_subs 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe2310c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efe1c13caa0 con 0x7efe1c08a960 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe18004f40 con 0x7efe1c08a960 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe180052d0 con 0x7efe1c08a960 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe117fa640 10 monclient: dump: 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.337 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.325+0000 7efe12ffd640 4 set_mon_vals no callback set 2026-02-12T17:30:10.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.326+0000 7efe2310c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.326+0000 7efe2310c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.326+0000 7efe2310c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:10.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.326+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c0008d0 con 0x7efe1c08a960 2026-02-12T17:30:10.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.326+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7efe18013470 con 0x7efe1c08a960 2026-02-12T17:30:10.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.326+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(108..108 src has 1..108) ==== 3943+0+0 (unknown 4280216266 0 0) 0x7efe1804fbc0 con 0x7efe1c08a960 2026-02-12T17:30:10.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.326+0000 7efe20e81640 10 monclient: get_auth_request con 0x7efdec03f700 auth_method 0 2026-02-12T17:30:10.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.328+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7efe18018440 con 0x7efe1c08a960 2026-02-12T17:30:10.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.328+0000 7efe117fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.328+0000 7efe117fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:10.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.474+0000 7efe2310c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:30:10.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.474+0000 7efe2310c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:30:10.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.474+0000 7efe2310c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:10.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.474+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efe1c13caa0 con 0x7efe1c08a960 2026-02-12T17:30:10.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.474+0000 7efe117fa640 1 -- 10.20.193.57:0/2530718429 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 555796065) 0x7efe1c13caa0 con 0x7efe1c08a960 2026-02-12T17:30:10.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.474+0000 7efe117fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:30:10.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.474+0000 7efe117fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:10.473 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:30:10.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.475+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 >> v1:10.20.193.82:6800/2441377515 conn(0x7efdec03f700 legacy=0x7efdec05fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.475+0000 7efe2310c640 10 monclient: shutdown 2026-02-12T17:30:10.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.475+0000 7efe2310c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:10.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.475+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 >> v1:10.20.193.57:6789/0 conn(0x7efe1c08a960 legacy=0x7efe1c2382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.475+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 shutdown_connections 2026-02-12T17:30:10.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.475+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 >> 10.20.193.57:0/2530718429 conn(0x7efe1c091620 msgr2=0x7efe1c05c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:10.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.475+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 shutdown_connections 2026-02-12T17:30:10.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.475+0000 7efe2310c640 1 -- 10.20.193.57:0/2530718429 wait complete. 2026-02-12T17:30:10.482 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:30:10.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:30:10.482 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:30:10.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.549+0000 7fc002c3e640 10 monclient: get_monmap_and_config 2026-02-12T17:30:10.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.549+0000 7fc002c3e640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.549+0000 7fc002c3e640 10 monclient: monmap: 2026-02-12T17:30:10.548 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.548 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.548 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:10.550713+0000 2026-02-12T17:30:10.548 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:10.550713+0000 2026-02-12T17:30:10.548 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.548 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.548 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.549 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:10.549 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:10.549 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 1 Processor -- start 2026-02-12T17:30:10.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 1 -- start start 2026-02-12T17:30:10.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 10 monclient: init 2026-02-12T17:30:10.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:30:10.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 10 monclient(hunting): picked mon.noname-a con 0x7fbffc08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 10 monclient(hunting): picked mon.noname-b con 0x7fbffc08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 10 monclient(hunting): picked mon.noname-c con 0x7fbffc182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc08a820 con 0x7fbffc08c250 2026-02-12T17:30:10.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc089450 con 0x7fbffc182cc0 2026-02-12T17:30:10.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc089730 con 0x7fbffc08c620 2026-02-12T17:30:10.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc002c3e640 10 monclient(hunting): authenticate will time out at 690.369729s 2026-02-12T17:30:10.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc0009b3640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbffc08c250 0x7fbffc08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51246/0 (socket says 10.20.193.57:51246) 2026-02-12T17:30:10.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.550+0000 7fc0009b3640 1 -- 10.20.193.57:0/1800809468 learned_addr learned my addr 10.20.193.57:0/1800809468 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.552+0000 7fc0009b3640 1 -- 10.20.193.57:0/1800809468 >> v1:10.20.193.57:6789/0 conn(0x7fbffc08c250 legacy=0x7fbffc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.552+0000 7fbff3fff640 1 -- 10.20.193.57:0/1800809468 >> v1:10.20.193.57:6790/0 conn(0x7fbffc08c620 legacy=0x7fbffc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 -- 10.20.193.57:0/1800809468 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850936767 0 0) 0x7fbfec002c20 con 0x7fbffc08c250 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient(hunting): my global_id is 4530 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 -- 10.20.193.57:0/1800809468 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfe80035e0 con 0x7fbffc08c250 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fc0011b4640 1 -- 10.20.193.57:0/1800809468 >> v1:10.20.193.82:6789/0 conn(0x7fbffc182cc0 legacy=0x7fbffc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 -- 10.20.193.57:0/1800809468 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2298547062 0 0) 0x7fbfe80035e0 con 0x7fbffc08c250 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 -- 10.20.193.57:0/1800809468 >> v1:10.20.193.57:6790/0 conn(0x7fbffc08c620 legacy=0x7fbffc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 -- 10.20.193.57:0/1800809468 >> v1:10.20.193.82:6789/0 conn(0x7fbffc182cc0 legacy=0x7fbffc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 monclient: found mon.noname-a 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 -- 10.20.193.57:0/1800809468 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc089a10 con 0x7fbffc08c250 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 -- 10.20.193.57:0/1800809468 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbfec0032e0 con 0x7fbffc08c250 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:10.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: dump: 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fc002c3e640 5 monclient: authenticate success, global_id 4530 2026-02-12T17:30:10.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fc002c3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 -- 10.20.193.57:0/1800809468 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbfec004960 con 0x7fbffc08c250 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 1 -- 10.20.193.57:0/1800809468 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbfec004cf0 con 0x7fbffc08c250 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fbff37fe640 10 monclient: dump: 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.563 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fc002c3e640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.553+0000 7fc002c3e640 4 set_mon_vals no callback set 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 10 monclient: shutdown 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 1 -- 10.20.193.57:0/1800809468 >> v1:10.20.193.57:6789/0 conn(0x7fbffc08c250 legacy=0x7fbffc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 1 -- 10.20.193.57:0/1800809468 shutdown_connections 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 1 -- 10.20.193.57:0/1800809468 >> 10.20.193.57:0/1800809468 conn(0x7fbffc0916b0 msgr2=0x7fbffc091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 1 -- 10.20.193.57:0/1800809468 shutdown_connections 2026-02-12T17:30:10.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 1 -- 10.20.193.57:0/1800809468 wait complete. 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 10 monclient: monmap: 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:10.565 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 1 Processor -- start 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 1 -- start start 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.554+0000 7fc002c3e640 10 monclient: init 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 10 monclient(hunting): picked mon.noname-a con 0x7fbffc08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 10 monclient(hunting): picked mon.noname-b con 0x7fbffc08c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 10 monclient(hunting): picked mon.noname-c con 0x7fbffc182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc13de60 con 0x7fbffc08c250 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc18e6e0 con 0x7fbffc08c620 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbffc138e40 con 0x7fbffc182cc0 2026-02-12T17:30:10.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc002c3e640 10 monclient(hunting): authenticate will time out at 690.374080s 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc0009b3640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbffc08c250 0x7fbffc136780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51252/0 (socket says 10.20.193.57:51252) 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc0011b4640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbffc182cc0 0x7fbffc193490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:33938/0 (socket says 10.20.193.57:33938) 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.555+0000 7fc0009b3640 1 -- 10.20.193.57:0/2964664721 learned_addr learned my addr 10.20.193.57:0/2964664721 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fc0011b4640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6790/0 conn(0x7fbffc182cc0 legacy=0x7fbffc193490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fc0009b3640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6789/0 conn(0x7fbffc08c250 legacy=0x7fbffc136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff3fff640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.82:6789/0 conn(0x7fbffc08c620 legacy=0x7fbffc136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983017769 0 0) 0x7fbffc138e40 con 0x7fbffc182cc0 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): my global_id is 34100 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfcc0035e0 con 0x7fbffc182cc0 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680119172 0 0) 0x7fbffc13de60 con 0x7fbffc08c250 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): my global_id is 4533 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbffc138e40 con 0x7fbffc08c250 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548375282 0 0) 0x7fbffc18e6e0 con 0x7fbffc08c620 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): my global_id is 4477 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbffc13de60 con 0x7fbffc08c620 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2551336147 0 0) 0x7fbfcc0035e0 con 0x7fbffc182cc0 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbffc18e6e0 con 0x7fbffc182cc0 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbff8004420 con 0x7fbffc182cc0 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): dump: 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.569 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2867036339 0 0) 0x7fbffc138e40 con 0x7fbffc08c250 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbfcc0035e0 con 0x7fbffc08c250 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbfec003130 con 0x7fbffc08c250 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient(hunting): dump: 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.570 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1713370004 0 0) 0x7fbffc18e6e0 con 0x7fbffc182cc0 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.82:6789/0 conn(0x7fbffc08c620 legacy=0x7fbffc136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6789/0 conn(0x7fbffc08c250 legacy=0x7fbffc136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 monclient: found mon.c 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc1375a0 con 0x7fbffc182cc0 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fbff17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fc002c3e640 5 monclient: authenticate success, global_id 34100 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fc002c3e640 10 monclient: _renew_subs 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fc002c3e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbffc139180 con 0x7fbffc182cc0 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fc002c3e640 10 monclient: _renew_subs 2026-02-12T17:30:10.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fc002c3e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.557+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbffc0888a0 con 0x7fbffc182cc0 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fc002c3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbffc090810 con 0x7fbffc05cf10 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbff80045c0 con 0x7fbffc182cc0 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff17fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbff8004c10 con 0x7fbffc182cc0 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff17fa640 10 monclient: dump: 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.573 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fbff8004de0 con 0x7fbffc182cc0 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff2ffd640 4 set_mon_vals no callback set 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(108..108 src has 1..108) ==== 3943+0+0 (unknown 4280216266 0 0) 0x7fbff804fc10 con 0x7fbffc182cc0 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.558+0000 7fbff3fff640 10 monclient: get_auth_request con 0x7fbfcc03fce0 auth_method 0 2026-02-12T17:30:10.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fc0009b3640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6789/0 conn(0x7fbffc05cf10 legacy=0x7fbffc0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887721369 0 0) 0x7fbffc090810 con 0x7fbffc05cf10 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 10 monclient(hunting): my global_id is 4536 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbffc18e6e0 con 0x7fbffc05cf10 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3751827971 0 0) 0x7fbffc18e6e0 con 0x7fbffc05cf10 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbffc090810 con 0x7fbffc05cf10 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbfec0051d0 con 0x7fbffc05cf10 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 10 monclient: dump: 2026-02-12T17:30:10.575 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 466556044 0 0) 0x7fbffc090810 con 0x7fbffc05cf10 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.560+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbffc13f870 con 0x7fbffc05cf10 2026-02-12T17:30:10.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.561+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fbfec005330 con 0x7fbffc05cf10 2026-02-12T17:30:10.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.561+0000 7fbff17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.561+0000 7fbff17fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:10.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.561+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6789/0 conn(0x7fbffc05cf10 legacy=0x7fbffc0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.561+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6789/0 conn(0x7fbffc05cf10 legacy=0x7fbffc0582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:10.578 INFO:tasks.rados.rados.0.trial082.stdout:427: done (3 left) 2026-02-12T17:30:10.578 INFO:tasks.rados.rados.0.trial082.stdout:429: done (2 left) 2026-02-12T17:30:10.578 INFO:tasks.rados.rados.0.trial082.stdout:431: done (1 left) 2026-02-12T17:30:10.578 INFO:tasks.rados.rados.0.trial082.stdout:432: done (0 left) 2026-02-12T17:30:10.578 INFO:tasks.rados.rados.0.trial082.stdout:433: delete oid 10 current snap is 44 2026-02-12T17:30:10.578 INFO:tasks.rados.rados.0.trial082.stdout:433: done (0 left) 2026-02-12T17:30:10.578 INFO:tasks.rados.rados.0.trial082.stdout:434: snap_remove snap 43 2026-02-12T17:30:10.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.564+0000 7fc002c3e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:30:10.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.564+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbffc05d2e0 con 0x7fbffc0589d0 2026-02-12T17:30:10.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fc0009b3640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6789/0 conn(0x7fbffc0589d0 legacy=0x7fbffc195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683118584 0 0) 0x7fbffc05d2e0 con 0x7fbffc0589d0 2026-02-12T17:30:10.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 10 monclient(hunting): my global_id is 4539 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbffc090810 con 0x7fbffc0589d0 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1289904538 0 0) 0x7fbffc090810 con 0x7fbffc0589d0 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbffc05d2e0 con 0x7fbffc0589d0 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbfec005970 con 0x7fbffc0589d0 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.566+0000 7fbff17fa640 10 monclient: dump: 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.581 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.567+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2323434085 0 0) 0x7fbffc05d2e0 con 0x7fbffc0589d0 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.567+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbffc08f580 con 0x7fbffc0589d0 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4507 (unknown 0 0 1020450110) 0x7fbfec0071b0 con 0x7fbffc0589d0 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fbff17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fbff17fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6789/0 conn(0x7fbffc0589d0 legacy=0x7fbffc195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fbff17fa640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6789/0 conn(0x7fbffc0589d0 legacy=0x7fbffc195bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 14, 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 132100, 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:30:10.583 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:10.584 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:10.585 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:30:10.586 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:10.587 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:10.588 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:10.589 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.590 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:30:10.591 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:30:10.592 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:30:10.593 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:30:10.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.82:6800/2441377515 conn(0x7fbfcc03fce0 legacy=0x7fbfcc060190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc002c3e640 10 monclient: shutdown 2026-02-12T17:30:10.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc002c3e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:10.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 >> v1:10.20.193.57:6790/0 conn(0x7fbffc182cc0 legacy=0x7fbffc193490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc0011b4640 1 -- 10.20.193.57:0/2964664721 reap_dead start 2026-02-12T17:30:10.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc0011b4640 1 -- 10.20.193.57:0/2964664721 reap_dead start 2026-02-12T17:30:10.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 shutdown_connections 2026-02-12T17:30:10.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 >> 10.20.193.57:0/2964664721 conn(0x7fbffc0916b0 msgr2=0x7fbffc08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:10.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 shutdown_connections 2026-02-12T17:30:10.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.568+0000 7fc002c3e640 1 -- 10.20.193.57:0/2964664721 wait complete. 2026-02-12T17:30:10.595 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:30:10.595 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:30:10.595 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:30:10.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient: get_monmap_and_config 2026-02-12T17:30:10.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient: monmap: 2026-02-12T17:30:10.662 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.662 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.662 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:10.664937+0000 2026-02-12T17:30:10.663 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:10.664937+0000 2026-02-12T17:30:10.663 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.663 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.663 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.663 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:10.663 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:10.663 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 1 Processor -- start 2026-02-12T17:30:10.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 1 -- start start 2026-02-12T17:30:10.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient: init 2026-02-12T17:30:10.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient(hunting): picked mon.noname-a con 0x7fd21008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient(hunting): picked mon.noname-c con 0x7fd21008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient(hunting): picked mon.noname-b con 0x7fd210182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21008a820 con 0x7fd21008c250 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd210089450 con 0x7fd21008c620 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd210089730 con 0x7fd210182cc0 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd21790c640 10 monclient(hunting): authenticate will time out at 690.483845s 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd215681640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd21008c250 0x7fd21008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51290/0 (socket says 10.20.193.57:51290) 2026-02-12T17:30:10.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.664+0000 7fd215681640 1 -- 10.20.193.57:0/2958500764 learned_addr learned my addr 10.20.193.57:0/2958500764 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd215681640 1 -- 10.20.193.57:0/2958500764 >> v1:10.20.193.57:6789/0 conn(0x7fd21008c250 legacy=0x7fd21008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd215e82640 1 -- 10.20.193.57:0/2958500764 >> v1:10.20.193.57:6790/0 conn(0x7fd210182cc0 legacy=0x7fd2101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942249411 0 0) 0x7fd200002c20 con 0x7fd21008c250 2026-02-12T17:30:10.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient(hunting): my global_id is 4542 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1f80035e0 con 0x7fd21008c250 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885256152 0 0) 0x7fd210089730 con 0x7fd210182cc0 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient(hunting): my global_id is 34103 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd200002c20 con 0x7fd210182cc0 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd214e80640 1 -- 10.20.193.57:0/2958500764 >> v1:10.20.193.82:6789/0 conn(0x7fd21008c620 legacy=0x7fd21008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1015944161 0 0) 0x7fd1f80035e0 con 0x7fd21008c250 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 >> v1:10.20.193.57:6790/0 conn(0x7fd210182cc0 legacy=0x7fd2101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 >> v1:10.20.193.82:6789/0 conn(0x7fd21008c620 legacy=0x7fd21008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 monclient: found mon.noname-a 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd210089a10 con 0x7fd21008c250 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2000032e0 con 0x7fd21008c250 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: dump: 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.670 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 5 monclient: authenticate success, global_id 4542 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd200004960 con 0x7fd21008c250 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 1 -- 10.20.193.57:0/2958500764 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd200004cf0 con 0x7fd21008c250 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd1fffff640 10 monclient: dump: 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.671 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 4 set_mon_vals no callback set 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 10 monclient: shutdown 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 1 -- 10.20.193.57:0/2958500764 >> v1:10.20.193.57:6789/0 conn(0x7fd21008c250 legacy=0x7fd21008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 1 -- 10.20.193.57:0/2958500764 shutdown_connections 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 1 -- 10.20.193.57:0/2958500764 >> 10.20.193.57:0/2958500764 conn(0x7fd2100916b0 msgr2=0x7fd210091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 1 -- 10.20.193.57:0/2958500764 shutdown_connections 2026-02-12T17:30:10.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.667+0000 7fd21790c640 1 -- 10.20.193.57:0/2958500764 wait complete. 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient: monmap: 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 1 Processor -- start 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 1 -- start start 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient: init 2026-02-12T17:30:10.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient(hunting): picked mon.noname-a con 0x7fd21008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient(hunting): picked mon.noname-c con 0x7fd21008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient(hunting): picked mon.noname-b con 0x7fd210182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd210086540 con 0x7fd21008c250 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21013e8e0 con 0x7fd210182cc0 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2100888a0 con 0x7fd21008c620 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd21790c640 10 monclient(hunting): authenticate will time out at 690.487744s 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd214e80640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fd21008c620 0x7fd210085e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:33958/0 (socket says 10.20.193.57:33958) 2026-02-12T17:30:10.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.668+0000 7fd214e80640 1 -- 10.20.193.57:0/4239241542 learned_addr learned my addr 10.20.193.57:0/4239241542 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.670+0000 7fd214e80640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6790/0 conn(0x7fd21008c620 legacy=0x7fd210085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.670+0000 7fd215681640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6789/0 conn(0x7fd21008c250 legacy=0x7fd210085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.670+0000 7fd215681640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6789/0 conn(0x7fd21008c250 legacy=0x7fd210085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.670+0000 7fd215681640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6789/0 conn(0x7fd21008c250 legacy=0x7fd210085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.670+0000 7fd215681640 1 --1- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6789/0 conn(0x7fd21008c250 0x7fd210085720 :-1 s=OPENED pgs=218 gs=1 cs=1 l=1).handle_message read tag failed 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.670+0000 7fd215681640 1 --1- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6789/0 conn(0x7fd21008c250 0x7fd210085720 :-1 s=OPENED pgs=218 gs=1 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd215e82640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.82:6789/0 conn(0x7fd210182cc0 legacy=0x7fd2101954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.57:6789/0 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719209528 0 0) 0x7fd2100888a0 con 0x7fd21008c620 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient(hunting): my global_id is 34106 2026-02-12T17:30:10.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e00035e0 con 0x7fd21008c620 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1681640768 0 0) 0x7fd1e00035e0 con 0x7fd21008c620 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2100888a0 con 0x7fd21008c620 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2040033e0 con 0x7fd21008c620 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient(hunting): dump: 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.680 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 875330187 0 0) 0x7fd2100888a0 con 0x7fd21008c620 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.82:6789/0 conn(0x7fd210182cc0 legacy=0x7fd2101954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6789/0 conn(0x7fd21008c250 legacy=0x7fd210085720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 monclient: found mon.c 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21005d9e0 con 0x7fd21008c620 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd21790c640 5 monclient: authenticate success, global_id 34106 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd21790c640 10 monclient: _renew_subs 2026-02-12T17:30:10.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd21790c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd21013b2f0 con 0x7fd21008c620 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd21790c640 10 monclient: _renew_subs 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd21790c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd210087720 con 0x7fd21008c620 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd204003980 con 0x7fd21008c620 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd204003ca0 con 0x7fd21008c620 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1ff7fe640 4 set_mon_vals no callback set 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.671+0000 7fd1fdffb640 10 monclient: dump: 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.682 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.672+0000 7fd21790c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.672+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd210090810 con 0x7fd21005d040 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.672+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fd204003eb0 con 0x7fd21008c620 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.672+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(109..109 src has 1..109) ==== 3915+0+0 (unknown 93371380 0 0) 0x7fd20404ed10 con 0x7fd21008c620 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.672+0000 7fd215e82640 10 monclient: get_auth_request con 0x7fd1e003f720 auth_method 0 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd215681640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6790/0 conn(0x7fd21005d040 legacy=0x7fd2100582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764899179 0 0) 0x7fd210090810 con 0x7fd21005d040 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 10 monclient(hunting): my global_id is 34109 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2100888a0 con 0x7fd21005d040 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1909423842 0 0) 0x7fd2100888a0 con 0x7fd21005d040 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd210090810 con 0x7fd21005d040 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd200003130 con 0x7fd21005d040 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 10 monclient: dump: 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.684 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2451598479 0 0) 0x7fd210090810 con 0x7fd21005d040 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd21005d410 con 0x7fd21005d040 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd200003450 con 0x7fd21005d040 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6790/0 conn(0x7fd21005d040 legacy=0x7fd2100582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.674+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6790/0 conn(0x7fd21005d040 legacy=0x7fd2100582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.678+0000 7fd21790c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.678+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd21008f5b0 con 0x7fd2100589d0 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd215681640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6790/0 conn(0x7fd2100589d0 legacy=0x7fd210197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290325870 0 0) 0x7fd21008f5b0 con 0x7fd2100589d0 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 10 monclient(hunting): my global_id is 34112 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd210090810 con 0x7fd2100589d0 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 18518290 0 0) 0x7fd210090810 con 0x7fd2100589d0 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd21008f5b0 con 0x7fd2100589d0 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2000053c0 con 0x7fd2100589d0 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 10 monclient: dump: 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.686 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 290046053 0 0) 0x7fd21008f5b0 con 0x7fd2100589d0 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.680+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd210055340 con 0x7fd2100589d0 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4335 (unknown 0 0 2592883996) 0x7fd200007640 con 0x7fd2100589d0 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd1fdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd1fdffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6790/0 conn(0x7fd2100589d0 legacy=0x7fd210197be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd1fdffb640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6790/0 conn(0x7fd2100589d0 legacy=0x7fd210197be0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:10.687 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 14, 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 369, 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:30:10.688 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.689 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:10.690 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:30:10.691 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:10.692 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.693 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.694 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:10.695 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:10.696 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:30:10.697 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:30:10.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.82:6800/2441377515 conn(0x7fd1e003f720 legacy=0x7fd1e005fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd21790c640 10 monclient: shutdown 2026-02-12T17:30:10.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd21790c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:10.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd215e82640 1 -- 10.20.193.57:0/4239241542 reap_dead start 2026-02-12T17:30:10.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 >> v1:10.20.193.57:6790/0 conn(0x7fd21008c620 legacy=0x7fd210085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 shutdown_connections 2026-02-12T17:30:10.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 >> 10.20.193.57:0/4239241542 conn(0x7fd2100916b0 msgr2=0x7fd21008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:10.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 shutdown_connections 2026-02-12T17:30:10.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.681+0000 7fd21790c640 1 -- 10.20.193.57:0/4239241542 wait complete. 2026-02-12T17:30:10.699 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:30:10.699 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:30:10.699 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:30:10.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.767+0000 7f2cf130c640 10 monclient: get_monmap_and_config 2026-02-12T17:30:10.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.767+0000 7f2cf130c640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.767+0000 7f2cf130c640 10 monclient: monmap: 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:10.768753+0000 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:10.768753+0000 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:10.766 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 1 Processor -- start 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 1 -- start start 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 10 monclient: init 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 10 monclient(hunting): picked mon.noname-c con 0x7f2cec08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 10 monclient(hunting): picked mon.noname-a con 0x7f2cec08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 10 monclient(hunting): picked mon.noname-b con 0x7f2cec182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec08a820 con 0x7f2cec08c620 2026-02-12T17:30:10.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec089450 con 0x7f2cec08c250 2026-02-12T17:30:10.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec089730 con 0x7f2cec182cc0 2026-02-12T17:30:10.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cf130c640 10 monclient(hunting): authenticate will time out at 690.587688s 2026-02-12T17:30:10.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cea7fc640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f2cec08c620 0x7f2cec08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51302/0 (socket says 10.20.193.57:51302) 2026-02-12T17:30:10.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.768+0000 7f2cea7fc640 1 -- 10.20.193.57:0/2568750545 learned_addr learned my addr 10.20.193.57:0/2568750545 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.770+0000 7f2ceb7fe640 1 -- 10.20.193.57:0/2568750545 >> v1:10.20.193.57:6790/0 conn(0x7f2cec182cc0 legacy=0x7f2cec1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.770+0000 7f2cea7fc640 1 -- 10.20.193.57:0/2568750545 >> v1:10.20.193.57:6789/0 conn(0x7f2cec08c620 legacy=0x7f2cec08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ceaffd640 1 -- 10.20.193.57:0/2568750545 >> v1:10.20.193.82:6789/0 conn(0x7f2cec08c250 legacy=0x7f2cec08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1305176226 0 0) 0x7f2cec089730 con 0x7f2cec182cc0 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): my global_id is 34115 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cd80035e0 con 0x7f2cec182cc0 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2662396571 0 0) 0x7f2cd4002b50 con 0x7f2cec08c620 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): my global_id is 4545 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cec089730 con 0x7f2cec08c620 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643991687 0 0) 0x7f2cec089450 con 0x7f2cec08c250 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient(hunting): my global_id is 4480 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cd4002b50 con 0x7f2cec08c250 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 846559736 0 0) 0x7f2cd80035e0 con 0x7f2cec182cc0 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 >> v1:10.20.193.82:6789/0 conn(0x7f2cec08c250 legacy=0x7f2cec08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 >> v1:10.20.193.57:6789/0 conn(0x7f2cec08c620 legacy=0x7f2cec08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 monclient: found mon.noname-b 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec089a10 con 0x7f2cec182cc0 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2cdc004280 con 0x7f2cec182cc0 2026-02-12T17:30:10.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 5 monclient: authenticate success, global_id 34115 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: dump: 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:10.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cdc0044d0 con 0x7f2cec182cc0 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 1 -- 10.20.193.57:0/2568750545 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2cdc004960 con 0x7f2cec182cc0 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2ce9ffb640 10 monclient: dump: 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 4 set_mon_vals no callback set 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 10 monclient: shutdown 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 1 -- 10.20.193.57:0/2568750545 >> v1:10.20.193.57:6790/0 conn(0x7f2cec182cc0 legacy=0x7f2cec1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 1 -- 10.20.193.57:0/2568750545 shutdown_connections 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 1 -- 10.20.193.57:0/2568750545 >> 10.20.193.57:0/2568750545 conn(0x7f2cec0916b0 msgr2=0x7f2cec091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 1 -- 10.20.193.57:0/2568750545 shutdown_connections 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.771+0000 7f2cf130c640 1 -- 10.20.193.57:0/2568750545 wait complete. 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient: monmap: 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.776 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 1 Processor -- start 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 1 -- start start 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient: init 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient(hunting): picked mon.noname-c con 0x7f2cec08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient(hunting): picked mon.noname-a con 0x7f2cec08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient(hunting): picked mon.noname-b con 0x7f2cec182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec086ee0 con 0x7f2cec08c620 2026-02-12T17:30:10.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec05e770 con 0x7f2cec182cc0 2026-02-12T17:30:10.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec05d890 con 0x7f2cec08c250 2026-02-12T17:30:10.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2cf130c640 10 monclient(hunting): authenticate will time out at 690.591707s 2026-02-12T17:30:10.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2ceaffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f2cec08c250 0x7f2cec05ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:33996/0 (socket says 10.20.193.57:33996) 2026-02-12T17:30:10.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.772+0000 7f2ceaffd640 1 -- 10.20.193.57:0/270858533 learned_addr learned my addr 10.20.193.57:0/270858533 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.774+0000 7f2ceaffd640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.57:6790/0 conn(0x7f2cec08c250 legacy=0x7f2cec05ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.774+0000 7f2cea7fc640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.57:6789/0 conn(0x7f2cec08c620 legacy=0x7f2cec05d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.774+0000 7f2ceb7fe640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.82:6789/0 conn(0x7f2cec182cc0 legacy=0x7f2cec1953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.774+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561165365 0 0) 0x7f2cec05d890 con 0x7f2cec08c250 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.774+0000 7f2ccb7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.774+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.774+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.774+0000 7f2ccb7fe640 10 monclient(hunting): my global_id is 34118 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb80035e0 con 0x7f2cec08c250 2026-02-12T17:30:10.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 110579231 0 0) 0x7f2cec086ee0 con 0x7f2cec08c620 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): my global_id is 4548 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cec05d890 con 0x7f2cec08c620 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1174516008 0 0) 0x7f2cec05e770 con 0x7f2cec182cc0 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): my global_id is 4483 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cec086ee0 con 0x7f2cec182cc0 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1432570324 0 0) 0x7f2cb80035e0 con 0x7f2cec08c250 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cec05e770 con 0x7f2cec08c250 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2ce0003310 con 0x7f2cec08c250 2026-02-12T17:30:10.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): dump: 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3902569505 0 0) 0x7f2cec05d890 con 0x7f2cec08c620 2026-02-12T17:30:10.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cb80035e0 con 0x7f2cec08c620 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2cd40048a0 con 0x7f2cec08c620 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): dump: 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 820091990 0 0) 0x7f2cec086ee0 con 0x7f2cec182cc0 2026-02-12T17:30:10.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cec05d890 con 0x7f2cec182cc0 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2cdc004960 con 0x7f2cec182cc0 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient(hunting): dump: 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 591605241 0 0) 0x7f2cec05e770 con 0x7f2cec08c250 2026-02-12T17:30:10.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.82:6789/0 conn(0x7f2cec182cc0 legacy=0x7f2cec1953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.57:6789/0 conn(0x7f2cec08c620 legacy=0x7f2cec05d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 monclient: found mon.c 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec13ec00 con 0x7f2cec08c250 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2cf130c640 5 monclient: authenticate success, global_id 34118 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2cf130c640 10 monclient: _renew_subs 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2cf130c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec0888a0 con 0x7f2cec08c250 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2cf130c640 10 monclient: _renew_subs 2026-02-12T17:30:10.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2cf130c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2cec13ade0 con 0x7f2cec08c250 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ce0003980 con 0x7f2cec08c250 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2ce0003cd0 con 0x7f2cec08c250 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ccb7fe640 10 monclient: dump: 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.789 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2ce97fa640 4 set_mon_vals no callback set 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2cf130c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.775+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2cec090810 con 0x7f2cec057290 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.776+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f2ce0003e70 con 0x7f2cec08c250 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.776+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(109..109 src has 1..109) ==== 3915+0+0 (unknown 93371380 0 0) 0x7f2ce004ead0 con 0x7f2cec08c250 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.776+0000 7f2ceb7fe640 10 monclient: get_auth_request con 0x7f2cb8040000 auth_method 0 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2cea7fc640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.82:6789/0 conn(0x7f2cec057290 legacy=0x7f2cec057660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500331753 0 0) 0x7f2cec090810 con 0x7f2cec057290 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 10 monclient(hunting): my global_id is 4486 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cec05e770 con 0x7f2cec057290 2026-02-12T17:30:10.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3939323182 0 0) 0x7f2cec05e770 con 0x7f2cec057290 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cec090810 con 0x7f2cec057290 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2cd4003170 con 0x7f2cec057290 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 10 monclient: dump: 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 206989794 0 0) 0x7f2cec090810 con 0x7f2cec057290 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.778+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cec08f040 con 0x7f2cec057290 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.779+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f2cd40050c0 con 0x7f2cec057290 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.779+0000 7f2ccb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.779+0000 7f2ccb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.779+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.82:6789/0 conn(0x7f2cec057290 legacy=0x7f2cec057660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.779+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.82:6789/0 conn(0x7f2cec057290 legacy=0x7f2cec057660 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.782+0000 7f2cf130c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.782+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2cec055340 con 0x7f2cec057d70 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2cea7fc640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.82:6789/0 conn(0x7f2cec057d70 legacy=0x7f2cec197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3247658333 0 0) 0x7f2cec055340 con 0x7f2cec057d70 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 10 monclient(hunting): my global_id is 4489 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cec090810 con 0x7f2cec057d70 2026-02-12T17:30:10.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1974128640 0 0) 0x7f2cec090810 con 0x7f2cec057d70 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cec055340 con 0x7f2cec057d70 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2cd40056e0 con 0x7f2cec057d70 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.784+0000 7f2ccb7fe640 10 monclient: dump: 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2753207216 0 0) 0x7f2cec055340 con 0x7f2cec057d70 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2cec058170 con 0x7f2cec057d70 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 4054353256) 0x7f2cd4006be0 con 0x7f2cec057d70 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2ccb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2ccb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.82:6789/0 conn(0x7f2cec057d70 legacy=0x7f2cec197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2ccb7fe640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.82:6789/0 conn(0x7f2cec057d70 legacy=0x7f2cec197b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:10.794 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 14, 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 132281, 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:10.795 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:10.796 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:30:10.797 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:10.798 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.799 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:10.800 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:10.801 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.802 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:10.803 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:10.804 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:10.804 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:10.804 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:10.804 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:10.804 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:10.804 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:30:10.804 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.82:6800/2441377515 conn(0x7f2cb8040000 legacy=0x7f2cb80604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2cf130c640 10 monclient: shutdown 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2cf130c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 >> v1:10.20.193.57:6790/0 conn(0x7f2cec08c250 legacy=0x7f2cec05ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2ceb7fe640 1 -- 10.20.193.57:0/270858533 reap_dead start 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2ceb7fe640 1 -- 10.20.193.57:0/270858533 reap_dead start 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 shutdown_connections 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 >> 10.20.193.57:0/270858533 conn(0x7f2cec0916b0 msgr2=0x7f2cec13fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 shutdown_connections 2026-02-12T17:30:10.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.785+0000 7f2cf130c640 1 -- 10.20.193.57:0/270858533 wait complete. 2026-02-12T17:30:10.806 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:30:10.806 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:30:10.806 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient: get_monmap_and_config 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient: monmap: 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:10.874945+0000 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:10.874945+0000 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:10.873 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 1 Processor -- start 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 1 -- start start 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient: init 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient(hunting): picked mon.noname-c con 0x7f441408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient(hunting): picked mon.noname-b con 0x7f441408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient(hunting): picked mon.noname-a con 0x7f441408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441408d600 con 0x7f441408cb30 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441408b1f0 con 0x7f441408ae20 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441408d1f0 con 0x7f441408c730 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4419fa5640 10 monclient(hunting): authenticate will time out at 690.693815s 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4412ffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 0x7f4414181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:34012/0 (socket says 10.20.193.57:34012) 2026-02-12T17:30:10.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4412ffd640 1 -- 10.20.193.57:0/1286818714 learned_addr learned my addr 10.20.193.57:0/1286818714 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.874+0000 7f4413fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f441408cb30 0x7f44141a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51320/0 (socket says 10.20.193.57:51320) 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4413fff640 1 -- 10.20.193.57:0/1286818714 >> v1:10.20.193.57:6789/0 conn(0x7f441408cb30 legacy=0x7f44141a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4412ffd640 1 -- 10.20.193.57:0/1286818714 >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 legacy=0x7f4414181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44137fe640 1 -- 10.20.193.57:0/1286818714 >> v1:10.20.193.82:6789/0 conn(0x7f441408ae20 legacy=0x7f441408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 244434462 0 0) 0x7f441408d600 con 0x7f441408cb30 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): my global_id is 4551 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43f80035e0 con 0x7f441408cb30 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832900637 0 0) 0x7f441408d1f0 con 0x7f441408c730 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): my global_id is 34121 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f441408d600 con 0x7f441408c730 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1702855150 0 0) 0x7f441408b1f0 con 0x7f441408ae20 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient(hunting): my global_id is 4492 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f441408d1f0 con 0x7f441408ae20 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1027186447 0 0) 0x7f43f80035e0 con 0x7f441408cb30 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 legacy=0x7f4414181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 >> v1:10.20.193.82:6789/0 conn(0x7f441408ae20 legacy=0x7f441408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 monclient: found mon.noname-a 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4413fff640 1 --1- 10.20.193.57:0/1286818714 >> v1:10.20.193.57:6789/0 conn(0x7f441408cb30 0x7f44141a3310 :-1 s=OPENED pgs=221 gs=3 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f4408004230 mon_map magic: 0 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4414057320 con 0x7f441408cb30 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4419fa5640 5 monclient: authenticate success, global_id 4551 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4419fa5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4408004230 con 0x7f441408cb30 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient: dump: 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44080043c0 con 0x7f441408cb30 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4419fa5640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4419fa5640 4 set_mon_vals no callback set 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4419fa5640 10 monclient: shutdown 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4419fa5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4419fa5640 1 -- 10.20.193.57:0/1286818714 >> v1:10.20.193.57:6789/0 conn(0x7f441408cb30 legacy=0x7f44141a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 1 -- 10.20.193.57:0/1286818714 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4408005980 con 0x7f441408cb30 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f44127fc640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4419fa5640 1 -- 10.20.193.57:0/1286818714 shutdown_connections 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.877+0000 7f4419fa5640 1 -- 10.20.193.57:0/1286818714 >> 10.20.193.57:0/1286818714 conn(0x7f4414091620 msgr2=0x7f4414091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 1 -- 10.20.193.57:0/1286818714 shutdown_connections 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 1 -- 10.20.193.57:0/1286818714 wait complete. 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient: build_initial_monmap 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient: monmap: 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:10.881 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 1 Processor -- start 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 1 -- start start 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient: init 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient(hunting): picked mon.noname-b con 0x7f441408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient(hunting): picked mon.noname-c con 0x7f441408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient(hunting): picked mon.noname-a con 0x7f441408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441408d9c0 con 0x7f441408cb30 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4414088810 con 0x7f441408ae20 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4414083220 con 0x7f441408c730 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4419fa5640 10 monclient(hunting): authenticate will time out at 690.697925s 2026-02-12T17:30:10.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4412ffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 0x7f4414194260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:34020/0 (socket says 10.20.193.57:34020) 2026-02-12T17:30:10.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4413fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f441408cb30 0x7f4414195980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51330/0 (socket says 10.20.193.57:51330) 2026-02-12T17:30:10.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.878+0000 7f4412ffd640 1 -- 10.20.193.57:0/1046592628 learned_addr learned my addr 10.20.193.57:0/1046592628 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:10.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4412ffd640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 legacy=0x7f4414194260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4413fff640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6789/0 conn(0x7f441408cb30 legacy=0x7f4414195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229461569 0 0) 0x7f4414083220 con 0x7f441408c730 2026-02-12T17:30:10.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): my global_id is 34124 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e40035e0 con 0x7f441408c730 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900131701 0 0) 0x7f441408d9c0 con 0x7f441408cb30 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): my global_id is 4554 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4414083220 con 0x7f441408cb30 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f44137fe640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.82:6789/0 conn(0x7f441408ae20 legacy=0x7f4414152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1350839214 0 0) 0x7f43e40035e0 con 0x7f441408c730 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f441408d9c0 con 0x7f441408c730 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4404003560 con 0x7f441408c730 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:30:10.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): dump: 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2477051069 0 0) 0x7f4414083220 con 0x7f441408cb30 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43e40035e0 con 0x7f441408cb30 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4408004080 con 0x7f441408cb30 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:10.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): dump: 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659642452 0 0) 0x7f4414088810 con 0x7f441408ae20 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _negotiate 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient(hunting): my global_id is 4495 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4414083220 con 0x7f441408ae20 2026-02-12T17:30:10.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3798139006 0 0) 0x7f441408d9c0 con 0x7f441408c730 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.82:6789/0 conn(0x7f441408ae20 legacy=0x7f4414152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6789/0 conn(0x7f441408cb30 legacy=0x7f4414195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient: _finish_hunting 0 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 monclient: found mon.c 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4414084ce0 con 0x7f441408c730 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient: _finish_auth 0 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient: _check_auth_tickets 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4419fa5640 5 monclient: authenticate success, global_id 34124 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4419fa5640 10 monclient: _renew_subs 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4419fa5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4419fa5640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4414085020 con 0x7f441408c730 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4419fa5640 10 monclient: _renew_subs 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4419fa5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4419fa5640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4414085f60 con 0x7f441408c730 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4404004bc0 con 0x7f441408c730 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4404004f50 con 0x7f441408c730 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f4411ffb640 4 set_mon_vals no callback set 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.881+0000 7f43effff640 10 monclient: dump: 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:10.890 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.882+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f44040051e0 con 0x7f441408c730 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.882+0000 7f4419fa5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.882+0000 7f4419fa5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.882+0000 7f4419fa5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.882+0000 7f4419fa5640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44140008d0 con 0x7f441408c730 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.882+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(109..109 src has 1..109) ==== 3915+0+0 (unknown 93371380 0 0) 0x7f440404ed80 con 0x7f441408c730 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.882+0000 7f44137fe640 10 monclient: get_auth_request con 0x7f43e403fc40 auth_method 0 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.885+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f44040174b0 con 0x7f441408c730 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.885+0000 7f43effff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:10.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:10.885+0000 7f43effff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:11.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4419fa5640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:30:11.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4419fa5640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:30:11.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4419fa5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:11.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4419fa5640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f4414084e70 con 0x7f441408c730 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4412ffd640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 legacy=0x7f4414194260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4412ffd640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 legacy=0x7f4414194260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4412ffd640 1 --1- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 0x7f4414194260 :-1 s=OPENED pgs=82 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4412ffd640 1 --1- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 0x7f4414194260 :-1 s=OPENED pgs=82 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 10 monclient: ms_handle_reset current mon v1:10.20.193.57:6790/0 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6790/0 conn(0x7f441408c730 legacy=0x7f4414194260 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 10 monclient(hunting): picked mon.b con 0x7f441408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 10 monclient(hunting): picked mon.c con 0x7f43e4086690 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 10 monclient(hunting): picked mon.a con 0x7f441408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:11.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f441408d9c0 con 0x7f441408cb30 2026-02-12T17:30:11.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4414088810 con 0x7f441408ae20 2026-02-12T17:30:11.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f43e40cc270 con 0x7f43e4086690 2026-02-12T17:30:11.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:11.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4412ffd640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.82:6789/0 conn(0x7f441408ae20 legacy=0x7f43e4084e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T17:30:11.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4412ffd640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.82:6789/0 conn(0x7f441408ae20 legacy=0x7f43e4084e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:30:11.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4412ffd640 1 --1- 10.20.193.57:0/1046592628 >> v1:10.20.193.82:6789/0 conn(0x7f441408ae20 0x7f43e4084e40 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=5 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-12T17:30:11.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f4412ffd640 1 --1- 10.20.193.57:0/1046592628 >> v1:10.20.193.82:6789/0 conn(0x7f441408ae20 0x7f43e4084e40 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=5 cs=0 l=1).fault on lossy channel, failing 2026-02-12T17:30:11.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.030+0000 7f43effff640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.82:6789/0 2026-02-12T17:30:11.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f44137fe640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6789/0 conn(0x7f441408cb30 legacy=0x7f43e40c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:11.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f4413fff640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6790/0 conn(0x7f43e4086690 legacy=0x7f43e40a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:11.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285362037 0 0) 0x7f43e40cc270 con 0x7f43e4086690 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient(hunting): _negotiate 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f43e40ca210 con 0x7f43e4086690 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485348249 0 0) 0x7f441408d9c0 con 0x7f441408cb30 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient(hunting): _negotiate 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f43e40cc270 con 0x7f441408cb30 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1286764737 0 0) 0x7f43e40ca210 con 0x7f43e4086690 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.82:6789/0 conn(0x7f441408ae20 legacy=0x7f43e4084e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:11.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 >> v1:10.20.193.57:6789/0 conn(0x7f441408cb30 legacy=0x7f43e40c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: _finish_hunting 0 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 monclient: found mon.c 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f43e40cd4d0 con 0x7f43e4086690 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f441408d9c0 con 0x7f43e4086690 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: _finish_auth 0 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: _check_auth_tickets 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4408005b30 con 0x7f43e4086690 2026-02-12T17:30:11.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: dump: 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:11.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4408006090 con 0x7f43e4086690 2026-02-12T17:30:11.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f43effff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:11.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.032+0000 7f4411ffb640 4 set_mon_vals no callback set 2026-02-12T17:30:11.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.033+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f4408012d10 con 0x7f43e4086690 2026-02-12T17:30:11.038 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.039+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.038 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.039+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=13,kv=11,logm=64} crc {auth=38835164,config=1618278320,health=2358046931,kv=1466688342,logm=3641963423}) 2026-02-12T17:30:11.038 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.039+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=10,config=2,health=12,kv=11,logm=65} crc {auth=38835164,config=1618278320,health=175251547,kv=1466688342,logm=2291039737}) 2026-02-12T17:30:11.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.039+0000 7f43effff640 1 -- 10.20.193.57:0/1046592628 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_command_ack([{"prefix": "mon scrub"}]=-16 v0) ==== 57+0+0 (unknown 304018148 0 0) 0x7f4408017d30 con 0x7f43e4086690 2026-02-12T17:30:11.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.039+0000 7f43effff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:30:11.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:11.039+0000 7f43effff640 10 monclient: _finish_command 2 = mon:16 2026-02-12T17:30:11.039 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.039+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.039 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.039+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=13,kv=11,logm=64} crc {auth=38835164,config=1618278320,health=2358046931,kv=1466688342,logm=3641963423}) 2026-02-12T17:30:11.039 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.039+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=10,config=2,health=13,kv=11,logm=64} crc {auth=2511381803,config=1618278320,health=2829556894,kv=1466688342,logm=3955199301}) 2026-02-12T17:30:11.039 INFO:teuthology.orchestra.run.trial057.stderr:Error EBUSY: 2026-02-12T17:30:11.043 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.040+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.043 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.040+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3334596259}) 2026-02-12T17:30:11.043 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.040+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2799842026}) 2026-02-12T17:30:11.043 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.040+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.043 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.040+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3334596259}) 2026-02-12T17:30:11.043 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.040+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1864918748}) 2026-02-12T17:30:11.043 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2404998015}) 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1442443469}) 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2404998015}) 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3376065532}) 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978962207}) 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3008538524}) 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978962207}) 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1237384854}) 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.044 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1791260282}) 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=721487678}) 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1791260282}) 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.041+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1297468504}) 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1485196958}) 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1485605216}) 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1485196958}) 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4096884194}) 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.045 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=61,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=2} crc {logm=1436496433,mdsmap=2204869053,mgr=362726177,mgr_metadata=283970154,mgrstat=4138493413,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=1885656438}) 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=1} crc {logm=3403708390,mdsmap=2204869053,mgr=2215873856,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=2216533814,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=1780493049}) 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=61,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=2} crc {logm=1436496433,mdsmap=2204869053,mgr=362726177,mgr_metadata=283970154,mgrstat=4138493413,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=1885656438}) 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.042+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=1} crc {logm=799538754,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=1367622416,mon_config_key=2501260364,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=1780493049}) 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.043+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.043+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=16,osdmap=79} crc {osd_metadata=3710917960,osd_pg_creating=2399581066,osd_snap=754182858,osdmap=1085094948}) 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.043+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osd_snap=16,osdmap=80} crc {osd_metadata=311283700,osd_pg_creating=2399581066,osd_snap=754182859,osdmap=4029510608}) 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.043+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.043+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=16,osdmap=79} crc {osd_metadata=3710917960,osd_pg_creating=2399581066,osd_snap=754182858,osdmap=1085094948}) 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.043+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=16,osdmap=79} crc {osd_metadata=3710917960,osd_pg_creating=2399581066,osd_snap=754182858,osdmap=1577547881}) 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.044+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.044+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=95} crc {osdmap=2788632644}) 2026-02-12T17:30:11.046 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.044+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=95} crc {osdmap=4163309657}) 2026-02-12T17:30:11.047 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.044+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:30:11.047 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.044+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=95} crc {osdmap=2788632644}) 2026-02-12T17:30:11.047 INFO:tasks.ceph.mon.a.trial057.stderr:2026-02-12T17:30:11.044+0000 7fc53c9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=97} crc {osdmap=3614552717}) 2026-02-12T17:30:11.047 DEBUG:teuthology.orchestra.run:got remote process result: 16 2026-02-12T17:30:11.048 WARNING:tasks.mon_thrash:Ignoring exception while triggering scrub: Command failed on trial057 with status 16: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub' 2026-02-12T17:30:11.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:30:11.686 INFO:tasks.rados.rados.0.trial082.stdout:434: done (0 left) 2026-02-12T17:30:11.687 INFO:tasks.rados.rados.0.trial082.stdout:435: snap_create 2026-02-12T17:30:12.049 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:30:12.049 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:30:12.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient: get_monmap_and_config 2026-02-12T17:30:12.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient: build_initial_monmap 2026-02-12T17:30:12.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient: monmap: 2026-02-12T17:30:12.117 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:12.117 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:12.118978+0000 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:12.118978+0000 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 1 Processor -- start 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 1 -- start start 2026-02-12T17:30:12.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient: init 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient(hunting): picked mon.noname-a con 0x7fe04008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient(hunting): picked mon.noname-b con 0x7fe04008c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient(hunting): picked mon.noname-c con 0x7fe04008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04008d600 con 0x7fe04008ae20 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04008b1f0 con 0x7fe04008cb30 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04008d1f0 con 0x7fe04008c730 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe04870c640 10 monclient(hunting): authenticate will time out at 691.937844s 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe046481640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe04008ae20 0x7fe04008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51344/0 (socket says 10.20.193.57:51344) 2026-02-12T17:30:12.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe045c80640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe04008c730 0x7fe040181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:34052/0 (socket says 10.20.193.57:34052) 2026-02-12T17:30:12.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.118+0000 7fe046481640 1 -- 10.20.193.57:0/765987613 learned_addr learned my addr 10.20.193.57:0/765987613 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:12.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe046481640 1 -- 10.20.193.57:0/765987613 >> v1:10.20.193.57:6789/0 conn(0x7fe04008ae20 legacy=0x7fe04008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe045c80640 1 -- 10.20.193.57:0/765987613 >> v1:10.20.193.57:6790/0 conn(0x7fe04008c730 legacy=0x7fe040181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1248110317 0 0) 0x7fe04008d600 con 0x7fe04008ae20 2026-02-12T17:30:12.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): my global_id is 4557 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe046c82640 1 -- 10.20.193.57:0/765987613 >> v1:10.20.193.82:6789/0 conn(0x7fe04008cb30 legacy=0x7fe0401a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0280035e0 con 0x7fe04008ae20 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295240379 0 0) 0x7fe04008d1f0 con 0x7fe04008c730 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): my global_id is 34127 2026-02-12T17:30:12.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe04008d600 con 0x7fe04008c730 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339205903 0 0) 0x7fe04008b1f0 con 0x7fe04008cb30 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient(hunting): my global_id is 4498 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe04008d1f0 con 0x7fe04008cb30 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2548463634 0 0) 0x7fe0280035e0 con 0x7fe04008ae20 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 >> v1:10.20.193.57:6790/0 conn(0x7fe04008c730 legacy=0x7fe040181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 >> v1:10.20.193.82:6789/0 conn(0x7fe04008cb30 legacy=0x7fe0401a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: _finish_hunting 0 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 monclient: found mon.noname-a 2026-02-12T17:30:12.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe040057320 con 0x7fe04008ae20 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: _finish_auth 0 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: _check_auth_tickets 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 5 monclient: authenticate success, global_id 4557 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe0300030d0 con 0x7fe04008ae20 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: dump: 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.130 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe030003360 con 0x7fe04008ae20 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:12.131 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 1 -- 10.20.193.57:0/765987613 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe030004960 con 0x7fe04008ae20 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04547f640 10 monclient: dump: 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.132 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 4 set_mon_vals no callback set 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 10 monclient: shutdown 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 1 -- 10.20.193.57:0/765987613 >> v1:10.20.193.57:6789/0 conn(0x7fe04008ae20 legacy=0x7fe04008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 1 -- 10.20.193.57:0/765987613 shutdown_connections 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 1 -- 10.20.193.57:0/765987613 >> 10.20.193.57:0/765987613 conn(0x7fe040091620 msgr2=0x7fe040091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 1 -- 10.20.193.57:0/765987613 shutdown_connections 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.121+0000 7fe04870c640 1 -- 10.20.193.57:0/765987613 wait complete. 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient: build_initial_monmap 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient: monmap: 2026-02-12T17:30:12.133 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 1 Processor -- start 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 1 -- start start 2026-02-12T17:30:12.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient: init 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient(hunting): picked mon.noname-c con 0x7fe04008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient(hunting): picked mon.noname-b con 0x7fe04008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient(hunting): picked mon.noname-a con 0x7fe04008cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04008d9c0 con 0x7fe04008cb30 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04008a880 con 0x7fe04008c730 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe04011e530 con 0x7fe04008ae20 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe04870c640 10 monclient(hunting): authenticate will time out at 691.941921s 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe046481640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe04008ae20 0x7fe040088d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:34056/0 (socket says 10.20.193.57:34056) 2026-02-12T17:30:12.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.122+0000 7fe046481640 1 -- 10.20.193.57:0/2453026387 learned_addr learned my addr 10.20.193.57:0/2453026387 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe046c82640 1 -- 10.20.193.57:0/2453026387 >> v1:10.20.193.57:6789/0 conn(0x7fe04008cb30 legacy=0x7fe0401a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe046481640 1 -- 10.20.193.57:0/2453026387 >> v1:10.20.193.57:6790/0 conn(0x7fe04008ae20 legacy=0x7fe040088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364747789 0 0) 0x7fe04008d9c0 con 0x7fe04008cb30 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): my global_id is 4560 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0100035e0 con 0x7fe04008cb30 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522540837 0 0) 0x7fe04011e530 con 0x7fe04008ae20 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): my global_id is 34130 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe04008d9c0 con 0x7fe04008ae20 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 530095181 0 0) 0x7fe0100035e0 con 0x7fe04008cb30 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe045c80640 1 -- 10.20.193.57:0/2453026387 >> v1:10.20.193.82:6789/0 conn(0x7fe04008c730 legacy=0x7fe040089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe04011e530 con 0x7fe04008cb30 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe03c004460 con 0x7fe04008cb30 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): dump: 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.137 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1091961931 0 0) 0x7fe04008d9c0 con 0x7fe04008ae20 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0100035e0 con 0x7fe04008ae20 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe0300048a0 con 0x7fe04008ae20 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:12.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient(hunting): dump: 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1329536458 0 0) 0x7fe04011e530 con 0x7fe04008cb30 2026-02-12T17:30:12.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 >> v1:10.20.193.57:6790/0 conn(0x7fe04008ae20 legacy=0x7fe040088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 >> v1:10.20.193.82:6789/0 conn(0x7fe04008c730 legacy=0x7fe040089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 monclient: found mon.a 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04011eaf0 con 0x7fe04008cb30 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient: _finish_auth 0 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 5 monclient: authenticate success, global_id 4560 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 10 monclient: _renew_subs 2026-02-12T17:30:12.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe04005b030 con 0x7fe04008cb30 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 10 monclient: _renew_subs 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe040123680 con 0x7fe04008cb30 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe03c004a60 con 0x7fe04008cb30 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe03c004db0 con 0x7fe04008cb30 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe026ffd640 10 monclient: dump: 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.141 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe044c7e640 4 set_mon_vals no callback set 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.125+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04011d9c0 con 0x7fe04008cb30 2026-02-12T17:30:12.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.126+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe03c004f50 con 0x7fe04008cb30 2026-02-12T17:30:12.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.126+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 3943+0+0 (unknown 2635218685 0 0) 0x7fe03c04fbb0 con 0x7fe04008cb30 2026-02-12T17:30:12.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.126+0000 7fe046481640 10 monclient: get_auth_request con 0x7fe01003faf0 auth_method 0 2026-02-12T17:30:12.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.128+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe03c018370 con 0x7fe04008cb30 2026-02-12T17:30:12.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.128+0000 7fe026ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:12.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.128+0000 7fe026ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:12.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.273+0000 7fe04870c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:30:12.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.273+0000 7fe04870c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:30:12.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.273+0000 7fe04870c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.273+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe04011e870 con 0x7fe04008cb30 2026-02-12T17:30:12.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.273+0000 7fe026ffd640 1 -- 10.20.193.57:0/2453026387 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 4091751291) 0x7fe03c017b20 con 0x7fe04008cb30 2026-02-12T17:30:12.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.273+0000 7fe026ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:30:12.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.273+0000 7fe026ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:12.272 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:30:12.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.274+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe01003faf0 legacy=0x7fe01005ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.274+0000 7fe04870c640 10 monclient: shutdown 2026-02-12T17:30:12.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.274+0000 7fe04870c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:12.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.274+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 >> v1:10.20.193.57:6789/0 conn(0x7fe04008cb30 legacy=0x7fe0401a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.274+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 shutdown_connections 2026-02-12T17:30:12.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.274+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 >> 10.20.193.57:0/2453026387 conn(0x7fe040091620 msgr2=0x7fe0400597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:12.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.274+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 shutdown_connections 2026-02-12T17:30:12.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.274+0000 7fe04870c640 1 -- 10.20.193.57:0/2453026387 wait complete. 2026-02-12T17:30:12.281 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:30:12.281 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:30:12.281 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:30:12.281 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:30:12.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient: get_monmap_and_config 2026-02-12T17:30:12.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient: build_initial_monmap 2026-02-12T17:30:12.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient: monmap: 2026-02-12T17:30:12.349 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:12.349 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.349 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:12.351986+0000 2026-02-12T17:30:12.349 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:12.351986+0000 2026-02-12T17:30:12.350 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:12.350 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.350 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:12.350 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:12.350 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:12.350 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 1 Processor -- start 2026-02-12T17:30:12.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 1 -- start start 2026-02-12T17:30:12.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient: init 2026-02-12T17:30:12.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:12.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient(hunting): picked mon.noname-b con 0x7f4ccc08e290 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient(hunting): picked mon.noname-a con 0x7f4ccc08f500 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient(hunting): picked mon.noname-c con 0x7f4ccc08ed70 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc08fbd0 con 0x7f4ccc08f500 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc056250 con 0x7f4ccc08ed70 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc056530 con 0x7f4ccc08e290 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.351+0000 7f4cd250c640 10 monclient(hunting): authenticate will time out at 692.170941s 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.352+0000 7f4ccb7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f4ccc08f500 0x7f4ccc183f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51370/0 (socket says 10.20.193.57:51370) 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.352+0000 7f4ccb7fe640 1 -- 10.20.193.57:0/176217875 learned_addr learned my addr 10.20.193.57:0/176217875 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccb7fe640 1 -- 10.20.193.57:0/176217875 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc08f500 legacy=0x7f4ccc183f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccbfff640 1 -- 10.20.193.57:0/176217875 >> v1:10.20.193.57:6790/0 conn(0x7f4ccc08e290 legacy=0x7f4ccc08e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733051720 0 0) 0x7f4ccc08fbd0 con 0x7f4ccc08f500 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient(hunting): my global_id is 4563 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb00035e0 con 0x7f4ccc08f500 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004008811 0 0) 0x7f4ccc056530 con 0x7f4ccc08e290 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient(hunting): my global_id is 34133 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ccc08fbd0 con 0x7f4ccc08e290 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd0a82640 1 -- 10.20.193.57:0/176217875 >> v1:10.20.193.82:6789/0 conn(0x7f4ccc08ed70 legacy=0x7f4ccc1a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 22212977 0 0) 0x7f4cb00035e0 con 0x7f4ccc08f500 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 >> v1:10.20.193.57:6790/0 conn(0x7f4ccc08e290 legacy=0x7f4ccc08e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 >> v1:10.20.193.82:6789/0 conn(0x7f4ccc08ed70 legacy=0x7f4ccc1a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: _finish_hunting 0 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 monclient: found mon.noname-a 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc056810 con 0x7f4ccc08f500 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: _finish_auth 0 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: _check_auth_tickets 2026-02-12T17:30:12.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4cbc0030d0 con 0x7f4ccc08f500 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 5 monclient: authenticate success, global_id 4563 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: dump: 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.359 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4cbc0033d0 con 0x7f4ccc08f500 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 1 -- 10.20.193.57:0/176217875 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4cbc004b10 con 0x7f4ccc08f500 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 4 set_mon_vals no callback set 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:12.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4ccaffd640 10 monclient: dump: 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 10 monclient: shutdown 2026-02-12T17:30:12.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 1 -- 10.20.193.57:0/176217875 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc08f500 legacy=0x7f4ccc183f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 1 -- 10.20.193.57:0/176217875 shutdown_connections 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 1 -- 10.20.193.57:0/176217875 >> 10.20.193.57:0/176217875 conn(0x7f4ccc054b30 msgr2=0x7f4ccc093890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 1 -- 10.20.193.57:0/176217875 shutdown_connections 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.354+0000 7f4cd250c640 1 -- 10.20.193.57:0/176217875 wait complete. 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient: build_initial_monmap 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient: monmap: 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:12.362 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 1 Processor -- start 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 1 -- start start 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient: init 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient(hunting): picked mon.noname-a con 0x7f4ccc08e290 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:12.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient(hunting): picked mon.noname-c con 0x7f4ccc08ed70 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:12.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient(hunting): picked mon.noname-b con 0x7f4ccc08f500 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:12.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc141fc0 con 0x7f4ccc08e290 2026-02-12T17:30:12.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc1401a0 con 0x7f4ccc08f500 2026-02-12T17:30:12.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc13f500 con 0x7f4ccc08ed70 2026-02-12T17:30:12.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:12.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4cd250c640 10 monclient(hunting): authenticate will time out at 692.174755s 2026-02-12T17:30:12.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4ccbfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f4ccc08e290 0x7f4ccc153200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51374/0 (socket says 10.20.193.57:51374) 2026-02-12T17:30:12.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.355+0000 7f4ccbfff640 1 -- 10.20.193.57:0/3087807644 learned_addr learned my addr 10.20.193.57:0/3087807644 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:12.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.357+0000 7f4ccbfff640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc08e290 legacy=0x7f4ccc153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.357+0000 7f4ccb7fe640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6790/0 conn(0x7f4ccc08ed70 legacy=0x7f4ccc1944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cd0a82640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.82:6789/0 conn(0x7f4ccc08f500 legacy=0x7f4ccc195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750209788 0 0) 0x7f4ccc141fc0 con 0x7f4ccc08e290 2026-02-12T17:30:12.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): my global_id is 4566 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c9c0035e0 con 0x7f4ccc08e290 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210454515 0 0) 0x7f4ccc13f500 con 0x7f4ccc08ed70 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): my global_id is 34136 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ccc141fc0 con 0x7f4ccc08ed70 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563791681 0 0) 0x7f4ccc1401a0 con 0x7f4ccc08f500 2026-02-12T17:30:12.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): my global_id is 4507 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ccc13f500 con 0x7f4ccc08f500 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 553824278 0 0) 0x7f4ccc141fc0 con 0x7f4ccc08ed70 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ccc1401a0 con 0x7f4ccc08ed70 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4cbc0048a0 con 0x7f4ccc08ed70 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): dump: 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.372 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3479347824 0 0) 0x7f4c9c0035e0 con 0x7f4ccc08e290 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ccc141fc0 con 0x7f4ccc08e290 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4cb8003450 con 0x7f4ccc08e290 2026-02-12T17:30:12.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient(hunting): dump: 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.374 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2347995008 0 0) 0x7f4ccc1401a0 con 0x7f4ccc08ed70 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.82:6789/0 conn(0x7f4ccc08f500 legacy=0x7f4ccc195bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc08e290 legacy=0x7f4ccc153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 monclient: found mon.c 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc13dfe0 con 0x7f4ccc08ed70 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient: _finish_auth 0 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:12.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cd250c640 5 monclient: authenticate success, global_id 34136 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cd250c640 10 monclient: _renew_subs 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cd250c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc13f840 con 0x7f4ccc08ed70 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cd250c640 10 monclient: _renew_subs 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cd250c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4ccc13f220 con 0x7f4ccc08ed70 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4cbc004ab0 con 0x7f4ccc08ed70 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4cbc003570 con 0x7f4ccc08ed70 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:12.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cc8ff9640 10 monclient: dump: 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.358+0000 7f4cca7fc640 4 set_mon_vals no callback set 2026-02-12T17:30:12.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.359+0000 7f4cd250c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.359+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4ccc08f2e0 con 0x7f4ccc13cb50 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.359+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f4cbc011d70 con 0x7f4ccc08ed70 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.359+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(110..110 src has 1..110) ==== 3943+0+0 (unknown 2635218685 0 0) 0x7f4cbc04ec10 con 0x7f4ccc08ed70 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.359+0000 7f4cd0a82640 10 monclient: get_auth_request con 0x7f4c9c03fbe0 auth_method 0 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4ccbfff640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc13cb50 legacy=0x7f4ccc08bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844424677 0 0) 0x7f4ccc08f2e0 con 0x7f4ccc13cb50 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 10 monclient(hunting): my global_id is 4569 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ccc1401a0 con 0x7f4ccc13cb50 2026-02-12T17:30:12.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3723773119 0 0) 0x7f4ccc1401a0 con 0x7f4ccc13cb50 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ccc08f2e0 con 0x7f4ccc13cb50 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4cb8003af0 con 0x7f4ccc13cb50 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 10 monclient: dump: 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.379 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 439710796 0 0) 0x7f4ccc08f2e0 con 0x7f4ccc13cb50 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4ccc13cf20 con 0x7f4ccc13cb50 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4cb8005880 con 0x7f4ccc13cb50 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc13cb50 legacy=0x7f4ccc08bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.361+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc13cb50 legacy=0x7f4ccc08bca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.365+0000 7f4cd250c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.365+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4ccc153d10 con 0x7f4ccc153910 2026-02-12T17:30:12.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4ccbfff640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc153910 legacy=0x7f4ccc08c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1920303585 0 0) 0x7f4ccc153d10 con 0x7f4ccc153910 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 10 monclient(hunting): my global_id is 4572 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ccc08f2e0 con 0x7f4ccc153910 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3701517320 0 0) 0x7f4ccc08f2e0 con 0x7f4ccc153910 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ccc153d10 con 0x7f4ccc153910 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4cb8004330 con 0x7f4ccc153910 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:12.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 10 monclient: dump: 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2525145694 0 0) 0x7f4ccc153d10 con 0x7f4ccc153910 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4ccc0552f0 con 0x7f4ccc153910 2026-02-12T17:30:12.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4507 (unknown 0 0 1774050069) 0x7f4cb8005ba0 con 0x7f4ccc153910 2026-02-12T17:30:12.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:30:12.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:12.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc153910 legacy=0x7f4ccc08c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cc8ff9640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6789/0 conn(0x7f4ccc153910 legacy=0x7f4ccc08c3b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:12.383 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:30:12.383 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:12.383 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 14, 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 133900, 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:30:12.384 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:12.385 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:12.386 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:30:12.387 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:12.388 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:12.389 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:12.390 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:12.391 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.392 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:30:12.393 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.394 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:12.394 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:12.394 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:30:12.394 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.394 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.394 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.394 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:30:12.394 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:30:12.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.82:6800/2441377515 conn(0x7f4c9c03fbe0 legacy=0x7f4c9c060090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cd250c640 10 monclient: shutdown 2026-02-12T17:30:12.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cd250c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:12.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 >> v1:10.20.193.57:6790/0 conn(0x7f4ccc08ed70 legacy=0x7f4ccc1944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cd0a82640 1 -- 10.20.193.57:0/3087807644 reap_dead start 2026-02-12T17:30:12.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cd0a82640 1 -- 10.20.193.57:0/3087807644 reap_dead start 2026-02-12T17:30:12.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 shutdown_connections 2026-02-12T17:30:12.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.368+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 >> 10.20.193.57:0/3087807644 conn(0x7f4ccc054b30 msgr2=0x7f4ccc088e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:12.396 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.369+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 shutdown_connections 2026-02-12T17:30:12.396 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.369+0000 7f4cd250c640 1 -- 10.20.193.57:0/3087807644 wait complete. 2026-02-12T17:30:12.396 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:30:12.396 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:30:12.396 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.465+0000 7fefa4ff6640 10 monclient: get_monmap_and_config 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.465+0000 7fefa4ff6640 10 monclient: build_initial_monmap 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.465+0000 7fefa4ff6640 10 monclient: monmap: 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:12.466193+0000 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:12.466193+0000 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.463 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:12.464 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:12.464 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:12.464 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.465+0000 7fefa4ff6640 1 Processor -- start 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.465+0000 7fefa4ff6640 1 -- start start 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.465+0000 7fefa4ff6640 10 monclient: init 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 10 monclient(hunting): picked mon.noname-b con 0x7fefa008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 10 monclient(hunting): picked mon.noname-a con 0x7fefa008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 10 monclient(hunting): picked mon.noname-c con 0x7fefa0182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa008a820 con 0x7fefa008c620 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa0089450 con 0x7fefa0182cc0 2026-02-12T17:30:12.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa0089730 con 0x7fefa008c250 2026-02-12T17:30:12.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:12.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fefa4ff6640 10 monclient(hunting): authenticate will time out at 692.285111s 2026-02-12T17:30:12.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fef9e575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fefa008c250 0x7fefa008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:34090/0 (socket says 10.20.193.57:34090) 2026-02-12T17:30:12.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fef9e575640 1 -- 10.20.193.57:0/1592651372 learned_addr learned my addr 10.20.193.57:0/1592651372 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:12.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.466+0000 7fef9dd74640 1 --1- 10.20.193.57:0/1592651372 >> v1:10.20.193.57:6789/0 conn(0x7fefa008c620 0x7fefa008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51398/0 (socket says 10.20.193.57:51398) 2026-02-12T17:30:12.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9e575640 1 -- 10.20.193.57:0/1592651372 >> v1:10.20.193.57:6790/0 conn(0x7fefa008c250 legacy=0x7fefa008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9dd74640 1 -- 10.20.193.57:0/1592651372 >> v1:10.20.193.57:6789/0 conn(0x7fefa008c620 legacy=0x7fefa008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9ed76640 1 -- 10.20.193.57:0/1592651372 >> v1:10.20.193.82:6789/0 conn(0x7fefa0182cc0 legacy=0x7fefa01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008551353 0 0) 0x7fefa0089730 con 0x7fefa008c250 2026-02-12T17:30:12.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient(hunting): my global_id is 34139 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef8c0035e0 con 0x7fefa008c250 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215760332 0 0) 0x7fef88002c20 con 0x7fefa008c620 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient(hunting): my global_id is 4575 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa0089730 con 0x7fefa008c620 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 273128285 0 0) 0x7fef8c0035e0 con 0x7fefa008c250 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 >> v1:10.20.193.82:6789/0 conn(0x7fefa0182cc0 legacy=0x7fefa01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 >> v1:10.20.193.57:6789/0 conn(0x7fefa008c620 legacy=0x7fefa008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: _finish_hunting 0 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 monclient: found mon.noname-b 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:30:12.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa0089a10 con 0x7fefa008c250 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: _finish_auth 0 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: _check_auth_tickets 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fef94003150 con 0x7fefa008c250 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: dump: 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.471 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fefa4ff6640 5 monclient: authenticate success, global_id 34139 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fefa4ff6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef94003410 con 0x7fefa008c250 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 1 -- 10.20.193.57:0/1592651372 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fef94004b10 con 0x7fefa008c250 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fef9d573640 10 monclient: dump: 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.472 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fefa4ff6640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.468+0000 7fefa4ff6640 4 set_mon_vals no callback set 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 10 monclient: shutdown 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1592651372 >> v1:10.20.193.57:6790/0 conn(0x7fefa008c250 legacy=0x7fefa008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1592651372 shutdown_connections 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1592651372 >> 10.20.193.57:0/1592651372 conn(0x7fefa00916b0 msgr2=0x7fefa0091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1592651372 shutdown_connections 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1592651372 wait complete. 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 10 monclient: build_initial_monmap 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 10 monclient: monmap: 2026-02-12T17:30:12.473 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 1 Processor -- start 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 1 -- start start 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 10 monclient: init 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 10 monclient(hunting): picked mon.noname-b con 0x7fefa008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:12.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 10 monclient(hunting): picked mon.noname-c con 0x7fefa008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:12.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 10 monclient(hunting): picked mon.noname-a con 0x7fefa0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:12.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa013ebb0 con 0x7fefa0182cc0 2026-02-12T17:30:12.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.469+0000 7fefa4ff6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa0087210 con 0x7fefa008c250 2026-02-12T17:30:12.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.470+0000 7fefa4ff6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa0086570 con 0x7fefa008c620 2026-02-12T17:30:12.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.470+0000 7fefa4ff6640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:12.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.470+0000 7fefa4ff6640 10 monclient(hunting): authenticate will time out at 692.289029s 2026-02-12T17:30:12.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.470+0000 7fef9ed76640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fefa0182cc0 0x7fefa0195700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51400/0 (socket says 10.20.193.57:51400) 2026-02-12T17:30:12.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.470+0000 7fef9dd74640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fefa008c620 0x7fefa0085e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:34102/0 (socket says 10.20.193.57:34102) 2026-02-12T17:30:12.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.470+0000 7fef9ed76640 1 -- 10.20.193.57:0/1086513361 learned_addr learned my addr 10.20.193.57:0/1086513361 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef9ed76640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6789/0 conn(0x7fefa0182cc0 legacy=0x7fefa0195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef9dd74640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6790/0 conn(0x7fefa008c620 legacy=0x7fefa0085e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633201404 0 0) 0x7fefa013ebb0 con 0x7fefa0182cc0 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): my global_id is 4578 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef6c0035e0 con 0x7fefa0182cc0 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 115906575 0 0) 0x7fefa0086570 con 0x7fefa008c620 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): my global_id is 34142 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa013ebb0 con 0x7fefa008c620 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2171440867 0 0) 0x7fef6c0035e0 con 0x7fefa0182cc0 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefa0086570 con 0x7fefa0182cc0 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fef900044c0 con 0x7fefa0182cc0 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef9e575640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.82:6789/0 conn(0x7fefa008c250 legacy=0x7fefa0085750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): dump: 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.480 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 501696432 0 0) 0x7fefa013ebb0 con 0x7fefa008c620 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fef6c0035e0 con 0x7fefa008c620 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fef880034f0 con 0x7fefa008c620 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient(hunting): dump: 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.481 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3783306564 0 0) 0x7fefa0086570 con 0x7fefa0182cc0 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6790/0 conn(0x7fefa008c620 legacy=0x7fefa0085e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.82:6789/0 conn(0x7fefa008c250 legacy=0x7fefa0085750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 monclient: found mon.a 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa00888f0 con 0x7fefa0182cc0 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient: _finish_auth 0 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:30:12.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fefa4ff6640 5 monclient: authenticate success, global_id 4578 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fefa4ff6640 10 monclient: _renew_subs 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fefa4ff6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fefa013bfc0 con 0x7fefa0182cc0 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fefa4ff6640 10 monclient: _renew_subs 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fefa4ff6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fefa013e560 con 0x7fefa0182cc0 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fef90004b20 con 0x7fefa0182cc0 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fef90004e70 con 0x7fefa0182cc0 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef9cd72640 4 set_mon_vals no callback set 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.472+0000 7fef86ffd640 10 monclient: dump: 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.483 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.473+0000 7fefa4ff6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.473+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fefa0090810 con 0x7fefa005ddd0 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.473+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fef900050c0 con 0x7fefa0182cc0 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.473+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 3943+0+0 (unknown 2635218685 0 0) 0x7fef9004fda0 con 0x7fefa0182cc0 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.473+0000 7fef9dd74640 10 monclient: get_auth_request con 0x7fef6c03faa0 auth_method 0 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef9e575640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6790/0 conn(0x7fefa005ddd0 legacy=0x7fefa018d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361777184 0 0) 0x7fefa0090810 con 0x7fefa005ddd0 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 10 monclient(hunting): my global_id is 34145 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa0086570 con 0x7fefa005ddd0 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2031707709 0 0) 0x7fefa0086570 con 0x7fefa005ddd0 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefa0090810 con 0x7fefa005ddd0 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fef94004b00 con 0x7fefa005ddd0 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 10 monclient: dump: 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.485 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 848253635 0 0) 0x7fefa0090810 con 0x7fefa005ddd0 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.475+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fefa013c9d0 con 0x7fefa005ddd0 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.476+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fef94002fa0 con 0x7fefa005ddd0 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.476+0000 7fef86ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.476+0000 7fef86ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.476+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6790/0 conn(0x7fefa005ddd0 legacy=0x7fefa018d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.476+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6790/0 conn(0x7fefa005ddd0 legacy=0x7fefa018d360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.479+0000 7fefa4ff6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:30:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.479+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fefa005e1a0 con 0x7fefa018da70 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef9e575640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6790/0 conn(0x7fefa018da70 legacy=0x7fefa0197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288778287 0 0) 0x7fefa005e1a0 con 0x7fefa018da70 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 10 monclient(hunting): my global_id is 34148 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa0090810 con 0x7fefa018da70 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1957099478 0 0) 0x7fefa0090810 con 0x7fefa018da70 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefa005e1a0 con 0x7fefa018da70 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fef940051b0 con 0x7fefa018da70 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 10 monclient: dump: 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1140052339 0 0) 0x7fefa005e1a0 con 0x7fefa018da70 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.481+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fefa008f580 con 0x7fefa018da70 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4336 (unknown 0 0 237415674) 0x7fef940074d0 con 0x7fefa018da70 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fef86ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:30:12.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fef86ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6790/0 conn(0x7fefa018da70 legacy=0x7fefa0197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fef86ffd640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6790/0 conn(0x7fefa018da70 legacy=0x7fefa0197e30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 14, 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 2171, 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:30:12.490 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:12.491 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:12.492 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:30:12.493 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:12.494 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:30:12.495 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:30:12.496 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:30:12.497 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:12.498 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:12.499 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:12.499 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.499 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.499 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.499 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:30:12.499 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.82:6800/2441377515 conn(0x7fef6c03faa0 legacy=0x7fef6c05ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fefa4ff6640 10 monclient: shutdown 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fefa4ff6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 >> v1:10.20.193.57:6789/0 conn(0x7fefa0182cc0 legacy=0x7fefa0195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fef9ed76640 1 -- 10.20.193.57:0/1086513361 reap_dead start 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fef9ed76640 1 -- 10.20.193.57:0/1086513361 reap_dead start 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 shutdown_connections 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 >> 10.20.193.57:0/1086513361 conn(0x7fefa00916b0 msgr2=0x7fefa008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 shutdown_connections 2026-02-12T17:30:12.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.482+0000 7fefa4ff6640 1 -- 10.20.193.57:0/1086513361 wait complete. 2026-02-12T17:30:12.501 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:30:12.501 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:30:12.501 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:30:12.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient: get_monmap_and_config 2026-02-12T17:30:12.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient: build_initial_monmap 2026-02-12T17:30:12.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient: monmap: 2026-02-12T17:30:12.568 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:12.568 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.569 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:12.571107+0000 2026-02-12T17:30:12.569 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:12.571107+0000 2026-02-12T17:30:12.569 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:12.569 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.569 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:12.569 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:12.569 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:12.569 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 1 Processor -- start 2026-02-12T17:30:12.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 1 -- start start 2026-02-12T17:30:12.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient: init 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient(hunting): picked mon.noname-a con 0x7f11d408c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient(hunting): picked mon.noname-b con 0x7f11d408c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient(hunting): picked mon.noname-c con 0x7f11d4182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d408a820 con 0x7f11d408c250 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d4089450 con 0x7f11d4182cc0 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d4089730 con 0x7f11d408c620 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.570+0000 7f11dc65b640 10 monclient(hunting): authenticate will time out at 692.389984s 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.571+0000 7f11da3d0640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f11d408c250 0x7f11d408a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51404/0 (socket says 10.20.193.57:51404) 2026-02-12T17:30:12.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.571+0000 7f11da3d0640 1 -- 10.20.193.57:0/1356733458 learned_addr learned my addr 10.20.193.57:0/1356733458 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:12.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11da3d0640 1 -- 10.20.193.57:0/1356733458 >> v1:10.20.193.57:6789/0 conn(0x7f11d408c250 legacy=0x7f11d408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d9bcf640 1 -- 10.20.193.57:0/1356733458 >> v1:10.20.193.57:6790/0 conn(0x7f11d408c620 legacy=0x7f11d408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057293510 0 0) 0x7f11c4002c20 con 0x7f11d408c250 2026-02-12T17:30:12.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient(hunting): my global_id is 4581 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11bc0035e0 con 0x7f11d408c250 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884467468 0 0) 0x7f11d4089730 con 0x7f11d408c620 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient(hunting): my global_id is 34151 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11c4002c20 con 0x7f11d408c620 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11dabd1640 1 -- 10.20.193.57:0/1356733458 >> v1:10.20.193.82:6789/0 conn(0x7f11d4182cc0 legacy=0x7f11d41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1410442263 0 0) 0x7f11bc0035e0 con 0x7f11d408c250 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 >> v1:10.20.193.57:6790/0 conn(0x7f11d408c620 legacy=0x7f11d408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 >> v1:10.20.193.82:6789/0 conn(0x7f11d4182cc0 legacy=0x7f11d41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: _finish_hunting 0 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 monclient: found mon.noname-a 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d4089a10 con 0x7f11d408c250 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: _finish_auth 0 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: _check_auth_tickets 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f11c40032e0 con 0x7f11d408c250 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: dump: 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.576 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11dc65b640 5 monclient: authenticate success, global_id 4581 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11dc65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11c4003520 con 0x7f11d408c250 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 1 -- 10.20.193.57:0/1356733458 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f11c4004b10 con 0x7f11d408c250 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11d93ce640 10 monclient: dump: 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11dc65b640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.573+0000 7f11dc65b640 4 set_mon_vals no callback set 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 10 monclient: shutdown 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:12.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 1 -- 10.20.193.57:0/1356733458 >> v1:10.20.193.57:6789/0 conn(0x7f11d408c250 legacy=0x7f11d408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 1 -- 10.20.193.57:0/1356733458 shutdown_connections 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 1 -- 10.20.193.57:0/1356733458 >> 10.20.193.57:0/1356733458 conn(0x7f11d40916b0 msgr2=0x7f11d4091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 1 -- 10.20.193.57:0/1356733458 shutdown_connections 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 1 -- 10.20.193.57:0/1356733458 wait complete. 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 10 monclient: build_initial_monmap 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 10 monclient: monmap: 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:12.579 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 1 Processor -- start 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 1 -- start start 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.574+0000 7f11dc65b640 10 monclient: init 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 10 monclient(hunting): picked mon.noname-c con 0x7f11d408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 10 monclient(hunting): picked mon.noname-a con 0x7f11d408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 10 monclient(hunting): picked mon.noname-b con 0x7f11d4182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d413c860 con 0x7f11d408c620 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d4086570 con 0x7f11d4182cc0 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11d413e8b0 con 0x7f11d408c250 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11dc65b640 10 monclient(hunting): authenticate will time out at 692.394062s 2026-02-12T17:30:12.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11d9bcf640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f11d408c620 0x7f11d4085e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51406/0 (socket says 10.20.193.57:51406) 2026-02-12T17:30:12.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.575+0000 7f11d9bcf640 1 -- 10.20.193.57:0/2381169307 learned_addr learned my addr 10.20.193.57:0/2381169307 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:12.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11d9bcf640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.57:6789/0 conn(0x7f11d408c620 legacy=0x7f11d4085e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11da3d0640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.57:6790/0 conn(0x7f11d408c250 legacy=0x7f11d4085750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986511835 0 0) 0x7f11d413c860 con 0x7f11d408c620 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): my global_id is 4584 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11a40035e0 con 0x7f11d408c620 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196460737 0 0) 0x7f11d413e8b0 con 0x7f11d408c250 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): my global_id is 34154 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11d413c860 con 0x7f11d408c250 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11dabd1640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.82:6789/0 conn(0x7f11d4182cc0 legacy=0x7f11d4195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1134451123 0 0) 0x7f11a40035e0 con 0x7f11d408c620 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11d413e8b0 con 0x7f11d408c620 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f11c80036d0 con 0x7f11d408c620 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): dump: 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.586 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3036812241 0 0) 0x7f11d413c860 con 0x7f11d408c250 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11a40035e0 con 0x7f11d408c250 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f11c4003130 con 0x7f11d408c250 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient(hunting): dump: 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.587 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3821537596 0 0) 0x7f11d413e8b0 con 0x7f11d408c620 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.57:6790/0 conn(0x7f11d408c250 legacy=0x7f11d4085750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.82:6789/0 conn(0x7f11d4182cc0 legacy=0x7f11d4195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient: _finish_hunting 0 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 monclient: found mon.a 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d40888a0 con 0x7f11d408c620 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient: _finish_auth 0 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient: _check_auth_tickets 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11dc65b640 5 monclient: authenticate success, global_id 4584 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11dc65b640 10 monclient: _renew_subs 2026-02-12T17:30:12.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11dc65b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f11d4087210 con 0x7f11d408c620 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11dc65b640 10 monclient: _renew_subs 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11dc65b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f11d413e620 con 0x7f11d408c620 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11c8002b20 con 0x7f11d408c620 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f11c8003dc0 con 0x7f11d408c620 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11baffd640 10 monclient: dump: 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.589 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.577+0000 7f11d8bcd640 4 set_mon_vals no callback set 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.578+0000 7f11dc65b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.578+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f11d405e240 con 0x7f11d405de70 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.578+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f11c8004010 con 0x7f11d408c620 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.578+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 3943+0+0 (unknown 2635218685 0 0) 0x7f11c804ecd0 con 0x7f11d408c620 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.578+0000 7f11dabd1640 10 monclient: get_auth_request con 0x7f11a403fae0 auth_method 0 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.580+0000 7f11da3d0640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.82:6789/0 conn(0x7f11d405de70 legacy=0x7f11d418d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.580+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1407489943 0 0) 0x7f11d405e240 con 0x7f11d405de70 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.580+0000 7f11baffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.580+0000 7f11baffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.580+0000 7f11baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.580+0000 7f11baffd640 10 monclient(hunting): my global_id is 4522 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.580+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11d413e8b0 con 0x7f11d405de70 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3291526204 0 0) 0x7f11d413e8b0 con 0x7f11d405de70 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11d405e240 con 0x7f11d405de70 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f11c4003390 con 0x7f11d405de70 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 10 monclient: dump: 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.591 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1019053201 0 0) 0x7f11d405e240 con 0x7f11d405de70 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11d4090810 con 0x7f11d405de70 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f11c40051f0 con 0x7f11d405de70 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.82:6789/0 conn(0x7f11d405de70 legacy=0x7f11d418d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.581+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.82:6789/0 conn(0x7f11d405de70 legacy=0x7f11d418d340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.584+0000 7f11dc65b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.584+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f11d4055340 con 0x7f11d418da50 2026-02-12T17:30:12.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11da3d0640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.82:6789/0 conn(0x7f11d418da50 legacy=0x7f11d4197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1690226959 0 0) 0x7f11d4055340 con 0x7f11d418da50 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 10 monclient(hunting): my global_id is 4525 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11d405e240 con 0x7f11d418da50 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1413846604 0 0) 0x7f11d405e240 con 0x7f11d418da50 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11d4055340 con 0x7f11d418da50 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f11c4005870 con 0x7f11d418da50 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 10 monclient: dump: 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:12.594 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1904544248 0 0) 0x7f11d4055340 con 0x7f11d418da50 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f11d413b120 con 0x7f11d418da50 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4672 (unknown 0 0 1268102285) 0x7f11c4007c90 con 0x7f11d418da50 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.82:6789/0 conn(0x7f11d418da50 legacy=0x7f11d4197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11baffd640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.82:6789/0 conn(0x7f11d418da50 legacy=0x7f11d4197ca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 14, 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 134084, 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:30:12.596 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:12.597 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:12.598 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:30:12.599 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:12.600 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:12.601 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:30:12.602 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:30:12.603 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:12.604 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:12.605 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:12.606 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:12.606 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:12.606 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:12.606 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:12.606 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:30:12.606 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.82:6800/2441377515 conn(0x7f11a403fae0 legacy=0x7f11a405ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11dc65b640 10 monclient: shutdown 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11dc65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 >> v1:10.20.193.57:6789/0 conn(0x7f11d408c620 legacy=0x7f11d4085e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.587+0000 7f11dabd1640 1 -- 10.20.193.57:0/2381169307 reap_dead start 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.588+0000 7f11dabd1640 1 -- 10.20.193.57:0/2381169307 reap_dead start 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.588+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 shutdown_connections 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.588+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 >> 10.20.193.57:0/2381169307 conn(0x7f11d40916b0 msgr2=0x7f11d408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.588+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 shutdown_connections 2026-02-12T17:30:12.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:12.588+0000 7f11dc65b640 1 -- 10.20.193.57:0/2381169307 wait complete. 2026-02-12T17:30:12.608 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:30:12.608 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-12T17:30:12.608 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-12T17:30:12.608 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-12T17:30:12.608 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-12T17:30:12.608 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T17:30:12.608 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:30:12.617 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T17:30:12.617 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-12T17:30:12.617 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-12T17:30:12.617 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-12T17:30:12.617 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T17:30:27.618 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-12T17:30:27.618 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-12T17:30:27.618 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-12T17:30:27.619 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:30:27.619 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:30:27.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.689+0000 7efeec7a5640 10 monclient: get_monmap_and_config 2026-02-12T17:30:27.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.689+0000 7efeec7a5640 10 monclient: build_initial_monmap 2026-02-12T17:30:27.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.689+0000 7efeec7a5640 10 monclient: monmap: 2026-02-12T17:30:27.689 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:27.689 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:27.689 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:27.690259+0000 2026-02-12T17:30:27.689 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:27.690259+0000 2026-02-12T17:30:27.689 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:27.689 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:27.690 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:27.690 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:27.690 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:27.690 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:27.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.689+0000 7efeec7a5640 1 Processor -- start 2026-02-12T17:30:27.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.689+0000 7efeec7a5640 1 -- start start 2026-02-12T17:30:27.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.689+0000 7efeec7a5640 10 monclient: init 2026-02-12T17:30:27.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:27.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:30:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 10 monclient(hunting): picked mon.noname-b con 0x7efee408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 10 monclient(hunting): picked mon.noname-c con 0x7efee408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 10 monclient(hunting): picked mon.noname-a con 0x7efee408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee408d600 con 0x7efee408cb30 2026-02-12T17:30:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee408b1f0 con 0x7efee408c730 2026-02-12T17:30:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee408d1f0 con 0x7efee408ae20 2026-02-12T17:30:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeec7a5640 10 monclient(hunting): authenticate will time out at 707.509149s 2026-02-12T17:30:27.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeea51a640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efee408c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:27.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeead1b640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7efee408cb30 0x7efee41a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:45862/0 (socket says 10.20.193.57:45862) 2026-02-12T17:30:27.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.690+0000 7efeead1b640 1 -- 10.20.193.57:0/2729898205 learned_addr learned my addr 10.20.193.57:0/2729898205 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:27.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.692+0000 7efeead1b640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6789/0 conn(0x7efee408cb30 legacy=0x7efee41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:27.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.692+0000 7efee9d19640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.82:6789/0 conn(0x7efee408c730 legacy=0x7efee4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:27.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:27.891+0000 7efeea51a640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efee408c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:28.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:28.292+0000 7efeea51a640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efee408c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:29.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:29.093+0000 7efeea51a640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efee408c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:30.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 10 monclient(hunting): tick 2026-02-12T17:30:30.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:30:30.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 1 monclient(hunting): continuing hunt 2026-02-12T17:30:30.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:30:30.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efee408c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:30:30.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.82:6789/0 conn(0x7efee408c730 legacy=0x7efee4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:30.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6789/0 conn(0x7efee408cb30 legacy=0x7efee41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:30.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:30:30.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 10 monclient(hunting): picked mon.noname-a con 0x7efee408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:30.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 10 monclient(hunting): picked mon.noname-c con 0x7efee408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:30.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 10 monclient(hunting): picked mon.noname-b con 0x7efee408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:30.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efeead1b640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efec40668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:30.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 1 -- 10.20.193.57:0/2729898205 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4057320 con 0x7efee408cb30 2026-02-12T17:30:30.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 1 -- 10.20.193.57:0/2729898205 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee408d1f0 con 0x7efee408c730 2026-02-12T17:30:30.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 1 -- 10.20.193.57:0/2729898205 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec406a0d0 con 0x7efee408ae20 2026-02-12T17:30:30.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.690+0000 7efecbfff640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:30.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.692+0000 7efeea51a640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6789/0 conn(0x7efee408cb30 legacy=0x7efec4023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:30.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.692+0000 7efee9d19640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.82:6789/0 conn(0x7efee408c730 legacy=0x7efec4045050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:30.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:30.891+0000 7efeead1b640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efec40668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:31.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:31.292+0000 7efeead1b640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efec40668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:32.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.093+0000 7efeead1b640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efec40668b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:32.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.630+0000 7efee9518640 1 -- 10.20.193.57:0/2729898205 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127397372 0 0) 0x7efee408d1f0 con 0x7efee408c730 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.630+0000 7efee9518640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.630+0000 7efee9518640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.630+0000 7efee9518640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.630+0000 7efee9518640 10 monclient(hunting): my global_id is 4528 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.630+0000 7efee9518640 1 -- 10.20.193.57:0/2729898205 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efecc0035e0 con 0x7efee408c730 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9d19640 1 --1- 10.20.193.57:0/2729898205 >> v1:10.20.193.82:6789/0 conn(0x7efee408c730 0x7efec4045050 :-1 s=OPENED pgs=229 gs=9 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7efed80030e0 mon_map magic: 0 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 1 -- 10.20.193.57:0/2729898205 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2268003902 0 0) 0x7efecc0035e0 con 0x7efee408c730 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6790/0 conn(0x7efee408ae20 legacy=0x7efec40668b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.57:6789/0 conn(0x7efee408cb30 legacy=0x7efec4023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 10 monclient: _finish_hunting 0 2026-02-12T17:30:32.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 1 monclient: found mon.noname-c 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 1 -- 10.20.193.57:0/2729898205 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec406b3f0 con 0x7efee408c730 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 10 monclient: _finish_auth 0 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 10 monclient: _check_auth_tickets 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 5 monclient: authenticate success, global_id 4528 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 1 -- 10.20.193.57:0/2729898205 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efed80030e0 con 0x7efee408c730 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 10 monclient: dump: 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 1 -- 10.20.193.57:0/2729898205 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efed8003360 con 0x7efee408c730 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 4 set_mon_vals no callback set 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 10 monclient: shutdown 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 1 -- 10.20.193.57:0/2729898205 >> v1:10.20.193.82:6789/0 conn(0x7efee408c730 legacy=0x7efec4045050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 1 -- 10.20.193.57:0/2729898205 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efed8003880 con 0x7efee408c730 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efee9518640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 1 -- 10.20.193.57:0/2729898205 shutdown_connections 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 1 -- 10.20.193.57:0/2729898205 >> 10.20.193.57:0/2729898205 conn(0x7efee4091620 msgr2=0x7efee4091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 1 -- 10.20.193.57:0/2729898205 shutdown_connections 2026-02-12T17:30:32.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.631+0000 7efeec7a5640 1 -- 10.20.193.57:0/2729898205 wait complete. 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient: build_initial_monmap 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient: monmap: 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 1 Processor -- start 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 1 -- start start 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient: init 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient(hunting): picked mon.noname-a con 0x7efee408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient(hunting): picked mon.noname-b con 0x7efee408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient(hunting): picked mon.noname-c con 0x7efee408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee408d9c0 con 0x7efee408ae20 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee405ad00 con 0x7efee408c730 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee4088810 con 0x7efee408cb30 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeec7a5640 10 monclient(hunting): authenticate will time out at 712.451829s 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeead1b640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7efee408cb30 legacy=0x7efee4134c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeea51a640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7efee408ae20 0x7efee4088d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:45882/0 (socket says 10.20.193.57:45882) 2026-02-12T17:30:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.632+0000 7efeea51a640 1 -- 10.20.193.57:0/4038430334 learned_addr learned my addr 10.20.193.57:0/4038430334 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:32.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.635+0000 7efeea51a640 1 -- 10.20.193.57:0/4038430334 >> v1:10.20.193.57:6789/0 conn(0x7efee408ae20 legacy=0x7efee4088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.635+0000 7efee9d19640 1 -- 10.20.193.57:0/4038430334 >> v1:10.20.193.82:6789/0 conn(0x7efee408c730 legacy=0x7efee4089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.635+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:30:32.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131013276 0 0) 0x7efee408d9c0 con 0x7efee408ae20 2026-02-12T17:30:32.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): my global_id is 4590 2026-02-12T17:30:32.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeb40035e0 con 0x7efee408ae20 2026-02-12T17:30:32.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507859615 0 0) 0x7efee405ad00 con 0x7efee408c730 2026-02-12T17:30:32.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): my global_id is 4531 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee408d9c0 con 0x7efee408c730 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2807898177 0 0) 0x7efeb40035e0 con 0x7efee408ae20 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efee405ad00 con 0x7efee408ae20 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efed4004630 con 0x7efee408ae20 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): dump: 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.638 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1469064665 0 0) 0x7efee408d9c0 con 0x7efee408c730 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efeb40035e0 con 0x7efee408c730 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efed80036d0 con 0x7efee408c730 2026-02-12T17:30:32.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient(hunting): dump: 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3954699418 0 0) 0x7efee405ad00 con 0x7efee408ae20 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 >> v1:10.20.193.57:6790/0 conn(0x7efee408cb30 legacy=0x7efee4134c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 >> v1:10.20.193.82:6789/0 conn(0x7efee408c730 legacy=0x7efee4089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient: _finish_hunting 0 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 monclient: found mon.a 2026-02-12T17:30:32.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee4084610 con 0x7efee408ae20 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient: _finish_auth 0 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient: _check_auth_tickets 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efeec7a5640 5 monclient: authenticate success, global_id 4590 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efeec7a5640 10 monclient: _renew_subs 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efeec7a5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efee4082d80 con 0x7efee408ae20 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efeec7a5640 10 monclient: _renew_subs 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efeec7a5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efee4084000 con 0x7efee408ae20 2026-02-12T17:30:32.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efed4004ac0 con 0x7efee408ae20 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efed4004e10 con 0x7efee408ae20 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efecaffd640 10 monclient: dump: 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.642 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.637+0000 7efee8d17640 4 set_mon_vals no callback set 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.638+0000 7efeec7a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.638+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7efed4004fb0 con 0x7efee408ae20 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.638+0000 7efeec7a5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.638+0000 7efeec7a5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.638+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee40008d0 con 0x7efee408ae20 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.638+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(111..111 src has 1..111) ==== 3915+0+0 (unknown 47404181 0 0) 0x7efed404eae0 con 0x7efee408ae20 2026-02-12T17:30:32.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.638+0000 7efee9d19640 10 monclient: get_auth_request con 0x7efeb403fa50 auth_method 0 2026-02-12T17:30:32.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.640+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7efed4017210 con 0x7efee408ae20 2026-02-12T17:30:32.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.640+0000 7efecaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:32.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.640+0000 7efecaffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.791+0000 7efeec7a5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:30:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.791+0000 7efeec7a5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:30:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.791+0000 7efeec7a5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.791+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efee4084240 con 0x7efee408ae20 2026-02-12T17:30:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.792+0000 7efecaffd640 1 -- 10.20.193.57:0/4038430334 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 2829627187) 0x7efed40151a0 con 0x7efee408ae20 2026-02-12T17:30:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.792+0000 7efecaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:30:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.792+0000 7efecaffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:32.790 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":16,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:30:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.793+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 >> v1:10.20.193.82:6800/2441377515 conn(0x7efeb403fa50 legacy=0x7efeb405ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.793+0000 7efeec7a5640 10 monclient: shutdown 2026-02-12T17:30:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.793+0000 7efeec7a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.793+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 >> v1:10.20.193.57:6789/0 conn(0x7efee408ae20 legacy=0x7efee4088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.793+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 shutdown_connections 2026-02-12T17:30:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.793+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 >> 10.20.193.57:0/4038430334 conn(0x7efee4091620 msgr2=0x7efee4125840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.793+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 shutdown_connections 2026-02-12T17:30:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.793+0000 7efeec7a5640 1 -- 10.20.193.57:0/4038430334 wait complete. 2026-02-12T17:30:32.798 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:30:32.799 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-12T17:30:32.799 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:30:32.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.865+0000 7fab2cc5b640 10 monclient: get_monmap_and_config 2026-02-12T17:30:32.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.865+0000 7fab2cc5b640 10 monclient: build_initial_monmap 2026-02-12T17:30:32.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.865+0000 7fab2cc5b640 10 monclient: monmap: 2026-02-12T17:30:32.863 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:32.863 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.863 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:32.866502+0000 2026-02-12T17:30:32.863 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:32.866502+0000 2026-02-12T17:30:32.863 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 1 Processor -- start 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 1 -- start start 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 10 monclient: init 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 10 monclient(hunting): picked mon.noname-b con 0x7fab280906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 10 monclient(hunting): picked mon.noname-a con 0x7fab280911b0 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 10 monclient(hunting): picked mon.noname-c con 0x7fab28185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab28090100 con 0x7fab280911b0 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab28091a70 con 0x7fab28185070 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab26575640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fab280906d0 legacy=0x7fab28090aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab28092360 con 0x7fab280906d0 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab2cc5b640 10 monclient(hunting): authenticate will time out at 712.685623s 2026-02-12T17:30:32.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab25d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fab280911b0 0x7fab28183950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:45896/0 (socket says 10.20.193.57:45896) 2026-02-12T17:30:32.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.866+0000 7fab25d74640 1 -- 10.20.193.57:0/3444146268 learned_addr learned my addr 10.20.193.57:0/3444146268 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:32.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.868+0000 7fab25d74640 1 -- 10.20.193.57:0/3444146268 >> v1:10.20.193.57:6789/0 conn(0x7fab280911b0 legacy=0x7fab28183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.868+0000 7fab26d76640 1 -- 10.20.193.57:0/3444146268 >> v1:10.20.193.82:6789/0 conn(0x7fab28185070 legacy=0x7fab281a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.868+0000 7fab25573640 1 -- 10.20.193.57:0/3444146268 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325688494 0 0) 0x7fab28090100 con 0x7fab280911b0 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.868+0000 7fab25573640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.868+0000 7fab25573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.868+0000 7fab25573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.868+0000 7fab25573640 10 monclient(hunting): my global_id is 4593 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.868+0000 7fab25573640 1 -- 10.20.193.57:0/3444146268 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab140035e0 con 0x7fab280911b0 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 1 -- 10.20.193.57:0/3444146268 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2818718510 0 0) 0x7fab140035e0 con 0x7fab280911b0 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 1 -- 10.20.193.57:0/3444146268 >> v1:10.20.193.57:6790/0 conn(0x7fab280906d0 legacy=0x7fab28090aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 1 -- 10.20.193.57:0/3444146268 >> v1:10.20.193.82:6789/0 conn(0x7fab28185070 legacy=0x7fab281a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: _finish_hunting 0 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 1 monclient: found mon.noname-a 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 1 -- 10.20.193.57:0/3444146268 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2805cf80 con 0x7fab280911b0 2026-02-12T17:30:32.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: _finish_auth 0 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: _check_auth_tickets 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 1 -- 10.20.193.57:0/3444146268 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fab100030d0 con 0x7fab280911b0 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 5 monclient: authenticate success, global_id 4593 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: dump: 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 1 -- 10.20.193.57:0/3444146268 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab10003360 con 0x7fab280911b0 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 1 -- 10.20.193.57:0/3444146268 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fab10004960 con 0x7fab280911b0 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 4 set_mon_vals no callback set 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab25573640 10 monclient: dump: 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 10 monclient: shutdown 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 1 -- 10.20.193.57:0/3444146268 >> v1:10.20.193.57:6789/0 conn(0x7fab280911b0 legacy=0x7fab28183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 1 -- 10.20.193.57:0/3444146268 shutdown_connections 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 1 -- 10.20.193.57:0/3444146268 >> 10.20.193.57:0/3444146268 conn(0x7fab28054330 msgr2=0x7fab28054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 1 -- 10.20.193.57:0/3444146268 shutdown_connections 2026-02-12T17:30:32.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.869+0000 7fab2cc5b640 1 -- 10.20.193.57:0/3444146268 wait complete. 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient: build_initial_monmap 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient: monmap: 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 1 Processor -- start 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 1 -- start start 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient: init 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient(hunting): picked mon.noname-c con 0x7fab280906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient(hunting): picked mon.noname-a con 0x7fab280911b0 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient(hunting): picked mon.noname-b con 0x7fab28185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab26575640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fab280906d0 legacy=0x7fab2812fbc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:32.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab2808b4c0 con 0x7fab280911b0 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab281339e0 con 0x7fab28185070 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab281309e0 con 0x7fab280906d0 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab2cc5b640 10 monclient(hunting): authenticate will time out at 712.689614s 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab25d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fab280911b0 0x7fab281302d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:45912/0 (socket says 10.20.193.57:45912) 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.870+0000 7fab25d74640 1 -- 10.20.193.57:0/1066311469 learned_addr learned my addr 10.20.193.57:0/1066311469 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.872+0000 7fab25d74640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6789/0 conn(0x7fab280911b0 legacy=0x7fab281302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.872+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373559938 0 0) 0x7fab2808b4c0 con 0x7fab280911b0 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.872+0000 7fab26d76640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.82:6789/0 conn(0x7fab28185070 legacy=0x7fab28174a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.872+0000 7fab0effd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.872+0000 7fab0effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.872+0000 7fab0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.872+0000 7fab0effd640 10 monclient(hunting): my global_id is 4596 2026-02-12T17:30:32.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.872+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaf40035e0 con 0x7fab280911b0 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017582240 0 0) 0x7fab281339e0 con 0x7fab28185070 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient(hunting): my global_id is 4537 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab2808b4c0 con 0x7fab28185070 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 77260309 0 0) 0x7faaf40035e0 con 0x7fab280911b0 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab281339e0 con 0x7fab280911b0 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fab10002b30 con 0x7fab280911b0 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient(hunting): dump: 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:32.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 688686778 0 0) 0x7fab281339e0 con 0x7fab280911b0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6790/0 conn(0x7fab280906d0 legacy=0x7fab2812fbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.82:6789/0 conn(0x7fab28185070 legacy=0x7fab28174a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient: _finish_hunting 0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 monclient: found mon.a 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab28062bb0 con 0x7fab280911b0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient: _finish_auth 0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient: _check_auth_tickets 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab2cc5b640 5 monclient: authenticate success, global_id 4596 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab2cc5b640 10 monclient: _renew_subs 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab2cc5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fab28132b70 con 0x7fab280911b0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab2cc5b640 10 monclient: _renew_subs 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab2cc5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fab28133700 con 0x7fab280911b0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab25d74640 1 --1- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6789/0 conn(0x7fab280911b0 0x7fab281302d0 :-1 s=OPENED pgs=248 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fab10004950 config(0 keys) 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab10004950 con 0x7fab280911b0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab24d72640 4 set_mon_vals no callback set 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab2cc5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fab280008d0 con 0x7fab28143320 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fab100050f0 con 0x7fab280911b0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 10 monclient: dump: 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.872 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.873 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.873 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.873+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fab10005380 con 0x7fab280911b0 2026-02-12T17:30:32.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.874+0000 7fab26d76640 10 monclient: get_auth_request con 0x7faaf403f6a0 auth_method 0 2026-02-12T17:30:32.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.875+0000 7fab26575640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6789/0 conn(0x7fab28143320 legacy=0x7fab2812c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349680362 0 0) 0x7fab280008d0 con 0x7fab28143320 2026-02-12T17:30:32.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 10 monclient(hunting): my global_id is 4599 2026-02-12T17:30:32.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab281339e0 con 0x7fab28143320 2026-02-12T17:30:32.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1694203140 0 0) 0x7fab281339e0 con 0x7fab28143320 2026-02-12T17:30:32.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab280008d0 con 0x7fab28143320 2026-02-12T17:30:32.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fab1c0042a0 con 0x7fab28143320 2026-02-12T17:30:32.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:32.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 10 monclient: dump: 2026-02-12T17:30:32.876 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.877 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.877 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.877 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.877 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.877 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.877 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.877 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.878 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.878 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 650801411 0 0) 0x7fab280008d0 con 0x7fab28143320 2026-02-12T17:30:32.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab2805c950 con 0x7fab28143320 2026-02-12T17:30:32.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fab1c006650 con 0x7fab28143320 2026-02-12T17:30:32.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:32.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:32.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6789/0 conn(0x7fab28143320 legacy=0x7fab2812c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.876+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6789/0 conn(0x7fab28143320 legacy=0x7fab2812c330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:32.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.879+0000 7fab2cc5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:30:32.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.879+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fab28092d90 con 0x7fab2812ca40 2026-02-12T17:30:32.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab26575640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6789/0 conn(0x7fab2812ca40 legacy=0x7fab28177180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1238688432 0 0) 0x7fab28092d90 con 0x7fab2812ca40 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 10 monclient(hunting): my global_id is 4602 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab280008d0 con 0x7fab2812ca40 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4170918082 0 0) 0x7fab280008d0 con 0x7fab2812ca40 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab28092d90 con 0x7fab2812ca40 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fab1c004bd0 con 0x7fab2812ca40 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 10 monclient: dump: 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.881 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1145928666 0 0) 0x7fab28092d90 con 0x7fab2812ca40 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fab28132470 con 0x7fab2812ca40 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4494 (unknown 0 0 3044164217) 0x7fab1c006080 con 0x7fab2812ca40 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:32.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6789/0 conn(0x7fab2812ca40 legacy=0x7fab28177180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.882+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6789/0 conn(0x7fab2812ca40 legacy=0x7fab28177180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 16, 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 154414, 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:30:32.883 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:32.884 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:32.885 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:30:32.886 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:32.887 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.888 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:32.889 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:32.890 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.891 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:32.892 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:30:32.893 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.894 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.894 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.894 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:30:32.894 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:30:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.82:6800/2441377515 conn(0x7faaf403f6a0 legacy=0x7faaf405fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab2cc5b640 10 monclient: shutdown 2026-02-12T17:30:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab2cc5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 >> v1:10.20.193.57:6789/0 conn(0x7fab280911b0 legacy=0x7fab281302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab26d76640 1 -- 10.20.193.57:0/1066311469 reap_dead start 2026-02-12T17:30:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab0effd640 1 -- 10.20.193.57:0/1066311469 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(111..111 src has 1..111) ==== 3915+0+0 (unknown 47404181 0 0) 0x7fab1004eed0 con 0x7fab280911b0 2026-02-12T17:30:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab26d76640 1 -- 10.20.193.57:0/1066311469 reap_dead start 2026-02-12T17:30:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 shutdown_connections 2026-02-12T17:30:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 >> 10.20.193.57:0/1066311469 conn(0x7fab28054330 msgr2=0x7fab2808f650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 shutdown_connections 2026-02-12T17:30:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.883+0000 7fab2cc5b640 1 -- 10.20.193.57:0/1066311469 wait complete. 2026-02-12T17:30:32.896 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:30:32.896 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:30:32.896 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.963+0000 7f96b54cc640 10 monclient: get_monmap_and_config 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.963+0000 7f96b54cc640 10 monclient: build_initial_monmap 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.963+0000 7f96b54cc640 10 monclient: monmap: 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:30:32.964666+0000 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:30:32.964666+0000 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:30:32.962 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 1 Processor -- start 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 1 -- start start 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 10 monclient: init 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 10 monclient(hunting): picked mon.noname-c con 0x7f96b00906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 10 monclient(hunting): picked mon.noname-b con 0x7f96b00911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 10 monclient(hunting): picked mon.noname-a con 0x7f96b0185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b0090100 con 0x7f96b0185070 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b0091a70 con 0x7f96b00906d0 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b0092360 con 0x7f96b00911b0 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:32.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96b54cc640 10 monclient(hunting): authenticate will time out at 712.783744s 2026-02-12T17:30:32.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96ae7fc640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f96b00911b0 legacy=0x7f96b0183950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:32.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96af7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f96b0185070 0x7f96b01a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:43084/0 (socket says 10.20.193.57:43084) 2026-02-12T17:30:32.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.964+0000 7f96af7fe640 1 -- 10.20.193.57:0/4137436553 learned_addr learned my addr 10.20.193.57:0/4137436553 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:32.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.966+0000 7f96af7fe640 1 -- 10.20.193.57:0/4137436553 >> v1:10.20.193.57:6789/0 conn(0x7f96b0185070 legacy=0x7f96b01a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 -- 10.20.193.57:0/4137436553 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724341697 0 0) 0x7f96b0090100 con 0x7f96b0185070 2026-02-12T17:30:32.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient(hunting): my global_id is 4605 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 -- 10.20.193.57:0/4137436553 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f969c0035e0 con 0x7f96b0185070 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 -- 10.20.193.57:0/4137436553 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4294261469 0 0) 0x7f969c0035e0 con 0x7f96b0185070 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 -- 10.20.193.57:0/4137436553 >> v1:10.20.193.57:6790/0 conn(0x7f96b00911b0 legacy=0x7f96b0183950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 -- 10.20.193.57:0/4137436553 >> v1:10.20.193.82:6789/0 conn(0x7f96b00906d0 legacy=0x7f96b0090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: _finish_hunting 0 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 monclient: found mon.noname-a 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 -- 10.20.193.57:0/4137436553 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b005cf80 con 0x7f96b0185070 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: _finish_auth 0 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: _check_auth_tickets 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:32.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 5 monclient: authenticate success, global_id 4605 2026-02-12T17:30:32.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 -- 10.20.193.57:0/4137436553 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96a00041b0 con 0x7f96b0185070 2026-02-12T17:30:32.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:32.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:32.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: dump: 2026-02-12T17:30:32.969 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.969 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.969 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.969 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.970 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.970 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.970 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.970 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.970 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.970 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:30:32.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 -- 10.20.193.57:0/4137436553 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96a0004440 con 0x7f96b0185070 2026-02-12T17:30:32.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:32.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 1 -- 10.20.193.57:0/4137436553 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96a0005a40 con 0x7f96b0185070 2026-02-12T17:30:32.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:32.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96adffb640 10 monclient: dump: 2026-02-12T17:30:32.971 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.971 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.971 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.971 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.971 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.972 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.972 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.972 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.972 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.972 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:30:32.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 4 set_mon_vals no callback set 2026-02-12T17:30:32.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 10 monclient: shutdown 2026-02-12T17:30:32.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:32.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 1 -- 10.20.193.57:0/4137436553 >> v1:10.20.193.57:6789/0 conn(0x7f96b0185070 legacy=0x7f96b01a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 1 -- 10.20.193.57:0/4137436553 shutdown_connections 2026-02-12T17:30:32.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 1 -- 10.20.193.57:0/4137436553 >> 10.20.193.57:0/4137436553 conn(0x7f96b0054330 msgr2=0x7f96b0054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:32.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 1 -- 10.20.193.57:0/4137436553 shutdown_connections 2026-02-12T17:30:32.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.967+0000 7f96b54cc640 1 -- 10.20.193.57:0/4137436553 wait complete. 2026-02-12T17:30:32.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient: build_initial_monmap 2026-02-12T17:30:32.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient: monmap: 2026-02-12T17:30:32.973 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 1 Processor -- start 2026-02-12T17:30:32.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 1 -- start start 2026-02-12T17:30:32.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient: init 2026-02-12T17:30:32.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:30:32.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:30:32.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient(hunting): picked mon.noname-a con 0x7f96b00906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:30:32.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient(hunting): picked mon.noname-c con 0x7f96b00911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:30:32.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient(hunting): picked mon.noname-b con 0x7f96b0185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:30:32.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b0133970 con 0x7f96b00906d0 2026-02-12T17:30:32.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b0133c50 con 0x7f96b0185070 2026-02-12T17:30:32.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b0130cf0 con 0x7f96b00911b0 2026-02-12T17:30:32.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:30:32.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96b54cc640 10 monclient(hunting): authenticate will time out at 712.787734s 2026-02-12T17:30:32.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96ae7fc640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f96b00911b0 legacy=0x7f96b01305e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:30:32.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96aeffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f96b00906d0 0x7f96b012fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:43090/0 (socket says 10.20.193.57:43090) 2026-02-12T17:30:32.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.968+0000 7f96aeffd640 1 -- 10.20.193.57:0/814785643 learned_addr learned my addr 10.20.193.57:0/814785643 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.970+0000 7f96aeffd640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.57:6789/0 conn(0x7f96b00906d0 legacy=0x7f96b012fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.970+0000 7f96af7fe640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.82:6789/0 conn(0x7f96b0185070 legacy=0x7f96b0174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982955325 0 0) 0x7f96b0133970 con 0x7f96b00906d0 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): my global_id is 4608 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f967c0035e0 con 0x7f96b00906d0 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187049666 0 0) 0x7f96b0133c50 con 0x7f96b0185070 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): my global_id is 4540 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96b0133970 con 0x7f96b0185070 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2599048329 0 0) 0x7f967c0035e0 con 0x7f96b00906d0 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96b0133c50 con 0x7f96b00906d0 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96a40043b0 con 0x7f96b00906d0 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): dump: 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 642867012 0 0) 0x7f96b0133970 con 0x7f96b0185070 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f967c0035e0 con 0x7f96b0185070 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96a00045b0 con 0x7f96b0185070 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient(hunting): dump: 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 775111068 0 0) 0x7f96b0133c50 con 0x7f96b00906d0 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.57:6790/0 conn(0x7f96b00911b0 legacy=0x7f96b01305e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.82:6789/0 conn(0x7f96b0185070 legacy=0x7f96b0174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 monclient: found mon.a 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b0134100 con 0x7f96b00906d0 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient: _finish_auth 0 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96b54cc640 5 monclient: authenticate success, global_id 4608 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96b54cc640 10 monclient: _renew_subs 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96b54cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f96b008f140 con 0x7f96b00906d0 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96b54cc640 10 monclient: _renew_subs 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96b54cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:30:32.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f96b0062bb0 con 0x7f96b00906d0 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96a4002950 con 0x7f96b00906d0 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96a4002c70 con 0x7f96b00906d0 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f968f7fe640 10 monclient: dump: 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96ad7fa640 4 set_mon_vals no callback set 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96b54cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:32.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.971+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f96b008bcd0 con 0x7f96b012c330 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.972+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f96a4002ec0 con 0x7f96b00906d0 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.972+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(111..111 src has 1..111) ==== 3915+0+0 (unknown 47404181 0 0) 0x7f96a404ec30 con 0x7f96b00906d0 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.972+0000 7f96af7fe640 10 monclient: get_auth_request con 0x7f967c03fa80 auth_method 0 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f96ae7fc640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.82:6789/0 conn(0x7f96b012c330 legacy=0x7f96b012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1462647928 0 0) 0x7f96b008bcd0 con 0x7f96b012c330 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 10 monclient(hunting): my global_id is 4543 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96b0133c50 con 0x7f96b012c330 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1399962335 0 0) 0x7f96b0133c50 con 0x7f96b012c330 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96b008bcd0 con 0x7f96b012c330 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96980043a0 con 0x7f96b012c330 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.974+0000 7f968f7fe640 10 monclient: dump: 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.988 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.975+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1170979859 0 0) 0x7f96b008bcd0 con 0x7f96b012c330 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.975+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96b005c950 con 0x7f96b012c330 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.975+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9698006750 con 0x7f96b012c330 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.975+0000 7f968f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.975+0000 7f968f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.975+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.82:6789/0 conn(0x7f96b012c330 legacy=0x7f96b012c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.975+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.82:6789/0 conn(0x7f96b012c330 legacy=0x7f96b012c700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.978+0000 7f96b54cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.978+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f96b012d210 con 0x7f96b012ce10 2026-02-12T17:30:32.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f96ae7fc640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.82:6789/0 conn(0x7f96b012ce10 legacy=0x7f96b01773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229970359 0 0) 0x7f96b012d210 con 0x7f96b012ce10 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 10 monclient(hunting): my global_id is 4546 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96b008bcd0 con 0x7f96b012ce10 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2097364167 0 0) 0x7f96b008bcd0 con 0x7f96b012ce10 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96b012d210 con 0x7f96b012ce10 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9698004d00 con 0x7f96b012ce10 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 10 monclient: dump: 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:30:32.990 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1311594124 0 0) 0x7f96b012d210 con 0x7f96b012ce10 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f96b0092c50 con 0x7f96b012ce10 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 1163092981) 0x7f96980062a0 con 0x7f96b012ce10 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.82:6789/0 conn(0x7f96b012ce10 legacy=0x7f96b01773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f968f7fe640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.82:6789/0 conn(0x7f96b012ce10 legacy=0x7f96b01773b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:32.991 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 16, 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 154478, 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:32.992 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:32.993 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:30:32.994 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.995 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:30:32.996 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:30:32.997 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:32.998 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:30:32.999 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:30:33.000 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:30:33.000 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:30:33.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.82:6800/2441377515 conn(0x7f967c03fa80 legacy=0x7f967c05ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:33.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f96b54cc640 10 monclient: shutdown 2026-02-12T17:30:33.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f96b54cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:30:33.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 >> v1:10.20.193.57:6789/0 conn(0x7f96b00906d0 legacy=0x7f96b012fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:30:33.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.981+0000 7f96af7fe640 1 -- 10.20.193.57:0/814785643 reap_dead start 2026-02-12T17:30:33.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.982+0000 7f96af7fe640 1 -- 10.20.193.57:0/814785643 reap_dead start 2026-02-12T17:30:33.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.982+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 shutdown_connections 2026-02-12T17:30:33.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.982+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 >> 10.20.193.57:0/814785643 conn(0x7f96b0054330 msgr2=0x7f96b008f690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:30:33.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.982+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 shutdown_connections 2026-02-12T17:30:33.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:30:32.982+0000 7f96b54cc640 1 -- 10.20.193.57:0/814785643 wait complete. 2026-02-12T17:30:33.001 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:30:33.001 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:30:33.630 INFO:tasks.rados.rados.0.trial082.stdout:435: done (0 left) 2026-02-12T17:30:33.630 INFO:tasks.rados.rados.0.trial082.stdout:436: read oid 26 snap 41 2026-02-12T17:30:33.630 INFO:tasks.rados.rados.0.trial082.stdout:436: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-12T17:30:33.630 INFO:tasks.rados.rados.0.trial082.stdout:437: snap_remove snap 44 2026-02-12T17:30:34.631 INFO:tasks.rados.rados.0.trial082.stdout:437: done (1 left) 2026-02-12T17:30:34.631 INFO:tasks.rados.rados.0.trial082.stdout:438: snap_create 2026-02-12T17:30:34.631 INFO:tasks.rados.rados.0.trial082.stdout:436: expect (ObjNum 25 snap 0 seq_num 25) 2026-02-12T17:30:34.631 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:34.650 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:34.667 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:35.632 INFO:tasks.rados.rados.0.trial082.stdout:436: done (1 left) 2026-02-12T17:30:35.632 INFO:tasks.rados.rados.0.trial082.stdout:438: done (0 left) 2026-02-12T17:30:35.632 INFO:tasks.rados.rados.0.trial082.stdout:439: copy_from oid 48 from oid 1 current snap is 46 2026-02-12T17:30:35.632 INFO:tasks.rados.rados.0.trial082.stdout:440: write oid 44 current snap is 46 2026-02-12T17:30:35.632 INFO:tasks.rados.rados.0.trial082.stdout:440: seq_num 182 ranges {658874=771437,2083958=603055} 2026-02-12T17:30:35.638 INFO:tasks.rados.rados.0.trial082.stdout:440: writing trial08226312-44 from 658874 to 1430311 tid 1 2026-02-12T17:30:35.643 INFO:tasks.rados.rados.0.trial082.stdout:440: writing trial08226312-44 from 2083958 to 2687013 tid 2 2026-02-12T17:30:35.643 INFO:tasks.rados.rados.0.trial082.stdout:441: read oid 32 snap -1 2026-02-12T17:30:35.643 INFO:tasks.rados.rados.0.trial082.stdout:441: expect (ObjNum 173 snap 43 seq_num 173) 2026-02-12T17:30:35.643 INFO:tasks.rados.rados.0.trial082.stdout:442: write (excl) oid 40 current snap is 46 2026-02-12T17:30:35.643 INFO:tasks.rados.rados.0.trial082.stdout:439: finishing copy_from to trial08226312-48 2026-02-12T17:30:35.643 INFO:tasks.rados.rados.0.trial082.stdout:439: got expected ENOENT (src dne) 2026-02-12T17:30:35.643 INFO:tasks.rados.rados.0.trial082.stdout:439: finishing copy_from racing read to trial08226312-48 2026-02-12T17:30:35.643 INFO:tasks.rados.rados.0.trial082.stdout:440: finishing write tid 1 to trial08226312-44 2026-02-12T17:30:35.644 INFO:tasks.rados.rados.0.trial082.stdout:442: seq_num 183 ranges {675681=563039,1858793=746713,3025937=49744} 2026-02-12T17:30:35.647 INFO:tasks.rados.rados.0.trial082.stdout:442: writing trial08226312-40 from 675681 to 1238720 tid 1 2026-02-12T17:30:35.652 INFO:tasks.rados.rados.0.trial082.stdout:442: writing trial08226312-40 from 1858793 to 2605506 tid 2 2026-02-12T17:30:35.654 INFO:tasks.rados.rados.0.trial082.stdout:442: writing trial08226312-40 from 3025937 to 3075681 tid 3 2026-02-12T17:30:35.654 INFO:tasks.rados.rados.0.trial082.stdout:439: done (3 left) 2026-02-12T17:30:35.654 INFO:tasks.rados.rados.0.trial082.stdout:443: snap_create 2026-02-12T17:30:35.655 INFO:tasks.rados.rados.0.trial082.stdout:440: finishing write tid 2 to trial08226312-44 2026-02-12T17:30:35.655 INFO:tasks.rados.rados.0.trial082.stdout:440: finishing write tid 3 to trial08226312-44 2026-02-12T17:30:35.655 INFO:tasks.rados.rados.0.trial082.stdout:440: finishing write tid 4 to trial08226312-44 2026-02-12T17:30:35.655 INFO:tasks.rados.rados.0.trial082.stdout:440: oid 44 updating version 0 to 264 2026-02-12T17:30:35.655 INFO:tasks.rados.rados.0.trial082.stdout:440: oid 44 updating version 264 to 265 2026-02-12T17:30:35.655 INFO:tasks.rados.rados.0.trial082.stdout:440: oid 44 updating version 265 to 266 2026-02-12T17:30:35.655 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 266 (ObjNum 182 snap 46 seq_num 182) dirty exists 2026-02-12T17:30:35.655 INFO:tasks.rados.rados.0.trial082.stdout:440: left oid 44 (ObjNum 182 snap 46 seq_num 182) 2026-02-12T17:30:35.655 INFO:tasks.rados.rados.0.trial082.stdout:441: expect (ObjNum 173 snap 43 seq_num 173) 2026-02-12T17:30:35.785 INFO:tasks.rados.rados.0.trial082.stdout:442: finishing write tid 1 to trial08226312-40 2026-02-12T17:30:35.786 INFO:tasks.rados.rados.0.trial082.stdout:442: finishing write tid 2 to trial08226312-40 2026-02-12T17:30:35.786 INFO:tasks.rados.rados.0.trial082.stdout:442: finishing write tid 3 to trial08226312-40 2026-02-12T17:30:35.786 INFO:tasks.rados.rados.0.trial082.stdout:442: finishing write tid 4 to trial08226312-40 2026-02-12T17:30:35.786 INFO:tasks.rados.rados.0.trial082.stdout:442: finishing write tid 5 to trial08226312-40 2026-02-12T17:30:35.786 INFO:tasks.rados.rados.0.trial082.stdout:442: oid 40 updating version 0 to 279 2026-02-12T17:30:35.786 INFO:tasks.rados.rados.0.trial082.stdout:442: oid 40 version 279 is already newer than 278 2026-02-12T17:30:35.786 INFO:tasks.rados.rados.0.trial082.stdout:442: oid 40 updating version 279 to 281 2026-02-12T17:30:35.786 INFO:tasks.rados.rados.0.trial082.stdout:442: oid 40 version 281 is already newer than 280 2026-02-12T17:30:35.787 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 281 (ObjNum 183 snap 46 seq_num 183) dirty exists 2026-02-12T17:30:35.787 INFO:tasks.rados.rados.0.trial082.stdout:442: left oid 40 (ObjNum 183 snap 46 seq_num 183) 2026-02-12T17:30:36.637 INFO:tasks.rados.rados.0.trial082.stdout:440: done (3 left) 2026-02-12T17:30:36.637 INFO:tasks.rados.rados.0.trial082.stdout:441: done (2 left) 2026-02-12T17:30:36.637 INFO:tasks.rados.rados.0.trial082.stdout:442: done (1 left) 2026-02-12T17:30:36.637 INFO:tasks.rados.rados.0.trial082.stdout:443: done (0 left) 2026-02-12T17:30:36.637 INFO:tasks.rados.rados.0.trial082.stdout:444: snap_create 2026-02-12T17:30:37.623 INFO:tasks.rados.rados.0.trial082.stdout:444: done (0 left) 2026-02-12T17:30:37.623 INFO:tasks.rados.rados.0.trial082.stdout:445: write oid 40 current snap is 48 2026-02-12T17:30:37.623 INFO:tasks.rados.rados.0.trial082.stdout:445: seq_num 184 ranges {692488=638288,1917275=606724} 2026-02-12T17:30:37.627 INFO:tasks.rados.rados.0.trial082.stdout:445: writing trial08226312-40 from 692488 to 1330776 tid 1 2026-02-12T17:30:37.632 INFO:tasks.rados.rados.0.trial082.stdout:445: writing trial08226312-40 from 1917275 to 2523999 tid 2 2026-02-12T17:30:37.633 INFO:tasks.rados.rados.0.trial082.stdout:446: read oid 30 snap -1 2026-02-12T17:30:37.633 INFO:tasks.rados.rados.0.trial082.stdout:446: expect (ObjNum 140 snap 34 seq_num 140) 2026-02-12T17:30:37.633 INFO:tasks.rados.rados.0.trial082.stdout:447: write (excl) oid 28 current snap is 48 2026-02-12T17:30:37.633 INFO:tasks.rados.rados.0.trial082.stdout:445: finishing write tid 1 to trial08226312-40 2026-02-12T17:30:37.633 INFO:tasks.rados.rados.0.trial082.stdout:447: seq_num 185 ranges {709295=713537,1859404=750382} 2026-02-12T17:30:37.637 INFO:tasks.rados.rados.0.trial082.stdout:447: writing trial08226312-28 from 709295 to 1422832 tid 1 2026-02-12T17:30:37.642 INFO:tasks.rados.rados.0.trial082.stdout:447: writing trial08226312-28 from 1859404 to 2609786 tid 2 2026-02-12T17:30:37.642 INFO:tasks.rados.rados.0.trial082.stdout:448: copy_from oid 22 from oid 49 current snap is 48 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:445: finishing write tid 2 to trial08226312-40 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:445: finishing write tid 3 to trial08226312-40 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:445: finishing write tid 4 to trial08226312-40 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:445: oid 40 updating version 0 to 285 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:445: oid 40 version 285 is already newer than 284 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:445: oid 40 version 285 is already newer than 283 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 285 (ObjNum 184 snap 48 seq_num 184) dirty exists 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:445: left oid 40 (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:446: expect (ObjNum 140 snap 34 seq_num 140) 2026-02-12T17:30:37.643 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:37.661 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:447: finishing write tid 1 to trial08226312-28 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:445: done (3 left) 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:446: done (2 left) 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:449: delete oid 20 current snap is 48 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:447: finishing write tid 2 to trial08226312-28 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:447: finishing write tid 3 to trial08226312-28 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:447: finishing write tid 4 to trial08226312-28 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:447: oid 28 updating version 0 to 289 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:447: oid 28 version 289 is already newer than 288 2026-02-12T17:30:37.700 INFO:tasks.rados.rados.0.trial082.stdout:447: oid 28 version 289 is already newer than 287 2026-02-12T17:30:37.701 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 289 (ObjNum 185 snap 48 seq_num 185) dirty exists 2026-02-12T17:30:37.701 INFO:tasks.rados.rados.0.trial082.stdout:447: left oid 28 (ObjNum 185 snap 48 seq_num 185) 2026-02-12T17:30:37.701 INFO:tasks.rados.rados.0.trial082.stdout:448: finishing copy_from racing read to trial08226312-22 2026-02-12T17:30:37.701 INFO:tasks.rados.rados.0.trial082.stdout:448: finishing copy_from to trial08226312-22 2026-02-12T17:30:37.701 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 15 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:30:37.702 INFO:tasks.rados.rados.0.trial082.stdout:447: done (2 left) 2026-02-12T17:30:37.702 INFO:tasks.rados.rados.0.trial082.stdout:448: done (1 left) 2026-02-12T17:30:37.702 INFO:tasks.rados.rados.0.trial082.stdout:449: done (0 left) 2026-02-12T17:30:37.702 INFO:tasks.rados.rados.0.trial082.stdout:450: read oid 26 snap -1 2026-02-12T17:30:37.702 INFO:tasks.rados.rados.0.trial082.stdout:450: expect (ObjNum 167 snap 42 seq_num 167) 2026-02-12T17:30:37.702 INFO:tasks.rados.rados.0.trial082.stdout:451: read oid 20 snap -1 2026-02-12T17:30:37.702 INFO:tasks.rados.rados.0.trial082.stdout:451: expect deleted 2026-02-12T17:30:37.702 INFO:tasks.rados.rados.0.trial082.stdout:452: snap_create 2026-02-12T17:30:37.703 INFO:tasks.rados.rados.0.trial082.stdout:450: expect (ObjNum 167 snap 42 seq_num 167) 2026-02-12T17:30:37.720 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2648712 2026-02-12T17:30:37.736 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2304058 2026-02-12T17:30:38.641 INFO:tasks.rados.rados.0.trial082.stdout:450: done (2 left) 2026-02-12T17:30:38.641 INFO:tasks.rados.rados.0.trial082.stdout:451: done (1 left) 2026-02-12T17:30:38.641 INFO:tasks.rados.rados.0.trial082.stdout:452: done (0 left) 2026-02-12T17:30:38.641 INFO:tasks.rados.rados.0.trial082.stdout:453: delete oid 7 current snap is 49 2026-02-12T17:30:38.644 INFO:tasks.rados.rados.0.trial082.stdout:453: done (0 left) 2026-02-12T17:30:38.644 INFO:tasks.rados.rados.0.trial082.stdout:454: read oid 7 snap -1 2026-02-12T17:30:38.644 INFO:tasks.rados.rados.0.trial082.stdout:454: expect deleted 2026-02-12T17:30:38.644 INFO:tasks.rados.rados.0.trial082.stdout:455: delete oid 5 current snap is 49 2026-02-12T17:30:38.646 INFO:tasks.rados.rados.0.trial082.stdout:454: done (1 left) 2026-02-12T17:30:38.646 INFO:tasks.rados.rados.0.trial082.stdout:455: done (0 left) 2026-02-12T17:30:38.646 INFO:tasks.rados.rados.0.trial082.stdout:456: read oid 39 snap -1 2026-02-12T17:30:38.646 INFO:tasks.rados.rados.0.trial082.stdout:456: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:30:38.646 INFO:tasks.rados.rados.0.trial082.stdout:457: read oid 21 snap 48 2026-02-12T17:30:38.646 INFO:tasks.rados.rados.0.trial082.stdout:457: expect (ObjNum 171 snap 42 seq_num 171) 2026-02-12T17:30:38.646 INFO:tasks.rados.rados.0.trial082.stdout:458: delete oid 25 current snap is 49 2026-02-12T17:30:38.647 INFO:tasks.rados.rados.0.trial082.stdout:458: done (2 left) 2026-02-12T17:30:38.647 INFO:tasks.rados.rados.0.trial082.stdout:459: snap_remove snap 47 2026-02-12T17:30:40.337 INFO:tasks.rados.rados.0.trial082.stdout:459: done (2 left) 2026-02-12T17:30:40.337 INFO:tasks.rados.rados.0.trial082.stdout:460: write oid 32 current snap is 49 2026-02-12T17:30:40.337 INFO:tasks.rados.rados.0.trial082.stdout:460: seq_num 190 ranges {793330=689782,2035461=617731,3101545=91785} 2026-02-12T17:30:40.343 INFO:tasks.rados.rados.0.trial082.stdout:460: writing trial08226312-32 from 793330 to 1483112 tid 1 2026-02-12T17:30:40.347 INFO:tasks.rados.rados.0.trial082.stdout:460: writing trial08226312-32 from 2035461 to 2653192 tid 2 2026-02-12T17:30:40.350 INFO:tasks.rados.rados.0.trial082.stdout:460: writing trial08226312-32 from 3101545 to 3193330 tid 3 2026-02-12T17:30:40.350 INFO:tasks.rados.rados.0.trial082.stdout:461: snap_create 2026-02-12T17:30:40.350 INFO:tasks.rados.rados.0.trial082.stdout:456: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:30:40.397 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2877339 2026-02-12T17:30:40.430 INFO:tasks.rados.rados.0.trial082.stdout:457: expect (ObjNum 171 snap 42 seq_num 171) 2026-02-12T17:30:40.458 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2022287 2026-02-12T17:30:40.484 INFO:tasks.rados.rados.0.trial082.stdout:460: finishing write tid 1 to trial08226312-32 2026-02-12T17:30:40.484 INFO:tasks.rados.rados.0.trial082.stdout:460: finishing write tid 2 to trial08226312-32 2026-02-12T17:30:40.485 INFO:tasks.rados.rados.0.trial082.stdout:460: finishing write tid 3 to trial08226312-32 2026-02-12T17:30:40.485 INFO:tasks.rados.rados.0.trial082.stdout:460: finishing write tid 4 to trial08226312-32 2026-02-12T17:30:40.485 INFO:tasks.rados.rados.0.trial082.stdout:460: finishing write tid 5 to trial08226312-32 2026-02-12T17:30:40.485 INFO:tasks.rados.rados.0.trial082.stdout:460: oid 32 updating version 0 to 126 2026-02-12T17:30:40.485 INFO:tasks.rados.rados.0.trial082.stdout:460: oid 32 updating version 126 to 128 2026-02-12T17:30:40.485 INFO:tasks.rados.rados.0.trial082.stdout:460: oid 32 version 128 is already newer than 127 2026-02-12T17:30:40.485 INFO:tasks.rados.rados.0.trial082.stdout:460: oid 32 version 128 is already newer than 125 2026-02-12T17:30:40.485 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 128 (ObjNum 190 snap 49 seq_num 190) dirty exists 2026-02-12T17:30:40.485 INFO:tasks.rados.rados.0.trial082.stdout:460: left oid 32 (ObjNum 190 snap 49 seq_num 190) 2026-02-12T17:30:40.738 INFO:tasks.rados.rados.0.trial082.stdout:456: done (3 left) 2026-02-12T17:30:40.738 INFO:tasks.rados.rados.0.trial082.stdout:457: done (2 left) 2026-02-12T17:30:40.738 INFO:tasks.rados.rados.0.trial082.stdout:460: done (1 left) 2026-02-12T17:30:40.738 INFO:tasks.rados.rados.0.trial082.stdout:461: done (0 left) 2026-02-12T17:30:40.739 INFO:tasks.rados.rados.0.trial082.stdout:462: delete oid 37 current snap is 50 2026-02-12T17:30:40.739 INFO:tasks.rados.rados.0.trial082.stdout:462: done (0 left) 2026-02-12T17:30:40.740 INFO:tasks.rados.rados.0.trial082.stdout:463: write oid 13 current snap is 50 2026-02-12T17:30:40.740 INFO:tasks.rados.rados.0.trial082.stdout:463: seq_num 192 ranges {426944=556633,1468778=621400,2872744=354200} 2026-02-12T17:30:40.743 INFO:tasks.rados.rados.0.trial082.stdout:463: writing trial08226312-13 from 426944 to 983577 tid 1 2026-02-12T17:30:40.747 INFO:tasks.rados.rados.0.trial082.stdout:463: writing trial08226312-13 from 1468778 to 2090178 tid 2 2026-02-12T17:30:40.752 INFO:tasks.rados.rados.0.trial082.stdout:463: writing trial08226312-13 from 2872744 to 3226944 tid 3 2026-02-12T17:30:40.752 INFO:tasks.rados.rados.0.trial082.stdout:464: read oid 1 snap -1 2026-02-12T17:30:40.752 INFO:tasks.rados.rados.0.trial082.stdout:464: expect deleted 2026-02-12T17:30:40.752 INFO:tasks.rados.rados.0.trial082.stdout:465: read oid 27 snap -1 2026-02-12T17:30:40.753 INFO:tasks.rados.rados.0.trial082.stdout:465: expect (ObjNum 169 snap 42 seq_num 169) 2026-02-12T17:30:40.753 INFO:tasks.rados.rados.0.trial082.stdout:466: snap_create 2026-02-12T17:30:40.753 INFO:tasks.rados.rados.0.trial082.stdout:463: finishing write tid 1 to trial08226312-13 2026-02-12T17:30:40.753 INFO:tasks.rados.rados.0.trial082.stdout:463: finishing write tid 2 to trial08226312-13 2026-02-12T17:30:40.753 INFO:tasks.rados.rados.0.trial082.stdout:463: finishing write tid 3 to trial08226312-13 2026-02-12T17:30:40.757 INFO:tasks.rados.rados.0.trial082.stdout:465: expect (ObjNum 169 snap 42 seq_num 169) 2026-02-12T17:30:40.757 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:40.793 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:40.828 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:40.863 INFO:tasks.rados.rados.0.trial082.stdout:463: finishing write tid 4 to trial08226312-13 2026-02-12T17:30:40.864 INFO:tasks.rados.rados.0.trial082.stdout:463: finishing write tid 5 to trial08226312-13 2026-02-12T17:30:40.864 INFO:tasks.rados.rados.0.trial082.stdout:463: oid 13 updating version 0 to 117 2026-02-12T17:30:40.864 INFO:tasks.rados.rados.0.trial082.stdout:463: oid 13 updating version 117 to 119 2026-02-12T17:30:40.864 INFO:tasks.rados.rados.0.trial082.stdout:463: oid 13 version 119 is already newer than 118 2026-02-12T17:30:40.864 INFO:tasks.rados.rados.0.trial082.stdout:463: oid 13 updating version 119 to 120 2026-02-12T17:30:40.864 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 120 (ObjNum 192 snap 50 seq_num 192) dirty exists 2026-02-12T17:30:40.864 INFO:tasks.rados.rados.0.trial082.stdout:463: left oid 13 (ObjNum 192 snap 50 seq_num 192) 2026-02-12T17:30:41.739 INFO:tasks.rados.rados.0.trial082.stdout:463: done (3 left) 2026-02-12T17:30:41.739 INFO:tasks.rados.rados.0.trial082.stdout:464: done (2 left) 2026-02-12T17:30:41.739 INFO:tasks.rados.rados.0.trial082.stdout:465: done (1 left) 2026-02-12T17:30:41.739 INFO:tasks.rados.rados.0.trial082.stdout:466: done (0 left) 2026-02-12T17:30:41.740 INFO:tasks.rados.rados.0.trial082.stdout:467: copy_from oid 16 from oid 35 current snap is 51 2026-02-12T17:30:41.740 INFO:tasks.rados.rados.0.trial082.stdout:468: read oid 17 snap -1 2026-02-12T17:30:41.740 INFO:tasks.rados.rados.0.trial082.stdout:468: expect (ObjNum 65 snap 8 seq_num 65) 2026-02-12T17:30:41.740 INFO:tasks.rados.rados.0.trial082.stdout:469: snap_remove snap 41 2026-02-12T17:30:42.624 INFO:tasks.rados.rados.0.trial082.stdout:469: done (2 left) 2026-02-12T17:30:42.624 INFO:tasks.rados.rados.0.trial082.stdout:470: write (excl) oid 50 current snap is 51 2026-02-12T17:30:42.624 INFO:tasks.rados.rados.0.trial082.stdout:470: seq_num 193 ranges {443751=631882,1810907=765058,3067461=176290} 2026-02-12T17:30:42.628 INFO:tasks.rados.rados.0.trial082.stdout:470: writing trial08226312-50 from 443751 to 1075633 tid 1 2026-02-12T17:30:42.633 INFO:tasks.rados.rados.0.trial082.stdout:470: writing trial08226312-50 from 1810907 to 2575965 tid 2 2026-02-12T17:30:42.636 INFO:tasks.rados.rados.0.trial082.stdout:470: writing trial08226312-50 from 3067461 to 3243751 tid 3 2026-02-12T17:30:42.636 INFO:tasks.rados.rados.0.trial082.stdout:471: write oid 6 current snap is 51 2026-02-12T17:30:42.636 INFO:tasks.rados.rados.0.trial082.stdout:471: seq_num 194 ranges {460558=707131,1869389=508716,3094884=165674} 2026-02-12T17:30:42.640 INFO:tasks.rados.rados.0.trial082.stdout:471: writing trial08226312-6 from 460558 to 1167689 tid 1 2026-02-12T17:30:42.645 INFO:tasks.rados.rados.0.trial082.stdout:471: writing trial08226312-6 from 1869389 to 2378105 tid 2 2026-02-12T17:30:42.648 INFO:tasks.rados.rados.0.trial082.stdout:471: writing trial08226312-6 from 3094884 to 3260558 tid 3 2026-02-12T17:30:42.648 INFO:tasks.rados.rados.0.trial082.stdout:472: snap_create 2026-02-12T17:30:42.649 INFO:tasks.rados.rados.0.trial082.stdout:468: expect (ObjNum 65 snap 8 seq_num 65) 2026-02-12T17:30:42.653 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1801912 2026-02-12T17:30:42.685 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:42.729 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 593426 2026-02-12T17:30:42.767 INFO:tasks.rados.rados.0.trial082.stdout:467: finishing copy_from to trial08226312-16 2026-02-12T17:30:42.767 INFO:tasks.rados.rados.0.trial082.stdout:467: got expected ENOENT (src dne) 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:467: finishing copy_from racing read to trial08226312-16 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:470: finishing write tid 1 to trial08226312-50 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:470: finishing write tid 2 to trial08226312-50 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:470: finishing write tid 3 to trial08226312-50 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:470: finishing write tid 4 to trial08226312-50 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:470: finishing write tid 5 to trial08226312-50 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:470: oid 50 updating version 0 to 66 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:470: oid 50 updating version 66 to 67 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:470: oid 50 updating version 67 to 68 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:470: oid 50 version 68 is already newer than 65 2026-02-12T17:30:42.768 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 68 (ObjNum 193 snap 51 seq_num 193) dirty exists 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:470: left oid 50 (ObjNum 193 snap 51 seq_num 193) 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:471: finishing write tid 1 to trial08226312-6 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:471: finishing write tid 2 to trial08226312-6 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:471: finishing write tid 3 to trial08226312-6 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:471: finishing write tid 4 to trial08226312-6 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:471: finishing write tid 5 to trial08226312-6 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:471: oid 6 updating version 0 to 71 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:471: oid 6 updating version 71 to 73 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:471: oid 6 version 73 is already newer than 72 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:471: oid 6 version 73 is already newer than 70 2026-02-12T17:30:42.769 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 73 (ObjNum 194 snap 51 seq_num 194) dirty exists 2026-02-12T17:30:42.770 INFO:tasks.rados.rados.0.trial082.stdout:471: left oid 6 (ObjNum 194 snap 51 seq_num 194) 2026-02-12T17:30:43.625 INFO:tasks.rados.rados.0.trial082.stdout:467: done (4 left) 2026-02-12T17:30:43.625 INFO:tasks.rados.rados.0.trial082.stdout:468: done (3 left) 2026-02-12T17:30:43.625 INFO:tasks.rados.rados.0.trial082.stdout:470: done (2 left) 2026-02-12T17:30:43.625 INFO:tasks.rados.rados.0.trial082.stdout:471: done (1 left) 2026-02-12T17:30:43.626 INFO:tasks.rados.rados.0.trial082.stdout:472: done (0 left) 2026-02-12T17:30:43.626 INFO:tasks.rados.rados.0.trial082.stdout:473: read oid 48 snap -1 2026-02-12T17:30:43.626 INFO:tasks.rados.rados.0.trial082.stdout:473: expect deleted 2026-02-12T17:30:43.626 INFO:tasks.rados.rados.0.trial082.stdout:474: write oid 21 current snap is 52 2026-02-12T17:30:43.626 INFO:tasks.rados.rados.0.trial082.stdout:474: seq_num 195 ranges {477365=782380,1927871=768727,3122307=155058} 2026-02-12T17:30:43.630 INFO:tasks.rados.rados.0.trial082.stdout:474: writing trial08226312-21 from 477365 to 1259745 tid 1 2026-02-12T17:30:43.636 INFO:tasks.rados.rados.0.trial082.stdout:474: writing trial08226312-21 from 1927871 to 2696598 tid 2 2026-02-12T17:30:43.638 INFO:tasks.rados.rados.0.trial082.stdout:474: writing trial08226312-21 from 3122307 to 3277365 tid 3 2026-02-12T17:30:43.638 INFO:tasks.rados.rados.0.trial082.stdout:475: write oid 3 current snap is 52 2026-02-12T17:30:43.638 INFO:tasks.rados.rados.0.trial082.stdout:475: seq_num 196 ranges {494172=457629,1586353=512385,2749730=544442} 2026-02-12T17:30:43.641 INFO:tasks.rados.rados.0.trial082.stdout:475: writing trial08226312-3 from 494172 to 951801 tid 1 2026-02-12T17:30:43.646 INFO:tasks.rados.rados.0.trial082.stdout:475: writing trial08226312-3 from 1586353 to 2098738 tid 2 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:475: writing trial08226312-3 from 2749730 to 3294172 tid 3 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:476: copy_from oid 33 from oid 9 current snap is 52 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:474: finishing write tid 1 to trial08226312-21 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:474: finishing write tid 2 to trial08226312-21 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:474: finishing write tid 3 to trial08226312-21 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:474: finishing write tid 4 to trial08226312-21 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:474: finishing write tid 5 to trial08226312-21 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:474: oid 21 updating version 0 to 217 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:474: oid 21 updating version 217 to 219 2026-02-12T17:30:43.652 INFO:tasks.rados.rados.0.trial082.stdout:474: oid 21 version 219 is already newer than 218 2026-02-12T17:30:43.653 INFO:tasks.rados.rados.0.trial082.stdout:474: oid 21 version 219 is already newer than 216 2026-02-12T17:30:43.653 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 219 (ObjNum 195 snap 52 seq_num 195) dirty exists 2026-02-12T17:30:43.653 INFO:tasks.rados.rados.0.trial082.stdout:474: left oid 21 (ObjNum 195 snap 52 seq_num 195) 2026-02-12T17:30:43.653 INFO:tasks.rados.rados.0.trial082.stdout:475: finishing write tid 1 to trial08226312-3 2026-02-12T17:30:43.653 INFO:tasks.rados.rados.0.trial082.stdout:473: done (3 left) 2026-02-12T17:30:43.653 INFO:tasks.rados.rados.0.trial082.stdout:474: done (2 left) 2026-02-12T17:30:43.653 INFO:tasks.rados.rados.0.trial082.stdout:477: read oid 27 snap -1 2026-02-12T17:30:43.653 INFO:tasks.rados.rados.0.trial082.stdout:477: expect (ObjNum 169 snap 42 seq_num 169) 2026-02-12T17:30:43.653 INFO:tasks.rados.rados.0.trial082.stdout:478: snap_remove snap 48 2026-02-12T17:30:44.625 INFO:tasks.rados.rados.0.trial082.stdout:478: done (3 left) 2026-02-12T17:30:44.625 INFO:tasks.rados.rados.0.trial082.stdout:479: snap_remove snap 51 2026-02-12T17:30:45.628 INFO:tasks.rados.rados.0.trial082.stdout:479: done (3 left) 2026-02-12T17:30:45.628 INFO:tasks.rados.rados.0.trial082.stdout:480: copy_from oid 5 from oid 36 current snap is 52 2026-02-12T17:30:45.628 INFO:tasks.rados.rados.0.trial082.stdout:475: finishing write tid 2 to trial08226312-3 2026-02-12T17:30:45.628 INFO:tasks.rados.rados.0.trial082.stdout:476: finishing copy_from to trial08226312-33 2026-02-12T17:30:45.628 INFO:tasks.rados.rados.0.trial082.stdout:476: got expected ENOENT (src dne) 2026-02-12T17:30:45.628 INFO:tasks.rados.rados.0.trial082.stdout:476: finishing copy_from racing read to trial08226312-33 2026-02-12T17:30:45.628 INFO:tasks.rados.rados.0.trial082.stdout:475: finishing write tid 3 to trial08226312-3 2026-02-12T17:30:45.628 INFO:tasks.rados.rados.0.trial082.stdout:475: finishing write tid 4 to trial08226312-3 2026-02-12T17:30:45.628 INFO:tasks.rados.rados.0.trial082.stdout:477: expect (ObjNum 169 snap 42 seq_num 169) 2026-02-12T17:30:45.721 INFO:tasks.rados.rados.0.trial082.stdout:475: finishing write tid 5 to trial08226312-3 2026-02-12T17:30:45.721 INFO:tasks.rados.rados.0.trial082.stdout:475: oid 3 updating version 0 to 169 2026-02-12T17:30:45.721 INFO:tasks.rados.rados.0.trial082.stdout:475: oid 3 version 169 is already newer than 167 2026-02-12T17:30:45.721 INFO:tasks.rados.rados.0.trial082.stdout:475: oid 3 version 169 is already newer than 166 2026-02-12T17:30:45.722 INFO:tasks.rados.rados.0.trial082.stdout:475: oid 3 version 169 is already newer than 168 2026-02-12T17:30:45.722 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 169 (ObjNum 196 snap 52 seq_num 196) dirty exists 2026-02-12T17:30:45.722 INFO:tasks.rados.rados.0.trial082.stdout:475: left oid 3 (ObjNum 196 snap 52 seq_num 196) 2026-02-12T17:30:45.722 INFO:tasks.rados.rados.0.trial082.stdout:480: finishing copy_from racing read to trial08226312-5 2026-02-12T17:30:45.722 INFO:tasks.rados.rados.0.trial082.stdout:480: finishing copy_from to trial08226312-5 2026-02-12T17:30:45.723 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 263 (ObjNum 177 snap 43 seq_num 177) dirty exists 2026-02-12T17:30:45.723 INFO:tasks.rados.rados.0.trial082.stdout:475: done (3 left) 2026-02-12T17:30:45.723 INFO:tasks.rados.rados.0.trial082.stdout:476: done (2 left) 2026-02-12T17:30:45.723 INFO:tasks.rados.rados.0.trial082.stdout:477: done (1 left) 2026-02-12T17:30:45.723 INFO:tasks.rados.rados.0.trial082.stdout:480: done (0 left) 2026-02-12T17:30:45.723 INFO:tasks.rados.rados.0.trial082.stdout:481: read oid 9 snap -1 2026-02-12T17:30:45.724 INFO:tasks.rados.rados.0.trial082.stdout:481: expect deleted 2026-02-12T17:30:45.724 INFO:tasks.rados.rados.0.trial082.stdout:482: snap_remove snap 50 2026-02-12T17:30:46.631 INFO:tasks.rados.rados.0.trial082.stdout:482: done (1 left) 2026-02-12T17:30:46.631 INFO:tasks.rados.rados.0.trial082.stdout:483: write (excl) oid 24 current snap is 52 2026-02-12T17:30:46.631 INFO:tasks.rados.rados.0.trial082.stdout:483: seq_num 197 ranges {510979=532878,1528482=772396,3060800=250179} 2026-02-12T17:30:46.635 INFO:tasks.rados.rados.0.trial082.stdout:483: writing trial08226312-24 from 510979 to 1043857 tid 1 2026-02-12T17:30:46.639 INFO:tasks.rados.rados.0.trial082.stdout:483: writing trial08226312-24 from 1528482 to 2300878 tid 2 2026-02-12T17:30:46.643 INFO:tasks.rados.rados.0.trial082.stdout:483: writing trial08226312-24 from 3060800 to 3310979 tid 3 2026-02-12T17:30:46.644 INFO:tasks.rados.rados.0.trial082.stdout:484: write (excl) oid 34 current snap is 52 2026-02-12T17:30:46.644 INFO:tasks.rados.rados.0.trial082.stdout:484: seq_num 198 ranges {527786=724480,1703317=516054,2804576=435035} 2026-02-12T17:30:46.648 INFO:tasks.rados.rados.0.trial082.stdout:484: writing trial08226312-34 from 527786 to 1252266 tid 1 2026-02-12T17:30:46.652 INFO:tasks.rados.rados.0.trial082.stdout:484: writing trial08226312-34 from 1703317 to 2219371 tid 2 2026-02-12T17:30:46.656 INFO:tasks.rados.rados.0.trial082.stdout:484: writing trial08226312-34 from 2804576 to 3239611 tid 3 2026-02-12T17:30:46.656 INFO:tasks.rados.rados.0.trial082.stdout:485: delete oid 47 current snap is 52 2026-02-12T17:30:46.656 INFO:tasks.rados.rados.0.trial082.stdout:483: finishing write tid 1 to trial08226312-24 2026-02-12T17:30:46.656 INFO:tasks.rados.rados.0.trial082.stdout:483: finishing write tid 2 to trial08226312-24 2026-02-12T17:30:46.656 INFO:tasks.rados.rados.0.trial082.stdout:483: finishing write tid 3 to trial08226312-24 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:483: finishing write tid 4 to trial08226312-24 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:483: finishing write tid 5 to trial08226312-24 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:483: oid 24 updating version 0 to 276 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:483: oid 24 updating version 276 to 277 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:483: oid 24 version 277 is already newer than 275 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:483: oid 24 version 277 is already newer than 274 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 277 (ObjNum 197 snap 52 seq_num 197) dirty exists 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:483: left oid 24 (ObjNum 197 snap 52 seq_num 197) 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:484: finishing write tid 1 to trial08226312-34 2026-02-12T17:30:46.657 INFO:tasks.rados.rados.0.trial082.stdout:484: finishing write tid 2 to trial08226312-34 2026-02-12T17:30:46.659 INFO:tasks.rados.rados.0.trial082.stdout:481: done (3 left) 2026-02-12T17:30:46.659 INFO:tasks.rados.rados.0.trial082.stdout:483: done (2 left) 2026-02-12T17:30:46.659 INFO:tasks.rados.rados.0.trial082.stdout:485: done (1 left) 2026-02-12T17:30:46.659 INFO:tasks.rados.rados.0.trial082.stdout:486: copy_from oid 22 from oid 12 current snap is 52 2026-02-12T17:30:46.659 INFO:tasks.rados.rados.0.trial082.stdout:487: snap_create 2026-02-12T17:30:46.659 INFO:tasks.rados.rados.0.trial082.stdout:484: finishing write tid 3 to trial08226312-34 2026-02-12T17:30:46.659 INFO:tasks.rados.rados.0.trial082.stdout:484: finishing write tid 4 to trial08226312-34 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:486: finishing copy_from to trial08226312-22 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:486: got expected ENOENT (src dne) 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:484: finishing write tid 5 to trial08226312-34 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:484: oid 34 updating version 0 to 113 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:484: oid 34 updating version 113 to 115 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:484: oid 34 version 115 is already newer than 114 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:484: oid 34 version 115 is already newer than 112 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 115 (ObjNum 198 snap 52 seq_num 198) dirty exists 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:484: left oid 34 (ObjNum 198 snap 52 seq_num 198) 2026-02-12T17:30:46.660 INFO:tasks.rados.rados.0.trial082.stdout:486: finishing copy_from racing read to trial08226312-22 2026-02-12T17:30:47.626 INFO:tasks.rados.rados.0.trial082.stdout:484: done (2 left) 2026-02-12T17:30:47.626 INFO:tasks.rados.rados.0.trial082.stdout:486: done (1 left) 2026-02-12T17:30:47.626 INFO:tasks.rados.rados.0.trial082.stdout:487: done (0 left) 2026-02-12T17:30:47.626 INFO:tasks.rados.rados.0.trial082.stdout:488: read oid 29 snap -1 2026-02-12T17:30:47.627 INFO:tasks.rados.rados.0.trial082.stdout:488: expect deleted 2026-02-12T17:30:47.627 INFO:tasks.rados.rados.0.trial082.stdout:489: rollback oid 38 current snap is 53 2026-02-12T17:30:47.627 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 46 2026-02-12T17:30:47.627 INFO:tasks.rados.rados.0.trial082.stdout:490: copy_from oid 17 from oid 40 current snap is 53 2026-02-12T17:30:47.627 INFO:tasks.rados.rados.0.trial082.stdout:491: write oid 21 current snap is 53 2026-02-12T17:30:47.627 INFO:tasks.rados.rados.0.trial082.stdout:491: seq_num 200 ranges {561400=474978,1820281=519723,2859422=457579} 2026-02-12T17:30:47.630 INFO:tasks.rados.rados.0.trial082.stdout:491: writing trial08226312-21 from 561400 to 1036378 tid 1 2026-02-12T17:30:47.635 INFO:tasks.rados.rados.0.trial082.stdout:491: writing trial08226312-21 from 1820281 to 2340004 tid 2 2026-02-12T17:30:47.640 INFO:tasks.rados.rados.0.trial082.stdout:491: writing trial08226312-21 from 2859422 to 3317001 tid 3 2026-02-12T17:30:47.640 INFO:tasks.rados.rados.0.trial082.stdout:492: read oid 15 snap -1 2026-02-12T17:30:47.640 INFO:tasks.rados.rados.0.trial082.stdout:492: expect (ObjNum 160 snap 40 seq_num 160) 2026-02-12T17:30:47.640 INFO:tasks.rados.rados.0.trial082.stdout:493: write (excl) oid 18 current snap is 53 2026-02-12T17:30:47.640 INFO:tasks.rados.rados.0.trial082.stdout:489: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:30:47.640 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 0 (ObjNum 129 snap 0 seq_num 27054248) dirty dne 2026-02-12T17:30:47.640 INFO:tasks.rados.rados.0.trial082.stdout:493: seq_num 201 ranges {578207=550227,1762410=779734,3286845=91362} 2026-02-12T17:30:47.644 INFO:tasks.rados.rados.0.trial082.stdout:493: writing trial08226312-18 from 578207 to 1128434 tid 1 2026-02-12T17:30:47.649 INFO:tasks.rados.rados.0.trial082.stdout:493: writing trial08226312-18 from 1762410 to 2542144 tid 2 2026-02-12T17:30:47.653 INFO:tasks.rados.rados.0.trial082.stdout:493: writing trial08226312-18 from 3286845 to 3378207 tid 3 2026-02-12T17:30:47.653 INFO:tasks.rados.rados.0.trial082.stdout:489: done (5 left) 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:494: snap_create 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:491: finishing write tid 1 to trial08226312-21 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:490: finishing copy_from racing read to trial08226312-17 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:490: finishing copy_from to trial08226312-17 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 285 (ObjNum 184 snap 48 seq_num 184) dirty exists 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:491: finishing write tid 2 to trial08226312-21 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:491: finishing write tid 3 to trial08226312-21 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:491: finishing write tid 4 to trial08226312-21 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:491: finishing write tid 5 to trial08226312-21 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:491: oid 21 updating version 0 to 229 2026-02-12T17:30:47.654 INFO:tasks.rados.rados.0.trial082.stdout:491: oid 21 version 229 is already newer than 228 2026-02-12T17:30:47.655 INFO:tasks.rados.rados.0.trial082.stdout:491: oid 21 updating version 229 to 230 2026-02-12T17:30:47.655 INFO:tasks.rados.rados.0.trial082.stdout:491: oid 21 version 230 is already newer than 227 2026-02-12T17:30:47.655 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 230 (ObjNum 200 snap 53 seq_num 200) dirty exists 2026-02-12T17:30:47.655 INFO:tasks.rados.rados.0.trial082.stdout:491: left oid 21 (ObjNum 200 snap 53 seq_num 200) 2026-02-12T17:30:47.655 INFO:tasks.rados.rados.0.trial082.stdout:492: expect (ObjNum 160 snap 40 seq_num 160) 2026-02-12T17:30:47.655 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:47.681 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 417487 2026-02-12T17:30:47.707 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:47.736 INFO:tasks.rados.rados.0.trial082.stdout:493: finishing write tid 1 to trial08226312-18 2026-02-12T17:30:47.736 INFO:tasks.rados.rados.0.trial082.stdout:493: finishing write tid 2 to trial08226312-18 2026-02-12T17:30:47.736 INFO:tasks.rados.rados.0.trial082.stdout:493: finishing write tid 3 to trial08226312-18 2026-02-12T17:30:47.736 INFO:tasks.rados.rados.0.trial082.stdout:493: finishing write tid 4 to trial08226312-18 2026-02-12T17:30:47.736 INFO:tasks.rados.rados.0.trial082.stdout:493: finishing write tid 5 to trial08226312-18 2026-02-12T17:30:47.737 INFO:tasks.rados.rados.0.trial082.stdout:493: oid 18 updating version 0 to 119 2026-02-12T17:30:47.737 INFO:tasks.rados.rados.0.trial082.stdout:493: oid 18 version 119 is already newer than 117 2026-02-12T17:30:47.737 INFO:tasks.rados.rados.0.trial082.stdout:493: oid 18 updating version 119 to 120 2026-02-12T17:30:47.737 INFO:tasks.rados.rados.0.trial082.stdout:493: oid 18 version 120 is already newer than 118 2026-02-12T17:30:47.737 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 120 (ObjNum 201 snap 53 seq_num 201) dirty exists 2026-02-12T17:30:47.737 INFO:tasks.rados.rados.0.trial082.stdout:493: left oid 18 (ObjNum 201 snap 53 seq_num 201) 2026-02-12T17:30:48.630 INFO:tasks.rados.rados.0.trial082.stdout:488: done (5 left) 2026-02-12T17:30:48.630 INFO:tasks.rados.rados.0.trial082.stdout:490: done (4 left) 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:491: done (3 left) 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:492: done (2 left) 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:493: done (1 left) 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:494: done (0 left) 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:495: copy_from oid 27 from oid 37 current snap is 54 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:496: read oid 9 snap -1 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:496: expect deleted 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:497: read oid 4 snap -1 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:497: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:30:48.631 INFO:tasks.rados.rados.0.trial082.stdout:498: snap_create 2026-02-12T17:30:48.632 INFO:tasks.rados.rados.0.trial082.stdout:495: finishing copy_from to trial08226312-27 2026-02-12T17:30:48.632 INFO:tasks.rados.rados.0.trial082.stdout:495: got expected ENOENT (src dne) 2026-02-12T17:30:48.632 INFO:tasks.rados.rados.0.trial082.stdout:495: finishing copy_from racing read to trial08226312-27 2026-02-12T17:30:48.633 INFO:tasks.rados.rados.0.trial082.stdout:497: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:30:48.636 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1396175 2026-02-12T17:30:48.675 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2231505 2026-02-12T17:30:48.683 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:495: done (3 left) 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:496: done (2 left) 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:497: done (1 left) 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:498: done (0 left) 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:499: copy_from oid 44 from oid 37 current snap is 55 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:500: rollback oid 32 current snap is 55 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 45 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:501: read oid 33 snap -1 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:501: expect (ObjNum 123 snap 28 seq_num 123) 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:502: rollback oid 48 current snap is 55 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 53 2026-02-12T17:30:49.632 INFO:tasks.rados.rados.0.trial082.stdout:503: read oid 14 snap 49 2026-02-12T17:30:49.633 INFO:tasks.rados.rados.0.trial082.stdout:503: expect (ObjNum 175 snap 43 seq_num 175) 2026-02-12T17:30:49.633 INFO:tasks.rados.rados.0.trial082.stdout:504: read oid 8 snap -1 2026-02-12T17:30:49.633 INFO:tasks.rados.rados.0.trial082.stdout:504: expect (ObjNum 178 snap 43 seq_num 178) 2026-02-12T17:30:49.633 INFO:tasks.rados.rados.0.trial082.stdout:505: read oid 46 snap -1 2026-02-12T17:30:49.633 INFO:tasks.rados.rados.0.trial082.stdout:505: expect (ObjNum 119 snap 27 seq_num 119) 2026-02-12T17:30:49.633 INFO:tasks.rados.rados.0.trial082.stdout:506: read oid 3 snap -1 2026-02-12T17:30:49.633 INFO:tasks.rados.rados.0.trial082.stdout:506: expect (ObjNum 196 snap 52 seq_num 196) 2026-02-12T17:30:49.633 INFO:tasks.rados.rados.0.trial082.stdout:507: snap_remove snap 52 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:507: done (8 left) 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:508: rollback oid 49 current snap is 55 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 46 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:502: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:500: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:500: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:500: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 136 (ObjNum 173 snap 43 seq_num 173) dirty exists 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:504: expect (ObjNum 178 snap 43 seq_num 178) 2026-02-12T17:30:50.637 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:50.686 INFO:tasks.rados.rados.0.trial082.stdout:499: finishing copy_from to trial08226312-44 2026-02-12T17:30:50.686 INFO:tasks.rados.rados.0.trial082.stdout:499: got expected ENOENT (src dne) 2026-02-12T17:30:50.686 INFO:tasks.rados.rados.0.trial082.stdout:499: finishing copy_from racing read to trial08226312-44 2026-02-12T17:30:50.686 INFO:tasks.rados.rados.0.trial082.stdout:505: expect (ObjNum 119 snap 27 seq_num 119) 2026-02-12T17:30:50.691 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1405725 2026-02-12T17:30:50.717 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:50.735 INFO:tasks.rados.rados.0.trial082.stdout:503: expect (ObjNum 175 snap 43 seq_num 175) 2026-02-12T17:30:50.747 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:50.790 INFO:tasks.rados.rados.0.trial082.stdout:501: expect (ObjNum 123 snap 28 seq_num 123) 2026-02-12T17:30:50.790 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:50.888 INFO:tasks.rados.rados.0.trial082.stdout:506: expect (ObjNum 196 snap 52 seq_num 196) 2026-02-12T17:30:50.888 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:30:50.960 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1068605 2026-02-12T17:30:50.982 INFO:tasks.rados.rados.0.trial082.stdout:508: finishing rollback tid 0 to trial08226312-49 2026-02-12T17:30:50.982 INFO:tasks.rados.rados.0.trial082.stdout:508: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:30:50.982 INFO:tasks.rados.rados.0.trial082.stdout:508: finishing rollback tid 2 to trial08226312-49 2026-02-12T17:30:50.982 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 124 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:30:50.982 INFO:tasks.rados.rados.0.trial082.stdout:499: done (8 left) 2026-02-12T17:30:50.982 INFO:tasks.rados.rados.0.trial082.stdout:500: done (7 left) 2026-02-12T17:30:50.982 INFO:tasks.rados.rados.0.trial082.stdout:501: done (6 left) 2026-02-12T17:30:50.982 INFO:tasks.rados.rados.0.trial082.stdout:502: done (5 left) 2026-02-12T17:30:50.982 INFO:tasks.rados.rados.0.trial082.stdout:503: done (4 left) 2026-02-12T17:30:50.983 INFO:tasks.rados.rados.0.trial082.stdout:504: done (3 left) 2026-02-12T17:30:50.983 INFO:tasks.rados.rados.0.trial082.stdout:505: done (2 left) 2026-02-12T17:30:50.983 INFO:tasks.rados.rados.0.trial082.stdout:506: done (1 left) 2026-02-12T17:30:50.983 INFO:tasks.rados.rados.0.trial082.stdout:508: done (0 left) 2026-02-12T17:30:50.983 INFO:tasks.rados.rados.0.trial082.stdout:509: read oid 4 snap -1 2026-02-12T17:30:50.983 INFO:tasks.rados.rados.0.trial082.stdout:509: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:30:50.983 INFO:tasks.rados.rados.0.trial082.stdout:510: read oid 34 snap 45 2026-02-12T17:30:50.983 INFO:tasks.rados.rados.0.trial082.stdout:510: expect deleted 2026-02-12T17:30:50.983 INFO:tasks.rados.rados.0.trial082.stdout:511: delete oid 8 current snap is 55 2026-02-12T17:30:50.984 INFO:tasks.rados.rados.0.trial082.stdout:509: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:30:50.990 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1198396 2026-02-12T17:30:51.063 INFO:tasks.rados.rados.0.trial082.stdout:509: done (2 left) 2026-02-12T17:30:51.063 INFO:tasks.rados.rados.0.trial082.stdout:510: done (1 left) 2026-02-12T17:30:51.063 INFO:tasks.rados.rados.0.trial082.stdout:511: done (0 left) 2026-02-12T17:30:51.063 INFO:tasks.rados.rados.0.trial082.stdout:512: write oid 1 current snap is 55 2026-02-12T17:30:51.063 INFO:tasks.rados.rados.0.trial082.stdout:512: seq_num 203 ranges {611821=700725,1879374=783403,3341691=70130} 2026-02-12T17:30:51.068 INFO:tasks.rados.rados.0.trial082.stdout:512: writing trial08226312-1 from 611821 to 1312546 tid 1 2026-02-12T17:30:51.073 INFO:tasks.rados.rados.0.trial082.stdout:512: writing trial08226312-1 from 1879374 to 2662777 tid 2 2026-02-12T17:30:51.076 INFO:tasks.rados.rados.0.trial082.stdout:512: writing trial08226312-1 from 3341691 to 3411821 tid 3 2026-02-12T17:30:51.076 INFO:tasks.rados.rados.0.trial082.stdout:513: write oid 25 current snap is 55 2026-02-12T17:30:51.076 INFO:tasks.rados.rados.0.trial082.stdout:512: finishing write tid 1 to trial08226312-1 2026-02-12T17:30:51.076 INFO:tasks.rados.rados.0.trial082.stdout:512: finishing write tid 2 to trial08226312-1 2026-02-12T17:30:51.076 INFO:tasks.rados.rados.0.trial082.stdout:513: seq_num 204 ranges {628628=775974,1937856=527061,3252761=175867} 2026-02-12T17:30:51.081 INFO:tasks.rados.rados.0.trial082.stdout:513: writing trial08226312-25 from 628628 to 1404602 tid 1 2026-02-12T17:30:51.085 INFO:tasks.rados.rados.0.trial082.stdout:513: writing trial08226312-25 from 1937856 to 2464917 tid 2 2026-02-12T17:30:51.088 INFO:tasks.rados.rados.0.trial082.stdout:513: writing trial08226312-25 from 3252761 to 3428628 tid 3 2026-02-12T17:30:51.089 INFO:tasks.rados.rados.0.trial082.stdout:514: write (excl) oid 28 current snap is 55 2026-02-12T17:30:51.089 INFO:tasks.rados.rados.0.trial082.stdout:512: finishing write tid 3 to trial08226312-1 2026-02-12T17:30:51.089 INFO:tasks.rados.rados.0.trial082.stdout:514: seq_num 205 ranges {645435=451223,1879985=787072,3280184=165251} 2026-02-12T17:30:51.092 INFO:tasks.rados.rados.0.trial082.stdout:514: writing trial08226312-28 from 645435 to 1096658 tid 1 2026-02-12T17:30:51.098 INFO:tasks.rados.rados.0.trial082.stdout:514: writing trial08226312-28 from 1879985 to 2667057 tid 2 2026-02-12T17:30:51.101 INFO:tasks.rados.rados.0.trial082.stdout:514: writing trial08226312-28 from 3280184 to 3445435 tid 3 2026-02-12T17:30:51.101 INFO:tasks.rados.rados.0.trial082.stdout:515: snap_remove snap 54 2026-02-12T17:30:51.640 INFO:tasks.rados.rados.0.trial082.stdout:515: done (3 left) 2026-02-12T17:30:51.640 INFO:tasks.rados.rados.0.trial082.stdout:516: write oid 18 current snap is 55 2026-02-12T17:30:51.640 INFO:tasks.rados.rados.0.trial082.stdout:516: seq_num 206 ranges {662242=642825,2054820=530730,3307607=154635} 2026-02-12T17:30:51.645 INFO:tasks.rados.rados.0.trial082.stdout:516: writing trial08226312-18 from 662242 to 1305067 tid 1 2026-02-12T17:30:51.650 INFO:tasks.rados.rados.0.trial082.stdout:516: writing trial08226312-18 from 2054820 to 2585550 tid 2 2026-02-12T17:30:51.653 INFO:tasks.rados.rados.0.trial082.stdout:516: writing trial08226312-18 from 3307607 to 3462242 tid 3 2026-02-12T17:30:51.654 INFO:tasks.rados.rados.0.trial082.stdout:517: snap_remove snap 49 2026-02-12T17:30:51.654 INFO:tasks.rados.rados.0.trial082.stdout:512: finishing write tid 4 to trial08226312-1 2026-02-12T17:30:51.654 INFO:tasks.rados.rados.0.trial082.stdout:512: finishing write tid 5 to trial08226312-1 2026-02-12T17:30:51.654 INFO:tasks.rados.rados.0.trial082.stdout:512: oid 1 updating version 0 to 26 2026-02-12T17:30:51.654 INFO:tasks.rados.rados.0.trial082.stdout:512: oid 1 version 26 is already newer than 23 2026-02-12T17:30:51.654 INFO:tasks.rados.rados.0.trial082.stdout:512: oid 1 version 26 is already newer than 25 2026-02-12T17:30:51.654 INFO:tasks.rados.rados.0.trial082.stdout:512: oid 1 version 26 is already newer than 24 2026-02-12T17:30:51.654 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 26 (ObjNum 203 snap 55 seq_num 203) dirty exists 2026-02-12T17:30:51.655 INFO:tasks.rados.rados.0.trial082.stdout:512: left oid 1 (ObjNum 203 snap 55 seq_num 203) 2026-02-12T17:30:51.655 INFO:tasks.rados.rados.0.trial082.stdout:513: finishing write tid 1 to trial08226312-25 2026-02-12T17:30:52.626 INFO:tasks.rados.rados.0.trial082.stdout:512: done (4 left) 2026-02-12T17:30:52.626 INFO:tasks.rados.rados.0.trial082.stdout:517: done (3 left) 2026-02-12T17:30:52.626 INFO:tasks.rados.rados.0.trial082.stdout:518: snap_remove snap 45 2026-02-12T17:30:53.628 INFO:tasks.rados.rados.0.trial082.stdout:513: finishing write tid 2 to trial08226312-25 2026-02-12T17:30:53.628 INFO:tasks.rados.rados.0.trial082.stdout:518: done (3 left) 2026-02-12T17:30:53.628 INFO:tasks.rados.rados.0.trial082.stdout:519: copy_from oid 20 from oid 33 current snap is 55 2026-02-12T17:30:53.628 INFO:tasks.rados.rados.0.trial082.stdout:513: finishing write tid 3 to trial08226312-25 2026-02-12T17:30:53.628 INFO:tasks.rados.rados.0.trial082.stdout:513: finishing write tid 4 to trial08226312-25 2026-02-12T17:30:53.628 INFO:tasks.rados.rados.0.trial082.stdout:513: finishing write tid 5 to trial08226312-25 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:513: oid 25 updating version 0 to 124 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:513: oid 25 version 124 is already newer than 122 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:513: oid 25 version 124 is already newer than 123 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:513: oid 25 version 124 is already newer than 121 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 124 (ObjNum 204 snap 55 seq_num 204) dirty exists 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:513: left oid 25 (ObjNum 204 snap 55 seq_num 204) 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:514: finishing write tid 1 to trial08226312-28 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:514: finishing write tid 2 to trial08226312-28 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:514: finishing write tid 3 to trial08226312-28 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:514: finishing write tid 4 to trial08226312-28 2026-02-12T17:30:53.629 INFO:tasks.rados.rados.0.trial082.stdout:514: finishing write tid 5 to trial08226312-28 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:514: oid 28 updating version 0 to 309 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:514: oid 28 version 309 is already newer than 307 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:514: oid 28 version 309 is already newer than 308 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:514: oid 28 updating version 309 to 310 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 310 (ObjNum 205 snap 55 seq_num 205) dirty exists 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:514: left oid 28 (ObjNum 205 snap 55 seq_num 205) 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:516: finishing write tid 1 to trial08226312-18 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:516: finishing write tid 2 to trial08226312-18 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:516: finishing write tid 3 to trial08226312-18 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:516: finishing write tid 4 to trial08226312-18 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:516: finishing write tid 5 to trial08226312-18 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:516: oid 18 updating version 0 to 130 2026-02-12T17:30:53.630 INFO:tasks.rados.rados.0.trial082.stdout:516: oid 18 updating version 130 to 132 2026-02-12T17:30:53.631 INFO:tasks.rados.rados.0.trial082.stdout:516: oid 18 updating version 132 to 133 2026-02-12T17:30:53.631 INFO:tasks.rados.rados.0.trial082.stdout:516: oid 18 version 133 is already newer than 131 2026-02-12T17:30:53.631 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 133 (ObjNum 206 snap 55 seq_num 206) dirty exists 2026-02-12T17:30:53.631 INFO:tasks.rados.rados.0.trial082.stdout:516: left oid 18 (ObjNum 206 snap 55 seq_num 206) 2026-02-12T17:30:53.631 INFO:tasks.rados.rados.0.trial082.stdout:513: done (3 left) 2026-02-12T17:30:53.631 INFO:tasks.rados.rados.0.trial082.stdout:514: done (2 left) 2026-02-12T17:30:53.631 INFO:tasks.rados.rados.0.trial082.stdout:516: done (1 left) 2026-02-12T17:30:53.631 INFO:tasks.rados.rados.0.trial082.stdout:520: snap_create 2026-02-12T17:30:53.634 INFO:tasks.rados.rados.0.trial082.stdout:519: finishing copy_from racing read to trial08226312-20 2026-02-12T17:30:53.634 INFO:tasks.rados.rados.0.trial082.stdout:519: finishing copy_from to trial08226312-20 2026-02-12T17:30:53.634 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 81 (ObjNum 123 snap 28 seq_num 123) dirty exists 2026-02-12T17:30:54.628 INFO:tasks.rados.rados.0.trial082.stdout:519: done (1 left) 2026-02-12T17:30:54.628 INFO:tasks.rados.rados.0.trial082.stdout:520: done (0 left) 2026-02-12T17:30:54.628 INFO:tasks.rados.rados.0.trial082.stdout:521: delete oid 8 current snap is 56 2026-02-12T17:30:54.629 INFO:tasks.rados.rados.0.trial082.stdout:521: done (0 left) 2026-02-12T17:30:54.629 INFO:tasks.rados.rados.0.trial082.stdout:522: snap_remove snap 55 2026-02-12T17:30:55.630 INFO:tasks.rados.rados.0.trial082.stdout:522: done (0 left) 2026-02-12T17:30:55.630 INFO:tasks.rados.rados.0.trial082.stdout:523: read oid 39 snap 46 2026-02-12T17:30:55.630 INFO:tasks.rados.rados.0.trial082.stdout:523: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:30:55.630 INFO:tasks.rados.rados.0.trial082.stdout:524: write oid 46 current snap is 56 2026-02-12T17:30:55.630 INFO:tasks.rados.rados.0.trial082.stdout:524: seq_num 208 ranges {695856=793323,2171784=534399,3362453=133403} 2026-02-12T17:30:55.636 INFO:tasks.rados.rados.0.trial082.stdout:524: writing trial08226312-46 from 695856 to 1489179 tid 1 2026-02-12T17:30:55.640 INFO:tasks.rados.rados.0.trial082.stdout:524: writing trial08226312-46 from 2171784 to 2706183 tid 2 2026-02-12T17:30:55.643 INFO:tasks.rados.rados.0.trial082.stdout:524: writing trial08226312-46 from 3362453 to 3495856 tid 3 2026-02-12T17:30:55.643 INFO:tasks.rados.rados.0.trial082.stdout:525: write (excl) oid 7 current snap is 56 2026-02-12T17:30:55.644 INFO:tasks.rados.rados.0.trial082.stdout:525: seq_num 209 ranges {712663=468572,1713913=678057,2873523=591733} 2026-02-12T17:30:55.647 INFO:tasks.rados.rados.0.trial082.stdout:525: writing trial08226312-7 from 712663 to 1181235 tid 1 2026-02-12T17:30:55.652 INFO:tasks.rados.rados.0.trial082.stdout:525: writing trial08226312-7 from 1713913 to 2391970 tid 2 2026-02-12T17:30:55.656 INFO:tasks.rados.rados.0.trial082.stdout:525: writing trial08226312-7 from 2873523 to 3465256 tid 3 2026-02-12T17:30:55.656 INFO:tasks.rados.rados.0.trial082.stdout:526: snap_create 2026-02-12T17:30:55.656 INFO:tasks.rados.rados.0.trial082.stdout:523: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:30:55.721 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1270246 2026-02-12T17:30:55.741 INFO:tasks.rados.rados.0.trial082.stdout:524: finishing write tid 1 to trial08226312-46 2026-02-12T17:30:55.741 INFO:tasks.rados.rados.0.trial082.stdout:524: finishing write tid 2 to trial08226312-46 2026-02-12T17:30:55.741 INFO:tasks.rados.rados.0.trial082.stdout:524: finishing write tid 3 to trial08226312-46 2026-02-12T17:30:55.741 INFO:tasks.rados.rados.0.trial082.stdout:524: finishing write tid 4 to trial08226312-46 2026-02-12T17:30:55.741 INFO:tasks.rados.rados.0.trial082.stdout:524: finishing write tid 5 to trial08226312-46 2026-02-12T17:30:55.741 INFO:tasks.rados.rados.0.trial082.stdout:524: oid 46 updating version 0 to 143 2026-02-12T17:30:55.741 INFO:tasks.rados.rados.0.trial082.stdout:524: oid 46 updating version 143 to 145 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:524: oid 46 version 145 is already newer than 144 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:524: oid 46 updating version 145 to 146 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 146 (ObjNum 208 snap 56 seq_num 208) dirty exists 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:524: left oid 46 (ObjNum 208 snap 56 seq_num 208) 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:525: finishing write tid 1 to trial08226312-7 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:525: finishing write tid 2 to trial08226312-7 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:525: finishing write tid 3 to trial08226312-7 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:525: finishing write tid 4 to trial08226312-7 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:525: finishing write tid 5 to trial08226312-7 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:525: oid 7 updating version 0 to 321 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:525: oid 7 version 321 is already newer than 320 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:525: oid 7 version 321 is already newer than 319 2026-02-12T17:30:55.742 INFO:tasks.rados.rados.0.trial082.stdout:525: oid 7 updating version 321 to 322 2026-02-12T17:30:55.743 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 322 (ObjNum 209 snap 56 seq_num 209) dirty exists 2026-02-12T17:30:55.743 INFO:tasks.rados.rados.0.trial082.stdout:525: left oid 7 (ObjNum 209 snap 56 seq_num 209) 2026-02-12T17:30:56.633 INFO:tasks.rados.rados.0.trial082.stdout:523: done (3 left) 2026-02-12T17:30:56.633 INFO:tasks.rados.rados.0.trial082.stdout:524: done (2 left) 2026-02-12T17:30:56.633 INFO:tasks.rados.rados.0.trial082.stdout:525: done (1 left) 2026-02-12T17:30:56.633 INFO:tasks.rados.rados.0.trial082.stdout:526: done (0 left) 2026-02-12T17:30:56.633 INFO:tasks.rados.rados.0.trial082.stdout:527: snap_remove snap 53 2026-02-12T17:30:57.626 INFO:tasks.rados.rados.0.trial082.stdout:527: done (0 left) 2026-02-12T17:30:57.626 INFO:tasks.rados.rados.0.trial082.stdout:528: rollback oid 33 current snap is 57 2026-02-12T17:30:57.626 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 56 2026-02-12T17:30:57.626 INFO:tasks.rados.rados.0.trial082.stdout:529: snap_create 2026-02-12T17:30:57.630 INFO:tasks.rados.rados.0.trial082.stdout:528: finishing rollback tid 0 to trial08226312-33 2026-02-12T17:30:57.630 INFO:tasks.rados.rados.0.trial082.stdout:528: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:30:57.631 INFO:tasks.rados.rados.0.trial082.stdout:528: finishing rollback tid 2 to trial08226312-33 2026-02-12T17:30:57.631 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 209 (ObjNum 123 snap 28 seq_num 123) dirty exists 2026-02-12T17:30:58.627 INFO:tasks.rados.rados.0.trial082.stdout:528: done (1 left) 2026-02-12T17:30:58.628 INFO:tasks.rados.rados.0.trial082.stdout:529: done (0 left) 2026-02-12T17:30:58.628 INFO:tasks.rados.rados.0.trial082.stdout:530: write oid 20 current snap is 58 2026-02-12T17:30:58.628 INFO:tasks.rados.rados.0.trial082.stdout:530: seq_num 210 ranges {729470=543821,1772395=538068,2900946=403005} 2026-02-12T17:30:58.632 INFO:tasks.rados.rados.0.trial082.stdout:530: writing trial08226312-20 from 729470 to 1273291 tid 1 2026-02-12T17:30:58.636 INFO:tasks.rados.rados.0.trial082.stdout:530: writing trial08226312-20 from 1772395 to 2310463 tid 2 2026-02-12T17:30:58.640 INFO:tasks.rados.rados.0.trial082.stdout:530: writing trial08226312-20 from 2900946 to 3303951 tid 3 2026-02-12T17:30:58.640 INFO:tasks.rados.rados.0.trial082.stdout:531: snap_remove snap 57 2026-02-12T17:30:59.635 INFO:tasks.rados.rados.0.trial082.stdout:531: done (1 left) 2026-02-12T17:30:59.635 INFO:tasks.rados.rados.0.trial082.stdout:532: read oid 32 snap 56 2026-02-12T17:30:59.635 INFO:tasks.rados.rados.0.trial082.stdout:532: expect (ObjNum 173 snap 43 seq_num 173) 2026-02-12T17:30:59.635 INFO:tasks.rados.rados.0.trial082.stdout:533: write (excl) oid 8 current snap is 58 2026-02-12T17:30:59.635 INFO:tasks.rados.rados.0.trial082.stdout:533: seq_num 211 ranges {746277=619070,1830877=681726,2928369=617908} 2026-02-12T17:30:59.640 INFO:tasks.rados.rados.0.trial082.stdout:533: writing trial08226312-8 from 746277 to 1365347 tid 1 2026-02-12T17:30:59.645 INFO:tasks.rados.rados.0.trial082.stdout:533: writing trial08226312-8 from 1830877 to 2512603 tid 2 2026-02-12T17:30:59.649 INFO:tasks.rados.rados.0.trial082.stdout:533: writing trial08226312-8 from 2928369 to 3546277 tid 3 2026-02-12T17:30:59.649 INFO:tasks.rados.rados.0.trial082.stdout:534: snap_remove snap 46 2026-02-12T17:31:00.637 INFO:tasks.rados.rados.0.trial082.stdout:534: done (3 left) 2026-02-12T17:31:00.638 INFO:tasks.rados.rados.0.trial082.stdout:535: read oid 6 snap -1 2026-02-12T17:31:00.638 INFO:tasks.rados.rados.0.trial082.stdout:535: expect (ObjNum 194 snap 51 seq_num 194) 2026-02-12T17:31:00.638 INFO:tasks.rados.rados.0.trial082.stdout:536: read oid 19 snap -1 2026-02-12T17:31:00.638 INFO:tasks.rados.rados.0.trial082.stdout:536: expect (ObjNum 148 snap 36 seq_num 148) 2026-02-12T17:31:00.638 INFO:tasks.rados.rados.0.trial082.stdout:537: read oid 41 snap 56 2026-02-12T17:31:00.638 INFO:tasks.rados.rados.0.trial082.stdout:537: expect deleted 2026-02-12T17:31:00.638 INFO:tasks.rados.rados.0.trial082.stdout:538: write (excl) oid 1 current snap is 58 2026-02-12T17:31:00.638 INFO:tasks.rados.rados.0.trial082.stdout:538: seq_num 212 ranges {763084=694319,1889359=541737,2955792=541902} 2026-02-12T17:31:00.643 INFO:tasks.rados.rados.0.trial082.stdout:538: writing trial08226312-1 from 763084 to 1457403 tid 1 2026-02-12T17:31:00.647 INFO:tasks.rados.rados.0.trial082.stdout:538: writing trial08226312-1 from 1889359 to 2431096 tid 2 2026-02-12T17:31:00.651 INFO:tasks.rados.rados.0.trial082.stdout:538: writing trial08226312-1 from 2955792 to 3497694 tid 3 2026-02-12T17:31:00.651 INFO:tasks.rados.rados.0.trial082.stdout:539: copy_from oid 30 from oid 36 current snap is 58 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:530: finishing write tid 1 to trial08226312-20 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:530: finishing write tid 2 to trial08226312-20 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:530: finishing write tid 3 to trial08226312-20 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:530: finishing write tid 4 to trial08226312-20 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:540: rollback oid 18 current snap is 58 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 56 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:530: finishing write tid 5 to trial08226312-20 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:530: oid 20 updating version 0 to 311 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:530: oid 20 version 311 is already newer than 310 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:530: oid 20 version 311 is already newer than 309 2026-02-12T17:31:00.652 INFO:tasks.rados.rados.0.trial082.stdout:530: oid 20 updating version 311 to 312 2026-02-12T17:31:00.653 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 312 (ObjNum 210 snap 58 seq_num 210) dirty exists 2026-02-12T17:31:00.653 INFO:tasks.rados.rados.0.trial082.stdout:530: left oid 20 (ObjNum 210 snap 58 seq_num 210) 2026-02-12T17:31:00.653 INFO:tasks.rados.rados.0.trial082.stdout:532: expect (ObjNum 173 snap 43 seq_num 173) 2026-02-12T17:31:00.671 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1973667 2026-02-12T17:31:00.738 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:00.784 INFO:tasks.rados.rados.0.trial082.stdout:533: finishing write tid 1 to trial08226312-8 2026-02-12T17:31:00.784 INFO:tasks.rados.rados.0.trial082.stdout:530: done (8 left) 2026-02-12T17:31:00.784 INFO:tasks.rados.rados.0.trial082.stdout:532: done (7 left) 2026-02-12T17:31:00.784 INFO:tasks.rados.rados.0.trial082.stdout:541: write (excl) oid 24 current snap is 58 2026-02-12T17:31:00.784 INFO:tasks.rados.rados.0.trial082.stdout:533: finishing write tid 2 to trial08226312-8 2026-02-12T17:31:00.785 INFO:tasks.rados.rados.0.trial082.stdout:533: finishing write tid 3 to trial08226312-8 2026-02-12T17:31:00.785 INFO:tasks.rados.rados.0.trial082.stdout:541: seq_num 213 ranges {779891=485921,1947841=685395,3383215=196676} 2026-02-12T17:31:00.788 INFO:tasks.rados.rados.0.trial082.stdout:541: writing trial08226312-24 from 779891 to 1265812 tid 1 2026-02-12T17:31:00.793 INFO:tasks.rados.rados.0.trial082.stdout:541: writing trial08226312-24 from 1947841 to 2633236 tid 2 2026-02-12T17:31:00.798 INFO:tasks.rados.rados.0.trial082.stdout:541: writing trial08226312-24 from 3383215 to 3579891 tid 3 2026-02-12T17:31:00.798 INFO:tasks.rados.rados.0.trial082.stdout:542: read oid 47 snap 56 2026-02-12T17:31:00.798 INFO:tasks.rados.rados.0.trial082.stdout:542: expect deleted 2026-02-12T17:31:00.798 INFO:tasks.rados.rados.0.trial082.stdout:543: delete oid 35 current snap is 58 2026-02-12T17:31:00.798 INFO:tasks.rados.rados.0.trial082.stdout:533: finishing write tid 4 to trial08226312-8 2026-02-12T17:31:00.798 INFO:tasks.rados.rados.0.trial082.stdout:533: finishing write tid 5 to trial08226312-8 2026-02-12T17:31:00.798 INFO:tasks.rados.rados.0.trial082.stdout:533: oid 8 updating version 0 to 318 2026-02-12T17:31:00.799 INFO:tasks.rados.rados.0.trial082.stdout:533: oid 8 version 318 is already newer than 315 2026-02-12T17:31:00.799 INFO:tasks.rados.rados.0.trial082.stdout:533: oid 8 version 318 is already newer than 317 2026-02-12T17:31:00.799 INFO:tasks.rados.rados.0.trial082.stdout:533: oid 8 version 318 is already newer than 316 2026-02-12T17:31:00.799 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 318 (ObjNum 211 snap 58 seq_num 211) dirty exists 2026-02-12T17:31:00.799 INFO:tasks.rados.rados.0.trial082.stdout:533: left oid 8 (ObjNum 211 snap 58 seq_num 211) 2026-02-12T17:31:00.799 INFO:tasks.rados.rados.0.trial082.stdout:536: expect (ObjNum 148 snap 36 seq_num 148) 2026-02-12T17:31:00.842 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1721844 2026-02-12T17:31:00.858 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 767298 2026-02-12T17:31:00.882 INFO:tasks.rados.rados.0.trial082.stdout:535: expect (ObjNum 194 snap 51 seq_num 194) 2026-02-12T17:31:00.905 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3196080 2026-02-12T17:31:00.937 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 888369 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: finishing write tid 1 to trial08226312-1 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: finishing write tid 2 to trial08226312-1 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: finishing write tid 3 to trial08226312-1 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:533: done (9 left) 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:535: done (8 left) 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:536: done (7 left) 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:537: done (6 left) 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:543: done (5 left) 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:544: delete oid 7 current snap is 58 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: finishing write tid 4 to trial08226312-1 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: finishing write tid 5 to trial08226312-1 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: oid 1 updating version 0 to 30 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: oid 1 version 30 is already newer than 28 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: oid 1 version 30 is already newer than 29 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: oid 1 updating version 30 to 31 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 31 (ObjNum 212 snap 58 seq_num 212) dirty exists 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:538: left oid 1 (ObjNum 212 snap 58 seq_num 212) 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:540: finishing rollback tid 0 to trial08226312-18 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:540: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:31:00.965 INFO:tasks.rados.rados.0.trial082.stdout:540: finishing rollback tid 2 to trial08226312-18 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 153 (ObjNum 206 snap 55 seq_num 206) dirty exists 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:539: finishing copy_from racing read to trial08226312-30 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:539: finishing copy_from to trial08226312-30 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 263 (ObjNum 177 snap 43 seq_num 177) dirty exists 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: finishing write tid 1 to trial08226312-24 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: finishing write tid 2 to trial08226312-24 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: finishing write tid 3 to trial08226312-24 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: finishing write tid 4 to trial08226312-24 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: finishing write tid 5 to trial08226312-24 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: oid 24 updating version 0 to 330 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: oid 24 updating version 330 to 331 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: oid 24 version 331 is already newer than 328 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: oid 24 version 331 is already newer than 329 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 331 (ObjNum 213 snap 58 seq_num 213) dirty exists 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:541: left oid 24 (ObjNum 213 snap 58 seq_num 213) 2026-02-12T17:31:00.966 INFO:tasks.rados.rados.0.trial082.stdout:538: done (5 left) 2026-02-12T17:31:00.967 INFO:tasks.rados.rados.0.trial082.stdout:539: done (4 left) 2026-02-12T17:31:00.967 INFO:tasks.rados.rados.0.trial082.stdout:540: done (3 left) 2026-02-12T17:31:00.967 INFO:tasks.rados.rados.0.trial082.stdout:541: done (2 left) 2026-02-12T17:31:00.967 INFO:tasks.rados.rados.0.trial082.stdout:542: done (1 left) 2026-02-12T17:31:00.967 INFO:tasks.rados.rados.0.trial082.stdout:544: done (0 left) 2026-02-12T17:31:00.967 INFO:tasks.rados.rados.0.trial082.stdout:545: write oid 27 current snap is 58 2026-02-12T17:31:00.967 INFO:tasks.rados.rados.0.trial082.stdout:545: seq_num 216 ranges {430312=711668,1723287=549075,2781837=703343} 2026-02-12T17:31:00.970 INFO:tasks.rados.rados.0.trial082.stdout:545: writing trial08226312-27 from 430312 to 1141980 tid 1 2026-02-12T17:31:00.974 INFO:tasks.rados.rados.0.trial082.stdout:545: writing trial08226312-27 from 1723287 to 2272362 tid 2 2026-02-12T17:31:00.979 INFO:tasks.rados.rados.0.trial082.stdout:545: writing trial08226312-27 from 2781837 to 3485180 tid 3 2026-02-12T17:31:00.979 INFO:tasks.rados.rados.0.trial082.stdout:546: copy_from oid 31 from oid 41 current snap is 58 2026-02-12T17:31:00.979 INFO:tasks.rados.rados.0.trial082.stdout:545: finishing write tid 1 to trial08226312-27 2026-02-12T17:31:00.979 INFO:tasks.rados.rados.0.trial082.stdout:545: finishing write tid 2 to trial08226312-27 2026-02-12T17:31:00.979 INFO:tasks.rados.rados.0.trial082.stdout:547: snap_create 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:546: finishing copy_from to trial08226312-31 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:546: got expected ENOENT (src dne) 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:546: finishing copy_from racing read to trial08226312-31 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:545: finishing write tid 3 to trial08226312-27 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:545: finishing write tid 4 to trial08226312-27 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:545: finishing write tid 5 to trial08226312-27 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:545: oid 27 updating version 0 to 116 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:545: oid 27 version 116 is already newer than 115 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:545: oid 27 updating version 116 to 118 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:545: oid 27 version 118 is already newer than 117 2026-02-12T17:31:00.981 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 118 (ObjNum 216 snap 58 seq_num 216) dirty exists 2026-02-12T17:31:00.982 INFO:tasks.rados.rados.0.trial082.stdout:545: left oid 27 (ObjNum 216 snap 58 seq_num 216) 2026-02-12T17:31:01.650 INFO:tasks.rados.rados.0.trial082.stdout:545: done (2 left) 2026-02-12T17:31:01.650 INFO:tasks.rados.rados.0.trial082.stdout:546: done (1 left) 2026-02-12T17:31:01.650 INFO:tasks.rados.rados.0.trial082.stdout:547: done (0 left) 2026-02-12T17:31:01.650 INFO:tasks.rados.rados.0.trial082.stdout:548: snap_remove snap 58 2026-02-12T17:31:02.628 INFO:tasks.rados.rados.0.trial082.stdout:548: done (0 left) 2026-02-12T17:31:02.628 INFO:tasks.rados.rados.0.trial082.stdout:549: read oid 15 snap -1 2026-02-12T17:31:02.628 INFO:tasks.rados.rados.0.trial082.stdout:549: expect (ObjNum 160 snap 40 seq_num 160) 2026-02-12T17:31:02.629 INFO:tasks.rados.rados.0.trial082.stdout:550: copy_from oid 24 from oid 10 current snap is 59 2026-02-12T17:31:02.629 INFO:tasks.rados.rados.0.trial082.stdout:551: rollback oid 27 current snap is 59 2026-02-12T17:31:02.629 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 56 2026-02-12T17:31:02.629 INFO:tasks.rados.rados.0.trial082.stdout:552: read oid 18 snap -1 2026-02-12T17:31:02.629 INFO:tasks.rados.rados.0.trial082.stdout:552: expect (ObjNum 206 snap 55 seq_num 206) 2026-02-12T17:31:02.629 INFO:tasks.rados.rados.0.trial082.stdout:553: delete oid 29 current snap is 59 2026-02-12T17:31:02.631 INFO:tasks.rados.rados.0.trial082.stdout:553: done (4 left) 2026-02-12T17:31:02.631 INFO:tasks.rados.rados.0.trial082.stdout:554: read oid 12 snap -1 2026-02-12T17:31:02.631 INFO:tasks.rados.rados.0.trial082.stdout:554: expect deleted 2026-02-12T17:31:02.631 INFO:tasks.rados.rados.0.trial082.stdout:555: write (excl) oid 48 current snap is 59 2026-02-12T17:31:02.632 INFO:tasks.rados.rados.0.trial082.stdout:555: seq_num 218 ranges {463926=462166,1723898=436391,2603977=725887} 2026-02-12T17:31:02.635 INFO:tasks.rados.rados.0.trial082.stdout:555: writing trial08226312-48 from 463926 to 926092 tid 1 2026-02-12T17:31:02.639 INFO:tasks.rados.rados.0.trial082.stdout:555: writing trial08226312-48 from 1723898 to 2160289 tid 2 2026-02-12T17:31:02.644 INFO:tasks.rados.rados.0.trial082.stdout:555: writing trial08226312-48 from 2603977 to 3329864 tid 3 2026-02-12T17:31:02.644 INFO:tasks.rados.rados.0.trial082.stdout:556: write (excl) oid 23 current snap is 59 2026-02-12T17:31:02.644 INFO:tasks.rados.rados.0.trial082.stdout:556: seq_num 219 ranges {480733=537415,1782380=696402,3031400=537159} 2026-02-12T17:31:02.647 INFO:tasks.rados.rados.0.trial082.stdout:556: writing trial08226312-23 from 480733 to 1018148 tid 1 2026-02-12T17:31:02.653 INFO:tasks.rados.rados.0.trial082.stdout:556: writing trial08226312-23 from 1782380 to 2478782 tid 2 2026-02-12T17:31:02.657 INFO:tasks.rados.rados.0.trial082.stdout:556: writing trial08226312-23 from 3031400 to 3568559 tid 3 2026-02-12T17:31:02.657 INFO:tasks.rados.rados.0.trial082.stdout:557: read oid 45 snap -1 2026-02-12T17:31:02.658 INFO:tasks.rados.rados.0.trial082.stdout:557: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-12T17:31:02.658 INFO:tasks.rados.rados.0.trial082.stdout:558: rollback oid 43 current snap is 59 2026-02-12T17:31:02.658 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 43 to 56 2026-02-12T17:31:02.658 INFO:tasks.rados.rados.0.trial082.stdout:550: finishing copy_from to trial08226312-24 2026-02-12T17:31:02.658 INFO:tasks.rados.rados.0.trial082.stdout:550: got expected ENOENT (src dne) 2026-02-12T17:31:02.658 INFO:tasks.rados.rados.0.trial082.stdout:550: finishing copy_from racing read to trial08226312-24 2026-02-12T17:31:02.658 INFO:tasks.rados.rados.0.trial082.stdout:550: done (8 left) 2026-02-12T17:31:02.658 INFO:tasks.rados.rados.0.trial082.stdout:559: write (excl) oid 40 current snap is 59 2026-02-12T17:31:02.658 INFO:tasks.rados.rados.0.trial082.stdout:559: seq_num 220 ranges {497540=612664,1840862=440060,3058823=464784} 2026-02-12T17:31:02.661 INFO:tasks.rados.rados.0.trial082.stdout:559: writing trial08226312-40 from 497540 to 1110204 tid 1 2026-02-12T17:31:02.665 INFO:tasks.rados.rados.0.trial082.stdout:559: writing trial08226312-40 from 1840862 to 2280922 tid 2 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:559: writing trial08226312-40 from 3058823 to 3523607 tid 3 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:560: rollback oid 16 current snap is 59 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 56 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:554: done (9 left) 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:561: snap_create 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:551: finishing rollback tid 0 to trial08226312-27 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:551: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:551: finishing rollback tid 2 to trial08226312-27 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 121 (ObjNum 169 snap 42 seq_num 169) dirty exists 2026-02-12T17:31:02.671 INFO:tasks.rados.rados.0.trial082.stdout:549: expect (ObjNum 160 snap 40 seq_num 160) 2026-02-12T17:31:02.677 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 935918 2026-02-12T17:31:02.746 INFO:tasks.rados.rados.0.trial082.stdout:552: expect (ObjNum 206 snap 55 seq_num 206) 2026-02-12T17:31:02.746 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:02.791 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:02.862 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3244858 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: finishing write tid 1 to trial08226312-48 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: finishing write tid 2 to trial08226312-48 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: finishing write tid 3 to trial08226312-48 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: finishing write tid 4 to trial08226312-48 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: finishing write tid 5 to trial08226312-48 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: oid 48 updating version 0 to 23 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: oid 48 version 23 is already newer than 20 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: oid 48 version 23 is already newer than 21 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: oid 48 version 23 is already newer than 22 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 23 (ObjNum 218 snap 59 seq_num 218) dirty exists 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:555: left oid 48 (ObjNum 218 snap 59 seq_num 218) 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:556: finishing write tid 1 to trial08226312-23 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:556: finishing write tid 2 to trial08226312-23 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:558: finishing rollback tid 0 to trial08226312-43 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:558: finishing rollback tid 1 to trial08226312-43 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:558: finishing rollback tid 2 to trial08226312-43 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 266 (ObjNum 157 snap 40 seq_num 157) dirty exists 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:556: finishing write tid 3 to trial08226312-23 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:556: finishing write tid 4 to trial08226312-23 2026-02-12T17:31:02.874 INFO:tasks.rados.rados.0.trial082.stdout:556: finishing write tid 5 to trial08226312-23 2026-02-12T17:31:02.875 INFO:tasks.rados.rados.0.trial082.stdout:556: oid 23 updating version 0 to 268 2026-02-12T17:31:02.875 INFO:tasks.rados.rados.0.trial082.stdout:556: oid 23 updating version 268 to 269 2026-02-12T17:31:02.875 INFO:tasks.rados.rados.0.trial082.stdout:556: oid 23 version 269 is already newer than 267 2026-02-12T17:31:02.875 INFO:tasks.rados.rados.0.trial082.stdout:556: oid 23 updating version 269 to 270 2026-02-12T17:31:02.875 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 270 (ObjNum 219 snap 59 seq_num 219) dirty exists 2026-02-12T17:31:02.875 INFO:tasks.rados.rados.0.trial082.stdout:556: left oid 23 (ObjNum 219 snap 59 seq_num 219) 2026-02-12T17:31:02.875 INFO:tasks.rados.rados.0.trial082.stdout:557: expect (ObjNum 44 snap 0 seq_num 44) 2026-02-12T17:31:02.875 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:02.899 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2563037 2026-02-12T17:31:02.923 INFO:tasks.rados.rados.0.trial082.stdout:559: finishing write tid 1 to trial08226312-40 2026-02-12T17:31:02.923 INFO:tasks.rados.rados.0.trial082.stdout:559: finishing write tid 2 to trial08226312-40 2026-02-12T17:31:02.923 INFO:tasks.rados.rados.0.trial082.stdout:560: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 0 (ObjNum 129 snap 0 seq_num 28903504) dirty dne 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:559: finishing write tid 3 to trial08226312-40 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:559: finishing write tid 4 to trial08226312-40 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:559: finishing write tid 5 to trial08226312-40 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:559: oid 40 updating version 0 to 334 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:559: oid 40 updating version 334 to 335 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:559: oid 40 updating version 335 to 336 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:559: oid 40 updating version 336 to 337 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 337 (ObjNum 220 snap 59 seq_num 220) dirty exists 2026-02-12T17:31:02.924 INFO:tasks.rados.rados.0.trial082.stdout:559: left oid 40 (ObjNum 220 snap 59 seq_num 220) 2026-02-12T17:31:03.654 INFO:tasks.rados.rados.0.trial082.stdout:549: done (9 left) 2026-02-12T17:31:03.655 INFO:tasks.rados.rados.0.trial082.stdout:551: done (8 left) 2026-02-12T17:31:03.655 INFO:tasks.rados.rados.0.trial082.stdout:552: done (7 left) 2026-02-12T17:31:03.655 INFO:tasks.rados.rados.0.trial082.stdout:555: done (6 left) 2026-02-12T17:31:03.655 INFO:tasks.rados.rados.0.trial082.stdout:556: done (5 left) 2026-02-12T17:31:03.655 INFO:tasks.rados.rados.0.trial082.stdout:557: done (4 left) 2026-02-12T17:31:03.655 INFO:tasks.rados.rados.0.trial082.stdout:558: done (3 left) 2026-02-12T17:31:03.655 INFO:tasks.rados.rados.0.trial082.stdout:559: done (2 left) 2026-02-12T17:31:03.655 INFO:tasks.rados.rados.0.trial082.stdout:560: done (1 left) 2026-02-12T17:31:03.655 INFO:tasks.rados.rados.0.trial082.stdout:561: done (0 left) 2026-02-12T17:31:03.656 INFO:tasks.rados.rados.0.trial082.stdout:562: snap_create 2026-02-12T17:31:04.656 INFO:tasks.rados.rados.0.trial082.stdout:562: done (0 left) 2026-02-12T17:31:04.656 INFO:tasks.rados.rados.0.trial082.stdout:563: copy_from oid 45 from oid 44 current snap is 61 2026-02-12T17:31:04.656 INFO:tasks.rados.rados.0.trial082.stdout:564: rollback oid 28 current snap is 61 2026-02-12T17:31:04.656 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 59 2026-02-12T17:31:04.656 INFO:tasks.rados.rados.0.trial082.stdout:565: write oid 31 current snap is 61 2026-02-12T17:31:04.656 INFO:tasks.rados.rados.0.trial082.stdout:565: seq_num 221 ranges {514347=404266,1499344=700071,2686246=676056} 2026-02-12T17:31:04.659 INFO:tasks.rados.rados.0.trial082.stdout:565: writing trial08226312-31 from 514347 to 918613 tid 1 2026-02-12T17:31:04.663 INFO:tasks.rados.rados.0.trial082.stdout:565: writing trial08226312-31 from 1499344 to 2199415 tid 2 2026-02-12T17:31:04.668 INFO:tasks.rados.rados.0.trial082.stdout:565: writing trial08226312-31 from 2686246 to 3362302 tid 3 2026-02-12T17:31:04.669 INFO:tasks.rados.rados.0.trial082.stdout:566: write (excl) oid 23 current snap is 61 2026-02-12T17:31:04.669 INFO:tasks.rados.rados.0.trial082.stdout:566: seq_num 222 ranges {531154=479515,1557826=443729,2713669=487328,3679295=51859} 2026-02-12T17:31:04.672 INFO:tasks.rados.rados.0.trial082.stdout:566: writing trial08226312-23 from 531154 to 1010669 tid 1 2026-02-12T17:31:04.676 INFO:tasks.rados.rados.0.trial082.stdout:566: writing trial08226312-23 from 1557826 to 2001555 tid 2 2026-02-12T17:31:04.680 INFO:tasks.rados.rados.0.trial082.stdout:566: writing trial08226312-23 from 2713669 to 3200997 tid 3 2026-02-12T17:31:04.683 INFO:tasks.rados.rados.0.trial082.stdout:566: writing trial08226312-23 from 3679295 to 3731154 tid 4 2026-02-12T17:31:04.683 INFO:tasks.rados.rados.0.trial082.stdout:567: write (excl) oid 42 current snap is 61 2026-02-12T17:31:04.683 INFO:tasks.rados.rados.0.trial082.stdout:564: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:31:04.683 INFO:tasks.rados.rados.0.trial082.stdout:564: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:31:04.683 INFO:tasks.rados.rados.0.trial082.stdout:564: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:31:04.683 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 341 (ObjNum 205 snap 55 seq_num 205) dirty exists 2026-02-12T17:31:04.683 INFO:tasks.rados.rados.0.trial082.stdout:565: finishing write tid 1 to trial08226312-31 2026-02-12T17:31:04.683 INFO:tasks.rados.rados.0.trial082.stdout:567: seq_num 223 ranges {547961=554764,1616308=703740,2741092=698600} 2026-02-12T17:31:04.686 INFO:tasks.rados.rados.0.trial082.stdout:567: writing trial08226312-42 from 547961 to 1102725 tid 1 2026-02-12T17:31:04.691 INFO:tasks.rados.rados.0.trial082.stdout:567: writing trial08226312-42 from 1616308 to 2320048 tid 2 2026-02-12T17:31:04.695 INFO:tasks.rados.rados.0.trial082.stdout:567: writing trial08226312-42 from 2741092 to 3439692 tid 3 2026-02-12T17:31:04.696 INFO:tasks.rados.rados.0.trial082.stdout:564: done (4 left) 2026-02-12T17:31:04.696 INFO:tasks.rados.rados.0.trial082.stdout:568: write oid 18 current snap is 61 2026-02-12T17:31:04.696 INFO:tasks.rados.rados.0.trial082.stdout:568: seq_num 224 ranges {564768=630013,1674790=447398,2768515=626225} 2026-02-12T17:31:04.700 INFO:tasks.rados.rados.0.trial082.stdout:568: writing trial08226312-18 from 564768 to 1194781 tid 1 2026-02-12T17:31:04.704 INFO:tasks.rados.rados.0.trial082.stdout:568: writing trial08226312-18 from 1674790 to 2122188 tid 2 2026-02-12T17:31:04.709 INFO:tasks.rados.rados.0.trial082.stdout:568: writing trial08226312-18 from 2768515 to 3394740 tid 3 2026-02-12T17:31:04.709 INFO:tasks.rados.rados.0.trial082.stdout:569: write oid 33 current snap is 61 2026-02-12T17:31:04.709 INFO:tasks.rados.rados.0.trial082.stdout:569: seq_num 225 ranges {581575=705262,1733272=707409,3195938=437497} 2026-02-12T17:31:04.713 INFO:tasks.rados.rados.0.trial082.stdout:569: writing trial08226312-33 from 581575 to 1286837 tid 1 2026-02-12T17:31:04.718 INFO:tasks.rados.rados.0.trial082.stdout:569: writing trial08226312-33 from 1733272 to 2440681 tid 2 2026-02-12T17:31:04.723 INFO:tasks.rados.rados.0.trial082.stdout:569: writing trial08226312-33 from 3195938 to 3633435 tid 3 2026-02-12T17:31:04.723 INFO:tasks.rados.rados.0.trial082.stdout:570: copy_from oid 9 from oid 1 current snap is 61 2026-02-12T17:31:04.723 INFO:tasks.rados.rados.0.trial082.stdout:563: finishing copy_from racing read to trial08226312-45 2026-02-12T17:31:04.723 INFO:tasks.rados.rados.0.trial082.stdout:563: finishing copy_from to trial08226312-45 2026-02-12T17:31:04.723 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 266 (ObjNum 182 snap 46 seq_num 182) dirty exists 2026-02-12T17:31:04.724 INFO:tasks.rados.rados.0.trial082.stdout:565: finishing write tid 2 to trial08226312-31 2026-02-12T17:31:04.724 INFO:tasks.rados.rados.0.trial082.stdout:565: finishing write tid 3 to trial08226312-31 2026-02-12T17:31:04.724 INFO:tasks.rados.rados.0.trial082.stdout:565: finishing write tid 4 to trial08226312-31 2026-02-12T17:31:04.724 INFO:tasks.rados.rados.0.trial082.stdout:565: finishing write tid 5 to trial08226312-31 2026-02-12T17:31:04.724 INFO:tasks.rados.rados.0.trial082.stdout:565: oid 31 updating version 0 to 122 2026-02-12T17:31:04.724 INFO:tasks.rados.rados.0.trial082.stdout:565: oid 31 updating version 122 to 124 2026-02-12T17:31:04.725 INFO:tasks.rados.rados.0.trial082.stdout:565: oid 31 updating version 124 to 125 2026-02-12T17:31:04.725 INFO:tasks.rados.rados.0.trial082.stdout:565: oid 31 version 125 is already newer than 123 2026-02-12T17:31:04.725 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 125 (ObjNum 221 snap 61 seq_num 221) dirty exists 2026-02-12T17:31:04.725 INFO:tasks.rados.rados.0.trial082.stdout:565: left oid 31 (ObjNum 221 snap 61 seq_num 221) 2026-02-12T17:31:04.725 INFO:tasks.rados.rados.0.trial082.stdout:566: finishing write tid 1 to trial08226312-23 2026-02-12T17:31:04.725 INFO:tasks.rados.rados.0.trial082.stdout:563: done (6 left) 2026-02-12T17:31:04.725 INFO:tasks.rados.rados.0.trial082.stdout:565: done (5 left) 2026-02-12T17:31:04.726 INFO:tasks.rados.rados.0.trial082.stdout:571: read oid 28 snap -1 2026-02-12T17:31:04.726 INFO:tasks.rados.rados.0.trial082.stdout:571: expect (ObjNum 205 snap 55 seq_num 205) 2026-02-12T17:31:04.726 INFO:tasks.rados.rados.0.trial082.stdout:572: snap_remove snap 59 2026-02-12T17:31:05.662 INFO:tasks.rados.rados.0.trial082.stdout:572: done (6 left) 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:573: read oid 4 snap -1 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:573: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:574: copy_from oid 43 from oid 19 current snap is 61 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:566: finishing write tid 2 to trial08226312-23 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:566: finishing write tid 3 to trial08226312-23 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:566: finishing write tid 4 to trial08226312-23 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:566: finishing write tid 5 to trial08226312-23 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:566: finishing write tid 6 to trial08226312-23 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:566: oid 23 updating version 0 to 272 2026-02-12T17:31:05.663 INFO:tasks.rados.rados.0.trial082.stdout:566: oid 23 updating version 272 to 274 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:566: oid 23 version 274 is already newer than 271 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:566: oid 23 version 274 is already newer than 273 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:566: oid 23 updating version 274 to 275 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 275 (ObjNum 222 snap 61 seq_num 222) dirty exists 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:566: left oid 23 (ObjNum 222 snap 61 seq_num 222) 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:567: finishing write tid 1 to trial08226312-42 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:567: finishing write tid 2 to trial08226312-42 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:567: finishing write tid 3 to trial08226312-42 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:567: finishing write tid 4 to trial08226312-42 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:567: finishing write tid 5 to trial08226312-42 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:567: oid 42 updating version 0 to 345 2026-02-12T17:31:05.664 INFO:tasks.rados.rados.0.trial082.stdout:567: oid 42 updating version 345 to 346 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:567: oid 42 version 346 is already newer than 344 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:567: oid 42 version 346 is already newer than 343 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 346 (ObjNum 223 snap 61 seq_num 223) dirty exists 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:567: left oid 42 (ObjNum 223 snap 61 seq_num 223) 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:568: finishing write tid 1 to trial08226312-18 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:568: finishing write tid 2 to trial08226312-18 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:568: finishing write tid 3 to trial08226312-18 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:568: finishing write tid 4 to trial08226312-18 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:568: finishing write tid 5 to trial08226312-18 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:568: oid 18 updating version 0 to 156 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:568: oid 18 updating version 156 to 157 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:568: oid 18 updating version 157 to 158 2026-02-12T17:31:05.665 INFO:tasks.rados.rados.0.trial082.stdout:568: oid 18 version 158 is already newer than 155 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 158 (ObjNum 224 snap 61 seq_num 224) dirty exists 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:568: left oid 18 (ObjNum 224 snap 61 seq_num 224) 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:569: finishing write tid 1 to trial08226312-33 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:569: finishing write tid 2 to trial08226312-33 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:566: done (7 left) 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:567: done (6 left) 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:568: done (5 left) 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:575: copy_from oid 32 from oid 34 current snap is 61 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:569: finishing write tid 3 to trial08226312-33 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:569: finishing write tid 4 to trial08226312-33 2026-02-12T17:31:05.666 INFO:tasks.rados.rados.0.trial082.stdout:569: finishing write tid 5 to trial08226312-33 2026-02-12T17:31:05.667 INFO:tasks.rados.rados.0.trial082.stdout:569: oid 33 updating version 0 to 212 2026-02-12T17:31:05.667 INFO:tasks.rados.rados.0.trial082.stdout:569: oid 33 version 212 is already newer than 211 2026-02-12T17:31:05.667 INFO:tasks.rados.rados.0.trial082.stdout:569: oid 33 version 212 is already newer than 210 2026-02-12T17:31:05.667 INFO:tasks.rados.rados.0.trial082.stdout:569: oid 33 updating version 212 to 213 2026-02-12T17:31:05.667 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 213 (ObjNum 225 snap 61 seq_num 225) dirty exists 2026-02-12T17:31:05.667 INFO:tasks.rados.rados.0.trial082.stdout:569: left oid 33 (ObjNum 225 snap 61 seq_num 225) 2026-02-12T17:31:05.667 INFO:tasks.rados.rados.0.trial082.stdout:571: expect (ObjNum 205 snap 55 seq_num 205) 2026-02-12T17:31:05.720 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2483140 2026-02-12T17:31:05.779 INFO:tasks.rados.rados.0.trial082.stdout:570: finishing copy_from racing read to trial08226312-9 2026-02-12T17:31:05.780 INFO:tasks.rados.rados.0.trial082.stdout:570: finishing copy_from to trial08226312-9 2026-02-12T17:31:05.780 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 31 (ObjNum 212 snap 58 seq_num 212) dirty exists 2026-02-12T17:31:05.780 INFO:tasks.rados.rados.0.trial082.stdout:573: expect (ObjNum 58 snap 2 seq_num 58) 2026-02-12T17:31:05.780 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:05.823 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2086725 2026-02-12T17:31:05.831 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 225206 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:574: finishing copy_from racing read to trial08226312-43 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:574: finishing copy_from to trial08226312-43 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 248 (ObjNum 148 snap 36 seq_num 148) dirty exists 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:575: finishing copy_from racing read to trial08226312-32 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:575: finishing copy_from to trial08226312-32 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 115 (ObjNum 198 snap 52 seq_num 198) dirty exists 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:569: done (5 left) 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:570: done (4 left) 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:571: done (3 left) 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:573: done (2 left) 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:574: done (1 left) 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:575: done (0 left) 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:576: write oid 29 current snap is 61 2026-02-12T17:31:05.860 INFO:tasks.rados.rados.0.trial082.stdout:576: seq_num 226 ranges {598382=780511,2075401=451067,3107008=648769} 2026-02-12T17:31:05.865 INFO:tasks.rados.rados.0.trial082.stdout:576: writing trial08226312-29 from 598382 to 1378893 tid 1 2026-02-12T17:31:05.869 INFO:tasks.rados.rados.0.trial082.stdout:576: writing trial08226312-29 from 2075401 to 2526468 tid 2 2026-02-12T17:31:05.874 INFO:tasks.rados.rados.0.trial082.stdout:576: writing trial08226312-29 from 3107008 to 3755777 tid 3 2026-02-12T17:31:05.874 INFO:tasks.rados.rados.0.trial082.stdout:577: rollback oid 50 current snap is 61 2026-02-12T17:31:05.874 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 60 2026-02-12T17:31:05.874 INFO:tasks.rados.rados.0.trial082.stdout:576: finishing write tid 1 to trial08226312-29 2026-02-12T17:31:05.874 INFO:tasks.rados.rados.0.trial082.stdout:576: finishing write tid 2 to trial08226312-29 2026-02-12T17:31:05.874 INFO:tasks.rados.rados.0.trial082.stdout:578: snap_remove snap 56 2026-02-12T17:31:07.633 INFO:tasks.rados.rados.0.trial082.stdout:578: done (2 left) 2026-02-12T17:31:07.633 INFO:tasks.rados.rados.0.trial082.stdout:579: read oid 11 snap -1 2026-02-12T17:31:07.633 INFO:tasks.rados.rados.0.trial082.stdout:579: expect deleted 2026-02-12T17:31:07.633 INFO:tasks.rados.rados.0.trial082.stdout:580: write oid 46 current snap is 61 2026-02-12T17:31:07.634 INFO:tasks.rados.rados.0.trial082.stdout:576: finishing write tid 3 to trial08226312-29 2026-02-12T17:31:07.634 INFO:tasks.rados.rados.0.trial082.stdout:580: seq_num 227 ranges {615189=455760,1733883=711078,3134431=460041} 2026-02-12T17:31:07.636 INFO:tasks.rados.rados.0.trial082.stdout:580: writing trial08226312-46 from 615189 to 1070949 tid 1 2026-02-12T17:31:07.641 INFO:tasks.rados.rados.0.trial082.stdout:580: writing trial08226312-46 from 1733883 to 2444961 tid 2 2026-02-12T17:31:07.646 INFO:tasks.rados.rados.0.trial082.stdout:580: writing trial08226312-46 from 3134431 to 3594472 tid 3 2026-02-12T17:31:07.646 INFO:tasks.rados.rados.0.trial082.stdout:581: snap_create 2026-02-12T17:31:07.646 INFO:tasks.rados.rados.0.trial082.stdout:576: finishing write tid 4 to trial08226312-29 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:577: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:576: finishing write tid 5 to trial08226312-29 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:576: oid 29 updating version 0 to 97 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:576: oid 29 version 97 is already newer than 95 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:576: oid 29 updating version 97 to 98 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:576: oid 29 version 98 is already newer than 96 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 98 (ObjNum 226 snap 61 seq_num 226) dirty exists 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:576: left oid 29 (ObjNum 226 snap 61 seq_num 226) 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:577: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:577: finishing rollback tid 2 to trial08226312-50 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 102 (ObjNum 193 snap 51 seq_num 193) dirty exists 2026-02-12T17:31:07.647 INFO:tasks.rados.rados.0.trial082.stdout:580: finishing write tid 1 to trial08226312-46 2026-02-12T17:31:07.648 INFO:tasks.rados.rados.0.trial082.stdout:580: finishing write tid 2 to trial08226312-46 2026-02-12T17:31:07.648 INFO:tasks.rados.rados.0.trial082.stdout:580: finishing write tid 3 to trial08226312-46 2026-02-12T17:31:07.648 INFO:tasks.rados.rados.0.trial082.stdout:580: finishing write tid 4 to trial08226312-46 2026-02-12T17:31:07.649 INFO:tasks.rados.rados.0.trial082.stdout:580: finishing write tid 5 to trial08226312-46 2026-02-12T17:31:07.649 INFO:tasks.rados.rados.0.trial082.stdout:580: oid 46 updating version 0 to 147 2026-02-12T17:31:07.649 INFO:tasks.rados.rados.0.trial082.stdout:580: oid 46 updating version 147 to 148 2026-02-12T17:31:07.649 INFO:tasks.rados.rados.0.trial082.stdout:580: oid 46 updating version 148 to 150 2026-02-12T17:31:07.649 INFO:tasks.rados.rados.0.trial082.stdout:580: oid 46 version 150 is already newer than 149 2026-02-12T17:31:07.649 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 150 (ObjNum 227 snap 61 seq_num 227) dirty exists 2026-02-12T17:31:07.649 INFO:tasks.rados.rados.0.trial082.stdout:580: left oid 46 (ObjNum 227 snap 61 seq_num 227) 2026-02-12T17:31:08.634 INFO:tasks.rados.rados.0.trial082.stdout:576: done (4 left) 2026-02-12T17:31:08.634 INFO:tasks.rados.rados.0.trial082.stdout:577: done (3 left) 2026-02-12T17:31:08.635 INFO:tasks.rados.rados.0.trial082.stdout:579: done (2 left) 2026-02-12T17:31:08.635 INFO:tasks.rados.rados.0.trial082.stdout:580: done (1 left) 2026-02-12T17:31:08.635 INFO:tasks.rados.rados.0.trial082.stdout:581: done (0 left) 2026-02-12T17:31:08.635 INFO:tasks.rados.rados.0.trial082.stdout:582: write oid 15 current snap is 62 2026-02-12T17:31:08.635 INFO:tasks.rados.rados.0.trial082.stdout:582: seq_num 228 ranges {631996=531009,1792365=454736,2761854=671313} 2026-02-12T17:31:08.639 INFO:tasks.rados.rados.0.trial082.stdout:582: writing trial08226312-15 from 631996 to 1163005 tid 1 2026-02-12T17:31:08.643 INFO:tasks.rados.rados.0.trial082.stdout:582: writing trial08226312-15 from 1792365 to 2247101 tid 2 2026-02-12T17:31:08.648 INFO:tasks.rados.rados.0.trial082.stdout:582: writing trial08226312-15 from 2761854 to 3433167 tid 3 2026-02-12T17:31:08.648 INFO:tasks.rados.rados.0.trial082.stdout:583: copy_from oid 36 from oid 12 current snap is 62 2026-02-12T17:31:08.648 INFO:tasks.rados.rados.0.trial082.stdout:582: finishing write tid 1 to trial08226312-15 2026-02-12T17:31:08.648 INFO:tasks.rados.rados.0.trial082.stdout:582: finishing write tid 2 to trial08226312-15 2026-02-12T17:31:08.648 INFO:tasks.rados.rados.0.trial082.stdout:584: read oid 8 snap 60 2026-02-12T17:31:08.648 INFO:tasks.rados.rados.0.trial082.stdout:584: expect (ObjNum 211 snap 58 seq_num 211) 2026-02-12T17:31:08.648 INFO:tasks.rados.rados.0.trial082.stdout:585: snap_remove snap 61 2026-02-12T17:31:09.635 INFO:tasks.rados.rados.0.trial082.stdout:585: done (3 left) 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:586: copy_from oid 40 from oid 26 current snap is 62 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:583: finishing copy_from to trial08226312-36 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:583: got expected ENOENT (src dne) 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:583: finishing copy_from racing read to trial08226312-36 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:582: finishing write tid 3 to trial08226312-15 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:582: finishing write tid 4 to trial08226312-15 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:582: finishing write tid 5 to trial08226312-15 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:582: oid 15 updating version 0 to 265 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:582: oid 15 version 265 is already newer than 264 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:582: oid 15 updating version 265 to 267 2026-02-12T17:31:09.636 INFO:tasks.rados.rados.0.trial082.stdout:582: oid 15 version 267 is already newer than 266 2026-02-12T17:31:09.637 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 267 (ObjNum 228 snap 62 seq_num 228) dirty exists 2026-02-12T17:31:09.637 INFO:tasks.rados.rados.0.trial082.stdout:582: left oid 15 (ObjNum 228 snap 62 seq_num 228) 2026-02-12T17:31:09.637 INFO:tasks.rados.rados.0.trial082.stdout:584: expect (ObjNum 211 snap 58 seq_num 211) 2026-02-12T17:31:09.706 INFO:tasks.rados.rados.0.trial082.stdout:586: finishing copy_from racing read to trial08226312-40 2026-02-12T17:31:09.706 INFO:tasks.rados.rados.0.trial082.stdout:586: finishing copy_from to trial08226312-40 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 259 (ObjNum 167 snap 42 seq_num 167) dirty exists 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:582: done (3 left) 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:583: done (2 left) 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:584: done (1 left) 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:586: done (0 left) 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:587: rollback oid 50 current snap is 62 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 60 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:588: rollback oid 1 current snap is 62 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 60 2026-02-12T17:31:09.707 INFO:tasks.rados.rados.0.trial082.stdout:589: read oid 33 snap 60 2026-02-12T17:31:09.708 INFO:tasks.rados.rados.0.trial082.stdout:589: expect (ObjNum 123 snap 28 seq_num 123) 2026-02-12T17:31:09.708 INFO:tasks.rados.rados.0.trial082.stdout:590: write (excl) oid 34 current snap is 62 2026-02-12T17:31:09.708 INFO:tasks.rados.rados.0.trial082.stdout:590: seq_num 229 ranges {648803=722611,1967200=714747,3421983=426820} 2026-02-12T17:31:09.711 INFO:tasks.rados.rados.0.trial082.stdout:590: writing trial08226312-34 from 648803 to 1371414 tid 1 2026-02-12T17:31:09.716 INFO:tasks.rados.rados.0.trial082.stdout:590: writing trial08226312-34 from 1967200 to 2681947 tid 2 2026-02-12T17:31:09.720 INFO:tasks.rados.rados.0.trial082.stdout:590: writing trial08226312-34 from 3421983 to 3848803 tid 3 2026-02-12T17:31:09.721 INFO:tasks.rados.rados.0.trial082.stdout:591: write (excl) oid 5 current snap is 62 2026-02-12T17:31:09.721 INFO:tasks.rados.rados.0.trial082.stdout:591: seq_num 230 ranges {665610=797860,1909329=458405,2816700=410210} 2026-02-12T17:31:09.726 INFO:tasks.rados.rados.0.trial082.stdout:591: writing trial08226312-5 from 665610 to 1463470 tid 1 2026-02-12T17:31:09.729 INFO:tasks.rados.rados.0.trial082.stdout:591: writing trial08226312-5 from 1909329 to 2367734 tid 2 2026-02-12T17:31:09.733 INFO:tasks.rados.rados.0.trial082.stdout:591: writing trial08226312-5 from 2816700 to 3226910 tid 3 2026-02-12T17:31:09.733 INFO:tasks.rados.rados.0.trial082.stdout:592: write (excl) oid 37 current snap is 62 2026-02-12T17:31:09.733 INFO:tasks.rados.rados.0.trial082.stdout:588: finishing rollback tid 0 to trial08226312-1 2026-02-12T17:31:09.733 INFO:tasks.rados.rados.0.trial082.stdout:587: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:31:09.733 INFO:tasks.rados.rados.0.trial082.stdout:588: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:31:09.734 INFO:tasks.rados.rados.0.trial082.stdout:587: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:31:09.734 INFO:tasks.rados.rados.0.trial082.stdout:588: finishing rollback tid 2 to trial08226312-1 2026-02-12T17:31:09.734 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 37 (ObjNum 212 snap 58 seq_num 212) dirty exists 2026-02-12T17:31:09.734 INFO:tasks.rados.rados.0.trial082.stdout:587: finishing rollback tid 2 to trial08226312-50 2026-02-12T17:31:09.734 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 107 (ObjNum 193 snap 51 seq_num 193) dirty exists 2026-02-12T17:31:09.734 INFO:tasks.rados.rados.0.trial082.stdout:589: expect (ObjNum 123 snap 28 seq_num 123) 2026-02-12T17:31:09.785 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1819676 2026-02-12T17:31:09.822 INFO:tasks.rados.rados.0.trial082.stdout:590: finishing write tid 1 to trial08226312-34 2026-02-12T17:31:09.823 INFO:tasks.rados.rados.0.trial082.stdout:592: seq_num 231 ranges {682417=473109,1567811=602063,2844123=621482} 2026-02-12T17:31:09.827 INFO:tasks.rados.rados.0.trial082.stdout:592: writing trial08226312-37 from 682417 to 1155526 tid 1 2026-02-12T17:31:09.831 INFO:tasks.rados.rados.0.trial082.stdout:592: writing trial08226312-37 from 1567811 to 2169874 tid 2 2026-02-12T17:31:09.836 INFO:tasks.rados.rados.0.trial082.stdout:592: writing trial08226312-37 from 2844123 to 3465605 tid 3 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:587: done (5 left) 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:588: done (4 left) 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:589: done (3 left) 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:593: copy_from oid 27 from oid 30 current snap is 62 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:590: finishing write tid 2 to trial08226312-34 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:590: finishing write tid 3 to trial08226312-34 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:590: finishing write tid 4 to trial08226312-34 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:590: finishing write tid 5 to trial08226312-34 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:590: oid 34 updating version 0 to 166 2026-02-12T17:31:09.837 INFO:tasks.rados.rados.0.trial082.stdout:590: oid 34 version 166 is already newer than 165 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:590: oid 34 updating version 166 to 167 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:590: oid 34 version 167 is already newer than 164 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 167 (ObjNum 229 snap 62 seq_num 229) dirty exists 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:590: left oid 34 (ObjNum 229 snap 62 seq_num 229) 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:591: finishing write tid 1 to trial08226312-5 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:591: finishing write tid 2 to trial08226312-5 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:591: finishing write tid 3 to trial08226312-5 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:591: finishing write tid 4 to trial08226312-5 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:591: finishing write tid 5 to trial08226312-5 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:591: oid 5 updating version 0 to 270 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:591: oid 5 updating version 270 to 271 2026-02-12T17:31:09.838 INFO:tasks.rados.rados.0.trial082.stdout:591: oid 5 version 271 is already newer than 268 2026-02-12T17:31:09.839 INFO:tasks.rados.rados.0.trial082.stdout:591: oid 5 version 271 is already newer than 269 2026-02-12T17:31:09.839 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 271 (ObjNum 230 snap 62 seq_num 230) dirty exists 2026-02-12T17:31:09.839 INFO:tasks.rados.rados.0.trial082.stdout:591: left oid 5 (ObjNum 230 snap 62 seq_num 230) 2026-02-12T17:31:09.839 INFO:tasks.rados.rados.0.trial082.stdout:592: finishing write tid 1 to trial08226312-37 2026-02-12T17:31:09.839 INFO:tasks.rados.rados.0.trial082.stdout:590: done (3 left) 2026-02-12T17:31:09.839 INFO:tasks.rados.rados.0.trial082.stdout:591: done (2 left) 2026-02-12T17:31:09.839 INFO:tasks.rados.rados.0.trial082.stdout:594: snap_create 2026-02-12T17:31:09.839 INFO:tasks.rados.rados.0.trial082.stdout:592: finishing write tid 2 to trial08226312-37 2026-02-12T17:31:09.840 INFO:tasks.rados.rados.0.trial082.stdout:592: finishing write tid 3 to trial08226312-37 2026-02-12T17:31:09.840 INFO:tasks.rados.rados.0.trial082.stdout:592: finishing write tid 4 to trial08226312-37 2026-02-12T17:31:09.840 INFO:tasks.rados.rados.0.trial082.stdout:592: finishing write tid 5 to trial08226312-37 2026-02-12T17:31:09.840 INFO:tasks.rados.rados.0.trial082.stdout:592: oid 37 updating version 0 to 217 2026-02-12T17:31:09.840 INFO:tasks.rados.rados.0.trial082.stdout:592: oid 37 version 217 is already newer than 214 2026-02-12T17:31:09.840 INFO:tasks.rados.rados.0.trial082.stdout:592: oid 37 version 217 is already newer than 216 2026-02-12T17:31:09.841 INFO:tasks.rados.rados.0.trial082.stdout:592: oid 37 version 217 is already newer than 215 2026-02-12T17:31:09.841 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 217 (ObjNum 231 snap 62 seq_num 231) dirty exists 2026-02-12T17:31:09.841 INFO:tasks.rados.rados.0.trial082.stdout:592: left oid 37 (ObjNum 231 snap 62 seq_num 231) 2026-02-12T17:31:09.842 INFO:tasks.rados.rados.0.trial082.stdout:593: finishing copy_from racing read to trial08226312-27 2026-02-12T17:31:09.843 INFO:tasks.rados.rados.0.trial082.stdout:593: finishing copy_from to trial08226312-27 2026-02-12T17:31:09.844 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 263 (ObjNum 177 snap 43 seq_num 177) dirty exists 2026-02-12T17:31:10.641 INFO:tasks.rados.rados.0.trial082.stdout:592: done (2 left) 2026-02-12T17:31:10.642 INFO:tasks.rados.rados.0.trial082.stdout:593: done (1 left) 2026-02-12T17:31:10.642 INFO:tasks.rados.rados.0.trial082.stdout:594: done (0 left) 2026-02-12T17:31:10.642 INFO:tasks.rados.rados.0.trial082.stdout:595: copy_from oid 9 from oid 45 current snap is 63 2026-02-12T17:31:10.642 INFO:tasks.rados.rados.0.trial082.stdout:596: rollback oid 16 current snap is 63 2026-02-12T17:31:10.642 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 62 2026-02-12T17:31:10.642 INFO:tasks.rados.rados.0.trial082.stdout:597: snap_remove snap 60 2026-02-12T17:31:11.641 INFO:tasks.rados.rados.0.trial082.stdout:597: done (2 left) 2026-02-12T17:31:11.642 INFO:tasks.rados.rados.0.trial082.stdout:598: write (excl) oid 47 current snap is 63 2026-02-12T17:31:11.642 INFO:tasks.rados.rados.0.trial082.stdout:598: seq_num 232 ranges {699224=548358,2026293=462074,3271546=432754} 2026-02-12T17:31:11.646 INFO:tasks.rados.rados.0.trial082.stdout:598: writing trial08226312-47 from 699224 to 1247582 tid 1 2026-02-12T17:31:11.651 INFO:tasks.rados.rados.0.trial082.stdout:598: writing trial08226312-47 from 2026293 to 2488367 tid 2 2026-02-12T17:31:11.655 INFO:tasks.rados.rados.0.trial082.stdout:598: writing trial08226312-47 from 3271546 to 3704300 tid 3 2026-02-12T17:31:11.656 INFO:tasks.rados.rados.0.trial082.stdout:599: write (excl) oid 32 current snap is 63 2026-02-12T17:31:11.656 INFO:tasks.rados.rados.0.trial082.stdout:596: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:31:11.656 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 0 (ObjNum 689 snap 0 seq_num 27003951) dirty dne 2026-02-12T17:31:11.656 INFO:tasks.rados.rados.0.trial082.stdout:599: seq_num 233 ranges {716031=623607,2084775=605732,3298969=617062} 2026-02-12T17:31:11.660 INFO:tasks.rados.rados.0.trial082.stdout:599: writing trial08226312-32 from 716031 to 1339638 tid 1 2026-02-12T17:31:11.665 INFO:tasks.rados.rados.0.trial082.stdout:599: writing trial08226312-32 from 2084775 to 2690507 tid 2 2026-02-12T17:31:11.670 INFO:tasks.rados.rados.0.trial082.stdout:599: writing trial08226312-32 from 3298969 to 3916031 tid 3 2026-02-12T17:31:11.670 INFO:tasks.rados.rados.0.trial082.stdout:596: done (3 left) 2026-02-12T17:31:11.671 INFO:tasks.rados.rados.0.trial082.stdout:600: write oid 8 current snap is 63 2026-02-12T17:31:11.671 INFO:tasks.rados.rados.0.trial082.stdout:600: seq_num 234 ranges {732838=698856,2026904=465743,3210039=571651} 2026-02-12T17:31:11.676 INFO:tasks.rados.rados.0.trial082.stdout:600: writing trial08226312-8 from 732838 to 1431694 tid 1 2026-02-12T17:31:11.679 INFO:tasks.rados.rados.0.trial082.stdout:600: writing trial08226312-8 from 2026904 to 2492647 tid 2 2026-02-12T17:31:11.685 INFO:tasks.rados.rados.0.trial082.stdout:600: writing trial08226312-8 from 3210039 to 3781690 tid 3 2026-02-12T17:31:11.685 INFO:tasks.rados.rados.0.trial082.stdout:601: write oid 35 current snap is 63 2026-02-12T17:31:11.685 INFO:tasks.rados.rados.0.trial082.stdout:595: finishing copy_from racing read to trial08226312-9 2026-02-12T17:31:11.685 INFO:tasks.rados.rados.0.trial082.stdout:595: finishing copy_from to trial08226312-9 2026-02-12T17:31:11.685 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 266 (ObjNum 182 snap 46 seq_num 182) dirty exists 2026-02-12T17:31:11.685 INFO:tasks.rados.rados.0.trial082.stdout:598: finishing write tid 1 to trial08226312-47 2026-02-12T17:31:11.685 INFO:tasks.rados.rados.0.trial082.stdout:598: finishing write tid 2 to trial08226312-47 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:598: finishing write tid 3 to trial08226312-47 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:598: finishing write tid 4 to trial08226312-47 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:598: finishing write tid 5 to trial08226312-47 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:598: oid 47 updating version 0 to 336 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:598: oid 47 updating version 336 to 339 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:598: oid 47 version 339 is already newer than 337 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:598: oid 47 version 339 is already newer than 338 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 339 (ObjNum 232 snap 63 seq_num 232) dirty exists 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:598: left oid 47 (ObjNum 232 snap 63 seq_num 232) 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:599: finishing write tid 1 to trial08226312-32 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:599: finishing write tid 2 to trial08226312-32 2026-02-12T17:31:11.686 INFO:tasks.rados.rados.0.trial082.stdout:599: finishing write tid 3 to trial08226312-32 2026-02-12T17:31:11.687 INFO:tasks.rados.rados.0.trial082.stdout:599: finishing write tid 4 to trial08226312-32 2026-02-12T17:31:11.687 INFO:tasks.rados.rados.0.trial082.stdout:601: seq_num 235 ranges {749645=774105,2085386=609401,3237462=712183} 2026-02-12T17:31:11.690 INFO:tasks.rados.rados.0.trial082.stdout:601: writing trial08226312-35 from 749645 to 1523750 tid 1 2026-02-12T17:31:11.694 INFO:tasks.rados.rados.0.trial082.stdout:601: writing trial08226312-35 from 2085386 to 2694787 tid 2 2026-02-12T17:31:11.699 INFO:tasks.rados.rados.0.trial082.stdout:601: writing trial08226312-35 from 3237462 to 3949645 tid 3 2026-02-12T17:31:11.699 INFO:tasks.rados.rados.0.trial082.stdout:595: done (4 left) 2026-02-12T17:31:11.700 INFO:tasks.rados.rados.0.trial082.stdout:598: done (3 left) 2026-02-12T17:31:11.700 INFO:tasks.rados.rados.0.trial082.stdout:602: write (excl) oid 44 current snap is 63 2026-02-12T17:31:11.700 INFO:tasks.rados.rados.0.trial082.stdout:602: seq_num 236 ranges {766452=565707,1860221=469412,2981238=594195} 2026-02-12T17:31:11.704 INFO:tasks.rados.rados.0.trial082.stdout:602: writing trial08226312-44 from 766452 to 1332159 tid 1 2026-02-12T17:31:11.708 INFO:tasks.rados.rados.0.trial082.stdout:602: writing trial08226312-44 from 1860221 to 2329633 tid 2 2026-02-12T17:31:11.713 INFO:tasks.rados.rados.0.trial082.stdout:602: writing trial08226312-44 from 2981238 to 3575433 tid 3 2026-02-12T17:31:11.713 INFO:tasks.rados.rados.0.trial082.stdout:603: read oid 2 snap -1 2026-02-12T17:31:11.713 INFO:tasks.rados.rados.0.trial082.stdout:603: expect (ObjNum 134 snap 31 seq_num 134) 2026-02-12T17:31:11.713 INFO:tasks.rados.rados.0.trial082.stdout:604: read oid 47 snap -1 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:604: expect (ObjNum 232 snap 63 seq_num 232) 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:605: write (excl) oid 30 current snap is 63 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:599: finishing write tid 5 to trial08226312-32 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:599: oid 32 updating version 0 to 156 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:599: oid 32 updating version 156 to 157 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:599: oid 32 updating version 157 to 159 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:599: oid 32 version 159 is already newer than 158 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 159 (ObjNum 233 snap 63 seq_num 233) dirty exists 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:599: left oid 32 (ObjNum 233 snap 63 seq_num 233) 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:600: finishing write tid 1 to trial08226312-8 2026-02-12T17:31:11.714 INFO:tasks.rados.rados.0.trial082.stdout:605: seq_num 237 ranges {783259=640956,1918703=613070,3008661=405467,3821939=161320} 2026-02-12T17:31:11.718 INFO:tasks.rados.rados.0.trial082.stdout:605: writing trial08226312-30 from 783259 to 1424215 tid 1 2026-02-12T17:31:11.722 INFO:tasks.rados.rados.0.trial082.stdout:605: writing trial08226312-30 from 1918703 to 2531773 tid 2 2026-02-12T17:31:11.725 INFO:tasks.rados.rados.0.trial082.stdout:605: writing trial08226312-30 from 3008661 to 3414128 tid 3 2026-02-12T17:31:11.727 INFO:tasks.rados.rados.0.trial082.stdout:605: writing trial08226312-30 from 3821939 to 3983259 tid 4 2026-02-12T17:31:11.727 INFO:tasks.rados.rados.0.trial082.stdout:599: done (6 left) 2026-02-12T17:31:11.728 INFO:tasks.rados.rados.0.trial082.stdout:606: snap_remove snap 62 2026-02-12T17:31:13.086 INFO:tasks.rados.rados.0.trial082.stdout:606: done (6 left) 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:607: copy_from oid 31 from oid 46 current snap is 63 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:600: finishing write tid 2 to trial08226312-8 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:600: finishing write tid 3 to trial08226312-8 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:600: finishing write tid 4 to trial08226312-8 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:600: finishing write tid 5 to trial08226312-8 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:600: oid 8 updating version 0 to 344 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:600: oid 8 version 344 is already newer than 341 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:600: oid 8 version 344 is already newer than 342 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:600: oid 8 version 344 is already newer than 343 2026-02-12T17:31:13.087 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 344 (ObjNum 234 snap 63 seq_num 234) dirty exists 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:600: left oid 8 (ObjNum 234 snap 63 seq_num 234) 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: finishing write tid 1 to trial08226312-35 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: finishing write tid 2 to trial08226312-35 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: finishing write tid 3 to trial08226312-35 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: finishing write tid 4 to trial08226312-35 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: finishing write tid 5 to trial08226312-35 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: oid 35 updating version 0 to 287 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: oid 35 version 287 is already newer than 286 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: oid 35 updating version 287 to 288 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: oid 35 updating version 288 to 289 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 289 (ObjNum 235 snap 63 seq_num 235) dirty exists 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:601: left oid 35 (ObjNum 235 snap 63 seq_num 235) 2026-02-12T17:31:13.088 INFO:tasks.rados.rados.0.trial082.stdout:602: finishing write tid 1 to trial08226312-44 2026-02-12T17:31:13.089 INFO:tasks.rados.rados.0.trial082.stdout:600: done (6 left) 2026-02-12T17:31:13.089 INFO:tasks.rados.rados.0.trial082.stdout:601: done (5 left) 2026-02-12T17:31:13.089 INFO:tasks.rados.rados.0.trial082.stdout:608: write oid 11 current snap is 63 2026-02-12T17:31:13.089 INFO:tasks.rados.rados.0.trial082.stdout:608: seq_num 238 ranges {400066=716205,1860832=139234} 2026-02-12T17:31:13.090 INFO:tasks.rados.rados.0.trial082.stdout:608: writing trial08226312-11 from 400066 to 1116271 tid 1 2026-02-12T17:31:13.093 INFO:tasks.rados.rados.0.trial082.stdout:608: writing trial08226312-11 from 1860832 to 2000066 tid 2 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:609: snap_create 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:602: finishing write tid 2 to trial08226312-44 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:602: finishing write tid 3 to trial08226312-44 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:602: finishing write tid 4 to trial08226312-44 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:602: finishing write tid 5 to trial08226312-44 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:602: oid 44 updating version 0 to 294 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:602: oid 44 version 294 is already newer than 291 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:602: oid 44 version 294 is already newer than 292 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:602: oid 44 version 294 is already newer than 293 2026-02-12T17:31:13.094 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 294 (ObjNum 236 snap 63 seq_num 236) dirty exists 2026-02-12T17:31:13.095 INFO:tasks.rados.rados.0.trial082.stdout:602: left oid 44 (ObjNum 236 snap 63 seq_num 236) 2026-02-12T17:31:13.095 INFO:tasks.rados.rados.0.trial082.stdout:604: expect (ObjNum 232 snap 63 seq_num 232) 2026-02-12T17:31:13.121 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:13.170 INFO:tasks.rados.rados.0.trial082.stdout:603: expect (ObjNum 134 snap 31 seq_num 134) 2026-02-12T17:31:13.181 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1852391 2026-02-12T17:31:13.197 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:13.217 INFO:tasks.rados.rados.0.trial082.stdout:605: finishing write tid 1 to trial08226312-30 2026-02-12T17:31:13.217 INFO:tasks.rados.rados.0.trial082.stdout:605: finishing write tid 2 to trial08226312-30 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: finishing write tid 3 to trial08226312-30 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: finishing write tid 4 to trial08226312-30 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: finishing write tid 5 to trial08226312-30 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: finishing write tid 6 to trial08226312-30 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: oid 30 updating version 0 to 269 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: oid 30 updating version 269 to 271 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: oid 30 version 271 is already newer than 270 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: oid 30 version 271 is already newer than 267 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: oid 30 version 271 is already newer than 268 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 271 (ObjNum 237 snap 63 seq_num 237) dirty exists 2026-02-12T17:31:13.218 INFO:tasks.rados.rados.0.trial082.stdout:605: left oid 30 (ObjNum 237 snap 63 seq_num 237) 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:608: finishing write tid 1 to trial08226312-11 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:608: finishing write tid 2 to trial08226312-11 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:608: finishing write tid 3 to trial08226312-11 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:608: finishing write tid 4 to trial08226312-11 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:608: oid 11 updating version 0 to 153 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:608: oid 11 version 153 is already newer than 151 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:608: oid 11 version 153 is already newer than 152 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 153 (ObjNum 238 snap 63 seq_num 238) dirty exists 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:608: left oid 11 (ObjNum 238 snap 63 seq_num 238) 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:607: finishing copy_from racing read to trial08226312-31 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:607: finishing copy_from to trial08226312-31 2026-02-12T17:31:13.219 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 150 (ObjNum 227 snap 61 seq_num 227) dirty exists 2026-02-12T17:31:14.249 INFO:tasks.rados.rados.0.trial082.stdout:602: done (6 left) 2026-02-12T17:31:14.250 INFO:tasks.rados.rados.0.trial082.stdout:603: done (5 left) 2026-02-12T17:31:14.250 INFO:tasks.rados.rados.0.trial082.stdout:604: done (4 left) 2026-02-12T17:31:14.250 INFO:tasks.rados.rados.0.trial082.stdout:605: done (3 left) 2026-02-12T17:31:14.250 INFO:tasks.rados.rados.0.trial082.stdout:607: done (2 left) 2026-02-12T17:31:14.250 INFO:tasks.rados.rados.0.trial082.stdout:608: done (1 left) 2026-02-12T17:31:14.250 INFO:tasks.rados.rados.0.trial082.stdout:609: done (0 left) 2026-02-12T17:31:14.250 INFO:tasks.rados.rados.0.trial082.stdout:610: read oid 49 snap -1 2026-02-12T17:31:14.250 INFO:tasks.rados.rados.0.trial082.stdout:610: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:31:14.250 INFO:tasks.rados.rados.0.trial082.stdout:611: read oid 28 snap -1 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:611: expect (ObjNum 205 snap 55 seq_num 205) 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:612: rollback oid 12 current snap is 64 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 63 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:613: read oid 29 snap -1 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:613: expect (ObjNum 226 snap 61 seq_num 226) 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:614: read oid 13 snap -1 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:614: expect (ObjNum 192 snap 50 seq_num 192) 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:615: snap_create 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:612: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:31:14.251 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 0 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-12T17:31:14.257 INFO:tasks.rados.rados.0.trial082.stdout:610: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:31:14.261 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 855422 2026-02-12T17:31:14.293 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:14.312 INFO:tasks.rados.rados.0.trial082.stdout:611: expect (ObjNum 205 snap 55 seq_num 205) 2026-02-12T17:31:14.312 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:14.399 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:14.443 INFO:tasks.rados.rados.0.trial082.stdout:613: expect (ObjNum 226 snap 61 seq_num 226) 2026-02-12T17:31:14.495 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 435390 2026-02-12T17:31:14.519 INFO:tasks.rados.rados.0.trial082.stdout:614: expect (ObjNum 192 snap 50 seq_num 192) 2026-02-12T17:31:14.600 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:15.251 INFO:tasks.rados.rados.0.trial082.stdout:610: done (5 left) 2026-02-12T17:31:15.251 INFO:tasks.rados.rados.0.trial082.stdout:611: done (4 left) 2026-02-12T17:31:15.251 INFO:tasks.rados.rados.0.trial082.stdout:612: done (3 left) 2026-02-12T17:31:15.251 INFO:tasks.rados.rados.0.trial082.stdout:613: done (2 left) 2026-02-12T17:31:15.251 INFO:tasks.rados.rados.0.trial082.stdout:614: done (1 left) 2026-02-12T17:31:15.252 INFO:tasks.rados.rados.0.trial082.stdout:615: done (0 left) 2026-02-12T17:31:15.252 INFO:tasks.rados.rados.0.trial082.stdout:616: write (excl) oid 30 current snap is 65 2026-02-12T17:31:15.252 INFO:tasks.rados.rados.0.trial082.stdout:616: seq_num 239 ranges {416873=791454,1919314=97559} 2026-02-12T17:31:15.255 INFO:tasks.rados.rados.0.trial082.stdout:616: writing trial08226312-30 from 416873 to 1208327 tid 1 2026-02-12T17:31:15.258 INFO:tasks.rados.rados.0.trial082.stdout:616: writing trial08226312-30 from 1919314 to 2016873 tid 2 2026-02-12T17:31:15.259 INFO:tasks.rados.rados.0.trial082.stdout:617: snap_create 2026-02-12T17:31:15.261 INFO:tasks.rados.rados.0.trial082.stdout:616: finishing write tid 1 to trial08226312-30 2026-02-12T17:31:15.261 INFO:tasks.rados.rados.0.trial082.stdout:616: finishing write tid 2 to trial08226312-30 2026-02-12T17:31:15.261 INFO:tasks.rados.rados.0.trial082.stdout:616: finishing write tid 3 to trial08226312-30 2026-02-12T17:31:15.261 INFO:tasks.rados.rados.0.trial082.stdout:616: finishing write tid 4 to trial08226312-30 2026-02-12T17:31:15.262 INFO:tasks.rados.rados.0.trial082.stdout:616: oid 30 updating version 0 to 273 2026-02-12T17:31:15.262 INFO:tasks.rados.rados.0.trial082.stdout:616: oid 30 updating version 273 to 274 2026-02-12T17:31:15.262 INFO:tasks.rados.rados.0.trial082.stdout:616: oid 30 version 274 is already newer than 272 2026-02-12T17:31:15.262 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 274 (ObjNum 239 snap 65 seq_num 239) dirty exists 2026-02-12T17:31:15.262 INFO:tasks.rados.rados.0.trial082.stdout:616: left oid 30 (ObjNum 239 snap 65 seq_num 239) 2026-02-12T17:31:16.255 INFO:tasks.rados.rados.0.trial082.stdout:616: done (1 left) 2026-02-12T17:31:16.255 INFO:tasks.rados.rados.0.trial082.stdout:617: done (0 left) 2026-02-12T17:31:16.255 INFO:tasks.rados.rados.0.trial082.stdout:618: delete oid 8 current snap is 66 2026-02-12T17:31:16.259 INFO:tasks.rados.rados.0.trial082.stdout:618: done (0 left) 2026-02-12T17:31:16.259 INFO:tasks.rados.rados.0.trial082.stdout:619: read oid 14 snap -1 2026-02-12T17:31:16.259 INFO:tasks.rados.rados.0.trial082.stdout:619: expect (ObjNum 175 snap 43 seq_num 175) 2026-02-12T17:31:16.259 INFO:tasks.rados.rados.0.trial082.stdout:620: snap_create 2026-02-12T17:31:16.260 INFO:tasks.rados.rados.0.trial082.stdout:619: expect (ObjNum 175 snap 43 seq_num 175) 2026-02-12T17:31:16.267 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2630745 2026-02-12T17:31:17.256 INFO:tasks.rados.rados.0.trial082.stdout:619: done (1 left) 2026-02-12T17:31:17.256 INFO:tasks.rados.rados.0.trial082.stdout:620: done (0 left) 2026-02-12T17:31:17.256 INFO:tasks.rados.rados.0.trial082.stdout:621: read oid 8 snap -1 2026-02-12T17:31:17.256 INFO:tasks.rados.rados.0.trial082.stdout:621: expect deleted 2026-02-12T17:31:17.256 INFO:tasks.rados.rados.0.trial082.stdout:622: write oid 1 current snap is 67 2026-02-12T17:31:17.256 INFO:tasks.rados.rados.0.trial082.stdout:622: seq_num 241 ranges {450487=541952,1636278=414209} 2026-02-12T17:31:17.259 INFO:tasks.rados.rados.0.trial082.stdout:622: writing trial08226312-1 from 450487 to 992439 tid 1 2026-02-12T17:31:17.263 INFO:tasks.rados.rados.0.trial082.stdout:622: writing trial08226312-1 from 1636278 to 2050487 tid 2 2026-02-12T17:31:17.263 INFO:tasks.rados.rados.0.trial082.stdout:623: delete oid 36 current snap is 67 2026-02-12T17:31:17.263 INFO:tasks.rados.rados.0.trial082.stdout:622: finishing write tid 1 to trial08226312-1 2026-02-12T17:31:17.265 INFO:tasks.rados.rados.0.trial082.stdout:622: finishing write tid 2 to trial08226312-1 2026-02-12T17:31:17.265 INFO:tasks.rados.rados.0.trial082.stdout:622: finishing write tid 3 to trial08226312-1 2026-02-12T17:31:17.265 INFO:tasks.rados.rados.0.trial082.stdout:622: finishing write tid 4 to trial08226312-1 2026-02-12T17:31:17.265 INFO:tasks.rados.rados.0.trial082.stdout:622: oid 1 updating version 0 to 43 2026-02-12T17:31:17.266 INFO:tasks.rados.rados.0.trial082.stdout:622: oid 1 version 43 is already newer than 42 2026-02-12T17:31:17.266 INFO:tasks.rados.rados.0.trial082.stdout:622: oid 1 version 43 is already newer than 41 2026-02-12T17:31:17.266 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 43 (ObjNum 241 snap 67 seq_num 241) dirty exists 2026-02-12T17:31:17.266 INFO:tasks.rados.rados.0.trial082.stdout:622: left oid 1 (ObjNum 241 snap 67 seq_num 241) 2026-02-12T17:31:17.266 INFO:tasks.rados.rados.0.trial082.stdout:621: done (2 left) 2026-02-12T17:31:17.266 INFO:tasks.rados.rados.0.trial082.stdout:622: done (1 left) 2026-02-12T17:31:17.266 INFO:tasks.rados.rados.0.trial082.stdout:623: done (0 left) 2026-02-12T17:31:17.266 INFO:tasks.rados.rados.0.trial082.stdout:624: delete oid 33 current snap is 67 2026-02-12T17:31:17.268 INFO:tasks.rados.rados.0.trial082.stdout:624: done (0 left) 2026-02-12T17:31:17.268 INFO:tasks.rados.rados.0.trial082.stdout:625: rollback oid 50 current snap is 67 2026-02-12T17:31:17.268 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 63 2026-02-12T17:31:17.268 INFO:tasks.rados.rados.0.trial082.stdout:626: snap_create 2026-02-12T17:31:17.270 INFO:tasks.rados.rados.0.trial082.stdout:625: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:31:17.270 INFO:tasks.rados.rados.0.trial082.stdout:625: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:31:17.270 INFO:tasks.rados.rados.0.trial082.stdout:625: finishing rollback tid 2 to trial08226312-50 2026-02-12T17:31:17.270 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 113 (ObjNum 193 snap 51 seq_num 193) dirty exists 2026-02-12T17:31:17.630 INFO:tasks.rados.rados.0.trial082.stdout:625: done (1 left) 2026-02-12T17:31:17.631 INFO:tasks.rados.rados.0.trial082.stdout:626: done (0 left) 2026-02-12T17:31:17.631 INFO:tasks.rados.rados.0.trial082.stdout:627: write (excl) oid 36 current snap is 68 2026-02-12T17:31:17.631 INFO:tasks.rados.rados.0.trial082.stdout:627: seq_num 244 ranges {500908=484052,1411724=689184} 2026-02-12T17:31:17.634 INFO:tasks.rados.rados.0.trial082.stdout:627: writing trial08226312-36 from 500908 to 984960 tid 1 2026-02-12T17:31:17.639 INFO:tasks.rados.rados.0.trial082.stdout:627: writing trial08226312-36 from 1411724 to 2100908 tid 2 2026-02-12T17:31:17.639 INFO:tasks.rados.rados.0.trial082.stdout:628: write (excl) oid 32 current snap is 68 2026-02-12T17:31:17.639 INFO:tasks.rados.rados.0.trial082.stdout:628: seq_num 245 ranges {517715=559301,1870206=247509} 2026-02-12T17:31:17.643 INFO:tasks.rados.rados.0.trial082.stdout:628: writing trial08226312-32 from 517715 to 1077016 tid 1 2026-02-12T17:31:17.647 INFO:tasks.rados.rados.0.trial082.stdout:628: writing trial08226312-32 from 1870206 to 2117715 tid 2 2026-02-12T17:31:17.647 INFO:tasks.rados.rados.0.trial082.stdout:629: rollback oid 47 current snap is 68 2026-02-12T17:31:17.647 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 47 to 64 2026-02-12T17:31:17.647 INFO:tasks.rados.rados.0.trial082.stdout:627: finishing write tid 1 to trial08226312-36 2026-02-12T17:31:17.647 INFO:tasks.rados.rados.0.trial082.stdout:627: finishing write tid 2 to trial08226312-36 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:627: finishing write tid 3 to trial08226312-36 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:627: finishing write tid 4 to trial08226312-36 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:627: oid 36 updating version 0 to 299 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:627: oid 36 updating version 299 to 300 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:627: oid 36 updating version 300 to 301 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 301 (ObjNum 244 snap 68 seq_num 244) dirty exists 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:627: left oid 36 (ObjNum 244 snap 68 seq_num 244) 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:628: finishing write tid 1 to trial08226312-32 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:627: done (2 left) 2026-02-12T17:31:17.648 INFO:tasks.rados.rados.0.trial082.stdout:630: read oid 7 snap 65 2026-02-12T17:31:17.649 INFO:tasks.rados.rados.0.trial082.stdout:630: expect deleted 2026-02-12T17:31:17.649 INFO:tasks.rados.rados.0.trial082.stdout:631: delete oid 18 current snap is 68 2026-02-12T17:31:17.650 INFO:tasks.rados.rados.0.trial082.stdout:628: finishing write tid 2 to trial08226312-32 2026-02-12T17:31:17.650 INFO:tasks.rados.rados.0.trial082.stdout:628: finishing write tid 3 to trial08226312-32 2026-02-12T17:31:17.650 INFO:tasks.rados.rados.0.trial082.stdout:628: finishing write tid 4 to trial08226312-32 2026-02-12T17:31:17.650 INFO:tasks.rados.rados.0.trial082.stdout:628: oid 32 updating version 0 to 163 2026-02-12T17:31:17.650 INFO:tasks.rados.rados.0.trial082.stdout:628: oid 32 updating version 163 to 165 2026-02-12T17:31:17.650 INFO:tasks.rados.rados.0.trial082.stdout:628: oid 32 version 165 is already newer than 164 2026-02-12T17:31:17.650 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 165 (ObjNum 245 snap 68 seq_num 245) dirty exists 2026-02-12T17:31:17.650 INFO:tasks.rados.rados.0.trial082.stdout:628: left oid 32 (ObjNum 245 snap 68 seq_num 245) 2026-02-12T17:31:17.651 INFO:tasks.rados.rados.0.trial082.stdout:628: done (3 left) 2026-02-12T17:31:17.651 INFO:tasks.rados.rados.0.trial082.stdout:630: done (2 left) 2026-02-12T17:31:17.651 INFO:tasks.rados.rados.0.trial082.stdout:631: done (1 left) 2026-02-12T17:31:17.651 INFO:tasks.rados.rados.0.trial082.stdout:632: delete oid 23 current snap is 68 2026-02-12T17:31:17.651 INFO:tasks.rados.rados.0.trial082.stdout:629: finishing rollback tid 0 to trial08226312-47 2026-02-12T17:31:17.651 INFO:tasks.rados.rados.0.trial082.stdout:629: finishing rollback tid 1 to trial08226312-47 2026-02-12T17:31:17.651 INFO:tasks.rados.rados.0.trial082.stdout:629: finishing rollback tid 2 to trial08226312-47 2026-02-12T17:31:17.651 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 352 (ObjNum 232 snap 63 seq_num 232) dirty exists 2026-02-12T17:31:17.652 INFO:tasks.rados.rados.0.trial082.stdout:629: done (1 left) 2026-02-12T17:31:17.652 INFO:tasks.rados.rados.0.trial082.stdout:632: done (0 left) 2026-02-12T17:31:17.652 INFO:tasks.rados.rados.0.trial082.stdout:633: copy_from oid 8 from oid 22 current snap is 68 2026-02-12T17:31:17.652 INFO:tasks.rados.rados.0.trial082.stdout:634: snap_create 2026-02-12T17:31:17.656 INFO:tasks.rados.rados.0.trial082.stdout:633: finishing copy_from racing read to trial08226312-8 2026-02-12T17:31:17.656 INFO:tasks.rados.rados.0.trial082.stdout:633: finishing copy_from to trial08226312-8 2026-02-12T17:31:17.657 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 15 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:31:18.634 INFO:tasks.rados.rados.0.trial082.stdout:633: done (1 left) 2026-02-12T17:31:18.634 INFO:tasks.rados.rados.0.trial082.stdout:634: done (0 left) 2026-02-12T17:31:18.634 INFO:tasks.rados.rados.0.trial082.stdout:635: snap_remove snap 63 2026-02-12T17:31:19.636 INFO:tasks.rados.rados.0.trial082.stdout:635: done (0 left) 2026-02-12T17:31:19.636 INFO:tasks.rados.rados.0.trial082.stdout:636: read oid 36 snap -1 2026-02-12T17:31:19.636 INFO:tasks.rados.rados.0.trial082.stdout:636: expect (ObjNum 244 snap 68 seq_num 244) 2026-02-12T17:31:19.636 INFO:tasks.rados.rados.0.trial082.stdout:637: copy_from oid 3 from oid 30 current snap is 69 2026-02-12T17:31:19.636 INFO:tasks.rados.rados.0.trial082.stdout:638: read oid 46 snap -1 2026-02-12T17:31:19.636 INFO:tasks.rados.rados.0.trial082.stdout:638: expect (ObjNum 227 snap 61 seq_num 227) 2026-02-12T17:31:19.636 INFO:tasks.rados.rados.0.trial082.stdout:639: snap_remove snap 65 2026-02-12T17:31:20.636 INFO:tasks.rados.rados.0.trial082.stdout:639: done (3 left) 2026-02-12T17:31:20.636 INFO:tasks.rados.rados.0.trial082.stdout:640: snap_create 2026-02-12T17:31:20.636 INFO:tasks.rados.rados.0.trial082.stdout:636: expect (ObjNum 244 snap 68 seq_num 244) 2026-02-12T17:31:20.674 INFO:tasks.rados.rados.0.trial082.stdout:638: expect (ObjNum 227 snap 61 seq_num 227) 2026-02-12T17:31:20.674 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:20.747 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3040378 2026-02-12T17:31:20.780 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2340897 2026-02-12T17:31:20.804 INFO:tasks.rados.rados.0.trial082.stdout:637: finishing copy_from racing read to trial08226312-3 2026-02-12T17:31:20.804 INFO:tasks.rados.rados.0.trial082.stdout:637: finishing copy_from to trial08226312-3 2026-02-12T17:31:20.804 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 274 (ObjNum 239 snap 65 seq_num 239) dirty exists 2026-02-12T17:31:21.637 INFO:tasks.rados.rados.0.trial082.stdout:636: done (3 left) 2026-02-12T17:31:21.637 INFO:tasks.rados.rados.0.trial082.stdout:637: done (2 left) 2026-02-12T17:31:21.638 INFO:tasks.rados.rados.0.trial082.stdout:638: done (1 left) 2026-02-12T17:31:21.638 INFO:tasks.rados.rados.0.trial082.stdout:640: done (0 left) 2026-02-12T17:31:21.638 INFO:tasks.rados.rados.0.trial082.stdout:641: snap_remove snap 68 2026-02-12T17:31:22.637 INFO:tasks.rados.rados.0.trial082.stdout:641: done (0 left) 2026-02-12T17:31:22.638 INFO:tasks.rados.rados.0.trial082.stdout:642: snap_remove snap 67 2026-02-12T17:31:24.434 INFO:tasks.rados.rados.0.trial082.stdout:642: done (0 left) 2026-02-12T17:31:24.434 INFO:tasks.rados.rados.0.trial082.stdout:643: rollback oid 11 current snap is 70 2026-02-12T17:31:24.434 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 69 2026-02-12T17:31:24.434 INFO:tasks.rados.rados.0.trial082.stdout:644: write oid 26 current snap is 70 2026-02-12T17:31:24.434 INFO:tasks.rados.rados.0.trial082.stdout:644: seq_num 248 ranges {568136=785048,1929299=238837} 2026-02-12T17:31:24.439 INFO:tasks.rados.rados.0.trial082.stdout:644: writing trial08226312-26 from 568136 to 1353184 tid 1 2026-02-12T17:31:24.443 INFO:tasks.rados.rados.0.trial082.stdout:644: writing trial08226312-26 from 1929299 to 2168136 tid 2 2026-02-12T17:31:24.443 INFO:tasks.rados.rados.0.trial082.stdout:645: delete oid 1 current snap is 70 2026-02-12T17:31:24.443 INFO:tasks.rados.rados.0.trial082.stdout:643: finishing rollback tid 0 to trial08226312-11 2026-02-12T17:31:24.443 INFO:tasks.rados.rados.0.trial082.stdout:643: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:31:24.443 INFO:tasks.rados.rados.0.trial082.stdout:643: finishing rollback tid 2 to trial08226312-11 2026-02-12T17:31:24.443 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 156 (ObjNum 238 snap 63 seq_num 238) dirty exists 2026-02-12T17:31:24.443 INFO:tasks.rados.rados.0.trial082.stdout:644: finishing write tid 1 to trial08226312-26 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:643: done (2 left) 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:645: done (1 left) 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:646: read oid 19 snap 66 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:646: expect (ObjNum 148 snap 36 seq_num 148) 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:647: read oid 35 snap -1 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:647: expect (ObjNum 235 snap 63 seq_num 235) 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:648: copy_from oid 5 from oid 49 current snap is 70 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:649: read oid 36 snap 64 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:649: expect (ObjNum 177 snap 43 seq_num 177) 2026-02-12T17:31:24.445 INFO:tasks.rados.rados.0.trial082.stdout:650: read oid 9 snap -1 2026-02-12T17:31:24.446 INFO:tasks.rados.rados.0.trial082.stdout:650: expect (ObjNum 182 snap 46 seq_num 182) 2026-02-12T17:31:24.446 INFO:tasks.rados.rados.0.trial082.stdout:651: snap_create 2026-02-12T17:31:24.446 INFO:tasks.rados.rados.0.trial082.stdout:644: finishing write tid 2 to trial08226312-26 2026-02-12T17:31:24.446 INFO:tasks.rados.rados.0.trial082.stdout:646: expect (ObjNum 148 snap 36 seq_num 148) 2026-02-12T17:31:24.446 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:24.478 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 194865 2026-02-12T17:31:24.540 INFO:tasks.rados.rados.0.trial082.stdout:644: finishing write tid 3 to trial08226312-26 2026-02-12T17:31:24.540 INFO:tasks.rados.rados.0.trial082.stdout:644: finishing write tid 4 to trial08226312-26 2026-02-12T17:31:24.540 INFO:tasks.rados.rados.0.trial082.stdout:644: oid 26 updating version 0 to 316 2026-02-12T17:31:24.541 INFO:tasks.rados.rados.0.trial082.stdout:644: oid 26 version 316 is already newer than 315 2026-02-12T17:31:24.541 INFO:tasks.rados.rados.0.trial082.stdout:644: oid 26 updating version 316 to 317 2026-02-12T17:31:24.541 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 317 (ObjNum 248 snap 70 seq_num 248) dirty exists 2026-02-12T17:31:24.541 INFO:tasks.rados.rados.0.trial082.stdout:644: left oid 26 (ObjNum 248 snap 70 seq_num 248) 2026-02-12T17:31:24.541 INFO:tasks.rados.rados.0.trial082.stdout:647: expect (ObjNum 235 snap 63 seq_num 235) 2026-02-12T17:31:24.541 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:24.595 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:24.622 INFO:tasks.rados.rados.0.trial082.stdout:650: expect (ObjNum 182 snap 46 seq_num 182) 2026-02-12T17:31:24.622 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:24.663 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:24.742 INFO:tasks.rados.rados.0.trial082.stdout:648: finishing copy_from racing read to trial08226312-5 2026-02-12T17:31:24.742 INFO:tasks.rados.rados.0.trial082.stdout:648: finishing copy_from to trial08226312-5 2026-02-12T17:31:24.742 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 124 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:31:24.742 INFO:tasks.rados.rados.0.trial082.stdout:649: expect (ObjNum 177 snap 43 seq_num 177) 2026-02-12T17:31:24.742 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:24.817 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:25.435 INFO:tasks.rados.rados.0.trial082.stdout:644: done (6 left) 2026-02-12T17:31:25.435 INFO:tasks.rados.rados.0.trial082.stdout:646: done (5 left) 2026-02-12T17:31:25.436 INFO:tasks.rados.rados.0.trial082.stdout:647: done (4 left) 2026-02-12T17:31:25.436 INFO:tasks.rados.rados.0.trial082.stdout:648: done (3 left) 2026-02-12T17:31:25.436 INFO:tasks.rados.rados.0.trial082.stdout:649: done (2 left) 2026-02-12T17:31:25.436 INFO:tasks.rados.rados.0.trial082.stdout:650: done (1 left) 2026-02-12T17:31:25.436 INFO:tasks.rados.rados.0.trial082.stdout:651: done (0 left) 2026-02-12T17:31:25.436 INFO:tasks.rados.rados.0.trial082.stdout:652: read oid 9 snap -1 2026-02-12T17:31:25.436 INFO:tasks.rados.rados.0.trial082.stdout:652: expect (ObjNum 182 snap 46 seq_num 182) 2026-02-12T17:31:25.436 INFO:tasks.rados.rados.0.trial082.stdout:653: snap_create 2026-02-12T17:31:25.437 INFO:tasks.rados.rados.0.trial082.stdout:652: expect (ObjNum 182 snap 46 seq_num 182) 2026-02-12T17:31:26.436 INFO:tasks.rados.rados.0.trial082.stdout:652: done (1 left) 2026-02-12T17:31:26.436 INFO:tasks.rados.rados.0.trial082.stdout:653: done (0 left) 2026-02-12T17:31:26.436 INFO:tasks.rados.rados.0.trial082.stdout:654: read oid 20 snap 66 2026-02-12T17:31:26.436 INFO:tasks.rados.rados.0.trial082.stdout:654: expect (ObjNum 210 snap 58 seq_num 210) 2026-02-12T17:31:26.436 INFO:tasks.rados.rados.0.trial082.stdout:655: read oid 46 snap -1 2026-02-12T17:31:26.436 INFO:tasks.rados.rados.0.trial082.stdout:655: expect (ObjNum 227 snap 61 seq_num 227) 2026-02-12T17:31:26.437 INFO:tasks.rados.rados.0.trial082.stdout:656: delete oid 24 current snap is 72 2026-02-12T17:31:26.441 INFO:tasks.rados.rados.0.trial082.stdout:655: expect (ObjNum 227 snap 61 seq_num 227) 2026-02-12T17:31:26.554 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2231716 2026-02-12T17:31:26.578 INFO:tasks.rados.rados.0.trial082.stdout:654: expect (ObjNum 210 snap 58 seq_num 210) 2026-02-12T17:31:26.653 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:26.691 INFO:tasks.rados.rados.0.trial082.stdout:654: done (2 left) 2026-02-12T17:31:26.691 INFO:tasks.rados.rados.0.trial082.stdout:655: done (1 left) 2026-02-12T17:31:26.692 INFO:tasks.rados.rados.0.trial082.stdout:656: done (0 left) 2026-02-12T17:31:26.692 INFO:tasks.rados.rados.0.trial082.stdout:657: write (excl) oid 22 current snap is 72 2026-02-12T17:31:26.692 INFO:tasks.rados.rados.0.trial082.stdout:657: seq_num 251 ranges {618557=727148,2104745=113812} 2026-02-12T17:31:26.697 INFO:tasks.rados.rados.0.trial082.stdout:657: writing trial08226312-22 from 618557 to 1345705 tid 1 2026-02-12T17:31:26.700 INFO:tasks.rados.rados.0.trial082.stdout:657: writing trial08226312-22 from 2104745 to 2218557 tid 2 2026-02-12T17:31:26.700 INFO:tasks.rados.rados.0.trial082.stdout:658: snap_create 2026-02-12T17:31:26.701 INFO:tasks.rados.rados.0.trial082.stdout:657: finishing write tid 1 to trial08226312-22 2026-02-12T17:31:26.701 INFO:tasks.rados.rados.0.trial082.stdout:657: finishing write tid 2 to trial08226312-22 2026-02-12T17:31:26.702 INFO:tasks.rados.rados.0.trial082.stdout:657: finishing write tid 3 to trial08226312-22 2026-02-12T17:31:26.702 INFO:tasks.rados.rados.0.trial082.stdout:657: finishing write tid 4 to trial08226312-22 2026-02-12T17:31:26.702 INFO:tasks.rados.rados.0.trial082.stdout:657: oid 22 updating version 0 to 276 2026-02-12T17:31:26.702 INFO:tasks.rados.rados.0.trial082.stdout:657: oid 22 updating version 276 to 277 2026-02-12T17:31:26.702 INFO:tasks.rados.rados.0.trial082.stdout:657: oid 22 version 277 is already newer than 275 2026-02-12T17:31:26.702 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 277 (ObjNum 251 snap 72 seq_num 251) dirty exists 2026-02-12T17:31:26.702 INFO:tasks.rados.rados.0.trial082.stdout:657: left oid 22 (ObjNum 251 snap 72 seq_num 251) 2026-02-12T17:31:27.439 INFO:tasks.rados.rados.0.trial082.stdout:657: done (1 left) 2026-02-12T17:31:27.440 INFO:tasks.rados.rados.0.trial082.stdout:658: done (0 left) 2026-02-12T17:31:27.440 INFO:tasks.rados.rados.0.trial082.stdout:659: snap_create 2026-02-12T17:31:27.632 INFO:tasks.rados.rados.0.trial082.stdout:659: done (0 left) 2026-02-12T17:31:27.632 INFO:tasks.rados.rados.0.trial082.stdout:660: copy_from oid 32 from oid 29 current snap is 74 2026-02-12T17:31:27.632 INFO:tasks.rados.rados.0.trial082.stdout:661: write (excl) oid 19 current snap is 74 2026-02-12T17:31:27.632 INFO:tasks.rados.rados.0.trial082.stdout:661: seq_num 252 ranges {635364=402397,1763227=472137} 2026-02-12T17:31:27.636 INFO:tasks.rados.rados.0.trial082.stdout:661: writing trial08226312-19 from 635364 to 1037761 tid 1 2026-02-12T17:31:27.641 INFO:tasks.rados.rados.0.trial082.stdout:661: writing trial08226312-19 from 1763227 to 2235364 tid 2 2026-02-12T17:31:27.641 INFO:tasks.rados.rados.0.trial082.stdout:662: rollback oid 50 current snap is 74 2026-02-12T17:31:27.641 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 69 2026-02-12T17:31:27.641 INFO:tasks.rados.rados.0.trial082.stdout:663: read oid 25 snap -1 2026-02-12T17:31:27.641 INFO:tasks.rados.rados.0.trial082.stdout:663: expect (ObjNum 204 snap 55 seq_num 204) 2026-02-12T17:31:27.641 INFO:tasks.rados.rados.0.trial082.stdout:664: write oid 16 current snap is 74 2026-02-12T17:31:27.642 INFO:tasks.rados.rados.0.trial082.stdout:664: seq_num 253 ranges {652171=477646,1821709=430462} 2026-02-12T17:31:27.645 INFO:tasks.rados.rados.0.trial082.stdout:664: writing trial08226312-16 from 652171 to 1129817 tid 1 2026-02-12T17:31:27.649 INFO:tasks.rados.rados.0.trial082.stdout:664: writing trial08226312-16 from 1821709 to 2252171 tid 2 2026-02-12T17:31:27.650 INFO:tasks.rados.rados.0.trial082.stdout:665: write oid 2 current snap is 74 2026-02-12T17:31:27.650 INFO:tasks.rados.rados.0.trial082.stdout:665: seq_num 254 ranges {668978=552895,1763838=505140} 2026-02-12T17:31:27.654 INFO:tasks.rados.rados.0.trial082.stdout:665: writing trial08226312-2 from 668978 to 1221873 tid 1 2026-02-12T17:31:27.658 INFO:tasks.rados.rados.0.trial082.stdout:665: writing trial08226312-2 from 1763838 to 2268978 tid 2 2026-02-12T17:31:27.658 INFO:tasks.rados.rados.0.trial082.stdout:666: write oid 12 current snap is 74 2026-02-12T17:31:27.658 INFO:tasks.rados.rados.0.trial082.stdout:666: seq_num 255 ranges {685785=628144,1822320=463465} 2026-02-12T17:31:27.663 INFO:tasks.rados.rados.0.trial082.stdout:666: writing trial08226312-12 from 685785 to 1313929 tid 1 2026-02-12T17:31:27.667 INFO:tasks.rados.rados.0.trial082.stdout:666: writing trial08226312-12 from 1822320 to 2285785 tid 2 2026-02-12T17:31:27.667 INFO:tasks.rados.rados.0.trial082.stdout:667: rollback oid 4 current snap is 74 2026-02-12T17:31:27.667 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 4 to 73 2026-02-12T17:31:27.667 INFO:tasks.rados.rados.0.trial082.stdout:660: finishing copy_from racing read to trial08226312-32 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:661: finishing write tid 1 to trial08226312-19 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:660: finishing copy_from to trial08226312-32 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 98 (ObjNum 226 snap 61 seq_num 226) dirty exists 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:661: finishing write tid 2 to trial08226312-19 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:661: finishing write tid 3 to trial08226312-19 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:661: finishing write tid 4 to trial08226312-19 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:661: oid 19 updating version 0 to 367 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:661: oid 19 updating version 367 to 368 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:661: oid 19 updating version 368 to 369 2026-02-12T17:31:27.668 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 369 (ObjNum 252 snap 74 seq_num 252) dirty exists 2026-02-12T17:31:27.669 INFO:tasks.rados.rados.0.trial082.stdout:661: left oid 19 (ObjNum 252 snap 74 seq_num 252) 2026-02-12T17:31:27.669 INFO:tasks.rados.rados.0.trial082.stdout:662: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:31:27.669 INFO:tasks.rados.rados.0.trial082.stdout:668: read oid 11 snap -1 2026-02-12T17:31:27.669 INFO:tasks.rados.rados.0.trial082.stdout:668: expect (ObjNum 238 snap 63 seq_num 238) 2026-02-12T17:31:27.669 INFO:tasks.rados.rados.0.trial082.stdout:660: done (8 left) 2026-02-12T17:31:27.669 INFO:tasks.rados.rados.0.trial082.stdout:661: done (7 left) 2026-02-12T17:31:27.669 INFO:tasks.rados.rados.0.trial082.stdout:669: snap_remove snap 64 2026-02-12T17:31:28.636 INFO:tasks.rados.rados.0.trial082.stdout:669: done (7 left) 2026-02-12T17:31:28.636 INFO:tasks.rados.rados.0.trial082.stdout:670: write oid 8 current snap is 74 2026-02-12T17:31:28.636 INFO:tasks.rados.rados.0.trial082.stdout:670: seq_num 256 ranges {702592=703393,1880802=421790} 2026-02-12T17:31:28.641 INFO:tasks.rados.rados.0.trial082.stdout:670: writing trial08226312-8 from 702592 to 1405985 tid 1 2026-02-12T17:31:28.645 INFO:tasks.rados.rados.0.trial082.stdout:670: writing trial08226312-8 from 1880802 to 2302592 tid 2 2026-02-12T17:31:28.645 INFO:tasks.rados.rados.0.trial082.stdout:671: write oid 38 current snap is 74 2026-02-12T17:31:28.645 INFO:tasks.rados.rados.0.trial082.stdout:671: seq_num 257 ranges {719399=778642,1939284=380115} 2026-02-12T17:31:28.650 INFO:tasks.rados.rados.0.trial082.stdout:671: writing trial08226312-38 from 719399 to 1498041 tid 1 2026-02-12T17:31:28.654 INFO:tasks.rados.rados.0.trial082.stdout:671: writing trial08226312-38 from 1939284 to 2319399 tid 2 2026-02-12T17:31:28.654 INFO:tasks.rados.rados.0.trial082.stdout:672: rollback oid 32 current snap is 74 2026-02-12T17:31:28.654 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 73 2026-02-12T17:31:28.654 INFO:tasks.rados.rados.0.trial082.stdout:662: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:31:28.654 INFO:tasks.rados.rados.0.trial082.stdout:662: finishing rollback tid 2 to trial08226312-50 2026-02-12T17:31:28.654 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 121 (ObjNum 193 snap 51 seq_num 193) dirty exists 2026-02-12T17:31:28.655 INFO:tasks.rados.rados.0.trial082.stdout:662: done (9 left) 2026-02-12T17:31:28.655 INFO:tasks.rados.rados.0.trial082.stdout:673: write (excl) oid 22 current snap is 74 2026-02-12T17:31:28.655 INFO:tasks.rados.rados.0.trial082.stdout:673: seq_num 258 ranges {736206=453891,1881413=454793} 2026-02-12T17:31:28.658 INFO:tasks.rados.rados.0.trial082.stdout:673: writing trial08226312-22 from 736206 to 1190097 tid 1 2026-02-12T17:31:28.662 INFO:tasks.rados.rados.0.trial082.stdout:673: writing trial08226312-22 from 1881413 to 2336206 tid 2 2026-02-12T17:31:28.662 INFO:tasks.rados.rados.0.trial082.stdout:674: write (excl) oid 15 current snap is 74 2026-02-12T17:31:28.663 INFO:tasks.rados.rados.0.trial082.stdout:674: seq_num 259 ranges {753013=645493,2056248=296765} 2026-02-12T17:31:28.667 INFO:tasks.rados.rados.0.trial082.stdout:674: writing trial08226312-15 from 753013 to 1398506 tid 1 2026-02-12T17:31:28.671 INFO:tasks.rados.rados.0.trial082.stdout:674: writing trial08226312-15 from 2056248 to 2353013 tid 2 2026-02-12T17:31:28.671 INFO:tasks.rados.rados.0.trial082.stdout:675: write (excl) oid 39 current snap is 74 2026-02-12T17:31:28.671 INFO:tasks.rados.rados.0.trial082.stdout:675: seq_num 260 ranges {769820=720742,2114730=255090} 2026-02-12T17:31:28.677 INFO:tasks.rados.rados.0.trial082.stdout:675: writing trial08226312-39 from 769820 to 1490562 tid 1 2026-02-12T17:31:28.680 INFO:tasks.rados.rados.0.trial082.stdout:675: writing trial08226312-39 from 2114730 to 2369820 tid 2 2026-02-12T17:31:28.680 INFO:tasks.rados.rados.0.trial082.stdout:676: read oid 43 snap 69 2026-02-12T17:31:28.681 INFO:tasks.rados.rados.0.trial082.stdout:676: expect (ObjNum 148 snap 36 seq_num 148) 2026-02-12T17:31:28.681 INFO:tasks.rados.rados.0.trial082.stdout:677: read oid 28 snap 70 2026-02-12T17:31:28.681 INFO:tasks.rados.rados.0.trial082.stdout:677: expect (ObjNum 205 snap 55 seq_num 205) 2026-02-12T17:31:28.681 INFO:tasks.rados.rados.0.trial082.stdout:678: copy_from oid 42 from oid 3 current snap is 74 2026-02-12T17:31:28.681 INFO:tasks.rados.rados.0.trial082.stdout:663: expect (ObjNum 204 snap 55 seq_num 204) 2026-02-12T17:31:28.699 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3411148 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:664: finishing write tid 1 to trial08226312-16 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:664: finishing write tid 2 to trial08226312-16 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:664: finishing write tid 3 to trial08226312-16 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:664: finishing write tid 4 to trial08226312-16 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:664: oid 16 updating version 0 to 373 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:664: oid 16 updating version 373 to 375 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:664: oid 16 version 375 is already newer than 374 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 375 (ObjNum 253 snap 74 seq_num 253) dirty exists 2026-02-12T17:31:28.737 INFO:tasks.rados.rados.0.trial082.stdout:664: left oid 16 (ObjNum 253 snap 74 seq_num 253) 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:665: finishing write tid 1 to trial08226312-2 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:665: finishing write tid 2 to trial08226312-2 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:665: finishing write tid 3 to trial08226312-2 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:665: finishing write tid 4 to trial08226312-2 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:665: oid 2 updating version 0 to 250 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:665: oid 2 version 250 is already newer than 249 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:665: oid 2 updating version 250 to 251 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 251 (ObjNum 254 snap 74 seq_num 254) dirty exists 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:665: left oid 2 (ObjNum 254 snap 74 seq_num 254) 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:666: finishing write tid 1 to trial08226312-12 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:667: finishing rollback tid 0 to trial08226312-4 2026-02-12T17:31:28.738 INFO:tasks.rados.rados.0.trial082.stdout:667: finishing rollback tid 1 to trial08226312-4 2026-02-12T17:31:28.739 INFO:tasks.rados.rados.0.trial082.stdout:667: finishing rollback tid 2 to trial08226312-4 2026-02-12T17:31:28.739 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 373 (ObjNum 58 snap 2 seq_num 58) dirty exists 2026-02-12T17:31:28.739 INFO:tasks.rados.rados.0.trial082.stdout:668: expect (ObjNum 238 snap 63 seq_num 238) 2026-02-12T17:31:28.753 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 565245 2026-02-12T17:31:28.776 INFO:tasks.rados.rados.0.trial082.stdout:666: finishing write tid 2 to trial08226312-12 2026-02-12T17:31:28.776 INFO:tasks.rados.rados.0.trial082.stdout:666: finishing write tid 3 to trial08226312-12 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:663: done (14 left) 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:664: done (13 left) 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:665: done (12 left) 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:667: done (11 left) 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:668: done (10 left) 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:679: snap_create 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:666: finishing write tid 4 to trial08226312-12 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:666: oid 12 updating version 0 to 221 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:666: oid 12 version 221 is already newer than 219 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:666: oid 12 version 221 is already newer than 220 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 221 (ObjNum 255 snap 74 seq_num 255) dirty exists 2026-02-12T17:31:28.777 INFO:tasks.rados.rados.0.trial082.stdout:666: left oid 12 (ObjNum 255 snap 74 seq_num 255) 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:670: finishing write tid 1 to trial08226312-8 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:670: finishing write tid 2 to trial08226312-8 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:670: finishing write tid 3 to trial08226312-8 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:670: finishing write tid 4 to trial08226312-8 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:670: oid 8 updating version 0 to 385 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:670: oid 8 updating version 385 to 386 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:670: oid 8 updating version 386 to 387 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 387 (ObjNum 256 snap 74 seq_num 256) dirty exists 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:670: left oid 8 (ObjNum 256 snap 74 seq_num 256) 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:671: finishing write tid 1 to trial08226312-38 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:671: finishing write tid 2 to trial08226312-38 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:671: finishing write tid 3 to trial08226312-38 2026-02-12T17:31:28.778 INFO:tasks.rados.rados.0.trial082.stdout:671: finishing write tid 4 to trial08226312-38 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:671: oid 38 updating version 0 to 177 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:671: oid 38 updating version 177 to 178 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:671: oid 38 version 178 is already newer than 176 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 178 (ObjNum 257 snap 74 seq_num 257) dirty exists 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:671: left oid 38 (ObjNum 257 snap 74 seq_num 257) 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:672: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:672: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:672: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 181 (ObjNum 245 snap 68 seq_num 245) dirty exists 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:673: finishing write tid 1 to trial08226312-22 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:673: finishing write tid 2 to trial08226312-22 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:673: finishing write tid 3 to trial08226312-22 2026-02-12T17:31:28.779 INFO:tasks.rados.rados.0.trial082.stdout:673: finishing write tid 4 to trial08226312-22 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:673: oid 22 updating version 0 to 282 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:673: oid 22 version 282 is already newer than 281 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:673: oid 22 version 282 is already newer than 280 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 282 (ObjNum 258 snap 74 seq_num 258) dirty exists 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:673: left oid 22 (ObjNum 258 snap 74 seq_num 258) 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:674: finishing write tid 1 to trial08226312-15 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:674: finishing write tid 2 to trial08226312-15 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:674: finishing write tid 3 to trial08226312-15 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:674: finishing write tid 4 to trial08226312-15 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:674: oid 15 updating version 0 to 276 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:674: oid 15 version 276 is already newer than 275 2026-02-12T17:31:28.780 INFO:tasks.rados.rados.0.trial082.stdout:674: oid 15 updating version 276 to 277 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 277 (ObjNum 259 snap 74 seq_num 259) dirty exists 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:674: left oid 15 (ObjNum 259 snap 74 seq_num 259) 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:675: finishing write tid 1 to trial08226312-39 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:675: finishing write tid 2 to trial08226312-39 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:675: finishing write tid 3 to trial08226312-39 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:675: finishing write tid 4 to trial08226312-39 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:675: oid 39 updating version 0 to 253 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:675: oid 39 version 253 is already newer than 252 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:675: oid 39 updating version 253 to 254 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 254 (ObjNum 260 snap 74 seq_num 260) dirty exists 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:675: left oid 39 (ObjNum 260 snap 74 seq_num 260) 2026-02-12T17:31:28.781 INFO:tasks.rados.rados.0.trial082.stdout:677: expect (ObjNum 205 snap 55 seq_num 205) 2026-02-12T17:31:28.862 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:28.905 INFO:tasks.rados.rados.0.trial082.stdout:676: expect (ObjNum 148 snap 36 seq_num 148) 2026-02-12T17:31:28.925 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2211811 2026-02-12T17:31:28.941 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1428964 2026-02-12T17:31:28.956 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:28.987 INFO:tasks.rados.rados.0.trial082.stdout:678: finishing copy_from racing read to trial08226312-42 2026-02-12T17:31:28.988 INFO:tasks.rados.rados.0.trial082.stdout:678: finishing copy_from to trial08226312-42 2026-02-12T17:31:28.988 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 274 (ObjNum 239 snap 65 seq_num 239) dirty exists 2026-02-12T17:31:29.640 INFO:tasks.rados.rados.0.trial082.stdout:666: done (10 left) 2026-02-12T17:31:29.640 INFO:tasks.rados.rados.0.trial082.stdout:670: done (9 left) 2026-02-12T17:31:29.640 INFO:tasks.rados.rados.0.trial082.stdout:671: done (8 left) 2026-02-12T17:31:29.640 INFO:tasks.rados.rados.0.trial082.stdout:672: done (7 left) 2026-02-12T17:31:29.640 INFO:tasks.rados.rados.0.trial082.stdout:673: done (6 left) 2026-02-12T17:31:29.640 INFO:tasks.rados.rados.0.trial082.stdout:674: done (5 left) 2026-02-12T17:31:29.640 INFO:tasks.rados.rados.0.trial082.stdout:675: done (4 left) 2026-02-12T17:31:29.641 INFO:tasks.rados.rados.0.trial082.stdout:676: done (3 left) 2026-02-12T17:31:29.641 INFO:tasks.rados.rados.0.trial082.stdout:677: done (2 left) 2026-02-12T17:31:29.641 INFO:tasks.rados.rados.0.trial082.stdout:678: done (1 left) 2026-02-12T17:31:29.641 INFO:tasks.rados.rados.0.trial082.stdout:679: done (0 left) 2026-02-12T17:31:29.641 INFO:tasks.rados.rados.0.trial082.stdout:680: snap_create 2026-02-12T17:31:30.640 INFO:tasks.rados.rados.0.trial082.stdout:680: done (0 left) 2026-02-12T17:31:30.640 INFO:tasks.rados.rados.0.trial082.stdout:681: write (excl) oid 3 current snap is 76 2026-02-12T17:31:30.641 INFO:tasks.rados.rados.0.trial082.stdout:681: seq_num 261 ranges {786627=795991,2173212=213415} 2026-02-12T17:31:30.646 INFO:tasks.rados.rados.0.trial082.stdout:681: writing trial08226312-3 from 786627 to 1582618 tid 1 2026-02-12T17:31:30.649 INFO:tasks.rados.rados.0.trial082.stdout:681: writing trial08226312-3 from 2173212 to 2386627 tid 2 2026-02-12T17:31:30.649 INFO:tasks.rados.rados.0.trial082.stdout:682: copy_from oid 4 from oid 47 current snap is 76 2026-02-12T17:31:30.649 INFO:tasks.rados.rados.0.trial082.stdout:683: rollback oid 50 current snap is 76 2026-02-12T17:31:30.649 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 75 2026-02-12T17:31:30.649 INFO:tasks.rados.rados.0.trial082.stdout:684: write (excl) oid 9 current snap is 76 2026-02-12T17:31:30.649 INFO:tasks.rados.rados.0.trial082.stdout:684: seq_num 262 ranges {403434=471240,1315341=400756} 2026-02-12T17:31:30.652 INFO:tasks.rados.rados.0.trial082.stdout:684: writing trial08226312-9 from 403434 to 874674 tid 1 2026-02-12T17:31:30.655 INFO:tasks.rados.rados.0.trial082.stdout:684: writing trial08226312-9 from 1315341 to 1716097 tid 2 2026-02-12T17:31:30.655 INFO:tasks.rados.rados.0.trial082.stdout:685: write (excl) oid 34 current snap is 76 2026-02-12T17:31:30.655 INFO:tasks.rados.rados.0.trial082.stdout:685: seq_num 263 ranges {420241=546489,1373823=544414} 2026-02-12T17:31:30.659 INFO:tasks.rados.rados.0.trial082.stdout:685: writing trial08226312-34 from 420241 to 966730 tid 1 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:685: writing trial08226312-34 from 1373823 to 1918237 tid 2 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:686: snap_create 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:681: finishing write tid 1 to trial08226312-3 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:681: finishing write tid 2 to trial08226312-3 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:681: finishing write tid 3 to trial08226312-3 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:681: finishing write tid 4 to trial08226312-3 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:681: oid 3 updating version 0 to 279 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:681: oid 3 version 279 is already newer than 278 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:681: oid 3 updating version 279 to 280 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 280 (ObjNum 261 snap 76 seq_num 261) dirty exists 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:681: left oid 3 (ObjNum 261 snap 76 seq_num 261) 2026-02-12T17:31:30.663 INFO:tasks.rados.rados.0.trial082.stdout:683: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:683: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:683: finishing rollback tid 2 to trial08226312-50 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 127 (ObjNum 193 snap 51 seq_num 193) dirty exists 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:684: finishing write tid 1 to trial08226312-9 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:684: finishing write tid 2 to trial08226312-9 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:684: finishing write tid 3 to trial08226312-9 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:684: finishing write tid 4 to trial08226312-9 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:684: oid 9 updating version 0 to 379 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:684: oid 9 updating version 379 to 380 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:684: oid 9 updating version 380 to 381 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 381 (ObjNum 262 snap 76 seq_num 262) dirty exists 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:684: left oid 9 (ObjNum 262 snap 76 seq_num 262) 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:682: finishing copy_from racing read to trial08226312-4 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:682: finishing copy_from to trial08226312-4 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 352 (ObjNum 232 snap 63 seq_num 232) dirty exists 2026-02-12T17:31:30.664 INFO:tasks.rados.rados.0.trial082.stdout:685: finishing write tid 1 to trial08226312-34 2026-02-12T17:31:30.665 INFO:tasks.rados.rados.0.trial082.stdout:685: finishing write tid 2 to trial08226312-34 2026-02-12T17:31:30.665 INFO:tasks.rados.rados.0.trial082.stdout:685: finishing write tid 3 to trial08226312-34 2026-02-12T17:31:30.665 INFO:tasks.rados.rados.0.trial082.stdout:685: finishing write tid 4 to trial08226312-34 2026-02-12T17:31:30.665 INFO:tasks.rados.rados.0.trial082.stdout:685: oid 34 updating version 0 to 184 2026-02-12T17:31:30.665 INFO:tasks.rados.rados.0.trial082.stdout:685: oid 34 updating version 184 to 185 2026-02-12T17:31:30.665 INFO:tasks.rados.rados.0.trial082.stdout:685: oid 34 version 185 is already newer than 183 2026-02-12T17:31:30.665 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 185 (ObjNum 263 snap 76 seq_num 263) dirty exists 2026-02-12T17:31:30.665 INFO:tasks.rados.rados.0.trial082.stdout:685: left oid 34 (ObjNum 263 snap 76 seq_num 263) 2026-02-12T17:31:31.646 INFO:tasks.rados.rados.0.trial082.stdout:681: done (5 left) 2026-02-12T17:31:31.646 INFO:tasks.rados.rados.0.trial082.stdout:682: done (4 left) 2026-02-12T17:31:31.646 INFO:tasks.rados.rados.0.trial082.stdout:683: done (3 left) 2026-02-12T17:31:31.646 INFO:tasks.rados.rados.0.trial082.stdout:684: done (2 left) 2026-02-12T17:31:31.646 INFO:tasks.rados.rados.0.trial082.stdout:685: done (1 left) 2026-02-12T17:31:31.646 INFO:tasks.rados.rados.0.trial082.stdout:686: done (0 left) 2026-02-12T17:31:31.646 INFO:tasks.rados.rados.0.trial082.stdout:687: snap_remove snap 66 2026-02-12T17:31:32.647 INFO:tasks.rados.rados.0.trial082.stdout:687: done (0 left) 2026-02-12T17:31:32.647 INFO:tasks.rados.rados.0.trial082.stdout:688: snap_create 2026-02-12T17:31:33.648 INFO:tasks.rados.rados.0.trial082.stdout:688: done (0 left) 2026-02-12T17:31:33.648 INFO:tasks.rados.rados.0.trial082.stdout:689: write oid 35 current snap is 78 2026-02-12T17:31:33.648 INFO:tasks.rados.rados.0.trial082.stdout:689: seq_num 264 ranges {437048=621738,1832305=404425} 2026-02-12T17:31:33.652 INFO:tasks.rados.rados.0.trial082.stdout:689: writing trial08226312-35 from 437048 to 1058786 tid 1 2026-02-12T17:31:33.656 INFO:tasks.rados.rados.0.trial082.stdout:689: writing trial08226312-35 from 1832305 to 2236730 tid 2 2026-02-12T17:31:33.656 INFO:tasks.rados.rados.0.trial082.stdout:690: rollback oid 18 current snap is 78 2026-02-12T17:31:33.656 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 73 2026-02-12T17:31:33.657 INFO:tasks.rados.rados.0.trial082.stdout:691: write oid 25 current snap is 78 2026-02-12T17:31:33.657 INFO:tasks.rados.rados.0.trial082.stdout:691: seq_num 265 ranges {453855=696987,1890787=548083} 2026-02-12T17:31:33.660 INFO:tasks.rados.rados.0.trial082.stdout:691: writing trial08226312-25 from 453855 to 1150842 tid 1 2026-02-12T17:31:33.665 INFO:tasks.rados.rados.0.trial082.stdout:691: writing trial08226312-25 from 1890787 to 2438870 tid 2 2026-02-12T17:31:33.665 INFO:tasks.rados.rados.0.trial082.stdout:692: snap_create 2026-02-12T17:31:33.665 INFO:tasks.rados.rados.0.trial082.stdout:690: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:31:33.666 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 0 (ObjNum 129 snap 0 seq_num 26767014) dirty dne 2026-02-12T17:31:33.666 INFO:tasks.rados.rados.0.trial082.stdout:691: finishing write tid 1 to trial08226312-25 2026-02-12T17:31:33.666 INFO:tasks.rados.rados.0.trial082.stdout:689: finishing write tid 1 to trial08226312-35 2026-02-12T17:31:33.666 INFO:tasks.rados.rados.0.trial082.stdout:689: finishing write tid 2 to trial08226312-35 2026-02-12T17:31:33.667 INFO:tasks.rados.rados.0.trial082.stdout:689: finishing write tid 3 to trial08226312-35 2026-02-12T17:31:33.667 INFO:tasks.rados.rados.0.trial082.stdout:689: finishing write tid 4 to trial08226312-35 2026-02-12T17:31:33.667 INFO:tasks.rados.rados.0.trial082.stdout:689: oid 35 updating version 0 to 332 2026-02-12T17:31:33.667 INFO:tasks.rados.rados.0.trial082.stdout:689: oid 35 updating version 332 to 333 2026-02-12T17:31:33.667 INFO:tasks.rados.rados.0.trial082.stdout:689: oid 35 version 333 is already newer than 331 2026-02-12T17:31:33.667 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 333 (ObjNum 264 snap 78 seq_num 264) dirty exists 2026-02-12T17:31:33.667 INFO:tasks.rados.rados.0.trial082.stdout:689: left oid 35 (ObjNum 264 snap 78 seq_num 264) 2026-02-12T17:31:33.668 INFO:tasks.rados.rados.0.trial082.stdout:691: finishing write tid 2 to trial08226312-25 2026-02-12T17:31:33.668 INFO:tasks.rados.rados.0.trial082.stdout:691: finishing write tid 3 to trial08226312-25 2026-02-12T17:31:33.668 INFO:tasks.rados.rados.0.trial082.stdout:691: finishing write tid 4 to trial08226312-25 2026-02-12T17:31:33.668 INFO:tasks.rados.rados.0.trial082.stdout:691: oid 25 updating version 0 to 126 2026-02-12T17:31:33.668 INFO:tasks.rados.rados.0.trial082.stdout:691: oid 25 updating version 126 to 127 2026-02-12T17:31:33.668 INFO:tasks.rados.rados.0.trial082.stdout:691: oid 25 version 127 is already newer than 125 2026-02-12T17:31:33.668 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 127 (ObjNum 265 snap 78 seq_num 265) dirty exists 2026-02-12T17:31:33.669 INFO:tasks.rados.rados.0.trial082.stdout:691: left oid 25 (ObjNum 265 snap 78 seq_num 265) 2026-02-12T17:31:34.652 INFO:tasks.rados.rados.0.trial082.stdout:689: done (3 left) 2026-02-12T17:31:34.652 INFO:tasks.rados.rados.0.trial082.stdout:690: done (2 left) 2026-02-12T17:31:34.652 INFO:tasks.rados.rados.0.trial082.stdout:691: done (1 left) 2026-02-12T17:31:34.652 INFO:tasks.rados.rados.0.trial082.stdout:692: done (0 left) 2026-02-12T17:31:34.652 INFO:tasks.rados.rados.0.trial082.stdout:693: write (excl) oid 7 current snap is 79 2026-02-12T17:31:34.652 INFO:tasks.rados.rados.0.trial082.stdout:693: seq_num 266 ranges {470662=772236,1832916=408094} 2026-02-12T17:31:34.656 INFO:tasks.rados.rados.0.trial082.stdout:693: writing trial08226312-7 from 470662 to 1242898 tid 1 2026-02-12T17:31:34.660 INFO:tasks.rados.rados.0.trial082.stdout:693: writing trial08226312-7 from 1832916 to 2241010 tid 2 2026-02-12T17:31:34.660 INFO:tasks.rados.rados.0.trial082.stdout:694: snap_remove snap 75 2026-02-12T17:31:35.654 INFO:tasks.rados.rados.0.trial082.stdout:694: done (1 left) 2026-02-12T17:31:35.654 INFO:tasks.rados.rados.0.trial082.stdout:695: delete oid 33 current snap is 79 2026-02-12T17:31:35.655 INFO:tasks.rados.rados.0.trial082.stdout:693: finishing write tid 1 to trial08226312-7 2026-02-12T17:31:35.655 INFO:tasks.rados.rados.0.trial082.stdout:693: finishing write tid 2 to trial08226312-7 2026-02-12T17:31:35.655 INFO:tasks.rados.rados.0.trial082.stdout:693: finishing write tid 3 to trial08226312-7 2026-02-12T17:31:35.655 INFO:tasks.rados.rados.0.trial082.stdout:693: finishing write tid 4 to trial08226312-7 2026-02-12T17:31:35.655 INFO:tasks.rados.rados.0.trial082.stdout:693: oid 7 updating version 0 to 388 2026-02-12T17:31:35.655 INFO:tasks.rados.rados.0.trial082.stdout:693: oid 7 version 388 is already newer than 387 2026-02-12T17:31:35.655 INFO:tasks.rados.rados.0.trial082.stdout:693: oid 7 version 388 is already newer than 386 2026-02-12T17:31:35.655 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 388 (ObjNum 266 snap 79 seq_num 266) dirty exists 2026-02-12T17:31:35.655 INFO:tasks.rados.rados.0.trial082.stdout:693: left oid 7 (ObjNum 266 snap 79 seq_num 266) 2026-02-12T17:31:35.656 INFO:tasks.rados.rados.0.trial082.stdout:693: done (1 left) 2026-02-12T17:31:35.657 INFO:tasks.rados.rados.0.trial082.stdout:695: done (0 left) 2026-02-12T17:31:35.657 INFO:tasks.rados.rados.0.trial082.stdout:696: snap_remove snap 72 2026-02-12T17:31:36.657 INFO:tasks.rados.rados.0.trial082.stdout:696: done (0 left) 2026-02-12T17:31:36.657 INFO:tasks.rados.rados.0.trial082.stdout:697: copy_from oid 15 from oid 5 current snap is 79 2026-02-12T17:31:36.657 INFO:tasks.rados.rados.0.trial082.stdout:698: write oid 4 current snap is 79 2026-02-12T17:31:36.657 INFO:tasks.rados.rados.0.trial082.stdout:698: seq_num 268 ranges {504276=639087,1666233=695410} 2026-02-12T17:31:36.661 INFO:tasks.rados.rados.0.trial082.stdout:698: writing trial08226312-4 from 504276 to 1143363 tid 1 2026-02-12T17:31:36.667 INFO:tasks.rados.rados.0.trial082.stdout:698: writing trial08226312-4 from 1666233 to 2361643 tid 2 2026-02-12T17:31:36.667 INFO:tasks.rados.rados.0.trial082.stdout:699: read oid 2 snap -1 2026-02-12T17:31:36.667 INFO:tasks.rados.rados.0.trial082.stdout:699: expect (ObjNum 254 snap 74 seq_num 254) 2026-02-12T17:31:36.667 INFO:tasks.rados.rados.0.trial082.stdout:700: copy_from oid 20 from oid 34 current snap is 79 2026-02-12T17:31:36.667 INFO:tasks.rados.rados.0.trial082.stdout:698: finishing write tid 1 to trial08226312-4 2026-02-12T17:31:36.668 INFO:tasks.rados.rados.0.trial082.stdout:701: copy_from oid 30 from oid 44 current snap is 79 2026-02-12T17:31:36.668 INFO:tasks.rados.rados.0.trial082.stdout:702: delete oid 47 current snap is 79 2026-02-12T17:31:36.668 INFO:tasks.rados.rados.0.trial082.stdout:697: finishing copy_from racing read to trial08226312-15 2026-02-12T17:31:36.669 INFO:tasks.rados.rados.0.trial082.stdout:698: finishing write tid 2 to trial08226312-4 2026-02-12T17:31:36.669 INFO:tasks.rados.rados.0.trial082.stdout:699: expect (ObjNum 254 snap 74 seq_num 254) 2026-02-12T17:31:36.741 INFO:tasks.rados.rados.0.trial082.stdout:698: finishing write tid 3 to trial08226312-4 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:698: finishing write tid 4 to trial08226312-4 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:698: oid 4 updating version 0 to 407 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:698: oid 4 updating version 407 to 409 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:698: oid 4 version 409 is already newer than 408 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 409 (ObjNum 268 snap 79 seq_num 268) dirty exists 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:698: left oid 4 (ObjNum 268 snap 79 seq_num 268) 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:697: finishing copy_from to trial08226312-15 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 124 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:700: finishing copy_from racing read to trial08226312-20 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:701: finishing copy_from racing read to trial08226312-30 2026-02-12T17:31:36.742 INFO:tasks.rados.rados.0.trial082.stdout:697: done (5 left) 2026-02-12T17:31:36.743 INFO:tasks.rados.rados.0.trial082.stdout:698: done (4 left) 2026-02-12T17:31:36.743 INFO:tasks.rados.rados.0.trial082.stdout:699: done (3 left) 2026-02-12T17:31:36.743 INFO:tasks.rados.rados.0.trial082.stdout:702: done (2 left) 2026-02-12T17:31:36.743 INFO:tasks.rados.rados.0.trial082.stdout:703: write oid 19 current snap is 79 2026-02-12T17:31:36.743 INFO:tasks.rados.rados.0.trial082.stdout:700: finishing copy_from to trial08226312-20 2026-02-12T17:31:36.743 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 185 (ObjNum 263 snap 76 seq_num 263) dirty exists 2026-02-12T17:31:36.743 INFO:tasks.rados.rados.0.trial082.stdout:701: finishing copy_from to trial08226312-30 2026-02-12T17:31:36.743 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 294 (ObjNum 236 snap 63 seq_num 236) dirty exists 2026-02-12T17:31:36.743 INFO:tasks.rados.rados.0.trial082.stdout:703: seq_num 270 ranges {537890=789585,1783197=699079} 2026-02-12T17:31:36.746 INFO:tasks.rados.rados.0.trial082.stdout:703: writing trial08226312-19 from 537890 to 1327475 tid 1 2026-02-12T17:31:36.750 INFO:tasks.rados.rados.0.trial082.stdout:703: writing trial08226312-19 from 1783197 to 2482276 tid 2 2026-02-12T17:31:36.750 INFO:tasks.rados.rados.0.trial082.stdout:700: done (2 left) 2026-02-12T17:31:36.750 INFO:tasks.rados.rados.0.trial082.stdout:701: done (1 left) 2026-02-12T17:31:36.751 INFO:tasks.rados.rados.0.trial082.stdout:704: write (excl) oid 27 current snap is 79 2026-02-12T17:31:36.751 INFO:tasks.rados.rados.0.trial082.stdout:704: seq_num 271 ranges {554697=464834,1725326=559090} 2026-02-12T17:31:36.754 INFO:tasks.rados.rados.0.trial082.stdout:704: writing trial08226312-27 from 554697 to 1019531 tid 1 2026-02-12T17:31:36.759 INFO:tasks.rados.rados.0.trial082.stdout:704: writing trial08226312-27 from 1725326 to 2284416 tid 2 2026-02-12T17:31:36.759 INFO:tasks.rados.rados.0.trial082.stdout:705: copy_from oid 47 from oid 4 current snap is 79 2026-02-12T17:31:36.759 INFO:tasks.rados.rados.0.trial082.stdout:703: finishing write tid 1 to trial08226312-19 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:706: read oid 17 snap 76 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:706: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:707: delete oid 35 current snap is 79 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:703: finishing write tid 2 to trial08226312-19 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:703: finishing write tid 3 to trial08226312-19 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:703: finishing write tid 4 to trial08226312-19 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:703: oid 19 updating version 0 to 415 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:703: oid 19 updating version 415 to 416 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:703: oid 19 updating version 416 to 417 2026-02-12T17:31:36.760 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 417 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:31:36.761 INFO:tasks.rados.rados.0.trial082.stdout:703: left oid 19 (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:31:36.761 INFO:tasks.rados.rados.0.trial082.stdout:704: finishing write tid 1 to trial08226312-27 2026-02-12T17:31:36.762 INFO:tasks.rados.rados.0.trial082.stdout:703: done (4 left) 2026-02-12T17:31:36.762 INFO:tasks.rados.rados.0.trial082.stdout:707: done (3 left) 2026-02-12T17:31:36.762 INFO:tasks.rados.rados.0.trial082.stdout:708: copy_from oid 10 from oid 35 current snap is 79 2026-02-12T17:31:36.762 INFO:tasks.rados.rados.0.trial082.stdout:709: rollback oid 18 current snap is 79 2026-02-12T17:31:36.762 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 70 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:710: snap_create 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:704: finishing write tid 2 to trial08226312-27 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:704: finishing write tid 3 to trial08226312-27 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:708: finishing copy_from to trial08226312-10 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:708: got expected ENOENT (src dne) 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:708: finishing copy_from racing read to trial08226312-10 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:704: finishing write tid 4 to trial08226312-27 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:704: oid 27 updating version 0 to 266 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:704: oid 27 version 266 is already newer than 265 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:704: oid 27 version 266 is already newer than 264 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 266 (ObjNum 271 snap 79 seq_num 271) dirty exists 2026-02-12T17:31:36.763 INFO:tasks.rados.rados.0.trial082.stdout:704: left oid 27 (ObjNum 271 snap 79 seq_num 271) 2026-02-12T17:31:36.764 INFO:tasks.rados.rados.0.trial082.stdout:709: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:31:36.764 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 0 (ObjNum 81 snap 0 seq_num 26786896) dirty dne 2026-02-12T17:31:36.764 INFO:tasks.rados.rados.0.trial082.stdout:706: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:31:36.764 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 355038 2026-02-12T17:31:36.833 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1772868 2026-02-12T17:31:36.855 INFO:tasks.rados.rados.0.trial082.stdout:705: finishing copy_from racing read to trial08226312-47 2026-02-12T17:31:36.855 INFO:tasks.rados.rados.0.trial082.stdout:705: finishing copy_from to trial08226312-47 2026-02-12T17:31:36.855 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 409 (ObjNum 268 snap 79 seq_num 268) dirty exists 2026-02-12T17:31:37.635 INFO:tasks.rados.rados.0.trial082.stdout:704: done (5 left) 2026-02-12T17:31:37.635 INFO:tasks.rados.rados.0.trial082.stdout:705: done (4 left) 2026-02-12T17:31:37.635 INFO:tasks.rados.rados.0.trial082.stdout:706: done (3 left) 2026-02-12T17:31:37.635 INFO:tasks.rados.rados.0.trial082.stdout:708: done (2 left) 2026-02-12T17:31:37.635 INFO:tasks.rados.rados.0.trial082.stdout:709: done (1 left) 2026-02-12T17:31:37.635 INFO:tasks.rados.rados.0.trial082.stdout:710: done (0 left) 2026-02-12T17:31:37.635 INFO:tasks.rados.rados.0.trial082.stdout:711: read oid 49 snap 69 2026-02-12T17:31:37.635 INFO:tasks.rados.rados.0.trial082.stdout:711: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:31:37.635 INFO:tasks.rados.rados.0.trial082.stdout:712: read oid 13 snap -1 2026-02-12T17:31:37.636 INFO:tasks.rados.rados.0.trial082.stdout:712: expect (ObjNum 192 snap 50 seq_num 192) 2026-02-12T17:31:37.636 INFO:tasks.rados.rados.0.trial082.stdout:713: write oid 35 current snap is 80 2026-02-12T17:31:37.636 INFO:tasks.rados.rados.0.trial082.stdout:713: seq_num 273 ranges {588311=615332,1842290=562759} 2026-02-12T17:31:37.638 INFO:tasks.rados.rados.0.trial082.stdout:713: writing trial08226312-35 from 588311 to 1203643 tid 1 2026-02-12T17:31:37.643 INFO:tasks.rados.rados.0.trial082.stdout:713: writing trial08226312-35 from 1842290 to 2405049 tid 2 2026-02-12T17:31:37.643 INFO:tasks.rados.rados.0.trial082.stdout:714: write (excl) oid 37 current snap is 80 2026-02-12T17:31:37.643 INFO:tasks.rados.rados.0.trial082.stdout:714: seq_num 274 ranges {605118=406934,1617125=706417} 2026-02-12T17:31:37.647 INFO:tasks.rados.rados.0.trial082.stdout:714: writing trial08226312-37 from 605118 to 1012052 tid 1 2026-02-12T17:31:37.652 INFO:tasks.rados.rados.0.trial082.stdout:714: writing trial08226312-37 from 1617125 to 2323542 tid 2 2026-02-12T17:31:37.652 INFO:tasks.rados.rados.0.trial082.stdout:715: read oid 8 snap -1 2026-02-12T17:31:37.652 INFO:tasks.rados.rados.0.trial082.stdout:715: expect (ObjNum 256 snap 74 seq_num 256) 2026-02-12T17:31:37.652 INFO:tasks.rados.rados.0.trial082.stdout:716: write (excl) oid 9 current snap is 80 2026-02-12T17:31:37.653 INFO:tasks.rados.rados.0.trial082.stdout:716: seq_num 275 ranges {621925=482183,1559254=566428} 2026-02-12T17:31:37.656 INFO:tasks.rados.rados.0.trial082.stdout:716: writing trial08226312-9 from 621925 to 1104108 tid 1 2026-02-12T17:31:37.660 INFO:tasks.rados.rados.0.trial082.stdout:716: writing trial08226312-9 from 1559254 to 2125682 tid 2 2026-02-12T17:31:37.660 INFO:tasks.rados.rados.0.trial082.stdout:717: snap_remove snap 70 2026-02-12T17:31:38.659 INFO:tasks.rados.rados.0.trial082.stdout:717: done (6 left) 2026-02-12T17:31:38.660 INFO:tasks.rados.rados.0.trial082.stdout:718: snap_create 2026-02-12T17:31:38.660 INFO:tasks.rados.rados.0.trial082.stdout:711: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:31:38.714 INFO:tasks.rados.rados.0.trial082.stdout:712: expect (ObjNum 192 snap 50 seq_num 192) 2026-02-12T17:31:38.714 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:38.831 INFO:tasks.rados.rados.0.trial082.stdout:713: finishing write tid 1 to trial08226312-35 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:713: finishing write tid 2 to trial08226312-35 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:713: finishing write tid 3 to trial08226312-35 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:713: finishing write tid 4 to trial08226312-35 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:713: oid 35 updating version 0 to 341 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:713: oid 35 updating version 341 to 342 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:713: oid 35 version 342 is already newer than 340 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 342 (ObjNum 273 snap 80 seq_num 273) dirty exists 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:713: left oid 35 (ObjNum 273 snap 80 seq_num 273) 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:714: finishing write tid 1 to trial08226312-37 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:714: finishing write tid 2 to trial08226312-37 2026-02-12T17:31:38.832 INFO:tasks.rados.rados.0.trial082.stdout:714: finishing write tid 3 to trial08226312-37 2026-02-12T17:31:38.833 INFO:tasks.rados.rados.0.trial082.stdout:714: finishing write tid 4 to trial08226312-37 2026-02-12T17:31:38.833 INFO:tasks.rados.rados.0.trial082.stdout:714: oid 37 updating version 0 to 223 2026-02-12T17:31:38.833 INFO:tasks.rados.rados.0.trial082.stdout:714: oid 37 version 223 is already newer than 222 2026-02-12T17:31:38.833 INFO:tasks.rados.rados.0.trial082.stdout:714: oid 37 updating version 223 to 224 2026-02-12T17:31:38.833 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 224 (ObjNum 274 snap 80 seq_num 274) dirty exists 2026-02-12T17:31:38.833 INFO:tasks.rados.rados.0.trial082.stdout:714: left oid 37 (ObjNum 274 snap 80 seq_num 274) 2026-02-12T17:31:38.833 INFO:tasks.rados.rados.0.trial082.stdout:715: expect (ObjNum 256 snap 74 seq_num 256) 2026-02-12T17:31:38.854 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:38.900 INFO:tasks.rados.rados.0.trial082.stdout:716: finishing write tid 1 to trial08226312-9 2026-02-12T17:31:38.900 INFO:tasks.rados.rados.0.trial082.stdout:716: finishing write tid 2 to trial08226312-9 2026-02-12T17:31:38.901 INFO:tasks.rados.rados.0.trial082.stdout:716: finishing write tid 3 to trial08226312-9 2026-02-12T17:31:38.901 INFO:tasks.rados.rados.0.trial082.stdout:716: finishing write tid 4 to trial08226312-9 2026-02-12T17:31:38.901 INFO:tasks.rados.rados.0.trial082.stdout:716: oid 9 updating version 0 to 398 2026-02-12T17:31:38.901 INFO:tasks.rados.rados.0.trial082.stdout:716: oid 9 version 398 is already newer than 396 2026-02-12T17:31:38.901 INFO:tasks.rados.rados.0.trial082.stdout:716: oid 9 version 398 is already newer than 397 2026-02-12T17:31:38.901 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 398 (ObjNum 275 snap 80 seq_num 275) dirty exists 2026-02-12T17:31:38.901 INFO:tasks.rados.rados.0.trial082.stdout:716: left oid 9 (ObjNum 275 snap 80 seq_num 275) 2026-02-12T17:31:39.662 INFO:tasks.rados.rados.0.trial082.stdout:711: done (6 left) 2026-02-12T17:31:39.662 INFO:tasks.rados.rados.0.trial082.stdout:712: done (5 left) 2026-02-12T17:31:39.662 INFO:tasks.rados.rados.0.trial082.stdout:713: done (4 left) 2026-02-12T17:31:39.662 INFO:tasks.rados.rados.0.trial082.stdout:714: done (3 left) 2026-02-12T17:31:39.662 INFO:tasks.rados.rados.0.trial082.stdout:715: done (2 left) 2026-02-12T17:31:39.662 INFO:tasks.rados.rados.0.trial082.stdout:716: done (1 left) 2026-02-12T17:31:39.662 INFO:tasks.rados.rados.0.trial082.stdout:718: done (0 left) 2026-02-12T17:31:39.662 INFO:tasks.rados.rados.0.trial082.stdout:719: read oid 30 snap 71 2026-02-12T17:31:39.662 INFO:tasks.rados.rados.0.trial082.stdout:719: expect (ObjNum 239 snap 65 seq_num 239) 2026-02-12T17:31:39.663 INFO:tasks.rados.rados.0.trial082.stdout:720: delete oid 21 current snap is 81 2026-02-12T17:31:39.664 INFO:tasks.rados.rados.0.trial082.stdout:719: expect (ObjNum 239 snap 65 seq_num 239) 2026-02-12T17:31:39.722 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 877154 2026-02-12T17:31:39.745 INFO:tasks.rados.rados.0.trial082.stdout:719: done (1 left) 2026-02-12T17:31:39.745 INFO:tasks.rados.rados.0.trial082.stdout:720: done (0 left) 2026-02-12T17:31:39.745 INFO:tasks.rados.rados.0.trial082.stdout:721: read oid 29 snap -1 2026-02-12T17:31:39.745 INFO:tasks.rados.rados.0.trial082.stdout:721: expect (ObjNum 226 snap 61 seq_num 226) 2026-02-12T17:31:39.745 INFO:tasks.rados.rados.0.trial082.stdout:722: write (excl) oid 30 current snap is 81 2026-02-12T17:31:39.745 INFO:tasks.rados.rados.0.trial082.stdout:722: seq_num 277 ranges {655539=632681,2076218=570097} 2026-02-12T17:31:39.750 INFO:tasks.rados.rados.0.trial082.stdout:722: writing trial08226312-30 from 655539 to 1288220 tid 1 2026-02-12T17:31:39.755 INFO:tasks.rados.rados.0.trial082.stdout:722: writing trial08226312-30 from 2076218 to 2646315 tid 2 2026-02-12T17:31:39.755 INFO:tasks.rados.rados.0.trial082.stdout:723: read oid 42 snap -1 2026-02-12T17:31:39.755 INFO:tasks.rados.rados.0.trial082.stdout:723: expect (ObjNum 239 snap 65 seq_num 239) 2026-02-12T17:31:39.755 INFO:tasks.rados.rados.0.trial082.stdout:724: snap_create 2026-02-12T17:31:39.756 INFO:tasks.rados.rados.0.trial082.stdout:721: expect (ObjNum 226 snap 61 seq_num 226) 2026-02-12T17:31:39.805 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:39.832 INFO:tasks.rados.rados.0.trial082.stdout:722: finishing write tid 1 to trial08226312-30 2026-02-12T17:31:39.832 INFO:tasks.rados.rados.0.trial082.stdout:722: finishing write tid 2 to trial08226312-30 2026-02-12T17:31:39.832 INFO:tasks.rados.rados.0.trial082.stdout:722: finishing write tid 3 to trial08226312-30 2026-02-12T17:31:39.832 INFO:tasks.rados.rados.0.trial082.stdout:722: finishing write tid 4 to trial08226312-30 2026-02-12T17:31:39.832 INFO:tasks.rados.rados.0.trial082.stdout:722: oid 30 updating version 0 to 298 2026-02-12T17:31:39.833 INFO:tasks.rados.rados.0.trial082.stdout:722: oid 30 version 298 is already newer than 296 2026-02-12T17:31:39.833 INFO:tasks.rados.rados.0.trial082.stdout:722: oid 30 version 298 is already newer than 297 2026-02-12T17:31:39.833 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 298 (ObjNum 277 snap 81 seq_num 277) dirty exists 2026-02-12T17:31:39.833 INFO:tasks.rados.rados.0.trial082.stdout:722: left oid 30 (ObjNum 277 snap 81 seq_num 277) 2026-02-12T17:31:39.833 INFO:tasks.rados.rados.0.trial082.stdout:723: expect (ObjNum 239 snap 65 seq_num 239) 2026-02-12T17:31:39.882 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:40.665 INFO:tasks.rados.rados.0.trial082.stdout:721: done (3 left) 2026-02-12T17:31:40.666 INFO:tasks.rados.rados.0.trial082.stdout:722: done (2 left) 2026-02-12T17:31:40.666 INFO:tasks.rados.rados.0.trial082.stdout:723: done (1 left) 2026-02-12T17:31:40.666 INFO:tasks.rados.rados.0.trial082.stdout:724: done (0 left) 2026-02-12T17:31:40.666 INFO:tasks.rados.rados.0.trial082.stdout:725: rollback oid 6 current snap is 82 2026-02-12T17:31:40.666 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 6 to 81 2026-02-12T17:31:40.666 INFO:tasks.rados.rados.0.trial082.stdout:726: read oid 24 snap 76 2026-02-12T17:31:40.666 INFO:tasks.rados.rados.0.trial082.stdout:726: expect deleted 2026-02-12T17:31:40.666 INFO:tasks.rados.rados.0.trial082.stdout:727: delete oid 27 current snap is 82 2026-02-12T17:31:40.668 INFO:tasks.rados.rados.0.trial082.stdout:726: done (2 left) 2026-02-12T17:31:40.668 INFO:tasks.rados.rados.0.trial082.stdout:727: done (1 left) 2026-02-12T17:31:40.668 INFO:tasks.rados.rados.0.trial082.stdout:728: read oid 38 snap -1 2026-02-12T17:31:40.668 INFO:tasks.rados.rados.0.trial082.stdout:728: expect (ObjNum 257 snap 74 seq_num 257) 2026-02-12T17:31:40.668 INFO:tasks.rados.rados.0.trial082.stdout:729: copy_from oid 40 from oid 45 current snap is 82 2026-02-12T17:31:40.668 INFO:tasks.rados.rados.0.trial082.stdout:730: delete oid 32 current snap is 82 2026-02-12T17:31:40.669 INFO:tasks.rados.rados.0.trial082.stdout:728: expect (ObjNum 257 snap 74 seq_num 257) 2026-02-12T17:31:40.711 INFO:tasks.rados.rados.0.trial082.stdout:725: finishing rollback tid 0 to trial08226312-6 2026-02-12T17:31:40.711 INFO:tasks.rados.rados.0.trial082.stdout:725: finishing rollback tid 1 to trial08226312-6 2026-02-12T17:31:40.711 INFO:tasks.rados.rados.0.trial082.stdout:725: finishing rollback tid 2 to trial08226312-6 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 139 (ObjNum 194 snap 51 seq_num 194) dirty exists 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:729: finishing copy_from racing read to trial08226312-40 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:729: finishing copy_from to trial08226312-40 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 266 (ObjNum 182 snap 46 seq_num 182) dirty exists 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:725: done (3 left) 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:728: done (2 left) 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:729: done (1 left) 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:730: done (0 left) 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:731: read oid 12 snap -1 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:731: expect (ObjNum 255 snap 74 seq_num 255) 2026-02-12T17:31:40.712 INFO:tasks.rados.rados.0.trial082.stdout:732: read oid 35 snap -1 2026-02-12T17:31:40.713 INFO:tasks.rados.rados.0.trial082.stdout:732: expect (ObjNum 273 snap 80 seq_num 273) 2026-02-12T17:31:40.713 INFO:tasks.rados.rados.0.trial082.stdout:733: read oid 50 snap 78 2026-02-12T17:31:40.713 INFO:tasks.rados.rados.0.trial082.stdout:733: expect (ObjNum 193 snap 51 seq_num 193) 2026-02-12T17:31:40.713 INFO:tasks.rados.rados.0.trial082.stdout:734: delete oid 23 current snap is 82 2026-02-12T17:31:40.715 INFO:tasks.rados.rados.0.trial082.stdout:731: expect (ObjNum 255 snap 74 seq_num 255) 2026-02-12T17:31:40.763 INFO:tasks.rados.rados.0.trial082.stdout:732: expect (ObjNum 273 snap 80 seq_num 273) 2026-02-12T17:31:40.763 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:40.781 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:40.815 INFO:tasks.rados.rados.0.trial082.stdout:733: expect (ObjNum 193 snap 51 seq_num 193) 2026-02-12T17:31:40.837 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2279101 2026-02-12T17:31:40.883 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:40.923 INFO:tasks.rados.rados.0.trial082.stdout:731: done (3 left) 2026-02-12T17:31:40.923 INFO:tasks.rados.rados.0.trial082.stdout:732: done (2 left) 2026-02-12T17:31:40.923 INFO:tasks.rados.rados.0.trial082.stdout:733: done (1 left) 2026-02-12T17:31:40.923 INFO:tasks.rados.rados.0.trial082.stdout:734: done (0 left) 2026-02-12T17:31:40.923 INFO:tasks.rados.rados.0.trial082.stdout:735: read oid 17 snap -1 2026-02-12T17:31:40.923 INFO:tasks.rados.rados.0.trial082.stdout:735: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:31:40.923 INFO:tasks.rados.rados.0.trial082.stdout:736: read oid 11 snap -1 2026-02-12T17:31:40.923 INFO:tasks.rados.rados.0.trial082.stdout:736: expect (ObjNum 238 snap 63 seq_num 238) 2026-02-12T17:31:40.923 INFO:tasks.rados.rados.0.trial082.stdout:737: write (excl) oid 43 current snap is 82 2026-02-12T17:31:40.924 INFO:tasks.rados.rados.0.trial082.stdout:737: seq_num 281 ranges {722767=533677,1793793=461082} 2026-02-12T17:31:40.927 INFO:tasks.rados.rados.0.trial082.stdout:737: writing trial08226312-43 from 722767 to 1256444 tid 1 2026-02-12T17:31:40.931 INFO:tasks.rados.rados.0.trial082.stdout:737: writing trial08226312-43 from 1793793 to 2254875 tid 2 2026-02-12T17:31:40.931 INFO:tasks.rados.rados.0.trial082.stdout:738: read oid 48 snap -1 2026-02-12T17:31:40.931 INFO:tasks.rados.rados.0.trial082.stdout:738: expect (ObjNum 218 snap 59 seq_num 218) 2026-02-12T17:31:40.932 INFO:tasks.rados.rados.0.trial082.stdout:739: read oid 2 snap 78 2026-02-12T17:31:40.932 INFO:tasks.rados.rados.0.trial082.stdout:739: expect (ObjNum 254 snap 74 seq_num 254) 2026-02-12T17:31:40.932 INFO:tasks.rados.rados.0.trial082.stdout:740: read oid 50 snap -1 2026-02-12T17:31:40.932 INFO:tasks.rados.rados.0.trial082.stdout:740: expect (ObjNum 193 snap 51 seq_num 193) 2026-02-12T17:31:40.932 INFO:tasks.rados.rados.0.trial082.stdout:741: read oid 27 snap -1 2026-02-12T17:31:40.932 INFO:tasks.rados.rados.0.trial082.stdout:741: expect deleted 2026-02-12T17:31:40.932 INFO:tasks.rados.rados.0.trial082.stdout:742: write oid 47 current snap is 82 2026-02-12T17:31:40.932 INFO:tasks.rados.rados.0.trial082.stdout:742: seq_num 282 ranges {739574=725279,1968628=721093} 2026-02-12T17:31:40.936 INFO:tasks.rados.rados.0.trial082.stdout:742: writing trial08226312-47 from 739574 to 1464853 tid 1 2026-02-12T17:31:40.941 INFO:tasks.rados.rados.0.trial082.stdout:742: writing trial08226312-47 from 1968628 to 2689721 tid 2 2026-02-12T17:31:40.941 INFO:tasks.rados.rados.0.trial082.stdout:743: write (excl) oid 16 current snap is 82 2026-02-12T17:31:40.941 INFO:tasks.rados.rados.0.trial082.stdout:743: seq_num 283 ranges {756381=400528,1910757=464751} 2026-02-12T17:31:40.945 INFO:tasks.rados.rados.0.trial082.stdout:743: writing trial08226312-16 from 756381 to 1156909 tid 1 2026-02-12T17:31:40.950 INFO:tasks.rados.rados.0.trial082.stdout:743: writing trial08226312-16 from 1910757 to 2375508 tid 2 2026-02-12T17:31:40.950 INFO:tasks.rados.rados.0.trial082.stdout:744: delete oid 39 current snap is 82 2026-02-12T17:31:40.950 INFO:tasks.rados.rados.0.trial082.stdout:735: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:31:40.975 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:41.031 INFO:tasks.rados.rados.0.trial082.stdout:736: expect (ObjNum 238 snap 63 seq_num 238) 2026-02-12T17:31:41.047 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 489953 2026-02-12T17:31:41.058 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:41.072 INFO:tasks.rados.rados.0.trial082.stdout:737: finishing write tid 1 to trial08226312-43 2026-02-12T17:31:41.072 INFO:tasks.rados.rados.0.trial082.stdout:739: expect (ObjNum 254 snap 74 seq_num 254) 2026-02-12T17:31:41.091 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2251807 2026-02-12T17:31:41.096 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 763195 2026-02-12T17:31:41.141 INFO:tasks.rados.rados.0.trial082.stdout:737: finishing write tid 2 to trial08226312-43 2026-02-12T17:31:41.141 INFO:tasks.rados.rados.0.trial082.stdout:737: finishing write tid 3 to trial08226312-43 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:737: finishing write tid 4 to trial08226312-43 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:737: oid 43 updating version 0 to 301 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:737: oid 43 updating version 301 to 302 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:737: oid 43 version 302 is already newer than 300 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 302 (ObjNum 281 snap 82 seq_num 281) dirty exists 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:737: left oid 43 (ObjNum 281 snap 82 seq_num 281) 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:735: done (9 left) 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:736: done (8 left) 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:737: done (7 left) 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:739: done (6 left) 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:741: done (5 left) 2026-02-12T17:31:41.142 INFO:tasks.rados.rados.0.trial082.stdout:744: done (4 left) 2026-02-12T17:31:41.143 INFO:tasks.rados.rados.0.trial082.stdout:745: delete oid 22 current snap is 82 2026-02-12T17:31:41.143 INFO:tasks.rados.rados.0.trial082.stdout:740: expect (ObjNum 193 snap 51 seq_num 193) 2026-02-12T17:31:41.143 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 694586 2026-02-12T17:31:41.178 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:41.257 INFO:tasks.rados.rados.0.trial082.stdout:738: expect (ObjNum 218 snap 59 seq_num 218) 2026-02-12T17:31:41.316 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 760910 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:742: finishing write tid 1 to trial08226312-47 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:742: finishing write tid 2 to trial08226312-47 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:742: finishing write tid 3 to trial08226312-47 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:742: finishing write tid 4 to trial08226312-47 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:742: oid 47 updating version 0 to 434 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:742: oid 47 version 434 is already newer than 433 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:742: oid 47 version 434 is already newer than 432 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 434 (ObjNum 282 snap 82 seq_num 282) dirty exists 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:742: left oid 47 (ObjNum 282 snap 82 seq_num 282) 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:743: finishing write tid 1 to trial08226312-16 2026-02-12T17:31:41.337 INFO:tasks.rados.rados.0.trial082.stdout:738: done (4 left) 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:740: done (3 left) 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:742: done (2 left) 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:745: done (1 left) 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:746: rollback oid 48 current snap is 82 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 81 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:743: finishing write tid 2 to trial08226312-16 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:743: finishing write tid 3 to trial08226312-16 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:743: finishing write tid 4 to trial08226312-16 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:743: oid 16 updating version 0 to 408 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:743: oid 16 version 408 is already newer than 406 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:743: oid 16 version 408 is already newer than 407 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 408 (ObjNum 283 snap 82 seq_num 283) dirty exists 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:743: left oid 16 (ObjNum 283 snap 82 seq_num 283) 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:743: done (1 left) 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:747: delete oid 1 current snap is 82 2026-02-12T17:31:41.338 INFO:tasks.rados.rados.0.trial082.stdout:747: done (1 left) 2026-02-12T17:31:41.339 INFO:tasks.rados.rados.0.trial082.stdout:748: delete oid 50 current snap is 82 2026-02-12T17:31:41.339 INFO:tasks.rados.rados.0.trial082.stdout:746: finishing rollback tid 0 to trial08226312-48 2026-02-12T17:31:41.340 INFO:tasks.rados.rados.0.trial082.stdout:746: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:31:41.340 INFO:tasks.rados.rados.0.trial082.stdout:748: done (1 left) 2026-02-12T17:31:41.340 INFO:tasks.rados.rados.0.trial082.stdout:749: rollback oid 23 current snap is 82 2026-02-12T17:31:41.340 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 23 to 81 2026-02-12T17:31:41.340 INFO:tasks.rados.rados.0.trial082.stdout:750: copy_from oid 42 from oid 17 current snap is 82 2026-02-12T17:31:41.340 INFO:tasks.rados.rados.0.trial082.stdout:751: write (excl) oid 32 current snap is 82 2026-02-12T17:31:41.340 INFO:tasks.rados.rados.0.trial082.stdout:751: seq_num 288 ranges {440416=776773,1686814=732100} 2026-02-12T17:31:41.345 INFO:tasks.rados.rados.0.trial082.stdout:751: writing trial08226312-32 from 440416 to 1217189 tid 1 2026-02-12T17:31:41.349 INFO:tasks.rados.rados.0.trial082.stdout:751: writing trial08226312-32 from 1686814 to 2418914 tid 2 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:752: delete oid 43 current snap is 82 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:746: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 27 (ObjNum 218 snap 59 seq_num 218) dirty exists 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:749: finishing rollback tid 1 to trial08226312-23 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 0 (ObjNum 0 snap 0 seq_num 304) dirty dne 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:750: finishing copy_from racing read to trial08226312-42 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:751: finishing write tid 1 to trial08226312-32 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:750: finishing copy_from to trial08226312-42 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 285 (ObjNum 184 snap 48 seq_num 184) dirty exists 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:746: done (4 left) 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:749: done (3 left) 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:750: done (2 left) 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:752: done (1 left) 2026-02-12T17:31:41.350 INFO:tasks.rados.rados.0.trial082.stdout:753: snap_remove snap 80 2026-02-12T17:31:41.667 INFO:tasks.rados.rados.0.trial082.stdout:753: done (1 left) 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:754: read oid 13 snap -1 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:754: expect (ObjNum 192 snap 50 seq_num 192) 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:755: copy_from oid 12 from oid 33 current snap is 82 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:751: finishing write tid 2 to trial08226312-32 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:751: finishing write tid 3 to trial08226312-32 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:751: finishing write tid 4 to trial08226312-32 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:751: oid 32 updating version 0 to 190 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:751: oid 32 updating version 190 to 191 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:751: oid 32 updating version 191 to 192 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 192 (ObjNum 288 snap 82 seq_num 288) dirty exists 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:751: left oid 32 (ObjNum 288 snap 82 seq_num 288) 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:751: done (2 left) 2026-02-12T17:31:41.668 INFO:tasks.rados.rados.0.trial082.stdout:756: delete oid 6 current snap is 82 2026-02-12T17:31:41.669 INFO:tasks.rados.rados.0.trial082.stdout:755: finishing copy_from to trial08226312-12 2026-02-12T17:31:41.669 INFO:tasks.rados.rados.0.trial082.stdout:755: got expected ENOENT (src dne) 2026-02-12T17:31:41.669 INFO:tasks.rados.rados.0.trial082.stdout:755: finishing copy_from racing read to trial08226312-12 2026-02-12T17:31:41.670 INFO:tasks.rados.rados.0.trial082.stdout:755: done (2 left) 2026-02-12T17:31:41.670 INFO:tasks.rados.rados.0.trial082.stdout:756: done (1 left) 2026-02-12T17:31:41.670 INFO:tasks.rados.rados.0.trial082.stdout:757: write (excl) oid 2 current snap is 82 2026-02-12T17:31:41.670 INFO:tasks.rados.rados.0.trial082.stdout:757: seq_num 291 ranges {490837=718873,1862260=479427,2875032=15805} 2026-02-12T17:31:41.675 INFO:tasks.rados.rados.0.trial082.stdout:757: writing trial08226312-2 from 490837 to 1209710 tid 1 2026-02-12T17:31:41.679 INFO:tasks.rados.rados.0.trial082.stdout:757: writing trial08226312-2 from 1862260 to 2341687 tid 2 2026-02-12T17:31:41.681 INFO:tasks.rados.rados.0.trial082.stdout:757: writing trial08226312-2 from 2875032 to 2890837 tid 3 2026-02-12T17:31:41.681 INFO:tasks.rados.rados.0.trial082.stdout:758: write (excl) oid 38 current snap is 82 2026-02-12T17:31:41.681 INFO:tasks.rados.rados.0.trial082.stdout:758: seq_num 292 ranges {507644=794122,1920742=623085} 2026-02-12T17:31:41.686 INFO:tasks.rados.rados.0.trial082.stdout:758: writing trial08226312-38 from 507644 to 1301766 tid 1 2026-02-12T17:31:41.691 INFO:tasks.rados.rados.0.trial082.stdout:758: writing trial08226312-38 from 1920742 to 2543827 tid 2 2026-02-12T17:31:41.691 INFO:tasks.rados.rados.0.trial082.stdout:759: snap_create 2026-02-12T17:31:41.691 INFO:tasks.rados.rados.0.trial082.stdout:754: expect (ObjNum 192 snap 50 seq_num 192) 2026-02-12T17:31:41.772 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:41.813 INFO:tasks.rados.rados.0.trial082.stdout:757: finishing write tid 1 to trial08226312-2 2026-02-12T17:31:41.813 INFO:tasks.rados.rados.0.trial082.stdout:757: finishing write tid 2 to trial08226312-2 2026-02-12T17:31:41.813 INFO:tasks.rados.rados.0.trial082.stdout:757: finishing write tid 3 to trial08226312-2 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:757: finishing write tid 4 to trial08226312-2 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:757: finishing write tid 5 to trial08226312-2 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:757: oid 2 updating version 0 to 258 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:757: oid 2 updating version 258 to 259 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:757: oid 2 version 259 is already newer than 257 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:757: oid 2 version 259 is already newer than 256 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 259 (ObjNum 291 snap 82 seq_num 291) dirty exists 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:757: left oid 2 (ObjNum 291 snap 82 seq_num 291) 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:758: finishing write tid 1 to trial08226312-38 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:758: finishing write tid 2 to trial08226312-38 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:758: finishing write tid 3 to trial08226312-38 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:758: finishing write tid 4 to trial08226312-38 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:758: oid 38 updating version 0 to 198 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:758: oid 38 version 198 is already newer than 196 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:758: oid 38 version 198 is already newer than 197 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 198 (ObjNum 292 snap 82 seq_num 292) dirty exists 2026-02-12T17:31:41.814 INFO:tasks.rados.rados.0.trial082.stdout:758: left oid 38 (ObjNum 292 snap 82 seq_num 292) 2026-02-12T17:31:42.670 INFO:tasks.rados.rados.0.trial082.stdout:754: done (3 left) 2026-02-12T17:31:42.670 INFO:tasks.rados.rados.0.trial082.stdout:757: done (2 left) 2026-02-12T17:31:42.670 INFO:tasks.rados.rados.0.trial082.stdout:758: done (1 left) 2026-02-12T17:31:42.670 INFO:tasks.rados.rados.0.trial082.stdout:759: done (0 left) 2026-02-12T17:31:42.670 INFO:tasks.rados.rados.0.trial082.stdout:760: read oid 25 snap -1 2026-02-12T17:31:42.670 INFO:tasks.rados.rados.0.trial082.stdout:760: expect (ObjNum 265 snap 78 seq_num 265) 2026-02-12T17:31:42.670 INFO:tasks.rados.rados.0.trial082.stdout:761: delete oid 2 current snap is 83 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:761: done (1 left) 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:762: read oid 1 snap 74 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:762: expect deleted 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:763: copy_from oid 24 from oid 39 current snap is 83 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:764: copy_from oid 28 from oid 3 current snap is 83 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:765: copy_from oid 14 from oid 7 current snap is 83 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:766: rollback oid 21 current snap is 83 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 82 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:767: copy_from oid 27 from oid 22 current snap is 83 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:768: copy_from oid 9 from oid 42 current snap is 83 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:769: write oid 4 current snap is 83 2026-02-12T17:31:42.672 INFO:tasks.rados.rados.0.trial082.stdout:769: seq_num 294 ranges {541258=544620,1637706=626754,2840948=100310} 2026-02-12T17:31:42.676 INFO:tasks.rados.rados.0.trial082.stdout:769: writing trial08226312-4 from 541258 to 1085878 tid 1 2026-02-12T17:31:42.680 INFO:tasks.rados.rados.0.trial082.stdout:769: writing trial08226312-4 from 1637706 to 2264460 tid 2 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:769: writing trial08226312-4 from 2840948 to 2941258 tid 3 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:770: copy_from oid 5 from oid 19 current snap is 83 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:762: done (9 left) 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:771: read oid 44 snap -1 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:771: expect (ObjNum 236 snap 63 seq_num 236) 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:772: copy_from oid 29 from oid 10 current snap is 83 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:763: finishing copy_from to trial08226312-24 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:763: got expected ENOENT (src dne) 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:773: delete oid 35 current snap is 83 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:763: finishing copy_from racing read to trial08226312-24 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:767: finishing copy_from to trial08226312-27 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:767: got expected ENOENT (src dne) 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:767: finishing copy_from racing read to trial08226312-27 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:766: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 295 (ObjNum 33 snap 0 seq_num 4556992) dirty dne 2026-02-12T17:31:42.683 INFO:tasks.rados.rados.0.trial082.stdout:760: expect (ObjNum 265 snap 78 seq_num 265) 2026-02-12T17:31:42.706 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:769: finishing write tid 1 to trial08226312-4 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:765: finishing copy_from racing read to trial08226312-14 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:765: finishing copy_from to trial08226312-14 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 388 (ObjNum 266 snap 79 seq_num 266) dirty exists 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:764: finishing copy_from racing read to trial08226312-28 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:760: done (11 left) 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:763: done (10 left) 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:765: done (9 left) 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:766: done (8 left) 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:767: done (7 left) 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:773: done (6 left) 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:774: write (excl) oid 13 current snap is 83 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:768: finishing copy_from to trial08226312-9 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 285 (ObjNum 184 snap 48 seq_num 184) dirty exists 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:768: finishing copy_from racing read to trial08226312-9 2026-02-12T17:31:42.755 INFO:tasks.rados.rados.0.trial082.stdout:774: seq_num 296 ranges {574872=695118,2038317=630423} 2026-02-12T17:31:42.759 INFO:tasks.rados.rados.0.trial082.stdout:774: writing trial08226312-13 from 574872 to 1269990 tid 1 2026-02-12T17:31:42.764 INFO:tasks.rados.rados.0.trial082.stdout:774: writing trial08226312-13 from 2038317 to 2668740 tid 2 2026-02-12T17:31:42.764 INFO:tasks.rados.rados.0.trial082.stdout:768: done (6 left) 2026-02-12T17:31:42.765 INFO:tasks.rados.rados.0.trial082.stdout:775: copy_from oid 21 from oid 39 current snap is 83 2026-02-12T17:31:42.765 INFO:tasks.rados.rados.0.trial082.stdout:769: finishing write tid 2 to trial08226312-4 2026-02-12T17:31:42.765 INFO:tasks.rados.rados.0.trial082.stdout:772: finishing copy_from to trial08226312-29 2026-02-12T17:31:42.765 INFO:tasks.rados.rados.0.trial082.stdout:772: got expected ENOENT (src dne) 2026-02-12T17:31:42.765 INFO:tasks.rados.rados.0.trial082.stdout:772: finishing copy_from racing read to trial08226312-29 2026-02-12T17:31:42.765 INFO:tasks.rados.rados.0.trial082.stdout:764: finishing copy_from to trial08226312-28 2026-02-12T17:31:42.765 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 280 (ObjNum 261 snap 76 seq_num 261) dirty exists 2026-02-12T17:31:42.765 INFO:tasks.rados.rados.0.trial082.stdout:771: expect (ObjNum 236 snap 63 seq_num 236) 2026-02-12T17:31:42.765 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 24958 2026-02-12T17:31:42.834 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1064588 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:769: finishing write tid 3 to trial08226312-4 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:769: finishing write tid 4 to trial08226312-4 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:769: finishing write tid 5 to trial08226312-4 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:769: oid 4 updating version 0 to 441 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:769: oid 4 version 441 is already newer than 438 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:769: oid 4 version 441 is already newer than 439 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:769: oid 4 version 441 is already newer than 440 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 441 (ObjNum 294 snap 83 seq_num 294) dirty exists 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:769: left oid 4 (ObjNum 294 snap 83 seq_num 294) 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:770: finishing copy_from racing read to trial08226312-5 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:770: finishing copy_from to trial08226312-5 2026-02-12T17:31:42.940 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 417 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:774: finishing write tid 1 to trial08226312-13 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:775: finishing copy_from to trial08226312-21 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:775: got expected ENOENT (src dne) 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:775: finishing copy_from racing read to trial08226312-21 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:774: finishing write tid 2 to trial08226312-13 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:774: finishing write tid 3 to trial08226312-13 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:774: finishing write tid 4 to trial08226312-13 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:774: oid 13 updating version 0 to 129 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:774: oid 13 updating version 129 to 130 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:774: oid 13 version 130 is already newer than 128 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 130 (ObjNum 296 snap 83 seq_num 296) dirty exists 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:774: left oid 13 (ObjNum 296 snap 83 seq_num 296) 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:764: done (6 left) 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:769: done (5 left) 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:770: done (4 left) 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:771: done (3 left) 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:772: done (2 left) 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:774: done (1 left) 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:775: done (0 left) 2026-02-12T17:31:42.941 INFO:tasks.rados.rados.0.trial082.stdout:776: snap_remove snap 76 2026-02-12T17:31:43.674 INFO:tasks.rados.rados.0.trial082.stdout:776: done (0 left) 2026-02-12T17:31:43.674 INFO:tasks.rados.rados.0.trial082.stdout:777: read oid 48 snap -1 2026-02-12T17:31:43.674 INFO:tasks.rados.rados.0.trial082.stdout:777: expect (ObjNum 218 snap 59 seq_num 218) 2026-02-12T17:31:43.674 INFO:tasks.rados.rados.0.trial082.stdout:778: write oid 17 current snap is 83 2026-02-12T17:31:43.674 INFO:tasks.rados.rados.0.trial082.stdout:778: seq_num 297 ranges {591679=486720,1813152=490434} 2026-02-12T17:31:43.678 INFO:tasks.rados.rados.0.trial082.stdout:778: writing trial08226312-17 from 591679 to 1078399 tid 1 2026-02-12T17:31:43.683 INFO:tasks.rados.rados.0.trial082.stdout:778: writing trial08226312-17 from 1813152 to 2303586 tid 2 2026-02-12T17:31:43.683 INFO:tasks.rados.rados.0.trial082.stdout:779: copy_from oid 32 from oid 21 current snap is 83 2026-02-12T17:31:43.683 INFO:tasks.rados.rados.0.trial082.stdout:777: expect (ObjNum 218 snap 59 seq_num 218) 2026-02-12T17:31:43.685 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1721006 2026-02-12T17:31:43.728 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 828708 2026-02-12T17:31:43.748 INFO:tasks.rados.rados.0.trial082.stdout:778: finishing write tid 1 to trial08226312-17 2026-02-12T17:31:43.748 INFO:tasks.rados.rados.0.trial082.stdout:777: done (2 left) 2026-02-12T17:31:43.748 INFO:tasks.rados.rados.0.trial082.stdout:780: rollback oid 2 current snap is 83 2026-02-12T17:31:43.748 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 82 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:778: finishing write tid 2 to trial08226312-17 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:778: finishing write tid 3 to trial08226312-17 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:778: finishing write tid 4 to trial08226312-17 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:778: oid 17 updating version 0 to 443 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:778: oid 17 updating version 443 to 453 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:778: oid 17 version 453 is already newer than 452 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 453 (ObjNum 297 snap 83 seq_num 297) dirty exists 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:778: left oid 17 (ObjNum 297 snap 83 seq_num 297) 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:779: finishing copy_from to trial08226312-32 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:779: got expected ENOENT (src dne) 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:779: finishing copy_from racing read to trial08226312-32 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:778: done (2 left) 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:779: done (1 left) 2026-02-12T17:31:43.749 INFO:tasks.rados.rados.0.trial082.stdout:781: snap_create 2026-02-12T17:31:43.750 INFO:tasks.rados.rados.0.trial082.stdout:780: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:31:43.750 INFO:tasks.rados.rados.0.trial082.stdout:780: finishing rollback tid 2 to trial08226312-2 2026-02-12T17:31:43.750 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 262 (ObjNum 291 snap 82 seq_num 291) dirty exists 2026-02-12T17:31:44.676 INFO:tasks.rados.rados.0.trial082.stdout:780: done (1 left) 2026-02-12T17:31:44.676 INFO:tasks.rados.rados.0.trial082.stdout:781: done (0 left) 2026-02-12T17:31:44.676 INFO:tasks.rados.rados.0.trial082.stdout:782: snap_create 2026-02-12T17:31:45.678 INFO:tasks.rados.rados.0.trial082.stdout:782: done (0 left) 2026-02-12T17:31:45.678 INFO:tasks.rados.rados.0.trial082.stdout:783: copy_from oid 13 from oid 32 current snap is 85 2026-02-12T17:31:45.678 INFO:tasks.rados.rados.0.trial082.stdout:784: rollback oid 45 current snap is 85 2026-02-12T17:31:45.678 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 81 2026-02-12T17:31:45.678 INFO:tasks.rados.rados.0.trial082.stdout:785: snap_remove snap 78 2026-02-12T17:31:46.682 INFO:tasks.rados.rados.0.trial082.stdout:785: done (2 left) 2026-02-12T17:31:46.682 INFO:tasks.rados.rados.0.trial082.stdout:786: delete oid 46 current snap is 85 2026-02-12T17:31:46.682 INFO:tasks.rados.rados.0.trial082.stdout:784: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:31:46.682 INFO:tasks.rados.rados.0.trial082.stdout:784: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:31:46.682 INFO:tasks.rados.rados.0.trial082.stdout:784: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:31:46.682 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 353 (ObjNum 182 snap 46 seq_num 182) dirty exists 2026-02-12T17:31:46.682 INFO:tasks.rados.rados.0.trial082.stdout:783: finishing copy_from racing read to trial08226312-13 2026-02-12T17:31:46.683 INFO:tasks.rados.rados.0.trial082.stdout:783: finishing copy_from to trial08226312-13 2026-02-12T17:31:46.683 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 192 (ObjNum 288 snap 82 seq_num 288) dirty exists 2026-02-12T17:31:46.685 INFO:tasks.rados.rados.0.trial082.stdout:783: done (2 left) 2026-02-12T17:31:46.685 INFO:tasks.rados.rados.0.trial082.stdout:784: done (1 left) 2026-02-12T17:31:46.685 INFO:tasks.rados.rados.0.trial082.stdout:786: done (0 left) 2026-02-12T17:31:46.685 INFO:tasks.rados.rados.0.trial082.stdout:787: delete oid 12 current snap is 85 2026-02-12T17:31:46.687 INFO:tasks.rados.rados.0.trial082.stdout:787: done (0 left) 2026-02-12T17:31:46.687 INFO:tasks.rados.rados.0.trial082.stdout:788: read oid 32 snap -1 2026-02-12T17:31:46.687 INFO:tasks.rados.rados.0.trial082.stdout:788: expect (ObjNum 288 snap 82 seq_num 288) 2026-02-12T17:31:46.687 INFO:tasks.rados.rados.0.trial082.stdout:789: read oid 34 snap -1 2026-02-12T17:31:46.687 INFO:tasks.rados.rados.0.trial082.stdout:789: expect (ObjNum 263 snap 76 seq_num 263) 2026-02-12T17:31:46.687 INFO:tasks.rados.rados.0.trial082.stdout:790: write oid 14 current snap is 85 2026-02-12T17:31:46.687 INFO:tasks.rados.rados.0.trial082.stdout:790: seq_num 300 ranges {642100=712467,1872245=637761} 2026-02-12T17:31:46.692 INFO:tasks.rados.rados.0.trial082.stdout:790: writing trial08226312-14 from 642100 to 1354567 tid 1 2026-02-12T17:31:46.696 INFO:tasks.rados.rados.0.trial082.stdout:790: writing trial08226312-14 from 1872245 to 2510006 tid 2 2026-02-12T17:31:46.696 INFO:tasks.rados.rados.0.trial082.stdout:791: copy_from oid 7 from oid 3 current snap is 85 2026-02-12T17:31:46.697 INFO:tasks.rados.rados.0.trial082.stdout:788: expect (ObjNum 288 snap 82 seq_num 288) 2026-02-12T17:31:46.747 INFO:tasks.rados.rados.0.trial082.stdout:789: expect (ObjNum 263 snap 76 seq_num 263) 2026-02-12T17:31:46.807 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 727803 2026-02-12T17:31:46.832 INFO:tasks.rados.rados.0.trial082.stdout:790: finishing write tid 1 to trial08226312-14 2026-02-12T17:31:46.833 INFO:tasks.rados.rados.0.trial082.stdout:788: done (3 left) 2026-02-12T17:31:46.833 INFO:tasks.rados.rados.0.trial082.stdout:789: done (2 left) 2026-02-12T17:31:46.833 INFO:tasks.rados.rados.0.trial082.stdout:792: copy_from oid 17 from oid 46 current snap is 85 2026-02-12T17:31:46.833 INFO:tasks.rados.rados.0.trial082.stdout:790: finishing write tid 2 to trial08226312-14 2026-02-12T17:31:46.833 INFO:tasks.rados.rados.0.trial082.stdout:790: finishing write tid 3 to trial08226312-14 2026-02-12T17:31:46.833 INFO:tasks.rados.rados.0.trial082.stdout:790: finishing write tid 4 to trial08226312-14 2026-02-12T17:31:46.833 INFO:tasks.rados.rados.0.trial082.stdout:790: oid 14 updating version 0 to 420 2026-02-12T17:31:46.833 INFO:tasks.rados.rados.0.trial082.stdout:790: oid 14 version 420 is already newer than 419 2026-02-12T17:31:46.833 INFO:tasks.rados.rados.0.trial082.stdout:790: oid 14 version 420 is already newer than 418 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 420 (ObjNum 300 snap 85 seq_num 300) dirty exists 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:790: left oid 14 (ObjNum 300 snap 85 seq_num 300) 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:791: finishing copy_from racing read to trial08226312-7 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:791: finishing copy_from to trial08226312-7 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 280 (ObjNum 261 snap 76 seq_num 261) dirty exists 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:790: done (2 left) 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:791: done (1 left) 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:793: rollback oid 13 current snap is 85 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 81 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:794: write (excl) oid 35 current snap is 85 2026-02-12T17:31:46.834 INFO:tasks.rados.rados.0.trial082.stdout:794: seq_num 301 ranges {658907=787716,1930727=497772,3032909=25998} 2026-02-12T17:31:46.837 INFO:tasks.rados.rados.0.trial082.stdout:794: writing trial08226312-35 from 658907 to 1446623 tid 1 2026-02-12T17:31:46.841 INFO:tasks.rados.rados.0.trial082.stdout:794: writing trial08226312-35 from 1930727 to 2428499 tid 2 2026-02-12T17:31:46.843 INFO:tasks.rados.rados.0.trial082.stdout:794: writing trial08226312-35 from 3032909 to 3058907 tid 3 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:795: snap_create 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:792: finishing copy_from to trial08226312-17 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:792: got expected ENOENT (src dne) 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:792: finishing copy_from racing read to trial08226312-17 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:793: finishing rollback tid 0 to trial08226312-13 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:793: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:793: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 195 (ObjNum 192 snap 50 seq_num 192) dirty exists 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:794: finishing write tid 1 to trial08226312-35 2026-02-12T17:31:46.844 INFO:tasks.rados.rados.0.trial082.stdout:794: finishing write tid 2 to trial08226312-35 2026-02-12T17:31:46.845 INFO:tasks.rados.rados.0.trial082.stdout:794: finishing write tid 3 to trial08226312-35 2026-02-12T17:31:46.845 INFO:tasks.rados.rados.0.trial082.stdout:794: finishing write tid 4 to trial08226312-35 2026-02-12T17:31:46.845 INFO:tasks.rados.rados.0.trial082.stdout:794: finishing write tid 5 to trial08226312-35 2026-02-12T17:31:46.845 INFO:tasks.rados.rados.0.trial082.stdout:794: oid 35 updating version 0 to 358 2026-02-12T17:31:46.846 INFO:tasks.rados.rados.0.trial082.stdout:794: oid 35 updating version 358 to 361 2026-02-12T17:31:46.846 INFO:tasks.rados.rados.0.trial082.stdout:794: oid 35 version 361 is already newer than 359 2026-02-12T17:31:46.846 INFO:tasks.rados.rados.0.trial082.stdout:794: oid 35 version 361 is already newer than 360 2026-02-12T17:31:46.846 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 361 (ObjNum 301 snap 85 seq_num 301) dirty exists 2026-02-12T17:31:46.846 INFO:tasks.rados.rados.0.trial082.stdout:794: left oid 35 (ObjNum 301 snap 85 seq_num 301) 2026-02-12T17:31:47.634 INFO:tasks.rados.rados.0.trial082.stdout:792: done (3 left) 2026-02-12T17:31:47.634 INFO:tasks.rados.rados.0.trial082.stdout:793: done (2 left) 2026-02-12T17:31:47.635 INFO:tasks.rados.rados.0.trial082.stdout:794: done (1 left) 2026-02-12T17:31:47.635 INFO:tasks.rados.rados.0.trial082.stdout:795: done (0 left) 2026-02-12T17:31:47.635 INFO:tasks.rados.rados.0.trial082.stdout:796: delete oid 18 current snap is 86 2026-02-12T17:31:47.635 INFO:tasks.rados.rados.0.trial082.stdout:796: done (0 left) 2026-02-12T17:31:47.636 INFO:tasks.rados.rados.0.trial082.stdout:797: copy_from oid 20 from oid 4 current snap is 86 2026-02-12T17:31:47.636 INFO:tasks.rados.rados.0.trial082.stdout:798: snap_remove snap 83 2026-02-12T17:31:48.637 INFO:tasks.rados.rados.0.trial082.stdout:798: done (1 left) 2026-02-12T17:31:48.637 INFO:tasks.rados.rados.0.trial082.stdout:799: write (excl) oid 47 current snap is 86 2026-02-12T17:31:48.637 INFO:tasks.rados.rados.0.trial082.stdout:799: seq_num 303 ranges {692521=538214,1931338=785088} 2026-02-12T17:31:48.641 INFO:tasks.rados.rados.0.trial082.stdout:799: writing trial08226312-47 from 692521 to 1230735 tid 1 2026-02-12T17:31:48.647 INFO:tasks.rados.rados.0.trial082.stdout:799: writing trial08226312-47 from 1931338 to 2716426 tid 2 2026-02-12T17:31:48.647 INFO:tasks.rados.rados.0.trial082.stdout:800: copy_from oid 15 from oid 12 current snap is 86 2026-02-12T17:31:48.647 INFO:tasks.rados.rados.0.trial082.stdout:797: finishing copy_from racing read to trial08226312-20 2026-02-12T17:31:48.647 INFO:tasks.rados.rados.0.trial082.stdout:797: finishing copy_from to trial08226312-20 2026-02-12T17:31:48.647 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 441 (ObjNum 294 snap 83 seq_num 294) dirty exists 2026-02-12T17:31:48.648 INFO:tasks.rados.rados.0.trial082.stdout:799: finishing write tid 1 to trial08226312-47 2026-02-12T17:31:48.648 INFO:tasks.rados.rados.0.trial082.stdout:797: done (2 left) 2026-02-12T17:31:48.648 INFO:tasks.rados.rados.0.trial082.stdout:801: snap_create 2026-02-12T17:31:48.648 INFO:tasks.rados.rados.0.trial082.stdout:800: finishing copy_from to trial08226312-15 2026-02-12T17:31:48.648 INFO:tasks.rados.rados.0.trial082.stdout:800: got expected ENOENT (src dne) 2026-02-12T17:31:48.648 INFO:tasks.rados.rados.0.trial082.stdout:800: finishing copy_from racing read to trial08226312-15 2026-02-12T17:31:48.649 INFO:tasks.rados.rados.0.trial082.stdout:799: finishing write tid 2 to trial08226312-47 2026-02-12T17:31:48.649 INFO:tasks.rados.rados.0.trial082.stdout:799: finishing write tid 3 to trial08226312-47 2026-02-12T17:31:48.649 INFO:tasks.rados.rados.0.trial082.stdout:799: finishing write tid 4 to trial08226312-47 2026-02-12T17:31:48.649 INFO:tasks.rados.rados.0.trial082.stdout:799: oid 47 updating version 0 to 470 2026-02-12T17:31:48.649 INFO:tasks.rados.rados.0.trial082.stdout:799: oid 47 version 470 is already newer than 469 2026-02-12T17:31:48.649 INFO:tasks.rados.rados.0.trial082.stdout:799: oid 47 updating version 470 to 471 2026-02-12T17:31:48.650 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 471 (ObjNum 303 snap 86 seq_num 303) dirty exists 2026-02-12T17:31:48.650 INFO:tasks.rados.rados.0.trial082.stdout:799: left oid 47 (ObjNum 303 snap 86 seq_num 303) 2026-02-12T17:31:49.640 INFO:tasks.rados.rados.0.trial082.stdout:799: done (2 left) 2026-02-12T17:31:49.640 INFO:tasks.rados.rados.0.trial082.stdout:800: done (1 left) 2026-02-12T17:31:49.640 INFO:tasks.rados.rados.0.trial082.stdout:801: done (0 left) 2026-02-12T17:31:49.640 INFO:tasks.rados.rados.0.trial082.stdout:802: read oid 5 snap 69 2026-02-12T17:31:49.641 INFO:tasks.rados.rados.0.trial082.stdout:802: expect (ObjNum 230 snap 62 seq_num 230) 2026-02-12T17:31:49.641 INFO:tasks.rados.rados.0.trial082.stdout:803: read oid 40 snap -1 2026-02-12T17:31:49.641 INFO:tasks.rados.rados.0.trial082.stdout:803: expect (ObjNum 182 snap 46 seq_num 182) 2026-02-12T17:31:49.641 INFO:tasks.rados.rados.0.trial082.stdout:804: write oid 33 current snap is 87 2026-02-12T17:31:49.641 INFO:tasks.rados.rados.0.trial082.stdout:804: seq_num 304 ranges {709328=613463,1989820=645099} 2026-02-12T17:31:49.644 INFO:tasks.rados.rados.0.trial082.stdout:804: writing trial08226312-33 from 709328 to 1322791 tid 1 2026-02-12T17:31:49.650 INFO:tasks.rados.rados.0.trial082.stdout:804: writing trial08226312-33 from 1989820 to 2634919 tid 2 2026-02-12T17:31:49.650 INFO:tasks.rados.rados.0.trial082.stdout:805: copy_from oid 37 from oid 38 current snap is 87 2026-02-12T17:31:49.650 INFO:tasks.rados.rados.0.trial082.stdout:803: expect (ObjNum 182 snap 46 seq_num 182) 2026-02-12T17:31:49.733 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:49.774 INFO:tasks.rados.rados.0.trial082.stdout:804: finishing write tid 1 to trial08226312-33 2026-02-12T17:31:49.774 INFO:tasks.rados.rados.0.trial082.stdout:802: expect (ObjNum 230 snap 62 seq_num 230) 2026-02-12T17:31:49.827 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:49.886 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 474745 2026-02-12T17:31:49.940 INFO:tasks.rados.rados.0.trial082.stdout:804: finishing write tid 2 to trial08226312-33 2026-02-12T17:31:49.940 INFO:tasks.rados.rados.0.trial082.stdout:804: finishing write tid 3 to trial08226312-33 2026-02-12T17:31:49.940 INFO:tasks.rados.rados.0.trial082.stdout:802: done (3 left) 2026-02-12T17:31:49.940 INFO:tasks.rados.rados.0.trial082.stdout:803: done (2 left) 2026-02-12T17:31:49.940 INFO:tasks.rados.rados.0.trial082.stdout:806: snap_remove snap 71 2026-02-12T17:31:50.642 INFO:tasks.rados.rados.0.trial082.stdout:806: done (2 left) 2026-02-12T17:31:50.643 INFO:tasks.rados.rados.0.trial082.stdout:807: snap_create 2026-02-12T17:31:50.643 INFO:tasks.rados.rados.0.trial082.stdout:804: finishing write tid 4 to trial08226312-33 2026-02-12T17:31:50.643 INFO:tasks.rados.rados.0.trial082.stdout:804: oid 33 updating version 0 to 228 2026-02-12T17:31:50.643 INFO:tasks.rados.rados.0.trial082.stdout:804: oid 33 version 228 is already newer than 227 2026-02-12T17:31:50.643 INFO:tasks.rados.rados.0.trial082.stdout:804: oid 33 version 228 is already newer than 226 2026-02-12T17:31:50.643 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 228 (ObjNum 304 snap 87 seq_num 304) dirty exists 2026-02-12T17:31:50.643 INFO:tasks.rados.rados.0.trial082.stdout:804: left oid 33 (ObjNum 304 snap 87 seq_num 304) 2026-02-12T17:31:50.643 INFO:tasks.rados.rados.0.trial082.stdout:805: finishing copy_from racing read to trial08226312-37 2026-02-12T17:31:50.643 INFO:tasks.rados.rados.0.trial082.stdout:805: finishing copy_from to trial08226312-37 2026-02-12T17:31:50.644 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 198 (ObjNum 292 snap 82 seq_num 292) dirty exists 2026-02-12T17:31:51.645 INFO:tasks.rados.rados.0.trial082.stdout:804: done (2 left) 2026-02-12T17:31:51.645 INFO:tasks.rados.rados.0.trial082.stdout:805: done (1 left) 2026-02-12T17:31:51.646 INFO:tasks.rados.rados.0.trial082.stdout:807: done (0 left) 2026-02-12T17:31:51.646 INFO:tasks.rados.rados.0.trial082.stdout:808: rollback oid 18 current snap is 88 2026-02-12T17:31:51.646 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 79 2026-02-12T17:31:51.646 INFO:tasks.rados.rados.0.trial082.stdout:809: read oid 19 snap -1 2026-02-12T17:31:51.646 INFO:tasks.rados.rados.0.trial082.stdout:809: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:31:51.646 INFO:tasks.rados.rados.0.trial082.stdout:810: delete oid 11 current snap is 88 2026-02-12T17:31:51.647 INFO:tasks.rados.rados.0.trial082.stdout:808: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:31:51.647 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 0 (ObjNum 305 snap 0 seq_num 27035603) dirty dne 2026-02-12T17:31:51.649 INFO:tasks.rados.rados.0.trial082.stdout:808: done (2 left) 2026-02-12T17:31:51.649 INFO:tasks.rados.rados.0.trial082.stdout:810: done (1 left) 2026-02-12T17:31:51.649 INFO:tasks.rados.rados.0.trial082.stdout:811: read oid 2 snap 85 2026-02-12T17:31:51.649 INFO:tasks.rados.rados.0.trial082.stdout:811: expect (ObjNum 291 snap 82 seq_num 291) 2026-02-12T17:31:51.649 INFO:tasks.rados.rados.0.trial082.stdout:812: delete oid 16 current snap is 88 2026-02-12T17:31:51.649 INFO:tasks.rados.rados.0.trial082.stdout:809: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:31:51.649 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 231748 2026-02-12T17:31:51.701 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1284096 2026-02-12T17:31:51.776 INFO:tasks.rados.rados.0.trial082.stdout:811: expect (ObjNum 291 snap 82 seq_num 291) 2026-02-12T17:31:51.776 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:51.819 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 931140 2026-02-12T17:31:51.876 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1954342 2026-02-12T17:31:51.886 INFO:tasks.rados.rados.0.trial082.stdout:809: done (2 left) 2026-02-12T17:31:51.886 INFO:tasks.rados.rados.0.trial082.stdout:811: done (1 left) 2026-02-12T17:31:51.886 INFO:tasks.rados.rados.0.trial082.stdout:812: done (0 left) 2026-02-12T17:31:51.886 INFO:tasks.rados.rados.0.trial082.stdout:813: rollback oid 22 current snap is 88 2026-02-12T17:31:51.886 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 77 2026-02-12T17:31:51.886 INFO:tasks.rados.rados.0.trial082.stdout:814: write (excl) oid 18 current snap is 88 2026-02-12T17:31:51.886 INFO:tasks.rados.rados.0.trial082.stdout:814: seq_num 307 ranges {759749=555563,1765266=792426,2964741=195008} 2026-02-12T17:31:51.891 INFO:tasks.rados.rados.0.trial082.stdout:814: writing trial08226312-18 from 759749 to 1315312 tid 1 2026-02-12T17:31:51.896 INFO:tasks.rados.rados.0.trial082.stdout:814: writing trial08226312-18 from 1765266 to 2557692 tid 2 2026-02-12T17:31:51.898 INFO:tasks.rados.rados.0.trial082.stdout:814: writing trial08226312-18 from 2964741 to 3159749 tid 3 2026-02-12T17:31:51.898 INFO:tasks.rados.rados.0.trial082.stdout:815: write (excl) oid 8 current snap is 88 2026-02-12T17:31:51.898 INFO:tasks.rados.rados.0.trial082.stdout:815: seq_num 308 ranges {776556=630812,1823748=652437,3108517=68039} 2026-02-12T17:31:51.903 INFO:tasks.rados.rados.0.trial082.stdout:815: writing trial08226312-8 from 776556 to 1407368 tid 1 2026-02-12T17:31:51.908 INFO:tasks.rados.rados.0.trial082.stdout:815: writing trial08226312-8 from 1823748 to 2476185 tid 2 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:815: writing trial08226312-8 from 3108517 to 3176556 tid 3 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:816: snap_create 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:813: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:813: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 340 (ObjNum 258 snap 74 seq_num 258) dirty exists 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:814: finishing write tid 1 to trial08226312-18 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:814: finishing write tid 2 to trial08226312-18 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:814: finishing write tid 3 to trial08226312-18 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:814: finishing write tid 4 to trial08226312-18 2026-02-12T17:31:51.911 INFO:tasks.rados.rados.0.trial082.stdout:814: finishing write tid 5 to trial08226312-18 2026-02-12T17:31:51.912 INFO:tasks.rados.rados.0.trial082.stdout:814: oid 18 updating version 0 to 204 2026-02-12T17:31:51.912 INFO:tasks.rados.rados.0.trial082.stdout:814: oid 18 version 204 is already newer than 203 2026-02-12T17:31:51.912 INFO:tasks.rados.rados.0.trial082.stdout:814: oid 18 version 204 is already newer than 201 2026-02-12T17:31:51.912 INFO:tasks.rados.rados.0.trial082.stdout:814: oid 18 version 204 is already newer than 202 2026-02-12T17:31:51.912 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 204 (ObjNum 307 snap 88 seq_num 307) dirty exists 2026-02-12T17:31:51.912 INFO:tasks.rados.rados.0.trial082.stdout:814: left oid 18 (ObjNum 307 snap 88 seq_num 307) 2026-02-12T17:31:51.912 INFO:tasks.rados.rados.0.trial082.stdout:815: finishing write tid 1 to trial08226312-8 2026-02-12T17:31:51.912 INFO:tasks.rados.rados.0.trial082.stdout:815: finishing write tid 2 to trial08226312-8 2026-02-12T17:31:51.913 INFO:tasks.rados.rados.0.trial082.stdout:815: finishing write tid 3 to trial08226312-8 2026-02-12T17:31:51.913 INFO:tasks.rados.rados.0.trial082.stdout:815: finishing write tid 4 to trial08226312-8 2026-02-12T17:31:51.913 INFO:tasks.rados.rados.0.trial082.stdout:815: finishing write tid 5 to trial08226312-8 2026-02-12T17:31:51.913 INFO:tasks.rados.rados.0.trial082.stdout:815: oid 8 updating version 0 to 490 2026-02-12T17:31:51.913 INFO:tasks.rados.rados.0.trial082.stdout:815: oid 8 version 490 is already newer than 489 2026-02-12T17:31:51.913 INFO:tasks.rados.rados.0.trial082.stdout:815: oid 8 version 490 is already newer than 487 2026-02-12T17:31:51.913 INFO:tasks.rados.rados.0.trial082.stdout:815: oid 8 version 490 is already newer than 488 2026-02-12T17:31:51.914 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 490 (ObjNum 308 snap 88 seq_num 308) dirty exists 2026-02-12T17:31:51.914 INFO:tasks.rados.rados.0.trial082.stdout:815: left oid 8 (ObjNum 308 snap 88 seq_num 308) 2026-02-12T17:31:52.647 INFO:tasks.rados.rados.0.trial082.stdout:813: done (3 left) 2026-02-12T17:31:52.647 INFO:tasks.rados.rados.0.trial082.stdout:814: done (2 left) 2026-02-12T17:31:52.648 INFO:tasks.rados.rados.0.trial082.stdout:815: done (1 left) 2026-02-12T17:31:52.648 INFO:tasks.rados.rados.0.trial082.stdout:816: done (0 left) 2026-02-12T17:31:52.648 INFO:tasks.rados.rados.0.trial082.stdout:817: delete oid 35 current snap is 89 2026-02-12T17:31:52.650 INFO:tasks.rados.rados.0.trial082.stdout:817: done (0 left) 2026-02-12T17:31:52.650 INFO:tasks.rados.rados.0.trial082.stdout:818: rollback oid 35 current snap is 89 2026-02-12T17:31:52.650 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 35 to 84 2026-02-12T17:31:52.650 INFO:tasks.rados.rados.0.trial082.stdout:819: read oid 28 snap 77 2026-02-12T17:31:52.650 INFO:tasks.rados.rados.0.trial082.stdout:819: expect (ObjNum 205 snap 55 seq_num 205) 2026-02-12T17:31:52.650 INFO:tasks.rados.rados.0.trial082.stdout:820: write (excl) oid 32 current snap is 89 2026-02-12T17:31:52.650 INFO:tasks.rados.rados.0.trial082.stdout:820: seq_num 310 ranges {410170=781310,1940712=656106,3163363=46807} 2026-02-12T17:31:52.654 INFO:tasks.rados.rados.0.trial082.stdout:820: writing trial08226312-32 from 410170 to 1191480 tid 1 2026-02-12T17:31:52.659 INFO:tasks.rados.rados.0.trial082.stdout:820: writing trial08226312-32 from 1940712 to 2596818 tid 2 2026-02-12T17:31:52.662 INFO:tasks.rados.rados.0.trial082.stdout:820: writing trial08226312-32 from 3163363 to 3210170 tid 3 2026-02-12T17:31:52.662 INFO:tasks.rados.rados.0.trial082.stdout:821: copy_from oid 6 from oid 49 current snap is 89 2026-02-12T17:31:52.662 INFO:tasks.rados.rados.0.trial082.stdout:818: finishing rollback tid 1 to trial08226312-35 2026-02-12T17:31:52.662 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 369 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-12T17:31:52.662 INFO:tasks.rados.rados.0.trial082.stdout:819: expect (ObjNum 205 snap 55 seq_num 205) 2026-02-12T17:31:52.705 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:52.748 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 101499 2026-02-12T17:31:52.792 INFO:tasks.rados.rados.0.trial082.stdout:820: finishing write tid 1 to trial08226312-32 2026-02-12T17:31:52.792 INFO:tasks.rados.rados.0.trial082.stdout:820: finishing write tid 2 to trial08226312-32 2026-02-12T17:31:52.792 INFO:tasks.rados.rados.0.trial082.stdout:818: done (3 left) 2026-02-12T17:31:52.792 INFO:tasks.rados.rados.0.trial082.stdout:819: done (2 left) 2026-02-12T17:31:52.792 INFO:tasks.rados.rados.0.trial082.stdout:822: snap_create 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:820: finishing write tid 3 to trial08226312-32 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:820: finishing write tid 4 to trial08226312-32 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:820: finishing write tid 5 to trial08226312-32 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:820: oid 32 updating version 0 to 212 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:820: oid 32 version 212 is already newer than 210 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:820: oid 32 version 212 is already newer than 211 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:820: oid 32 updating version 212 to 213 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 213 (ObjNum 310 snap 89 seq_num 310) dirty exists 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:820: left oid 32 (ObjNum 310 snap 89 seq_num 310) 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:821: finishing copy_from racing read to trial08226312-6 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:821: finishing copy_from to trial08226312-6 2026-02-12T17:31:52.793 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 124 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:31:53.652 INFO:tasks.rados.rados.0.trial082.stdout:820: done (2 left) 2026-02-12T17:31:53.652 INFO:tasks.rados.rados.0.trial082.stdout:821: done (1 left) 2026-02-12T17:31:53.652 INFO:tasks.rados.rados.0.trial082.stdout:822: done (0 left) 2026-02-12T17:31:53.652 INFO:tasks.rados.rados.0.trial082.stdout:823: read oid 1 snap -1 2026-02-12T17:31:53.652 INFO:tasks.rados.rados.0.trial082.stdout:823: expect deleted 2026-02-12T17:31:53.652 INFO:tasks.rados.rados.0.trial082.stdout:824: read oid 8 snap -1 2026-02-12T17:31:53.652 INFO:tasks.rados.rados.0.trial082.stdout:824: expect (ObjNum 308 snap 88 seq_num 308) 2026-02-12T17:31:53.652 INFO:tasks.rados.rados.0.trial082.stdout:825: read oid 9 snap 74 2026-02-12T17:31:53.652 INFO:tasks.rados.rados.0.trial082.stdout:825: expect (ObjNum 182 snap 46 seq_num 182) 2026-02-12T17:31:53.653 INFO:tasks.rados.rados.0.trial082.stdout:826: delete oid 24 current snap is 90 2026-02-12T17:31:53.655 INFO:tasks.rados.rados.0.trial082.stdout:824: expect (ObjNum 308 snap 88 seq_num 308) 2026-02-12T17:31:53.726 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 314994 2026-02-12T17:31:53.763 INFO:tasks.rados.rados.0.trial082.stdout:825: expect (ObjNum 182 snap 46 seq_num 182) 2026-02-12T17:31:53.786 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2212442 2026-02-12T17:31:53.858 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2228946 2026-02-12T17:31:53.870 INFO:tasks.rados.rados.0.trial082.stdout:823: done (3 left) 2026-02-12T17:31:53.870 INFO:tasks.rados.rados.0.trial082.stdout:824: done (2 left) 2026-02-12T17:31:53.870 INFO:tasks.rados.rados.0.trial082.stdout:825: done (1 left) 2026-02-12T17:31:53.871 INFO:tasks.rados.rados.0.trial082.stdout:826: done (0 left) 2026-02-12T17:31:53.871 INFO:tasks.rados.rados.0.trial082.stdout:827: rollback oid 23 current snap is 90 2026-02-12T17:31:53.871 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 23 to 69 2026-02-12T17:31:53.871 INFO:tasks.rados.rados.0.trial082.stdout:828: rollback oid 28 current snap is 90 2026-02-12T17:31:53.871 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 88 2026-02-12T17:31:53.871 INFO:tasks.rados.rados.0.trial082.stdout:829: delete oid 15 current snap is 90 2026-02-12T17:31:53.871 INFO:tasks.rados.rados.0.trial082.stdout:827: finishing rollback tid 1 to trial08226312-23 2026-02-12T17:31:53.872 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 0 (ObjNum 26816112 snap 0 seq_num 304) dirty dne 2026-02-12T17:31:53.872 INFO:tasks.rados.rados.0.trial082.stdout:827: done (2 left) 2026-02-12T17:31:53.872 INFO:tasks.rados.rados.0.trial082.stdout:829: done (1 left) 2026-02-12T17:31:53.872 INFO:tasks.rados.rados.0.trial082.stdout:830: read oid 3 snap -1 2026-02-12T17:31:53.872 INFO:tasks.rados.rados.0.trial082.stdout:830: expect (ObjNum 261 snap 76 seq_num 261) 2026-02-12T17:31:53.873 INFO:tasks.rados.rados.0.trial082.stdout:831: write oid 4 current snap is 90 2026-02-12T17:31:53.873 INFO:tasks.rados.rados.0.trial082.stdout:831: seq_num 313 ranges {460591=723410,1716158=403433,2729279=440140} 2026-02-12T17:31:53.876 INFO:tasks.rados.rados.0.trial082.stdout:831: writing trial08226312-4 from 460591 to 1184001 tid 1 2026-02-12T17:31:53.880 INFO:tasks.rados.rados.0.trial082.stdout:831: writing trial08226312-4 from 1716158 to 2119591 tid 2 2026-02-12T17:31:53.884 INFO:tasks.rados.rados.0.trial082.stdout:831: writing trial08226312-4 from 2729279 to 3169419 tid 3 2026-02-12T17:31:53.884 INFO:tasks.rados.rados.0.trial082.stdout:832: write (excl) oid 40 current snap is 90 2026-02-12T17:31:53.884 INFO:tasks.rados.rados.0.trial082.stdout:832: seq_num 314 ranges {477398=798659,1774640=663444,2873055=404343} 2026-02-12T17:31:53.888 INFO:tasks.rados.rados.0.trial082.stdout:832: writing trial08226312-40 from 477398 to 1276057 tid 1 2026-02-12T17:31:53.893 INFO:tasks.rados.rados.0.trial082.stdout:832: writing trial08226312-40 from 1774640 to 2438084 tid 2 2026-02-12T17:31:53.896 INFO:tasks.rados.rados.0.trial082.stdout:832: writing trial08226312-40 from 2873055 to 3277398 tid 3 2026-02-12T17:31:53.896 INFO:tasks.rados.rados.0.trial082.stdout:833: snap_create 2026-02-12T17:31:53.896 INFO:tasks.rados.rados.0.trial082.stdout:828: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:31:53.897 INFO:tasks.rados.rados.0.trial082.stdout:828: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:31:53.897 INFO:tasks.rados.rados.0.trial082.stdout:828: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:31:53.897 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 458 (ObjNum 261 snap 76 seq_num 261) dirty exists 2026-02-12T17:31:53.897 INFO:tasks.rados.rados.0.trial082.stdout:830: expect (ObjNum 261 snap 76 seq_num 261) 2026-02-12T17:31:53.897 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:54.006 INFO:tasks.rados.rados.0.trial082.stdout:831: finishing write tid 1 to trial08226312-4 2026-02-12T17:31:54.006 INFO:tasks.rados.rados.0.trial082.stdout:831: finishing write tid 2 to trial08226312-4 2026-02-12T17:31:54.006 INFO:tasks.rados.rados.0.trial082.stdout:831: finishing write tid 3 to trial08226312-4 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:831: finishing write tid 4 to trial08226312-4 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:831: finishing write tid 5 to trial08226312-4 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:831: oid 4 updating version 0 to 495 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:831: oid 4 version 495 is already newer than 494 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:831: oid 4 version 495 is already newer than 493 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:831: oid 4 updating version 495 to 496 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 496 (ObjNum 313 snap 90 seq_num 313) dirty exists 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:831: left oid 4 (ObjNum 313 snap 90 seq_num 313) 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:832: finishing write tid 1 to trial08226312-40 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:832: finishing write tid 2 to trial08226312-40 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:832: finishing write tid 3 to trial08226312-40 2026-02-12T17:31:54.007 INFO:tasks.rados.rados.0.trial082.stdout:832: finishing write tid 4 to trial08226312-40 2026-02-12T17:31:54.008 INFO:tasks.rados.rados.0.trial082.stdout:832: finishing write tid 5 to trial08226312-40 2026-02-12T17:31:54.008 INFO:tasks.rados.rados.0.trial082.stdout:832: oid 40 updating version 0 to 460 2026-02-12T17:31:54.008 INFO:tasks.rados.rados.0.trial082.stdout:832: oid 40 updating version 460 to 461 2026-02-12T17:31:54.008 INFO:tasks.rados.rados.0.trial082.stdout:832: oid 40 updating version 461 to 462 2026-02-12T17:31:54.008 INFO:tasks.rados.rados.0.trial082.stdout:832: oid 40 updating version 462 to 463 2026-02-12T17:31:54.008 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 463 (ObjNum 314 snap 90 seq_num 314) dirty exists 2026-02-12T17:31:54.008 INFO:tasks.rados.rados.0.trial082.stdout:832: left oid 40 (ObjNum 314 snap 90 seq_num 314) 2026-02-12T17:31:54.655 INFO:tasks.rados.rados.0.trial082.stdout:828: done (4 left) 2026-02-12T17:31:54.656 INFO:tasks.rados.rados.0.trial082.stdout:830: done (3 left) 2026-02-12T17:31:54.656 INFO:tasks.rados.rados.0.trial082.stdout:831: done (2 left) 2026-02-12T17:31:54.656 INFO:tasks.rados.rados.0.trial082.stdout:832: done (1 left) 2026-02-12T17:31:54.656 INFO:tasks.rados.rados.0.trial082.stdout:833: done (0 left) 2026-02-12T17:31:54.656 INFO:tasks.rados.rados.0.trial082.stdout:834: snap_create 2026-02-12T17:31:55.658 INFO:tasks.rados.rados.0.trial082.stdout:834: done (0 left) 2026-02-12T17:31:55.659 INFO:tasks.rados.rados.0.trial082.stdout:835: read oid 14 snap -1 2026-02-12T17:31:55.659 INFO:tasks.rados.rados.0.trial082.stdout:835: expect (ObjNum 300 snap 85 seq_num 300) 2026-02-12T17:31:55.659 INFO:tasks.rados.rados.0.trial082.stdout:836: rollback oid 21 current snap is 92 2026-02-12T17:31:55.659 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 91 2026-02-12T17:31:55.659 INFO:tasks.rados.rados.0.trial082.stdout:837: read oid 8 snap 81 2026-02-12T17:31:55.659 INFO:tasks.rados.rados.0.trial082.stdout:837: expect (ObjNum 256 snap 74 seq_num 256) 2026-02-12T17:31:55.659 INFO:tasks.rados.rados.0.trial082.stdout:838: read oid 48 snap -1 2026-02-12T17:31:55.659 INFO:tasks.rados.rados.0.trial082.stdout:838: expect (ObjNum 218 snap 59 seq_num 218) 2026-02-12T17:31:55.659 INFO:tasks.rados.rados.0.trial082.stdout:839: read oid 46 snap 85 2026-02-12T17:31:55.660 INFO:tasks.rados.rados.0.trial082.stdout:839: expect deleted 2026-02-12T17:31:55.660 INFO:tasks.rados.rados.0.trial082.stdout:840: read oid 18 snap -1 2026-02-12T17:31:55.660 INFO:tasks.rados.rados.0.trial082.stdout:840: expect (ObjNum 307 snap 88 seq_num 307) 2026-02-12T17:31:55.660 INFO:tasks.rados.rados.0.trial082.stdout:841: read oid 23 snap 87 2026-02-12T17:31:55.660 INFO:tasks.rados.rados.0.trial082.stdout:841: expect deleted 2026-02-12T17:31:55.660 INFO:tasks.rados.rados.0.trial082.stdout:842: read oid 9 snap -1 2026-02-12T17:31:55.660 INFO:tasks.rados.rados.0.trial082.stdout:842: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:31:55.660 INFO:tasks.rados.rados.0.trial082.stdout:843: copy_from oid 20 from oid 43 current snap is 92 2026-02-12T17:31:55.660 INFO:tasks.rados.rados.0.trial082.stdout:844: snap_create 2026-02-12T17:31:55.661 INFO:tasks.rados.rados.0.trial082.stdout:836: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:31:55.661 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 295 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:31:55.662 INFO:tasks.rados.rados.0.trial082.stdout:837: expect (ObjNum 256 snap 74 seq_num 256) 2026-02-12T17:31:55.721 INFO:tasks.rados.rados.0.trial082.stdout:843: finishing copy_from to trial08226312-20 2026-02-12T17:31:55.722 INFO:tasks.rados.rados.0.trial082.stdout:843: got expected ENOENT (src dne) 2026-02-12T17:31:55.722 INFO:tasks.rados.rados.0.trial082.stdout:843: finishing copy_from racing read to trial08226312-20 2026-02-12T17:31:55.722 INFO:tasks.rados.rados.0.trial082.stdout:842: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:31:55.804 INFO:tasks.rados.rados.0.trial082.stdout:838: expect (ObjNum 218 snap 59 seq_num 218) 2026-02-12T17:31:55.819 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:55.862 INFO:tasks.rados.rados.0.trial082.stdout:840: expect (ObjNum 307 snap 88 seq_num 307) 2026-02-12T17:31:55.862 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:55.921 INFO:tasks.rados.rados.0.trial082.stdout:835: expect (ObjNum 300 snap 85 seq_num 300) 2026-02-12T17:31:55.948 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:55.978 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:56.660 INFO:tasks.rados.rados.0.trial082.stdout:835: done (9 left) 2026-02-12T17:31:56.660 INFO:tasks.rados.rados.0.trial082.stdout:836: done (8 left) 2026-02-12T17:31:56.660 INFO:tasks.rados.rados.0.trial082.stdout:837: done (7 left) 2026-02-12T17:31:56.660 INFO:tasks.rados.rados.0.trial082.stdout:838: done (6 left) 2026-02-12T17:31:56.660 INFO:tasks.rados.rados.0.trial082.stdout:839: done (5 left) 2026-02-12T17:31:56.660 INFO:tasks.rados.rados.0.trial082.stdout:840: done (4 left) 2026-02-12T17:31:56.661 INFO:tasks.rados.rados.0.trial082.stdout:841: done (3 left) 2026-02-12T17:31:56.661 INFO:tasks.rados.rados.0.trial082.stdout:842: done (2 left) 2026-02-12T17:31:56.661 INFO:tasks.rados.rados.0.trial082.stdout:843: done (1 left) 2026-02-12T17:31:56.661 INFO:tasks.rados.rados.0.trial082.stdout:844: done (0 left) 2026-02-12T17:31:56.661 INFO:tasks.rados.rados.0.trial082.stdout:845: write oid 45 current snap is 93 2026-02-12T17:31:56.661 INFO:tasks.rados.rados.0.trial082.stdout:845: seq_num 315 ranges {494205=473908,1433122=407102,2384125=462684} 2026-02-12T17:31:56.663 INFO:tasks.rados.rados.0.trial082.stdout:845: writing trial08226312-45 from 494205 to 968113 tid 1 2026-02-12T17:31:56.666 INFO:tasks.rados.rados.0.trial082.stdout:845: writing trial08226312-45 from 1433122 to 1840224 tid 2 2026-02-12T17:31:56.670 INFO:tasks.rados.rados.0.trial082.stdout:845: writing trial08226312-45 from 2384125 to 2846809 tid 3 2026-02-12T17:31:56.670 INFO:tasks.rados.rados.0.trial082.stdout:845: finishing write tid 1 to trial08226312-45 2026-02-12T17:31:56.671 INFO:tasks.rados.rados.0.trial082.stdout:845: finishing write tid 2 to trial08226312-45 2026-02-12T17:31:56.671 INFO:tasks.rados.rados.0.trial082.stdout:846: read oid 44 snap -1 2026-02-12T17:31:56.671 INFO:tasks.rados.rados.0.trial082.stdout:846: expect (ObjNum 236 snap 63 seq_num 236) 2026-02-12T17:31:56.671 INFO:tasks.rados.rados.0.trial082.stdout:847: rollback oid 7 current snap is 93 2026-02-12T17:31:56.671 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 7 to 69 2026-02-12T17:31:56.671 INFO:tasks.rados.rados.0.trial082.stdout:848: write (excl) oid 33 current snap is 93 2026-02-12T17:31:56.671 INFO:tasks.rados.rados.0.trial082.stdout:848: seq_num 316 ranges {511012=549157,1775251=550760,3095195=215817} 2026-02-12T17:31:56.674 INFO:tasks.rados.rados.0.trial082.stdout:848: writing trial08226312-33 from 511012 to 1060169 tid 1 2026-02-12T17:31:56.678 INFO:tasks.rados.rados.0.trial082.stdout:848: writing trial08226312-33 from 1775251 to 2326011 tid 2 2026-02-12T17:31:56.682 INFO:tasks.rados.rados.0.trial082.stdout:848: writing trial08226312-33 from 3095195 to 3311012 tid 3 2026-02-12T17:31:56.682 INFO:tasks.rados.rados.0.trial082.stdout:849: snap_remove snap 92 2026-02-12T17:31:57.637 INFO:tasks.rados.rados.0.trial082.stdout:849: done (4 left) 2026-02-12T17:31:57.637 INFO:tasks.rados.rados.0.trial082.stdout:850: delete oid 2 current snap is 93 2026-02-12T17:31:57.637 INFO:tasks.rados.rados.0.trial082.stdout:847: finishing rollback tid 0 to trial08226312-7 2026-02-12T17:31:57.637 INFO:tasks.rados.rados.0.trial082.stdout:847: finishing rollback tid 1 to trial08226312-7 2026-02-12T17:31:57.637 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 466 (ObjNum 33 snap 0 seq_num 6575) dirty dne 2026-02-12T17:31:57.637 INFO:tasks.rados.rados.0.trial082.stdout:846: expect (ObjNum 236 snap 63 seq_num 236) 2026-02-12T17:31:57.683 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3950507 2026-02-12T17:31:57.687 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:31:57.800 INFO:tasks.rados.rados.0.trial082.stdout:845: finishing write tid 3 to trial08226312-45 2026-02-12T17:31:57.800 INFO:tasks.rados.rados.0.trial082.stdout:845: finishing write tid 4 to trial08226312-45 2026-02-12T17:31:57.801 INFO:tasks.rados.rados.0.trial082.stdout:846: done (4 left) 2026-02-12T17:31:57.801 INFO:tasks.rados.rados.0.trial082.stdout:847: done (3 left) 2026-02-12T17:31:57.801 INFO:tasks.rados.rados.0.trial082.stdout:850: done (2 left) 2026-02-12T17:31:57.801 INFO:tasks.rados.rados.0.trial082.stdout:851: snap_remove snap 74 2026-02-12T17:31:58.665 INFO:tasks.rados.rados.0.trial082.stdout:851: done (2 left) 2026-02-12T17:31:58.665 INFO:tasks.rados.rados.0.trial082.stdout:852: copy_from oid 29 from oid 12 current snap is 93 2026-02-12T17:31:58.665 INFO:tasks.rados.rados.0.trial082.stdout:845: finishing write tid 5 to trial08226312-45 2026-02-12T17:31:58.665 INFO:tasks.rados.rados.0.trial082.stdout:845: oid 45 updating version 0 to 376 2026-02-12T17:31:58.665 INFO:tasks.rados.rados.0.trial082.stdout:845: oid 45 version 376 is already newer than 374 2026-02-12T17:31:58.665 INFO:tasks.rados.rados.0.trial082.stdout:845: oid 45 version 376 is already newer than 373 2026-02-12T17:31:58.665 INFO:tasks.rados.rados.0.trial082.stdout:845: oid 45 version 376 is already newer than 375 2026-02-12T17:31:58.665 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 376 (ObjNum 315 snap 93 seq_num 315) dirty exists 2026-02-12T17:31:58.666 INFO:tasks.rados.rados.0.trial082.stdout:845: left oid 45 (ObjNum 315 snap 93 seq_num 315) 2026-02-12T17:31:58.666 INFO:tasks.rados.rados.0.trial082.stdout:845: done (2 left) 2026-02-12T17:31:58.666 INFO:tasks.rados.rados.0.trial082.stdout:853: snap_remove snap 79 2026-02-12T17:31:59.667 INFO:tasks.rados.rados.0.trial082.stdout:853: done (2 left) 2026-02-12T17:31:59.667 INFO:tasks.rados.rados.0.trial082.stdout:854: write oid 30 current snap is 93 2026-02-12T17:31:59.667 INFO:tasks.rados.rados.0.trial082.stdout:854: seq_num 318 ranges {544626=699655,1892215=554429,3150041=194585} 2026-02-12T17:31:59.672 INFO:tasks.rados.rados.0.trial082.stdout:854: writing trial08226312-30 from 544626 to 1244281 tid 1 2026-02-12T17:31:59.676 INFO:tasks.rados.rados.0.trial082.stdout:854: writing trial08226312-30 from 1892215 to 2446644 tid 2 2026-02-12T17:31:59.680 INFO:tasks.rados.rados.0.trial082.stdout:854: writing trial08226312-30 from 3150041 to 3344626 tid 3 2026-02-12T17:31:59.680 INFO:tasks.rados.rados.0.trial082.stdout:855: snap_create 2026-02-12T17:31:59.680 INFO:tasks.rados.rados.0.trial082.stdout:848: finishing write tid 1 to trial08226312-33 2026-02-12T17:31:59.680 INFO:tasks.rados.rados.0.trial082.stdout:848: finishing write tid 2 to trial08226312-33 2026-02-12T17:31:59.680 INFO:tasks.rados.rados.0.trial082.stdout:848: finishing write tid 3 to trial08226312-33 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:848: finishing write tid 4 to trial08226312-33 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:848: finishing write tid 5 to trial08226312-33 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:848: oid 33 updating version 0 to 230 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:848: oid 33 version 230 is already newer than 229 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:848: oid 33 updating version 230 to 232 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:848: oid 33 version 232 is already newer than 231 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 232 (ObjNum 316 snap 93 seq_num 316) dirty exists 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:848: left oid 33 (ObjNum 316 snap 93 seq_num 316) 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:852: finishing copy_from to trial08226312-29 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:852: got expected ENOENT (src dne) 2026-02-12T17:31:59.681 INFO:tasks.rados.rados.0.trial082.stdout:852: finishing copy_from racing read to trial08226312-29 2026-02-12T17:31:59.682 INFO:tasks.rados.rados.0.trial082.stdout:854: finishing write tid 1 to trial08226312-30 2026-02-12T17:31:59.682 INFO:tasks.rados.rados.0.trial082.stdout:854: finishing write tid 2 to trial08226312-30 2026-02-12T17:31:59.682 INFO:tasks.rados.rados.0.trial082.stdout:854: finishing write tid 3 to trial08226312-30 2026-02-12T17:31:59.683 INFO:tasks.rados.rados.0.trial082.stdout:854: finishing write tid 4 to trial08226312-30 2026-02-12T17:31:59.683 INFO:tasks.rados.rados.0.trial082.stdout:854: finishing write tid 5 to trial08226312-30 2026-02-12T17:31:59.683 INFO:tasks.rados.rados.0.trial082.stdout:854: oid 30 updating version 0 to 361 2026-02-12T17:31:59.683 INFO:tasks.rados.rados.0.trial082.stdout:854: oid 30 version 361 is already newer than 360 2026-02-12T17:31:59.683 INFO:tasks.rados.rados.0.trial082.stdout:854: oid 30 updating version 361 to 362 2026-02-12T17:31:59.683 INFO:tasks.rados.rados.0.trial082.stdout:854: oid 30 version 362 is already newer than 359 2026-02-12T17:31:59.683 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 362 (ObjNum 318 snap 93 seq_num 318) dirty exists 2026-02-12T17:31:59.683 INFO:tasks.rados.rados.0.trial082.stdout:854: left oid 30 (ObjNum 318 snap 93 seq_num 318) 2026-02-12T17:32:01.049 INFO:tasks.rados.rados.0.trial082.stdout:848: done (3 left) 2026-02-12T17:32:01.049 INFO:tasks.rados.rados.0.trial082.stdout:852: done (2 left) 2026-02-12T17:32:01.049 INFO:tasks.rados.rados.0.trial082.stdout:854: done (1 left) 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:855: done (0 left) 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:856: rollback oid 16 current snap is 94 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 88 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:857: read oid 14 snap -1 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:857: expect (ObjNum 300 snap 85 seq_num 300) 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:858: read oid 37 snap -1 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:858: expect (ObjNum 292 snap 82 seq_num 292) 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:859: rollback oid 34 current snap is 94 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 93 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:860: write oid 40 current snap is 94 2026-02-12T17:32:01.050 INFO:tasks.rados.rados.0.trial082.stdout:860: seq_num 319 ranges {561433=774904,1950697=414440,2777464=583969} 2026-02-12T17:32:01.054 INFO:tasks.rados.rados.0.trial082.stdout:860: writing trial08226312-40 from 561433 to 1336337 tid 1 2026-02-12T17:32:01.057 INFO:tasks.rados.rados.0.trial082.stdout:860: writing trial08226312-40 from 1950697 to 2365137 tid 2 2026-02-12T17:32:01.061 INFO:tasks.rados.rados.0.trial082.stdout:860: writing trial08226312-40 from 2777464 to 3361433 tid 3 2026-02-12T17:32:01.062 INFO:tasks.rados.rados.0.trial082.stdout:861: snap_remove snap 86 2026-02-12T17:32:02.051 INFO:tasks.rados.rados.0.trial082.stdout:861: done (5 left) 2026-02-12T17:32:02.051 INFO:tasks.rados.rados.0.trial082.stdout:862: read oid 2 snap 90 2026-02-12T17:32:02.051 INFO:tasks.rados.rados.0.trial082.stdout:862: expect (ObjNum 291 snap 82 seq_num 291) 2026-02-12T17:32:02.051 INFO:tasks.rados.rados.0.trial082.stdout:863: read oid 6 snap -1 2026-02-12T17:32:02.051 INFO:tasks.rados.rados.0.trial082.stdout:863: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:32:02.051 INFO:tasks.rados.rados.0.trial082.stdout:864: snap_create 2026-02-12T17:32:02.051 INFO:tasks.rados.rados.0.trial082.stdout:856: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:32:02.051 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 454 (ObjNum 129 snap 0 seq_num 27076439) dirty dne 2026-02-12T17:32:02.052 INFO:tasks.rados.rados.0.trial082.stdout:857: expect (ObjNum 300 snap 85 seq_num 300) 2026-02-12T17:32:02.090 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2605496 2026-02-12T17:32:02.127 INFO:tasks.rados.rados.0.trial082.stdout:859: finishing rollback tid 0 to trial08226312-34 2026-02-12T17:32:02.127 INFO:tasks.rados.rados.0.trial082.stdout:859: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:32:02.127 INFO:tasks.rados.rados.0.trial082.stdout:859: finishing rollback tid 2 to trial08226312-34 2026-02-12T17:32:02.127 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 210 (ObjNum 263 snap 76 seq_num 263) dirty exists 2026-02-12T17:32:02.127 INFO:tasks.rados.rados.0.trial082.stdout:858: expect (ObjNum 292 snap 82 seq_num 292) 2026-02-12T17:32:02.156 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1381519 2026-02-12T17:32:02.175 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:32:02.204 INFO:tasks.rados.rados.0.trial082.stdout:860: finishing write tid 1 to trial08226312-40 2026-02-12T17:32:02.204 INFO:tasks.rados.rados.0.trial082.stdout:860: finishing write tid 2 to trial08226312-40 2026-02-12T17:32:02.204 INFO:tasks.rados.rados.0.trial082.stdout:860: finishing write tid 3 to trial08226312-40 2026-02-12T17:32:02.204 INFO:tasks.rados.rados.0.trial082.stdout:860: finishing write tid 4 to trial08226312-40 2026-02-12T17:32:02.205 INFO:tasks.rados.rados.0.trial082.stdout:860: finishing write tid 5 to trial08226312-40 2026-02-12T17:32:02.205 INFO:tasks.rados.rados.0.trial082.stdout:860: oid 40 updating version 0 to 494 2026-02-12T17:32:02.205 INFO:tasks.rados.rados.0.trial082.stdout:860: oid 40 updating version 494 to 496 2026-02-12T17:32:02.205 INFO:tasks.rados.rados.0.trial082.stdout:860: oid 40 version 496 is already newer than 495 2026-02-12T17:32:02.205 INFO:tasks.rados.rados.0.trial082.stdout:860: oid 40 version 496 is already newer than 493 2026-02-12T17:32:02.205 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 496 (ObjNum 319 snap 94 seq_num 319) dirty exists 2026-02-12T17:32:02.205 INFO:tasks.rados.rados.0.trial082.stdout:860: left oid 40 (ObjNum 319 snap 94 seq_num 319) 2026-02-12T17:32:02.205 INFO:tasks.rados.rados.0.trial082.stdout:862: expect (ObjNum 291 snap 82 seq_num 291) 2026-02-12T17:32:02.319 INFO:tasks.rados.rados.0.trial082.stdout:863: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:32:02.321 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 713915 2026-02-12T17:32:02.361 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2677315 2026-02-12T17:32:02.636 INFO:tasks.rados.rados.0.trial082.stdout:856: done (7 left) 2026-02-12T17:32:02.636 INFO:tasks.rados.rados.0.trial082.stdout:857: done (6 left) 2026-02-12T17:32:02.637 INFO:tasks.rados.rados.0.trial082.stdout:858: done (5 left) 2026-02-12T17:32:02.637 INFO:tasks.rados.rados.0.trial082.stdout:859: done (4 left) 2026-02-12T17:32:02.637 INFO:tasks.rados.rados.0.trial082.stdout:860: done (3 left) 2026-02-12T17:32:02.637 INFO:tasks.rados.rados.0.trial082.stdout:862: done (2 left) 2026-02-12T17:32:02.637 INFO:tasks.rados.rados.0.trial082.stdout:863: done (1 left) 2026-02-12T17:32:02.637 INFO:tasks.rados.rados.0.trial082.stdout:864: done (0 left) 2026-02-12T17:32:02.637 INFO:tasks.rados.rados.0.trial082.stdout:865: snap_remove snap 82 2026-02-12T17:32:03.002 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:32:03.002 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:32:03.002 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T17:32:03.003 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T17:32:03.016 INFO:tasks.ceph.mon.c:Started 2026-02-12T17:32:03.016 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-12T17:32:03.016 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-12T17:32:03.017 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-12T17:32:03.017 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T17:32:18.017 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-12T17:32:18.018 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-12T17:32:18.018 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-12T17:32:18.018 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:32:18.018 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:32:18.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.087+0000 7ff978207640 10 monclient: get_monmap_and_config 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.087+0000 7ff978207640 10 monclient: build_initial_monmap 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.087+0000 7ff978207640 10 monclient: monmap: 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:18.088715+0000 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:18.088715+0000 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:18.086 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:18.087 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:18.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 1 Processor -- start 2026-02-12T17:32:18.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 1 -- start start 2026-02-12T17:32:18.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 10 monclient: init 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 10 monclient(hunting): picked mon.noname-c con 0x7ff970088b20 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 10 monclient(hunting): picked mon.noname-a con 0x7ff97008a960 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 10 monclient(hunting): picked mon.noname-b con 0x7ff970089600 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97008a0d0 con 0x7ff97008a960 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97008ba10 con 0x7ff970088b20 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97008b170 con 0x7ff970089600 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff978207640 10 monclient(hunting): authenticate will time out at 817.907660s 2026-02-12T17:32:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff97677d640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ff970089600 0x7ff9701a20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:48274/0 (socket says 10.20.193.57:48274) 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff97577b640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff97008a960 0x7ff9701809c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40696/0 (socket says 10.20.193.57:40696) 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.088+0000 7ff97677d640 1 -- 10.20.193.57:0/3610813985 learned_addr learned my addr 10.20.193.57:0/3610813985 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.090+0000 7ff97677d640 1 -- 10.20.193.57:0/3610813985 >> v1:10.20.193.57:6790/0 conn(0x7ff970089600 legacy=0x7ff9701a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.090+0000 7ff97577b640 1 -- 10.20.193.57:0/3610813985 >> v1:10.20.193.57:6789/0 conn(0x7ff97008a960 legacy=0x7ff9701809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917832314 0 0) 0x7ff97008b170 con 0x7ff970089600 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient(hunting): _negotiate 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient(hunting): my global_id is 44099 2026-02-12T17:32:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9580035e0 con 0x7ff970089600 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465190939 0 0) 0x7ff97008a0d0 con 0x7ff97008a960 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient(hunting): _negotiate 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient(hunting): my global_id is 4611 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff97008b170 con 0x7ff97008a960 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff975f7c640 1 -- 10.20.193.57:0/3610813985 >> v1:10.20.193.82:6789/0 conn(0x7ff970088b20 legacy=0x7ff970088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3264030689 0 0) 0x7ff9580035e0 con 0x7ff970089600 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 >> v1:10.20.193.82:6789/0 conn(0x7ff970088b20 legacy=0x7ff970088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 >> v1:10.20.193.57:6789/0 conn(0x7ff97008a960 legacy=0x7ff9701809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: _finish_hunting 0 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 monclient: found mon.noname-b 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9700574f0 con 0x7ff970089600 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: _finish_auth 0 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: _check_auth_tickets 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff96c0041b0 con 0x7ff970089600 2026-02-12T17:32:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: dump: 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 5 monclient: authenticate success, global_id 44099 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff96c0044b0 con 0x7ff970089600 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 1 -- 10.20.193.57:0/3610813985 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff96c005bf0 con 0x7ff970089600 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff974f7a640 10 monclient: dump: 2026-02-12T17:32:18.101 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 4 set_mon_vals no callback set 2026-02-12T17:32:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 10 monclient: shutdown 2026-02-12T17:32:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 1 -- 10.20.193.57:0/3610813985 >> v1:10.20.193.57:6790/0 conn(0x7ff970089600 legacy=0x7ff9701a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 1 -- 10.20.193.57:0/3610813985 shutdown_connections 2026-02-12T17:32:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 1 -- 10.20.193.57:0/3610813985 >> 10.20.193.57:0/3610813985 conn(0x7ff970091620 msgr2=0x7ff970091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 1 -- 10.20.193.57:0/3610813985 shutdown_connections 2026-02-12T17:32:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.091+0000 7ff978207640 1 -- 10.20.193.57:0/3610813985 wait complete. 2026-02-12T17:32:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient: build_initial_monmap 2026-02-12T17:32:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient: monmap: 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 1 Processor -- start 2026-02-12T17:32:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 1 -- start start 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient: init 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient(hunting): picked mon.noname-b con 0x7ff970088b20 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient(hunting): picked mon.noname-c con 0x7ff970089600 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient(hunting): picked mon.noname-a con 0x7ff97008a960 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff970084e70 con 0x7ff97008a960 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff970085430 con 0x7ff970088b20 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff970085710 con 0x7ff970089600 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff978207640 10 monclient(hunting): authenticate will time out at 817.911645s 2026-02-12T17:32:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff97677d640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff97008a960 0x7ff9701950f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40708/0 (socket says 10.20.193.57:40708) 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff97677d640 1 -- 10.20.193.57:0/2551590773 learned_addr learned my addr 10.20.193.57:0/2551590773 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.092+0000 7ff97577b640 1 --1- 10.20.193.57:0/2551590773 >> v1:10.20.193.57:6790/0 conn(0x7ff970089600 0x7ff970086c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:48276/0 (socket says 10.20.193.57:48276) 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff97577b640 1 -- 10.20.193.57:0/2551590773 >> v1:10.20.193.57:6790/0 conn(0x7ff970089600 legacy=0x7ff970086c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff97677d640 1 -- 10.20.193.57:0/2551590773 >> v1:10.20.193.57:6789/0 conn(0x7ff97008a960 legacy=0x7ff9701950f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff975f7c640 1 -- 10.20.193.57:0/2551590773 >> v1:10.20.193.82:6789/0 conn(0x7ff970088b20 legacy=0x7ff970152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899229578 0 0) 0x7ff970085710 con 0x7ff970089600 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff95e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff95e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff95e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff95e7fc640 10 monclient(hunting): my global_id is 44102 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9400035e0 con 0x7ff970089600 2026-02-12T17:32:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.094+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839377765 0 0) 0x7ff970084e70 con 0x7ff97008a960 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): my global_id is 4614 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff970085710 con 0x7ff97008a960 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2842799650 0 0) 0x7ff9400035e0 con 0x7ff970089600 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff970084e70 con 0x7ff970089600 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff964003360 con 0x7ff970089600 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): dump: 2026-02-12T17:32:18.107 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 375926041 0 0) 0x7ff970085710 con 0x7ff97008a960 2026-02-12T17:32:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9400035e0 con 0x7ff97008a960 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff96c004620 con 0x7ff97008a960 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient(hunting): dump: 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1266378098 0 0) 0x7ff970084e70 con 0x7ff970089600 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 >> v1:10.20.193.82:6789/0 conn(0x7ff970088b20 legacy=0x7ff970152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 >> v1:10.20.193.57:6789/0 conn(0x7ff97008a960 legacy=0x7ff9701950f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 monclient: found mon.c 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff970088810 con 0x7ff970089600 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:32:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 5 monclient: authenticate success, global_id 44102 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 10 monclient: _renew_subs 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff970084430 con 0x7ff970089600 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 10 monclient: _renew_subs 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff970087350 con 0x7ff970089600 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff964004b50 con 0x7ff970089600 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff964004e70 con 0x7ff970089600 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95ffff640 4 set_mon_vals no callback set 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 10 monclient: dump: 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:18.112 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:18.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:18.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:18.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:18.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9700008d0 con 0x7ff970089600 2026-02-12T17:32:18.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.095+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff964005100 con 0x7ff970089600 2026-02-12T17:32:18.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.096+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(200..200 src has 1..200) ==== 3959+0+0 (unknown 1118138979 0 0) 0x7ff96404ec10 con 0x7ff970089600 2026-02-12T17:32:18.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.096+0000 7ff975f7c640 10 monclient: get_auth_request con 0x7ff94003fae0 auth_method 0 2026-02-12T17:32:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.098+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff964017370 con 0x7ff970089600 2026-02-12T17:32:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.098+0000 7ff95e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.098+0000 7ff95e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:18.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.242+0000 7ff978207640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:32:18.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.242+0000 7ff978207640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:18.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.242+0000 7ff978207640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:18.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.242+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff970087600 con 0x7ff970089600 2026-02-12T17:32:18.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.242+0000 7ff95e7fc640 1 -- 10.20.193.57:0/2551590773 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 671954961) 0x7ff964016b20 con 0x7ff970089600 2026-02-12T17:32:18.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.242+0000 7ff95e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:18.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.242+0000 7ff95e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:18.241 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":18,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:32:18.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.243+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff94003fae0 legacy=0x7ff94005ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:18.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.243+0000 7ff978207640 10 monclient: shutdown 2026-02-12T17:32:18.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.243+0000 7ff978207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:18.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.243+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 >> v1:10.20.193.57:6790/0 conn(0x7ff970089600 legacy=0x7ff970086c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:18.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.243+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 shutdown_connections 2026-02-12T17:32:18.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.243+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 >> 10.20.193.57:0/2551590773 conn(0x7ff970091620 msgr2=0x7ff97005a150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:18.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.243+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 shutdown_connections 2026-02-12T17:32:18.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:18.243+0000 7ff978207640 1 -- 10.20.193.57:0/2551590773 wait complete. 2026-02-12T17:32:21.250 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:32:21.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.320+0000 7fd76dbc2640 10 monclient: get_monmap_and_config 2026-02-12T17:32:21.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.320+0000 7fd76dbc2640 10 monclient: build_initial_monmap 2026-02-12T17:32:21.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.320+0000 7fd76dbc2640 10 monclient: monmap: 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:21.321256+0000 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:21.321256+0000 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.320+0000 7fd76dbc2640 1 Processor -- start 2026-02-12T17:32:21.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.320+0000 7fd76dbc2640 1 -- start start 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.320+0000 7fd76dbc2640 10 monclient: init 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 10 monclient(hunting): picked mon.noname-a con 0x7fd76808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 10 monclient(hunting): picked mon.noname-b con 0x7fd76808c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 10 monclient(hunting): picked mon.noname-c con 0x7fd76808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76808d600 con 0x7fd76808ae20 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76808b1f0 con 0x7fd76808cb30 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76808d1f0 con 0x7fd76808c730 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd76dbc2640 10 monclient(hunting): authenticate will time out at 821.140133s 2026-02-12T17:32:21.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd7677fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd76808ae20 0x7fd76808c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40718/0 (socket says 10.20.193.57:40718) 2026-02-12T17:32:21.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.321+0000 7fd7677fe640 1 -- 10.20.193.57:0/3043392105 learned_addr learned my addr 10.20.193.57:0/3043392105 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7677fe640 1 -- 10.20.193.57:0/3043392105 >> v1:10.20.193.57:6789/0 conn(0x7fd76808ae20 legacy=0x7fd76808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd766ffd640 1 -- 10.20.193.57:0/3043392105 >> v1:10.20.193.57:6790/0 conn(0x7fd76808c730 legacy=0x7fd768181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299918469 0 0) 0x7fd76808d600 con 0x7fd76808ae20 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient(hunting): my global_id is 4617 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd74c0035e0 con 0x7fd76808ae20 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028937847 0 0) 0x7fd76808d1f0 con 0x7fd76808c730 2026-02-12T17:32:21.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient(hunting): my global_id is 44105 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd76808d600 con 0x7fd76808c730 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1730432756 0 0) 0x7fd76808d600 con 0x7fd76808c730 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 >> v1:10.20.193.82:6789/0 conn(0x7fd76808cb30 legacy=0x7fd7681a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd767fff640 1 -- 10.20.193.57:0/3043392105 >> v1:10.20.193.82:6789/0 conn(0x7fd76808cb30 legacy=0x7fd7681a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 >> v1:10.20.193.57:6789/0 conn(0x7fd76808ae20 legacy=0x7fd76808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: _finish_hunting 0 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 monclient: found mon.noname-b 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:21.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd768057320 con 0x7fd76808c730 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: _finish_auth 0 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: _check_auth_tickets 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd758003110 con 0x7fd76808c730 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd76dbc2640 5 monclient: authenticate success, global_id 44105 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd76dbc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: dump: 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:21.331 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd76dbc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7580033a0 con 0x7fd76808c730 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:21.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 1 -- 10.20.193.57:0/3043392105 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd758003880 con 0x7fd76808c730 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd76dbc2640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd76dbc2640 4 set_mon_vals no callback set 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.323+0000 7fd7667fc640 10 monclient: dump: 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:21.333 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 10 monclient: shutdown 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 1 -- 10.20.193.57:0/3043392105 >> v1:10.20.193.57:6790/0 conn(0x7fd76808c730 legacy=0x7fd768181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 1 -- 10.20.193.57:0/3043392105 shutdown_connections 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 1 -- 10.20.193.57:0/3043392105 >> 10.20.193.57:0/3043392105 conn(0x7fd768091620 msgr2=0x7fd768091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 1 -- 10.20.193.57:0/3043392105 shutdown_connections 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 1 -- 10.20.193.57:0/3043392105 wait complete. 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 10 monclient: build_initial_monmap 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 10 monclient: monmap: 2026-02-12T17:32:21.334 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 1 Processor -- start 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 1 -- start start 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.324+0000 7fd76dbc2640 10 monclient: init 2026-02-12T17:32:21.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 10 monclient(hunting): picked mon.noname-a con 0x7fd76808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 10 monclient(hunting): picked mon.noname-b con 0x7fd76808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 10 monclient(hunting): picked mon.noname-c con 0x7fd76808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76808d9c0 con 0x7fd76808ae20 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd768088810 con 0x7fd76808c730 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76805b020 con 0x7fd76808cb30 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd76dbc2640 10 monclient(hunting): authenticate will time out at 821.144158s 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd7677fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd76808ae20 0x7fd768118f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40726/0 (socket says 10.20.193.57:40726) 2026-02-12T17:32:21.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.325+0000 7fd7677fe640 1 -- 10.20.193.57:0/90031336 learned_addr learned my addr 10.20.193.57:0/90031336 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd7677fe640 1 -- 10.20.193.57:0/90031336 >> v1:10.20.193.57:6789/0 conn(0x7fd76808ae20 legacy=0x7fd768118f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd767fff640 1 -- 10.20.193.57:0/90031336 >> v1:10.20.193.57:6790/0 conn(0x7fd76808cb30 legacy=0x7fd7681a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164095802 0 0) 0x7fd76808d9c0 con 0x7fd76808ae20 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): my global_id is 4620 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7380035e0 con 0x7fd76808ae20 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772984376 0 0) 0x7fd76808b1f0 con 0x7fd76808cb30 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:21.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): my global_id is 44108 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd76808d9c0 con 0x7fd76808cb30 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd766ffd640 1 -- 10.20.193.57:0/90031336 >> v1:10.20.193.82:6789/0 conn(0x7fd76808c730 legacy=0x7fd768119650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3226133747 0 0) 0x7fd76808d9c0 con 0x7fd76808cb30 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd76808b1f0 con 0x7fd76808cb30 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd75c0043a0 con 0x7fd76808cb30 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): dump: 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.338 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3535285822 0 0) 0x7fd7380035e0 con 0x7fd76808ae20 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd76808d9c0 con 0x7fd76808ae20 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd754002f00 con 0x7fd76808ae20 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:21.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient(hunting): dump: 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1593975781 0 0) 0x7fd76808d9c0 con 0x7fd76808ae20 2026-02-12T17:32:21.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 >> v1:10.20.193.57:6790/0 conn(0x7fd76808cb30 legacy=0x7fd7681a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 >> v1:10.20.193.82:6789/0 conn(0x7fd76808c730 legacy=0x7fd768119650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient: _finish_hunting 0 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 monclient: found mon.a 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76811cc50 con 0x7fd76808ae20 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient: _finish_auth 0 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient: _check_auth_tickets 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3823694800 0 0) 0x7fd76808b1f0 con 0x7fd76808cb30 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd76dbc2640 5 monclient: authenticate success, global_id 4620 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd76dbc2640 10 monclient: _renew_subs 2026-02-12T17:32:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd76dbc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd768119d60 con 0x7fd76808ae20 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd76dbc2640 10 monclient: _renew_subs 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd76dbc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd76811c970 con 0x7fd76808ae20 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd754004b50 con 0x7fd76808ae20 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd754004e70 con 0x7fd76808ae20 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd743fff640 10 monclient: dump: 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:21.342 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.327+0000 7fd765ffb640 4 set_mon_vals no callback set 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.328+0000 7fd76dbc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.328+0000 7fd76dbc2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.328+0000 7fd76dbc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.328+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7680008d0 con 0x7fd76808ae20 2026-02-12T17:32:21.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.328+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fd754011ae0 con 0x7fd76808ae20 2026-02-12T17:32:21.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.328+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(201..201 src has 1..201) ==== 3899+0+0 (unknown 1498166233 0 0) 0x7fd75404eb10 con 0x7fd76808ae20 2026-02-12T17:32:21.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.329+0000 7fd766ffd640 10 monclient: get_auth_request con 0x7fd73803fad0 auth_method 0 2026-02-12T17:32:21.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.331+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fd754050e60 con 0x7fd76808ae20 2026-02-12T17:32:21.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.331+0000 7fd743fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:21.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.331+0000 7fd743fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:21.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.474+0000 7fd76dbc2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:32:21.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.474+0000 7fd76dbc2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:21.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.474+0000 7fd76dbc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:21.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.474+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd768123490 con 0x7fd76808ae20 2026-02-12T17:32:21.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.474+0000 7fd743fff640 1 -- 10.20.193.57:0/90031336 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 1520794062) 0x7fd7540172b0 con 0x7fd76808ae20 2026-02-12T17:32:21.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.474+0000 7fd743fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:21.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.474+0000 7fd743fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:21.473 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":18,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:32:21.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.475+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 >> v1:10.20.193.82:6800/2441377515 conn(0x7fd73803fad0 legacy=0x7fd73805ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:21.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.475+0000 7fd76dbc2640 10 monclient: shutdown 2026-02-12T17:32:21.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.475+0000 7fd76dbc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:21.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.475+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 >> v1:10.20.193.57:6789/0 conn(0x7fd76808ae20 legacy=0x7fd768118f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:21.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.475+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 shutdown_connections 2026-02-12T17:32:21.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.475+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 >> 10.20.193.57:0/90031336 conn(0x7fd768091620 msgr2=0x7fd7680597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:21.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.476+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 shutdown_connections 2026-02-12T17:32:21.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:21.476+0000 7fd76dbc2640 1 -- 10.20.193.57:0/90031336 wait complete. 2026-02-12T17:32:24.482 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:32:24.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient: get_monmap_and_config 2026-02-12T17:32:24.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient: build_initial_monmap 2026-02-12T17:32:24.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient: monmap: 2026-02-12T17:32:24.550 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:24.550 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:24.550 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:24.551909+0000 2026-02-12T17:32:24.550 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:24.551909+0000 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 1 Processor -- start 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 1 -- start start 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient: init 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:24.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient(hunting): picked mon.noname-a con 0x7f663808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient(hunting): picked mon.noname-c con 0x7f663808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient(hunting): picked mon.noname-b con 0x7f663808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663808d600 con 0x7f663808ae20 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663808b1f0 con 0x7f663808c730 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663808d1f0 con 0x7f663808cb30 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663f3e5640 10 monclient(hunting): authenticate will time out at 824.370770s 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663d15a640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f663808ae20 0x7f663808c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35368/0 (socket says 10.20.193.57:35368) 2026-02-12T17:32:24.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.551+0000 7f663d15a640 1 -- 10.20.193.57:0/277523542 learned_addr learned my addr 10.20.193.57:0/277523542 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:24.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.553+0000 7f663d15a640 1 -- 10.20.193.57:0/277523542 >> v1:10.20.193.57:6789/0 conn(0x7f663808ae20 legacy=0x7f663808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.553+0000 7f663d95b640 1 -- 10.20.193.57:0/277523542 >> v1:10.20.193.57:6790/0 conn(0x7f663808cb30 legacy=0x7f66381a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663c959640 1 -- 10.20.193.57:0/277523542 >> v1:10.20.193.82:6789/0 conn(0x7f663808c730 legacy=0x7f6638181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 -- 10.20.193.57:0/277523542 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730550601 0 0) 0x7f663808d1f0 con 0x7f663808cb30 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient(hunting): my global_id is 44111 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 -- 10.20.193.57:0/277523542 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66200035e0 con 0x7f663808cb30 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 -- 10.20.193.57:0/277523542 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 570096178 0 0) 0x7f66200035e0 con 0x7f663808cb30 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 -- 10.20.193.57:0/277523542 >> v1:10.20.193.82:6789/0 conn(0x7f663808c730 legacy=0x7f6638181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:24.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 -- 10.20.193.57:0/277523542 >> v1:10.20.193.57:6789/0 conn(0x7f663808ae20 legacy=0x7f663808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: _finish_hunting 0 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 monclient: found mon.noname-b 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 -- 10.20.193.57:0/277523542 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6638057320 con 0x7f663808cb30 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: _finish_auth 0 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: _check_auth_tickets 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 -- 10.20.193.57:0/277523542 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f66340041f0 con 0x7f663808cb30 2026-02-12T17:32:24.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: dump: 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:24.561 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 5 monclient: authenticate success, global_id 44111 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 -- 10.20.193.57:0/277523542 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6634004480 con 0x7f663808cb30 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 1 -- 10.20.193.57:0/277523542 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6634004960 con 0x7f663808cb30 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f6627fff640 10 monclient: dump: 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:24.562 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 4 set_mon_vals no callback set 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 10 monclient: shutdown 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:24.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 1 -- 10.20.193.57:0/277523542 >> v1:10.20.193.57:6790/0 conn(0x7f663808cb30 legacy=0x7f66381a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 1 -- 10.20.193.57:0/277523542 shutdown_connections 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 1 -- 10.20.193.57:0/277523542 >> 10.20.193.57:0/277523542 conn(0x7f6638091620 msgr2=0x7f6638091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 1 -- 10.20.193.57:0/277523542 shutdown_connections 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.554+0000 7f663f3e5640 1 -- 10.20.193.57:0/277523542 wait complete. 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient: build_initial_monmap 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient: monmap: 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:24.564 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 1 Processor -- start 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 1 -- start start 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient: init 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient(hunting): picked mon.noname-c con 0x7f663808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient(hunting): picked mon.noname-b con 0x7f663808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient(hunting): picked mon.noname-a con 0x7f663808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:24.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663808d9c0 con 0x7f663808cb30 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663805ab90 con 0x7f663808c730 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f663805d310 con 0x7f663808ae20 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663f3e5640 10 monclient(hunting): authenticate will time out at 824.374725s 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663d15a640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f663808ae20 0x7f6638088b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39402/0 (socket says 10.20.193.57:39402) 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.555+0000 7f663d15a640 1 -- 10.20.193.57:0/1270430344 learned_addr learned my addr 10.20.193.57:0/1270430344 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.557+0000 7f663d15a640 1 -- 10.20.193.57:0/1270430344 >> v1:10.20.193.57:6790/0 conn(0x7f663808ae20 legacy=0x7f6638088b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.557+0000 7f663d95b640 1 -- 10.20.193.57:0/1270430344 >> v1:10.20.193.57:6789/0 conn(0x7f663808cb30 legacy=0x7f6638195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663c959640 1 -- 10.20.193.57:0/1270430344 >> v1:10.20.193.82:6789/0 conn(0x7f663808c730 legacy=0x7f6638089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235900866 0 0) 0x7f663805d310 con 0x7f663808ae20 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:24.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient(hunting): my global_id is 44114 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66080035e0 con 0x7f663808ae20 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2899981261 0 0) 0x7f66080035e0 con 0x7f663808ae20 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f663805d310 con 0x7f663808ae20 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f66280032d0 con 0x7f663808ae20 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient(hunting): dump: 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:24.567 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4045881089 0 0) 0x7f663805d310 con 0x7f663808ae20 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 >> v1:10.20.193.82:6789/0 conn(0x7f663808c730 legacy=0x7f6638089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 >> v1:10.20.193.57:6789/0 conn(0x7f663808cb30 legacy=0x7f6638195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:24.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 monclient: found mon.c 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663807a770 con 0x7f663808ae20 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient: _finish_auth 0 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 5 monclient: authenticate success, global_id 44114 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 10 monclient: _renew_subs 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f663807aa50 con 0x7f663808ae20 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 10 monclient: _renew_subs 2026-02-12T17:32:24.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f663808a000 con 0x7f663808ae20 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6628003470 con 0x7f663808ae20 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6628004dc0 con 0x7f663808ae20 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f66277fe640 4 set_mon_vals no callback set 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f6625ffb640 10 monclient: dump: 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:24.570 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.558+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f663807a550 con 0x7f663808ae20 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.559+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f6628005020 con 0x7f663808ae20 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.559+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(201..201 src has 1..201) ==== 3899+0+0 (unknown 1498166233 0 0) 0x7f662804ecc0 con 0x7f663808ae20 2026-02-12T17:32:24.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.559+0000 7f663c959640 10 monclient: get_auth_request con 0x7f660803f6f0 auth_method 0 2026-02-12T17:32:24.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.561+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f6628013690 con 0x7f663808ae20 2026-02-12T17:32:24.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.561+0000 7f6625ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:24.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.561+0000 7f6625ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:24.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.706+0000 7f663f3e5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:32:24.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.706+0000 7f663f3e5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:24.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.706+0000 7f663f3e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:24.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.706+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f663805bb20 con 0x7f663808ae20 2026-02-12T17:32:24.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.706+0000 7f6625ffb640 1 -- 10.20.193.57:0/1270430344 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 530470581) 0x7f6628016bb0 con 0x7f663808ae20 2026-02-12T17:32:24.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.706+0000 7f6625ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:24.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.706+0000 7f6625ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:24.705 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":18,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:32:24.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.707+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 >> v1:10.20.193.82:6800/2441377515 conn(0x7f660803f6f0 legacy=0x7f660805fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:24.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.707+0000 7f663f3e5640 10 monclient: shutdown 2026-02-12T17:32:24.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.707+0000 7f663f3e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:24.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.707+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 >> v1:10.20.193.57:6790/0 conn(0x7f663808ae20 legacy=0x7f6638088b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:24.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.707+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 shutdown_connections 2026-02-12T17:32:24.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.707+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 >> 10.20.193.57:0/1270430344 conn(0x7f6638091620 msgr2=0x7f66380597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:24.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.707+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 shutdown_connections 2026-02-12T17:32:24.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:24.707+0000 7f663f3e5640 1 -- 10.20.193.57:0/1270430344 wait complete. 2026-02-12T17:32:27.713 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:32:27.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.782+0000 7f812810c640 10 monclient: get_monmap_and_config 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.782+0000 7f812810c640 10 monclient: build_initial_monmap 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.782+0000 7f812810c640 10 monclient: monmap: 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:27.783721+0000 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:27.783721+0000 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:27.781 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:27.782 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:27.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 1 Processor -- start 2026-02-12T17:32:27.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 1 -- start start 2026-02-12T17:32:27.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 10 monclient: init 2026-02-12T17:32:27.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:27.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 10 monclient(hunting): picked mon.noname-c con 0x7f812008c020 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 10 monclient(hunting): picked mon.noname-b con 0x7f812008d540 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 10 monclient(hunting): picked mon.noname-a con 0x7f81200585e0 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8120057420 con 0x7f81200585e0 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8120057c00 con 0x7f812008c020 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8120057ee0 con 0x7f812008d540 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f812810c640 10 monclient(hunting): authenticate will time out at 827.602677s 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f8125680640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f812008d540 0x7f8120181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39416/0 (socket says 10.20.193.57:39416) 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.783+0000 7f8125680640 1 -- 10.20.193.57:0/3214155763 learned_addr learned my addr 10.20.193.57:0/3214155763 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.785+0000 7f8126682640 1 -- 10.20.193.57:0/3214155763 >> v1:10.20.193.57:6789/0 conn(0x7f81200585e0 legacy=0x7f81201a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:27.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.785+0000 7f8125680640 1 -- 10.20.193.57:0/3214155763 >> v1:10.20.193.57:6790/0 conn(0x7f812008d540 legacy=0x7f8120181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:27.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:27.786+0000 7f8125e81640 1 -- 10.20.193.57:0/3214155763 >> v1:10.20.193.82:6789/0 conn(0x7f812008c020 legacy=0x7f812008c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:29.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 -- 10.20.193.57:0/3214155763 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4139918228 0 0) 0x7f8120057420 con 0x7f81200585e0 2026-02-12T17:32:29.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient(hunting): _negotiate 2026-02-12T17:32:29.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:29.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:29.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient(hunting): my global_id is 4623 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 -- 10.20.193.57:0/3214155763 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81080035e0 con 0x7f81200585e0 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 -- 10.20.193.57:0/3214155763 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2042309589 0 0) 0x7f81080035e0 con 0x7f81200585e0 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 -- 10.20.193.57:0/3214155763 >> v1:10.20.193.57:6790/0 conn(0x7f812008d540 legacy=0x7f8120181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 -- 10.20.193.57:0/3214155763 >> v1:10.20.193.82:6789/0 conn(0x7f812008c020 legacy=0x7f812008c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: _finish_hunting 0 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 monclient: found mon.noname-a 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 -- 10.20.193.57:0/3214155763 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812008b960 con 0x7f81200585e0 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: _finish_auth 0 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: _check_auth_tickets 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 -- 10.20.193.57:0/3214155763 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f811c004200 con 0x7f81200585e0 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:29.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: dump: 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f812810c640 5 monclient: authenticate success, global_id 4623 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f812810c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 -- 10.20.193.57:0/3214155763 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f811c004500 con 0x7f81200585e0 2026-02-12T17:32:29.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 1 -- 10.20.193.57:0/3214155763 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f811c004960 con 0x7f81200585e0 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f8124e7f640 10 monclient: dump: 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f812810c640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:29.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.029+0000 7f812810c640 4 set_mon_vals no callback set 2026-02-12T17:32:29.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.030+0000 7f812810c640 10 monclient: shutdown 2026-02-12T17:32:29.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.030+0000 7f812810c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:29.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.030+0000 7f812810c640 1 -- 10.20.193.57:0/3214155763 >> v1:10.20.193.57:6789/0 conn(0x7f81200585e0 legacy=0x7f81201a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:29.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.030+0000 7f812810c640 1 -- 10.20.193.57:0/3214155763 shutdown_connections 2026-02-12T17:32:29.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.030+0000 7f812810c640 1 -- 10.20.193.57:0/3214155763 >> 10.20.193.57:0/3214155763 conn(0x7f8120091620 msgr2=0x7f8120091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:29.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.030+0000 7f812810c640 1 -- 10.20.193.57:0/3214155763 shutdown_connections 2026-02-12T17:32:29.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.030+0000 7f812810c640 1 -- 10.20.193.57:0/3214155763 wait complete. 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient: build_initial_monmap 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient: monmap: 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:29.036 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 1 Processor -- start 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 1 -- start start 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient: init 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient(hunting): picked mon.noname-a con 0x7f81200585e0 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient(hunting): picked mon.noname-c con 0x7f812008c020 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient(hunting): picked mon.noname-b con 0x7f8120153070 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8120088810 con 0x7f81200585e0 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812005ae60 con 0x7f8120153070 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812005d5f0 con 0x7f812008c020 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f812810c640 10 monclient(hunting): authenticate will time out at 828.850800s 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f8125e81640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f81200585e0 0x7f81200868b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35392/0 (socket says 10.20.193.57:35392) 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.031+0000 7f8125e81640 1 -- 10.20.193.57:0/3907075909 learned_addr learned my addr 10.20.193.57:0/3907075909 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f8125e81640 1 -- 10.20.193.57:0/3907075909 >> v1:10.20.193.57:6789/0 conn(0x7f81200585e0 legacy=0x7f81200868b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:29.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f8125680640 1 -- 10.20.193.57:0/3907075909 >> v1:10.20.193.57:6790/0 conn(0x7f812008c020 legacy=0x7f81201941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986120117 0 0) 0x7f8120088810 con 0x7f81200585e0 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 10 monclient(hunting): my global_id is 4626 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80f00035e0 con 0x7f81200585e0 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f8126682640 1 -- 10.20.193.57:0/3907075909 >> v1:10.20.193.82:6789/0 conn(0x7f8120153070 legacy=0x7f81201958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979024568 0 0) 0x7f812005ae60 con 0x7f8120153070 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 10 monclient(hunting): my global_id is 4549 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.034+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8120088810 con 0x7f8120153070 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 766004083 0 0) 0x7f8120088810 con 0x7f8120153070 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f812005ae60 con 0x7f8120153070 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f811c0043a0 con 0x7f8120153070 2026-02-12T17:32:29.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient(hunting): dump: 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2827249204 0 0) 0x7f812005ae60 con 0x7f8120153070 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 >> v1:10.20.193.57:6790/0 conn(0x7f812008c020 legacy=0x7f81201941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 >> v1:10.20.193.57:6789/0 conn(0x7f81200585e0 legacy=0x7f81200868b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:29.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 monclient: found mon.b 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812008aa40 con 0x7f8120153070 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f812810c640 5 monclient: authenticate success, global_id 4549 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f812810c640 10 monclient: _renew_subs 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f812810c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f812008a760 con 0x7f8120153070 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f812810c640 10 monclient: _renew_subs 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f812810c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f81200890a0 con 0x7f8120153070 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f811c0048d0 con 0x7f8120153070 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f811c0050f0 con 0x7f8120153070 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.035+0000 7f810e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:29.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f810e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f810e7fc640 10 monclient: dump: 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f810ffff640 4 set_mon_vals no callback set 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f812810c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f812810c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f812810c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81200008d0 con 0x7f8120153070 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f811c0053b0 con 0x7f8120153070 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(201..201 src has 1..201) ==== 3899+0+0 (unknown 1498166233 0 0) 0x7f811c04fc60 con 0x7f8120153070 2026-02-12T17:32:29.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.036+0000 7f8125e81640 10 monclient: get_auth_request con 0x7f80f003f8c0 auth_method 0 2026-02-12T17:32:29.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.039+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f811c017ea0 con 0x7f8120153070 2026-02-12T17:32:29.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.039+0000 7f810e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:29.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.039+0000 7f810e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:29.085 INFO:tasks.rados.rados.0.trial082.stdout:865: done (0 left) 2026-02-12T17:32:29.085 INFO:tasks.rados.rados.0.trial082.stdout:866: rollback oid 1 current snap is 95 2026-02-12T17:32:29.085 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 90 2026-02-12T17:32:29.085 INFO:tasks.rados.rados.0.trial082.stdout:867: copy_from oid 11 from oid 14 current snap is 95 2026-02-12T17:32:29.086 INFO:tasks.rados.rados.0.trial082.stdout:868: snap_remove snap 93 2026-02-12T17:32:29.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.184+0000 7f812810c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:32:29.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.184+0000 7f812810c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:29.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.184+0000 7f812810c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.184+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f812008f520 con 0x7f8120153070 2026-02-12T17:32:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.184+0000 7f810e7fc640 1 -- 10.20.193.57:0/3907075909 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 1875952754) 0x7f811c017cc0 con 0x7f8120153070 2026-02-12T17:32:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.184+0000 7f810e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.184+0000 7f810e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:29.183 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":20,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:32:29.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.186+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 >> v1:10.20.193.82:6800/2441377515 conn(0x7f80f003f8c0 legacy=0x7f80f005fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:29.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.186+0000 7f812810c640 10 monclient: shutdown 2026-02-12T17:32:29.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.186+0000 7f812810c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:29.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.186+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 >> v1:10.20.193.82:6789/0 conn(0x7f8120153070 legacy=0x7f81201958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:29.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.186+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 shutdown_connections 2026-02-12T17:32:29.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.186+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 >> 10.20.193.57:0/3907075909 conn(0x7f8120091620 msgr2=0x7f812005caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:29.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.186+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 shutdown_connections 2026-02-12T17:32:29.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:29.186+0000 7f812810c640 1 -- 10.20.193.57:0/3907075909 wait complete. 2026-02-12T17:32:30.088 INFO:tasks.rados.rados.0.trial082.stdout:868: done (2 left) 2026-02-12T17:32:30.088 INFO:tasks.rados.rados.0.trial082.stdout:869: read oid 26 snap 94 2026-02-12T17:32:30.088 INFO:tasks.rados.rados.0.trial082.stdout:869: expect (ObjNum 248 snap 70 seq_num 248) 2026-02-12T17:32:30.088 INFO:tasks.rados.rados.0.trial082.stdout:870: delete oid 42 current snap is 95 2026-02-12T17:32:30.088 INFO:tasks.rados.rados.0.trial082.stdout:866: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:32:30.088 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 49 (ObjNum 129 snap 0 seq_num 26781824) dirty dne 2026-02-12T17:32:30.088 INFO:tasks.rados.rados.0.trial082.stdout:867: finishing copy_from racing read to trial08226312-11 2026-02-12T17:32:30.089 INFO:tasks.rados.rados.0.trial082.stdout:867: finishing copy_from to trial08226312-11 2026-02-12T17:32:30.089 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 420 (ObjNum 300 snap 85 seq_num 300) dirty exists 2026-02-12T17:32:30.090 INFO:tasks.rados.rados.0.trial082.stdout:866: done (3 left) 2026-02-12T17:32:30.090 INFO:tasks.rados.rados.0.trial082.stdout:867: done (2 left) 2026-02-12T17:32:30.090 INFO:tasks.rados.rados.0.trial082.stdout:870: done (1 left) 2026-02-12T17:32:30.090 INFO:tasks.rados.rados.0.trial082.stdout:871: read oid 50 snap 85 2026-02-12T17:32:30.090 INFO:tasks.rados.rados.0.trial082.stdout:871: expect deleted 2026-02-12T17:32:30.090 INFO:tasks.rados.rados.0.trial082.stdout:872: write oid 13 current snap is 95 2026-02-12T17:32:30.090 INFO:tasks.rados.rados.0.trial082.stdout:872: seq_num 321 ranges {595047=641755,1667661=418109,2548663=763022} 2026-02-12T17:32:30.095 INFO:tasks.rados.rados.0.trial082.stdout:872: writing trial08226312-13 from 595047 to 1236802 tid 1 2026-02-12T17:32:30.098 INFO:tasks.rados.rados.0.trial082.stdout:872: writing trial08226312-13 from 1667661 to 2085770 tid 2 2026-02-12T17:32:30.103 INFO:tasks.rados.rados.0.trial082.stdout:872: writing trial08226312-13 from 2548663 to 3311685 tid 3 2026-02-12T17:32:30.103 INFO:tasks.rados.rados.0.trial082.stdout:873: snap_remove snap 91 2026-02-12T17:32:31.090 INFO:tasks.rados.rados.0.trial082.stdout:873: done (3 left) 2026-02-12T17:32:31.090 INFO:tasks.rados.rados.0.trial082.stdout:874: read oid 30 snap 73 2026-02-12T17:32:31.090 INFO:tasks.rados.rados.0.trial082.stdout:874: expect (ObjNum 239 snap 65 seq_num 239) 2026-02-12T17:32:31.091 INFO:tasks.rados.rados.0.trial082.stdout:875: snap_create 2026-02-12T17:32:31.091 INFO:tasks.rados.rados.0.trial082.stdout:869: expect (ObjNum 248 snap 70 seq_num 248) 2026-02-12T17:32:31.115 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:32:31.148 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1198546 2026-02-12T17:32:31.167 INFO:tasks.rados.rados.0.trial082.stdout:872: finishing write tid 1 to trial08226312-13 2026-02-12T17:32:31.167 INFO:tasks.rados.rados.0.trial082.stdout:872: finishing write tid 2 to trial08226312-13 2026-02-12T17:32:31.167 INFO:tasks.rados.rados.0.trial082.stdout:872: finishing write tid 3 to trial08226312-13 2026-02-12T17:32:31.167 INFO:tasks.rados.rados.0.trial082.stdout:872: finishing write tid 4 to trial08226312-13 2026-02-12T17:32:31.167 INFO:tasks.rados.rados.0.trial082.stdout:872: finishing write tid 5 to trial08226312-13 2026-02-12T17:32:31.167 INFO:tasks.rados.rados.0.trial082.stdout:872: oid 13 updating version 0 to 197 2026-02-12T17:32:31.167 INFO:tasks.rados.rados.0.trial082.stdout:872: oid 13 version 197 is already newer than 196 2026-02-12T17:32:31.167 INFO:tasks.rados.rados.0.trial082.stdout:872: oid 13 updating version 197 to 199 2026-02-12T17:32:31.167 INFO:tasks.rados.rados.0.trial082.stdout:872: oid 13 version 199 is already newer than 198 2026-02-12T17:32:31.168 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 199 (ObjNum 321 snap 95 seq_num 321) dirty exists 2026-02-12T17:32:31.168 INFO:tasks.rados.rados.0.trial082.stdout:872: left oid 13 (ObjNum 321 snap 95 seq_num 321) 2026-02-12T17:32:31.168 INFO:tasks.rados.rados.0.trial082.stdout:874: expect (ObjNum 239 snap 65 seq_num 239) 2026-02-12T17:32:31.197 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1708363 2026-02-12T17:32:32.093 INFO:tasks.rados.rados.0.trial082.stdout:869: done (4 left) 2026-02-12T17:32:32.093 INFO:tasks.rados.rados.0.trial082.stdout:871: done (3 left) 2026-02-12T17:32:32.093 INFO:tasks.rados.rados.0.trial082.stdout:872: done (2 left) 2026-02-12T17:32:32.093 INFO:tasks.rados.rados.0.trial082.stdout:874: done (1 left) 2026-02-12T17:32:32.093 INFO:tasks.rados.rados.0.trial082.stdout:875: done (0 left) 2026-02-12T17:32:32.094 INFO:tasks.rados.rados.0.trial082.stdout:876: read oid 9 snap -1 2026-02-12T17:32:32.094 INFO:tasks.rados.rados.0.trial082.stdout:876: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:32:32.094 INFO:tasks.rados.rados.0.trial082.stdout:877: snap_remove snap 73 2026-02-12T17:32:32.193 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:32:32.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient: get_monmap_and_config 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient: monmap: 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:32.262846+0000 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:32.262846+0000 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:32.260 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:32.261 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 1 Processor -- start 2026-02-12T17:32:32.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 1 -- start start 2026-02-12T17:32:32.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient: init 2026-02-12T17:32:32.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:32:32.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient(hunting): picked mon.noname-b con 0x7f192408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient(hunting): picked mon.noname-a con 0x7f192408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient(hunting): picked mon.noname-c con 0x7f192408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192408d600 con 0x7f192408c730 2026-02-12T17:32:32.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192408b1f0 con 0x7f192408cb30 2026-02-12T17:32:32.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192408d1f0 con 0x7f192408ae20 2026-02-12T17:32:32.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f192c25b640 10 monclient(hunting): authenticate will time out at 832.081754s 2026-02-12T17:32:32.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f19297cf640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f192408c730 0x7f1924181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35400/0 (socket says 10.20.193.57:35400) 2026-02-12T17:32:32.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.262+0000 7f19297cf640 1 -- 10.20.193.57:0/1027213207 learned_addr learned my addr 10.20.193.57:0/1027213207 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.264+0000 7f1929fd0640 1 -- 10.20.193.57:0/1027213207 >> v1:10.20.193.57:6790/0 conn(0x7f192408ae20 legacy=0x7f192408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f19297cf640 1 -- 10.20.193.57:0/1027213207 >> v1:10.20.193.57:6789/0 conn(0x7f192408c730 legacy=0x7f1924181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507828117 0 0) 0x7f192408d1f0 con 0x7f192408ae20 2026-02-12T17:32:32.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): my global_id is 44117 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192a7d1640 1 -- 10.20.193.57:0/1027213207 >> v1:10.20.193.82:6789/0 conn(0x7f192408cb30 legacy=0x7f19241a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f190c0035e0 con 0x7f192408ae20 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3531747952 0 0) 0x7f192408d600 con 0x7f192408c730 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): my global_id is 4629 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f192408d1f0 con 0x7f192408c730 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256370339 0 0) 0x7f192408b1f0 con 0x7f192408cb30 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient(hunting): my global_id is 4552 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f192408d600 con 0x7f192408cb30 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 820766158 0 0) 0x7f190c0035e0 con 0x7f192408ae20 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 >> v1:10.20.193.82:6789/0 conn(0x7f192408cb30 legacy=0x7f19241a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 >> v1:10.20.193.57:6789/0 conn(0x7f192408c730 legacy=0x7f1924181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 monclient: found mon.noname-b 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1924057320 con 0x7f192408ae20 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1914003190 con 0x7f192408ae20 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 5 monclient: authenticate success, global_id 44117 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: dump: 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.274 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f19140033e0 con 0x7f192408ae20 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 1 -- 10.20.193.57:0/1027213207 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1914003880 con 0x7f192408ae20 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f1928fce640 10 monclient: dump: 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:32.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 4 set_mon_vals no callback set 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 10 monclient: shutdown 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 1 -- 10.20.193.57:0/1027213207 >> v1:10.20.193.57:6790/0 conn(0x7f192408ae20 legacy=0x7f192408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 1 -- 10.20.193.57:0/1027213207 shutdown_connections 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 1 -- 10.20.193.57:0/1027213207 >> 10.20.193.57:0/1027213207 conn(0x7f1924091620 msgr2=0x7f1924091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 1 -- 10.20.193.57:0/1027213207 shutdown_connections 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.265+0000 7f192c25b640 1 -- 10.20.193.57:0/1027213207 wait complete. 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient: monmap: 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:32.277 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 1 Processor -- start 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 1 -- start start 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient: init 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:32:32.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient(hunting): picked mon.noname-a con 0x7f192408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient(hunting): picked mon.noname-b con 0x7f192408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient(hunting): picked mon.noname-c con 0x7f192408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192408d9c0 con 0x7f192408ae20 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192411dd80 con 0x7f192408c730 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192411d7c0 con 0x7f192408cb30 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192c25b640 10 monclient(hunting): authenticate will time out at 832.085622s 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f1929fd0640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f192408ae20 0x7f1924088d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35410/0 (socket says 10.20.193.57:35410) 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f1929fd0640 1 -- 10.20.193.57:0/1464959969 learned_addr learned my addr 10.20.193.57:0/1464959969 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.266+0000 7f192a7d1640 1 --1- 10.20.193.57:0/1464959969 >> v1:10.20.193.57:6790/0 conn(0x7f192408cb30 0x7f19241a2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39448/0 (socket says 10.20.193.57:39448) 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f192a7d1640 1 -- 10.20.193.57:0/1464959969 >> v1:10.20.193.57:6790/0 conn(0x7f192408cb30 legacy=0x7f19241a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f1929fd0640 1 -- 10.20.193.57:0/1464959969 >> v1:10.20.193.57:6789/0 conn(0x7f192408ae20 legacy=0x7f1924088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4162371451 0 0) 0x7f192411d7c0 con 0x7f192408cb30 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 10 monclient(hunting): my global_id is 44120 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18f40035e0 con 0x7f192408cb30 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3895427814 0 0) 0x7f192408d9c0 con 0x7f192408ae20 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 10 monclient(hunting): my global_id is 4632 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.268+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f192411d7c0 con 0x7f192408ae20 2026-02-12T17:32:32.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19297cf640 1 -- 10.20.193.57:0/1464959969 >> v1:10.20.193.82:6789/0 conn(0x7f192408c730 legacy=0x7f1924089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3407482755 0 0) 0x7f18f40035e0 con 0x7f192408cb30 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f192408d9c0 con 0x7f192408cb30 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1920004460 con 0x7f192408cb30 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient(hunting): dump: 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.281 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4175736041 0 0) 0x7f192411d7c0 con 0x7f192408ae20 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18f40035e0 con 0x7f192408ae20 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1914003550 con 0x7f192408ae20 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient(hunting): dump: 2026-02-12T17:32:32.282 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2692276524 0 0) 0x7f192408d9c0 con 0x7f192408cb30 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 >> v1:10.20.193.82:6789/0 conn(0x7f192408c730 legacy=0x7f1924089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 >> v1:10.20.193.57:6789/0 conn(0x7f192408ae20 legacy=0x7f1924088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 monclient: found mon.c 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192411daa0 con 0x7f192408cb30 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 5 monclient: authenticate success, global_id 44120 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 10 monclient: _renew_subs 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f192405b140 con 0x7f192408cb30 2026-02-12T17:32:32.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 10 monclient: _renew_subs 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f192411d4e0 con 0x7f192408cb30 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1920004a60 con 0x7f192408cb30 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1920004db0 con 0x7f192408cb30 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 10 monclient: dump: 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.285 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f1913fff640 4 set_mon_vals no callback set 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19240008d0 con 0x7f192408cb30 2026-02-12T17:32:32.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.269+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1920005040 con 0x7f192408cb30 2026-02-12T17:32:32.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.270+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(205..205 src has 1..205) ==== 3947+0+0 (unknown 975744462 0 0) 0x7f192004fc60 con 0x7f192408cb30 2026-02-12T17:32:32.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.270+0000 7f1929fd0640 10 monclient: get_auth_request con 0x7f18f403fb80 auth_method 0 2026-02-12T17:32:32.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.272+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f1920017db0 con 0x7f192408cb30 2026-02-12T17:32:32.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.272+0000 7f19127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.272+0000 7f19127fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:32.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.424+0000 7f192c25b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:32:32.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.424+0000 7f192c25b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:32.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.424+0000 7f192c25b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.424+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f192408f520 con 0x7f192408cb30 2026-02-12T17:32:32.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.424+0000 7f19127fc640 1 -- 10.20.193.57:0/1464959969 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2494175190) 0x7f1920017bd0 con 0x7f192408cb30 2026-02-12T17:32:32.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.424+0000 7f19127fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:32.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.424+0000 7f19127fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:32.422 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:32:32.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.425+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 >> v1:10.20.193.82:6800/2441377515 conn(0x7f18f403fb80 legacy=0x7f18f4060030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.425+0000 7f192c25b640 10 monclient: shutdown 2026-02-12T17:32:32.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.425+0000 7f192c25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.425+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 >> v1:10.20.193.57:6790/0 conn(0x7f192408cb30 legacy=0x7f19241a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.425+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 shutdown_connections 2026-02-12T17:32:32.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.425+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 >> 10.20.193.57:0/1464959969 conn(0x7f1924091620 msgr2=0x7f19240597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.425+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 shutdown_connections 2026-02-12T17:32:32.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.425+0000 7f192c25b640 1 -- 10.20.193.57:0/1464959969 wait complete. 2026-02-12T17:32:32.430 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:32:32.430 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:32:32.430 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:32:32.495 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.498+0000 7f89e254c640 10 monclient: get_monmap_and_config 2026-02-12T17:32:32.495 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.498+0000 7f89e254c640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.498+0000 7f89e254c640 10 monclient: monmap: 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:32.499110+0000 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:32.499110+0000 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.498+0000 7f89e254c640 1 Processor -- start 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.498+0000 7f89e254c640 1 -- start start 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.498+0000 7f89e254c640 10 monclient: init 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 10 monclient(hunting): picked mon.noname-c con 0x7f89dc08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 10 monclient(hunting): picked mon.noname-a con 0x7f89dc08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 10 monclient(hunting): picked mon.noname-b con 0x7f89dc182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc08a820 con 0x7f89dc08c620 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc089450 con 0x7f89dc08c250 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc089730 con 0x7f89dc182cc0 2026-02-12T17:32:32.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89e254c640 10 monclient(hunting): authenticate will time out at 832.318200s 2026-02-12T17:32:32.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89db7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f89dc08c620 0x7f89dc08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35418/0 (socket says 10.20.193.57:35418) 2026-02-12T17:32:32.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.499+0000 7f89db7fe640 1 -- 10.20.193.57:0/1899453480 learned_addr learned my addr 10.20.193.57:0/1899453480 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89db7fe640 1 -- 10.20.193.57:0/1899453480 >> v1:10.20.193.57:6789/0 conn(0x7f89dc08c620 legacy=0x7f89dc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89e0ac2640 1 -- 10.20.193.57:0/1899453480 >> v1:10.20.193.57:6790/0 conn(0x7f89dc182cc0 legacy=0x7f89dc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1693540466 0 0) 0x7f89cc002c20 con 0x7f89dc08c620 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient(hunting): my global_id is 4635 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c00035e0 con 0x7f89dc08c620 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472770229 0 0) 0x7f89dc089730 con 0x7f89dc182cc0 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient(hunting): my global_id is 44123 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89cc002c20 con 0x7f89dc182cc0 2026-02-12T17:32:32.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2560881207 0 0) 0x7f89cc002c20 con 0x7f89dc182cc0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 >> v1:10.20.193.82:6789/0 conn(0x7f89dc08c250 legacy=0x7f89dc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89dbfff640 1 -- 10.20.193.57:0/1899453480 >> v1:10.20.193.82:6789/0 conn(0x7f89dc08c250 legacy=0x7f89dc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 >> v1:10.20.193.57:6789/0 conn(0x7f89dc08c620 legacy=0x7f89dc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 monclient: found mon.noname-b 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc089a10 con 0x7f89dc182cc0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89d0004280 con 0x7f89dc182cc0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient: dump: 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89e254c640 5 monclient: authenticate success, global_id 44123 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89e254c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89e0ac2640 1 --1- 10.20.193.57:0/1899453480 >> v1:10.20.193.57:6790/0 conn(0x7f89dc182cc0 0x7f89dc1a30a0 :-1 s=OPENED pgs=101 gs=3 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f89d0004630 mon_map magic: 0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89d0004450 con 0x7f89dc182cc0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89daffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89e254c640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.501+0000 7f89e254c640 4 set_mon_vals no callback set 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 10 monclient: shutdown 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 1 -- 10.20.193.57:0/1899453480 >> v1:10.20.193.57:6790/0 conn(0x7f89dc182cc0 legacy=0x7f89dc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89daffd640 1 -- 10.20.193.57:0/1899453480 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89d0004630 con 0x7f89dc182cc0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89daffd640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 1 -- 10.20.193.57:0/1899453480 shutdown_connections 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 1 -- 10.20.193.57:0/1899453480 >> 10.20.193.57:0/1899453480 conn(0x7f89dc0916b0 msgr2=0x7f89dc091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 1 -- 10.20.193.57:0/1899453480 shutdown_connections 2026-02-12T17:32:32.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 1 -- 10.20.193.57:0/1899453480 wait complete. 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 10 monclient: monmap: 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 1 Processor -- start 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 1 -- start start 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 10 monclient: init 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.502+0000 7f89e254c640 10 monclient(hunting): picked mon.noname-c con 0x7f89dc08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.503+0000 7f89e254c640 10 monclient(hunting): picked mon.noname-a con 0x7f89dc08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.503+0000 7f89e254c640 10 monclient(hunting): picked mon.noname-b con 0x7f89dc182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.503+0000 7f89e254c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc086860 con 0x7f89dc08c620 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.503+0000 7f89e254c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc05dee0 con 0x7f89dc182cc0 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.503+0000 7f89e254c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc0870c0 con 0x7f89dc08c250 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.503+0000 7f89e254c640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.503+0000 7f89e254c640 10 monclient(hunting): authenticate will time out at 832.322028s 2026-02-12T17:32:32.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.503+0000 7f89dbfff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f89dc08c250 0x7f89dc13e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39466/0 (socket says 10.20.193.57:39466) 2026-02-12T17:32:32.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.503+0000 7f89dbfff640 1 -- 10.20.193.57:0/3875904432 learned_addr learned my addr 10.20.193.57:0/3875904432 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89dbfff640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6790/0 conn(0x7f89dc08c250 legacy=0x7f89dc13e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89db7fe640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6789/0 conn(0x7f89dc08c620 legacy=0x7f89dc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3741867916 0 0) 0x7f89dc0870c0 con 0x7f89dc08c250 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): my global_id is 44126 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89ac0035e0 con 0x7f89dc08c250 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 929908227 0 0) 0x7f89dc086860 con 0x7f89dc08c620 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): my global_id is 4638 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89dc0870c0 con 0x7f89dc08c620 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89e0ac2640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.82:6789/0 conn(0x7f89dc182cc0 legacy=0x7f89dc1823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3133062237 0 0) 0x7f89dc0870c0 con 0x7f89dc08c620 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89dc086860 con 0x7f89dc08c620 2026-02-12T17:32:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2303273281 0 0) 0x7f89ac0035e0 con 0x7f89dc08c250 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89dc0870c0 con 0x7f89dc08c250 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89c80032e0 con 0x7f89dc08c250 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): dump: 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89cc0048a0 con 0x7f89dc08c620 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient(hunting): dump: 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1315969187 0 0) 0x7f89dc086860 con 0x7f89dc08c620 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6790/0 conn(0x7f89dc08c250 legacy=0x7f89dc13e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.82:6789/0 conn(0x7f89dc182cc0 legacy=0x7f89dc1823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 monclient: found mon.a 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc182ad0 con 0x7f89dc08c620 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247192378 0 0) 0x7f89dc05dee0 con 0x7f89dc182cc0 2026-02-12T17:32:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89e254c640 5 monclient: authenticate success, global_id 4638 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89e254c640 10 monclient: _renew_subs 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89e254c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89dc13ed50 con 0x7f89dc08c620 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89e254c640 10 monclient: _renew_subs 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89e254c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f89dc13e850 con 0x7f89dc08c620 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89cc004cb0 con 0x7f89dc08c620 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89cc004fd0 con 0x7f89dc08c620 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89da7fc640 4 set_mon_vals no callback set 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.505+0000 7f89d8ff9640 10 monclient: dump: 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.506+0000 7f89e254c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.506+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f89dc090810 con 0x7f89dc1a47c0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.506+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f89cc011c40 con 0x7f89dc08c620 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.506+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(205..205 src has 1..205) ==== 3947+0+0 (unknown 975744462 0 0) 0x7f89cc04ea80 con 0x7f89dc08c620 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.506+0000 7f89e0ac2640 10 monclient: get_auth_request con 0x7f89ac03fa10 auth_method 0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89dbfff640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6789/0 conn(0x7f89dc1a47c0 legacy=0x7f89dc057290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1471624387 0 0) 0x7f89dc090810 con 0x7f89dc1a47c0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 10 monclient(hunting): my global_id is 4641 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89dc05dee0 con 0x7f89dc1a47c0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4003199852 0 0) 0x7f89dc05dee0 con 0x7f89dc1a47c0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89dc090810 con 0x7f89dc1a47c0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89c8003d90 con 0x7f89dc1a47c0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 10 monclient: dump: 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4098980020 0 0) 0x7f89dc090810 con 0x7f89dc1a47c0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89dc08f5b0 con 0x7f89dc1a47c0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f89c8004210 con 0x7f89dc1a47c0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6789/0 conn(0x7f89dc1a47c0 legacy=0x7f89dc057290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.508+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6789/0 conn(0x7f89dc1a47c0 legacy=0x7f89dc057290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:32.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.512+0000 7f89e254c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:32:32.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.512+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f89dc055340 con 0x7f89dc0579a0 2026-02-12T17:32:32.511 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89dbfff640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6789/0 conn(0x7f89dc0579a0 legacy=0x7f89dc11e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.511 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998074973 0 0) 0x7f89dc055340 con 0x7f89dc0579a0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 10 monclient(hunting): my global_id is 4644 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89dc090810 con 0x7f89dc0579a0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 630339709 0 0) 0x7f89dc090810 con 0x7f89dc0579a0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89dc055340 con 0x7f89dc0579a0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89c8005a30 con 0x7f89dc0579a0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 10 monclient: dump: 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2640486763 0 0) 0x7f89dc055340 con 0x7f89dc0579a0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f89dc085ba0 con 0x7f89dc0579a0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 2563270876) 0x7f89c8005e80 con 0x7f89dc0579a0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6789/0 conn(0x7f89dc0579a0 legacy=0x7f89dc11e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.514+0000 7f89d8ff9640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6789/0 conn(0x7f89dc0579a0 legacy=0x7f89dc11e7f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 22, 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 274046, 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:32.513 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.514 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:32.515 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:32:32.516 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.82:6800/2441377515 conn(0x7f89ac03fa10 legacy=0x7f89ac05fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e254c640 10 monclient: shutdown 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e254c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 >> v1:10.20.193.57:6789/0 conn(0x7f89dc08c620 legacy=0x7f89dc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e0ac2640 1 -- 10.20.193.57:0/3875904432 reap_dead start 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e0ac2640 1 -- 10.20.193.57:0/3875904432 reap_dead start 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 shutdown_connections 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 >> 10.20.193.57:0/3875904432 conn(0x7f89dc0916b0 msgr2=0x7f89dc08b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 shutdown_connections 2026-02-12T17:32:32.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.515+0000 7f89e254c640 1 -- 10.20.193.57:0/3875904432 wait complete. 2026-02-12T17:32:32.517 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:32:32.517 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:32:32.517 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:32:32.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.583+0000 7f0777a12640 10 monclient: get_monmap_and_config 2026-02-12T17:32:32.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.583+0000 7f0777a12640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.583+0000 7f0777a12640 10 monclient: monmap: 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:32.584794+0000 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:32.584794+0000 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:32.582 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 1 Processor -- start 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 1 -- start start 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 10 monclient: init 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 10 monclient(hunting): picked mon.noname-a con 0x7f077008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 10 monclient(hunting): picked mon.noname-b con 0x7f077008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 10 monclient(hunting): picked mon.noname-c con 0x7f0770182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077008a820 con 0x7f077008c250 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0770089450 con 0x7f0770182cc0 2026-02-12T17:32:32.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0770089730 con 0x7f077008c620 2026-02-12T17:32:32.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0777a12640 10 monclient(hunting): authenticate will time out at 832.403666s 2026-02-12T17:32:32.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0774f86640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f077008c620 0x7f077008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39470/0 (socket says 10.20.193.57:39470) 2026-02-12T17:32:32.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0774f86640 1 -- 10.20.193.57:0/1566111307 learned_addr learned my addr 10.20.193.57:0/1566111307 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.584+0000 7f0775787640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f077008c250 0x7f077008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35456/0 (socket says 10.20.193.57:35456) 2026-02-12T17:32:32.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.586+0000 7f0774f86640 1 -- 10.20.193.57:0/1566111307 >> v1:10.20.193.57:6790/0 conn(0x7f077008c620 legacy=0x7f077008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.586+0000 7f0775787640 1 -- 10.20.193.57:0/1566111307 >> v1:10.20.193.57:6789/0 conn(0x7f077008c250 legacy=0x7f077008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.586+0000 7f0775f88640 1 -- 10.20.193.57:0/1566111307 >> v1:10.20.193.82:6789/0 conn(0x7f0770182cc0 legacy=0x7f07701a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397407403 0 0) 0x7f0770089730 con 0x7f077008c620 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): my global_id is 44129 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07580035e0 con 0x7f077008c620 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2922632073 0 0) 0x7f0760002c20 con 0x7f077008c250 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): my global_id is 4647 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0770089730 con 0x7f077008c250 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707200768 0 0) 0x7f0770089450 con 0x7f0770182cc0 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient(hunting): my global_id is 4564 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0760002c20 con 0x7f0770182cc0 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3299872765 0 0) 0x7f07580035e0 con 0x7f077008c620 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 >> v1:10.20.193.82:6789/0 conn(0x7f0770182cc0 legacy=0x7f07701a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 >> v1:10.20.193.57:6789/0 conn(0x7f077008c250 legacy=0x7f077008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 monclient: found mon.noname-b 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0770089a10 con 0x7f077008c620 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0764003150 con 0x7f077008c620 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 5 monclient: authenticate success, global_id 44129 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: dump: 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.588 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07640033a0 con 0x7f077008c620 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 1 -- 10.20.193.57:0/1566111307 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0764004b10 con 0x7f077008c620 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f075ffff640 10 monclient: dump: 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.589 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 4 set_mon_vals no callback set 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 10 monclient: shutdown 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 1 -- 10.20.193.57:0/1566111307 >> v1:10.20.193.57:6790/0 conn(0x7f077008c620 legacy=0x7f077008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 1 -- 10.20.193.57:0/1566111307 shutdown_connections 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 1 -- 10.20.193.57:0/1566111307 >> 10.20.193.57:0/1566111307 conn(0x7f07700916b0 msgr2=0x7f0770091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 1 -- 10.20.193.57:0/1566111307 shutdown_connections 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.587+0000 7f0777a12640 1 -- 10.20.193.57:0/1566111307 wait complete. 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient: monmap: 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:32.590 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 1 Processor -- start 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 1 -- start start 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient: init 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient(hunting): picked mon.noname-a con 0x7f077008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient(hunting): picked mon.noname-c con 0x7f077008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient(hunting): picked mon.noname-b con 0x7f0770182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077013e830 con 0x7f077008c250 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0770087140 con 0x7f0770182cc0 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077005d580 con 0x7f077008c620 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0777a12640 10 monclient(hunting): authenticate will time out at 832.407628s 2026-02-12T17:32:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0775787640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f077008c250 0x7f077005c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35472/0 (socket says 10.20.193.57:35472) 2026-02-12T17:32:32.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0775787640 1 -- 10.20.193.57:0/446266332 learned_addr learned my addr 10.20.193.57:0/446266332 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.588+0000 7f0774f86640 1 --1- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6790/0 conn(0x7f077008c620 0x7f077005ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39484/0 (socket says 10.20.193.57:39484) 2026-02-12T17:32:32.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f0775787640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6789/0 conn(0x7f077008c250 legacy=0x7f077005c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f0774f86640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6790/0 conn(0x7f077008c620 legacy=0x7f077005ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1323451520 0 0) 0x7f077013e830 con 0x7f077008c250 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 10 monclient(hunting): my global_id is 4650 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07400035e0 con 0x7f077008c250 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307131818 0 0) 0x7f077005d580 con 0x7f077008c620 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 10 monclient(hunting): my global_id is 44132 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f077013e830 con 0x7f077008c620 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.590+0000 7f0775f88640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.82:6789/0 conn(0x7f0770182cc0 legacy=0x7f07701953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1485264947 0 0) 0x7f077013e830 con 0x7f077008c620 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f077005d580 con 0x7f077008c620 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 411835167 0 0) 0x7f07400035e0 con 0x7f077008c250 2026-02-12T17:32:32.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f077013e830 con 0x7f077008c250 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0764002fa0 con 0x7f077008c620 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): dump: 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0760003550 con 0x7f077008c250 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): dump: 2026-02-12T17:32:32.596 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285635700 0 0) 0x7f0770087140 con 0x7f0770182cc0 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient(hunting): my global_id is 4567 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07400035e0 con 0x7f0770182cc0 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 683120901 0 0) 0x7f077005d580 con 0x7f077008c620 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.82:6789/0 conn(0x7f0770182cc0 legacy=0x7f07701953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6789/0 conn(0x7f077008c250 legacy=0x7f077005c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 monclient: found mon.c 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0770087420 con 0x7f077008c620 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f0777a12640 5 monclient: authenticate success, global_id 44132 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f0777a12640 10 monclient: _renew_subs 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f0777a12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f077008eef0 con 0x7f077008c620 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f0777a12640 10 monclient: _renew_subs 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f0777a12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f07700888a0 con 0x7f077008c620 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0764002d70 con 0x7f077008c620 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f07640050f0 con 0x7f077008c620 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075f7fe640 4 set_mon_vals no callback set 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 10 monclient: dump: 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f0777a12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0770086f80 con 0x7f077018dae0 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.591+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0764011d60 con 0x7f077008c620 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.592+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(205..205 src has 1..205) ==== 3947+0+0 (unknown 975744462 0 0) 0x7f076404ebf0 con 0x7f077008c620 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.592+0000 7f0775f88640 10 monclient: get_auth_request con 0x7f074003fc60 auth_method 0 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.593+0000 7f0775787640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6790/0 conn(0x7f077018dae0 legacy=0x7f0770058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212089560 0 0) 0x7f0770086f80 con 0x7f077018dae0 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 10 monclient(hunting): my global_id is 44135 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f077005d580 con 0x7f077018dae0 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 792849676 0 0) 0x7f077005d580 con 0x7f077018dae0 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0770086f80 con 0x7f077018dae0 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0760005030 con 0x7f077018dae0 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 10 monclient: dump: 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2732819088 0 0) 0x7f0770086f80 con 0x7f077018dae0 2026-02-12T17:32:32.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0770090810 con 0x7f077018dae0 2026-02-12T17:32:32.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f07600073c0 con 0x7f077018dae0 2026-02-12T17:32:32.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:32.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6790/0 conn(0x7f077018dae0 legacy=0x7f0770058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.594+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6790/0 conn(0x7f077018dae0 legacy=0x7f0770058410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.597+0000 7f0777a12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.597+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f077008f5b0 con 0x7f077004d1c0 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0775787640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6790/0 conn(0x7f077004d1c0 legacy=0x7f0770197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103346155 0 0) 0x7f077008f5b0 con 0x7f077004d1c0 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 10 monclient(hunting): my global_id is 44138 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0770086f80 con 0x7f077004d1c0 2026-02-12T17:32:32.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2110022715 0 0) 0x7f0770086f80 con 0x7f077004d1c0 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f077008f5b0 con 0x7f077004d1c0 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0760005950 con 0x7f077004d1c0 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 10 monclient: dump: 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3613110030 0 0) 0x7f077008f5b0 con 0x7f077004d1c0 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0770055340 con 0x7f077004d1c0 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4337 (unknown 0 0 1315189108) 0x7f0760006f10 con 0x7f077004d1c0 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:32:32.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6790/0 conn(0x7f077004d1c0 legacy=0x7f0770197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f075dffb640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6790/0 conn(0x7f077004d1c0 legacy=0x7f0770197b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 22, 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 29525, 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 1, 2026-02-12T17:32:32.604 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:32:32.605 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:32:32.606 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:32.607 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.608 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:32:32.609 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:32:32.610 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:32:32.611 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:32:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.82:6800/2441377515 conn(0x7f074003fc60 legacy=0x7f0740060110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0777a12640 10 monclient: shutdown 2026-02-12T17:32:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0777a12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 >> v1:10.20.193.57:6790/0 conn(0x7f077008c620 legacy=0x7f077005ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0775f88640 1 -- 10.20.193.57:0/446266332 reap_dead start 2026-02-12T17:32:32.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 shutdown_connections 2026-02-12T17:32:32.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 >> 10.20.193.57:0/446266332 conn(0x7f07700916b0 msgr2=0x7f077018e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 shutdown_connections 2026-02-12T17:32:32.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.600+0000 7f0777a12640 1 -- 10.20.193.57:0/446266332 wait complete. 2026-02-12T17:32:32.613 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:32:32.613 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:32:32.613 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:32:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient: get_monmap_and_config 2026-02-12T17:32:32.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient: monmap: 2026-02-12T17:32:32.679 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.679 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.679 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:32.681959+0000 2026-02-12T17:32:32.679 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:32.681959+0000 2026-02-12T17:32:32.679 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.679 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.679 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.680 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:32.680 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:32.680 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 1 Processor -- start 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 1 -- start start 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient: init 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient(hunting): picked mon.noname-c con 0x7f42bc08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient(hunting): picked mon.noname-a con 0x7f42bc08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient(hunting): picked mon.noname-b con 0x7f42bc182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc08a820 con 0x7f42bc08c620 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc089450 con 0x7f42bc08c250 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc089730 con 0x7f42bc182cc0 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c42cc640 10 monclient(hunting): authenticate will time out at 832.500857s 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c1840640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f42bc08c620 0x7f42bc08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35482/0 (socket says 10.20.193.57:35482) 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c1840640 1 -- 10.20.193.57:0/3994740583 learned_addr learned my addr 10.20.193.57:0/3994740583 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.681+0000 7f42c2842640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f42bc182cc0 0x7f42bc1a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39520/0 (socket says 10.20.193.57:39520) 2026-02-12T17:32:32.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c2842640 1 -- 10.20.193.57:0/3994740583 >> v1:10.20.193.57:6790/0 conn(0x7f42bc182cc0 legacy=0x7f42bc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c1840640 1 -- 10.20.193.57:0/3994740583 >> v1:10.20.193.57:6789/0 conn(0x7f42bc08c620 legacy=0x7f42bc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255466674 0 0) 0x7f42bc089730 con 0x7f42bc182cc0 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient(hunting): my global_id is 44141 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a40035e0 con 0x7f42bc182cc0 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518318024 0 0) 0x7f42b0002b50 con 0x7f42bc08c620 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient(hunting): my global_id is 4653 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c2041640 1 -- 10.20.193.57:0/3994740583 >> v1:10.20.193.82:6789/0 conn(0x7f42bc08c250 legacy=0x7f42bc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42bc089730 con 0x7f42bc08c620 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3172622932 0 0) 0x7f42a40035e0 con 0x7f42bc182cc0 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 >> v1:10.20.193.82:6789/0 conn(0x7f42bc08c250 legacy=0x7f42bc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 >> v1:10.20.193.57:6789/0 conn(0x7f42bc08c620 legacy=0x7f42bc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 monclient: found mon.noname-b 2026-02-12T17:32:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc089a10 con 0x7f42bc182cc0 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f42b8004230 con 0x7f42bc182cc0 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: dump: 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 5 monclient: authenticate success, global_id 44141 2026-02-12T17:32:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42b80044f0 con 0x7f42bc182cc0 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 1 -- 10.20.193.57:0/3994740583 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f42b8005b30 con 0x7f42bc182cc0 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c103f640 10 monclient: dump: 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 4 set_mon_vals no callback set 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 10 monclient: shutdown 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 1 -- 10.20.193.57:0/3994740583 >> v1:10.20.193.57:6790/0 conn(0x7f42bc182cc0 legacy=0x7f42bc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 1 -- 10.20.193.57:0/3994740583 shutdown_connections 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 1 -- 10.20.193.57:0/3994740583 >> 10.20.193.57:0/3994740583 conn(0x7f42bc0916b0 msgr2=0x7f42bc091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 1 -- 10.20.193.57:0/3994740583 shutdown_connections 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.684+0000 7f42c42cc640 1 -- 10.20.193.57:0/3994740583 wait complete. 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient: monmap: 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 1 Processor -- start 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 1 -- start start 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient: init 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient(hunting): picked mon.noname-c con 0x7f42bc08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient(hunting): picked mon.noname-a con 0x7f42bc08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient(hunting): picked mon.noname-b con 0x7f42bc182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc05dca0 con 0x7f42bc08c620 2026-02-12T17:32:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc05e260 con 0x7f42bc182cc0 2026-02-12T17:32:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc13eb90 con 0x7f42bc08c250 2026-02-12T17:32:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c42cc640 10 monclient(hunting): authenticate will time out at 832.504839s 2026-02-12T17:32:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c1840640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f42bc08c620 0x7f42bc13ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35494/0 (socket says 10.20.193.57:35494) 2026-02-12T17:32:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.685+0000 7f42c1840640 1 -- 10.20.193.57:0/1604678492 learned_addr learned my addr 10.20.193.57:0/1604678492 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.687+0000 7f42c1840640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.57:6789/0 conn(0x7f42bc08c620 legacy=0x7f42bc13ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.687+0000 7f42c2041640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.57:6790/0 conn(0x7f42bc08c250 legacy=0x7f42bc191a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614207896 0 0) 0x7f42bc13eb90 con 0x7f42bc08c250 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): my global_id is 44144 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c0035e0 con 0x7f42bc08c250 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2737331837 0 0) 0x7f42bc05dca0 con 0x7f42bc08c620 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): my global_id is 4656 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42bc13eb90 con 0x7f42bc08c620 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c2842640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.82:6789/0 conn(0x7f42bc182cc0 legacy=0x7f42bc192da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2502586437 0 0) 0x7f428c0035e0 con 0x7f42bc08c250 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42bc05dca0 con 0x7f42bc08c250 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f42ac003340 con 0x7f42bc08c250 2026-02-12T17:32:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): dump: 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996310435 0 0) 0x7f42bc05e260 con 0x7f42bc182cc0 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): my global_id is 4573 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c0035e0 con 0x7f42bc182cc0 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3204787909 0 0) 0x7f42bc13eb90 con 0x7f42bc08c620 2026-02-12T17:32:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42bc05e260 con 0x7f42bc08c620 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f42b00033d0 con 0x7f42bc08c620 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient(hunting): dump: 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1117318813 0 0) 0x7f42bc05dca0 con 0x7f42bc08c250 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.82:6789/0 conn(0x7f42bc182cc0 legacy=0x7f42bc192da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.57:6789/0 conn(0x7f42bc08c620 legacy=0x7f42bc13ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 monclient: found mon.c 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc0888a0 con 0x7f42bc08c250 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c42cc640 5 monclient: authenticate success, global_id 44144 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c42cc640 10 monclient: _renew_subs 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c42cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42bc05c1e0 con 0x7f42bc08c250 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c42cc640 10 monclient: _renew_subs 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c42cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f42bc05c970 con 0x7f42bc08c250 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42ac003980 con 0x7f42bc08c250 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f42ac003ca0 con 0x7f42bc08c250 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c083e640 4 set_mon_vals no callback set 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42a2ffd640 10 monclient: dump: 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.694 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.688+0000 7f42c42cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.689+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f42bc05dee0 con 0x7f42bc18d360 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.689+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f42ac003f30 con 0x7f42bc08c250 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.689+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(205..205 src has 1..205) ==== 3947+0+0 (unknown 975744462 0 0) 0x7f42ac04ec30 con 0x7f42bc08c250 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.689+0000 7f42c2842640 10 monclient: get_auth_request con 0x7f428c03fd10 auth_method 0 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.691+0000 7f42c1840640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.82:6789/0 conn(0x7f42bc18d360 legacy=0x7f42bc18d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.691+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772159733 0 0) 0x7f42bc05dee0 con 0x7f42bc18d360 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.691+0000 7f42a2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.691+0000 7f42a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.691+0000 7f42a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.691+0000 7f42a2ffd640 10 monclient(hunting): my global_id is 4576 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.691+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42bc05dca0 con 0x7f42bc18d360 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2495658707 0 0) 0x7f42bc05dca0 con 0x7f42bc18d360 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42bc05dee0 con 0x7f42bc18d360 2026-02-12T17:32:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f42b0004c80 con 0x7f42bc18d360 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 10 monclient: dump: 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2647704234 0 0) 0x7f42bc05dee0 con 0x7f42bc18d360 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42bc090810 con 0x7f42bc18d360 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f42b0005990 con 0x7f42bc18d360 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.82:6789/0 conn(0x7f42bc18d360 legacy=0x7f42bc18d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.692+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.82:6789/0 conn(0x7f42bc18d360 legacy=0x7f42bc18d730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:32.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.695+0000 7f42c42cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:32:32.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.695+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f42bc055340 con 0x7f42bc18de40 2026-02-12T17:32:32.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42c1840640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.82:6789/0 conn(0x7f42bc18de40 legacy=0x7f42bc1954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935565619 0 0) 0x7f42bc055340 con 0x7f42bc18de40 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 10 monclient(hunting): my global_id is 4579 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42bc05dee0 con 0x7f42bc18de40 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 676517364 0 0) 0x7f42bc05dee0 con 0x7f42bc18de40 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42bc055340 con 0x7f42bc18de40 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f42b00053f0 con 0x7f42bc18de40 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 10 monclient: dump: 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.698 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 107233086 0 0) 0x7f42bc055340 con 0x7f42bc18de40 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f42bc18e210 con 0x7f42bc18de40 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 2955757943) 0x7f42b0005b80 con 0x7f42bc18de40 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.82:6789/0 conn(0x7f42bc18de40 legacy=0x7f42bc1954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.698+0000 7f42a2ffd640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.82:6789/0 conn(0x7f42bc18de40 legacy=0x7f42bc1954d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 22, 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 274195, 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:32:32.699 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 1, 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:32:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:32:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.705 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:32:32.707 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:32:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.82:6800/2441377515 conn(0x7f428c03fd10 legacy=0x7f428c0601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c42cc640 10 monclient: shutdown 2026-02-12T17:32:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c42cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 >> v1:10.20.193.57:6790/0 conn(0x7f42bc08c250 legacy=0x7f42bc191a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c2842640 1 -- 10.20.193.57:0/1604678492 reap_dead start 2026-02-12T17:32:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c2842640 1 -- 10.20.193.57:0/1604678492 reap_dead start 2026-02-12T17:32:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 shutdown_connections 2026-02-12T17:32:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 >> 10.20.193.57:0/1604678492 conn(0x7f42bc0916b0 msgr2=0x7f42bc08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 shutdown_connections 2026-02-12T17:32:32.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.699+0000 7f42c42cc640 1 -- 10.20.193.57:0/1604678492 wait complete. 2026-02-12T17:32:32.709 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:32:32.709 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:32:32.709 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:32:32.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.776+0000 7f49299b9640 10 monclient: get_monmap_and_config 2026-02-12T17:32:32.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.776+0000 7f49299b9640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.776+0000 7f49299b9640 10 monclient: monmap: 2026-02-12T17:32:32.774 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.774 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.774 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:32.777446+0000 2026-02-12T17:32:32.775 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:32.777446+0000 2026-02-12T17:32:32.775 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.775 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.775 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.775 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:32.775 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:32.775 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.776+0000 7f49299b9640 1 Processor -- start 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 1 -- start start 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 10 monclient: init 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 10 monclient(hunting): picked mon.noname-c con 0x7f492408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 10 monclient(hunting): picked mon.noname-b con 0x7f492408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 10 monclient(hunting): picked mon.noname-a con 0x7f492408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492408d600 con 0x7f492408cb30 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492408b1f0 con 0x7f492408ae20 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492408d1f0 con 0x7f492408c730 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49299b9640 10 monclient(hunting): authenticate will time out at 832.596302s 2026-02-12T17:32:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49227fc640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f492408c730 0x7f4924181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39536/0 (socket says 10.20.193.57:39536) 2026-02-12T17:32:32.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.777+0000 7f49227fc640 1 -- 10.20.193.57:0/3009607356 learned_addr learned my addr 10.20.193.57:0/3009607356 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f49227fc640 1 -- 10.20.193.57:0/3009607356 >> v1:10.20.193.57:6790/0 conn(0x7f492408c730 legacy=0x7f4924181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f49237fe640 1 -- 10.20.193.57:0/3009607356 >> v1:10.20.193.57:6789/0 conn(0x7f492408cb30 legacy=0x7f49241a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4922ffd640 1 -- 10.20.193.57:0/3009607356 >> v1:10.20.193.82:6789/0 conn(0x7f492408ae20 legacy=0x7f492408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181944965 0 0) 0x7f492408d1f0 con 0x7f492408c730 2026-02-12T17:32:32.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): my global_id is 44147 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49100035e0 con 0x7f492408c730 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597298468 0 0) 0x7f492408d600 con 0x7f492408cb30 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): my global_id is 4659 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492408d1f0 con 0x7f492408cb30 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841079076 0 0) 0x7f492408b1f0 con 0x7f492408ae20 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient(hunting): my global_id is 4582 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492408d600 con 0x7f492408ae20 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3111005276 0 0) 0x7f49100035e0 con 0x7f492408c730 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 >> v1:10.20.193.82:6789/0 conn(0x7f492408ae20 legacy=0x7f492408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 >> v1:10.20.193.57:6789/0 conn(0x7f492408cb30 legacy=0x7f49241a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 monclient: found mon.noname-b 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4924057320 con 0x7f492408c730 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f490c0030c0 con 0x7f492408c730 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f4921ffb640 10 monclient: dump: 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.781 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f49299b9640 5 monclient: authenticate success, global_id 44147 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.779+0000 7f49299b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f490c003350 con 0x7f492408c730 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f4921ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f4921ffb640 1 -- 10.20.193.57:0/3009607356 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f490c004960 con 0x7f492408c730 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f4921ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f4921ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f4921ffb640 10 monclient: dump: 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.782 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 4 set_mon_vals no callback set 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 10 monclient: shutdown 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 1 -- 10.20.193.57:0/3009607356 >> v1:10.20.193.57:6790/0 conn(0x7f492408c730 legacy=0x7f4924181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 1 -- 10.20.193.57:0/3009607356 shutdown_connections 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 1 -- 10.20.193.57:0/3009607356 >> 10.20.193.57:0/3009607356 conn(0x7f4924091620 msgr2=0x7f4924091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 1 -- 10.20.193.57:0/3009607356 shutdown_connections 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 1 -- 10.20.193.57:0/3009607356 wait complete. 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 10 monclient: build_initial_monmap 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 10 monclient: monmap: 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:32.783 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.780+0000 7f49299b9640 1 Processor -- start 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 1 -- start start 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 10 monclient: init 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 10 monclient(hunting): picked mon.noname-c con 0x7f492408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 10 monclient(hunting): picked mon.noname-a con 0x7f492408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 10 monclient(hunting): picked mon.noname-b con 0x7f492408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492408d9c0 con 0x7f492408c730 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49241536f0 con 0x7f492408cb30 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4924088810 con 0x7f492408ae20 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f49299b9640 10 monclient(hunting): authenticate will time out at 832.600291s 2026-02-12T17:32:32.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f4922ffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f492408ae20 0x7f4924152fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39548/0 (socket says 10.20.193.57:39548) 2026-02-12T17:32:32.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.781+0000 7f4922ffd640 1 -- 10.20.193.57:0/1335057978 learned_addr learned my addr 10.20.193.57:0/1335057978 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f4922ffd640 1 -- 10.20.193.57:0/1335057978 >> v1:10.20.193.57:6790/0 conn(0x7f492408ae20 legacy=0x7f4924152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f49227fc640 1 -- 10.20.193.57:0/1335057978 >> v1:10.20.193.57:6789/0 conn(0x7f492408c730 legacy=0x7f4924086be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447798879 0 0) 0x7f4924088810 con 0x7f492408ae20 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): my global_id is 44150 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48f40035e0 con 0x7f492408ae20 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825127975 0 0) 0x7f492408d9c0 con 0x7f492408c730 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): my global_id is 4662 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4924088810 con 0x7f492408c730 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f49237fe640 1 -- 10.20.193.57:0/1335057978 >> v1:10.20.193.82:6789/0 conn(0x7f492408cb30 legacy=0x7f4924195140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1850035432 0 0) 0x7f48f40035e0 con 0x7f492408ae20 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f492408d9c0 con 0x7f492408ae20 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f49180033b0 con 0x7f492408ae20 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): dump: 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.788 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1067616997 0 0) 0x7f4924088810 con 0x7f492408c730 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48f40035e0 con 0x7f492408c730 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f490c002b30 con 0x7f492408c730 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient(hunting): dump: 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1872760621 0 0) 0x7f492408d9c0 con 0x7f492408ae20 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 >> v1:10.20.193.82:6789/0 conn(0x7f492408cb30 legacy=0x7f4924195140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 >> v1:10.20.193.57:6789/0 conn(0x7f492408c730 legacy=0x7f4924086be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient: _finish_hunting 0 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 monclient: found mon.c 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4924083370 con 0x7f492408ae20 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient: _finish_auth 0 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 10 monclient: _check_auth_tickets 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f48fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f49299b9640 5 monclient: authenticate success, global_id 44150 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f49299b9640 10 monclient: _renew_subs 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f49299b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.783+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4924083f30 con 0x7f492408ae20 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f49299b9640 10 monclient: _renew_subs 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f49299b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f49240872f0 con 0x7f492408ae20 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4918003980 con 0x7f492408ae20 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f48fbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4918003d10 con 0x7f492408ae20 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f48fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f48fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f48fbfff640 10 monclient: dump: 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f49217fa640 4 set_mon_vals no callback set 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f49299b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f49299b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f49299b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49240008d0 con 0x7f492408ae20 2026-02-12T17:32:32.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f4918003fa0 con 0x7f492408ae20 2026-02-12T17:32:32.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.784+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(205..205 src has 1..205) ==== 3947+0+0 (unknown 975744462 0 0) 0x7f491804eac0 con 0x7f492408ae20 2026-02-12T17:32:32.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.785+0000 7f49227fc640 10 monclient: get_auth_request con 0x7f48f403fa30 auth_method 0 2026-02-12T17:32:32.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.787+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f4918017240 con 0x7f492408ae20 2026-02-12T17:32:32.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.787+0000 7f48fbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:32.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.787+0000 7f48fbfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:32.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.930+0000 7f49299b9640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:32:32.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.930+0000 7f49299b9640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:32:32.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.930+0000 7f49299b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:32.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.930+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f4924083ed0 con 0x7f492408ae20 2026-02-12T17:32:32.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.931+0000 7f48fbfff640 1 -- 10.20.193.57:0/1335057978 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f49180169f0 con 0x7f492408ae20 2026-02-12T17:32:32.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.932+0000 7f48fbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:32:32.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.932+0000 7f48fbfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:32.932 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.932 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=13,kv=9,logm=65} crc {auth=2108616033,config=1618278320,health=1181117202,kv=3942281178,logm=1060648705}) 2026-02-12T17:32:32.932 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=12,kv=10,logm=65} crc {auth=2108616033,config=1618278320,health=1881428993,kv=2230797681,logm=1064515023}) 2026-02-12T17:32:32.932 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.932 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=13,kv=9,logm=65} crc {auth=2108616033,config=1618278320,health=1181117202,kv=3942281178,logm=1060648705}) 2026-02-12T17:32:32.932 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=10,config=2,health=11,kv=11,logm=66} crc {auth=4166146077,config=1618278320,health=2336895171,kv=1466688342,logm=2896550213}) 2026-02-12T17:32:32.932 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.932 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3195784822}) 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2268017921}) 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3195784822}) 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.928+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3927483978}) 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.929+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.929+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2140566197}) 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.929+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2154064083}) 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.929+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.929+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2140566197}) 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.929+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4201888101}) 2026-02-12T17:32:32.933 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.934 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4202064823}) 2026-02-12T17:32:32.934 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4246164286}) 2026-02-12T17:32:32.934 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.934 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4202064823}) 2026-02-12T17:32:32.934 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2124682415}) 2026-02-12T17:32:32.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.933+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 >> v1:10.20.193.82:6800/2441377515 conn(0x7f48f403fa30 legacy=0x7f48f405fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.933+0000 7f49299b9640 10 monclient: shutdown 2026-02-12T17:32:32.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.933+0000 7f49299b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:32.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.933+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 >> v1:10.20.193.57:6790/0 conn(0x7f492408ae20 legacy=0x7f4924152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:32.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.933+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 shutdown_connections 2026-02-12T17:32:32.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.933+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 >> 10.20.193.57:0/1335057978 conn(0x7f4924091620 msgr2=0x7f49240597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:32.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.933+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 shutdown_connections 2026-02-12T17:32:32.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:32.933+0000 7f49299b9640 1 -- 10.20.193.57:0/1335057978 wait complete. 2026-02-12T17:32:32.942 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:32:32.942 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.942 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2100360116}) 2026-02-12T17:32:32.942 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3576520633}) 2026-02-12T17:32:32.942 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.942 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2100360116}) 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.930+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1238146840}) 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1184669546}) 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2655094573}) 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1184669546}) 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1334361990}) 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=856606713}) 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241097632}) 2026-02-12T17:32:32.943 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=856606713}) 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.931+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4179916110}) 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.932+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.932+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=169229006}) 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.932+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1247863001}) 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.932+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.932+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=169229006}) 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.932+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=451069483}) 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=213834335}) 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2854389864}) 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.944 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=213834335}) 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1705851617}) 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1200000038}) 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3723533759}) 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1200000038}) 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.933+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4187548171}) 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=28,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=24} crc {logm=1101729607,mdsmap=2204869053,mgr=919603529,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3202334106,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3814064227,osd_pg_creating=1491817950,osd_snap=3267594247}) 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=26,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=26} crc {logm=1667464315,mdsmap=2130131172,mgr=1659003414,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3202334106,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1491817950,osd_snap=2655352121}) 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.945 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=28,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=24} crc {logm=1101729607,mdsmap=2204869053,mgr=919603529,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3202334106,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3814064227,osd_pg_creating=1491817950,osd_snap=3267594247}) 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=27,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=27} crc {logm=2605292367,mdsmap=2204869053,mgr=362726177,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=2805208887,mon_config_key=2653962004,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1491817950,osd_snap=3586702372}) 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=9,osdmap=91} crc {osd_snap=2100016332,osdmap=179030143}) 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=9,osdmap=91} crc {osd_snap=2100016332,osdmap=2679732880}) 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=9,osdmap=91} crc {osd_snap=2100016332,osdmap=179030143}) 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.934+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=9,osdmap=91} crc {osd_snap=2100016332,osdmap=1203824796}) 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2017184198}) 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2700436430}) 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.946 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2017184198}) 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1792012676}) 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2520638512}) 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1709250768}) 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2520638512}) 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.935+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3630162030}) 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.936+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.936+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=20} crc {osdmap=3967649130}) 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.936+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=18} crc {osdmap=1247120115}) 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.936+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:32:32.947 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.936+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=20} crc {osdmap=3967649130}) 2026-02-12T17:32:32.948 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:32:32.936+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=20} crc {osdmap=420923832}) 2026-02-12T17:32:33.023 INFO:tasks.rados.rados.0.trial082.stdout:877: done (1 left) 2026-02-12T17:32:33.023 INFO:tasks.rados.rados.0.trial082.stdout:878: snap_remove snap 85 2026-02-12T17:32:33.943 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:32:33.943 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:32:34.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient: get_monmap_and_config 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient: monmap: 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:34.010893+0000 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:34.010893+0000 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.008 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:34.009 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:34.009 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 1 Processor -- start 2026-02-12T17:32:34.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 1 -- start start 2026-02-12T17:32:34.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient: init 2026-02-12T17:32:34.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:32:34.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient(hunting): picked mon.noname-b con 0x7f366408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient(hunting): picked mon.noname-c con 0x7f366408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient(hunting): picked mon.noname-a con 0x7f366408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366408d600 con 0x7f366408cb30 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366408b1f0 con 0x7f366408c730 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366408d1f0 con 0x7f366408ae20 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f366ae8c640 10 monclient(hunting): authenticate will time out at 833.829794s 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f3669402640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f366408cb30 0x7f36641a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:56190/0 (socket says 10.20.193.57:56190) 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f3669402640 1 -- 10.20.193.57:0/3860834623 learned_addr learned my addr 10.20.193.57:0/3860834623 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.010+0000 7f3668c01640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f366408ae20 0x7f366408c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:52864/0 (socket says 10.20.193.57:52864) 2026-02-12T17:32:34.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f3669402640 1 -- 10.20.193.57:0/3860834623 >> v1:10.20.193.57:6789/0 conn(0x7f366408cb30 legacy=0x7f36641a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f3668c01640 1 -- 10.20.193.57:0/3860834623 >> v1:10.20.193.57:6790/0 conn(0x7f366408ae20 legacy=0x7f366408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484354509 0 0) 0x7f366408d600 con 0x7f366408cb30 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient(hunting): my global_id is 4665 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36500035e0 con 0x7f366408cb30 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997180354 0 0) 0x7f366408d1f0 con 0x7f366408ae20 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient(hunting): my global_id is 44153 2026-02-12T17:32:34.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f366408d600 con 0x7f366408ae20 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365bfff640 1 -- 10.20.193.57:0/3860834623 >> v1:10.20.193.82:6789/0 conn(0x7f366408c730 legacy=0x7f3664181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3071107189 0 0) 0x7f36500035e0 con 0x7f366408cb30 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 >> v1:10.20.193.57:6790/0 conn(0x7f366408ae20 legacy=0x7f366408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 >> v1:10.20.193.82:6789/0 conn(0x7f366408c730 legacy=0x7f3664181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 monclient: found mon.noname-a 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3664057320 con 0x7f366408cb30 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3660004230 con 0x7f366408cb30 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: dump: 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.021 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 5 monclient: authenticate success, global_id 4665 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3660004480 con 0x7f366408cb30 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 1 -- 10.20.193.57:0/3860834623 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3660005bf0 con 0x7f366408cb30 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f365b7fe640 10 monclient: dump: 2026-02-12T17:32:34.022 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 4 set_mon_vals no callback set 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 10 monclient: shutdown 2026-02-12T17:32:34.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 1 -- 10.20.193.57:0/3860834623 >> v1:10.20.193.57:6789/0 conn(0x7f366408cb30 legacy=0x7f36641a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 1 -- 10.20.193.57:0/3860834623 shutdown_connections 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 1 -- 10.20.193.57:0/3860834623 >> 10.20.193.57:0/3860834623 conn(0x7f3664091620 msgr2=0x7f3664091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 1 -- 10.20.193.57:0/3860834623 shutdown_connections 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.013+0000 7f366ae8c640 1 -- 10.20.193.57:0/3860834623 wait complete. 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient: monmap: 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:34.024 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 1 Processor -- start 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 1 -- start start 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient: init 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:32:34.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient(hunting): picked mon.noname-a con 0x7f366408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient(hunting): picked mon.noname-b con 0x7f366408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient(hunting): picked mon.noname-c con 0x7f366408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366408d9c0 con 0x7f366408ae20 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36641224a0 con 0x7f366408c730 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3664088810 con 0x7f366408cb30 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f366ae8c640 10 monclient(hunting): authenticate will time out at 833.833775s 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f3668c01640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f366408ae20 0x7f36641331b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:56192/0 (socket says 10.20.193.57:56192) 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.014+0000 7f3668c01640 1 -- 10.20.193.57:0/2119219933 learned_addr learned my addr 10.20.193.57:0/2119219933 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.016+0000 7f3668c01640 1 -- 10.20.193.57:0/2119219933 >> v1:10.20.193.57:6789/0 conn(0x7f366408ae20 legacy=0x7f36641331b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.016+0000 7f3669402640 1 -- 10.20.193.57:0/2119219933 >> v1:10.20.193.57:6790/0 conn(0x7f366408cb30 legacy=0x7f36641a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f365bfff640 1 -- 10.20.193.57:0/2119219933 >> v1:10.20.193.82:6789/0 conn(0x7f366408c730 legacy=0x7f36641338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231152011 0 0) 0x7f3664088810 con 0x7f366408cb30 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): my global_id is 44156 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36340035e0 con 0x7f366408cb30 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048492013 0 0) 0x7f366408d9c0 con 0x7f366408ae20 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): my global_id is 4668 2026-02-12T17:32:34.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3664088810 con 0x7f366408ae20 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940641202 0 0) 0x7f36641224a0 con 0x7f366408c730 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): my global_id is 4591 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f366408d9c0 con 0x7f366408c730 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 869411232 0 0) 0x7f36340035e0 con 0x7f366408cb30 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36641224a0 con 0x7f366408cb30 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3660004080 con 0x7f366408cb30 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): dump: 2026-02-12T17:32:34.028 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:34.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1898847390 0 0) 0x7f3664088810 con 0x7f366408ae20 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36340035e0 con 0x7f366408ae20 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3654003310 con 0x7f366408ae20 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient(hunting): dump: 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.030 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 614397505 0 0) 0x7f36641224a0 con 0x7f366408cb30 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 >> v1:10.20.193.82:6789/0 conn(0x7f366408c730 legacy=0x7f36641338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 >> v1:10.20.193.57:6789/0 conn(0x7f366408ae20 legacy=0x7f36641331b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 monclient: found mon.c 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366411d970 con 0x7f366408cb30 2026-02-12T17:32:34.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f366ae8c640 5 monclient: authenticate success, global_id 44156 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f366ae8c640 10 monclient: _renew_subs 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f366ae8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3664133fd0 con 0x7f366408cb30 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f366ae8c640 10 monclient: _renew_subs 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f366ae8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f366411d690 con 0x7f366408cb30 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3660003e50 con 0x7f366408cb30 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f36600061d0 con 0x7f366408cb30 2026-02-12T17:32:34.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f36597fa640 10 monclient: dump: 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.033 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.017+0000 7f365affd640 4 set_mon_vals no callback set 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.018+0000 7f366ae8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.018+0000 7f366ae8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.018+0000 7f366ae8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.018+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f366411c1a0 con 0x7f366408cb30 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.018+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3660012e40 con 0x7f366408cb30 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.018+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(206..206 src has 1..206) ==== 4003+0+0 (unknown 3486574554 0 0) 0x7f366004fc20 con 0x7f366408cb30 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.018+0000 7f3668c01640 10 monclient: get_auth_request con 0x7f363403fce0 auth_method 0 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.020+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3660018400 con 0x7f366408cb30 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.020+0000 7f36597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.020+0000 7f36597fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:34.035 INFO:tasks.rados.rados.0.trial082.stdout:878: done (1 left) 2026-02-12T17:32:34.035 INFO:tasks.rados.rados.0.trial082.stdout:879: snap_create 2026-02-12T17:32:34.035 INFO:tasks.rados.rados.0.trial082.stdout:876: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:32:34.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.166+0000 7f366ae8c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:32:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.166+0000 7f366ae8c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.166+0000 7f366ae8c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.166+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f366411d4b0 con 0x7f366408cb30 2026-02-12T17:32:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.166+0000 7f36597fa640 1 -- 10.20.193.57:0/2119219933 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 885111571) 0x7f3660016390 con 0x7f366408cb30 2026-02-12T17:32:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.166+0000 7f36597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.166+0000 7f36597fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:34.166 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:32:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.168+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 >> v1:10.20.193.82:6800/2441377515 conn(0x7f363403fce0 legacy=0x7f3634060190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.168+0000 7f366ae8c640 10 monclient: shutdown 2026-02-12T17:32:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.168+0000 7f366ae8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.168+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 >> v1:10.20.193.57:6790/0 conn(0x7f366408cb30 legacy=0x7f36641a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.168+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 shutdown_connections 2026-02-12T17:32:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.168+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 >> 10.20.193.57:0/2119219933 conn(0x7f3664091620 msgr2=0x7f36640597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.168+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 shutdown_connections 2026-02-12T17:32:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.168+0000 7f366ae8c640 1 -- 10.20.193.57:0/2119219933 wait complete. 2026-02-12T17:32:34.174 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:32:34.174 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:32:34.174 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:32:34.175 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:32:34.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.244+0000 7f7cb879d640 10 monclient: get_monmap_and_config 2026-02-12T17:32:34.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.244+0000 7f7cb879d640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.244+0000 7f7cb879d640 10 monclient: monmap: 2026-02-12T17:32:34.242 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.242 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.243 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:34.245430+0000 2026-02-12T17:32:34.243 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:34.245430+0000 2026-02-12T17:32:34.243 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.243 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.243 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.243 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:34.243 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:34.243 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 1 Processor -- start 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 1 -- start start 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 10 monclient: init 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 10 monclient(hunting): picked mon.noname-c con 0x7f7cb008e290 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 10 monclient(hunting): picked mon.noname-b con 0x7f7cb008f500 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 10 monclient(hunting): picked mon.noname-a con 0x7f7cb008ed70 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb008fbd0 con 0x7f7cb008ed70 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb0056250 con 0x7f7cb008e290 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb0056530 con 0x7f7cb008f500 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb879d640 10 monclient(hunting): authenticate will time out at 834.064352s 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb5d11640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f7cb008f500 0x7f7cb0183f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:52894/0 (socket says 10.20.193.57:52894) 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb6d13640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f7cb008ed70 0x7f7cb01a5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:56196/0 (socket says 10.20.193.57:56196) 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.245+0000 7f7cb5d11640 1 -- 10.20.193.57:0/4231521388 learned_addr learned my addr 10.20.193.57:0/4231521388 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb6d13640 1 -- 10.20.193.57:0/4231521388 >> v1:10.20.193.57:6789/0 conn(0x7f7cb008ed70 legacy=0x7f7cb01a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5d11640 1 -- 10.20.193.57:0/4231521388 >> v1:10.20.193.57:6790/0 conn(0x7f7cb008f500 legacy=0x7f7cb0183f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb6512640 1 -- 10.20.193.57:0/4231521388 >> v1:10.20.193.82:6789/0 conn(0x7f7cb008e290 legacy=0x7f7cb008e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843403960 0 0) 0x7f7cb008fbd0 con 0x7f7cb008ed70 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient(hunting): my global_id is 4671 2026-02-12T17:32:34.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c980035e0 con 0x7f7cb008ed70 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2156746379 0 0) 0x7f7cb0056530 con 0x7f7cb008f500 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient(hunting): my global_id is 44159 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb008fbd0 con 0x7f7cb008f500 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3046226548 0 0) 0x7f7c980035e0 con 0x7f7cb008ed70 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 >> v1:10.20.193.57:6790/0 conn(0x7f7cb008f500 legacy=0x7f7cb0183f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 >> v1:10.20.193.82:6789/0 conn(0x7f7cb008e290 legacy=0x7f7cb008e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 monclient: found mon.noname-a 2026-02-12T17:32:34.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb0056810 con 0x7f7cb008ed70 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7cac004230 con 0x7f7cb008ed70 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb5510640 10 monclient: dump: 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.252 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb879d640 5 monclient: authenticate success, global_id 4671 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.247+0000 7f7cb879d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cac004470 con 0x7f7cb008ed70 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb5510640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 4 set_mon_vals no callback set 2026-02-12T17:32:34.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb5510640 1 -- 10.20.193.57:0/4231521388 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7cac005b30 con 0x7f7cb008ed70 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb5510640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb5510640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb5510640 10 monclient: dump: 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.254 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 10 monclient: shutdown 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 1 -- 10.20.193.57:0/4231521388 >> v1:10.20.193.57:6789/0 conn(0x7f7cb008ed70 legacy=0x7f7cb01a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 1 -- 10.20.193.57:0/4231521388 shutdown_connections 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 1 -- 10.20.193.57:0/4231521388 >> 10.20.193.57:0/4231521388 conn(0x7f7cb0054b30 msgr2=0x7f7cb0093890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 1 -- 10.20.193.57:0/4231521388 shutdown_connections 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 1 -- 10.20.193.57:0/4231521388 wait complete. 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.248+0000 7f7cb879d640 10 monclient: monmap: 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:34.255 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 1 Processor -- start 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 1 -- start start 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 10 monclient: init 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:32:34.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 10 monclient(hunting): picked mon.noname-a con 0x7f7cb008e290 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 10 monclient(hunting): picked mon.noname-b con 0x7f7cb008ed70 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 10 monclient(hunting): picked mon.noname-c con 0x7f7cb008f500 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb01400e0 con 0x7f7cb008e290 2026-02-12T17:32:34.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb013dee0 con 0x7f7cb008ed70 2026-02-12T17:32:34.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb013f400 con 0x7f7cb008f500 2026-02-12T17:32:34.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb879d640 10 monclient(hunting): authenticate will time out at 834.068536s 2026-02-12T17:32:34.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb6512640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f7cb008e290 0x7f7cb0153650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:56208/0 (socket says 10.20.193.57:56208) 2026-02-12T17:32:34.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.249+0000 7f7cb6512640 1 -- 10.20.193.57:0/3250584097 learned_addr learned my addr 10.20.193.57:0/3250584097 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7cb6512640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6789/0 conn(0x7f7cb008e290 legacy=0x7f7cb0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7cb6d13640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6790/0 conn(0x7f7cb008f500 legacy=0x7f7cb0195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172660002 0 0) 0x7f7cb01400e0 con 0x7f7cb008e290 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 10 monclient(hunting): my global_id is 4674 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c800035e0 con 0x7f7cb008e290 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722531772 0 0) 0x7f7cb013f400 con 0x7f7cb008f500 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 10 monclient(hunting): my global_id is 44162 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.251+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb01400e0 con 0x7f7cb008f500 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2980397002 0 0) 0x7f7c800035e0 con 0x7f7cb008e290 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cb013f400 con 0x7f7cb008e290 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ca00033c0 con 0x7f7cb008e290 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient(hunting): dump: 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.265 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb5d11640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.82:6789/0 conn(0x7f7cb008ed70 legacy=0x7f7cb0194210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2045197995 0 0) 0x7f7cb01400e0 con 0x7f7cb008f500 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c800035e0 con 0x7f7cb008f500 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7cac004080 con 0x7f7cb008f500 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:34.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient(hunting): dump: 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1128447502 0 0) 0x7f7cb013f400 con 0x7f7cb008e290 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6790/0 conn(0x7f7cb008f500 legacy=0x7f7cb0195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.82:6789/0 conn(0x7f7cb008ed70 legacy=0x7f7cb0194210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 monclient: found mon.a 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb0141f10 con 0x7f7cb008e290 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb879d640 5 monclient: authenticate success, global_id 4674 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb879d640 10 monclient: _renew_subs 2026-02-12T17:32:34.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb879d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb008a400 con 0x7f7cb008e290 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb879d640 10 monclient: _renew_subs 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb879d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7cb013f120 con 0x7f7cb008e290 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ca00039f0 con 0x7f7cb008e290 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ca0003d10 con 0x7f7cb008e290 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 10 monclient: dump: 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.269 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb4d0f640 4 set_mon_vals no callback set 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb879d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7cb008f2e0 con 0x7f7cb013c8d0 2026-02-12T17:32:34.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.252+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f7ca0003fa0 con 0x7f7cb008e290 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.253+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(207..207 src has 1..207) ==== 3975+0+0 (unknown 2917108618 0 0) 0x7f7ca004ed10 con 0x7f7cb008e290 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.253+0000 7f7cb6d13640 10 monclient: get_auth_request con 0x7f7c8003fae0 auth_method 0 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.254+0000 7f7cb5d11640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6789/0 conn(0x7f7cb013c8d0 legacy=0x7f7cb008ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.254+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398634850 0 0) 0x7f7cb008f2e0 con 0x7f7cb013c8d0 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.254+0000 7f7c96ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.254+0000 7f7c96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.254+0000 7f7c96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.254+0000 7f7c96ffd640 10 monclient(hunting): my global_id is 4677 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.254+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb013f400 con 0x7f7cb013c8d0 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2182710232 0 0) 0x7f7cb013f400 con 0x7f7cb013c8d0 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cb008f2e0 con 0x7f7cb013c8d0 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ca4003120 con 0x7f7cb013c8d0 2026-02-12T17:32:34.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 10 monclient: dump: 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.272 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1970756293 0 0) 0x7f7cb008f2e0 con 0x7f7cb013c8d0 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7cb005ee00 con 0x7f7cb013c8d0 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7ca4003510 con 0x7f7cb013c8d0 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6789/0 conn(0x7f7cb013c8d0 legacy=0x7f7cb008ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.255+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6789/0 conn(0x7f7cb013c8d0 legacy=0x7f7cb008ac90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.258+0000 7f7cb879d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.258+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7cb0153d60 con 0x7f7cb008b3a0 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7cb5d11640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6789/0 conn(0x7f7cb008b3a0 legacy=0x7f7cb0198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272663984 0 0) 0x7f7cb0153d60 con 0x7f7cb008b3a0 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 10 monclient(hunting): my global_id is 4680 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb008f2e0 con 0x7f7cb008b3a0 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4043368177 0 0) 0x7f7cb008f2e0 con 0x7f7cb008b3a0 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cb0153d60 con 0x7f7cb008b3a0 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ca4004cd0 con 0x7f7cb008b3a0 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.260+0000 7f7c96ffd640 10 monclient: dump: 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.274 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 422885305 0 0) 0x7f7cb0153d60 con 0x7f7cb008b3a0 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7cb013f740 con 0x7f7cb008b3a0 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 1328459926) 0x7f7ca4005a10 con 0x7f7cb008b3a0 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7c96ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:32:34.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7c96ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:34.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6789/0 conn(0x7f7cb008b3a0 legacy=0x7f7cb0198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7c96ffd640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6789/0 conn(0x7f7cb008b3a0 legacy=0x7f7cb0198060 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:34.276 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:32:34.276 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:34.276 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:34.276 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:32:34.276 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 22, 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 275793, 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:34.277 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:34.278 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:34.278 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:34.278 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:34.278 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:34.278 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:34.278 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:34.278 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:34.278 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:34.278 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:34.279 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:32:34.280 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:34.281 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:34.282 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.283 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:34.284 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:34.285 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:32:34.286 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.287 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.288 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:32:34.289 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.82:6800/2441377515 conn(0x7f7c8003fae0 legacy=0x7f7c8005ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb879d640 10 monclient: shutdown 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb879d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 >> v1:10.20.193.57:6789/0 conn(0x7f7cb008e290 legacy=0x7f7cb0153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb6d13640 1 -- 10.20.193.57:0/3250584097 reap_dead start 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb6d13640 1 -- 10.20.193.57:0/3250584097 reap_dead start 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 shutdown_connections 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 >> 10.20.193.57:0/3250584097 conn(0x7f7cb0054b30 msgr2=0x7f7cb008d750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 shutdown_connections 2026-02-12T17:32:34.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.261+0000 7f7cb879d640 1 -- 10.20.193.57:0/3250584097 wait complete. 2026-02-12T17:32:34.291 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:32:34.291 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:32:34.291 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:32:34.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.358+0000 7f3fb0e52640 10 monclient: get_monmap_and_config 2026-02-12T17:32:34.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.358+0000 7f3fb0e52640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.358+0000 7f3fb0e52640 10 monclient: monmap: 2026-02-12T17:32:34.356 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.357 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.357 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:34.359452+0000 2026-02-12T17:32:34.357 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:34.359452+0000 2026-02-12T17:32:34.357 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.357 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.357 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.357 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:34.357 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:34.357 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 1 Processor -- start 2026-02-12T17:32:34.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 1 -- start start 2026-02-12T17:32:34.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 10 monclient: init 2026-02-12T17:32:34.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:32:34.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 10 monclient(hunting): picked mon.noname-b con 0x7f3fac0906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 10 monclient(hunting): picked mon.noname-c con 0x7f3fac0911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 10 monclient(hunting): picked mon.noname-a con 0x7f3fac185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac090100 con 0x7f3fac185070 2026-02-12T17:32:34.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac091a70 con 0x7f3fac0911b0 2026-02-12T17:32:34.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac092360 con 0x7f3fac0906d0 2026-02-12T17:32:34.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3fb0e52640 10 monclient(hunting): authenticate will time out at 834.178594s 2026-02-12T17:32:34.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3faa575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3fac0906d0 0x7f3fac090aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:52912/0 (socket says 10.20.193.57:52912) 2026-02-12T17:32:34.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3faa575640 1 -- 10.20.193.57:0/491796149 learned_addr learned my addr 10.20.193.57:0/491796149 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.359+0000 7f3faad76640 1 --1- 10.20.193.57:0/491796149 >> v1:10.20.193.57:6789/0 conn(0x7f3fac185070 0x7f3fac1a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:56234/0 (socket says 10.20.193.57:56234) 2026-02-12T17:32:34.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.361+0000 7f3faad76640 1 -- 10.20.193.57:0/491796149 >> v1:10.20.193.57:6789/0 conn(0x7f3fac185070 legacy=0x7f3fac1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.361+0000 7f3faa575640 1 -- 10.20.193.57:0/491796149 >> v1:10.20.193.57:6790/0 conn(0x7f3fac0906d0 legacy=0x7f3fac090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9d74640 1 -- 10.20.193.57:0/491796149 >> v1:10.20.193.82:6789/0 conn(0x7f3fac0911b0 legacy=0x7f3fac183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849445820 0 0) 0x7f3fac090100 con 0x7f3fac185070 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): my global_id is 4683 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f980035e0 con 0x7f3fac185070 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422275609 0 0) 0x7f3fac092360 con 0x7f3fac0906d0 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.369 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): my global_id is 44165 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fac090100 con 0x7f3fac0906d0 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986512427 0 0) 0x7f3fac091a70 con 0x7f3fac0911b0 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient(hunting): my global_id is 4600 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fac092360 con 0x7f3fac0911b0 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1019355905 0 0) 0x7f3fac090100 con 0x7f3fac0906d0 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 >> v1:10.20.193.82:6789/0 conn(0x7f3fac0911b0 legacy=0x7f3fac183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 >> v1:10.20.193.57:6789/0 conn(0x7f3fac185070 legacy=0x7f3fac1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 monclient: found mon.noname-b 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac05cf80 con 0x7f3fac0906d0 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3fa00030d0 con 0x7f3fac0906d0 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: dump: 2026-02-12T17:32:34.371 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 5 monclient: authenticate success, global_id 44165 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:34.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fa0003360 con 0x7f3fac0906d0 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 1 -- 10.20.193.57:0/491796149 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3fa0004960 con 0x7f3fac0906d0 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fa9573640 10 monclient: dump: 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.373 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 4 set_mon_vals no callback set 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 10 monclient: shutdown 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 1 -- 10.20.193.57:0/491796149 >> v1:10.20.193.57:6790/0 conn(0x7f3fac0906d0 legacy=0x7f3fac090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 1 -- 10.20.193.57:0/491796149 shutdown_connections 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 1 -- 10.20.193.57:0/491796149 >> 10.20.193.57:0/491796149 conn(0x7f3fac054330 msgr2=0x7f3fac054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 1 -- 10.20.193.57:0/491796149 shutdown_connections 2026-02-12T17:32:34.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.362+0000 7f3fb0e52640 1 -- 10.20.193.57:0/491796149 wait complete. 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient: monmap: 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:34.375 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 1 Processor -- start 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 1 -- start start 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient: init 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient(hunting): picked mon.noname-b con 0x7f3fac0906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient(hunting): picked mon.noname-a con 0x7f3fac0911b0 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient(hunting): picked mon.noname-c con 0x7f3fac185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac133900 con 0x7f3fac0911b0 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac130c30 con 0x7f3fac0906d0 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fac133be0 con 0x7f3fac185070 2026-02-12T17:32:34.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fb0e52640 10 monclient(hunting): authenticate will time out at 834.182839s 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fa9d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f3fac0911b0 0x7f3fac130520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:56236/0 (socket says 10.20.193.57:56236) 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3fa9d74640 1 -- 10.20.193.57:0/1758732575 learned_addr learned my addr 10.20.193.57:0/1758732575 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.363+0000 7f3faad76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3fac185070 0x7f3fac174c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:52914/0 (socket says 10.20.193.57:52914) 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fa9d74640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6789/0 conn(0x7f3fac0911b0 legacy=0x7f3fac130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3faad76640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6790/0 conn(0x7f3fac185070 legacy=0x7f3fac174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3faa575640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.82:6789/0 conn(0x7f3fac0906d0 legacy=0x7f3fac12fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820387595 0 0) 0x7f3fac133900 con 0x7f3fac0911b0 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): my global_id is 4686 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f780035e0 con 0x7f3fac0911b0 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829899448 0 0) 0x7f3fac133be0 con 0x7f3fac185070 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): my global_id is 44168 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fac133900 con 0x7f3fac185070 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050697635 0 0) 0x7f3fac130c30 con 0x7f3fac0906d0 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): my global_id is 4603 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fac133be0 con 0x7f3fac0906d0 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2772761325 0 0) 0x7f3fac133900 con 0x7f3fac185070 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fac130c30 con 0x7f3fac185070 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3f9c004610 con 0x7f3fac185070 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): dump: 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.379 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 495668104 0 0) 0x7f3f780035e0 con 0x7f3fac0911b0 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fac133900 con 0x7f3fac0911b0 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3f94003450 con 0x7f3fac0911b0 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient(hunting): dump: 2026-02-12T17:32:34.380 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 354889606 0 0) 0x7f3fac130c30 con 0x7f3fac185070 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.82:6789/0 conn(0x7f3fac0906d0 legacy=0x7f3fac12fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6789/0 conn(0x7f3fac0911b0 legacy=0x7f3fac130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 monclient: found mon.c 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac08f2b0 con 0x7f3fac185070 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fb0e52640 5 monclient: authenticate success, global_id 44168 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fb0e52640 10 monclient: _renew_subs 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fb0e52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3fac08b620 con 0x7f3fac185070 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fb0e52640 10 monclient: _renew_subs 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fb0e52640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3fac132d70 con 0x7f3fac185070 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f9c005c30 con 0x7f3fac185070 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3f9c005f50 con 0x7f3fac185070 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3f92ffd640 10 monclient: dump: 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.383 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fa8d72640 4 set_mon_vals no callback set 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.366+0000 7f3fb0e52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.367+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3fac133680 con 0x7f3fac08ea90 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.367+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3f9c012bc0 con 0x7f3fac185070 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.367+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(207..207 src has 1..207) ==== 3975+0+0 (unknown 2917108618 0 0) 0x7f3f9c04fbd0 con 0x7f3fac185070 2026-02-12T17:32:34.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.367+0000 7f3fa9d74640 10 monclient: get_auth_request con 0x7f3f7803fbe0 auth_method 0 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3faa575640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6790/0 conn(0x7f3fac08ea90 legacy=0x7f3fac04d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280172653 0 0) 0x7f3fac133680 con 0x7f3fac08ea90 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 10 monclient(hunting): my global_id is 44171 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fac130c30 con 0x7f3fac08ea90 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3679421217 0 0) 0x7f3fac130c30 con 0x7f3fac08ea90 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fac133680 con 0x7f3fac08ea90 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3fa0004e40 con 0x7f3fac08ea90 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 10 monclient: dump: 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1530295669 0 0) 0x7f3fac133680 con 0x7f3fac08ea90 2026-02-12T17:32:34.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fac05c950 con 0x7f3fac08ea90 2026-02-12T17:32:34.387 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3fa000aa20 con 0x7f3fac08ea90 2026-02-12T17:32:34.387 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.387 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:34.387 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6790/0 conn(0x7f3fac08ea90 legacy=0x7f3fac04d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.387 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.369+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6790/0 conn(0x7f3fac08ea90 legacy=0x7f3fac04d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:34.388 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.373+0000 7f3fb0e52640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.373+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3fac134000 con 0x7f3fac08ee60 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3faa575640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6790/0 conn(0x7f3fac08ee60 legacy=0x7f3fac1773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 784602943 0 0) 0x7f3fac134000 con 0x7f3fac08ee60 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 10 monclient(hunting): my global_id is 44174 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fac133680 con 0x7f3fac08ee60 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 94199581 0 0) 0x7f3fac133680 con 0x7f3fac08ee60 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fac134000 con 0x7f3fac08ee60 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3fa0005730 con 0x7f3fac08ee60 2026-02-12T17:32:34.389 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 10 monclient: dump: 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 797492038 0 0) 0x7f3fac134000 con 0x7f3fac08ee60 2026-02-12T17:32:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3fac04d8d0 con 0x7f3fac08ee60 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4337 (unknown 0 0 3718760840) 0x7f3fa0007a30 con 0x7f3fac08ee60 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6790/0 conn(0x7f3fac08ee60 legacy=0x7f3fac1773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.375+0000 7f3f92ffd640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6790/0 conn(0x7f3fac08ee60 legacy=0x7f3fac1773b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:32:34.391 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 22, 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 31300, 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:34.392 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:34.393 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:32:34.394 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:34.395 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:34.396 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:34.397 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.398 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.399 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:32:34.400 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:32:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.82:6800/2441377515 conn(0x7f3f7803fbe0 legacy=0x7f3f78060090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3fb0e52640 10 monclient: shutdown 2026-02-12T17:32:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3fb0e52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 >> v1:10.20.193.57:6790/0 conn(0x7f3fac185070 legacy=0x7f3fac174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3faad76640 1 -- 10.20.193.57:0/1758732575 reap_dead start 2026-02-12T17:32:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3faad76640 1 -- 10.20.193.57:0/1758732575 reap_dead start 2026-02-12T17:32:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 shutdown_connections 2026-02-12T17:32:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 >> 10.20.193.57:0/1758732575 conn(0x7f3fac054330 msgr2=0x7f3fac08f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 shutdown_connections 2026-02-12T17:32:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.376+0000 7f3fb0e52640 1 -- 10.20.193.57:0/1758732575 wait complete. 2026-02-12T17:32:34.402 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:32:34.402 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:32:34.402 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:32:34.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.469+0000 7fae547c2640 10 monclient: get_monmap_and_config 2026-02-12T17:32:34.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.469+0000 7fae547c2640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.469+0000 7fae547c2640 10 monclient: monmap: 2026-02-12T17:32:34.467 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.467 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.467 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:34.470587+0000 2026-02-12T17:32:34.468 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:34.470587+0000 2026-02-12T17:32:34.468 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.468 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.468 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.468 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:34.468 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:34.468 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 1 Processor -- start 2026-02-12T17:32:34.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 1 -- start start 2026-02-12T17:32:34.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 10 monclient: init 2026-02-12T17:32:34.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 10 monclient(hunting): picked mon.noname-b con 0x7fae4c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 10 monclient(hunting): picked mon.noname-a con 0x7fae4c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 10 monclient(hunting): picked mon.noname-c con 0x7fae4c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c08a820 con 0x7fae4c08c620 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c089450 con 0x7fae4c182cc0 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c089730 con 0x7fae4c08c250 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae547c2640 10 monclient(hunting): authenticate will time out at 834.289502s 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae51d36640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fae4c08c620 0x7fae4c08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:56240/0 (socket says 10.20.193.57:56240) 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae51d36640 1 -- 10.20.193.57:0/3747211557 learned_addr learned my addr 10.20.193.57:0/3747211557 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.470+0000 7fae52537640 1 --1- 10.20.193.57:0/3747211557 >> v1:10.20.193.57:6790/0 conn(0x7fae4c08c250 0x7fae4c08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:52948/0 (socket says 10.20.193.57:52948) 2026-02-12T17:32:34.478 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae52537640 1 -- 10.20.193.57:0/3747211557 >> v1:10.20.193.57:6790/0 conn(0x7fae4c08c250 legacy=0x7fae4c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51d36640 1 -- 10.20.193.57:0/3747211557 >> v1:10.20.193.57:6789/0 conn(0x7fae4c08c620 legacy=0x7fae4c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256289030 0 0) 0x7fae4c089730 con 0x7fae4c08c250 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 10 monclient(hunting): my global_id is 44177 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae340035e0 con 0x7fae4c08c250 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2879816570 0 0) 0x7fae40002c20 con 0x7fae4c08c620 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 10 monclient(hunting): my global_id is 4689 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c089730 con 0x7fae4c08c620 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.472+0000 7fae52d38640 1 -- 10.20.193.57:0/3747211557 >> v1:10.20.193.82:6789/0 conn(0x7fae4c182cc0 legacy=0x7fae4c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741366537 0 0) 0x7fae4c089450 con 0x7fae4c182cc0 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient(hunting): my global_id is 4606 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae40002c20 con 0x7fae4c182cc0 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2062574964 0 0) 0x7fae340035e0 con 0x7fae4c08c250 2026-02-12T17:32:34.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 >> v1:10.20.193.82:6789/0 conn(0x7fae4c182cc0 legacy=0x7fae4c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 >> v1:10.20.193.57:6789/0 conn(0x7fae4c08c620 legacy=0x7fae4c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 monclient: found mon.noname-b 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c089a10 con 0x7fae4c08c250 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae3c0030d0 con 0x7fae4c08c250 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 5 monclient: authenticate success, global_id 44177 2026-02-12T17:32:34.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: dump: 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.482 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae3c0033d0 con 0x7fae4c08c250 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 1 -- 10.20.193.57:0/3747211557 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae3c004a50 con 0x7fae4c08c250 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae51535640 10 monclient: dump: 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.483 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 4 set_mon_vals no callback set 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 10 monclient: shutdown 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 1 -- 10.20.193.57:0/3747211557 >> v1:10.20.193.57:6790/0 conn(0x7fae4c08c250 legacy=0x7fae4c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 1 -- 10.20.193.57:0/3747211557 shutdown_connections 2026-02-12T17:32:34.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 1 -- 10.20.193.57:0/3747211557 >> 10.20.193.57:0/3747211557 conn(0x7fae4c0916b0 msgr2=0x7fae4c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 1 -- 10.20.193.57:0/3747211557 shutdown_connections 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.473+0000 7fae547c2640 1 -- 10.20.193.57:0/3747211557 wait complete. 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient: monmap: 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.485 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 1 Processor -- start 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 1 -- start start 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient: init 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient(hunting): picked mon.noname-a con 0x7fae4c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient(hunting): picked mon.noname-c con 0x7fae4c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient(hunting): picked mon.noname-b con 0x7fae4c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c139080 con 0x7fae4c08c250 2026-02-12T17:32:34.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c1375a0 con 0x7fae4c182cc0 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4c0888a0 con 0x7fae4c08c620 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae547c2640 10 monclient(hunting): authenticate will time out at 834.293534s 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae52537640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fae4c08c250 0x7fae4c136780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:56246/0 (socket says 10.20.193.57:56246) 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.474+0000 7fae52537640 1 -- 10.20.193.57:0/1702252850 learned_addr learned my addr 10.20.193.57:0/1702252850 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae52537640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.57:6789/0 conn(0x7fae4c08c250 legacy=0x7fae4c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae51d36640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.57:6790/0 conn(0x7fae4c08c620 legacy=0x7fae4c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2111907708 0 0) 0x7fae4c139080 con 0x7fae4c08c250 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 10 monclient(hunting): my global_id is 4692 2026-02-12T17:32:34.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae1c0035e0 con 0x7fae4c08c250 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2043668861 0 0) 0x7fae4c0888a0 con 0x7fae4c08c620 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 10 monclient(hunting): my global_id is 44180 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c139080 con 0x7fae4c08c620 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.476+0000 7fae52d38640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.82:6789/0 conn(0x7fae4c182cc0 legacy=0x7fae4c1934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 632288918 0 0) 0x7fae1c0035e0 con 0x7fae4c08c250 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae4c0888a0 con 0x7fae4c08c250 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae3c0048a0 con 0x7fae4c08c250 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:34.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient(hunting): dump: 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:34.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1980697483 0 0) 0x7fae4c139080 con 0x7fae4c08c620 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae1c0035e0 con 0x7fae4c08c620 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae400034f0 con 0x7fae4c08c620 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient(hunting): dump: 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.490 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2124554132 0 0) 0x7fae4c0888a0 con 0x7fae4c08c250 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.57:6790/0 conn(0x7fae4c08c620 legacy=0x7fae4c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.82:6789/0 conn(0x7fae4c182cc0 legacy=0x7fae4c1934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 monclient: found mon.a 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c05dd60 con 0x7fae4c08c250 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae547c2640 5 monclient: authenticate success, global_id 4692 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae547c2640 10 monclient: _renew_subs 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae547c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae4c13e8e0 con 0x7fae4c08c250 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae547c2640 10 monclient: _renew_subs 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae547c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fae4c13e250 con 0x7fae4c08c250 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae3c004cb0 con 0x7fae4c08c250 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae3c005040 con 0x7fae4c08c250 2026-02-12T17:32:34.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae32ffd640 10 monclient: dump: 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.493 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae50d34640 4 set_mon_vals no callback set 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae547c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.477+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fae4c05d770 con 0x7fae4c05d3a0 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.478+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fae3c0052d0 con 0x7fae4c08c250 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.478+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(207..207 src has 1..207) ==== 3975+0+0 (unknown 2917108618 0 0) 0x7fae3c04ece0 con 0x7fae4c08c250 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.478+0000 7fae52d38640 10 monclient: get_auth_request con 0x7fae1c03fb30 auth_method 0 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae51d36640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.82:6789/0 conn(0x7fae4c05d3a0 legacy=0x7fae4c0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516823187 0 0) 0x7fae4c05d770 con 0x7fae4c05d3a0 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 10 monclient(hunting): my global_id is 4612 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c0888a0 con 0x7fae4c05d3a0 2026-02-12T17:32:34.494 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4079708691 0 0) 0x7fae4c0888a0 con 0x7fae4c05d3a0 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae4c05d770 con 0x7fae4c05d3a0 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae40004cd0 con 0x7fae4c05d3a0 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 10 monclient: dump: 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.495 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.496 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 831580547 0 0) 0x7fae4c05d770 con 0x7fae4c05d3a0 2026-02-12T17:32:34.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae4c090810 con 0x7fae4c05d3a0 2026-02-12T17:32:34.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fae40005100 con 0x7fae4c05d3a0 2026-02-12T17:32:34.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:34.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.82:6789/0 conn(0x7fae4c05d3a0 legacy=0x7fae4c0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.480+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.82:6789/0 conn(0x7fae4c05d3a0 legacy=0x7fae4c0582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.484+0000 7fae547c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.484+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fae4c055340 con 0x7fae4c0589d0 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae51d36640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.82:6789/0 conn(0x7fae4c0589d0 legacy=0x7fae4c195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063728428 0 0) 0x7fae4c055340 con 0x7fae4c0589d0 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 10 monclient(hunting): my global_id is 4615 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c05d770 con 0x7fae4c0589d0 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1600746553 0 0) 0x7fae4c05d770 con 0x7fae4c0589d0 2026-02-12T17:32:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae4c055340 con 0x7fae4c0589d0 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fae400056e0 con 0x7fae4c0589d0 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.486+0000 7fae32ffd640 10 monclient: dump: 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.499 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.500 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3652179686 0 0) 0x7fae4c055340 con 0x7fae4c0589d0 2026-02-12T17:32:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fae4c18e900 con 0x7fae4c0589d0 2026-02-12T17:32:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 2031126826) 0x7fae40006c00 con 0x7fae4c0589d0 2026-02-12T17:32:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae32ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:32:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae32ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.82:6789/0 conn(0x7fae4c0589d0 legacy=0x7fae4c195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae32ffd640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.82:6789/0 conn(0x7fae4c0589d0 legacy=0x7fae4c195be0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:34.500 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 22, 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 275984, 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:32:34.501 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.502 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:34.503 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:32:34.504 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:34.505 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:32:34.506 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.507 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.508 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.509 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:34.510 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:34.511 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:34.511 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:32:34.511 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:32:34.511 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.82:6800/2441377515 conn(0x7fae1c03fb30 legacy=0x7fae1c05ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae547c2640 10 monclient: shutdown 2026-02-12T17:32:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae547c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 >> v1:10.20.193.57:6789/0 conn(0x7fae4c08c250 legacy=0x7fae4c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae52d38640 1 -- 10.20.193.57:0/1702252850 reap_dead start 2026-02-12T17:32:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 shutdown_connections 2026-02-12T17:32:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 >> 10.20.193.57:0/1702252850 conn(0x7fae4c0916b0 msgr2=0x7fae4c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 shutdown_connections 2026-02-12T17:32:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.487+0000 7fae547c2640 1 -- 10.20.193.57:0/1702252850 wait complete. 2026-02-12T17:32:34.512 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:32:34.512 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-12T17:32:34.512 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T17:32:34.513 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-12T17:32:34.513 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-12T17:32:34.513 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T17:32:34.513 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:32:34.523 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T17:32:34.523 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:32:34.523 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:32:34.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient: get_monmap_and_config 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient: monmap: 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:34.627870+0000 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:34.627870+0000 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.625 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:34.626 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:34.626 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 1 Processor -- start 2026-02-12T17:32:34.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 1 -- start start 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient: init 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient(hunting): picked mon.noname-b con 0x7f0a0808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient(hunting): picked mon.noname-a con 0x7f0a0808cc80 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient(hunting): picked mon.noname-c con 0x7f0a081852d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0808d600 con 0x7f0a0808cc80 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08089770 con 0x7f0a081852d0 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0808b1f0 con 0x7f0a0808ae20 2026-02-12T17:32:34.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0fc12640 10 monclient(hunting): authenticate will time out at 834.446769s 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0d186640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f0a0808cc80 legacy=0x7f0a08183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0d987640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0a0808ae20 0x7f0a0808c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:52998/0 (socket says 10.20.193.57:52998) 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.627+0000 7f0a0d987640 1 -- 10.20.193.57:0/2883504989 learned_addr learned my addr 10.20.193.57:0/2883504989 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0d987640 1 -- 10.20.193.57:0/2883504989 >> v1:10.20.193.57:6790/0 conn(0x7f0a0808ae20 legacy=0x7f0a0808c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0e188640 1 -- 10.20.193.57:0/2883504989 >> v1:10.20.193.82:6789/0 conn(0x7f0a081852d0 legacy=0x7f0a081a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3711763897 0 0) 0x7f0a0808b1f0 con 0x7f0a0808ae20 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient(hunting): my global_id is 44183 2026-02-12T17:32:34.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09f00035e0 con 0x7f0a0808ae20 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354933888 0 0) 0x7f0a08089770 con 0x7f0a081852d0 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient(hunting): my global_id is 4618 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a0808b1f0 con 0x7f0a081852d0 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3082479102 0 0) 0x7f09f00035e0 con 0x7f0a0808ae20 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 >> v1:10.20.193.82:6789/0 conn(0x7f0a081852d0 legacy=0x7f0a081a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 >> v1:10.20.193.57:6789/0 conn(0x7f0a0808cc80 legacy=0x7f0a08183bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 monclient: found mon.noname-b 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a0808c020 con 0x7f0a0808ae20 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09f80030d0 con 0x7f0a0808ae20 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 5 monclient: authenticate success, global_id 44183 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:34.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: dump: 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09f80033d0 con 0x7f0a0808ae20 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 1 -- 10.20.193.57:0/2883504989 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09f8004b10 con 0x7f0a0808ae20 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0c985640 10 monclient: dump: 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.636 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 4 set_mon_vals no callback set 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 10 monclient: shutdown 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 1 -- 10.20.193.57:0/2883504989 >> v1:10.20.193.57:6790/0 conn(0x7f0a0808ae20 legacy=0x7f0a0808c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 1 -- 10.20.193.57:0/2883504989 shutdown_connections 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 1 -- 10.20.193.57:0/2883504989 >> 10.20.193.57:0/2883504989 conn(0x7f0a08091620 msgr2=0x7f0a08091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:34.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 1 -- 10.20.193.57:0/2883504989 shutdown_connections 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.630+0000 7f0a0fc12640 1 -- 10.20.193.57:0/2883504989 wait complete. 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient: build_initial_monmap 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient: monmap: 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:34.638 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 1 Processor -- start 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 1 -- start start 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient: init 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient(hunting): picked mon.noname-c con 0x7f0a0808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient(hunting): picked mon.noname-a con 0x7f0a0808cc80 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient(hunting): picked mon.noname-b con 0x7f0a081852d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08086e90 con 0x7f0a0808cc80 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08088810 con 0x7f0a081852d0 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a080832e0 con 0x7f0a0808ae20 2026-02-12T17:32:34.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:34.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0d186640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f0a0808cc80 legacy=0x7f0a08131fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:34.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0fc12640 10 monclient(hunting): authenticate will time out at 834.450737s 2026-02-12T17:32:34.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0d987640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0a0808ae20 0x7f0a08131890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:53002/0 (socket says 10.20.193.57:53002) 2026-02-12T17:32:34.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.631+0000 7f0a0d987640 1 -- 10.20.193.57:0/4128899064 learned_addr learned my addr 10.20.193.57:0/4128899064 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:34.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.633+0000 7f0a0d987640 1 -- 10.20.193.57:0/4128899064 >> v1:10.20.193.57:6790/0 conn(0x7f0a0808ae20 legacy=0x7f0a08131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.633+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 562498882 0 0) 0x7f0a080832e0 con 0x7f0a0808ae20 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient(hunting): my global_id is 44186 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09d80035e0 con 0x7f0a0808ae20 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3117445143 0 0) 0x7f09d80035e0 con 0x7f0a0808ae20 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a080832e0 con 0x7f0a0808ae20 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0e188640 1 -- 10.20.193.57:0/4128899064 >> v1:10.20.193.82:6789/0 conn(0x7f0a081852d0 legacy=0x7f0a081849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09f8004a50 con 0x7f0a0808ae20 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:34.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient(hunting): dump: 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.645 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3452095007 0 0) 0x7f0a080832e0 con 0x7f0a0808ae20 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 >> v1:10.20.193.82:6789/0 conn(0x7f0a081852d0 legacy=0x7f0a081849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 >> v1:10.20.193.57:6789/0 conn(0x7f0a0808cc80 legacy=0x7f0a08131fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient: _finish_hunting 0 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 monclient: found mon.c 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a081326b0 con 0x7f0a0808ae20 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient: _finish_auth 0 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient: _check_auth_tickets 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:34.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 5 monclient: authenticate success, global_id 44186 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 10 monclient: _renew_subs 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0805df70 con 0x7f0a0808ae20 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 10 monclient: _renew_subs 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a081850c0 con 0x7f0a0808ae20 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0d987640 1 --1- 10.20.193.57:0/4128899064 >> v1:10.20.193.57:6790/0 conn(0x7f0a0808ae20 0x7f0a08131890 :-1 s=OPENED pgs=127 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f09f8004f60 config(0 keys) 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09f8004f60 con 0x7f0a0808ae20 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f09f7fff640 4 set_mon_vals no callback set 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.634+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a080008d0 con 0x7f0a0808ae20 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.635+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f09f8005280 con 0x7f0a0808ae20 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.635+0000 7f09f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.635+0000 7f09f67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.635+0000 7f09f67fc640 10 monclient: dump: 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:34.648 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:34.649 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:34.649 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:34.649 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:34.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.635+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f09f8011ef0 con 0x7f0a0808ae20 2026-02-12T17:32:34.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.635+0000 7f0a0d186640 10 monclient: get_auth_request con 0x7f09d803f5f0 auth_method 0 2026-02-12T17:32:34.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:34.637+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(207..207 src has 1..207) ==== 3975+0+0 (unknown 2917108618 0 0) 0x7f09f804edc0 con 0x7f0a0808ae20 2026-02-12T17:32:35.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.463+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f09f8017570 con 0x7f0a0808ae20 2026-02-12T17:32:35.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.463+0000 7f09f67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:35.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.463+0000 7f09f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:35.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.606+0000 7f0a0fc12640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:32:35.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.606+0000 7f0a0fc12640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:35.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.606+0000 7f0a0fc12640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:35.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.606+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0a0808f520 con 0x7f0a0808ae20 2026-02-12T17:32:35.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.606+0000 7f09f67fc640 1 -- 10.20.193.57:0/4128899064 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 3515955373) 0x7f09f8016d20 con 0x7f0a0808ae20 2026-02-12T17:32:35.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.606+0000 7f09f67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:35.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.606+0000 7f09f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:35.605 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:32:35.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.607+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 >> v1:10.20.193.82:6800/2441377515 conn(0x7f09d803f5f0 legacy=0x7f09d805faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:35.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.607+0000 7f0a0fc12640 10 monclient: shutdown 2026-02-12T17:32:35.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.607+0000 7f0a0fc12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:35.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.607+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 >> v1:10.20.193.57:6790/0 conn(0x7f0a0808ae20 legacy=0x7f0a08131890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:35.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.607+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 shutdown_connections 2026-02-12T17:32:35.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.607+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 >> 10.20.193.57:0/4128899064 conn(0x7f0a08091620 msgr2=0x7f0a081a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:35.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.607+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 shutdown_connections 2026-02-12T17:32:35.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:35.607+0000 7f0a0fc12640 1 -- 10.20.193.57:0/4128899064 wait complete. 2026-02-12T17:32:38.614 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:32:38.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient: get_monmap_and_config 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient: build_initial_monmap 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient: monmap: 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:38.683032+0000 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:38.683032+0000 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:38.680 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 1 Processor -- start 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 1 -- start start 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient: init 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient(hunting): picked mon.noname-c con 0x7f584408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient(hunting): picked mon.noname-a con 0x7f584408cc80 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient(hunting): picked mon.noname-b con 0x7f58441852d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584408d600 con 0x7f584408cc80 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5844089770 con 0x7f584408ae20 2026-02-12T17:32:38.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f584408b1f0 con 0x7f58441852d0 2026-02-12T17:32:38.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:38.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f584b8c3640 10 monclient(hunting): authenticate will time out at 838.501907s 2026-02-12T17:32:38.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.681+0000 7f5848e37640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f584408cc80 legacy=0x7f5844183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:38.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.682+0000 7f5849e39640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f58441852d0 0x7f58441a56b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:53014/0 (socket says 10.20.193.57:53014) 2026-02-12T17:32:38.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.682+0000 7f5849e39640 1 -- 10.20.193.57:0/801581815 learned_addr learned my addr 10.20.193.57:0/801581815 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:38.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5849e39640 1 -- 10.20.193.57:0/801581815 >> v1:10.20.193.57:6790/0 conn(0x7f58441852d0 legacy=0x7f58441a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:38.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5849638640 1 -- 10.20.193.57:0/801581815 >> v1:10.20.193.82:6789/0 conn(0x7f584408ae20 legacy=0x7f584408c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 1 -- 10.20.193.57:0/801581815 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550862260 0 0) 0x7f5844089770 con 0x7f584408ae20 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient(hunting): my global_id is 4624 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 1 -- 10.20.193.57:0/801581815 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f582c0035e0 con 0x7f584408ae20 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 1 -- 10.20.193.57:0/801581815 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 577133862 0 0) 0x7f582c0035e0 con 0x7f584408ae20 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 1 -- 10.20.193.57:0/801581815 >> v1:10.20.193.57:6790/0 conn(0x7f58441852d0 legacy=0x7f58441a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 1 -- 10.20.193.57:0/801581815 >> v1:10.20.193.57:6789/0 conn(0x7f584408cc80 legacy=0x7f5844183bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient: _finish_hunting 0 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 1 monclient: found mon.noname-c 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 1 -- 10.20.193.57:0/801581815 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584408c020 con 0x7f584408ae20 2026-02-12T17:32:38.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient: _finish_auth 0 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient: _check_auth_tickets 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 1 -- 10.20.193.57:0/801581815 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5834003120 con 0x7f584408ae20 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f5833fff640 10 monclient: dump: 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f584b8c3640 5 monclient: authenticate success, global_id 4624 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.684+0000 7f584b8c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f5833fff640 1 -- 10.20.193.57:0/801581815 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5834003420 con 0x7f584408ae20 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f5833fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:38.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 4 set_mon_vals no callback set 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f5833fff640 1 -- 10.20.193.57:0/801581815 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5834003880 con 0x7f584408ae20 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f5833fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f5833fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f5833fff640 10 monclient: dump: 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 10 monclient: shutdown 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 1 -- 10.20.193.57:0/801581815 >> v1:10.20.193.82:6789/0 conn(0x7f584408ae20 legacy=0x7f584408c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 1 -- 10.20.193.57:0/801581815 shutdown_connections 2026-02-12T17:32:38.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 1 -- 10.20.193.57:0/801581815 >> 10.20.193.57:0/801581815 conn(0x7f5844091620 msgr2=0x7f5844091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:38.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 1 -- 10.20.193.57:0/801581815 shutdown_connections 2026-02-12T17:32:38.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 1 -- 10.20.193.57:0/801581815 wait complete. 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 10 monclient: build_initial_monmap 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 10 monclient: monmap: 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:38.689 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 1 Processor -- start 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 1 -- start start 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.685+0000 7f584b8c3640 10 monclient: init 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 10 monclient(hunting): picked mon.noname-a con 0x7f584408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 10 monclient(hunting): picked mon.noname-b con 0x7f584408cc80 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 10 monclient(hunting): picked mon.noname-c con 0x7f58441852d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5844083aa0 con 0x7f584408ae20 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58440835a0 con 0x7f584408cc80 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58440805f0 con 0x7f58441852d0 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f5849638640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f584408ae20 legacy=0x7f584407f7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f584b8c3640 10 monclient(hunting): authenticate will time out at 838.506301s 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f5849e39640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f58441852d0 0x7f58441849b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:53020/0 (socket says 10.20.193.57:53020) 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.686+0000 7f5849e39640 1 -- 10.20.193.57:0/2169559797 learned_addr learned my addr 10.20.193.57:0/2169559797 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.688+0000 7f5849e39640 1 -- 10.20.193.57:0/2169559797 >> v1:10.20.193.57:6790/0 conn(0x7f58441852d0 legacy=0x7f58441849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.688+0000 7f5848e37640 1 -- 10.20.193.57:0/2169559797 >> v1:10.20.193.82:6789/0 conn(0x7f584408cc80 legacy=0x7f584407fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:38.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.688+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2775577724 0 0) 0x7f58440835a0 con 0x7f584408cc80 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.688+0000 7f5831ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.688+0000 7f5831ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.688+0000 7f5831ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.688+0000 7f5831ffb640 10 monclient(hunting): my global_id is 4627 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.688+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58140035e0 con 0x7f584408cc80 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2006424277 0 0) 0x7f58140035e0 con 0x7f584408cc80 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58440835a0 con 0x7f584408cc80 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5838004440 con 0x7f584408cc80 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient(hunting): dump: 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:38.691 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1660475834 0 0) 0x7f58440835a0 con 0x7f584408cc80 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 >> v1:10.20.193.57:6790/0 conn(0x7f58441852d0 legacy=0x7f58441849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 >> v1:10.20.193.57:6789/0 conn(0x7f584408ae20 legacy=0x7f584407f7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 monclient: found mon.b 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5844087fc0 con 0x7f584408cc80 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient: _finish_auth 0 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f584b8c3640 5 monclient: authenticate success, global_id 4627 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f584b8c3640 10 monclient: _renew_subs 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f584b8c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5844088810 con 0x7f584408cc80 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f584b8c3640 10 monclient: _renew_subs 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f584b8c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5844082730 con 0x7f584408cc80 2026-02-12T17:32:38.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58380046d0 con 0x7f584408cc80 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5838004a30 con 0x7f584408cc80 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f5831ffb640 10 monclient: dump: 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f58337fe640 4 set_mon_vals no callback set 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.689+0000 7f584b8c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.690+0000 7f584b8c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.690+0000 7f584b8c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.690+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5844082f40 con 0x7f584408cc80 2026-02-12T17:32:38.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.690+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5838004cc0 con 0x7f584408cc80 2026-02-12T17:32:38.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.690+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(207..207 src has 1..207) ==== 3975+0+0 (unknown 2917108618 0 0) 0x7f583804eb60 con 0x7f584408cc80 2026-02-12T17:32:38.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.691+0000 7f5849638640 10 monclient: get_auth_request con 0x7f581403f680 auth_method 0 2026-02-12T17:32:38.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.693+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f5838016b80 con 0x7f584408cc80 2026-02-12T17:32:38.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.693+0000 7f5831ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:38.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.693+0000 7f5831ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:38.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.837+0000 7f584b8c3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:32:38.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.837+0000 7f584b8c3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:38.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.837+0000 7f584b8c3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:32:38.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.837+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5844055340 con 0x7f584408cc80 2026-02-12T17:32:38.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.838+0000 7f5831ffb640 1 -- 10.20.193.57:0/2169559797 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2738452850) 0x7f583804b920 con 0x7f584408cc80 2026-02-12T17:32:38.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.838+0000 7f5831ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:38.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.838+0000 7f5831ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:38.837 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:32:38.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.839+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 >> v1:10.20.193.82:6800/2441377515 conn(0x7f581403f680 legacy=0x7f581405fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:38.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.839+0000 7f584b8c3640 10 monclient: shutdown 2026-02-12T17:32:38.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.839+0000 7f584b8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:38.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.839+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 >> v1:10.20.193.82:6789/0 conn(0x7f584408cc80 legacy=0x7f584407fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:38.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.839+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 shutdown_connections 2026-02-12T17:32:38.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.839+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 >> 10.20.193.57:0/2169559797 conn(0x7f5844091620 msgr2=0x7f584405d340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:38.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.839+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 shutdown_connections 2026-02-12T17:32:38.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:38.839+0000 7f584b8c3640 1 -- 10.20.193.57:0/2169559797 wait complete. 2026-02-12T17:32:41.845 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:32:41.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient: get_monmap_and_config 2026-02-12T17:32:41.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient: build_initial_monmap 2026-02-12T17:32:41.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient: monmap: 2026-02-12T17:32:41.912 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:41.912 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:41.912 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:41.915079+0000 2026-02-12T17:32:41.912 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:41.915079+0000 2026-02-12T17:32:41.912 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:41.913 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:41.913 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:41.913 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:41.913 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:41.913 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:41.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 1 Processor -- start 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 1 -- start start 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient: init 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient(hunting): picked mon.noname-c con 0x7f0f3008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient(hunting): picked mon.noname-a con 0x7f0f3008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient(hunting): picked mon.noname-b con 0x7f0f3008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3008d600 con 0x7f0f3008c730 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3008b1f0 con 0x7f0f3008ae20 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3008d1f0 con 0x7f0f3008cb30 2026-02-12T17:32:41.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:41.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f38394640 10 monclient(hunting): authenticate will time out at 841.733933s 2026-02-12T17:32:41.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.913+0000 7f0f35908640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f30181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:41.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.914+0000 7f0f3690a640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0f3008cb30 0x7f0f301a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:53032/0 (socket says 10.20.193.57:53032) 2026-02-12T17:32:41.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.914+0000 7f0f36109640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f0f3008ae20 0x7f0f3008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:37206/0 (socket says 10.20.193.57:37206) 2026-02-12T17:32:41.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.914+0000 7f0f3690a640 1 -- 10.20.193.57:0/900805412 learned_addr learned my addr 10.20.193.57:0/900805412 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:41.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.916+0000 7f0f3690a640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6790/0 conn(0x7f0f3008cb30 legacy=0x7f0f301a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:41.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:41.916+0000 7f0f36109640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.82:6789/0 conn(0x7f0f3008ae20 legacy=0x7f0f3008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:42.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:42.115+0000 7f0f35908640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f30181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:42.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:42.516+0000 7f0f35908640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f30181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:43.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:43.317+0000 7f0f35908640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f30181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:44.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 10 monclient(hunting): tick 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 1 monclient(hunting): continuing hunt 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6790/0 conn(0x7f0f3008cb30 legacy=0x7f0f301a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.82:6789/0 conn(0x7f0f3008ae20 legacy=0x7f0f3008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f30181be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 10 monclient(hunting): picked mon.noname-c con 0x7f0f3008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 10 monclient(hunting): picked mon.noname-a con 0x7f0f3008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 10 monclient(hunting): picked mon.noname-b con 0x7f0f3008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f35908640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f10045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f30057320 con 0x7f0f3008c730 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3008d600 con 0x7f0f3008ae20 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1006a0b0 con 0x7f0f3008cb30 2026-02-12T17:32:44.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.914+0000 7f0f17fff640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:44.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.916+0000 7f0f3690a640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6790/0 conn(0x7f0f3008cb30 legacy=0x7f0f10066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:44.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:44.916+0000 7f0f36109640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.82:6789/0 conn(0x7f0f3008ae20 legacy=0x7f0f10023890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:45.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:45.116+0000 7f0f35908640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f10045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:45.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:45.517+0000 7f0f35908640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f10045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:46.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:46.319+0000 7f0f35908640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f10045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 10 monclient(hunting): tick 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 1 monclient(hunting): continuing hunt 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6790/0 conn(0x7f0f3008cb30 legacy=0x7f0f10066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.82:6789/0 conn(0x7f0f3008ae20 legacy=0x7f0f10023890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f10045060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 10 monclient(hunting): picked mon.noname-a con 0x7f0f3008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 10 monclient(hunting): picked mon.noname-b con 0x7f0f3008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 10 monclient(hunting): picked mon.noname-c con 0x7f0f3008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f36109640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f10044fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:47.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1006b3d0 con 0x7f0f3008c730 2026-02-12T17:32:47.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f30057320 con 0x7f0f3008ae20 2026-02-12T17:32:47.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 1 -- 10.20.193.57:0/900805412 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f100692d0 con 0x7f0f3008cb30 2026-02-12T17:32:47.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.915+0000 7f0f17fff640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:47.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.916+0000 7f0f35908640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6790/0 conn(0x7f0f3008cb30 legacy=0x7f0f10066810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:47.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.916+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:32:47.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:47.916+0000 7f0f3690a640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.82:6789/0 conn(0x7f0f3008ae20 legacy=0x7f0f10023890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:48.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:48.117+0000 7f0f36109640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f10044fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:48.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:48.518+0000 7f0f36109640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f10044fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:49.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.102+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960725864 0 0) 0x7f0f30057320 con 0x7f0f3008ae20 2026-02-12T17:32:49.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.102+0000 7f0f35107640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.102+0000 7f0f35107640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.102+0000 7f0f35107640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.102+0000 7f0f35107640 10 monclient(hunting): my global_id is 4630 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.102+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f180035e0 con 0x7f0f3008ae20 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.102+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 352168258 0 0) 0x7f0f180035e0 con 0x7f0f3008ae20 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6790/0 conn(0x7f0f3008cb30 legacy=0x7f0f10066810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008c730 legacy=0x7f0f10044fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: _finish_hunting 0 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 1 monclient: found mon.noname-c 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f10069520 con 0x7f0f3008ae20 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: _finish_auth 0 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: _check_auth_tickets 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0f2c0040d0 con 0x7f0f3008ae20 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: dump: 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.102 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 5 monclient: authenticate success, global_id 4630 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f2c004350 con 0x7f0f3008ae20 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 1 -- 10.20.193.57:0/900805412 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0f2c005a40 con 0x7f0f3008ae20 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f35107640 10 monclient: dump: 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:49.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 4 set_mon_vals no callback set 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 10 monclient: shutdown 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 1 -- 10.20.193.57:0/900805412 >> v1:10.20.193.82:6789/0 conn(0x7f0f3008ae20 legacy=0x7f0f10023890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 1 -- 10.20.193.57:0/900805412 shutdown_connections 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 1 -- 10.20.193.57:0/900805412 >> 10.20.193.57:0/900805412 conn(0x7f0f30091620 msgr2=0x7f0f30091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 1 -- 10.20.193.57:0/900805412 shutdown_connections 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.103+0000 7f0f38394640 1 -- 10.20.193.57:0/900805412 wait complete. 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.104+0000 7f0f38394640 10 monclient: build_initial_monmap 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.104+0000 7f0f38394640 10 monclient: monmap: 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:49.104 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.104+0000 7f0f38394640 1 Processor -- start 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.104+0000 7f0f38394640 1 -- start start 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.104+0000 7f0f38394640 10 monclient: init 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 10 monclient(hunting): picked mon.noname-b con 0x7f0f3008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 10 monclient(hunting): picked mon.noname-c con 0x7f0f3008c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 10 monclient(hunting): picked mon.noname-a con 0x7f0f3008cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3008d9c0 con 0x7f0f3008cb30 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3005cba0 con 0x7f0f3008ae20 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f3011a8b0 con 0x7f0f3008c730 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f38394640 10 monclient(hunting): authenticate will time out at 848.925199s 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f3690a640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f0f3008cb30 legacy=0x7f0f30119d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f35908640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0f3008c730 0x7f0f30119610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:41610/0 (socket says 10.20.193.57:41610) 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.105+0000 7f0f35908640 1 -- 10.20.193.57:0/2175908676 learned_addr learned my addr 10.20.193.57:0/2175908676 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:49.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f35908640 1 -- 10.20.193.57:0/2175908676 >> v1:10.20.193.57:6790/0 conn(0x7f0f3008c730 legacy=0x7f0f30119610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770071283 0 0) 0x7f0f3011a8b0 con 0x7f0f3008c730 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): my global_id is 44192 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f000035e0 con 0x7f0f3008c730 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f36109640 1 -- 10.20.193.57:0/2175908676 >> v1:10.20.193.82:6789/0 conn(0x7f0f3008ae20 legacy=0x7f0f30118f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4288174074 0 0) 0x7f0f000035e0 con 0x7f0f3008c730 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f3011a8b0 con 0x7f0f3008c730 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0f240046c0 con 0x7f0f3008c730 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): dump: 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638303945 0 0) 0x7f0f3005cba0 con 0x7f0f3008ae20 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient(hunting): my global_id is 4633 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f000035e0 con 0x7f0f3008ae20 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3093898381 0 0) 0x7f0f3011a8b0 con 0x7f0f3008c730 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 >> v1:10.20.193.82:6789/0 conn(0x7f0f3008ae20 legacy=0x7f0f30118f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 >> v1:10.20.193.57:6789/0 conn(0x7f0f3008cb30 legacy=0x7f0f30119d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 monclient: found mon.c 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3011cc10 con 0x7f0f3008c730 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient: _finish_auth 0 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f38394640 5 monclient: authenticate success, global_id 44192 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f38394640 10 monclient: _renew_subs 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f38394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.107+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3005af50 con 0x7f0f3008c730 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f38394640 10 monclient: _renew_subs 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f38394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f3011b590 con 0x7f0f3008c730 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f24004bf0 con 0x7f0f3008c730 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f16ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0f24004f10 con 0x7f0f3008c730 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f16ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f16ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f34906640 4 set_mon_vals no callback set 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f16ffd640 10 monclient: dump: 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.108 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f38394640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f38394640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f38394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f300008d0 con 0x7f0f3008c730 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.108+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0f240051a0 con 0x7f0f3008c730 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.109+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(207..207 src has 1..207) ==== 3975+0+0 (unknown 2917108618 0 0) 0x7f0f2404ee20 con 0x7f0f3008c730 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.109+0000 7f0f36109640 10 monclient: get_auth_request con 0x7f0f0003f760 auth_method 0 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.111+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f0f2408a180 con 0x7f0f3008c730 2026-02-12T17:32:49.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.111+0000 7f0f16ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:49.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.111+0000 7f0f16ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:49.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.259+0000 7f0f38394640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:32:49.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.259+0000 7f0f38394640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:49.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.259+0000 7f0f38394640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.259+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0f3008f520 con 0x7f0f3008c730 2026-02-12T17:32:49.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.259+0000 7f0f16ffd640 1 -- 10.20.193.57:0/2175908676 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 2419811408) 0x7f0f24017510 con 0x7f0f3008c730 2026-02-12T17:32:49.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.259+0000 7f0f16ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:32:49.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.259+0000 7f0f16ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:49.258 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":26,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:32:49.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.260+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 >> v1:10.20.193.82:6800/2441377515 conn(0x7f0f0003f760 legacy=0x7f0f0005fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.260+0000 7f0f38394640 10 monclient: shutdown 2026-02-12T17:32:49.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.260+0000 7f0f38394640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:49.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.260+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 >> v1:10.20.193.57:6790/0 conn(0x7f0f3008c730 legacy=0x7f0f30119610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.260+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 shutdown_connections 2026-02-12T17:32:49.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.260+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 >> 10.20.193.57:0/2175908676 conn(0x7f0f30091620 msgr2=0x7f0f300597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:49.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.261+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 shutdown_connections 2026-02-12T17:32:49.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.261+0000 7f0f38394640 1 -- 10.20.193.57:0/2175908676 wait complete. 2026-02-12T17:32:49.267 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:32:49.267 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-12T17:32:49.268 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.334+0000 7ffbd5c5b640 10 monclient: get_monmap_and_config 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.334+0000 7ffbd5c5b640 10 monclient: build_initial_monmap 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.334+0000 7ffbd5c5b640 10 monclient: monmap: 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:49.336451+0000 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:49.336451+0000 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:49.333 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 1 Processor -- start 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 1 -- start start 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 10 monclient: init 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 10 monclient(hunting): picked mon.noname-b con 0x7ffbd008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 10 monclient(hunting): picked mon.noname-c con 0x7ffbd008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 10 monclient(hunting): picked mon.noname-a con 0x7ffbd0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd008a820 con 0x7ffbd0182cc0 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd0089450 con 0x7ffbd008c620 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd0089730 con 0x7ffbd008c250 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbd5c5b640 10 monclient(hunting): authenticate will time out at 849.155370s 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbcffff640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7ffbd0182cc0 legacy=0x7ffbd01a30a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbcf7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ffbd008c250 0x7ffbd008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:41620/0 (socket says 10.20.193.57:41620) 2026-02-12T17:32:49.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.335+0000 7ffbcf7fe640 1 -- 10.20.193.57:0/1258753908 learned_addr learned my addr 10.20.193.57:0/1258753908 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:49.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbcf7fe640 1 -- 10.20.193.57:0/1258753908 >> v1:10.20.193.57:6790/0 conn(0x7ffbd008c250 legacy=0x7ffbd008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbceffd640 1 -- 10.20.193.57:0/1258753908 >> v1:10.20.193.82:6789/0 conn(0x7ffbd008c620 legacy=0x7ffbd008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 1 -- 10.20.193.57:0/1258753908 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658071113 0 0) 0x7ffbd0089730 con 0x7ffbd008c250 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient(hunting): my global_id is 44195 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 1 -- 10.20.193.57:0/1258753908 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbb40035e0 con 0x7ffbd008c250 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 1 -- 10.20.193.57:0/1258753908 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2414270518 0 0) 0x7ffbb40035e0 con 0x7ffbd008c250 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 1 -- 10.20.193.57:0/1258753908 >> v1:10.20.193.82:6789/0 conn(0x7ffbd008c620 legacy=0x7ffbd008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 1 -- 10.20.193.57:0/1258753908 >> v1:10.20.193.57:6789/0 conn(0x7ffbd0182cc0 legacy=0x7ffbd01a30a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 1 monclient: found mon.noname-b 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 1 -- 10.20.193.57:0/1258753908 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd0089a10 con 0x7ffbd008c250 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient: _finish_auth 0 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 1 -- 10.20.193.57:0/1258753908 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffbbc003150 con 0x7ffbd008c250 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbce7fc640 10 monclient: dump: 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.337 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbd5c5b640 5 monclient: authenticate success, global_id 44195 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.337+0000 7ffbd5c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbce7fc640 1 -- 10.20.193.57:0/1258753908 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffbbc003410 con 0x7ffbd008c250 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbce7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbce7fc640 1 -- 10.20.193.57:0/1258753908 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffbbc004b10 con 0x7ffbd008c250 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 4 set_mon_vals no callback set 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbce7fc640 10 monclient: dump: 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 10 monclient: shutdown 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/1258753908 >> v1:10.20.193.57:6790/0 conn(0x7ffbd008c250 legacy=0x7ffbd008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/1258753908 shutdown_connections 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/1258753908 >> 10.20.193.57:0/1258753908 conn(0x7ffbd00916b0 msgr2=0x7ffbd0091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/1258753908 shutdown_connections 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/1258753908 wait complete. 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 10 monclient: build_initial_monmap 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.338+0000 7ffbd5c5b640 10 monclient: monmap: 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:49.339 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 1 Processor -- start 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 1 -- start start 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 10 monclient: init 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 10 monclient(hunting): picked mon.noname-b con 0x7ffbd008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 10 monclient(hunting): picked mon.noname-c con 0x7ffbd008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 10 monclient(hunting): picked mon.noname-a con 0x7ffbd0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd0139930 con 0x7ffbd0182cc0 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd00888a0 con 0x7ffbd008c250 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd01392f0 con 0x7ffbd008c620 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbd5c5b640 10 monclient(hunting): authenticate will time out at 849.159401s 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbcffff640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7ffbd0182cc0 legacy=0x7ffbd01953c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbceffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ffbd008c620 0x7ffbd0138680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:41636/0 (socket says 10.20.193.57:41636) 2026-02-12T17:32:49.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.339+0000 7ffbceffd640 1 -- 10.20.193.57:0/896705755 learned_addr learned my addr 10.20.193.57:0/896705755 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:49.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbceffd640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.57:6790/0 conn(0x7ffbd008c620 legacy=0x7ffbd0138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbcf7fe640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.82:6789/0 conn(0x7ffbd008c250 legacy=0x7ffbd0137f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724559426 0 0) 0x7ffbd01392f0 con 0x7ffbd008c620 2026-02-12T17:32:49.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): my global_id is 44198 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffba00035e0 con 0x7ffbd008c620 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312916290 0 0) 0x7ffbd00888a0 con 0x7ffbd008c250 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): my global_id is 4639 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbd01392f0 con 0x7ffbd008c250 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3890411665 0 0) 0x7ffba00035e0 con 0x7ffbd008c620 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbd00888a0 con 0x7ffbd008c620 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffbc00033e0 con 0x7ffbd008c620 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): dump: 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.341+0000 7ffbabfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2281504564 0 0) 0x7ffbd00888a0 con 0x7ffbd008c620 2026-02-12T17:32:49.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.82:6789/0 conn(0x7ffbd008c250 legacy=0x7ffbd0137f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.57:6789/0 conn(0x7ffbd0182cc0 legacy=0x7ffbd01953c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 10 monclient: _finish_hunting 0 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 1 monclient: found mon.c 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd013ad20 con 0x7ffbd008c620 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 10 monclient: _finish_auth 0 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 10 monclient: _check_auth_tickets 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbd5c5b640 5 monclient: authenticate success, global_id 44198 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbd5c5b640 10 monclient: _renew_subs 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbd5c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd013b3f0 con 0x7ffbd008c620 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbd5c5b640 10 monclient: _renew_subs 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbd5c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ffbd0138f30 con 0x7ffbd008c620 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffbc00039f0 con 0x7ffbd008c620 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffbc0003d10 con 0x7ffbd008c620 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 10 monclient: dump: 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.343 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbcdffb640 4 set_mon_vals no callback set 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbd5c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffbd013bda0 con 0x7ffbd013e400 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.342+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ffbc0003f20 con 0x7ffbd008c620 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.343+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(207..207 src has 1..207) ==== 3975+0+0 (unknown 2917108618 0 0) 0x7ffbc004ed70 con 0x7ffbd008c620 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.343+0000 7ffbcffff640 10 monclient: get_auth_request con 0x7ffba003f760 auth_method 0 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.344+0000 7ffbcf7fe640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.57:6790/0 conn(0x7ffbd013e400 legacy=0x7ffbd005b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.344+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071904990 0 0) 0x7ffbd013bda0 con 0x7ffbd013e400 2026-02-12T17:32:49.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.344+0000 7ffbabfff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.344+0000 7ffbabfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.344+0000 7ffbabfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.344+0000 7ffbabfff640 10 monclient(hunting): my global_id is 44201 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.344+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbd00888a0 con 0x7ffbd013e400 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 316129197 0 0) 0x7ffbd00888a0 con 0x7ffbd013e400 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbd013bda0 con 0x7ffbd013e400 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffbbc0048a0 con 0x7ffbd013e400 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 10 monclient: dump: 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3007051625 0 0) 0x7ffbd013bda0 con 0x7ffbd013e400 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffbd013b170 con 0x7ffbd013e400 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ffbbc004ad0 con 0x7ffbd013e400 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.57:6790/0 conn(0x7ffbd013e400 legacy=0x7ffbd005b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.345+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.57:6790/0 conn(0x7ffbd013e400 legacy=0x7ffbd005b7c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:49.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.348+0000 7ffbd5c5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:32:49.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.348+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffbd013e7d0 con 0x7ffbd005bed0 2026-02-12T17:32:49.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.350+0000 7ffbcf7fe640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.57:6790/0 conn(0x7ffbd005bed0 legacy=0x7ffbd0197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579391536 0 0) 0x7ffbd013e7d0 con 0x7ffbd005bed0 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 10 monclient(hunting): my global_id is 44204 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbd013bda0 con 0x7ffbd005bed0 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3226433252 0 0) 0x7ffbd013bda0 con 0x7ffbd005bed0 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbd013e7d0 con 0x7ffbd005bed0 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffbbc0053a0 con 0x7ffbd005bed0 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 10 monclient: dump: 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 858644796 0 0) 0x7ffbd013e7d0 con 0x7ffbd005bed0 2026-02-12T17:32:49.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffbd0090810 con 0x7ffbd005bed0 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4493 (unknown 0 0 1114816998) 0x7ffbbc007660 con 0x7ffbd005bed0 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.57:6790/0 conn(0x7ffbd005bed0 legacy=0x7ffbd0197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbabfff640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.57:6790/0 conn(0x7ffbd005bed0 legacy=0x7ffbd0197af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 26, 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 46277, 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:32:49.351 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:49.352 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:49.353 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:49.354 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.355 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:32:49.356 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:32:49.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.82:6800/2441377515 conn(0x7ffba003f760 legacy=0x7ffba005fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbd5c5b640 10 monclient: shutdown 2026-02-12T17:32:49.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbd5c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:49.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 >> v1:10.20.193.57:6790/0 conn(0x7ffbd008c620 legacy=0x7ffbd0138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbcffff640 1 -- 10.20.193.57:0/896705755 reap_dead start 2026-02-12T17:32:49.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.351+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 shutdown_connections 2026-02-12T17:32:49.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.352+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 >> 10.20.193.57:0/896705755 conn(0x7ffbd00916b0 msgr2=0x7ffbd0089fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:49.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.352+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 shutdown_connections 2026-02-12T17:32:49.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.352+0000 7ffbd5c5b640 1 -- 10.20.193.57:0/896705755 wait complete. 2026-02-12T17:32:49.358 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:32:49.358 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:32:49.358 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.425+0000 7f517fc5b640 10 monclient: get_monmap_and_config 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.425+0000 7f517fc5b640 10 monclient: build_initial_monmap 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.425+0000 7f517fc5b640 10 monclient: monmap: 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:32:49.427573+0000 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:32:49.427573+0000 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:32:49.424 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 1 Processor -- start 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 1 -- start start 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 10 monclient: init 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 10 monclient(hunting): picked mon.noname-a con 0x7f5178085720 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 10 monclient(hunting): picked mon.noname-c con 0x7f5178086ea0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 10 monclient(hunting): picked mon.noname-b con 0x7f5178086200 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5178089500 con 0x7f5178085720 2026-02-12T17:32:49.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51780867e0 con 0x7f5178086ea0 2026-02-12T17:32:49.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5178086c20 con 0x7f5178086200 2026-02-12T17:32:49.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:49.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517fc5b640 10 monclient(hunting): authenticate will time out at 849.246493s 2026-02-12T17:32:49.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517d9d0640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f5178085720 legacy=0x7f5178085af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:49.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517e1d1640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f5178086200 0x7f51781a2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:41658/0 (socket says 10.20.193.57:41658) 2026-02-12T17:32:49.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.426+0000 7f517e1d1640 1 -- 10.20.193.57:0/2277586281 learned_addr learned my addr 10.20.193.57:0/2277586281 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:49.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.428+0000 7f517e1d1640 1 -- 10.20.193.57:0/2277586281 >> v1:10.20.193.57:6790/0 conn(0x7f5178086200 legacy=0x7f51781a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.428+0000 7f517c9ce640 1 -- 10.20.193.57:0/2277586281 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352147374 0 0) 0x7f5178086c20 con 0x7f5178086200 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.428+0000 7f517c9ce640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.428+0000 7f517c9ce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.428+0000 7f517c9ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.428+0000 7f517c9ce640 10 monclient(hunting): my global_id is 44207 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.428+0000 7f517c9ce640 1 -- 10.20.193.57:0/2277586281 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51600035e0 con 0x7f5178086200 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.428+0000 7f517d1cf640 1 -- 10.20.193.57:0/2277586281 >> v1:10.20.193.82:6789/0 conn(0x7f5178086ea0 legacy=0x7f5178180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 1 -- 10.20.193.57:0/2277586281 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3942242021 0 0) 0x7f51600035e0 con 0x7f5178086200 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 1 -- 10.20.193.57:0/2277586281 >> v1:10.20.193.82:6789/0 conn(0x7f5178086ea0 legacy=0x7f5178180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 1 -- 10.20.193.57:0/2277586281 >> v1:10.20.193.57:6789/0 conn(0x7f5178085720 legacy=0x7f5178085af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: _finish_hunting 0 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 1 monclient: found mon.noname-b 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 1 -- 10.20.193.57:0/2277586281 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5178087f40 con 0x7f5178086200 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: _finish_auth 0 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: _check_auth_tickets 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 1 -- 10.20.193.57:0/2277586281 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f51740041b0 con 0x7f5178086200 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 5 monclient: authenticate success, global_id 44207 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: dump: 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.428 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 1 -- 10.20.193.57:0/2277586281 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51740044b0 con 0x7f5178086200 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 1 -- 10.20.193.57:0/2277586281 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5174005bf0 con 0x7f5178086200 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517c9ce640 10 monclient: dump: 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 10 monclient: get_monmap_and_config success 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 4 set_mon_vals no callback set 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 10 monclient: shutdown 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 1 -- 10.20.193.57:0/2277586281 >> v1:10.20.193.57:6790/0 conn(0x7f5178086200 legacy=0x7f51781a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 1 -- 10.20.193.57:0/2277586281 shutdown_connections 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 1 -- 10.20.193.57:0/2277586281 >> 10.20.193.57:0/2277586281 conn(0x7f51780916b0 msgr2=0x7f5178091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 1 -- 10.20.193.57:0/2277586281 shutdown_connections 2026-02-12T17:32:49.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.429+0000 7f517fc5b640 1 -- 10.20.193.57:0/2277586281 wait complete. 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient: build_initial_monmap 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient: monmap: 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 1 Processor -- start 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 1 -- start start 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient: init 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient(hunting): picked mon.noname-a con 0x7f5178085720 addr v1:10.20.193.57:6789/0 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient(hunting): picked mon.noname-c con 0x7f5178086200 addr v1:10.20.193.57:6790/0 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient(hunting): picked mon.noname-b con 0x7f5178086ea0 addr v1:10.20.193.82:6789/0 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f517807d630 con 0x7f5178085720 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f517805cde0 con 0x7f5178086ea0 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f517807d070 con 0x7f5178086200 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517fc5b640 10 monclient(hunting): authenticate will time out at 849.250638s 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517d9d0640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f5178085720 legacy=0x7f517812e7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517d1cf640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f5178086200 0x7f517812f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:41664/0 (socket says 10.20.193.57:41664) 2026-02-12T17:32:49.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.430+0000 7f517d1cf640 1 -- 10.20.193.57:0/2417936161 learned_addr learned my addr 10.20.193.57:0/2417936161 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:32:49.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.432+0000 7f517d1cf640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.57:6790/0 conn(0x7f5178086200 legacy=0x7f517812f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.432+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017964636 0 0) 0x7f517807d070 con 0x7f5178086200 2026-02-12T17:32:49.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.432+0000 7f51667fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.432+0000 7f51667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.432+0000 7f51667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.432+0000 7f51667fc640 10 monclient(hunting): my global_id is 44210 2026-02-12T17:32:49.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.432+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51480035e0 con 0x7f5178086200 2026-02-12T17:32:49.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517e1d1640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.82:6789/0 conn(0x7f5178086ea0 legacy=0x7f5178130da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1176512278 0 0) 0x7f51480035e0 con 0x7f5178086200 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f517807d070 con 0x7f5178086200 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f516c0033e0 con 0x7f5178086200 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient(hunting): dump: 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1661826677 0 0) 0x7f517807d070 con 0x7f5178086200 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.82:6789/0 conn(0x7f5178086ea0 legacy=0x7f5178130da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.57:6789/0 conn(0x7f5178085720 legacy=0x7f517812e7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient: _finish_hunting 0 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 monclient: found mon.c 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517807d350 con 0x7f5178086200 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient: _finish_auth 0 2026-02-12T17:32:49.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient: _check_auth_tickets 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517fc5b640 5 monclient: authenticate success, global_id 44210 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517fc5b640 10 monclient: _renew_subs 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517fc5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f517812e340 con 0x7f5178086200 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517fc5b640 10 monclient: _renew_subs 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517fc5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f517812f080 con 0x7f5178086200 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f516c0039f0 con 0x7f5178086200 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f516c003d10 con 0x7f5178086200 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f5167fff640 4 set_mon_vals no callback set 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 10 monclient: dump: 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517fc5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f517807c200 con 0x7f517807be30 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.433+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f516c003f20 con 0x7f5178086200 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.434+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(207..207 src has 1..207) ==== 3975+0+0 (unknown 2917108618 0 0) 0x7f516c04ed50 con 0x7f5178086200 2026-02-12T17:32:49.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.434+0000 7f517e1d1640 10 monclient: get_auth_request con 0x7f514803f610 auth_method 0 2026-02-12T17:32:49.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f517d9d0640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.82:6789/0 conn(0x7f517807be30 legacy=0x7f5178058190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2162756788 0 0) 0x7f517807c200 con 0x7f517807be30 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 10 monclient(hunting): my global_id is 4648 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f517807d070 con 0x7f517807be30 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3184844630 0 0) 0x7f517807d070 con 0x7f517807be30 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f517807c200 con 0x7f517807be30 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f51680042d0 con 0x7f517807be30 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 10 monclient: dump: 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3068100463 0 0) 0x7f517807c200 con 0x7f517807be30 2026-02-12T17:32:49.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.436+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f517808cb40 con 0x7f517807be30 2026-02-12T17:32:49.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.437+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f51680066c0 con 0x7f517807be30 2026-02-12T17:32:49.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.437+0000 7f51667fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:32:49.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.437+0000 7f51667fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:32:49.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.437+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.82:6789/0 conn(0x7f517807be30 legacy=0x7f5178058190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.437+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.82:6789/0 conn(0x7f517807be30 legacy=0x7f5178058190 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:49.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.440+0000 7f517fc5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:32:49.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.440+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f517807ce70 con 0x7f51780588a0 2026-02-12T17:32:49.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f517d9d0640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.82:6789/0 conn(0x7f51780588a0 legacy=0x7f51781334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1917696627 0 0) 0x7f517807ce70 con 0x7f51780588a0 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 10 monclient(hunting): _negotiate 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 10 monclient(hunting): my global_id is 4651 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f517807c200 con 0x7f51780588a0 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 951101852 0 0) 0x7f517807c200 con 0x7f51780588a0 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f517807ce70 con 0x7f51780588a0 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5168004bf0 con 0x7f51780588a0 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 10 monclient: dump: 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4169209980 0 0) 0x7f517807ce70 con 0x7f51780588a0 2026-02-12T17:32:49.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.443+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f517812e530 con 0x7f51780588a0 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 3719320079) 0x7f51680061b0 con 0x7f51780588a0 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f51667fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f51667fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.82:6789/0 conn(0x7f51780588a0 legacy=0x7f51781334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f51667fc640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.82:6789/0 conn(0x7f51780588a0 legacy=0x7f51781334d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 26, 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 290941, 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:49.443 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:32:49.444 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:32:49.445 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.446 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.82:6800/2441377515 conn(0x7f514803f610 legacy=0x7f514805fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517fc5b640 10 monclient: shutdown 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517fc5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 >> v1:10.20.193.57:6790/0 conn(0x7f5178086200 legacy=0x7f517812f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517e1d1640 1 -- 10.20.193.57:0/2417936161 reap_dead start 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517e1d1640 1 -- 10.20.193.57:0/2417936161 reap_dead start 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 shutdown_connections 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 >> 10.20.193.57:0/2417936161 conn(0x7f51780916b0 msgr2=0x7f517808e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 shutdown_connections 2026-02-12T17:32:49.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:32:49.444+0000 7f517fc5b640 1 -- 10.20.193.57:0/2417936161 wait complete. 2026-02-12T17:32:49.448 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:32:49.448 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:32:50.102 INFO:tasks.rados.rados.0.trial082.stdout:876: done (1 left) 2026-02-12T17:32:50.103 INFO:tasks.rados.rados.0.trial082.stdout:879: done (0 left) 2026-02-12T17:32:50.103 INFO:tasks.rados.rados.0.trial082.stdout:880: write oid 25 current snap is 97 2026-02-12T17:32:50.103 INFO:tasks.rados.rados.0.trial082.stdout:880: seq_num 322 ranges {611854=717004,2126143=561767,3259733=152121} 2026-02-12T17:32:50.108 INFO:tasks.rados.rados.0.trial082.stdout:880: writing trial08226312-25 from 611854 to 1328858 tid 1 2026-02-12T17:32:50.113 INFO:tasks.rados.rados.0.trial082.stdout:880: writing trial08226312-25 from 2126143 to 2687910 tid 2 2026-02-12T17:32:50.117 INFO:tasks.rados.rados.0.trial082.stdout:880: writing trial08226312-25 from 3259733 to 3411854 tid 3 2026-02-12T17:32:50.117 INFO:tasks.rados.rados.0.trial082.stdout:881: rollback oid 28 current snap is 97 2026-02-12T17:32:50.117 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 89 2026-02-12T17:32:50.117 INFO:tasks.rados.rados.0.trial082.stdout:880: finishing write tid 1 to trial08226312-25 2026-02-12T17:32:50.117 INFO:tasks.rados.rados.0.trial082.stdout:880: finishing write tid 2 to trial08226312-25 2026-02-12T17:32:50.117 INFO:tasks.rados.rados.0.trial082.stdout:882: read oid 4 snap -1 2026-02-12T17:32:50.117 INFO:tasks.rados.rados.0.trial082.stdout:882: expect (ObjNum 313 snap 90 seq_num 313) 2026-02-12T17:32:50.117 INFO:tasks.rados.rados.0.trial082.stdout:883: snap_remove snap 87 2026-02-12T17:32:51.110 INFO:tasks.rados.rados.0.trial082.stdout:883: done (3 left) 2026-02-12T17:32:51.111 INFO:tasks.rados.rados.0.trial082.stdout:884: rollback oid 24 current snap is 97 2026-02-12T17:32:51.111 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 95 2026-02-12T17:32:51.111 INFO:tasks.rados.rados.0.trial082.stdout:880: finishing write tid 3 to trial08226312-25 2026-02-12T17:32:51.111 INFO:tasks.rados.rados.0.trial082.stdout:880: finishing write tid 4 to trial08226312-25 2026-02-12T17:32:51.111 INFO:tasks.rados.rados.0.trial082.stdout:880: finishing write tid 5 to trial08226312-25 2026-02-12T17:32:51.111 INFO:tasks.rados.rados.0.trial082.stdout:880: oid 25 updating version 0 to 200 2026-02-12T17:32:51.111 INFO:tasks.rados.rados.0.trial082.stdout:880: oid 25 updating version 200 to 201 2026-02-12T17:32:51.111 INFO:tasks.rados.rados.0.trial082.stdout:880: oid 25 updating version 201 to 202 2026-02-12T17:32:51.111 INFO:tasks.rados.rados.0.trial082.stdout:880: oid 25 updating version 202 to 203 2026-02-12T17:32:51.112 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 203 (ObjNum 322 snap 97 seq_num 322) dirty exists 2026-02-12T17:32:51.112 INFO:tasks.rados.rados.0.trial082.stdout:880: left oid 25 (ObjNum 322 snap 97 seq_num 322) 2026-02-12T17:32:51.112 INFO:tasks.rados.rados.0.trial082.stdout:881: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:32:51.112 INFO:tasks.rados.rados.0.trial082.stdout:881: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:32:51.112 INFO:tasks.rados.rados.0.trial082.stdout:881: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:32:51.112 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 546 (ObjNum 261 snap 76 seq_num 261) dirty exists 2026-02-12T17:32:51.112 INFO:tasks.rados.rados.0.trial082.stdout:882: expect (ObjNum 313 snap 90 seq_num 313) 2026-02-12T17:32:51.112 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:32:51.170 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1355233 2026-02-12T17:32:51.254 INFO:tasks.rados.rados.0.trial082.stdout:884: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:32:51.254 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 365 (ObjNum 129 snap 0 seq_num 26776080) dirty dne 2026-02-12T17:32:51.254 INFO:tasks.rados.rados.0.trial082.stdout:880: done (3 left) 2026-02-12T17:32:51.254 INFO:tasks.rados.rados.0.trial082.stdout:881: done (2 left) 2026-02-12T17:32:51.254 INFO:tasks.rados.rados.0.trial082.stdout:882: done (1 left) 2026-02-12T17:32:51.254 INFO:tasks.rados.rados.0.trial082.stdout:884: done (0 left) 2026-02-12T17:32:51.254 INFO:tasks.rados.rados.0.trial082.stdout:885: read oid 21 snap -1 2026-02-12T17:32:51.254 INFO:tasks.rados.rados.0.trial082.stdout:885: expect deleted 2026-02-12T17:32:51.254 INFO:tasks.rados.rados.0.trial082.stdout:886: read oid 6 snap -1 2026-02-12T17:32:51.255 INFO:tasks.rados.rados.0.trial082.stdout:886: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:32:51.255 INFO:tasks.rados.rados.0.trial082.stdout:887: copy_from oid 49 from oid 7 current snap is 97 2026-02-12T17:32:51.255 INFO:tasks.rados.rados.0.trial082.stdout:888: snap_remove snap 81 2026-02-12T17:32:52.112 INFO:tasks.rados.rados.0.trial082.stdout:888: done (3 left) 2026-02-12T17:32:52.112 INFO:tasks.rados.rados.0.trial082.stdout:889: snap_remove snap 77 2026-02-12T17:32:53.024 INFO:tasks.rados.rados.0.trial082.stdout:889: done (3 left) 2026-02-12T17:32:53.024 INFO:tasks.rados.rados.0.trial082.stdout:890: read oid 23 snap -1 2026-02-12T17:32:53.025 INFO:tasks.rados.rados.0.trial082.stdout:890: expect deleted 2026-02-12T17:32:53.025 INFO:tasks.rados.rados.0.trial082.stdout:891: rollback oid 48 current snap is 97 2026-02-12T17:32:53.025 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 95 2026-02-12T17:32:53.025 INFO:tasks.rados.rados.0.trial082.stdout:887: finishing copy_from to trial08226312-49 2026-02-12T17:32:53.025 INFO:tasks.rados.rados.0.trial082.stdout:887: got expected ENOENT (src dne) 2026-02-12T17:32:53.025 INFO:tasks.rados.rados.0.trial082.stdout:887: finishing copy_from racing read to trial08226312-49 2026-02-12T17:32:53.025 INFO:tasks.rados.rados.0.trial082.stdout:886: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:32:53.025 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 47772 2026-02-12T17:32:53.076 INFO:tasks.rados.rados.0.trial082.stdout:891: finishing rollback tid 0 to trial08226312-48 2026-02-12T17:32:53.077 INFO:tasks.rados.rados.0.trial082.stdout:891: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:32:53.077 INFO:tasks.rados.rados.0.trial082.stdout:891: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:32:53.077 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 47 (ObjNum 218 snap 59 seq_num 218) dirty exists 2026-02-12T17:32:53.077 INFO:tasks.rados.rados.0.trial082.stdout:885: done (4 left) 2026-02-12T17:32:53.077 INFO:tasks.rados.rados.0.trial082.stdout:886: done (3 left) 2026-02-12T17:32:53.077 INFO:tasks.rados.rados.0.trial082.stdout:887: done (2 left) 2026-02-12T17:32:53.077 INFO:tasks.rados.rados.0.trial082.stdout:890: done (1 left) 2026-02-12T17:32:53.077 INFO:tasks.rados.rados.0.trial082.stdout:891: done (0 left) 2026-02-12T17:32:53.077 INFO:tasks.rados.rados.0.trial082.stdout:892: read oid 37 snap 95 2026-02-12T17:32:53.078 INFO:tasks.rados.rados.0.trial082.stdout:892: expect (ObjNum 292 snap 82 seq_num 292) 2026-02-12T17:32:53.078 INFO:tasks.rados.rados.0.trial082.stdout:893: read oid 29 snap -1 2026-02-12T17:32:53.078 INFO:tasks.rados.rados.0.trial082.stdout:893: expect (ObjNum 226 snap 61 seq_num 226) 2026-02-12T17:32:53.078 INFO:tasks.rados.rados.0.trial082.stdout:894: snap_remove snap 90 2026-02-12T17:32:54.036 INFO:tasks.rados.rados.0.trial082.stdout:894: done (2 left) 2026-02-12T17:32:54.036 INFO:tasks.rados.rados.0.trial082.stdout:895: write (excl) oid 22 current snap is 97 2026-02-12T17:32:54.036 INFO:tasks.rados.rados.0.trial082.stdout:895: seq_num 323 ranges {628661=792253,2184625=421778,3403509=25152} 2026-02-12T17:32:54.041 INFO:tasks.rados.rados.0.trial082.stdout:895: writing trial08226312-22 from 628661 to 1420914 tid 1 2026-02-12T17:32:54.045 INFO:tasks.rados.rados.0.trial082.stdout:895: writing trial08226312-22 from 2184625 to 2606403 tid 2 2026-02-12T17:32:54.049 INFO:tasks.rados.rados.0.trial082.stdout:895: writing trial08226312-22 from 3403509 to 3428661 tid 3 2026-02-12T17:32:54.049 INFO:tasks.rados.rados.0.trial082.stdout:896: write (excl) oid 3 current snap is 97 2026-02-12T17:32:54.049 INFO:tasks.rados.rados.0.trial082.stdout:892: expect (ObjNum 292 snap 82 seq_num 292) 2026-02-12T17:32:54.104 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:32:54.134 INFO:tasks.rados.rados.0.trial082.stdout:893: expect (ObjNum 226 snap 61 seq_num 226) 2026-02-12T17:32:54.136 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1448889 2026-02-12T17:32:54.205 INFO:tasks.rados.rados.0.trial082.stdout:895: finishing write tid 1 to trial08226312-22 2026-02-12T17:32:54.205 INFO:tasks.rados.rados.0.trial082.stdout:895: finishing write tid 2 to trial08226312-22 2026-02-12T17:32:54.205 INFO:tasks.rados.rados.0.trial082.stdout:895: finishing write tid 3 to trial08226312-22 2026-02-12T17:32:54.205 INFO:tasks.rados.rados.0.trial082.stdout:895: finishing write tid 4 to trial08226312-22 2026-02-12T17:32:54.205 INFO:tasks.rados.rados.0.trial082.stdout:895: finishing write tid 5 to trial08226312-22 2026-02-12T17:32:54.205 INFO:tasks.rados.rados.0.trial082.stdout:895: oid 22 updating version 0 to 400 2026-02-12T17:32:54.205 INFO:tasks.rados.rados.0.trial082.stdout:895: oid 22 version 400 is already newer than 398 2026-02-12T17:32:54.206 INFO:tasks.rados.rados.0.trial082.stdout:895: oid 22 version 400 is already newer than 399 2026-02-12T17:32:54.206 INFO:tasks.rados.rados.0.trial082.stdout:895: oid 22 updating version 400 to 401 2026-02-12T17:32:54.206 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 401 (ObjNum 323 snap 97 seq_num 323) dirty exists 2026-02-12T17:32:54.206 INFO:tasks.rados.rados.0.trial082.stdout:895: left oid 22 (ObjNum 323 snap 97 seq_num 323) 2026-02-12T17:32:54.206 INFO:tasks.rados.rados.0.trial082.stdout:896: seq_num 324 ranges {645468=467502,1726754=565436,2798226=596838} 2026-02-12T17:32:54.209 INFO:tasks.rados.rados.0.trial082.stdout:896: writing trial08226312-3 from 645468 to 1112970 tid 1 2026-02-12T17:32:54.213 INFO:tasks.rados.rados.0.trial082.stdout:896: writing trial08226312-3 from 1726754 to 2292190 tid 2 2026-02-12T17:32:54.218 INFO:tasks.rados.rados.0.trial082.stdout:896: writing trial08226312-3 from 2798226 to 3395064 tid 3 2026-02-12T17:32:54.218 INFO:tasks.rados.rados.0.trial082.stdout:892: done (3 left) 2026-02-12T17:32:54.218 INFO:tasks.rados.rados.0.trial082.stdout:893: done (2 left) 2026-02-12T17:32:54.218 INFO:tasks.rados.rados.0.trial082.stdout:895: done (1 left) 2026-02-12T17:32:54.218 INFO:tasks.rados.rados.0.trial082.stdout:897: write (excl) oid 12 current snap is 97 2026-02-12T17:32:54.218 INFO:tasks.rados.rados.0.trial082.stdout:896: finishing write tid 1 to trial08226312-3 2026-02-12T17:32:54.218 INFO:tasks.rados.rados.0.trial082.stdout:896: finishing write tid 2 to trial08226312-3 2026-02-12T17:32:54.219 INFO:tasks.rados.rados.0.trial082.stdout:897: seq_num 325 ranges {662275=542751,1785236=425447,2942002=520273} 2026-02-12T17:32:54.222 INFO:tasks.rados.rados.0.trial082.stdout:897: writing trial08226312-12 from 662275 to 1205026 tid 1 2026-02-12T17:32:54.226 INFO:tasks.rados.rados.0.trial082.stdout:897: writing trial08226312-12 from 1785236 to 2210683 tid 2 2026-02-12T17:32:54.231 INFO:tasks.rados.rados.0.trial082.stdout:897: writing trial08226312-12 from 2942002 to 3462275 tid 3 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:898: delete oid 27 current snap is 97 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:896: finishing write tid 3 to trial08226312-3 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:896: finishing write tid 4 to trial08226312-3 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:896: finishing write tid 5 to trial08226312-3 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:896: oid 3 updating version 0 to 422 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:896: oid 3 updating version 422 to 425 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:896: oid 3 version 425 is already newer than 423 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:896: oid 3 version 425 is already newer than 424 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 425 (ObjNum 324 snap 97 seq_num 324) dirty exists 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:896: left oid 3 (ObjNum 324 snap 97 seq_num 324) 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:897: finishing write tid 1 to trial08226312-12 2026-02-12T17:32:54.232 INFO:tasks.rados.rados.0.trial082.stdout:897: finishing write tid 2 to trial08226312-12 2026-02-12T17:32:54.233 INFO:tasks.rados.rados.0.trial082.stdout:896: done (2 left) 2026-02-12T17:32:54.233 INFO:tasks.rados.rados.0.trial082.stdout:898: done (1 left) 2026-02-12T17:32:54.233 INFO:tasks.rados.rados.0.trial082.stdout:899: read oid 24 snap 96 2026-02-12T17:32:54.234 INFO:tasks.rados.rados.0.trial082.stdout:899: expect deleted 2026-02-12T17:32:54.234 INFO:tasks.rados.rados.0.trial082.stdout:900: read oid 16 snap -1 2026-02-12T17:32:54.234 INFO:tasks.rados.rados.0.trial082.stdout:900: expect deleted 2026-02-12T17:32:54.234 INFO:tasks.rados.rados.0.trial082.stdout:901: write (excl) oid 18 current snap is 97 2026-02-12T17:32:54.234 INFO:tasks.rados.rados.0.trial082.stdout:901: seq_num 327 ranges {695889=409602,1618553=712763,2996848=499041} 2026-02-12T17:32:54.236 INFO:tasks.rados.rados.0.trial082.stdout:901: writing trial08226312-18 from 695889 to 1105491 tid 1 2026-02-12T17:32:54.241 INFO:tasks.rados.rados.0.trial082.stdout:901: writing trial08226312-18 from 1618553 to 2331316 tid 2 2026-02-12T17:32:54.245 INFO:tasks.rados.rados.0.trial082.stdout:901: writing trial08226312-18 from 2996848 to 3495889 tid 3 2026-02-12T17:32:54.245 INFO:tasks.rados.rados.0.trial082.stdout:902: write oid 17 current snap is 97 2026-02-12T17:32:54.245 INFO:tasks.rados.rados.0.trial082.stdout:902: seq_num 328 ranges {712696=484851,1960682=572774,3307918=204778} 2026-02-12T17:32:54.249 INFO:tasks.rados.rados.0.trial082.stdout:902: writing trial08226312-17 from 712696 to 1197547 tid 1 2026-02-12T17:32:54.254 INFO:tasks.rados.rados.0.trial082.stdout:902: writing trial08226312-17 from 1960682 to 2533456 tid 2 2026-02-12T17:32:54.259 INFO:tasks.rados.rados.0.trial082.stdout:902: writing trial08226312-17 from 3307918 to 3512696 tid 3 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:903: rollback oid 28 current snap is 97 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 88 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:897: finishing write tid 3 to trial08226312-12 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:897: finishing write tid 4 to trial08226312-12 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:897: finishing write tid 5 to trial08226312-12 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:897: oid 12 updating version 0 to 234 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:897: oid 12 updating version 234 to 236 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:897: oid 12 version 236 is already newer than 235 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:897: oid 12 version 236 is already newer than 233 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 236 (ObjNum 325 snap 97 seq_num 325) dirty exists 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:897: left oid 12 (ObjNum 325 snap 97 seq_num 325) 2026-02-12T17:32:54.260 INFO:tasks.rados.rados.0.trial082.stdout:901: finishing write tid 1 to trial08226312-18 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:901: finishing write tid 2 to trial08226312-18 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:897: done (5 left) 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:899: done (4 left) 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:900: done (3 left) 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:904: copy_from oid 46 from oid 6 current snap is 97 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:901: finishing write tid 3 to trial08226312-18 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:901: finishing write tid 4 to trial08226312-18 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:901: finishing write tid 5 to trial08226312-18 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:901: oid 18 updating version 0 to 233 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:901: oid 18 updating version 233 to 234 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:901: oid 18 updating version 234 to 235 2026-02-12T17:32:54.261 INFO:tasks.rados.rados.0.trial082.stdout:901: oid 18 version 235 is already newer than 232 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 235 (ObjNum 327 snap 97 seq_num 327) dirty exists 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:901: left oid 18 (ObjNum 327 snap 97 seq_num 327) 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:902: finishing write tid 1 to trial08226312-17 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:902: finishing write tid 2 to trial08226312-17 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:901: done (3 left) 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:905: rollback oid 45 current snap is 97 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 95 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:906: rollback oid 18 current snap is 97 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 94 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:907: rollback oid 32 current snap is 97 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 94 2026-02-12T17:32:54.262 INFO:tasks.rados.rados.0.trial082.stdout:908: snap_create 2026-02-12T17:32:54.264 INFO:tasks.rados.rados.0.trial082.stdout:902: finishing write tid 3 to trial08226312-17 2026-02-12T17:32:54.264 INFO:tasks.rados.rados.0.trial082.stdout:902: finishing write tid 4 to trial08226312-17 2026-02-12T17:32:54.264 INFO:tasks.rados.rados.0.trial082.stdout:902: finishing write tid 5 to trial08226312-17 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:902: oid 17 updating version 0 to 582 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:902: oid 17 updating version 582 to 583 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:902: oid 17 updating version 583 to 584 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:902: oid 17 version 584 is already newer than 581 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 584 (ObjNum 328 snap 97 seq_num 328) dirty exists 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:902: left oid 17 (ObjNum 328 snap 97 seq_num 328) 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:903: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:903: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:906: finishing rollback tid 0 to trial08226312-18 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:906: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:32:54.265 INFO:tasks.rados.rados.0.trial082.stdout:906: finishing rollback tid 2 to trial08226312-18 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 238 (ObjNum 307 snap 88 seq_num 307) dirty exists 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:903: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 589 (ObjNum 261 snap 76 seq_num 261) dirty exists 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:907: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:907: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:907: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 243 (ObjNum 310 snap 89 seq_num 310) dirty exists 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:905: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:905: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:905: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 420 (ObjNum 315 snap 93 seq_num 315) dirty exists 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:904: finishing copy_from racing read to trial08226312-46 2026-02-12T17:32:54.266 INFO:tasks.rados.rados.0.trial082.stdout:904: finishing copy_from to trial08226312-46 2026-02-12T17:32:54.267 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 124 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:32:55.126 INFO:tasks.rados.rados.0.trial082.stdout:902: done (6 left) 2026-02-12T17:32:55.126 INFO:tasks.rados.rados.0.trial082.stdout:903: done (5 left) 2026-02-12T17:32:55.126 INFO:tasks.rados.rados.0.trial082.stdout:904: done (4 left) 2026-02-12T17:32:55.126 INFO:tasks.rados.rados.0.trial082.stdout:905: done (3 left) 2026-02-12T17:32:55.126 INFO:tasks.rados.rados.0.trial082.stdout:906: done (2 left) 2026-02-12T17:32:55.126 INFO:tasks.rados.rados.0.trial082.stdout:907: done (1 left) 2026-02-12T17:32:55.126 INFO:tasks.rados.rados.0.trial082.stdout:908: done (0 left) 2026-02-12T17:32:55.127 INFO:tasks.rados.rados.0.trial082.stdout:909: copy_from oid 31 from oid 42 current snap is 98 2026-02-12T17:32:55.127 INFO:tasks.rados.rados.0.trial082.stdout:910: snap_create 2026-02-12T17:32:55.127 INFO:tasks.rados.rados.0.trial082.stdout:909: finishing copy_from to trial08226312-31 2026-02-12T17:32:55.127 INFO:tasks.rados.rados.0.trial082.stdout:909: got expected ENOENT (src dne) 2026-02-12T17:32:55.128 INFO:tasks.rados.rados.0.trial082.stdout:909: finishing copy_from racing read to trial08226312-31 2026-02-12T17:32:56.127 INFO:tasks.rados.rados.0.trial082.stdout:909: done (1 left) 2026-02-12T17:32:56.127 INFO:tasks.rados.rados.0.trial082.stdout:910: done (0 left) 2026-02-12T17:32:56.128 INFO:tasks.rados.rados.0.trial082.stdout:911: read oid 4 snap 94 2026-02-12T17:32:56.128 INFO:tasks.rados.rados.0.trial082.stdout:911: expect (ObjNum 313 snap 90 seq_num 313) 2026-02-12T17:32:56.128 INFO:tasks.rados.rados.0.trial082.stdout:912: read oid 21 snap -1 2026-02-12T17:32:56.128 INFO:tasks.rados.rados.0.trial082.stdout:912: expect deleted 2026-02-12T17:32:56.128 INFO:tasks.rados.rados.0.trial082.stdout:913: delete oid 13 current snap is 99 2026-02-12T17:32:56.130 INFO:tasks.rados.rados.0.trial082.stdout:913: done (2 left) 2026-02-12T17:32:56.130 INFO:tasks.rados.rados.0.trial082.stdout:914: copy_from oid 32 from oid 24 current snap is 99 2026-02-12T17:32:56.130 INFO:tasks.rados.rados.0.trial082.stdout:915: write oid 41 current snap is 99 2026-02-12T17:32:56.130 INFO:tasks.rados.rados.0.trial082.stdout:915: seq_num 330 ranges {746310=635349,2077646=576443,3362764=183546} 2026-02-12T17:32:56.135 INFO:tasks.rados.rados.0.trial082.stdout:915: writing trial08226312-41 from 746310 to 1381659 tid 1 2026-02-12T17:32:56.140 INFO:tasks.rados.rados.0.trial082.stdout:915: writing trial08226312-41 from 2077646 to 2654089 tid 2 2026-02-12T17:32:56.144 INFO:tasks.rados.rados.0.trial082.stdout:915: writing trial08226312-41 from 3362764 to 3546310 tid 3 2026-02-12T17:32:56.144 INFO:tasks.rados.rados.0.trial082.stdout:916: read oid 42 snap -1 2026-02-12T17:32:56.144 INFO:tasks.rados.rados.0.trial082.stdout:916: expect deleted 2026-02-12T17:32:56.145 INFO:tasks.rados.rados.0.trial082.stdout:917: rollback oid 11 current snap is 99 2026-02-12T17:32:56.145 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 69 2026-02-12T17:32:56.145 INFO:tasks.rados.rados.0.trial082.stdout:911: expect (ObjNum 313 snap 90 seq_num 313) 2026-02-12T17:32:56.196 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:32:56.292 INFO:tasks.rados.rados.0.trial082.stdout:914: finishing copy_from to trial08226312-32 2026-02-12T17:32:56.292 INFO:tasks.rados.rados.0.trial082.stdout:914: got expected ENOENT (src dne) 2026-02-12T17:32:56.292 INFO:tasks.rados.rados.0.trial082.stdout:914: finishing copy_from racing read to trial08226312-32 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:915: finishing write tid 1 to trial08226312-41 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:915: finishing write tid 2 to trial08226312-41 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:911: done (5 left) 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:912: done (4 left) 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:914: done (3 left) 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:918: copy_from oid 17 from oid 43 current snap is 99 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:915: finishing write tid 3 to trial08226312-41 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:915: finishing write tid 4 to trial08226312-41 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:915: finishing write tid 5 to trial08226312-41 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:915: oid 41 updating version 0 to 239 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:915: oid 41 version 239 is already newer than 238 2026-02-12T17:32:56.293 INFO:tasks.rados.rados.0.trial082.stdout:915: oid 41 updating version 239 to 240 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:915: oid 41 version 240 is already newer than 237 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 240 (ObjNum 330 snap 99 seq_num 330) dirty exists 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:915: left oid 41 (ObjNum 330 snap 99 seq_num 330) 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:917: finishing rollback tid 0 to trial08226312-11 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:917: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:917: finishing rollback tid 2 to trial08226312-11 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 423 (ObjNum 238 snap 63 seq_num 238) dirty exists 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:915: done (3 left) 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:916: done (2 left) 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:917: done (1 left) 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:919: write (excl) oid 21 current snap is 99 2026-02-12T17:32:56.294 INFO:tasks.rados.rados.0.trial082.stdout:919: seq_num 331 ranges {763117=710598,2136128=720101,3390187=172930} 2026-02-12T17:32:56.297 INFO:tasks.rados.rados.0.trial082.stdout:919: writing trial08226312-21 from 763117 to 1473715 tid 1 2026-02-12T17:32:56.302 INFO:tasks.rados.rados.0.trial082.stdout:919: writing trial08226312-21 from 2136128 to 2856229 tid 2 2026-02-12T17:32:56.305 INFO:tasks.rados.rados.0.trial082.stdout:919: writing trial08226312-21 from 3390187 to 3563117 tid 3 2026-02-12T17:32:56.305 INFO:tasks.rados.rados.0.trial082.stdout:920: write oid 46 current snap is 99 2026-02-12T17:32:56.305 INFO:tasks.rados.rados.0.trial082.stdout:920: seq_num 332 ranges {779924=785847,2078257=580112,3301257=278667} 2026-02-12T17:32:56.311 INFO:tasks.rados.rados.0.trial082.stdout:920: writing trial08226312-46 from 779924 to 1565771 tid 1 2026-02-12T17:32:56.315 INFO:tasks.rados.rados.0.trial082.stdout:920: writing trial08226312-46 from 2078257 to 2658369 tid 2 2026-02-12T17:32:56.319 INFO:tasks.rados.rados.0.trial082.stdout:920: writing trial08226312-46 from 3301257 to 3579924 tid 3 2026-02-12T17:32:56.319 INFO:tasks.rados.rados.0.trial082.stdout:921: delete oid 48 current snap is 99 2026-02-12T17:32:56.319 INFO:tasks.rados.rados.0.trial082.stdout:918: finishing copy_from to trial08226312-17 2026-02-12T17:32:56.319 INFO:tasks.rados.rados.0.trial082.stdout:918: got expected ENOENT (src dne) 2026-02-12T17:32:56.319 INFO:tasks.rados.rados.0.trial082.stdout:918: finishing copy_from racing read to trial08226312-17 2026-02-12T17:32:56.319 INFO:tasks.rados.rados.0.trial082.stdout:919: finishing write tid 1 to trial08226312-21 2026-02-12T17:32:56.319 INFO:tasks.rados.rados.0.trial082.stdout:919: finishing write tid 2 to trial08226312-21 2026-02-12T17:32:56.319 INFO:tasks.rados.rados.0.trial082.stdout:919: finishing write tid 3 to trial08226312-21 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:919: finishing write tid 4 to trial08226312-21 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:919: finishing write tid 5 to trial08226312-21 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:919: oid 21 updating version 0 to 402 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:919: oid 21 updating version 402 to 403 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:919: oid 21 updating version 403 to 405 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:919: oid 21 version 405 is already newer than 404 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 405 (ObjNum 331 snap 99 seq_num 331) dirty exists 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:919: left oid 21 (ObjNum 331 snap 99 seq_num 331) 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:920: finishing write tid 1 to trial08226312-46 2026-02-12T17:32:56.320 INFO:tasks.rados.rados.0.trial082.stdout:920: finishing write tid 2 to trial08226312-46 2026-02-12T17:32:56.321 INFO:tasks.rados.rados.0.trial082.stdout:920: finishing write tid 3 to trial08226312-46 2026-02-12T17:32:56.321 INFO:tasks.rados.rados.0.trial082.stdout:920: finishing write tid 4 to trial08226312-46 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:920: finishing write tid 5 to trial08226312-46 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:920: oid 46 updating version 0 to 427 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:920: oid 46 version 427 is already newer than 425 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:920: oid 46 version 427 is already newer than 424 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:920: oid 46 version 427 is already newer than 426 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 427 (ObjNum 332 snap 99 seq_num 332) dirty exists 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:920: left oid 46 (ObjNum 332 snap 99 seq_num 332) 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:918: done (3 left) 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:919: done (2 left) 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:920: done (1 left) 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:921: done (0 left) 2026-02-12T17:32:56.322 INFO:tasks.rados.rados.0.trial082.stdout:922: write (excl) oid 11 current snap is 99 2026-02-12T17:32:56.323 INFO:tasks.rados.rados.0.trial082.stdout:922: seq_num 334 ranges {413538=536345,1395221=583781,2556103=658617} 2026-02-12T17:32:56.324 INFO:tasks.rados.rados.0.trial082.stdout:922: writing trial08226312-11 from 413538 to 949883 tid 1 2026-02-12T17:32:56.327 INFO:tasks.rados.rados.0.trial082.stdout:922: writing trial08226312-11 from 1395221 to 1979002 tid 2 2026-02-12T17:32:56.332 INFO:tasks.rados.rados.0.trial082.stdout:922: writing trial08226312-11 from 2556103 to 3214720 tid 3 2026-02-12T17:32:56.333 INFO:tasks.rados.rados.0.trial082.stdout:923: write (excl) oid 43 current snap is 99 2026-02-12T17:32:56.333 INFO:tasks.rados.rados.0.trial082.stdout:923: seq_num 335 ranges {430345=727947,1570056=727439,2699879=469889} 2026-02-12T17:32:56.336 INFO:tasks.rados.rados.0.trial082.stdout:923: writing trial08226312-43 from 430345 to 1158292 tid 1 2026-02-12T17:32:56.341 INFO:tasks.rados.rados.0.trial082.stdout:923: writing trial08226312-43 from 1570056 to 2297495 tid 2 2026-02-12T17:32:56.344 INFO:tasks.rados.rados.0.trial082.stdout:923: writing trial08226312-43 from 2699879 to 3169768 tid 3 2026-02-12T17:32:56.345 INFO:tasks.rados.rados.0.trial082.stdout:924: read oid 19 snap -1 2026-02-12T17:32:56.345 INFO:tasks.rados.rados.0.trial082.stdout:924: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:32:56.345 INFO:tasks.rados.rados.0.trial082.stdout:925: snap_create 2026-02-12T17:32:56.345 INFO:tasks.rados.rados.0.trial082.stdout:922: finishing write tid 1 to trial08226312-11 2026-02-12T17:32:56.345 INFO:tasks.rados.rados.0.trial082.stdout:922: finishing write tid 2 to trial08226312-11 2026-02-12T17:32:56.345 INFO:tasks.rados.rados.0.trial082.stdout:922: finishing write tid 3 to trial08226312-11 2026-02-12T17:32:56.345 INFO:tasks.rados.rados.0.trial082.stdout:922: finishing write tid 4 to trial08226312-11 2026-02-12T17:32:56.345 INFO:tasks.rados.rados.0.trial082.stdout:922: finishing write tid 5 to trial08226312-11 2026-02-12T17:32:56.345 INFO:tasks.rados.rados.0.trial082.stdout:922: oid 11 updating version 0 to 428 2026-02-12T17:32:56.346 INFO:tasks.rados.rados.0.trial082.stdout:922: oid 11 updating version 428 to 429 2026-02-12T17:32:56.346 INFO:tasks.rados.rados.0.trial082.stdout:922: oid 11 updating version 429 to 430 2026-02-12T17:32:56.346 INFO:tasks.rados.rados.0.trial082.stdout:922: oid 11 updating version 430 to 431 2026-02-12T17:32:56.346 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 431 (ObjNum 334 snap 99 seq_num 334) dirty exists 2026-02-12T17:32:56.346 INFO:tasks.rados.rados.0.trial082.stdout:922: left oid 11 (ObjNum 334 snap 99 seq_num 334) 2026-02-12T17:32:56.346 INFO:tasks.rados.rados.0.trial082.stdout:923: finishing write tid 1 to trial08226312-43 2026-02-12T17:32:56.346 INFO:tasks.rados.rados.0.trial082.stdout:923: finishing write tid 2 to trial08226312-43 2026-02-12T17:32:56.347 INFO:tasks.rados.rados.0.trial082.stdout:923: finishing write tid 3 to trial08226312-43 2026-02-12T17:32:56.347 INFO:tasks.rados.rados.0.trial082.stdout:923: finishing write tid 4 to trial08226312-43 2026-02-12T17:32:56.347 INFO:tasks.rados.rados.0.trial082.stdout:923: finishing write tid 5 to trial08226312-43 2026-02-12T17:32:56.347 INFO:tasks.rados.rados.0.trial082.stdout:923: oid 43 updating version 0 to 408 2026-02-12T17:32:56.347 INFO:tasks.rados.rados.0.trial082.stdout:923: oid 43 version 408 is already newer than 406 2026-02-12T17:32:56.347 INFO:tasks.rados.rados.0.trial082.stdout:923: oid 43 version 408 is already newer than 407 2026-02-12T17:32:56.348 INFO:tasks.rados.rados.0.trial082.stdout:923: oid 43 updating version 408 to 409 2026-02-12T17:32:56.348 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 409 (ObjNum 335 snap 99 seq_num 335) dirty exists 2026-02-12T17:32:56.348 INFO:tasks.rados.rados.0.trial082.stdout:923: left oid 43 (ObjNum 335 snap 99 seq_num 335) 2026-02-12T17:32:56.348 INFO:tasks.rados.rados.0.trial082.stdout:924: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:32:56.358 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1522605 2026-02-12T17:32:56.426 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:32:57.132 INFO:tasks.rados.rados.0.trial082.stdout:922: done (3 left) 2026-02-12T17:32:57.132 INFO:tasks.rados.rados.0.trial082.stdout:923: done (2 left) 2026-02-12T17:32:57.132 INFO:tasks.rados.rados.0.trial082.stdout:924: done (1 left) 2026-02-12T17:32:57.132 INFO:tasks.rados.rados.0.trial082.stdout:925: done (0 left) 2026-02-12T17:32:57.132 INFO:tasks.rados.rados.0.trial082.stdout:926: copy_from oid 17 from oid 35 current snap is 100 2026-02-12T17:32:57.132 INFO:tasks.rados.rados.0.trial082.stdout:927: copy_from oid 4 from oid 45 current snap is 100 2026-02-12T17:32:57.132 INFO:tasks.rados.rados.0.trial082.stdout:928: copy_from oid 12 from oid 46 current snap is 100 2026-02-12T17:32:57.132 INFO:tasks.rados.rados.0.trial082.stdout:929: read oid 22 snap 95 2026-02-12T17:32:57.133 INFO:tasks.rados.rados.0.trial082.stdout:929: expect (ObjNum 258 snap 74 seq_num 258) 2026-02-12T17:32:57.133 INFO:tasks.rados.rados.0.trial082.stdout:930: write oid 11 current snap is 100 2026-02-12T17:32:57.133 INFO:tasks.rados.rados.0.trial082.stdout:930: seq_num 336 ranges {447152=403196,1512185=587450,2727302=681161} 2026-02-12T17:32:57.134 INFO:tasks.rados.rados.0.trial082.stdout:930: writing trial08226312-11 from 447152 to 850348 tid 1 2026-02-12T17:32:57.139 INFO:tasks.rados.rados.0.trial082.stdout:930: writing trial08226312-11 from 1512185 to 2099635 tid 2 2026-02-12T17:32:57.145 INFO:tasks.rados.rados.0.trial082.stdout:930: writing trial08226312-11 from 2727302 to 3408463 tid 3 2026-02-12T17:32:57.145 INFO:tasks.rados.rados.0.trial082.stdout:931: read oid 27 snap -1 2026-02-12T17:32:57.145 INFO:tasks.rados.rados.0.trial082.stdout:931: expect deleted 2026-02-12T17:32:57.145 INFO:tasks.rados.rados.0.trial082.stdout:932: snap_create 2026-02-12T17:32:57.145 INFO:tasks.rados.rados.0.trial082.stdout:926: finishing copy_from to trial08226312-17 2026-02-12T17:32:57.145 INFO:tasks.rados.rados.0.trial082.stdout:926: got expected ENOENT (src dne) 2026-02-12T17:32:57.145 INFO:tasks.rados.rados.0.trial082.stdout:926: finishing copy_from racing read to trial08226312-17 2026-02-12T17:32:57.146 INFO:tasks.rados.rados.0.trial082.stdout:929: expect (ObjNum 258 snap 74 seq_num 258) 2026-02-12T17:32:57.200 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:32:57.229 INFO:tasks.rados.rados.0.trial082.stdout:930: finishing write tid 1 to trial08226312-11 2026-02-12T17:32:57.229 INFO:tasks.rados.rados.0.trial082.stdout:927: finishing copy_from racing read to trial08226312-4 2026-02-12T17:32:57.229 INFO:tasks.rados.rados.0.trial082.stdout:927: finishing copy_from to trial08226312-4 2026-02-12T17:32:57.229 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 420 (ObjNum 315 snap 93 seq_num 315) dirty exists 2026-02-12T17:32:57.229 INFO:tasks.rados.rados.0.trial082.stdout:930: finishing write tid 2 to trial08226312-11 2026-02-12T17:32:57.229 INFO:tasks.rados.rados.0.trial082.stdout:928: finishing copy_from racing read to trial08226312-12 2026-02-12T17:32:57.229 INFO:tasks.rados.rados.0.trial082.stdout:928: finishing copy_from to trial08226312-12 2026-02-12T17:32:57.229 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 427 (ObjNum 332 snap 99 seq_num 332) dirty exists 2026-02-12T17:32:57.229 INFO:tasks.rados.rados.0.trial082.stdout:930: finishing write tid 3 to trial08226312-11 2026-02-12T17:32:57.230 INFO:tasks.rados.rados.0.trial082.stdout:930: finishing write tid 4 to trial08226312-11 2026-02-12T17:32:57.230 INFO:tasks.rados.rados.0.trial082.stdout:930: finishing write tid 5 to trial08226312-11 2026-02-12T17:32:57.230 INFO:tasks.rados.rados.0.trial082.stdout:930: oid 11 updating version 0 to 433 2026-02-12T17:32:57.230 INFO:tasks.rados.rados.0.trial082.stdout:930: oid 11 updating version 433 to 435 2026-02-12T17:32:57.230 INFO:tasks.rados.rados.0.trial082.stdout:930: oid 11 version 435 is already newer than 434 2026-02-12T17:32:57.230 INFO:tasks.rados.rados.0.trial082.stdout:930: oid 11 version 435 is already newer than 432 2026-02-12T17:32:57.230 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 435 (ObjNum 336 snap 100 seq_num 336) dirty exists 2026-02-12T17:32:57.230 INFO:tasks.rados.rados.0.trial082.stdout:930: left oid 11 (ObjNum 336 snap 100 seq_num 336) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:926: done (6 left) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:927: done (5 left) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:928: done (4 left) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:929: done (3 left) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:930: done (2 left) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:931: done (1 left) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:932: done (0 left) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:933: rollback oid 41 current snap is 101 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 89 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:934: read oid 42 snap 84 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:934: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:935: read oid 32 snap -1 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:935: expect (ObjNum 310 snap 89 seq_num 310) 2026-02-12T17:32:58.134 INFO:tasks.rados.rados.0.trial082.stdout:936: delete oid 13 current snap is 101 2026-02-12T17:32:58.136 INFO:tasks.rados.rados.0.trial082.stdout:936: done (3 left) 2026-02-12T17:32:58.136 INFO:tasks.rados.rados.0.trial082.stdout:937: snap_create 2026-02-12T17:32:58.136 INFO:tasks.rados.rados.0.trial082.stdout:933: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:32:58.136 INFO:tasks.rados.rados.0.trial082.stdout:933: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:32:58.136 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 429 (ObjNum 97 snap 0 seq_num 1746817384) dirty dne 2026-02-12T17:32:58.137 INFO:tasks.rados.rados.0.trial082.stdout:935: expect (ObjNum 310 snap 89 seq_num 310) 2026-02-12T17:32:58.160 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3185613 2026-02-12T17:32:58.219 INFO:tasks.rados.rados.0.trial082.stdout:934: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:32:59.137 INFO:tasks.rados.rados.0.trial082.stdout:933: done (3 left) 2026-02-12T17:32:59.137 INFO:tasks.rados.rados.0.trial082.stdout:934: done (2 left) 2026-02-12T17:32:59.137 INFO:tasks.rados.rados.0.trial082.stdout:935: done (1 left) 2026-02-12T17:32:59.138 INFO:tasks.rados.rados.0.trial082.stdout:937: done (0 left) 2026-02-12T17:32:59.138 INFO:tasks.rados.rados.0.trial082.stdout:938: write oid 23 current snap is 102 2026-02-12T17:32:59.138 INFO:tasks.rados.rados.0.trial082.stdout:938: seq_num 338 ranges {480766=553694,1629149=591119,2782148=420058} 2026-02-12T17:32:59.141 INFO:tasks.rados.rados.0.trial082.stdout:938: writing trial08226312-23 from 480766 to 1034460 tid 1 2026-02-12T17:32:59.145 INFO:tasks.rados.rados.0.trial082.stdout:938: writing trial08226312-23 from 1629149 to 2220268 tid 2 2026-02-12T17:32:59.150 INFO:tasks.rados.rados.0.trial082.stdout:938: writing trial08226312-23 from 2782148 to 3202206 tid 3 2026-02-12T17:32:59.150 INFO:tasks.rados.rados.0.trial082.stdout:939: read oid 12 snap -1 2026-02-12T17:32:59.150 INFO:tasks.rados.rados.0.trial082.stdout:939: expect (ObjNum 332 snap 99 seq_num 332) 2026-02-12T17:32:59.150 INFO:tasks.rados.rados.0.trial082.stdout:940: read oid 18 snap -1 2026-02-12T17:32:59.150 INFO:tasks.rados.rados.0.trial082.stdout:940: expect (ObjNum 307 snap 88 seq_num 307) 2026-02-12T17:32:59.150 INFO:tasks.rados.rados.0.trial082.stdout:941: rollback oid 1 current snap is 102 2026-02-12T17:32:59.150 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 99 2026-02-12T17:32:59.151 INFO:tasks.rados.rados.0.trial082.stdout:938: finishing write tid 1 to trial08226312-23 2026-02-12T17:32:59.151 INFO:tasks.rados.rados.0.trial082.stdout:938: finishing write tid 2 to trial08226312-23 2026-02-12T17:32:59.151 INFO:tasks.rados.rados.0.trial082.stdout:942: delete oid 48 current snap is 102 2026-02-12T17:32:59.152 INFO:tasks.rados.rados.0.trial082.stdout:938: finishing write tid 3 to trial08226312-23 2026-02-12T17:32:59.152 INFO:tasks.rados.rados.0.trial082.stdout:938: finishing write tid 4 to trial08226312-23 2026-02-12T17:32:59.152 INFO:tasks.rados.rados.0.trial082.stdout:938: finishing write tid 5 to trial08226312-23 2026-02-12T17:32:59.152 INFO:tasks.rados.rados.0.trial082.stdout:938: oid 23 updating version 0 to 422 2026-02-12T17:32:59.152 INFO:tasks.rados.rados.0.trial082.stdout:938: oid 23 version 422 is already newer than 421 2026-02-12T17:32:59.152 INFO:tasks.rados.rados.0.trial082.stdout:938: oid 23 updating version 422 to 424 2026-02-12T17:32:59.153 INFO:tasks.rados.rados.0.trial082.stdout:938: oid 23 version 424 is already newer than 423 2026-02-12T17:32:59.153 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 424 (ObjNum 338 snap 102 seq_num 338) dirty exists 2026-02-12T17:32:59.153 INFO:tasks.rados.rados.0.trial082.stdout:938: left oid 23 (ObjNum 338 snap 102 seq_num 338) 2026-02-12T17:32:59.153 INFO:tasks.rados.rados.0.trial082.stdout:938: done (4 left) 2026-02-12T17:32:59.153 INFO:tasks.rados.rados.0.trial082.stdout:942: done (3 left) 2026-02-12T17:32:59.153 INFO:tasks.rados.rados.0.trial082.stdout:943: rollback oid 32 current snap is 102 2026-02-12T17:32:59.153 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 98 2026-02-12T17:32:59.153 INFO:tasks.rados.rados.0.trial082.stdout:944: snap_remove snap 100 2026-02-12T17:33:00.141 INFO:tasks.rados.rados.0.trial082.stdout:944: done (4 left) 2026-02-12T17:33:00.141 INFO:tasks.rados.rados.0.trial082.stdout:945: read oid 5 snap 88 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:945: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:946: copy_from oid 50 from oid 34 current snap is 102 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:941: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 49 (ObjNum 0 snap 0 seq_num 304) dirty dne 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:943: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:943: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:943: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 247 (ObjNum 310 snap 89 seq_num 310) dirty exists 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:939: expect (ObjNum 332 snap 99 seq_num 332) 2026-02-12T17:33:00.142 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:00.175 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:00.240 INFO:tasks.rados.rados.0.trial082.stdout:940: expect (ObjNum 307 snap 88 seq_num 307) 2026-02-12T17:33:00.240 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 489576 2026-02-12T17:33:00.259 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:00.303 INFO:tasks.rados.rados.0.trial082.stdout:945: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:33:00.303 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:00.393 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:00.438 INFO:tasks.rados.rados.0.trial082.stdout:946: finishing copy_from racing read to trial08226312-50 2026-02-12T17:33:00.438 INFO:tasks.rados.rados.0.trial082.stdout:946: finishing copy_from to trial08226312-50 2026-02-12T17:33:00.438 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 210 (ObjNum 263 snap 76 seq_num 263) dirty exists 2026-02-12T17:33:00.438 INFO:tasks.rados.rados.0.trial082.stdout:939: done (5 left) 2026-02-12T17:33:00.439 INFO:tasks.rados.rados.0.trial082.stdout:940: done (4 left) 2026-02-12T17:33:00.439 INFO:tasks.rados.rados.0.trial082.stdout:941: done (3 left) 2026-02-12T17:33:00.439 INFO:tasks.rados.rados.0.trial082.stdout:943: done (2 left) 2026-02-12T17:33:00.439 INFO:tasks.rados.rados.0.trial082.stdout:945: done (1 left) 2026-02-12T17:33:00.439 INFO:tasks.rados.rados.0.trial082.stdout:946: done (0 left) 2026-02-12T17:33:00.439 INFO:tasks.rados.rados.0.trial082.stdout:947: snap_remove snap 69 2026-02-12T17:33:01.143 INFO:tasks.rados.rados.0.trial082.stdout:947: done (0 left) 2026-02-12T17:33:01.143 INFO:tasks.rados.rados.0.trial082.stdout:948: snap_create 2026-02-12T17:33:02.146 INFO:tasks.rados.rados.0.trial082.stdout:948: done (0 left) 2026-02-12T17:33:02.147 INFO:tasks.rados.rados.0.trial082.stdout:949: rollback oid 1 current snap is 103 2026-02-12T17:33:02.147 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 96 2026-02-12T17:33:02.147 INFO:tasks.rados.rados.0.trial082.stdout:950: snap_remove snap 97 2026-02-12T17:33:03.026 INFO:tasks.rados.rados.0.trial082.stdout:950: done (1 left) 2026-02-12T17:33:03.026 INFO:tasks.rados.rados.0.trial082.stdout:951: read oid 49 snap -1 2026-02-12T17:33:03.026 INFO:tasks.rados.rados.0.trial082.stdout:951: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:33:03.026 INFO:tasks.rados.rados.0.trial082.stdout:952: read oid 36 snap 95 2026-02-12T17:33:03.026 INFO:tasks.rados.rados.0.trial082.stdout:952: expect (ObjNum 244 snap 68 seq_num 244) 2026-02-12T17:33:03.026 INFO:tasks.rados.rados.0.trial082.stdout:953: write oid 43 current snap is 103 2026-02-12T17:33:03.027 INFO:tasks.rados.rados.0.trial082.stdout:953: seq_num 340 ranges {514380=704192,1629760=478435,2604288=442602} 2026-02-12T17:33:03.030 INFO:tasks.rados.rados.0.trial082.stdout:953: writing trial08226312-43 from 514380 to 1218572 tid 1 2026-02-12T17:33:03.034 INFO:tasks.rados.rados.0.trial082.stdout:953: writing trial08226312-43 from 1629760 to 2108195 tid 2 2026-02-12T17:33:03.037 INFO:tasks.rados.rados.0.trial082.stdout:953: writing trial08226312-43 from 2604288 to 3046890 tid 3 2026-02-12T17:33:03.037 INFO:tasks.rados.rados.0.trial082.stdout:954: write (excl) oid 22 current snap is 103 2026-02-12T17:33:03.037 INFO:tasks.rados.rados.0.trial082.stdout:954: seq_num 341 ranges {531187=779441,2088242=738446,3431711=299476} 2026-02-12T17:33:03.042 INFO:tasks.rados.rados.0.trial082.stdout:954: writing trial08226312-22 from 531187 to 1310628 tid 1 2026-02-12T17:33:03.048 INFO:tasks.rados.rados.0.trial082.stdout:954: writing trial08226312-22 from 2088242 to 2826688 tid 2 2026-02-12T17:33:03.052 INFO:tasks.rados.rados.0.trial082.stdout:954: writing trial08226312-22 from 3431711 to 3731187 tid 3 2026-02-12T17:33:03.052 INFO:tasks.rados.rados.0.trial082.stdout:955: rollback oid 48 current snap is 103 2026-02-12T17:33:03.052 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 98 2026-02-12T17:33:03.052 INFO:tasks.rados.rados.0.trial082.stdout:949: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:33:03.052 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:33:03.052 INFO:tasks.rados.rados.0.trial082.stdout:952: expect (ObjNum 244 snap 68 seq_num 244) 2026-02-12T17:33:03.054 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1211794 2026-02-12T17:33:03.068 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1616020 2026-02-12T17:33:03.082 INFO:tasks.rados.rados.0.trial082.stdout:951: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:33:03.082 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:03.108 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2447799 2026-02-12T17:33:03.133 INFO:tasks.rados.rados.0.trial082.stdout:953: finishing write tid 1 to trial08226312-43 2026-02-12T17:33:03.133 INFO:tasks.rados.rados.0.trial082.stdout:953: finishing write tid 2 to trial08226312-43 2026-02-12T17:33:03.133 INFO:tasks.rados.rados.0.trial082.stdout:953: finishing write tid 3 to trial08226312-43 2026-02-12T17:33:03.133 INFO:tasks.rados.rados.0.trial082.stdout:953: finishing write tid 4 to trial08226312-43 2026-02-12T17:33:03.133 INFO:tasks.rados.rados.0.trial082.stdout:949: done (5 left) 2026-02-12T17:33:03.133 INFO:tasks.rados.rados.0.trial082.stdout:951: done (4 left) 2026-02-12T17:33:03.133 INFO:tasks.rados.rados.0.trial082.stdout:952: done (3 left) 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:956: copy_from oid 44 from oid 8 current snap is 103 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:953: finishing write tid 5 to trial08226312-43 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:953: oid 43 updating version 0 to 420 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:953: oid 43 version 420 is already newer than 419 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:953: oid 43 updating version 420 to 422 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:953: oid 43 version 422 is already newer than 421 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 422 (ObjNum 340 snap 103 seq_num 340) dirty exists 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:953: left oid 43 (ObjNum 340 snap 103 seq_num 340) 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:954: finishing write tid 1 to trial08226312-22 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:954: finishing write tid 2 to trial08226312-22 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:954: finishing write tid 3 to trial08226312-22 2026-02-12T17:33:03.134 INFO:tasks.rados.rados.0.trial082.stdout:955: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:954: finishing write tid 4 to trial08226312-22 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:955: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 60 (ObjNum 218 snap 59 seq_num 218) dirty exists 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:954: finishing write tid 5 to trial08226312-22 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:954: oid 22 updating version 0 to 426 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:954: oid 22 updating version 426 to 427 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:954: oid 22 version 427 is already newer than 424 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:954: oid 22 version 427 is already newer than 425 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 427 (ObjNum 341 snap 103 seq_num 341) dirty exists 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:954: left oid 22 (ObjNum 341 snap 103 seq_num 341) 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:953: done (3 left) 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:954: done (2 left) 2026-02-12T17:33:03.135 INFO:tasks.rados.rados.0.trial082.stdout:955: done (1 left) 2026-02-12T17:33:03.136 INFO:tasks.rados.rados.0.trial082.stdout:957: delete oid 25 current snap is 103 2026-02-12T17:33:03.136 INFO:tasks.rados.rados.0.trial082.stdout:957: done (1 left) 2026-02-12T17:33:03.136 INFO:tasks.rados.rados.0.trial082.stdout:958: write (excl) oid 32 current snap is 103 2026-02-12T17:33:03.136 INFO:tasks.rados.rados.0.trial082.stdout:958: seq_num 343 ranges {564801=646292,1921559=742115,3202910=561891} 2026-02-12T17:33:03.139 INFO:tasks.rados.rados.0.trial082.stdout:958: writing trial08226312-32 from 564801 to 1211093 tid 1 2026-02-12T17:33:03.144 INFO:tasks.rados.rados.0.trial082.stdout:958: writing trial08226312-32 from 1921559 to 2663674 tid 2 2026-02-12T17:33:03.149 INFO:tasks.rados.rados.0.trial082.stdout:958: writing trial08226312-32 from 3202910 to 3764801 tid 3 2026-02-12T17:33:03.149 INFO:tasks.rados.rados.0.trial082.stdout:959: delete oid 45 current snap is 103 2026-02-12T17:33:03.149 INFO:tasks.rados.rados.0.trial082.stdout:956: finishing copy_from racing read to trial08226312-44 2026-02-12T17:33:03.149 INFO:tasks.rados.rados.0.trial082.stdout:956: finishing copy_from to trial08226312-44 2026-02-12T17:33:03.149 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 490 (ObjNum 308 snap 88 seq_num 308) dirty exists 2026-02-12T17:33:03.150 INFO:tasks.rados.rados.0.trial082.stdout:958: finishing write tid 1 to trial08226312-32 2026-02-12T17:33:03.150 INFO:tasks.rados.rados.0.trial082.stdout:958: finishing write tid 2 to trial08226312-32 2026-02-12T17:33:03.152 INFO:tasks.rados.rados.0.trial082.stdout:958: finishing write tid 3 to trial08226312-32 2026-02-12T17:33:03.153 INFO:tasks.rados.rados.0.trial082.stdout:958: finishing write tid 4 to trial08226312-32 2026-02-12T17:33:03.153 INFO:tasks.rados.rados.0.trial082.stdout:958: finishing write tid 5 to trial08226312-32 2026-02-12T17:33:03.153 INFO:tasks.rados.rados.0.trial082.stdout:958: oid 32 updating version 0 to 257 2026-02-12T17:33:03.153 INFO:tasks.rados.rados.0.trial082.stdout:958: oid 32 updating version 257 to 258 2026-02-12T17:33:03.153 INFO:tasks.rados.rados.0.trial082.stdout:958: oid 32 version 258 is already newer than 253 2026-02-12T17:33:03.153 INFO:tasks.rados.rados.0.trial082.stdout:958: oid 32 version 258 is already newer than 256 2026-02-12T17:33:03.153 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 258 (ObjNum 343 snap 103 seq_num 343) dirty exists 2026-02-12T17:33:03.153 INFO:tasks.rados.rados.0.trial082.stdout:958: left oid 32 (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:33:03.153 INFO:tasks.rados.rados.0.trial082.stdout:956: done (2 left) 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:958: done (1 left) 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:959: done (0 left) 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:960: read oid 7 snap -1 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:960: expect deleted 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:961: rollback oid 27 current snap is 103 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 84 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:962: read oid 19 snap -1 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:962: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:963: copy_from oid 37 from oid 39 current snap is 103 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:964: read oid 9 snap -1 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:964: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:965: rollback oid 17 current snap is 103 2026-02-12T17:33:03.154 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 84 2026-02-12T17:33:03.155 INFO:tasks.rados.rados.0.trial082.stdout:966: rollback oid 13 current snap is 103 2026-02-12T17:33:03.155 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 96 2026-02-12T17:33:03.155 INFO:tasks.rados.rados.0.trial082.stdout:967: copy_from oid 25 from oid 40 current snap is 103 2026-02-12T17:33:03.155 INFO:tasks.rados.rados.0.trial082.stdout:968: rollback oid 11 current snap is 103 2026-02-12T17:33:03.155 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 101 2026-02-12T17:33:03.155 INFO:tasks.rados.rados.0.trial082.stdout:969: write oid 34 current snap is 103 2026-02-12T17:33:03.155 INFO:tasks.rados.rados.0.trial082.stdout:969: seq_num 345 ranges {598415=796790,1922170=745784,3141403=415315} 2026-02-12T17:33:03.156 INFO:tasks.rados.rados.0.trial082.stdout:969: writing trial08226312-34 from 598415 to 1395205 tid 1 2026-02-12T17:33:03.160 INFO:tasks.rados.rados.0.trial082.stdout:969: writing trial08226312-34 from 1922170 to 2667954 tid 2 2026-02-12T17:33:03.164 INFO:tasks.rados.rados.0.trial082.stdout:969: writing trial08226312-34 from 3141403 to 3556718 tid 3 2026-02-12T17:33:03.164 INFO:tasks.rados.rados.0.trial082.stdout:970: snap_create 2026-02-12T17:33:03.164 INFO:tasks.rados.rados.0.trial082.stdout:961: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:33:03.164 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 0 (ObjNum 705 snap 0 seq_num 6605) dirty dne 2026-02-12T17:33:03.164 INFO:tasks.rados.rados.0.trial082.stdout:963: finishing copy_from to trial08226312-37 2026-02-12T17:33:03.164 INFO:tasks.rados.rados.0.trial082.stdout:963: got expected ENOENT (src dne) 2026-02-12T17:33:03.165 INFO:tasks.rados.rados.0.trial082.stdout:963: finishing copy_from racing read to trial08226312-37 2026-02-12T17:33:03.165 INFO:tasks.rados.rados.0.trial082.stdout:962: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:33:03.165 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:03.210 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:03.255 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:03.300 INFO:tasks.rados.rados.0.trial082.stdout:968: finishing rollback tid 0 to trial08226312-11 2026-02-12T17:33:03.300 INFO:tasks.rados.rados.0.trial082.stdout:968: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:33:03.300 INFO:tasks.rados.rados.0.trial082.stdout:968: finishing rollback tid 2 to trial08226312-11 2026-02-12T17:33:03.300 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 438 (ObjNum 336 snap 100 seq_num 336) dirty exists 2026-02-12T17:33:03.300 INFO:tasks.rados.rados.0.trial082.stdout:966: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:33:03.301 INFO:tasks.rados.rados.0.trial082.stdout:966: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:33:03.301 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 207 (ObjNum 321 snap 95 seq_num 321) dirty exists 2026-02-12T17:33:03.301 INFO:tasks.rados.rados.0.trial082.stdout:965: finishing rollback tid 0 to trial08226312-17 2026-02-12T17:33:03.301 INFO:tasks.rados.rados.0.trial082.stdout:965: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:33:03.301 INFO:tasks.rados.rados.0.trial082.stdout:965: finishing rollback tid 2 to trial08226312-17 2026-02-12T17:33:03.301 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 606 (ObjNum 297 snap 83 seq_num 297) dirty exists 2026-02-12T17:33:03.301 INFO:tasks.rados.rados.0.trial082.stdout:964: expect (ObjNum 184 snap 48 seq_num 184) 2026-02-12T17:33:03.301 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:03.363 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 163002 2026-02-12T17:33:03.396 INFO:tasks.rados.rados.0.trial082.stdout:969: finishing write tid 1 to trial08226312-34 2026-02-12T17:33:03.396 INFO:tasks.rados.rados.0.trial082.stdout:967: finishing copy_from racing read to trial08226312-25 2026-02-12T17:33:03.396 INFO:tasks.rados.rados.0.trial082.stdout:967: finishing copy_from to trial08226312-25 2026-02-12T17:33:03.396 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 496 (ObjNum 319 snap 94 seq_num 319) dirty exists 2026-02-12T17:33:03.396 INFO:tasks.rados.rados.0.trial082.stdout:969: finishing write tid 2 to trial08226312-34 2026-02-12T17:33:03.396 INFO:tasks.rados.rados.0.trial082.stdout:969: finishing write tid 3 to trial08226312-34 2026-02-12T17:33:03.396 INFO:tasks.rados.rados.0.trial082.stdout:969: finishing write tid 4 to trial08226312-34 2026-02-12T17:33:03.396 INFO:tasks.rados.rados.0.trial082.stdout:969: finishing write tid 5 to trial08226312-34 2026-02-12T17:33:03.397 INFO:tasks.rados.rados.0.trial082.stdout:969: oid 34 updating version 0 to 243 2026-02-12T17:33:03.397 INFO:tasks.rados.rados.0.trial082.stdout:969: oid 34 updating version 243 to 245 2026-02-12T17:33:03.397 INFO:tasks.rados.rados.0.trial082.stdout:969: oid 34 version 245 is already newer than 242 2026-02-12T17:33:03.397 INFO:tasks.rados.rados.0.trial082.stdout:969: oid 34 version 245 is already newer than 244 2026-02-12T17:33:03.397 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 245 (ObjNum 345 snap 103 seq_num 345) dirty exists 2026-02-12T17:33:03.397 INFO:tasks.rados.rados.0.trial082.stdout:969: left oid 34 (ObjNum 345 snap 103 seq_num 345) 2026-02-12T17:33:04.150 INFO:tasks.rados.rados.0.trial082.stdout:960: done (10 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:961: done (9 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:962: done (8 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:963: done (7 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:964: done (6 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:965: done (5 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:966: done (4 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:967: done (3 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:968: done (2 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:969: done (1 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:970: done (0 left) 2026-02-12T17:33:04.151 INFO:tasks.rados.rados.0.trial082.stdout:971: rollback oid 6 current snap is 104 2026-02-12T17:33:04.152 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 6 to 101 2026-02-12T17:33:04.152 INFO:tasks.rados.rados.0.trial082.stdout:972: snap_remove snap 98 2026-02-12T17:33:05.274 INFO:tasks.rados.rados.0.trial082.stdout:972: done (1 left) 2026-02-12T17:33:05.274 INFO:tasks.rados.rados.0.trial082.stdout:973: read oid 25 snap -1 2026-02-12T17:33:05.274 INFO:tasks.rados.rados.0.trial082.stdout:973: expect (ObjNum 319 snap 94 seq_num 319) 2026-02-12T17:33:05.274 INFO:tasks.rados.rados.0.trial082.stdout:974: write (excl) oid 21 current snap is 104 2026-02-12T17:33:05.274 INFO:tasks.rados.rados.0.trial082.stdout:971: finishing rollback tid 0 to trial08226312-6 2026-02-12T17:33:05.274 INFO:tasks.rados.rados.0.trial082.stdout:971: finishing rollback tid 1 to trial08226312-6 2026-02-12T17:33:05.274 INFO:tasks.rados.rados.0.trial082.stdout:971: finishing rollback tid 2 to trial08226312-6 2026-02-12T17:33:05.274 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 213 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-12T17:33:05.275 INFO:tasks.rados.rados.0.trial082.stdout:974: seq_num 346 ranges {615222=472039,1580652=489442,2768826=626587} 2026-02-12T17:33:05.277 INFO:tasks.rados.rados.0.trial082.stdout:974: writing trial08226312-21 from 615222 to 1087261 tid 1 2026-02-12T17:33:05.281 INFO:tasks.rados.rados.0.trial082.stdout:974: writing trial08226312-21 from 1580652 to 2070094 tid 2 2026-02-12T17:33:05.286 INFO:tasks.rados.rados.0.trial082.stdout:974: writing trial08226312-21 from 2768826 to 3395413 tid 3 2026-02-12T17:33:05.286 INFO:tasks.rados.rados.0.trial082.stdout:971: done (2 left) 2026-02-12T17:33:05.286 INFO:tasks.rados.rados.0.trial082.stdout:975: write (excl) oid 8 current snap is 104 2026-02-12T17:33:05.286 INFO:tasks.rados.rados.0.trial082.stdout:975: seq_num 347 ranges {632029=547288,1639134=749453,2796249=437859,3653524=178505} 2026-02-12T17:33:05.290 INFO:tasks.rados.rados.0.trial082.stdout:975: writing trial08226312-8 from 632029 to 1179317 tid 1 2026-02-12T17:33:05.295 INFO:tasks.rados.rados.0.trial082.stdout:975: writing trial08226312-8 from 1639134 to 2388587 tid 2 2026-02-12T17:33:05.298 INFO:tasks.rados.rados.0.trial082.stdout:975: writing trial08226312-8 from 2796249 to 3234108 tid 3 2026-02-12T17:33:05.301 INFO:tasks.rados.rados.0.trial082.stdout:975: writing trial08226312-8 from 3653524 to 3832029 tid 4 2026-02-12T17:33:05.301 INFO:tasks.rados.rados.0.trial082.stdout:976: delete oid 9 current snap is 104 2026-02-12T17:33:05.301 INFO:tasks.rados.rados.0.trial082.stdout:974: finishing write tid 1 to trial08226312-21 2026-02-12T17:33:05.301 INFO:tasks.rados.rados.0.trial082.stdout:973: expect (ObjNum 319 snap 94 seq_num 319) 2026-02-12T17:33:05.447 INFO:tasks.rados.rados.0.trial082.stdout:974: finishing write tid 2 to trial08226312-21 2026-02-12T17:33:05.447 INFO:tasks.rados.rados.0.trial082.stdout:974: finishing write tid 3 to trial08226312-21 2026-02-12T17:33:05.447 INFO:tasks.rados.rados.0.trial082.stdout:974: finishing write tid 4 to trial08226312-21 2026-02-12T17:33:05.447 INFO:tasks.rados.rados.0.trial082.stdout:974: finishing write tid 5 to trial08226312-21 2026-02-12T17:33:05.447 INFO:tasks.rados.rados.0.trial082.stdout:974: oid 21 updating version 0 to 433 2026-02-12T17:33:05.447 INFO:tasks.rados.rados.0.trial082.stdout:974: oid 21 version 433 is already newer than 432 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:974: oid 21 updating version 433 to 434 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:974: oid 21 version 434 is already newer than 431 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 434 (ObjNum 346 snap 104 seq_num 346) dirty exists 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:974: left oid 21 (ObjNum 346 snap 104 seq_num 346) 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:975: finishing write tid 1 to trial08226312-8 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:975: finishing write tid 2 to trial08226312-8 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:973: done (3 left) 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:974: done (2 left) 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:976: done (1 left) 2026-02-12T17:33:05.448 INFO:tasks.rados.rados.0.trial082.stdout:977: delete oid 4 current snap is 104 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: finishing write tid 3 to trial08226312-8 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: finishing write tid 4 to trial08226312-8 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: finishing write tid 5 to trial08226312-8 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: finishing write tid 6 to trial08226312-8 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: oid 8 updating version 0 to 616 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: oid 8 version 616 is already newer than 615 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: oid 8 version 616 is already newer than 613 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: oid 8 version 616 is already newer than 612 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: oid 8 version 616 is already newer than 614 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 616 (ObjNum 347 snap 104 seq_num 347) dirty exists 2026-02-12T17:33:05.449 INFO:tasks.rados.rados.0.trial082.stdout:975: left oid 8 (ObjNum 347 snap 104 seq_num 347) 2026-02-12T17:33:05.451 INFO:tasks.rados.rados.0.trial082.stdout:975: done (1 left) 2026-02-12T17:33:05.451 INFO:tasks.rados.rados.0.trial082.stdout:977: done (0 left) 2026-02-12T17:33:05.451 INFO:tasks.rados.rados.0.trial082.stdout:978: rollback oid 34 current snap is 104 2026-02-12T17:33:05.451 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 84 2026-02-12T17:33:05.451 INFO:tasks.rados.rados.0.trial082.stdout:979: snap_create 2026-02-12T17:33:05.451 INFO:tasks.rados.rados.0.trial082.stdout:978: finishing rollback tid 0 to trial08226312-34 2026-02-12T17:33:05.451 INFO:tasks.rados.rados.0.trial082.stdout:978: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:33:05.451 INFO:tasks.rados.rados.0.trial082.stdout:978: finishing rollback tid 2 to trial08226312-34 2026-02-12T17:33:05.451 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 251 (ObjNum 263 snap 76 seq_num 263) dirty exists 2026-02-12T17:33:07.020 INFO:tasks.rados.rados.0.trial082.stdout:978: done (1 left) 2026-02-12T17:33:07.021 INFO:tasks.rados.rados.0.trial082.stdout:979: done (0 left) 2026-02-12T17:33:07.021 INFO:tasks.rados.rados.0.trial082.stdout:980: delete oid 10 current snap is 105 2026-02-12T17:33:07.022 INFO:tasks.rados.rados.0.trial082.stdout:980: done (0 left) 2026-02-12T17:33:07.022 INFO:tasks.rados.rados.0.trial082.stdout:981: read oid 49 snap -1 2026-02-12T17:33:07.022 INFO:tasks.rados.rados.0.trial082.stdout:981: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:33:07.022 INFO:tasks.rados.rados.0.trial082.stdout:982: write (excl) oid 35 current snap is 105 2026-02-12T17:33:07.022 INFO:tasks.rados.rados.0.trial082.stdout:982: seq_num 351 ranges {699257=564637,1873062=640438,3305941=593316} 2026-02-12T17:33:07.027 INFO:tasks.rados.rados.0.trial082.stdout:982: writing trial08226312-35 from 699257 to 1263894 tid 1 2026-02-12T17:33:07.032 INFO:tasks.rados.rados.0.trial082.stdout:982: writing trial08226312-35 from 1873062 to 2513500 tid 2 2026-02-12T17:33:07.037 INFO:tasks.rados.rados.0.trial082.stdout:982: writing trial08226312-35 from 3305941 to 3899257 tid 3 2026-02-12T17:33:07.037 INFO:tasks.rados.rados.0.trial082.stdout:983: delete oid 21 current snap is 105 2026-02-12T17:33:07.037 INFO:tasks.rados.rados.0.trial082.stdout:981: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:33:07.037 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:07.057 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:07.083 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2581545 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:982: finishing write tid 1 to trial08226312-35 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:982: finishing write tid 2 to trial08226312-35 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:981: done (2 left) 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:983: done (1 left) 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:984: delete oid 2 current snap is 105 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:982: finishing write tid 3 to trial08226312-35 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:982: finishing write tid 4 to trial08226312-35 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:982: finishing write tid 5 to trial08226312-35 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:982: oid 35 updating version 0 to 495 2026-02-12T17:33:07.088 INFO:tasks.rados.rados.0.trial082.stdout:982: oid 35 version 495 is already newer than 493 2026-02-12T17:33:07.089 INFO:tasks.rados.rados.0.trial082.stdout:982: oid 35 version 495 is already newer than 494 2026-02-12T17:33:07.089 INFO:tasks.rados.rados.0.trial082.stdout:982: oid 35 version 495 is already newer than 492 2026-02-12T17:33:07.089 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 495 (ObjNum 351 snap 105 seq_num 351) dirty exists 2026-02-12T17:33:07.089 INFO:tasks.rados.rados.0.trial082.stdout:982: left oid 35 (ObjNum 351 snap 105 seq_num 351) 2026-02-12T17:33:07.089 INFO:tasks.rados.rados.0.trial082.stdout:982: done (1 left) 2026-02-12T17:33:07.089 INFO:tasks.rados.rados.0.trial082.stdout:984: done (0 left) 2026-02-12T17:33:07.090 INFO:tasks.rados.rados.0.trial082.stdout:985: read oid 41 snap -1 2026-02-12T17:33:07.090 INFO:tasks.rados.rados.0.trial082.stdout:985: expect deleted 2026-02-12T17:33:07.090 INFO:tasks.rados.rados.0.trial082.stdout:986: snap_remove snap 84 2026-02-12T17:33:08.023 INFO:tasks.rados.rados.0.trial082.stdout:986: done (1 left) 2026-02-12T17:33:08.023 INFO:tasks.rados.rados.0.trial082.stdout:987: copy_from oid 3 from oid 26 current snap is 105 2026-02-12T17:33:08.023 INFO:tasks.rados.rados.0.trial082.stdout:985: done (1 left) 2026-02-12T17:33:08.023 INFO:tasks.rados.rados.0.trial082.stdout:988: read oid 23 snap -1 2026-02-12T17:33:08.023 INFO:tasks.rados.rados.0.trial082.stdout:988: expect (ObjNum 338 snap 102 seq_num 338) 2026-02-12T17:33:08.023 INFO:tasks.rados.rados.0.trial082.stdout:989: write oid 21 current snap is 105 2026-02-12T17:33:08.024 INFO:tasks.rados.rados.0.trial082.stdout:989: seq_num 354 ranges {749678=790384,2332155=504118,3271857=549469} 2026-02-12T17:33:08.028 INFO:tasks.rados.rados.0.trial082.stdout:989: writing trial08226312-21 from 749678 to 1540062 tid 1 2026-02-12T17:33:08.033 INFO:tasks.rados.rados.0.trial082.stdout:989: writing trial08226312-21 from 2332155 to 2836273 tid 2 2026-02-12T17:33:08.037 INFO:tasks.rados.rados.0.trial082.stdout:989: writing trial08226312-21 from 3271857 to 3821326 tid 3 2026-02-12T17:33:08.037 INFO:tasks.rados.rados.0.trial082.stdout:990: snap_create 2026-02-12T17:33:08.037 INFO:tasks.rados.rados.0.trial082.stdout:989: finishing write tid 1 to trial08226312-21 2026-02-12T17:33:08.037 INFO:tasks.rados.rados.0.trial082.stdout:988: expect (ObjNum 338 snap 102 seq_num 338) 2026-02-12T17:33:08.063 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:08.090 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:08.117 INFO:tasks.rados.rados.0.trial082.stdout:987: finishing copy_from racing read to trial08226312-3 2026-02-12T17:33:08.117 INFO:tasks.rados.rados.0.trial082.stdout:987: finishing copy_from to trial08226312-3 2026-02-12T17:33:08.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 317 (ObjNum 248 snap 70 seq_num 248) dirty exists 2026-02-12T17:33:08.117 INFO:tasks.rados.rados.0.trial082.stdout:989: finishing write tid 2 to trial08226312-21 2026-02-12T17:33:08.117 INFO:tasks.rados.rados.0.trial082.stdout:989: finishing write tid 3 to trial08226312-21 2026-02-12T17:33:08.117 INFO:tasks.rados.rados.0.trial082.stdout:989: finishing write tid 4 to trial08226312-21 2026-02-12T17:33:08.118 INFO:tasks.rados.rados.0.trial082.stdout:989: finishing write tid 5 to trial08226312-21 2026-02-12T17:33:08.118 INFO:tasks.rados.rados.0.trial082.stdout:989: oid 21 updating version 0 to 442 2026-02-12T17:33:08.118 INFO:tasks.rados.rados.0.trial082.stdout:989: oid 21 version 442 is already newer than 441 2026-02-12T17:33:08.118 INFO:tasks.rados.rados.0.trial082.stdout:989: oid 21 updating version 442 to 443 2026-02-12T17:33:08.118 INFO:tasks.rados.rados.0.trial082.stdout:989: oid 21 version 443 is already newer than 440 2026-02-12T17:33:08.118 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 443 (ObjNum 354 snap 105 seq_num 354) dirty exists 2026-02-12T17:33:08.118 INFO:tasks.rados.rados.0.trial082.stdout:989: left oid 21 (ObjNum 354 snap 105 seq_num 354) 2026-02-12T17:33:09.029 INFO:tasks.rados.rados.0.trial082.stdout:987: done (3 left) 2026-02-12T17:33:09.030 INFO:tasks.rados.rados.0.trial082.stdout:988: done (2 left) 2026-02-12T17:33:09.030 INFO:tasks.rados.rados.0.trial082.stdout:989: done (1 left) 2026-02-12T17:33:09.030 INFO:tasks.rados.rados.0.trial082.stdout:990: done (0 left) 2026-02-12T17:33:09.030 INFO:tasks.rados.rados.0.trial082.stdout:991: copy_from oid 4 from oid 5 current snap is 106 2026-02-12T17:33:09.030 INFO:tasks.rados.rados.0.trial082.stdout:992: write (excl) oid 24 current snap is 106 2026-02-12T17:33:09.030 INFO:tasks.rados.rados.0.trial082.stdout:992: seq_num 355 ranges {766485=465633,1990637=647776,3299280=667205} 2026-02-12T17:33:09.034 INFO:tasks.rados.rados.0.trial082.stdout:992: writing trial08226312-24 from 766485 to 1232118 tid 1 2026-02-12T17:33:09.039 INFO:tasks.rados.rados.0.trial082.stdout:992: writing trial08226312-24 from 1990637 to 2638413 tid 2 2026-02-12T17:33:09.045 INFO:tasks.rados.rados.0.trial082.stdout:992: writing trial08226312-24 from 3299280 to 3966485 tid 3 2026-02-12T17:33:09.045 INFO:tasks.rados.rados.0.trial082.stdout:993: write oid 30 current snap is 106 2026-02-12T17:33:09.045 INFO:tasks.rados.rados.0.trial082.stdout:991: finishing copy_from racing read to trial08226312-4 2026-02-12T17:33:09.045 INFO:tasks.rados.rados.0.trial082.stdout:991: finishing copy_from to trial08226312-4 2026-02-12T17:33:09.045 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 417 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:33:09.045 INFO:tasks.rados.rados.0.trial082.stdout:992: finishing write tid 1 to trial08226312-24 2026-02-12T17:33:09.045 INFO:tasks.rados.rados.0.trial082.stdout:992: finishing write tid 2 to trial08226312-24 2026-02-12T17:33:09.045 INFO:tasks.rados.rados.0.trial082.stdout:993: seq_num 356 ranges {783292=540882,1932766=507787,3210350=572013} 2026-02-12T17:33:09.049 INFO:tasks.rados.rados.0.trial082.stdout:993: writing trial08226312-30 from 783292 to 1324174 tid 1 2026-02-12T17:33:09.053 INFO:tasks.rados.rados.0.trial082.stdout:993: writing trial08226312-30 from 1932766 to 2440553 tid 2 2026-02-12T17:33:09.059 INFO:tasks.rados.rados.0.trial082.stdout:993: writing trial08226312-30 from 3210350 to 3782363 tid 3 2026-02-12T17:33:09.059 INFO:tasks.rados.rados.0.trial082.stdout:991: done (2 left) 2026-02-12T17:33:09.059 INFO:tasks.rados.rados.0.trial082.stdout:994: delete oid 40 current snap is 106 2026-02-12T17:33:09.059 INFO:tasks.rados.rados.0.trial082.stdout:992: finishing write tid 3 to trial08226312-24 2026-02-12T17:33:09.059 INFO:tasks.rados.rados.0.trial082.stdout:992: finishing write tid 4 to trial08226312-24 2026-02-12T17:33:09.059 INFO:tasks.rados.rados.0.trial082.stdout:992: finishing write tid 5 to trial08226312-24 2026-02-12T17:33:09.059 INFO:tasks.rados.rados.0.trial082.stdout:992: oid 24 updating version 0 to 632 2026-02-12T17:33:09.060 INFO:tasks.rados.rados.0.trial082.stdout:992: oid 24 updating version 632 to 633 2026-02-12T17:33:09.060 INFO:tasks.rados.rados.0.trial082.stdout:992: oid 24 version 633 is already newer than 630 2026-02-12T17:33:09.060 INFO:tasks.rados.rados.0.trial082.stdout:992: oid 24 version 633 is already newer than 631 2026-02-12T17:33:09.060 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 633 (ObjNum 355 snap 106 seq_num 355) dirty exists 2026-02-12T17:33:09.060 INFO:tasks.rados.rados.0.trial082.stdout:992: left oid 24 (ObjNum 355 snap 106 seq_num 355) 2026-02-12T17:33:09.060 INFO:tasks.rados.rados.0.trial082.stdout:993: finishing write tid 1 to trial08226312-30 2026-02-12T17:33:09.060 INFO:tasks.rados.rados.0.trial082.stdout:993: finishing write tid 2 to trial08226312-30 2026-02-12T17:33:09.061 INFO:tasks.rados.rados.0.trial082.stdout:993: finishing write tid 3 to trial08226312-30 2026-02-12T17:33:09.061 INFO:tasks.rados.rados.0.trial082.stdout:993: finishing write tid 4 to trial08226312-30 2026-02-12T17:33:09.061 INFO:tasks.rados.rados.0.trial082.stdout:993: finishing write tid 5 to trial08226312-30 2026-02-12T17:33:09.061 INFO:tasks.rados.rados.0.trial082.stdout:993: oid 30 updating version 0 to 448 2026-02-12T17:33:09.061 INFO:tasks.rados.rados.0.trial082.stdout:993: oid 30 version 448 is already newer than 447 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:993: oid 30 version 448 is already newer than 446 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:993: oid 30 version 448 is already newer than 445 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 448 (ObjNum 356 snap 106 seq_num 356) dirty exists 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:993: left oid 30 (ObjNum 356 snap 106 seq_num 356) 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:992: done (2 left) 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:993: done (1 left) 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:994: done (0 left) 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:995: copy_from oid 42 from oid 15 current snap is 106 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:996: delete oid 8 current snap is 106 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:995: finishing copy_from to trial08226312-42 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:995: got expected ENOENT (src dne) 2026-02-12T17:33:09.062 INFO:tasks.rados.rados.0.trial082.stdout:995: finishing copy_from racing read to trial08226312-42 2026-02-12T17:33:09.063 INFO:tasks.rados.rados.0.trial082.stdout:995: done (1 left) 2026-02-12T17:33:09.063 INFO:tasks.rados.rados.0.trial082.stdout:996: done (0 left) 2026-02-12T17:33:09.063 INFO:tasks.rados.rados.0.trial082.stdout:997: copy_from oid 26 from oid 32 current snap is 106 2026-02-12T17:33:09.063 INFO:tasks.rados.rados.0.trial082.stdout:998: snap_create 2026-02-12T17:33:09.070 INFO:tasks.rados.rados.0.trial082.stdout:997: finishing copy_from racing read to trial08226312-26 2026-02-12T17:33:09.073 INFO:tasks.rados.rados.0.trial082.stdout:997: finishing copy_from to trial08226312-26 2026-02-12T17:33:09.073 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 258 (ObjNum 343 snap 103 seq_num 343) dirty exists 2026-02-12T17:33:10.034 INFO:tasks.rados.rados.0.trial082.stdout:997: done (1 left) 2026-02-12T17:33:10.034 INFO:tasks.rados.rados.0.trial082.stdout:998: done (0 left) 2026-02-12T17:33:10.034 INFO:tasks.rados.rados.0.trial082.stdout:999: copy_from oid 1 from oid 48 current snap is 107 2026-02-12T17:33:10.034 INFO:tasks.rados.rados.0.trial082.stdout:1000: snap_create 2026-02-12T17:33:10.044 INFO:tasks.rados.rados.0.trial082.stdout:999: finishing copy_from racing read to trial08226312-1 2026-02-12T17:33:10.045 INFO:tasks.rados.rados.0.trial082.stdout:999: finishing copy_from to trial08226312-1 2026-02-12T17:33:10.045 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 60 (ObjNum 218 snap 59 seq_num 218) dirty exists 2026-02-12T17:33:11.035 INFO:tasks.rados.rados.0.trial082.stdout:999: done (1 left) 2026-02-12T17:33:11.035 INFO:tasks.rados.rados.0.trial082.stdout:1000: done (0 left) 2026-02-12T17:33:11.035 INFO:tasks.rados.rados.0.trial082.stdout:1001: write (excl) oid 16 current snap is 108 2026-02-12T17:33:11.035 INFO:tasks.rados.rados.0.trial082.stdout:1001: seq_num 359 ranges {433713=482982,1424565=609148} 2026-02-12T17:33:11.039 INFO:tasks.rados.rados.0.trial082.stdout:1001: writing trial08226312-16 from 433713 to 916695 tid 1 2026-02-12T17:33:11.043 INFO:tasks.rados.rados.0.trial082.stdout:1001: writing trial08226312-16 from 1424565 to 2033713 tid 2 2026-02-12T17:33:11.043 INFO:tasks.rados.rados.0.trial082.stdout:1002: snap_remove snap 101 2026-02-12T17:33:12.039 INFO:tasks.rados.rados.0.trial082.stdout:1002: done (1 left) 2026-02-12T17:33:12.039 INFO:tasks.rados.rados.0.trial082.stdout:1003: write (excl) oid 46 current snap is 108 2026-02-12T17:33:12.039 INFO:tasks.rados.rados.0.trial082.stdout:1003: seq_num 360 ranges {450520=558231,1483047=515125} 2026-02-12T17:33:12.042 INFO:tasks.rados.rados.0.trial082.stdout:1003: writing trial08226312-46 from 450520 to 1008751 tid 1 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1003: writing trial08226312-46 from 1483047 to 1998172 tid 2 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1004: snap_remove snap 104 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1001: finishing write tid 1 to trial08226312-16 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1001: finishing write tid 2 to trial08226312-16 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1001: finishing write tid 3 to trial08226312-16 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1001: finishing write tid 4 to trial08226312-16 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1001: oid 16 updating version 0 to 615 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1001: oid 16 version 615 is already newer than 614 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1001: oid 16 updating version 615 to 616 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 616 (ObjNum 359 snap 108 seq_num 359) dirty exists 2026-02-12T17:33:12.047 INFO:tasks.rados.rados.0.trial082.stdout:1001: left oid 16 (ObjNum 359 snap 108 seq_num 359) 2026-02-12T17:33:12.048 INFO:tasks.rados.rados.0.trial082.stdout:1003: finishing write tid 1 to trial08226312-46 2026-02-12T17:33:13.027 INFO:tasks.rados.rados.0.trial082.stdout:1001: done (2 left) 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1004: done (1 left) 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1005: read oid 3 snap 103 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1005: expect (ObjNum 324 snap 97 seq_num 324) 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1006: write oid 2 current snap is 108 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1003: finishing write tid 2 to trial08226312-46 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1003: finishing write tid 3 to trial08226312-46 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1003: finishing write tid 4 to trial08226312-46 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1003: oid 46 updating version 0 to 440 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1003: oid 46 updating version 440 to 441 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:1003: oid 46 version 441 is already newer than 439 2026-02-12T17:33:13.028 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 441 (ObjNum 360 snap 108 seq_num 360) dirty exists 2026-02-12T17:33:13.029 INFO:tasks.rados.rados.0.trial082.stdout:1003: left oid 46 (ObjNum 360 snap 108 seq_num 360) 2026-02-12T17:33:13.029 INFO:tasks.rados.rados.0.trial082.stdout:1006: seq_num 361 ranges {467327=633480,1825176=242151} 2026-02-12T17:33:13.031 INFO:tasks.rados.rados.0.trial082.stdout:1006: writing trial08226312-2 from 467327 to 1100807 tid 1 2026-02-12T17:33:13.035 INFO:tasks.rados.rados.0.trial082.stdout:1006: writing trial08226312-2 from 1825176 to 2067327 tid 2 2026-02-12T17:33:13.035 INFO:tasks.rados.rados.0.trial082.stdout:1003: done (2 left) 2026-02-12T17:33:13.035 INFO:tasks.rados.rados.0.trial082.stdout:1007: copy_from oid 13 from oid 23 current snap is 108 2026-02-12T17:33:13.035 INFO:tasks.rados.rados.0.trial082.stdout:1006: finishing write tid 1 to trial08226312-2 2026-02-12T17:33:13.035 INFO:tasks.rados.rados.0.trial082.stdout:1005: expect (ObjNum 324 snap 97 seq_num 324) 2026-02-12T17:33:13.097 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:1006: finishing write tid 2 to trial08226312-2 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:1006: finishing write tid 3 to trial08226312-2 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:1006: finishing write tid 4 to trial08226312-2 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:1006: oid 2 updating version 0 to 265 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:1006: oid 2 version 265 is already newer than 264 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:1006: oid 2 updating version 265 to 266 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 266 (ObjNum 361 snap 108 seq_num 361) dirty exists 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:1006: left oid 2 (ObjNum 361 snap 108 seq_num 361) 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:1007: finishing copy_from racing read to trial08226312-13 2026-02-12T17:33:13.135 INFO:tasks.rados.rados.0.trial082.stdout:1007: finishing copy_from to trial08226312-13 2026-02-12T17:33:13.136 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 424 (ObjNum 338 snap 102 seq_num 338) dirty exists 2026-02-12T17:33:13.136 INFO:tasks.rados.rados.0.trial082.stdout:1005: done (2 left) 2026-02-12T17:33:13.136 INFO:tasks.rados.rados.0.trial082.stdout:1006: done (1 left) 2026-02-12T17:33:13.136 INFO:tasks.rados.rados.0.trial082.stdout:1007: done (0 left) 2026-02-12T17:33:13.136 INFO:tasks.rados.rados.0.trial082.stdout:1008: write (excl) oid 10 current snap is 108 2026-02-12T17:33:13.136 INFO:tasks.rados.rados.0.trial082.stdout:1008: seq_num 362 ranges {484134=708729,1883658=200476} 2026-02-12T17:33:13.139 INFO:tasks.rados.rados.0.trial082.stdout:1008: writing trial08226312-10 from 484134 to 1192863 tid 1 2026-02-12T17:33:13.142 INFO:tasks.rados.rados.0.trial082.stdout:1008: writing trial08226312-10 from 1883658 to 2084134 tid 2 2026-02-12T17:33:13.143 INFO:tasks.rados.rados.0.trial082.stdout:1009: delete oid 20 current snap is 108 2026-02-12T17:33:13.143 INFO:tasks.rados.rados.0.trial082.stdout:1008: finishing write tid 1 to trial08226312-10 2026-02-12T17:33:13.144 INFO:tasks.rados.rados.0.trial082.stdout:1008: finishing write tid 2 to trial08226312-10 2026-02-12T17:33:13.144 INFO:tasks.rados.rados.0.trial082.stdout:1008: finishing write tid 3 to trial08226312-10 2026-02-12T17:33:13.144 INFO:tasks.rados.rados.0.trial082.stdout:1008: finishing write tid 4 to trial08226312-10 2026-02-12T17:33:13.144 INFO:tasks.rados.rados.0.trial082.stdout:1008: oid 10 updating version 0 to 462 2026-02-12T17:33:13.144 INFO:tasks.rados.rados.0.trial082.stdout:1008: oid 10 version 462 is already newer than 461 2026-02-12T17:33:13.144 INFO:tasks.rados.rados.0.trial082.stdout:1008: oid 10 updating version 462 to 463 2026-02-12T17:33:13.144 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 463 (ObjNum 362 snap 108 seq_num 362) dirty exists 2026-02-12T17:33:13.145 INFO:tasks.rados.rados.0.trial082.stdout:1008: left oid 10 (ObjNum 362 snap 108 seq_num 362) 2026-02-12T17:33:13.145 INFO:tasks.rados.rados.0.trial082.stdout:1008: done (1 left) 2026-02-12T17:33:13.145 INFO:tasks.rados.rados.0.trial082.stdout:1009: done (0 left) 2026-02-12T17:33:13.145 INFO:tasks.rados.rados.0.trial082.stdout:1010: write oid 50 current snap is 108 2026-02-12T17:33:13.145 INFO:tasks.rados.rados.0.trial082.stdout:1010: seq_num 364 ranges {517748=459227,1600622=406110} 2026-02-12T17:33:13.147 INFO:tasks.rados.rados.0.trial082.stdout:1010: writing trial08226312-50 from 517748 to 976975 tid 1 2026-02-12T17:33:13.151 INFO:tasks.rados.rados.0.trial082.stdout:1010: writing trial08226312-50 from 1600622 to 2006732 tid 2 2026-02-12T17:33:13.152 INFO:tasks.rados.rados.0.trial082.stdout:1011: write (excl) oid 32 current snap is 108 2026-02-12T17:33:13.152 INFO:tasks.rados.rados.0.trial082.stdout:1011: seq_num 365 ranges {534555=650829,1659104=475451} 2026-02-12T17:33:13.156 INFO:tasks.rados.rados.0.trial082.stdout:1011: writing trial08226312-32 from 534555 to 1185384 tid 1 2026-02-12T17:33:13.160 INFO:tasks.rados.rados.0.trial082.stdout:1011: writing trial08226312-32 from 1659104 to 2134555 tid 2 2026-02-12T17:33:13.160 INFO:tasks.rados.rados.0.trial082.stdout:1012: write oid 16 current snap is 108 2026-02-12T17:33:13.160 INFO:tasks.rados.rados.0.trial082.stdout:1012: seq_num 366 ranges {551362=726078,1717586=409779} 2026-02-12T17:33:13.164 INFO:tasks.rados.rados.0.trial082.stdout:1012: writing trial08226312-16 from 551362 to 1277440 tid 1 2026-02-12T17:33:13.168 INFO:tasks.rados.rados.0.trial082.stdout:1012: writing trial08226312-16 from 1717586 to 2127365 tid 2 2026-02-12T17:33:13.168 INFO:tasks.rados.rados.0.trial082.stdout:1013: read oid 6 snap 89 2026-02-12T17:33:13.168 INFO:tasks.rados.rados.0.trial082.stdout:1013: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:1014: rollback oid 38 current snap is 108 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 95 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:1010: finishing write tid 1 to trial08226312-50 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:1010: finishing write tid 2 to trial08226312-50 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:1010: finishing write tid 3 to trial08226312-50 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:1010: finishing write tid 4 to trial08226312-50 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:1010: oid 50 updating version 0 to 214 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:1010: oid 50 updating version 214 to 216 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:1010: oid 50 version 216 is already newer than 215 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 216 (ObjNum 364 snap 108 seq_num 364) dirty exists 2026-02-12T17:33:13.169 INFO:tasks.rados.rados.0.trial082.stdout:1010: left oid 50 (ObjNum 364 snap 108 seq_num 364) 2026-02-12T17:33:13.170 INFO:tasks.rados.rados.0.trial082.stdout:1011: finishing write tid 1 to trial08226312-32 2026-02-12T17:33:13.170 INFO:tasks.rados.rados.0.trial082.stdout:1011: finishing write tid 2 to trial08226312-32 2026-02-12T17:33:13.170 INFO:tasks.rados.rados.0.trial082.stdout:1011: finishing write tid 3 to trial08226312-32 2026-02-12T17:33:13.170 INFO:tasks.rados.rados.0.trial082.stdout:1010: done (4 left) 2026-02-12T17:33:13.170 INFO:tasks.rados.rados.0.trial082.stdout:1015: read oid 20 snap -1 2026-02-12T17:33:13.170 INFO:tasks.rados.rados.0.trial082.stdout:1015: expect deleted 2026-02-12T17:33:13.170 INFO:tasks.rados.rados.0.trial082.stdout:1016: snap_remove snap 105 2026-02-12T17:33:14.044 INFO:tasks.rados.rados.0.trial082.stdout:1016: done (5 left) 2026-02-12T17:33:14.044 INFO:tasks.rados.rados.0.trial082.stdout:1017: write (excl) oid 42 current snap is 108 2026-02-12T17:33:14.044 INFO:tasks.rados.rados.0.trial082.stdout:1017: seq_num 367 ranges {568169=401327,1376068=669790} 2026-02-12T17:33:14.047 INFO:tasks.rados.rados.0.trial082.stdout:1017: writing trial08226312-42 from 568169 to 969496 tid 1 2026-02-12T17:33:14.053 INFO:tasks.rados.rados.0.trial082.stdout:1017: writing trial08226312-42 from 1376068 to 2045858 tid 2 2026-02-12T17:33:14.053 INFO:tasks.rados.rados.0.trial082.stdout:1018: rollback oid 14 current snap is 108 2026-02-12T17:33:14.053 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 14 to 102 2026-02-12T17:33:14.053 INFO:tasks.rados.rados.0.trial082.stdout:1011: finishing write tid 4 to trial08226312-32 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1011: oid 32 updating version 0 to 266 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1011: oid 32 updating version 266 to 268 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1011: oid 32 version 268 is already newer than 267 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 268 (ObjNum 365 snap 108 seq_num 365) dirty exists 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1011: left oid 32 (ObjNum 365 snap 108 seq_num 365) 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1012: finishing write tid 1 to trial08226312-16 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1012: finishing write tid 2 to trial08226312-16 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1012: finishing write tid 3 to trial08226312-16 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1012: finishing write tid 4 to trial08226312-16 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1012: oid 16 updating version 0 to 623 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1012: oid 16 updating version 623 to 625 2026-02-12T17:33:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1012: oid 16 version 625 is already newer than 624 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 625 (ObjNum 366 snap 108 seq_num 366) dirty exists 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1012: left oid 16 (ObjNum 366 snap 108 seq_num 366) 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1014: finishing rollback tid 0 to trial08226312-38 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1014: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1011: done (6 left) 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1012: done (5 left) 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1015: done (4 left) 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1019: read oid 19 snap 88 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1019: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1020: rollback oid 10 current snap is 108 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 10 to 95 2026-02-12T17:33:14.055 INFO:tasks.rados.rados.0.trial082.stdout:1014: finishing rollback tid 2 to trial08226312-38 2026-02-12T17:33:14.056 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 272 (ObjNum 292 snap 82 seq_num 292) dirty exists 2026-02-12T17:33:14.056 INFO:tasks.rados.rados.0.trial082.stdout:1013: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-12T17:33:14.056 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:14.075 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 870445 2026-02-12T17:33:14.101 INFO:tasks.rados.rados.0.trial082.stdout:1017: finishing write tid 1 to trial08226312-42 2026-02-12T17:33:14.101 INFO:tasks.rados.rados.0.trial082.stdout:1013: done (5 left) 2026-02-12T17:33:14.101 INFO:tasks.rados.rados.0.trial082.stdout:1014: done (4 left) 2026-02-12T17:33:14.101 INFO:tasks.rados.rados.0.trial082.stdout:1021: write (excl) oid 16 current snap is 108 2026-02-12T17:33:14.101 INFO:tasks.rados.rados.0.trial082.stdout:1021: seq_num 368 ranges {584976=476576,1834550=350426} 2026-02-12T17:33:14.105 INFO:tasks.rados.rados.0.trial082.stdout:1021: writing trial08226312-16 from 584976 to 1061552 tid 1 2026-02-12T17:33:14.109 INFO:tasks.rados.rados.0.trial082.stdout:1021: writing trial08226312-16 from 1834550 to 2184976 tid 2 2026-02-12T17:33:14.110 INFO:tasks.rados.rados.0.trial082.stdout:1022: snap_create 2026-02-12T17:33:14.110 INFO:tasks.rados.rados.0.trial082.stdout:1020: finishing rollback tid 0 to trial08226312-10 2026-02-12T17:33:14.110 INFO:tasks.rados.rados.0.trial082.stdout:1020: finishing rollback tid 1 to trial08226312-10 2026-02-12T17:33:14.110 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 467 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:33:14.110 INFO:tasks.rados.rados.0.trial082.stdout:1018: finishing rollback tid 0 to trial08226312-14 2026-02-12T17:33:14.110 INFO:tasks.rados.rados.0.trial082.stdout:1018: finishing rollback tid 1 to trial08226312-14 2026-02-12T17:33:14.110 INFO:tasks.rados.rados.0.trial082.stdout:1019: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:33:14.196 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:14.242 INFO:tasks.rados.rados.0.trial082.stdout:1017: finishing write tid 2 to trial08226312-42 2026-02-12T17:33:14.242 INFO:tasks.rados.rados.0.trial082.stdout:1018: finishing rollback tid 2 to trial08226312-14 2026-02-12T17:33:14.242 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 428 (ObjNum 300 snap 85 seq_num 300) dirty exists 2026-02-12T17:33:14.242 INFO:tasks.rados.rados.0.trial082.stdout:1017: finishing write tid 3 to trial08226312-42 2026-02-12T17:33:14.242 INFO:tasks.rados.rados.0.trial082.stdout:1017: finishing write tid 4 to trial08226312-42 2026-02-12T17:33:14.242 INFO:tasks.rados.rados.0.trial082.stdout:1017: oid 42 updating version 0 to 628 2026-02-12T17:33:14.242 INFO:tasks.rados.rados.0.trial082.stdout:1017: oid 42 updating version 628 to 629 2026-02-12T17:33:14.242 INFO:tasks.rados.rados.0.trial082.stdout:1017: oid 42 updating version 629 to 630 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 630 (ObjNum 367 snap 108 seq_num 367) dirty exists 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:1017: left oid 42 (ObjNum 367 snap 108 seq_num 367) 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:1021: finishing write tid 1 to trial08226312-16 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:1021: finishing write tid 2 to trial08226312-16 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:1021: finishing write tid 3 to trial08226312-16 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:1021: finishing write tid 4 to trial08226312-16 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:1021: oid 16 updating version 0 to 632 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:1021: oid 16 version 632 is already newer than 631 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:1021: oid 16 updating version 632 to 633 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 633 (ObjNum 368 snap 108 seq_num 368) dirty exists 2026-02-12T17:33:14.243 INFO:tasks.rados.rados.0.trial082.stdout:1021: left oid 16 (ObjNum 368 snap 108 seq_num 368) 2026-02-12T17:33:15.044 INFO:tasks.rados.rados.0.trial082.stdout:1017: done (5 left) 2026-02-12T17:33:15.044 INFO:tasks.rados.rados.0.trial082.stdout:1018: done (4 left) 2026-02-12T17:33:15.044 INFO:tasks.rados.rados.0.trial082.stdout:1019: done (3 left) 2026-02-12T17:33:15.044 INFO:tasks.rados.rados.0.trial082.stdout:1020: done (2 left) 2026-02-12T17:33:15.044 INFO:tasks.rados.rados.0.trial082.stdout:1021: done (1 left) 2026-02-12T17:33:15.044 INFO:tasks.rados.rados.0.trial082.stdout:1022: done (0 left) 2026-02-12T17:33:15.045 INFO:tasks.rados.rados.0.trial082.stdout:1023: snap_remove snap 89 2026-02-12T17:33:16.044 INFO:tasks.rados.rados.0.trial082.stdout:1023: done (0 left) 2026-02-12T17:33:16.044 INFO:tasks.rados.rados.0.trial082.stdout:1024: snap_create 2026-02-12T17:33:17.045 INFO:tasks.rados.rados.0.trial082.stdout:1024: done (0 left) 2026-02-12T17:33:17.045 INFO:tasks.rados.rados.0.trial082.stdout:1025: snap_remove snap 109 2026-02-12T17:33:18.045 INFO:tasks.rados.rados.0.trial082.stdout:1025: done (0 left) 2026-02-12T17:33:18.046 INFO:tasks.rados.rados.0.trial082.stdout:1026: write (excl) oid 6 current snap is 110 2026-02-12T17:33:18.046 INFO:tasks.rados.rados.0.trial082.stdout:1026: seq_num 369 ranges {601783=551825,1776679=425104} 2026-02-12T17:33:18.050 INFO:tasks.rados.rados.0.trial082.stdout:1026: writing trial08226312-6 from 601783 to 1153608 tid 1 2026-02-12T17:33:18.054 INFO:tasks.rados.rados.0.trial082.stdout:1026: writing trial08226312-6 from 1776679 to 2201783 tid 2 2026-02-12T17:33:18.054 INFO:tasks.rados.rados.0.trial082.stdout:1027: delete oid 27 current snap is 110 2026-02-12T17:33:18.054 INFO:tasks.rados.rados.0.trial082.stdout:1026: finishing write tid 1 to trial08226312-6 2026-02-12T17:33:18.056 INFO:tasks.rados.rados.0.trial082.stdout:1026: finishing write tid 2 to trial08226312-6 2026-02-12T17:33:18.056 INFO:tasks.rados.rados.0.trial082.stdout:1026: finishing write tid 3 to trial08226312-6 2026-02-12T17:33:18.056 INFO:tasks.rados.rados.0.trial082.stdout:1026: finishing write tid 4 to trial08226312-6 2026-02-12T17:33:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1026: oid 6 updating version 0 to 217 2026-02-12T17:33:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1026: oid 6 updating version 217 to 219 2026-02-12T17:33:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1026: oid 6 version 219 is already newer than 218 2026-02-12T17:33:18.057 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 219 (ObjNum 369 snap 110 seq_num 369) dirty exists 2026-02-12T17:33:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1026: left oid 6 (ObjNum 369 snap 110 seq_num 369) 2026-02-12T17:33:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1026: done (1 left) 2026-02-12T17:33:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1027: done (0 left) 2026-02-12T17:33:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1028: snap_remove snap 95 2026-02-12T17:33:19.050 INFO:tasks.rados.rados.0.trial082.stdout:1028: done (0 left) 2026-02-12T17:33:19.050 INFO:tasks.rados.rados.0.trial082.stdout:1029: copy_from oid 12 from oid 17 current snap is 110 2026-02-12T17:33:19.051 INFO:tasks.rados.rados.0.trial082.stdout:1030: delete oid 34 current snap is 110 2026-02-12T17:33:19.053 INFO:tasks.rados.rados.0.trial082.stdout:1030: done (1 left) 2026-02-12T17:33:19.054 INFO:tasks.rados.rados.0.trial082.stdout:1031: write oid 49 current snap is 110 2026-02-12T17:33:19.054 INFO:tasks.rados.rados.0.trial082.stdout:1031: seq_num 372 ranges {652204=777572,1952125=300079} 2026-02-12T17:33:19.059 INFO:tasks.rados.rados.0.trial082.stdout:1031: writing trial08226312-49 from 652204 to 1429776 tid 1 2026-02-12T17:33:19.063 INFO:tasks.rados.rados.0.trial082.stdout:1031: writing trial08226312-49 from 1952125 to 2252204 tid 2 2026-02-12T17:33:19.063 INFO:tasks.rados.rados.0.trial082.stdout:1032: read oid 23 snap 103 2026-02-12T17:33:19.063 INFO:tasks.rados.rados.0.trial082.stdout:1032: expect (ObjNum 338 snap 102 seq_num 338) 2026-02-12T17:33:19.063 INFO:tasks.rados.rados.0.trial082.stdout:1033: snap_create 2026-02-12T17:33:19.063 INFO:tasks.rados.rados.0.trial082.stdout:1029: finishing copy_from racing read to trial08226312-12 2026-02-12T17:33:19.063 INFO:tasks.rados.rados.0.trial082.stdout:1029: finishing copy_from to trial08226312-12 2026-02-12T17:33:19.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 606 (ObjNum 297 snap 83 seq_num 297) dirty exists 2026-02-12T17:33:19.063 INFO:tasks.rados.rados.0.trial082.stdout:1031: finishing write tid 1 to trial08226312-49 2026-02-12T17:33:19.064 INFO:tasks.rados.rados.0.trial082.stdout:1031: finishing write tid 2 to trial08226312-49 2026-02-12T17:33:19.064 INFO:tasks.rados.rados.0.trial082.stdout:1031: finishing write tid 3 to trial08226312-49 2026-02-12T17:33:19.064 INFO:tasks.rados.rados.0.trial082.stdout:1031: finishing write tid 4 to trial08226312-49 2026-02-12T17:33:19.064 INFO:tasks.rados.rados.0.trial082.stdout:1031: oid 49 updating version 0 to 269 2026-02-12T17:33:19.065 INFO:tasks.rados.rados.0.trial082.stdout:1031: oid 49 version 269 is already newer than 267 2026-02-12T17:33:19.065 INFO:tasks.rados.rados.0.trial082.stdout:1031: oid 49 version 269 is already newer than 268 2026-02-12T17:33:19.065 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 269 (ObjNum 372 snap 110 seq_num 372) dirty exists 2026-02-12T17:33:19.065 INFO:tasks.rados.rados.0.trial082.stdout:1031: left oid 49 (ObjNum 372 snap 110 seq_num 372) 2026-02-12T17:33:19.065 INFO:tasks.rados.rados.0.trial082.stdout:1032: expect (ObjNum 338 snap 102 seq_num 338) 2026-02-12T17:33:19.119 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 187458 2026-02-12T17:33:20.053 INFO:tasks.rados.rados.0.trial082.stdout:1029: done (3 left) 2026-02-12T17:33:20.053 INFO:tasks.rados.rados.0.trial082.stdout:1031: done (2 left) 2026-02-12T17:33:20.053 INFO:tasks.rados.rados.0.trial082.stdout:1032: done (1 left) 2026-02-12T17:33:20.053 INFO:tasks.rados.rados.0.trial082.stdout:1033: done (0 left) 2026-02-12T17:33:20.053 INFO:tasks.rados.rados.0.trial082.stdout:1034: write oid 1 current snap is 111 2026-02-12T17:33:20.053 INFO:tasks.rados.rados.0.trial082.stdout:1034: seq_num 373 ranges {669011=569174,2010607=258404} 2026-02-12T17:33:20.058 INFO:tasks.rados.rados.0.trial082.stdout:1034: writing trial08226312-1 from 669011 to 1238185 tid 1 2026-02-12T17:33:20.062 INFO:tasks.rados.rados.0.trial082.stdout:1034: writing trial08226312-1 from 2010607 to 2269011 tid 2 2026-02-12T17:33:20.062 INFO:tasks.rados.rados.0.trial082.stdout:1035: delete oid 25 current snap is 111 2026-02-12T17:33:20.062 INFO:tasks.rados.rados.0.trial082.stdout:1034: finishing write tid 1 to trial08226312-1 2026-02-12T17:33:20.063 INFO:tasks.rados.rados.0.trial082.stdout:1034: finishing write tid 2 to trial08226312-1 2026-02-12T17:33:20.063 INFO:tasks.rados.rados.0.trial082.stdout:1034: finishing write tid 3 to trial08226312-1 2026-02-12T17:33:20.063 INFO:tasks.rados.rados.0.trial082.stdout:1034: finishing write tid 4 to trial08226312-1 2026-02-12T17:33:20.063 INFO:tasks.rados.rados.0.trial082.stdout:1034: oid 1 updating version 0 to 63 2026-02-12T17:33:20.064 INFO:tasks.rados.rados.0.trial082.stdout:1034: oid 1 version 63 is already newer than 61 2026-02-12T17:33:20.064 INFO:tasks.rados.rados.0.trial082.stdout:1034: oid 1 version 63 is already newer than 62 2026-02-12T17:33:20.064 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 63 (ObjNum 373 snap 111 seq_num 373) dirty exists 2026-02-12T17:33:20.064 INFO:tasks.rados.rados.0.trial082.stdout:1034: left oid 1 (ObjNum 373 snap 111 seq_num 373) 2026-02-12T17:33:20.064 INFO:tasks.rados.rados.0.trial082.stdout:1034: done (1 left) 2026-02-12T17:33:20.064 INFO:tasks.rados.rados.0.trial082.stdout:1035: done (0 left) 2026-02-12T17:33:20.064 INFO:tasks.rados.rados.0.trial082.stdout:1036: snap_create 2026-02-12T17:33:21.055 INFO:tasks.rados.rados.0.trial082.stdout:1036: done (0 left) 2026-02-12T17:33:21.055 INFO:tasks.rados.rados.0.trial082.stdout:1037: snap_remove snap 102 2026-02-12T17:33:22.056 INFO:tasks.rados.rados.0.trial082.stdout:1037: done (0 left) 2026-02-12T17:33:22.056 INFO:tasks.rados.rados.0.trial082.stdout:1038: delete oid 46 current snap is 112 2026-02-12T17:33:22.061 INFO:tasks.rados.rados.0.trial082.stdout:1038: done (0 left) 2026-02-12T17:33:22.061 INFO:tasks.rados.rados.0.trial082.stdout:1039: rollback oid 30 current snap is 112 2026-02-12T17:33:22.061 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 103 2026-02-12T17:33:22.062 INFO:tasks.rados.rados.0.trial082.stdout:1040: rollback oid 4 current snap is 112 2026-02-12T17:33:22.062 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 4 to 110 2026-02-12T17:33:22.062 INFO:tasks.rados.rados.0.trial082.stdout:1041: write oid 11 current snap is 112 2026-02-12T17:33:22.062 INFO:tasks.rados.rados.0.trial082.stdout:1041: seq_num 376 ranges {719432=794921,2186053=133379} 2026-02-12T17:33:22.067 INFO:tasks.rados.rados.0.trial082.stdout:1041: writing trial08226312-11 from 719432 to 1514353 tid 1 2026-02-12T17:33:22.071 INFO:tasks.rados.rados.0.trial082.stdout:1041: writing trial08226312-11 from 2186053 to 2319432 tid 2 2026-02-12T17:33:22.071 INFO:tasks.rados.rados.0.trial082.stdout:1042: rollback oid 47 current snap is 112 2026-02-12T17:33:22.071 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 47 to 94 2026-02-12T17:33:22.071 INFO:tasks.rados.rados.0.trial082.stdout:1040: finishing rollback tid 0 to trial08226312-4 2026-02-12T17:33:22.071 INFO:tasks.rados.rados.0.trial082.stdout:1040: finishing rollback tid 1 to trial08226312-4 2026-02-12T17:33:22.071 INFO:tasks.rados.rados.0.trial082.stdout:1040: finishing rollback tid 2 to trial08226312-4 2026-02-12T17:33:22.071 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 677 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:33:22.071 INFO:tasks.rados.rados.0.trial082.stdout:1039: finishing rollback tid 0 to trial08226312-30 2026-02-12T17:33:22.071 INFO:tasks.rados.rados.0.trial082.stdout:1039: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:33:22.072 INFO:tasks.rados.rados.0.trial082.stdout:1040: done (3 left) 2026-02-12T17:33:22.072 INFO:tasks.rados.rados.0.trial082.stdout:1043: snap_remove snap 96 2026-02-12T17:33:23.028 INFO:tasks.rados.rados.0.trial082.stdout:1043: done (3 left) 2026-02-12T17:33:23.028 INFO:tasks.rados.rados.0.trial082.stdout:1044: snap_remove snap 106 2026-02-12T17:33:24.030 INFO:tasks.rados.rados.0.trial082.stdout:1044: done (3 left) 2026-02-12T17:33:24.030 INFO:tasks.rados.rados.0.trial082.stdout:1045: write oid 31 current snap is 112 2026-02-12T17:33:24.030 INFO:tasks.rados.rados.0.trial082.stdout:1039: finishing rollback tid 2 to trial08226312-30 2026-02-12T17:33:24.030 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 487 (ObjNum 318 snap 93 seq_num 318) dirty exists 2026-02-12T17:33:24.031 INFO:tasks.rados.rados.0.trial082.stdout:1045: seq_num 377 ranges {736239=470170,1728182=571782} 2026-02-12T17:33:24.035 INFO:tasks.rados.rados.0.trial082.stdout:1045: writing trial08226312-31 from 736239 to 1206409 tid 1 2026-02-12T17:33:24.039 INFO:tasks.rados.rados.0.trial082.stdout:1045: writing trial08226312-31 from 1728182 to 2299964 tid 2 2026-02-12T17:33:24.039 INFO:tasks.rados.rados.0.trial082.stdout:1039: done (3 left) 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1046: copy_from oid 2 from oid 26 current snap is 112 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1041: finishing write tid 1 to trial08226312-11 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1041: finishing write tid 2 to trial08226312-11 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1041: finishing write tid 3 to trial08226312-11 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1041: finishing write tid 4 to trial08226312-11 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1041: oid 11 updating version 0 to 445 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1041: oid 11 version 445 is already newer than 444 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1041: oid 11 version 445 is already newer than 443 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 445 (ObjNum 376 snap 112 seq_num 376) dirty exists 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1041: left oid 11 (ObjNum 376 snap 112 seq_num 376) 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1042: finishing rollback tid 0 to trial08226312-47 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1042: finishing rollback tid 1 to trial08226312-47 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1042: finishing rollback tid 2 to trial08226312-47 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 681 (ObjNum 303 snap 86 seq_num 303) dirty exists 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1045: finishing write tid 1 to trial08226312-31 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1041: done (3 left) 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1042: done (2 left) 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1047: delete oid 34 current snap is 112 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1047: done (2 left) 2026-02-12T17:33:24.040 INFO:tasks.rados.rados.0.trial082.stdout:1048: snap_create 2026-02-12T17:33:24.041 INFO:tasks.rados.rados.0.trial082.stdout:1045: finishing write tid 2 to trial08226312-31 2026-02-12T17:33:24.041 INFO:tasks.rados.rados.0.trial082.stdout:1045: finishing write tid 3 to trial08226312-31 2026-02-12T17:33:24.041 INFO:tasks.rados.rados.0.trial082.stdout:1045: finishing write tid 4 to trial08226312-31 2026-02-12T17:33:24.041 INFO:tasks.rados.rados.0.trial082.stdout:1045: oid 31 updating version 0 to 269 2026-02-12T17:33:24.041 INFO:tasks.rados.rados.0.trial082.stdout:1045: oid 31 updating version 269 to 270 2026-02-12T17:33:24.041 INFO:tasks.rados.rados.0.trial082.stdout:1045: oid 31 version 270 is already newer than 268 2026-02-12T17:33:24.041 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 270 (ObjNum 377 snap 112 seq_num 377) dirty exists 2026-02-12T17:33:24.041 INFO:tasks.rados.rados.0.trial082.stdout:1045: left oid 31 (ObjNum 377 snap 112 seq_num 377) 2026-02-12T17:33:24.048 INFO:tasks.rados.rados.0.trial082.stdout:1046: finishing copy_from racing read to trial08226312-2 2026-02-12T17:33:24.048 INFO:tasks.rados.rados.0.trial082.stdout:1046: finishing copy_from to trial08226312-2 2026-02-12T17:33:24.048 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 258 (ObjNum 343 snap 103 seq_num 343) dirty exists 2026-02-12T17:33:25.030 INFO:tasks.rados.rados.0.trial082.stdout:1045: done (2 left) 2026-02-12T17:33:25.030 INFO:tasks.rados.rados.0.trial082.stdout:1046: done (1 left) 2026-02-12T17:33:25.030 INFO:tasks.rados.rados.0.trial082.stdout:1048: done (0 left) 2026-02-12T17:33:25.030 INFO:tasks.rados.rados.0.trial082.stdout:1049: rollback oid 19 current snap is 113 2026-02-12T17:33:25.030 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 103 2026-02-12T17:33:25.030 INFO:tasks.rados.rados.0.trial082.stdout:1050: write oid 46 current snap is 113 2026-02-12T17:33:25.030 INFO:tasks.rados.rados.0.trial082.stdout:1050: seq_num 379 ranges {769853=620668,1845146=524707} 2026-02-12T17:33:25.036 INFO:tasks.rados.rados.0.trial082.stdout:1050: writing trial08226312-46 from 769853 to 1390521 tid 1 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:1050: writing trial08226312-46 from 1845146 to 2369853 tid 2 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:1051: read oid 33 snap -1 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:1051: expect (ObjNum 316 snap 93 seq_num 316) 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:1052: write oid 41 current snap is 113 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:1049: finishing rollback tid 0 to trial08226312-19 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:1049: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:1049: finishing rollback tid 2 to trial08226312-19 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 701 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:1050: finishing write tid 1 to trial08226312-46 2026-02-12T17:33:25.040 INFO:tasks.rados.rados.0.trial082.stdout:1052: seq_num 380 ranges {786660=695917,1903628=435462} 2026-02-12T17:33:25.046 INFO:tasks.rados.rados.0.trial082.stdout:1052: writing trial08226312-41 from 786660 to 1482577 tid 1 2026-02-12T17:33:25.050 INFO:tasks.rados.rados.0.trial082.stdout:1052: writing trial08226312-41 from 1903628 to 2339090 tid 2 2026-02-12T17:33:25.050 INFO:tasks.rados.rados.0.trial082.stdout:1049: done (3 left) 2026-02-12T17:33:25.050 INFO:tasks.rados.rados.0.trial082.stdout:1053: write oid 48 current snap is 113 2026-02-12T17:33:25.050 INFO:tasks.rados.rados.0.trial082.stdout:1053: seq_num 381 ranges {403467=487519,1562110=579120} 2026-02-12T17:33:25.053 INFO:tasks.rados.rados.0.trial082.stdout:1053: writing trial08226312-48 from 403467 to 890986 tid 1 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1053: writing trial08226312-48 from 1562110 to 2141230 tid 2 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1054: read oid 45 snap -1 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1054: expect deleted 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1055: copy_from oid 23 from oid 5 current snap is 113 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1050: finishing write tid 2 to trial08226312-46 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1050: finishing write tid 3 to trial08226312-46 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1050: finishing write tid 4 to trial08226312-46 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1050: oid 46 updating version 0 to 447 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1050: oid 46 updating version 447 to 448 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1050: oid 46 version 448 is already newer than 446 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 448 (ObjNum 379 snap 113 seq_num 379) dirty exists 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1050: left oid 46 (ObjNum 379 snap 113 seq_num 379) 2026-02-12T17:33:25.058 INFO:tasks.rados.rados.0.trial082.stdout:1051: expect (ObjNum 316 snap 93 seq_num 316) 2026-02-12T17:33:25.083 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:25.115 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1052: finishing write tid 1 to trial08226312-41 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1052: finishing write tid 2 to trial08226312-41 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1052: finishing write tid 3 to trial08226312-41 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1052: finishing write tid 4 to trial08226312-41 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1052: oid 41 updating version 0 to 608 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1052: oid 41 version 608 is already newer than 607 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1052: oid 41 updating version 608 to 609 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 609 (ObjNum 380 snap 113 seq_num 380) dirty exists 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1052: left oid 41 (ObjNum 380 snap 113 seq_num 380) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1053: finishing write tid 1 to trial08226312-48 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1053: finishing write tid 2 to trial08226312-48 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1053: finishing write tid 3 to trial08226312-48 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1053: finishing write tid 4 to trial08226312-48 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1053: oid 48 updating version 0 to 72 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1053: oid 48 updating version 72 to 74 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1053: oid 48 version 74 is already newer than 73 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 74 (ObjNum 381 snap 113 seq_num 381) dirty exists 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1053: left oid 48 (ObjNum 381 snap 113 seq_num 381) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1055: finishing copy_from racing read to trial08226312-23 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1055: finishing copy_from to trial08226312-23 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 417 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1050: done (5 left) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1051: done (4 left) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1052: done (3 left) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1053: done (2 left) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1054: done (1 left) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1055: done (0 left) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1056: read oid 21 snap -1 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1056: expect (ObjNum 354 snap 105 seq_num 354) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1057: read oid 47 snap -1 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1057: expect (ObjNum 303 snap 86 seq_num 303) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1058: read oid 43 snap -1 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1058: expect (ObjNum 340 snap 103 seq_num 340) 2026-02-12T17:33:25.148 INFO:tasks.rados.rados.0.trial082.stdout:1059: snap_remove snap 107 2026-02-12T17:33:26.039 INFO:tasks.rados.rados.0.trial082.stdout:1059: done (3 left) 2026-02-12T17:33:26.040 INFO:tasks.rados.rados.0.trial082.stdout:1060: read oid 28 snap -1 2026-02-12T17:33:26.040 INFO:tasks.rados.rados.0.trial082.stdout:1060: expect (ObjNum 261 snap 76 seq_num 261) 2026-02-12T17:33:26.040 INFO:tasks.rados.rados.0.trial082.stdout:1061: write oid 29 current snap is 113 2026-02-12T17:33:26.040 INFO:tasks.rados.rados.0.trial082.stdout:1061: seq_num 382 ranges {420274=562768,1620592=439131} 2026-02-12T17:33:26.043 INFO:tasks.rados.rados.0.trial082.stdout:1061: writing trial08226312-29 from 420274 to 983042 tid 1 2026-02-12T17:33:26.047 INFO:tasks.rados.rados.0.trial082.stdout:1061: writing trial08226312-29 from 1620592 to 2059723 tid 2 2026-02-12T17:33:26.048 INFO:tasks.rados.rados.0.trial082.stdout:1062: copy_from oid 42 from oid 36 current snap is 113 2026-02-12T17:33:26.048 INFO:tasks.rados.rados.0.trial082.stdout:1063: read oid 6 snap -1 2026-02-12T17:33:26.048 INFO:tasks.rados.rados.0.trial082.stdout:1063: expect (ObjNum 369 snap 110 seq_num 369) 2026-02-12T17:33:26.048 INFO:tasks.rados.rados.0.trial082.stdout:1064: rollback oid 19 current snap is 113 2026-02-12T17:33:26.048 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 99 2026-02-12T17:33:26.048 INFO:tasks.rados.rados.0.trial082.stdout:1056: expect (ObjNum 354 snap 105 seq_num 354) 2026-02-12T17:33:26.058 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2776540 2026-02-12T17:33:26.087 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1782744 2026-02-12T17:33:26.106 INFO:tasks.rados.rados.0.trial082.stdout:1057: expect (ObjNum 303 snap 86 seq_num 303) 2026-02-12T17:33:26.106 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:26.224 INFO:tasks.rados.rados.0.trial082.stdout:1058: expect (ObjNum 340 snap 103 seq_num 340) 2026-02-12T17:33:26.312 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3089841 2026-02-12T17:33:26.321 INFO:tasks.rados.rados.0.trial082.stdout:1060: expect (ObjNum 261 snap 76 seq_num 261) 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1061: finishing write tid 1 to trial08226312-29 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1056: done (7 left) 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1057: done (6 left) 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1058: done (5 left) 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1060: done (4 left) 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1065: delete oid 40 current snap is 113 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1064: finishing rollback tid 0 to trial08226312-19 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1064: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1064: finishing rollback tid 2 to trial08226312-19 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 712 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1061: finishing write tid 2 to trial08226312-29 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1061: finishing write tid 3 to trial08226312-29 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1061: finishing write tid 4 to trial08226312-29 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1061: oid 29 updating version 0 to 223 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1061: oid 29 version 223 is already newer than 222 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1061: oid 29 updating version 223 to 224 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 224 (ObjNum 382 snap 113 seq_num 382) dirty exists 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1061: left oid 29 (ObjNum 382 snap 113 seq_num 382) 2026-02-12T17:33:26.429 INFO:tasks.rados.rados.0.trial082.stdout:1063: expect (ObjNum 369 snap 110 seq_num 369) 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1062: finishing copy_from racing read to trial08226312-42 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1062: finishing copy_from to trial08226312-42 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 301 (ObjNum 244 snap 68 seq_num 244) dirty exists 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1061: done (4 left) 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1062: done (3 left) 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1063: done (2 left) 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1064: done (1 left) 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1065: done (0 left) 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1066: copy_from oid 37 from oid 8 current snap is 113 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1067: write (excl) oid 5 current snap is 113 2026-02-12T17:33:26.489 INFO:tasks.rados.rados.0.trial082.stdout:1067: seq_num 384 ranges {453888=713266,1737556=442800} 2026-02-12T17:33:26.493 INFO:tasks.rados.rados.0.trial082.stdout:1067: writing trial08226312-5 from 453888 to 1167154 tid 1 2026-02-12T17:33:26.498 INFO:tasks.rados.rados.0.trial082.stdout:1067: writing trial08226312-5 from 1737556 to 2180356 tid 2 2026-02-12T17:33:26.498 INFO:tasks.rados.rados.0.trial082.stdout:1068: read oid 39 snap -1 2026-02-12T17:33:26.498 INFO:tasks.rados.rados.0.trial082.stdout:1068: expect deleted 2026-02-12T17:33:26.498 INFO:tasks.rados.rados.0.trial082.stdout:1069: snap_remove snap 108 2026-02-12T17:33:27.043 INFO:tasks.rados.rados.0.trial082.stdout:1069: done (3 left) 2026-02-12T17:33:27.043 INFO:tasks.rados.rados.0.trial082.stdout:1070: rollback oid 22 current snap is 113 2026-02-12T17:33:27.043 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 103 2026-02-12T17:33:27.043 INFO:tasks.rados.rados.0.trial082.stdout:1066: finishing copy_from to trial08226312-37 2026-02-12T17:33:27.043 INFO:tasks.rados.rados.0.trial082.stdout:1066: got expected ENOENT (src dne) 2026-02-12T17:33:27.043 INFO:tasks.rados.rados.0.trial082.stdout:1066: finishing copy_from racing read to trial08226312-37 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1067: finishing write tid 1 to trial08226312-5 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1067: finishing write tid 2 to trial08226312-5 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1067: finishing write tid 3 to trial08226312-5 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1067: finishing write tid 4 to trial08226312-5 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1067: oid 5 updating version 0 to 431 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1067: oid 5 version 431 is already newer than 429 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1067: oid 5 version 431 is already newer than 430 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 431 (ObjNum 384 snap 113 seq_num 384) dirty exists 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1067: left oid 5 (ObjNum 384 snap 113 seq_num 384) 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1066: done (3 left) 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1067: done (2 left) 2026-02-12T17:33:27.044 INFO:tasks.rados.rados.0.trial082.stdout:1068: done (1 left) 2026-02-12T17:33:27.045 INFO:tasks.rados.rados.0.trial082.stdout:1071: snap_remove snap 88 2026-02-12T17:33:28.053 INFO:tasks.rados.rados.0.trial082.stdout:1071: done (1 left) 2026-02-12T17:33:28.053 INFO:tasks.rados.rados.0.trial082.stdout:1072: copy_from oid 23 from oid 48 current snap is 113 2026-02-12T17:33:28.053 INFO:tasks.rados.rados.0.trial082.stdout:1070: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:33:28.054 INFO:tasks.rados.rados.0.trial082.stdout:1070: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:33:28.054 INFO:tasks.rados.rados.0.trial082.stdout:1070: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:33:28.054 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 499 (ObjNum 341 snap 103 seq_num 341) dirty exists 2026-02-12T17:33:28.054 INFO:tasks.rados.rados.0.trial082.stdout:1070: done (1 left) 2026-02-12T17:33:28.054 INFO:tasks.rados.rados.0.trial082.stdout:1073: write oid 2 current snap is 113 2026-02-12T17:33:28.054 INFO:tasks.rados.rados.0.trial082.stdout:1073: seq_num 385 ranges {470695=788515,1679685=586458} 2026-02-12T17:33:28.058 INFO:tasks.rados.rados.0.trial082.stdout:1073: writing trial08226312-2 from 470695 to 1259210 tid 1 2026-02-12T17:33:28.062 INFO:tasks.rados.rados.0.trial082.stdout:1073: writing trial08226312-2 from 1679685 to 2266143 tid 2 2026-02-12T17:33:28.062 INFO:tasks.rados.rados.0.trial082.stdout:1074: snap_remove snap 111 2026-02-12T17:33:29.057 INFO:tasks.rados.rados.0.trial082.stdout:1074: done (2 left) 2026-02-12T17:33:29.057 INFO:tasks.rados.rados.0.trial082.stdout:1075: read oid 6 snap -1 2026-02-12T17:33:29.057 INFO:tasks.rados.rados.0.trial082.stdout:1075: expect (ObjNum 369 snap 110 seq_num 369) 2026-02-12T17:33:29.057 INFO:tasks.rados.rados.0.trial082.stdout:1076: delete oid 47 current snap is 113 2026-02-12T17:33:29.057 INFO:tasks.rados.rados.0.trial082.stdout:1072: finishing copy_from racing read to trial08226312-23 2026-02-12T17:33:29.057 INFO:tasks.rados.rados.0.trial082.stdout:1073: finishing write tid 1 to trial08226312-2 2026-02-12T17:33:29.057 INFO:tasks.rados.rados.0.trial082.stdout:1072: finishing copy_from to trial08226312-23 2026-02-12T17:33:29.058 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 74 (ObjNum 381 snap 113 seq_num 381) dirty exists 2026-02-12T17:33:29.058 INFO:tasks.rados.rados.0.trial082.stdout:1073: finishing write tid 2 to trial08226312-2 2026-02-12T17:33:29.058 INFO:tasks.rados.rados.0.trial082.stdout:1073: finishing write tid 3 to trial08226312-2 2026-02-12T17:33:29.058 INFO:tasks.rados.rados.0.trial082.stdout:1073: finishing write tid 4 to trial08226312-2 2026-02-12T17:33:29.058 INFO:tasks.rados.rados.0.trial082.stdout:1073: oid 2 updating version 0 to 267 2026-02-12T17:33:29.058 INFO:tasks.rados.rados.0.trial082.stdout:1073: oid 2 updating version 267 to 268 2026-02-12T17:33:29.058 INFO:tasks.rados.rados.0.trial082.stdout:1073: oid 2 updating version 268 to 269 2026-02-12T17:33:29.058 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 269 (ObjNum 385 snap 113 seq_num 385) dirty exists 2026-02-12T17:33:29.058 INFO:tasks.rados.rados.0.trial082.stdout:1073: left oid 2 (ObjNum 385 snap 113 seq_num 385) 2026-02-12T17:33:29.059 INFO:tasks.rados.rados.0.trial082.stdout:1075: expect (ObjNum 369 snap 110 seq_num 369) 2026-02-12T17:33:29.114 INFO:tasks.rados.rados.0.trial082.stdout:1072: done (3 left) 2026-02-12T17:33:29.114 INFO:tasks.rados.rados.0.trial082.stdout:1073: done (2 left) 2026-02-12T17:33:29.114 INFO:tasks.rados.rados.0.trial082.stdout:1075: done (1 left) 2026-02-12T17:33:29.114 INFO:tasks.rados.rados.0.trial082.stdout:1076: done (0 left) 2026-02-12T17:33:29.114 INFO:tasks.rados.rados.0.trial082.stdout:1077: read oid 50 snap 103 2026-02-12T17:33:29.114 INFO:tasks.rados.rados.0.trial082.stdout:1077: expect (ObjNum 263 snap 76 seq_num 263) 2026-02-12T17:33:29.114 INFO:tasks.rados.rados.0.trial082.stdout:1078: rollback oid 8 current snap is 113 2026-02-12T17:33:29.114 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 94 2026-02-12T17:33:29.114 INFO:tasks.rados.rados.0.trial082.stdout:1079: snap_remove snap 112 2026-02-12T17:33:31.008 INFO:tasks.rados.rados.0.trial082.stdout:1079: done (2 left) 2026-02-12T17:33:31.008 INFO:tasks.rados.rados.0.trial082.stdout:1080: snap_remove snap 110 2026-02-12T17:33:31.061 INFO:tasks.rados.rados.0.trial082.stdout:1080: done (2 left) 2026-02-12T17:33:31.061 INFO:tasks.rados.rados.0.trial082.stdout:1081: copy_from oid 1 from oid 5 current snap is 113 2026-02-12T17:33:31.061 INFO:tasks.rados.rados.0.trial082.stdout:1078: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:33:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1078: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:33:31.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 740 (ObjNum 308 snap 88 seq_num 308) dirty exists 2026-02-12T17:33:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1077: expect (ObjNum 263 snap 76 seq_num 263) 2026-02-12T17:33:31.062 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:31.103 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1903800 2026-02-12T17:33:31.118 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:31.148 INFO:tasks.rados.rados.0.trial082.stdout:1081: finishing copy_from racing read to trial08226312-1 2026-02-12T17:33:31.149 INFO:tasks.rados.rados.0.trial082.stdout:1077: done (2 left) 2026-02-12T17:33:31.149 INFO:tasks.rados.rados.0.trial082.stdout:1078: done (1 left) 2026-02-12T17:33:31.149 INFO:tasks.rados.rados.0.trial082.stdout:1082: delete oid 44 current snap is 113 2026-02-12T17:33:31.149 INFO:tasks.rados.rados.0.trial082.stdout:1081: finishing copy_from to trial08226312-1 2026-02-12T17:33:31.149 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 431 (ObjNum 384 snap 113 seq_num 384) dirty exists 2026-02-12T17:33:31.150 INFO:tasks.rados.rados.0.trial082.stdout:1081: done (1 left) 2026-02-12T17:33:31.150 INFO:tasks.rados.rados.0.trial082.stdout:1082: done (0 left) 2026-02-12T17:33:31.150 INFO:tasks.rados.rados.0.trial082.stdout:1083: snap_remove snap 103 2026-02-12T17:33:32.064 INFO:tasks.rados.rados.0.trial082.stdout:1083: done (0 left) 2026-02-12T17:33:32.065 INFO:tasks.rados.rados.0.trial082.stdout:1084: read oid 38 snap -1 2026-02-12T17:33:32.065 INFO:tasks.rados.rados.0.trial082.stdout:1084: expect (ObjNum 292 snap 82 seq_num 292) 2026-02-12T17:33:32.065 INFO:tasks.rados.rados.0.trial082.stdout:1085: snap_create 2026-02-12T17:33:32.071 INFO:tasks.rados.rados.0.trial082.stdout:1084: expect (ObjNum 292 snap 82 seq_num 292) 2026-02-12T17:33:32.071 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:32.100 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:33.030 INFO:tasks.rados.rados.0.trial082.stdout:1084: done (1 left) 2026-02-12T17:33:33.030 INFO:tasks.rados.rados.0.trial082.stdout:1085: done (0 left) 2026-02-12T17:33:33.030 INFO:tasks.rados.rados.0.trial082.stdout:1086: write oid 33 current snap is 114 2026-02-12T17:33:33.030 INFO:tasks.rados.rados.0.trial082.stdout:1086: seq_num 388 ranges {521116=730615,1971484=549632} 2026-02-12T17:33:33.034 INFO:tasks.rados.rados.0.trial082.stdout:1086: writing trial08226312-33 from 521116 to 1251731 tid 1 2026-02-12T17:33:33.039 INFO:tasks.rados.rados.0.trial082.stdout:1086: writing trial08226312-33 from 1971484 to 2521116 tid 2 2026-02-12T17:33:33.040 INFO:tasks.rados.rados.0.trial082.stdout:1087: delete oid 40 current snap is 114 2026-02-12T17:33:33.040 INFO:tasks.rados.rados.0.trial082.stdout:1086: finishing write tid 1 to trial08226312-33 2026-02-12T17:33:33.040 INFO:tasks.rados.rados.0.trial082.stdout:1087: done (1 left) 2026-02-12T17:33:33.041 INFO:tasks.rados.rados.0.trial082.stdout:1088: write (excl) oid 43 current snap is 114 2026-02-12T17:33:33.041 INFO:tasks.rados.rados.0.trial082.stdout:1088: seq_num 390 ranges {554730=481113,1572095=737454} 2026-02-12T17:33:33.044 INFO:tasks.rados.rados.0.trial082.stdout:1088: writing trial08226312-43 from 554730 to 1035843 tid 1 2026-02-12T17:33:33.050 INFO:tasks.rados.rados.0.trial082.stdout:1088: writing trial08226312-43 from 1572095 to 2309549 tid 2 2026-02-12T17:33:33.050 INFO:tasks.rados.rados.0.trial082.stdout:1089: snap_create 2026-02-12T17:33:33.050 INFO:tasks.rados.rados.0.trial082.stdout:1086: finishing write tid 2 to trial08226312-33 2026-02-12T17:33:33.050 INFO:tasks.rados.rados.0.trial082.stdout:1086: finishing write tid 3 to trial08226312-33 2026-02-12T17:33:33.050 INFO:tasks.rados.rados.0.trial082.stdout:1086: finishing write tid 4 to trial08226312-33 2026-02-12T17:33:33.051 INFO:tasks.rados.rados.0.trial082.stdout:1086: oid 33 updating version 0 to 611 2026-02-12T17:33:33.051 INFO:tasks.rados.rados.0.trial082.stdout:1086: oid 33 updating version 611 to 612 2026-02-12T17:33:33.051 INFO:tasks.rados.rados.0.trial082.stdout:1086: oid 33 version 612 is already newer than 610 2026-02-12T17:33:33.051 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 612 (ObjNum 388 snap 114 seq_num 388) dirty exists 2026-02-12T17:33:33.051 INFO:tasks.rados.rados.0.trial082.stdout:1086: left oid 33 (ObjNum 388 snap 114 seq_num 388) 2026-02-12T17:33:33.051 INFO:tasks.rados.rados.0.trial082.stdout:1088: finishing write tid 1 to trial08226312-43 2026-02-12T17:33:33.052 INFO:tasks.rados.rados.0.trial082.stdout:1088: finishing write tid 2 to trial08226312-43 2026-02-12T17:33:33.052 INFO:tasks.rados.rados.0.trial082.stdout:1088: finishing write tid 3 to trial08226312-43 2026-02-12T17:33:33.052 INFO:tasks.rados.rados.0.trial082.stdout:1088: finishing write tid 4 to trial08226312-43 2026-02-12T17:33:33.052 INFO:tasks.rados.rados.0.trial082.stdout:1088: oid 43 updating version 0 to 523 2026-02-12T17:33:33.052 INFO:tasks.rados.rados.0.trial082.stdout:1088: oid 43 updating version 523 to 524 2026-02-12T17:33:33.052 INFO:tasks.rados.rados.0.trial082.stdout:1088: oid 43 updating version 524 to 525 2026-02-12T17:33:33.053 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 525 (ObjNum 390 snap 114 seq_num 390) dirty exists 2026-02-12T17:33:33.053 INFO:tasks.rados.rados.0.trial082.stdout:1088: left oid 43 (ObjNum 390 snap 114 seq_num 390) 2026-02-12T17:33:34.033 INFO:tasks.rados.rados.0.trial082.stdout:1086: done (2 left) 2026-02-12T17:33:34.034 INFO:tasks.rados.rados.0.trial082.stdout:1088: done (1 left) 2026-02-12T17:33:34.034 INFO:tasks.rados.rados.0.trial082.stdout:1089: done (0 left) 2026-02-12T17:33:34.034 INFO:tasks.rados.rados.0.trial082.stdout:1090: delete oid 13 current snap is 115 2026-02-12T17:33:34.035 INFO:tasks.rados.rados.0.trial082.stdout:1090: done (0 left) 2026-02-12T17:33:34.035 INFO:tasks.rados.rados.0.trial082.stdout:1091: delete oid 13 current snap is 115 2026-02-12T17:33:34.035 INFO:tasks.rados.rados.0.trial082.stdout:1091: done (0 left) 2026-02-12T17:33:34.035 INFO:tasks.rados.rados.0.trial082.stdout:1092: write (excl) oid 28 current snap is 115 2026-02-12T17:33:34.035 INFO:tasks.rados.rados.0.trial082.stdout:1092: seq_num 393 ranges {605151=706860,2031188=573963} 2026-02-12T17:33:34.040 INFO:tasks.rados.rados.0.trial082.stdout:1092: writing trial08226312-28 from 605151 to 1312011 tid 1 2026-02-12T17:33:34.046 INFO:tasks.rados.rados.0.trial082.stdout:1092: writing trial08226312-28 from 2031188 to 2605151 tid 2 2026-02-12T17:33:34.046 INFO:tasks.rados.rados.0.trial082.stdout:1093: snap_remove snap 114 2026-02-12T17:33:34.046 INFO:tasks.rados.rados.0.trial082.stdout:1092: finishing write tid 1 to trial08226312-28 2026-02-12T17:33:35.035 INFO:tasks.rados.rados.0.trial082.stdout:1093: done (1 left) 2026-02-12T17:33:35.035 INFO:tasks.rados.rados.0.trial082.stdout:1094: snap_create 2026-02-12T17:33:35.035 INFO:tasks.rados.rados.0.trial082.stdout:1092: finishing write tid 2 to trial08226312-28 2026-02-12T17:33:35.035 INFO:tasks.rados.rados.0.trial082.stdout:1092: finishing write tid 3 to trial08226312-28 2026-02-12T17:33:35.035 INFO:tasks.rados.rados.0.trial082.stdout:1092: finishing write tid 4 to trial08226312-28 2026-02-12T17:33:35.035 INFO:tasks.rados.rados.0.trial082.stdout:1092: oid 28 updating version 0 to 687 2026-02-12T17:33:35.036 INFO:tasks.rados.rados.0.trial082.stdout:1092: oid 28 updating version 687 to 688 2026-02-12T17:33:35.036 INFO:tasks.rados.rados.0.trial082.stdout:1092: oid 28 updating version 688 to 689 2026-02-12T17:33:35.036 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 689 (ObjNum 393 snap 115 seq_num 393) dirty exists 2026-02-12T17:33:35.036 INFO:tasks.rados.rados.0.trial082.stdout:1092: left oid 28 (ObjNum 393 snap 115 seq_num 393) 2026-02-12T17:33:36.035 INFO:tasks.rados.rados.0.trial082.stdout:1092: done (1 left) 2026-02-12T17:33:36.035 INFO:tasks.rados.rados.0.trial082.stdout:1094: done (0 left) 2026-02-12T17:33:36.035 INFO:tasks.rados.rados.0.trial082.stdout:1095: copy_from oid 26 from oid 40 current snap is 116 2026-02-12T17:33:36.035 INFO:tasks.rados.rados.0.trial082.stdout:1096: snap_remove snap 113 2026-02-12T17:33:37.035 INFO:tasks.rados.rados.0.trial082.stdout:1096: done (1 left) 2026-02-12T17:33:37.035 INFO:tasks.rados.rados.0.trial082.stdout:1097: delete oid 18 current snap is 116 2026-02-12T17:33:37.035 INFO:tasks.rados.rados.0.trial082.stdout:1095: finishing copy_from to trial08226312-26 2026-02-12T17:33:37.036 INFO:tasks.rados.rados.0.trial082.stdout:1095: got expected ENOENT (src dne) 2026-02-12T17:33:37.036 INFO:tasks.rados.rados.0.trial082.stdout:1095: finishing copy_from racing read to trial08226312-26 2026-02-12T17:33:37.039 INFO:tasks.rados.rados.0.trial082.stdout:1095: done (1 left) 2026-02-12T17:33:37.039 INFO:tasks.rados.rados.0.trial082.stdout:1097: done (0 left) 2026-02-12T17:33:37.039 INFO:tasks.rados.rados.0.trial082.stdout:1098: rollback oid 31 current snap is 116 2026-02-12T17:33:37.039 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 31 to 94 2026-02-12T17:33:37.039 INFO:tasks.rados.rados.0.trial082.stdout:1099: write (excl) oid 24 current snap is 116 2026-02-12T17:33:37.039 INFO:tasks.rados.rados.0.trial082.stdout:1099: seq_num 395 ranges {638765=457358,1748152=604803} 2026-02-12T17:33:37.043 INFO:tasks.rados.rados.0.trial082.stdout:1099: writing trial08226312-24 from 638765 to 1096123 tid 1 2026-02-12T17:33:37.048 INFO:tasks.rados.rados.0.trial082.stdout:1099: writing trial08226312-24 from 1748152 to 2352955 tid 2 2026-02-12T17:33:37.048 INFO:tasks.rados.rados.0.trial082.stdout:1100: delete oid 19 current snap is 116 2026-02-12T17:33:37.048 INFO:tasks.rados.rados.0.trial082.stdout:1098: finishing rollback tid 0 to trial08226312-31 2026-02-12T17:33:37.048 INFO:tasks.rados.rados.0.trial082.stdout:1098: finishing rollback tid 1 to trial08226312-31 2026-02-12T17:33:37.048 INFO:tasks.rados.rados.0.trial082.stdout:1098: finishing rollback tid 2 to trial08226312-31 2026-02-12T17:33:37.048 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 273 (ObjNum 227 snap 61 seq_num 227) dirty exists 2026-02-12T17:33:37.048 INFO:tasks.rados.rados.0.trial082.stdout:1099: finishing write tid 1 to trial08226312-24 2026-02-12T17:33:37.051 INFO:tasks.rados.rados.0.trial082.stdout:1099: finishing write tid 2 to trial08226312-24 2026-02-12T17:33:37.051 INFO:tasks.rados.rados.0.trial082.stdout:1099: finishing write tid 3 to trial08226312-24 2026-02-12T17:33:37.051 INFO:tasks.rados.rados.0.trial082.stdout:1099: finishing write tid 4 to trial08226312-24 2026-02-12T17:33:37.051 INFO:tasks.rados.rados.0.trial082.stdout:1099: oid 24 updating version 0 to 764 2026-02-12T17:33:37.051 INFO:tasks.rados.rados.0.trial082.stdout:1099: oid 24 version 764 is already newer than 763 2026-02-12T17:33:37.051 INFO:tasks.rados.rados.0.trial082.stdout:1099: oid 24 version 764 is already newer than 762 2026-02-12T17:33:37.051 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 764 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:33:37.052 INFO:tasks.rados.rados.0.trial082.stdout:1099: left oid 24 (ObjNum 395 snap 116 seq_num 395) 2026-02-12T17:33:37.052 INFO:tasks.rados.rados.0.trial082.stdout:1098: done (2 left) 2026-02-12T17:33:37.052 INFO:tasks.rados.rados.0.trial082.stdout:1099: done (1 left) 2026-02-12T17:33:37.052 INFO:tasks.rados.rados.0.trial082.stdout:1100: done (0 left) 2026-02-12T17:33:37.052 INFO:tasks.rados.rados.0.trial082.stdout:1101: read oid 15 snap -1 2026-02-12T17:33:37.052 INFO:tasks.rados.rados.0.trial082.stdout:1101: expect deleted 2026-02-12T17:33:37.052 INFO:tasks.rados.rados.0.trial082.stdout:1102: write (excl) oid 25 current snap is 116 2026-02-12T17:33:37.052 INFO:tasks.rados.rados.0.trial082.stdout:1102: seq_num 397 ranges {672379=724209,1865116=608472} 2026-02-12T17:33:37.057 INFO:tasks.rados.rados.0.trial082.stdout:1102: writing trial08226312-25 from 672379 to 1396588 tid 1 2026-02-12T17:33:37.061 INFO:tasks.rados.rados.0.trial082.stdout:1102: writing trial08226312-25 from 1865116 to 2473588 tid 2 2026-02-12T17:33:37.061 INFO:tasks.rados.rados.0.trial082.stdout:1103: copy_from oid 34 from oid 24 current snap is 116 2026-02-12T17:33:37.061 INFO:tasks.rados.rados.0.trial082.stdout:1102: finishing write tid 1 to trial08226312-25 2026-02-12T17:33:37.061 INFO:tasks.rados.rados.0.trial082.stdout:1101: done (2 left) 2026-02-12T17:33:37.061 INFO:tasks.rados.rados.0.trial082.stdout:1104: snap_remove snap 99 2026-02-12T17:33:38.030 INFO:tasks.rados.rados.0.trial082.stdout:1104: done (2 left) 2026-02-12T17:33:38.030 INFO:tasks.rados.rados.0.trial082.stdout:1105: snap_create 2026-02-12T17:33:38.030 INFO:tasks.rados.rados.0.trial082.stdout:1102: finishing write tid 2 to trial08226312-25 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:1102: finishing write tid 3 to trial08226312-25 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:1102: finishing write tid 4 to trial08226312-25 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:1102: oid 25 updating version 0 to 499 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:1102: oid 25 updating version 499 to 501 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:1102: oid 25 version 501 is already newer than 500 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 501 (ObjNum 397 snap 116 seq_num 397) dirty exists 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:1102: left oid 25 (ObjNum 397 snap 116 seq_num 397) 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:1103: finishing copy_from racing read to trial08226312-34 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:1103: finishing copy_from to trial08226312-34 2026-02-12T17:33:38.031 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 764 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:33:39.031 INFO:tasks.rados.rados.0.trial082.stdout:1102: done (2 left) 2026-02-12T17:33:39.032 INFO:tasks.rados.rados.0.trial082.stdout:1103: done (1 left) 2026-02-12T17:33:39.032 INFO:tasks.rados.rados.0.trial082.stdout:1105: done (0 left) 2026-02-12T17:33:39.032 INFO:tasks.rados.rados.0.trial082.stdout:1106: read oid 37 snap -1 2026-02-12T17:33:39.032 INFO:tasks.rados.rados.0.trial082.stdout:1106: expect (ObjNum 292 snap 82 seq_num 292) 2026-02-12T17:33:39.032 INFO:tasks.rados.rados.0.trial082.stdout:1107: write (excl) oid 33 current snap is 117 2026-02-12T17:33:39.032 INFO:tasks.rados.rados.0.trial082.stdout:1107: seq_num 398 ranges {689186=799458,1923598=752130} 2026-02-12T17:33:39.036 INFO:tasks.rados.rados.0.trial082.stdout:1107: writing trial08226312-33 from 689186 to 1488644 tid 1 2026-02-12T17:33:39.041 INFO:tasks.rados.rados.0.trial082.stdout:1107: writing trial08226312-33 from 1923598 to 2675728 tid 2 2026-02-12T17:33:39.041 INFO:tasks.rados.rados.0.trial082.stdout:1108: snap_remove snap 94 2026-02-12T17:33:40.041 INFO:tasks.rados.rados.0.trial082.stdout:1108: done (2 left) 2026-02-12T17:33:40.041 INFO:tasks.rados.rados.0.trial082.stdout:1109: snap_create 2026-02-12T17:33:40.041 INFO:tasks.rados.rados.0.trial082.stdout:1106: expect (ObjNum 292 snap 82 seq_num 292) 2026-02-12T17:33:40.071 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:40.102 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 670814 2026-02-12T17:33:40.126 INFO:tasks.rados.rados.0.trial082.stdout:1107: finishing write tid 1 to trial08226312-33 2026-02-12T17:33:40.126 INFO:tasks.rados.rados.0.trial082.stdout:1107: finishing write tid 2 to trial08226312-33 2026-02-12T17:33:40.127 INFO:tasks.rados.rados.0.trial082.stdout:1107: finishing write tid 3 to trial08226312-33 2026-02-12T17:33:40.127 INFO:tasks.rados.rados.0.trial082.stdout:1107: finishing write tid 4 to trial08226312-33 2026-02-12T17:33:40.127 INFO:tasks.rados.rados.0.trial082.stdout:1107: oid 33 updating version 0 to 613 2026-02-12T17:33:40.127 INFO:tasks.rados.rados.0.trial082.stdout:1107: oid 33 updating version 613 to 615 2026-02-12T17:33:40.127 INFO:tasks.rados.rados.0.trial082.stdout:1107: oid 33 version 615 is already newer than 614 2026-02-12T17:33:40.127 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 615 (ObjNum 398 snap 117 seq_num 398) dirty exists 2026-02-12T17:33:40.127 INFO:tasks.rados.rados.0.trial082.stdout:1107: left oid 33 (ObjNum 398 snap 117 seq_num 398) 2026-02-12T17:33:41.042 INFO:tasks.rados.rados.0.trial082.stdout:1106: done (2 left) 2026-02-12T17:33:41.042 INFO:tasks.rados.rados.0.trial082.stdout:1107: done (1 left) 2026-02-12T17:33:41.043 INFO:tasks.rados.rados.0.trial082.stdout:1109: done (0 left) 2026-02-12T17:33:41.043 INFO:tasks.rados.rados.0.trial082.stdout:1110: copy_from oid 1 from oid 23 current snap is 118 2026-02-12T17:33:41.043 INFO:tasks.rados.rados.0.trial082.stdout:1111: read oid 36 snap -1 2026-02-12T17:33:41.043 INFO:tasks.rados.rados.0.trial082.stdout:1111: expect (ObjNum 244 snap 68 seq_num 244) 2026-02-12T17:33:41.043 INFO:tasks.rados.rados.0.trial082.stdout:1112: snap_create 2026-02-12T17:33:41.045 INFO:tasks.rados.rados.0.trial082.stdout:1111: expect (ObjNum 244 snap 68 seq_num 244) 2026-02-12T17:33:41.088 INFO:tasks.rados.rados.0.trial082.stdout:1110: finishing copy_from racing read to trial08226312-1 2026-02-12T17:33:41.088 INFO:tasks.rados.rados.0.trial082.stdout:1110: finishing copy_from to trial08226312-1 2026-02-12T17:33:41.088 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 74 (ObjNum 381 snap 113 seq_num 381) dirty exists 2026-02-12T17:33:42.043 INFO:tasks.rados.rados.0.trial082.stdout:1110: done (2 left) 2026-02-12T17:33:42.043 INFO:tasks.rados.rados.0.trial082.stdout:1111: done (1 left) 2026-02-12T17:33:42.043 INFO:tasks.rados.rados.0.trial082.stdout:1112: done (0 left) 2026-02-12T17:33:42.043 INFO:tasks.rados.rados.0.trial082.stdout:1113: rollback oid 39 current snap is 119 2026-02-12T17:33:42.043 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 39 to 116 2026-02-12T17:33:42.043 INFO:tasks.rados.rados.0.trial082.stdout:1114: write (excl) oid 43 current snap is 119 2026-02-12T17:33:42.044 INFO:tasks.rados.rados.0.trial082.stdout:1114: seq_num 399 ranges {705993=474707,1582080=612141} 2026-02-12T17:33:42.047 INFO:tasks.rados.rados.0.trial082.stdout:1114: writing trial08226312-43 from 705993 to 1180700 tid 1 2026-02-12T17:33:42.051 INFO:tasks.rados.rados.0.trial082.stdout:1114: writing trial08226312-43 from 1582080 to 2194221 tid 2 2026-02-12T17:33:42.051 INFO:tasks.rados.rados.0.trial082.stdout:1115: delete oid 44 current snap is 119 2026-02-12T17:33:42.051 INFO:tasks.rados.rados.0.trial082.stdout:1113: finishing rollback tid 1 to trial08226312-39 2026-02-12T17:33:42.051 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 0 (ObjNum 33 snap 0 seq_num 25566448) dirty dne 2026-02-12T17:33:42.052 INFO:tasks.rados.rados.0.trial082.stdout:1114: finishing write tid 1 to trial08226312-43 2026-02-12T17:33:42.052 INFO:tasks.rados.rados.0.trial082.stdout:1113: done (2 left) 2026-02-12T17:33:42.052 INFO:tasks.rados.rados.0.trial082.stdout:1115: done (1 left) 2026-02-12T17:33:42.053 INFO:tasks.rados.rados.0.trial082.stdout:1116: rollback oid 27 current snap is 119 2026-02-12T17:33:42.053 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 118 2026-02-12T17:33:42.053 INFO:tasks.rados.rados.0.trial082.stdout:1117: write oid 34 current snap is 119 2026-02-12T17:33:42.053 INFO:tasks.rados.rados.0.trial082.stdout:1117: seq_num 401 ranges {739607=625205,1982691=499457} 2026-02-12T17:33:42.057 INFO:tasks.rados.rados.0.trial082.stdout:1117: writing trial08226312-34 from 739607 to 1364812 tid 1 2026-02-12T17:33:42.062 INFO:tasks.rados.rados.0.trial082.stdout:1117: writing trial08226312-34 from 1982691 to 2482148 tid 2 2026-02-12T17:33:42.062 INFO:tasks.rados.rados.0.trial082.stdout:1118: read oid 44 snap -1 2026-02-12T17:33:42.062 INFO:tasks.rados.rados.0.trial082.stdout:1118: expect deleted 2026-02-12T17:33:42.062 INFO:tasks.rados.rados.0.trial082.stdout:1119: write oid 7 current snap is 119 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1116: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1114: finishing write tid 2 to trial08226312-43 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1114: finishing write tid 3 to trial08226312-43 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1114: finishing write tid 4 to trial08226312-43 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1114: oid 43 updating version 0 to 543 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1114: oid 43 version 543 is already newer than 541 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1114: oid 43 version 543 is already newer than 542 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 543 (ObjNum 399 snap 119 seq_num 399) dirty exists 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1114: left oid 43 (ObjNum 399 snap 119 seq_num 399) 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1117: finishing write tid 1 to trial08226312-34 2026-02-12T17:33:42.063 INFO:tasks.rados.rados.0.trial082.stdout:1119: seq_num 402 ranges {756414=700454,2041173=715241} 2026-02-12T17:33:42.067 INFO:tasks.rados.rados.0.trial082.stdout:1119: writing trial08226312-7 from 756414 to 1456868 tid 1 2026-02-12T17:33:42.072 INFO:tasks.rados.rados.0.trial082.stdout:1119: writing trial08226312-7 from 2041173 to 2756414 tid 2 2026-02-12T17:33:42.072 INFO:tasks.rados.rados.0.trial082.stdout:1114: done (4 left) 2026-02-12T17:33:42.072 INFO:tasks.rados.rados.0.trial082.stdout:1116: done (3 left) 2026-02-12T17:33:42.072 INFO:tasks.rados.rados.0.trial082.stdout:1120: snap_create 2026-02-12T17:33:42.073 INFO:tasks.rados.rados.0.trial082.stdout:1117: finishing write tid 2 to trial08226312-34 2026-02-12T17:33:42.073 INFO:tasks.rados.rados.0.trial082.stdout:1117: finishing write tid 3 to trial08226312-34 2026-02-12T17:33:42.073 INFO:tasks.rados.rados.0.trial082.stdout:1117: finishing write tid 4 to trial08226312-34 2026-02-12T17:33:42.073 INFO:tasks.rados.rados.0.trial082.stdout:1117: oid 34 updating version 0 to 767 2026-02-12T17:33:42.073 INFO:tasks.rados.rados.0.trial082.stdout:1117: oid 34 version 767 is already newer than 766 2026-02-12T17:33:42.073 INFO:tasks.rados.rados.0.trial082.stdout:1117: oid 34 version 767 is already newer than 765 2026-02-12T17:33:42.073 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 767 (ObjNum 401 snap 119 seq_num 401) dirty exists 2026-02-12T17:33:42.073 INFO:tasks.rados.rados.0.trial082.stdout:1117: left oid 34 (ObjNum 401 snap 119 seq_num 401) 2026-02-12T17:33:42.073 INFO:tasks.rados.rados.0.trial082.stdout:1119: finishing write tid 1 to trial08226312-7 2026-02-12T17:33:42.074 INFO:tasks.rados.rados.0.trial082.stdout:1119: finishing write tid 2 to trial08226312-7 2026-02-12T17:33:42.074 INFO:tasks.rados.rados.0.trial082.stdout:1119: finishing write tid 3 to trial08226312-7 2026-02-12T17:33:42.074 INFO:tasks.rados.rados.0.trial082.stdout:1119: finishing write tid 4 to trial08226312-7 2026-02-12T17:33:42.074 INFO:tasks.rados.rados.0.trial082.stdout:1119: oid 7 updating version 0 to 710 2026-02-12T17:33:42.075 INFO:tasks.rados.rados.0.trial082.stdout:1119: oid 7 version 710 is already newer than 708 2026-02-12T17:33:42.075 INFO:tasks.rados.rados.0.trial082.stdout:1119: oid 7 version 710 is already newer than 709 2026-02-12T17:33:42.075 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 710 (ObjNum 402 snap 119 seq_num 402) dirty exists 2026-02-12T17:33:42.075 INFO:tasks.rados.rados.0.trial082.stdout:1119: left oid 7 (ObjNum 402 snap 119 seq_num 402) 2026-02-12T17:33:43.031 INFO:tasks.rados.rados.0.trial082.stdout:1117: done (3 left) 2026-02-12T17:33:43.031 INFO:tasks.rados.rados.0.trial082.stdout:1118: done (2 left) 2026-02-12T17:33:43.031 INFO:tasks.rados.rados.0.trial082.stdout:1119: done (1 left) 2026-02-12T17:33:43.031 INFO:tasks.rados.rados.0.trial082.stdout:1120: done (0 left) 2026-02-12T17:33:43.031 INFO:tasks.rados.rados.0.trial082.stdout:1121: write (excl) oid 14 current snap is 120 2026-02-12T17:33:43.031 INFO:tasks.rados.rados.0.trial082.stdout:1121: seq_num 403 ranges {773221=492056,1816008=503126} 2026-02-12T17:33:43.035 INFO:tasks.rados.rados.0.trial082.stdout:1121: writing trial08226312-14 from 773221 to 1265277 tid 1 2026-02-12T17:33:43.039 INFO:tasks.rados.rados.0.trial082.stdout:1121: writing trial08226312-14 from 1816008 to 2319134 tid 2 2026-02-12T17:33:43.040 INFO:tasks.rados.rados.0.trial082.stdout:1122: snap_create 2026-02-12T17:33:43.040 INFO:tasks.rados.rados.0.trial082.stdout:1121: finishing write tid 1 to trial08226312-14 2026-02-12T17:33:43.041 INFO:tasks.rados.rados.0.trial082.stdout:1121: finishing write tid 2 to trial08226312-14 2026-02-12T17:33:43.041 INFO:tasks.rados.rados.0.trial082.stdout:1121: finishing write tid 3 to trial08226312-14 2026-02-12T17:33:43.041 INFO:tasks.rados.rados.0.trial082.stdout:1121: finishing write tid 4 to trial08226312-14 2026-02-12T17:33:43.041 INFO:tasks.rados.rados.0.trial082.stdout:1121: oid 14 updating version 0 to 433 2026-02-12T17:33:43.042 INFO:tasks.rados.rados.0.trial082.stdout:1121: oid 14 updating version 433 to 434 2026-02-12T17:33:43.042 INFO:tasks.rados.rados.0.trial082.stdout:1121: oid 14 version 434 is already newer than 432 2026-02-12T17:33:43.042 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 434 (ObjNum 403 snap 120 seq_num 403) dirty exists 2026-02-12T17:33:43.042 INFO:tasks.rados.rados.0.trial082.stdout:1121: left oid 14 (ObjNum 403 snap 120 seq_num 403) 2026-02-12T17:33:44.033 INFO:tasks.rados.rados.0.trial082.stdout:1121: done (1 left) 2026-02-12T17:33:44.033 INFO:tasks.rados.rados.0.trial082.stdout:1122: done (0 left) 2026-02-12T17:33:44.033 INFO:tasks.rados.rados.0.trial082.stdout:1123: delete oid 14 current snap is 121 2026-02-12T17:33:44.034 INFO:tasks.rados.rados.0.trial082.stdout:1123: done (0 left) 2026-02-12T17:33:44.034 INFO:tasks.rados.rados.0.trial082.stdout:1124: write (excl) oid 1 current snap is 121 2026-02-12T17:33:44.034 INFO:tasks.rados.rados.0.trial082.stdout:1124: seq_num 405 ranges {406835=642554,1532972=506795,2772312=34523} 2026-02-12T17:33:44.038 INFO:tasks.rados.rados.0.trial082.stdout:1124: writing trial08226312-1 from 406835 to 1049389 tid 1 2026-02-12T17:33:44.042 INFO:tasks.rados.rados.0.trial082.stdout:1124: writing trial08226312-1 from 1532972 to 2039767 tid 2 2026-02-12T17:33:44.045 INFO:tasks.rados.rados.0.trial082.stdout:1124: writing trial08226312-1 from 2772312 to 2806835 tid 3 2026-02-12T17:33:44.045 INFO:tasks.rados.rados.0.trial082.stdout:1125: copy_from oid 11 from oid 27 current snap is 121 2026-02-12T17:33:44.045 INFO:tasks.rados.rados.0.trial082.stdout:1124: finishing write tid 1 to trial08226312-1 2026-02-12T17:33:44.046 INFO:tasks.rados.rados.0.trial082.stdout:1124: finishing write tid 2 to trial08226312-1 2026-02-12T17:33:44.046 INFO:tasks.rados.rados.0.trial082.stdout:1126: copy_from oid 30 from oid 36 current snap is 121 2026-02-12T17:33:44.046 INFO:tasks.rados.rados.0.trial082.stdout:1127: write (excl) oid 24 current snap is 121 2026-02-12T17:33:44.046 INFO:tasks.rados.rados.0.trial082.stdout:1127: seq_num 406 ranges {423642=717803,1875101=766806} 2026-02-12T17:33:44.049 INFO:tasks.rados.rados.0.trial082.stdout:1127: writing trial08226312-24 from 423642 to 1141445 tid 1 2026-02-12T17:33:44.055 INFO:tasks.rados.rados.0.trial082.stdout:1127: writing trial08226312-24 from 1875101 to 2641907 tid 2 2026-02-12T17:33:44.055 INFO:tasks.rados.rados.0.trial082.stdout:1128: read oid 26 snap 117 2026-02-12T17:33:44.055 INFO:tasks.rados.rados.0.trial082.stdout:1128: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:33:44.055 INFO:tasks.rados.rados.0.trial082.stdout:1129: snap_remove snap 118 2026-02-12T17:33:45.036 INFO:tasks.rados.rados.0.trial082.stdout:1129: done (5 left) 2026-02-12T17:33:45.036 INFO:tasks.rados.rados.0.trial082.stdout:1130: read oid 16 snap -1 2026-02-12T17:33:45.036 INFO:tasks.rados.rados.0.trial082.stdout:1130: expect (ObjNum 368 snap 108 seq_num 368) 2026-02-12T17:33:45.036 INFO:tasks.rados.rados.0.trial082.stdout:1131: write oid 6 current snap is 121 2026-02-12T17:33:45.036 INFO:tasks.rados.rados.0.trial082.stdout:1131: seq_num 407 ranges {440449=793052,1933583=510464} 2026-02-12T17:33:45.040 INFO:tasks.rados.rados.0.trial082.stdout:1131: writing trial08226312-6 from 440449 to 1233501 tid 1 2026-02-12T17:33:45.045 INFO:tasks.rados.rados.0.trial082.stdout:1131: writing trial08226312-6 from 1933583 to 2444047 tid 2 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1132: snap_create 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1125: finishing copy_from to trial08226312-11 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1125: got expected ENOENT (src dne) 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1125: finishing copy_from racing read to trial08226312-11 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1124: finishing write tid 3 to trial08226312-1 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1124: finishing write tid 4 to trial08226312-1 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1124: finishing write tid 5 to trial08226312-1 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1124: oid 1 updating version 0 to 435 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1124: oid 1 version 435 is already newer than 433 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1124: oid 1 version 435 is already newer than 434 2026-02-12T17:33:45.046 INFO:tasks.rados.rados.0.trial082.stdout:1124: oid 1 version 435 is already newer than 432 2026-02-12T17:33:45.047 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 435 (ObjNum 405 snap 121 seq_num 405) dirty exists 2026-02-12T17:33:45.047 INFO:tasks.rados.rados.0.trial082.stdout:1124: left oid 1 (ObjNum 405 snap 121 seq_num 405) 2026-02-12T17:33:45.047 INFO:tasks.rados.rados.0.trial082.stdout:1126: finishing copy_from racing read to trial08226312-30 2026-02-12T17:33:45.047 INFO:tasks.rados.rados.0.trial082.stdout:1126: finishing copy_from to trial08226312-30 2026-02-12T17:33:45.047 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 301 (ObjNum 244 snap 68 seq_num 244) dirty exists 2026-02-12T17:33:45.047 INFO:tasks.rados.rados.0.trial082.stdout:1127: finishing write tid 1 to trial08226312-24 2026-02-12T17:33:45.047 INFO:tasks.rados.rados.0.trial082.stdout:1128: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:33:45.047 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:45.150 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2345900 2026-02-12T17:33:45.174 INFO:tasks.rados.rados.0.trial082.stdout:1127: finishing write tid 2 to trial08226312-24 2026-02-12T17:33:45.174 INFO:tasks.rados.rados.0.trial082.stdout:1127: finishing write tid 3 to trial08226312-24 2026-02-12T17:33:45.174 INFO:tasks.rados.rados.0.trial082.stdout:1127: finishing write tid 4 to trial08226312-24 2026-02-12T17:33:45.174 INFO:tasks.rados.rados.0.trial082.stdout:1127: oid 24 updating version 0 to 794 2026-02-12T17:33:45.174 INFO:tasks.rados.rados.0.trial082.stdout:1127: oid 24 version 794 is already newer than 793 2026-02-12T17:33:45.174 INFO:tasks.rados.rados.0.trial082.stdout:1127: oid 24 version 794 is already newer than 792 2026-02-12T17:33:45.174 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 794 (ObjNum 406 snap 121 seq_num 406) dirty exists 2026-02-12T17:33:45.174 INFO:tasks.rados.rados.0.trial082.stdout:1127: left oid 24 (ObjNum 406 snap 121 seq_num 406) 2026-02-12T17:33:45.174 INFO:tasks.rados.rados.0.trial082.stdout:1130: expect (ObjNum 368 snap 108 seq_num 368) 2026-02-12T17:33:45.182 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1261253 2026-02-12T17:33:45.196 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 21401 2026-02-12T17:33:45.224 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 467666 2026-02-12T17:33:45.247 INFO:tasks.rados.rados.0.trial082.stdout:1131: finishing write tid 1 to trial08226312-6 2026-02-12T17:33:45.247 INFO:tasks.rados.rados.0.trial082.stdout:1131: finishing write tid 2 to trial08226312-6 2026-02-12T17:33:45.247 INFO:tasks.rados.rados.0.trial082.stdout:1131: finishing write tid 3 to trial08226312-6 2026-02-12T17:33:45.247 INFO:tasks.rados.rados.0.trial082.stdout:1131: finishing write tid 4 to trial08226312-6 2026-02-12T17:33:45.247 INFO:tasks.rados.rados.0.trial082.stdout:1131: oid 6 updating version 0 to 253 2026-02-12T17:33:45.248 INFO:tasks.rados.rados.0.trial082.stdout:1131: oid 6 updating version 253 to 254 2026-02-12T17:33:45.248 INFO:tasks.rados.rados.0.trial082.stdout:1131: oid 6 version 254 is already newer than 252 2026-02-12T17:33:45.248 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 254 (ObjNum 407 snap 121 seq_num 407) dirty exists 2026-02-12T17:33:45.248 INFO:tasks.rados.rados.0.trial082.stdout:1131: left oid 6 (ObjNum 407 snap 121 seq_num 407) 2026-02-12T17:33:46.039 INFO:tasks.rados.rados.0.trial082.stdout:1124: done (7 left) 2026-02-12T17:33:46.039 INFO:tasks.rados.rados.0.trial082.stdout:1125: done (6 left) 2026-02-12T17:33:46.039 INFO:tasks.rados.rados.0.trial082.stdout:1126: done (5 left) 2026-02-12T17:33:46.039 INFO:tasks.rados.rados.0.trial082.stdout:1127: done (4 left) 2026-02-12T17:33:46.039 INFO:tasks.rados.rados.0.trial082.stdout:1128: done (3 left) 2026-02-12T17:33:46.039 INFO:tasks.rados.rados.0.trial082.stdout:1130: done (2 left) 2026-02-12T17:33:46.039 INFO:tasks.rados.rados.0.trial082.stdout:1131: done (1 left) 2026-02-12T17:33:46.039 INFO:tasks.rados.rados.0.trial082.stdout:1132: done (0 left) 2026-02-12T17:33:46.039 INFO:tasks.rados.rados.0.trial082.stdout:1133: write (excl) oid 46 current snap is 122 2026-02-12T17:33:46.040 INFO:tasks.rados.rados.0.trial082.stdout:1133: seq_num 408 ranges {457256=468301,1592065=770475,2854581=2675} 2026-02-12T17:33:46.042 INFO:tasks.rados.rados.0.trial082.stdout:1133: writing trial08226312-46 from 457256 to 925557 tid 1 2026-02-12T17:33:46.047 INFO:tasks.rados.rados.0.trial082.stdout:1133: writing trial08226312-46 from 1592065 to 2362540 tid 2 2026-02-12T17:33:46.049 INFO:tasks.rados.rados.0.trial082.stdout:1133: writing trial08226312-46 from 2854581 to 2857256 tid 3 2026-02-12T17:33:46.050 INFO:tasks.rados.rados.0.trial082.stdout:1134: copy_from oid 47 from oid 32 current snap is 122 2026-02-12T17:33:46.050 INFO:tasks.rados.rados.0.trial082.stdout:1133: finishing write tid 1 to trial08226312-46 2026-02-12T17:33:46.050 INFO:tasks.rados.rados.0.trial082.stdout:1135: rollback oid 24 current snap is 122 2026-02-12T17:33:46.050 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 119 2026-02-12T17:33:46.050 INFO:tasks.rados.rados.0.trial082.stdout:1136: copy_from oid 9 from oid 17 current snap is 122 2026-02-12T17:33:46.050 INFO:tasks.rados.rados.0.trial082.stdout:1137: rollback oid 41 current snap is 122 2026-02-12T17:33:46.050 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 121 2026-02-12T17:33:46.050 INFO:tasks.rados.rados.0.trial082.stdout:1138: snap_remove snap 120 2026-02-12T17:33:47.039 INFO:tasks.rados.rados.0.trial082.stdout:1138: done (5 left) 2026-02-12T17:33:47.040 INFO:tasks.rados.rados.0.trial082.stdout:1139: read oid 10 snap -1 2026-02-12T17:33:47.040 INFO:tasks.rados.rados.0.trial082.stdout:1139: expect deleted 2026-02-12T17:33:47.040 INFO:tasks.rados.rados.0.trial082.stdout:1140: write oid 33 current snap is 122 2026-02-12T17:33:47.040 INFO:tasks.rados.rados.0.trial082.stdout:1140: seq_num 409 ranges {474063=543550,1650547=514133,2765651=108412} 2026-02-12T17:33:47.044 INFO:tasks.rados.rados.0.trial082.stdout:1140: writing trial08226312-33 from 474063 to 1017613 tid 1 2026-02-12T17:33:47.048 INFO:tasks.rados.rados.0.trial082.stdout:1140: writing trial08226312-33 from 1650547 to 2164680 tid 2 2026-02-12T17:33:47.051 INFO:tasks.rados.rados.0.trial082.stdout:1140: writing trial08226312-33 from 2765651 to 2874063 tid 3 2026-02-12T17:33:47.051 INFO:tasks.rados.rados.0.trial082.stdout:1141: write oid 42 current snap is 122 2026-02-12T17:33:47.051 INFO:tasks.rados.rados.0.trial082.stdout:1141: seq_num 410 ranges {490870=618799,1592676=774144,2793074=97796} 2026-02-12T17:33:47.055 INFO:tasks.rados.rados.0.trial082.stdout:1141: writing trial08226312-42 from 490870 to 1109669 tid 1 2026-02-12T17:33:47.060 INFO:tasks.rados.rados.0.trial082.stdout:1141: writing trial08226312-42 from 1592676 to 2366820 tid 2 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1141: writing trial08226312-42 from 2793074 to 2890870 tid 3 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1142: read oid 44 snap 117 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1142: expect deleted 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1143: snap_create 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1133: finishing write tid 2 to trial08226312-46 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1133: finishing write tid 3 to trial08226312-46 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1133: finishing write tid 4 to trial08226312-46 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1133: finishing write tid 5 to trial08226312-46 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1133: oid 46 updating version 0 to 452 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1133: oid 46 version 452 is already newer than 450 2026-02-12T17:33:47.064 INFO:tasks.rados.rados.0.trial082.stdout:1133: oid 46 version 452 is already newer than 451 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:1133: oid 46 version 452 is already newer than 449 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 452 (ObjNum 408 snap 122 seq_num 408) dirty exists 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:1133: left oid 46 (ObjNum 408 snap 122 seq_num 408) 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:1137: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:1137: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:1137: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 618 (ObjNum 380 snap 113 seq_num 380) dirty exists 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:1135: finishing rollback tid 0 to trial08226312-24 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:1135: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:1135: finishing rollback tid 2 to trial08226312-24 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 800 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:33:47.065 INFO:tasks.rados.rados.0.trial082.stdout:1134: finishing copy_from racing read to trial08226312-47 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1134: finishing copy_from to trial08226312-47 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 268 (ObjNum 365 snap 108 seq_num 365) dirty exists 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1136: finishing copy_from racing read to trial08226312-9 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1136: finishing copy_from to trial08226312-9 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 606 (ObjNum 297 snap 83 seq_num 297) dirty exists 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1140: finishing write tid 1 to trial08226312-33 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1140: finishing write tid 2 to trial08226312-33 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1140: finishing write tid 3 to trial08226312-33 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1140: finishing write tid 4 to trial08226312-33 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1140: finishing write tid 5 to trial08226312-33 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1140: oid 33 updating version 0 to 622 2026-02-12T17:33:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1140: oid 33 version 622 is already newer than 621 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1140: oid 33 version 622 is already newer than 620 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1140: oid 33 version 622 is already newer than 619 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 622 (ObjNum 409 snap 122 seq_num 409) dirty exists 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1140: left oid 33 (ObjNum 409 snap 122 seq_num 409) 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1141: finishing write tid 1 to trial08226312-42 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1141: finishing write tid 2 to trial08226312-42 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1141: finishing write tid 3 to trial08226312-42 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1141: finishing write tid 4 to trial08226312-42 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1141: finishing write tid 5 to trial08226312-42 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1141: oid 42 updating version 0 to 716 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1141: oid 42 version 716 is already newer than 714 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1141: oid 42 version 716 is already newer than 713 2026-02-12T17:33:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1141: oid 42 version 716 is already newer than 715 2026-02-12T17:33:47.068 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 716 (ObjNum 410 snap 122 seq_num 410) dirty exists 2026-02-12T17:33:47.068 INFO:tasks.rados.rados.0.trial082.stdout:1141: left oid 42 (ObjNum 410 snap 122 seq_num 410) 2026-02-12T17:33:48.032 INFO:tasks.rados.rados.0.trial082.stdout:1133: done (9 left) 2026-02-12T17:33:48.032 INFO:tasks.rados.rados.0.trial082.stdout:1134: done (8 left) 2026-02-12T17:33:48.033 INFO:tasks.rados.rados.0.trial082.stdout:1135: done (7 left) 2026-02-12T17:33:48.033 INFO:tasks.rados.rados.0.trial082.stdout:1136: done (6 left) 2026-02-12T17:33:48.033 INFO:tasks.rados.rados.0.trial082.stdout:1137: done (5 left) 2026-02-12T17:33:48.033 INFO:tasks.rados.rados.0.trial082.stdout:1139: done (4 left) 2026-02-12T17:33:48.033 INFO:tasks.rados.rados.0.trial082.stdout:1140: done (3 left) 2026-02-12T17:33:48.033 INFO:tasks.rados.rados.0.trial082.stdout:1141: done (2 left) 2026-02-12T17:33:48.033 INFO:tasks.rados.rados.0.trial082.stdout:1142: done (1 left) 2026-02-12T17:33:48.033 INFO:tasks.rados.rados.0.trial082.stdout:1143: done (0 left) 2026-02-12T17:33:48.033 INFO:tasks.rados.rados.0.trial082.stdout:1144: snap_create 2026-02-12T17:33:49.032 INFO:tasks.rados.rados.0.trial082.stdout:1144: done (0 left) 2026-02-12T17:33:49.033 INFO:tasks.rados.rados.0.trial082.stdout:1145: rollback oid 26 current snap is 124 2026-02-12T17:33:49.033 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 26 to 121 2026-02-12T17:33:49.033 INFO:tasks.rados.rados.0.trial082.stdout:1146: rollback oid 3 current snap is 124 2026-02-12T17:33:49.033 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 115 2026-02-12T17:33:49.033 INFO:tasks.rados.rados.0.trial082.stdout:1147: snap_remove snap 119 2026-02-12T17:33:50.033 INFO:tasks.rados.rados.0.trial082.stdout:1147: done (2 left) 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:1148: read oid 10 snap -1 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:1148: expect deleted 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:1149: delete oid 7 current snap is 124 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:1146: finishing rollback tid 0 to trial08226312-3 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:1146: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:1146: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 438 (ObjNum 248 snap 70 seq_num 248) dirty exists 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:1145: finishing rollback tid 0 to trial08226312-26 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:1145: finishing rollback tid 1 to trial08226312-26 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:1145: finishing rollback tid 2 to trial08226312-26 2026-02-12T17:33:50.034 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 528 (ObjNum 343 snap 103 seq_num 343) dirty exists 2026-02-12T17:33:50.036 INFO:tasks.rados.rados.0.trial082.stdout:1145: done (3 left) 2026-02-12T17:33:50.036 INFO:tasks.rados.rados.0.trial082.stdout:1146: done (2 left) 2026-02-12T17:33:50.037 INFO:tasks.rados.rados.0.trial082.stdout:1148: done (1 left) 2026-02-12T17:33:50.037 INFO:tasks.rados.rados.0.trial082.stdout:1149: done (0 left) 2026-02-12T17:33:50.037 INFO:tasks.rados.rados.0.trial082.stdout:1150: write (excl) oid 40 current snap is 124 2026-02-12T17:33:50.037 INFO:tasks.rados.rados.0.trial082.stdout:1150: seq_num 412 ranges {524484=485650,1425993=661460,2847920=76564} 2026-02-12T17:33:50.040 INFO:tasks.rados.rados.0.trial082.stdout:1150: writing trial08226312-40 from 524484 to 1010134 tid 1 2026-02-12T17:33:50.044 INFO:tasks.rados.rados.0.trial082.stdout:1150: writing trial08226312-40 from 1425993 to 2087453 tid 2 2026-02-12T17:33:50.048 INFO:tasks.rados.rados.0.trial082.stdout:1150: writing trial08226312-40 from 2847920 to 2924484 tid 3 2026-02-12T17:33:50.048 INFO:tasks.rados.rados.0.trial082.stdout:1151: write (excl) oid 50 current snap is 124 2026-02-12T17:33:50.048 INFO:tasks.rados.rados.0.trial082.stdout:1150: finishing write tid 1 to trial08226312-40 2026-02-12T17:33:50.048 INFO:tasks.rados.rados.0.trial082.stdout:1151: seq_num 413 ranges {541291=560899,1884475=521471} 2026-02-12T17:33:50.052 INFO:tasks.rados.rados.0.trial082.stdout:1151: writing trial08226312-50 from 541291 to 1102190 tid 1 2026-02-12T17:33:50.057 INFO:tasks.rados.rados.0.trial082.stdout:1151: writing trial08226312-50 from 1884475 to 2405946 tid 2 2026-02-12T17:33:50.057 INFO:tasks.rados.rados.0.trial082.stdout:1152: read oid 44 snap 116 2026-02-12T17:33:50.057 INFO:tasks.rados.rados.0.trial082.stdout:1152: expect deleted 2026-02-12T17:33:50.057 INFO:tasks.rados.rados.0.trial082.stdout:1153: write oid 38 current snap is 124 2026-02-12T17:33:50.057 INFO:tasks.rados.rados.0.trial082.stdout:1153: seq_num 414 ranges {558098=636148,1826604=665129} 2026-02-12T17:33:50.062 INFO:tasks.rados.rados.0.trial082.stdout:1153: writing trial08226312-38 from 558098 to 1194246 tid 1 2026-02-12T17:33:50.068 INFO:tasks.rados.rados.0.trial082.stdout:1153: writing trial08226312-38 from 1826604 to 2491733 tid 2 2026-02-12T17:33:50.068 INFO:tasks.rados.rados.0.trial082.stdout:1154: snap_create 2026-02-12T17:33:50.068 INFO:tasks.rados.rados.0.trial082.stdout:1150: finishing write tid 2 to trial08226312-40 2026-02-12T17:33:50.068 INFO:tasks.rados.rados.0.trial082.stdout:1150: finishing write tid 3 to trial08226312-40 2026-02-12T17:33:50.068 INFO:tasks.rados.rados.0.trial082.stdout:1150: finishing write tid 4 to trial08226312-40 2026-02-12T17:33:50.068 INFO:tasks.rados.rados.0.trial082.stdout:1150: finishing write tid 5 to trial08226312-40 2026-02-12T17:33:50.068 INFO:tasks.rados.rados.0.trial082.stdout:1150: oid 40 updating version 0 to 721 2026-02-12T17:33:50.068 INFO:tasks.rados.rados.0.trial082.stdout:1150: oid 40 updating version 721 to 724 2026-02-12T17:33:50.068 INFO:tasks.rados.rados.0.trial082.stdout:1150: oid 40 version 724 is already newer than 722 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:1150: oid 40 version 724 is already newer than 723 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 724 (ObjNum 412 snap 124 seq_num 412) dirty exists 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:1150: left oid 40 (ObjNum 412 snap 124 seq_num 412) 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:1151: finishing write tid 1 to trial08226312-50 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:1151: finishing write tid 2 to trial08226312-50 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:1151: finishing write tid 3 to trial08226312-50 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:1151: finishing write tid 4 to trial08226312-50 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:1151: oid 50 updating version 0 to 260 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:1151: oid 50 updating version 260 to 261 2026-02-12T17:33:50.069 INFO:tasks.rados.rados.0.trial082.stdout:1151: oid 50 updating version 261 to 262 2026-02-12T17:33:50.070 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 262 (ObjNum 413 snap 124 seq_num 413) dirty exists 2026-02-12T17:33:50.070 INFO:tasks.rados.rados.0.trial082.stdout:1151: left oid 50 (ObjNum 413 snap 124 seq_num 413) 2026-02-12T17:33:50.070 INFO:tasks.rados.rados.0.trial082.stdout:1153: finishing write tid 1 to trial08226312-38 2026-02-12T17:33:50.071 INFO:tasks.rados.rados.0.trial082.stdout:1153: finishing write tid 2 to trial08226312-38 2026-02-12T17:33:50.071 INFO:tasks.rados.rados.0.trial082.stdout:1153: finishing write tid 3 to trial08226312-38 2026-02-12T17:33:50.071 INFO:tasks.rados.rados.0.trial082.stdout:1153: finishing write tid 4 to trial08226312-38 2026-02-12T17:33:50.071 INFO:tasks.rados.rados.0.trial082.stdout:1153: oid 38 updating version 0 to 320 2026-02-12T17:33:50.071 INFO:tasks.rados.rados.0.trial082.stdout:1153: oid 38 version 320 is already newer than 318 2026-02-12T17:33:50.071 INFO:tasks.rados.rados.0.trial082.stdout:1153: oid 38 version 320 is already newer than 319 2026-02-12T17:33:50.071 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 320 (ObjNum 414 snap 124 seq_num 414) dirty exists 2026-02-12T17:33:50.071 INFO:tasks.rados.rados.0.trial082.stdout:1153: left oid 38 (ObjNum 414 snap 124 seq_num 414) 2026-02-12T17:33:51.046 INFO:tasks.rados.rados.0.trial082.stdout:1150: done (4 left) 2026-02-12T17:33:51.046 INFO:tasks.rados.rados.0.trial082.stdout:1151: done (3 left) 2026-02-12T17:33:51.046 INFO:tasks.rados.rados.0.trial082.stdout:1152: done (2 left) 2026-02-12T17:33:51.046 INFO:tasks.rados.rados.0.trial082.stdout:1153: done (1 left) 2026-02-12T17:33:51.046 INFO:tasks.rados.rados.0.trial082.stdout:1154: done (0 left) 2026-02-12T17:33:51.046 INFO:tasks.rados.rados.0.trial082.stdout:1155: write oid 39 current snap is 125 2026-02-12T17:33:51.046 INFO:tasks.rados.rados.0.trial082.stdout:1155: seq_num 415 ranges {574905=711397,1885086=525140,2930189=44716} 2026-02-12T17:33:51.050 INFO:tasks.rados.rados.0.trial082.stdout:1155: writing trial08226312-39 from 574905 to 1286302 tid 1 2026-02-12T17:33:51.055 INFO:tasks.rados.rados.0.trial082.stdout:1155: writing trial08226312-39 from 1885086 to 2410226 tid 2 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:1155: writing trial08226312-39 from 2930189 to 2974905 tid 3 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:1156: read oid 35 snap -1 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:1156: expect (ObjNum 351 snap 105 seq_num 351) 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:1157: rollback oid 1 current snap is 125 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 117 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:1155: finishing write tid 1 to trial08226312-39 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:1155: finishing write tid 2 to trial08226312-39 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:1158: rollback oid 17 current snap is 125 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 115 2026-02-12T17:33:51.058 INFO:tasks.rados.rados.0.trial082.stdout:1159: snap_create 2026-02-12T17:33:51.059 INFO:tasks.rados.rados.0.trial082.stdout:1155: finishing write tid 3 to trial08226312-39 2026-02-12T17:33:51.059 INFO:tasks.rados.rados.0.trial082.stdout:1155: finishing write tid 4 to trial08226312-39 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:1155: finishing write tid 5 to trial08226312-39 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:1155: oid 39 updating version 0 to 273 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:1155: oid 39 version 273 is already newer than 271 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:1155: oid 39 version 273 is already newer than 270 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:1155: oid 39 version 273 is already newer than 272 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 273 (ObjNum 415 snap 125 seq_num 415) dirty exists 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:1155: left oid 39 (ObjNum 415 snap 125 seq_num 415) 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:1157: finishing rollback tid 0 to trial08226312-1 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:1157: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:1157: finishing rollback tid 2 to trial08226312-1 2026-02-12T17:33:51.060 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 438 (ObjNum 384 snap 113 seq_num 384) dirty exists 2026-02-12T17:33:51.061 INFO:tasks.rados.rados.0.trial082.stdout:1158: finishing rollback tid 0 to trial08226312-17 2026-02-12T17:33:51.061 INFO:tasks.rados.rados.0.trial082.stdout:1158: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:33:51.061 INFO:tasks.rados.rados.0.trial082.stdout:1158: finishing rollback tid 2 to trial08226312-17 2026-02-12T17:33:51.061 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 809 (ObjNum 297 snap 83 seq_num 297) dirty exists 2026-02-12T17:33:51.061 INFO:tasks.rados.rados.0.trial082.stdout:1156: expect (ObjNum 351 snap 105 seq_num 351) 2026-02-12T17:33:51.120 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 950743 2026-02-12T17:33:52.048 INFO:tasks.rados.rados.0.trial082.stdout:1155: done (4 left) 2026-02-12T17:33:52.049 INFO:tasks.rados.rados.0.trial082.stdout:1156: done (3 left) 2026-02-12T17:33:52.049 INFO:tasks.rados.rados.0.trial082.stdout:1157: done (2 left) 2026-02-12T17:33:52.049 INFO:tasks.rados.rados.0.trial082.stdout:1158: done (1 left) 2026-02-12T17:33:52.049 INFO:tasks.rados.rados.0.trial082.stdout:1159: done (0 left) 2026-02-12T17:33:52.049 INFO:tasks.rados.rados.0.trial082.stdout:1160: rollback oid 38 current snap is 126 2026-02-12T17:33:52.049 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 122 2026-02-12T17:33:52.049 INFO:tasks.rados.rados.0.trial082.stdout:1161: snap_remove snap 123 2026-02-12T17:33:53.032 INFO:tasks.rados.rados.0.trial082.stdout:1161: done (1 left) 2026-02-12T17:33:53.033 INFO:tasks.rados.rados.0.trial082.stdout:1162: rollback oid 49 current snap is 126 2026-02-12T17:33:53.033 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 117 2026-02-12T17:33:53.033 INFO:tasks.rados.rados.0.trial082.stdout:1160: finishing rollback tid 0 to trial08226312-38 2026-02-12T17:33:53.033 INFO:tasks.rados.rados.0.trial082.stdout:1160: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:33:53.033 INFO:tasks.rados.rados.0.trial082.stdout:1160: finishing rollback tid 2 to trial08226312-38 2026-02-12T17:33:53.033 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 324 (ObjNum 292 snap 82 seq_num 292) dirty exists 2026-02-12T17:33:53.033 INFO:tasks.rados.rados.0.trial082.stdout:1160: done (1 left) 2026-02-12T17:33:53.033 INFO:tasks.rados.rados.0.trial082.stdout:1163: rollback oid 8 current snap is 126 2026-02-12T17:33:53.033 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 116 2026-02-12T17:33:53.034 INFO:tasks.rados.rados.0.trial082.stdout:1164: snap_create 2026-02-12T17:33:53.037 INFO:tasks.rados.rados.0.trial082.stdout:1163: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:33:53.037 INFO:tasks.rados.rados.0.trial082.stdout:1163: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:33:53.037 INFO:tasks.rados.rados.0.trial082.stdout:1163: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:33:53.037 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 813 (ObjNum 308 snap 88 seq_num 308) dirty exists 2026-02-12T17:33:53.037 INFO:tasks.rados.rados.0.trial082.stdout:1162: finishing rollback tid 0 to trial08226312-49 2026-02-12T17:33:53.038 INFO:tasks.rados.rados.0.trial082.stdout:1162: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:33:53.038 INFO:tasks.rados.rados.0.trial082.stdout:1162: finishing rollback tid 2 to trial08226312-49 2026-02-12T17:33:53.038 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 770 (ObjNum 372 snap 110 seq_num 372) dirty exists 2026-02-12T17:33:54.034 INFO:tasks.rados.rados.0.trial082.stdout:1162: done (2 left) 2026-02-12T17:33:54.034 INFO:tasks.rados.rados.0.trial082.stdout:1163: done (1 left) 2026-02-12T17:33:54.034 INFO:tasks.rados.rados.0.trial082.stdout:1164: done (0 left) 2026-02-12T17:33:54.034 INFO:tasks.rados.rados.0.trial082.stdout:1165: read oid 3 snap -1 2026-02-12T17:33:54.034 INFO:tasks.rados.rados.0.trial082.stdout:1165: expect (ObjNum 248 snap 70 seq_num 248) 2026-02-12T17:33:54.034 INFO:tasks.rados.rados.0.trial082.stdout:1166: rollback oid 5 current snap is 127 2026-02-12T17:33:54.035 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 5 to 126 2026-02-12T17:33:54.035 INFO:tasks.rados.rados.0.trial082.stdout:1167: copy_from oid 33 from oid 26 current snap is 127 2026-02-12T17:33:54.035 INFO:tasks.rados.rados.0.trial082.stdout:1168: read oid 40 snap -1 2026-02-12T17:33:54.035 INFO:tasks.rados.rados.0.trial082.stdout:1168: expect (ObjNum 412 snap 124 seq_num 412) 2026-02-12T17:33:54.035 INFO:tasks.rados.rados.0.trial082.stdout:1169: read oid 35 snap -1 2026-02-12T17:33:54.035 INFO:tasks.rados.rados.0.trial082.stdout:1169: expect (ObjNum 351 snap 105 seq_num 351) 2026-02-12T17:33:54.035 INFO:tasks.rados.rados.0.trial082.stdout:1170: write oid 20 current snap is 127 2026-02-12T17:33:54.035 INFO:tasks.rados.rados.0.trial082.stdout:1170: seq_num 416 ranges {591712=786646,1943568=668798} 2026-02-12T17:33:54.039 INFO:tasks.rados.rados.0.trial082.stdout:1170: writing trial08226312-20 from 591712 to 1378358 tid 1 2026-02-12T17:33:54.045 INFO:tasks.rados.rados.0.trial082.stdout:1170: writing trial08226312-20 from 1943568 to 2612366 tid 2 2026-02-12T17:33:54.045 INFO:tasks.rados.rados.0.trial082.stdout:1171: write (excl) oid 38 current snap is 127 2026-02-12T17:33:54.045 INFO:tasks.rados.rados.0.trial082.stdout:1171: seq_num 417 ranges {608519=461895,1602050=528809,2585035=423484} 2026-02-12T17:33:54.049 INFO:tasks.rados.rados.0.trial082.stdout:1171: writing trial08226312-38 from 608519 to 1070414 tid 1 2026-02-12T17:33:54.053 INFO:tasks.rados.rados.0.trial082.stdout:1171: writing trial08226312-38 from 1602050 to 2130859 tid 2 2026-02-12T17:33:54.057 INFO:tasks.rados.rados.0.trial082.stdout:1171: writing trial08226312-38 from 2585035 to 3008519 tid 3 2026-02-12T17:33:54.057 INFO:tasks.rados.rados.0.trial082.stdout:1172: write (excl) oid 12 current snap is 127 2026-02-12T17:33:54.057 INFO:tasks.rados.rados.0.trial082.stdout:1172: seq_num 418 ranges {625326=537144,1944179=672467} 2026-02-12T17:33:54.061 INFO:tasks.rados.rados.0.trial082.stdout:1172: writing trial08226312-12 from 625326 to 1162470 tid 1 2026-02-12T17:33:54.067 INFO:tasks.rados.rados.0.trial082.stdout:1172: writing trial08226312-12 from 1944179 to 2616646 tid 2 2026-02-12T17:33:54.067 INFO:tasks.rados.rados.0.trial082.stdout:1173: read oid 23 snap -1 2026-02-12T17:33:54.067 INFO:tasks.rados.rados.0.trial082.stdout:1173: expect (ObjNum 381 snap 113 seq_num 381) 2026-02-12T17:33:54.067 INFO:tasks.rados.rados.0.trial082.stdout:1174: read oid 22 snap -1 2026-02-12T17:33:54.068 INFO:tasks.rados.rados.0.trial082.stdout:1174: expect (ObjNum 341 snap 103 seq_num 341) 2026-02-12T17:33:54.068 INFO:tasks.rados.rados.0.trial082.stdout:1175: delete oid 28 current snap is 127 2026-02-12T17:33:54.068 INFO:tasks.rados.rados.0.trial082.stdout:1165: expect (ObjNum 248 snap 70 seq_num 248) 2026-02-12T17:33:54.087 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1934090 2026-02-12T17:33:54.088 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:54.138 INFO:tasks.rados.rados.0.trial082.stdout:1166: finishing rollback tid 0 to trial08226312-5 2026-02-12T17:33:54.138 INFO:tasks.rados.rados.0.trial082.stdout:1166: finishing rollback tid 1 to trial08226312-5 2026-02-12T17:33:54.138 INFO:tasks.rados.rados.0.trial082.stdout:1166: finishing rollback tid 2 to trial08226312-5 2026-02-12T17:33:54.139 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 441 (ObjNum 384 snap 113 seq_num 384) dirty exists 2026-02-12T17:33:54.139 INFO:tasks.rados.rados.0.trial082.stdout:1169: expect (ObjNum 351 snap 105 seq_num 351) 2026-02-12T17:33:54.165 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:54.202 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2348315 2026-02-12T17:33:54.212 INFO:tasks.rados.rados.0.trial082.stdout:1168: expect (ObjNum 412 snap 124 seq_num 412) 2026-02-12T17:33:54.244 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 214721 2026-02-12T17:33:54.265 INFO:tasks.rados.rados.0.trial082.stdout:1170: finishing write tid 1 to trial08226312-20 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1165: done (10 left) 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1166: done (9 left) 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1168: done (8 left) 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1169: done (7 left) 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1175: done (6 left) 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1176: copy_from oid 3 from oid 24 current snap is 127 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1167: finishing copy_from racing read to trial08226312-33 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1170: finishing write tid 2 to trial08226312-20 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1170: finishing write tid 3 to trial08226312-20 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1170: finishing write tid 4 to trial08226312-20 2026-02-12T17:33:54.266 INFO:tasks.rados.rados.0.trial082.stdout:1170: oid 20 updating version 0 to 818 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1170: oid 20 version 818 is already newer than 817 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1170: oid 20 version 818 is already newer than 816 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 818 (ObjNum 416 snap 127 seq_num 416) dirty exists 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1170: left oid 20 (ObjNum 416 snap 127 seq_num 416) 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1167: finishing copy_from to trial08226312-33 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 528 (ObjNum 343 snap 103 seq_num 343) dirty exists 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1171: finishing write tid 1 to trial08226312-38 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1171: finishing write tid 2 to trial08226312-38 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1171: finishing write tid 3 to trial08226312-38 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1171: finishing write tid 4 to trial08226312-38 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1171: finishing write tid 5 to trial08226312-38 2026-02-12T17:33:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1171: oid 38 updating version 0 to 331 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1171: oid 38 version 331 is already newer than 329 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1171: oid 38 version 331 is already newer than 330 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1171: oid 38 version 331 is already newer than 328 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 331 (ObjNum 417 snap 127 seq_num 417) dirty exists 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1171: left oid 38 (ObjNum 417 snap 127 seq_num 417) 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1172: finishing write tid 1 to trial08226312-12 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1167: done (6 left) 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1170: done (5 left) 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1171: done (4 left) 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1177: read oid 8 snap -1 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1177: expect (ObjNum 308 snap 88 seq_num 308) 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1178: read oid 26 snap -1 2026-02-12T17:33:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1178: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:33:54.269 INFO:tasks.rados.rados.0.trial082.stdout:1179: rollback oid 27 current snap is 127 2026-02-12T17:33:54.269 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 125 2026-02-12T17:33:54.269 INFO:tasks.rados.rados.0.trial082.stdout:1173: expect (ObjNum 381 snap 113 seq_num 381) 2026-02-12T17:33:54.269 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 774705 2026-02-12T17:33:54.286 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 119813 2026-02-12T17:33:54.320 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1748523 2026-02-12T17:33:54.329 INFO:tasks.rados.rados.0.trial082.stdout:1172: finishing write tid 2 to trial08226312-12 2026-02-12T17:33:54.330 INFO:tasks.rados.rados.0.trial082.stdout:1172: finishing write tid 3 to trial08226312-12 2026-02-12T17:33:54.330 INFO:tasks.rados.rados.0.trial082.stdout:1172: finishing write tid 4 to trial08226312-12 2026-02-12T17:33:54.330 INFO:tasks.rados.rados.0.trial082.stdout:1172: oid 12 updating version 0 to 624 2026-02-12T17:33:54.330 INFO:tasks.rados.rados.0.trial082.stdout:1172: oid 12 updating version 624 to 625 2026-02-12T17:33:54.330 INFO:tasks.rados.rados.0.trial082.stdout:1172: oid 12 version 625 is already newer than 623 2026-02-12T17:33:54.330 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 625 (ObjNum 418 snap 127 seq_num 418) dirty exists 2026-02-12T17:33:54.330 INFO:tasks.rados.rados.0.trial082.stdout:1172: left oid 12 (ObjNum 418 snap 127 seq_num 418) 2026-02-12T17:33:54.330 INFO:tasks.rados.rados.0.trial082.stdout:1174: expect (ObjNum 341 snap 103 seq_num 341) 2026-02-12T17:33:54.390 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1687936 2026-02-12T17:33:54.479 INFO:tasks.rados.rados.0.trial082.stdout:1179: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:33:54.480 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 0 (ObjNum 113 snap 0 seq_num 26833392) dirty dne 2026-02-12T17:33:54.480 INFO:tasks.rados.rados.0.trial082.stdout:1178: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:33:54.480 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:54.578 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1981361 2026-02-12T17:33:54.603 INFO:tasks.rados.rados.0.trial082.stdout:1177: expect (ObjNum 308 snap 88 seq_num 308) 2026-02-12T17:33:54.611 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1294460 2026-02-12T17:33:54.654 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2121794 2026-02-12T17:33:54.668 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:54.708 INFO:tasks.rados.rados.0.trial082.stdout:1176: finishing copy_from racing read to trial08226312-3 2026-02-12T17:33:54.708 INFO:tasks.rados.rados.0.trial082.stdout:1176: finishing copy_from to trial08226312-3 2026-02-12T17:33:54.708 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 800 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:33:54.708 INFO:tasks.rados.rados.0.trial082.stdout:1172: done (6 left) 2026-02-12T17:33:54.708 INFO:tasks.rados.rados.0.trial082.stdout:1173: done (5 left) 2026-02-12T17:33:54.708 INFO:tasks.rados.rados.0.trial082.stdout:1174: done (4 left) 2026-02-12T17:33:54.708 INFO:tasks.rados.rados.0.trial082.stdout:1176: done (3 left) 2026-02-12T17:33:54.708 INFO:tasks.rados.rados.0.trial082.stdout:1177: done (2 left) 2026-02-12T17:33:54.708 INFO:tasks.rados.rados.0.trial082.stdout:1178: done (1 left) 2026-02-12T17:33:54.709 INFO:tasks.rados.rados.0.trial082.stdout:1179: done (0 left) 2026-02-12T17:33:54.709 INFO:tasks.rados.rados.0.trial082.stdout:1180: snap_create 2026-02-12T17:33:55.038 INFO:tasks.rados.rados.0.trial082.stdout:1180: done (0 left) 2026-02-12T17:33:55.038 INFO:tasks.rados.rados.0.trial082.stdout:1181: rollback oid 6 current snap is 128 2026-02-12T17:33:55.038 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 6 to 121 2026-02-12T17:33:55.038 INFO:tasks.rados.rados.0.trial082.stdout:1182: write oid 16 current snap is 128 2026-02-12T17:33:55.038 INFO:tasks.rados.rados.0.trial082.stdout:1182: seq_num 420 ranges {658940=403995,1777496=676136,2950951=107989} 2026-02-12T17:33:55.041 INFO:tasks.rados.rados.0.trial082.stdout:1182: writing trial08226312-16 from 658940 to 1062935 tid 1 2026-02-12T17:33:55.046 INFO:tasks.rados.rados.0.trial082.stdout:1182: writing trial08226312-16 from 1777496 to 2453632 tid 2 2026-02-12T17:33:55.050 INFO:tasks.rados.rados.0.trial082.stdout:1182: writing trial08226312-16 from 2950951 to 3058940 tid 3 2026-02-12T17:33:55.050 INFO:tasks.rados.rados.0.trial082.stdout:1183: read oid 10 snap -1 2026-02-12T17:33:55.050 INFO:tasks.rados.rados.0.trial082.stdout:1183: expect deleted 2026-02-12T17:33:55.050 INFO:tasks.rados.rados.0.trial082.stdout:1184: copy_from oid 47 from oid 33 current snap is 128 2026-02-12T17:33:55.050 INFO:tasks.rados.rados.0.trial082.stdout:1181: finishing rollback tid 0 to trial08226312-6 2026-02-12T17:33:55.050 INFO:tasks.rados.rados.0.trial082.stdout:1181: finishing rollback tid 1 to trial08226312-6 2026-02-12T17:33:55.050 INFO:tasks.rados.rados.0.trial082.stdout:1181: finishing rollback tid 2 to trial08226312-6 2026-02-12T17:33:55.050 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 268 (ObjNum 407 snap 121 seq_num 407) dirty exists 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1182: finishing write tid 1 to trial08226312-16 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1181: done (3 left) 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1185: delete oid 15 current snap is 128 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1182: finishing write tid 2 to trial08226312-16 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1183: done (3 left) 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1185: done (2 left) 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1186: read oid 28 snap 121 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1186: expect (ObjNum 393 snap 115 seq_num 393) 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1187: rollback oid 27 current snap is 128 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 122 2026-02-12T17:33:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1188: snap_create 2026-02-12T17:33:55.052 INFO:tasks.rados.rados.0.trial082.stdout:1187: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:33:55.052 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:33:55.054 INFO:tasks.rados.rados.0.trial082.stdout:1182: finishing write tid 3 to trial08226312-16 2026-02-12T17:33:55.054 INFO:tasks.rados.rados.0.trial082.stdout:1182: finishing write tid 4 to trial08226312-16 2026-02-12T17:33:55.054 INFO:tasks.rados.rados.0.trial082.stdout:1182: finishing write tid 5 to trial08226312-16 2026-02-12T17:33:55.054 INFO:tasks.rados.rados.0.trial082.stdout:1182: oid 16 updating version 0 to 733 2026-02-12T17:33:55.054 INFO:tasks.rados.rados.0.trial082.stdout:1182: oid 16 version 733 is already newer than 730 2026-02-12T17:33:55.054 INFO:tasks.rados.rados.0.trial082.stdout:1182: oid 16 version 733 is already newer than 732 2026-02-12T17:33:55.054 INFO:tasks.rados.rados.0.trial082.stdout:1182: oid 16 version 733 is already newer than 731 2026-02-12T17:33:55.055 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 733 (ObjNum 420 snap 128 seq_num 420) dirty exists 2026-02-12T17:33:55.055 INFO:tasks.rados.rados.0.trial082.stdout:1182: left oid 16 (ObjNum 420 snap 128 seq_num 420) 2026-02-12T17:33:55.056 INFO:tasks.rados.rados.0.trial082.stdout:1186: expect (ObjNum 393 snap 115 seq_num 393) 2026-02-12T17:33:55.056 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:55.141 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:33:55.184 INFO:tasks.rados.rados.0.trial082.stdout:1184: finishing copy_from racing read to trial08226312-47 2026-02-12T17:33:55.185 INFO:tasks.rados.rados.0.trial082.stdout:1184: finishing copy_from to trial08226312-47 2026-02-12T17:33:55.185 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 528 (ObjNum 343 snap 103 seq_num 343) dirty exists 2026-02-12T17:33:56.044 INFO:tasks.rados.rados.0.trial082.stdout:1182: done (4 left) 2026-02-12T17:33:56.044 INFO:tasks.rados.rados.0.trial082.stdout:1184: done (3 left) 2026-02-12T17:33:56.044 INFO:tasks.rados.rados.0.trial082.stdout:1186: done (2 left) 2026-02-12T17:33:56.044 INFO:tasks.rados.rados.0.trial082.stdout:1187: done (1 left) 2026-02-12T17:33:56.044 INFO:tasks.rados.rados.0.trial082.stdout:1188: done (0 left) 2026-02-12T17:33:56.044 INFO:tasks.rados.rados.0.trial082.stdout:1189: snap_create 2026-02-12T17:33:57.044 INFO:tasks.rados.rados.0.trial082.stdout:1189: done (0 left) 2026-02-12T17:33:57.045 INFO:tasks.rados.rados.0.trial082.stdout:1190: snap_create 2026-02-12T17:33:58.033 INFO:tasks.rados.rados.0.trial082.stdout:1190: done (0 left) 2026-02-12T17:33:58.033 INFO:tasks.rados.rados.0.trial082.stdout:1191: copy_from oid 30 from oid 24 current snap is 131 2026-02-12T17:33:58.033 INFO:tasks.rados.rados.0.trial082.stdout:1192: read oid 19 snap -1 2026-02-12T17:33:58.033 INFO:tasks.rados.rados.0.trial082.stdout:1192: expect deleted 2026-02-12T17:33:58.033 INFO:tasks.rados.rados.0.trial082.stdout:1193: write (excl) oid 47 current snap is 131 2026-02-12T17:33:58.033 INFO:tasks.rados.rados.0.trial082.stdout:1193: seq_num 422 ranges {692554=554493,1778107=679805,2889444=203110} 2026-02-12T17:33:58.038 INFO:tasks.rados.rados.0.trial082.stdout:1193: writing trial08226312-47 from 692554 to 1247047 tid 1 2026-02-12T17:33:58.043 INFO:tasks.rados.rados.0.trial082.stdout:1193: writing trial08226312-47 from 1778107 to 2457912 tid 2 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1193: writing trial08226312-47 from 2889444 to 3092554 tid 3 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1194: read oid 2 snap -1 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1194: expect (ObjNum 385 snap 113 seq_num 385) 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1195: copy_from oid 22 from oid 49 current snap is 131 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1191: finishing copy_from racing read to trial08226312-30 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1191: finishing copy_from to trial08226312-30 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 800 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1193: finishing write tid 1 to trial08226312-47 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1193: finishing write tid 2 to trial08226312-47 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1191: done (4 left) 2026-02-12T17:33:58.047 INFO:tasks.rados.rados.0.trial082.stdout:1192: done (3 left) 2026-02-12T17:33:58.048 INFO:tasks.rados.rados.0.trial082.stdout:1196: copy_from oid 9 from oid 19 current snap is 131 2026-02-12T17:33:58.048 INFO:tasks.rados.rados.0.trial082.stdout:1197: write (excl) oid 5 current snap is 131 2026-02-12T17:33:58.048 INFO:tasks.rados.rados.0.trial082.stdout:1197: seq_num 423 ranges {709361=629742,1836589=539816,3033220=76141} 2026-02-12T17:33:58.051 INFO:tasks.rados.rados.0.trial082.stdout:1197: writing trial08226312-5 from 709361 to 1339103 tid 1 2026-02-12T17:33:58.055 INFO:tasks.rados.rados.0.trial082.stdout:1197: writing trial08226312-5 from 1836589 to 2376405 tid 2 2026-02-12T17:33:58.059 INFO:tasks.rados.rados.0.trial082.stdout:1197: writing trial08226312-5 from 3033220 to 3109361 tid 3 2026-02-12T17:33:58.059 INFO:tasks.rados.rados.0.trial082.stdout:1198: snap_create 2026-02-12T17:33:58.059 INFO:tasks.rados.rados.0.trial082.stdout:1193: finishing write tid 3 to trial08226312-47 2026-02-12T17:33:58.059 INFO:tasks.rados.rados.0.trial082.stdout:1193: finishing write tid 4 to trial08226312-47 2026-02-12T17:33:58.059 INFO:tasks.rados.rados.0.trial082.stdout:1196: finishing copy_from to trial08226312-9 2026-02-12T17:33:58.059 INFO:tasks.rados.rados.0.trial082.stdout:1196: got expected ENOENT (src dne) 2026-02-12T17:33:58.059 INFO:tasks.rados.rados.0.trial082.stdout:1196: finishing copy_from racing read to trial08226312-9 2026-02-12T17:33:58.059 INFO:tasks.rados.rados.0.trial082.stdout:1193: finishing write tid 5 to trial08226312-47 2026-02-12T17:33:58.060 INFO:tasks.rados.rados.0.trial082.stdout:1193: oid 47 updating version 0 to 822 2026-02-12T17:33:58.060 INFO:tasks.rados.rados.0.trial082.stdout:1193: oid 47 updating version 822 to 824 2026-02-12T17:33:58.060 INFO:tasks.rados.rados.0.trial082.stdout:1193: oid 47 version 824 is already newer than 823 2026-02-12T17:33:58.060 INFO:tasks.rados.rados.0.trial082.stdout:1193: oid 47 updating version 824 to 825 2026-02-12T17:33:58.060 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 825 (ObjNum 422 snap 131 seq_num 422) dirty exists 2026-02-12T17:33:58.060 INFO:tasks.rados.rados.0.trial082.stdout:1193: left oid 47 (ObjNum 422 snap 131 seq_num 422) 2026-02-12T17:33:58.060 INFO:tasks.rados.rados.0.trial082.stdout:1194: expect (ObjNum 385 snap 113 seq_num 385) 2026-02-12T17:33:58.066 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1695732 2026-02-12T17:33:58.089 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1967909 2026-02-12T17:33:58.125 INFO:tasks.rados.rados.0.trial082.stdout:1195: finishing copy_from racing read to trial08226312-22 2026-02-12T17:33:58.125 INFO:tasks.rados.rados.0.trial082.stdout:1197: finishing write tid 1 to trial08226312-5 2026-02-12T17:33:58.125 INFO:tasks.rados.rados.0.trial082.stdout:1195: finishing copy_from to trial08226312-22 2026-02-12T17:33:58.125 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 770 (ObjNum 372 snap 110 seq_num 372) dirty exists 2026-02-12T17:33:58.125 INFO:tasks.rados.rados.0.trial082.stdout:1197: finishing write tid 2 to trial08226312-5 2026-02-12T17:33:58.125 INFO:tasks.rados.rados.0.trial082.stdout:1197: finishing write tid 3 to trial08226312-5 2026-02-12T17:33:58.126 INFO:tasks.rados.rados.0.trial082.stdout:1197: finishing write tid 4 to trial08226312-5 2026-02-12T17:33:58.126 INFO:tasks.rados.rados.0.trial082.stdout:1197: finishing write tid 5 to trial08226312-5 2026-02-12T17:33:58.126 INFO:tasks.rados.rados.0.trial082.stdout:1197: oid 5 updating version 0 to 801 2026-02-12T17:33:58.126 INFO:tasks.rados.rados.0.trial082.stdout:1197: oid 5 updating version 801 to 802 2026-02-12T17:33:58.126 INFO:tasks.rados.rados.0.trial082.stdout:1197: oid 5 updating version 802 to 803 2026-02-12T17:33:58.126 INFO:tasks.rados.rados.0.trial082.stdout:1197: oid 5 updating version 803 to 804 2026-02-12T17:33:58.126 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 804 (ObjNum 423 snap 131 seq_num 423) dirty exists 2026-02-12T17:33:58.126 INFO:tasks.rados.rados.0.trial082.stdout:1197: left oid 5 (ObjNum 423 snap 131 seq_num 423) 2026-02-12T17:33:59.051 INFO:tasks.rados.rados.0.trial082.stdout:1193: done (5 left) 2026-02-12T17:33:59.051 INFO:tasks.rados.rados.0.trial082.stdout:1194: done (4 left) 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1195: done (3 left) 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1196: done (2 left) 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1197: done (1 left) 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1198: done (0 left) 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1199: read oid 31 snap -1 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1199: expect (ObjNum 227 snap 61 seq_num 227) 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1200: rollback oid 3 current snap is 132 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 122 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1201: read oid 41 snap -1 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1201: expect (ObjNum 380 snap 113 seq_num 380) 2026-02-12T17:33:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1202: write (excl) oid 37 current snap is 132 2026-02-12T17:33:59.053 INFO:tasks.rados.rados.0.trial082.stdout:1202: seq_num 424 ranges {726168=704991,1895071=683474} 2026-02-12T17:33:59.056 INFO:tasks.rados.rados.0.trial082.stdout:1202: writing trial08226312-37 from 726168 to 1431159 tid 1 2026-02-12T17:33:59.061 INFO:tasks.rados.rados.0.trial082.stdout:1202: writing trial08226312-37 from 1895071 to 2578545 tid 2 2026-02-12T17:33:59.061 INFO:tasks.rados.rados.0.trial082.stdout:1203: copy_from oid 38 from oid 30 current snap is 132 2026-02-12T17:33:59.061 INFO:tasks.rados.rados.0.trial082.stdout:1200: finishing rollback tid 0 to trial08226312-3 2026-02-12T17:33:59.061 INFO:tasks.rados.rados.0.trial082.stdout:1200: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:33:59.061 INFO:tasks.rados.rados.0.trial082.stdout:1200: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:33:59.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 807 (ObjNum 248 snap 70 seq_num 248) dirty exists 2026-02-12T17:33:59.062 INFO:tasks.rados.rados.0.trial082.stdout:1200: done (4 left) 2026-02-12T17:33:59.062 INFO:tasks.rados.rados.0.trial082.stdout:1204: write oid 16 current snap is 132 2026-02-12T17:33:59.062 INFO:tasks.rados.rados.0.trial082.stdout:1204: seq_num 425 ranges {742975=780240,1953553=427132,2971713=171262} 2026-02-12T17:33:59.067 INFO:tasks.rados.rados.0.trial082.stdout:1204: writing trial08226312-16 from 742975 to 1523215 tid 1 2026-02-12T17:33:59.070 INFO:tasks.rados.rados.0.trial082.stdout:1204: writing trial08226312-16 from 1953553 to 2380685 tid 2 2026-02-12T17:33:59.073 INFO:tasks.rados.rados.0.trial082.stdout:1204: writing trial08226312-16 from 2971713 to 3142975 tid 3 2026-02-12T17:33:59.073 INFO:tasks.rados.rados.0.trial082.stdout:1205: read oid 25 snap -1 2026-02-12T17:33:59.073 INFO:tasks.rados.rados.0.trial082.stdout:1205: expect (ObjNum 397 snap 116 seq_num 397) 2026-02-12T17:33:59.073 INFO:tasks.rados.rados.0.trial082.stdout:1206: copy_from oid 5 from oid 46 current snap is 132 2026-02-12T17:33:59.073 INFO:tasks.rados.rados.0.trial082.stdout:1201: expect (ObjNum 380 snap 113 seq_num 380) 2026-02-12T17:33:59.092 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1567691 2026-02-12T17:33:59.110 INFO:tasks.rados.rados.0.trial082.stdout:1199: expect (ObjNum 227 snap 61 seq_num 227) 2026-02-12T17:33:59.249 INFO:tasks.rados.rados.0.trial082.stdout:1202: finishing write tid 1 to trial08226312-37 2026-02-12T17:33:59.249 INFO:tasks.rados.rados.0.trial082.stdout:1199: done (6 left) 2026-02-12T17:33:59.249 INFO:tasks.rados.rados.0.trial082.stdout:1201: done (5 left) 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1207: copy_from oid 44 from oid 3 current snap is 132 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1202: finishing write tid 2 to trial08226312-37 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1202: finishing write tid 3 to trial08226312-37 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1202: finishing write tid 4 to trial08226312-37 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1202: oid 37 updating version 0 to 627 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1202: oid 37 version 627 is already newer than 626 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1202: oid 37 updating version 627 to 628 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 628 (ObjNum 424 snap 132 seq_num 424) dirty exists 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1202: left oid 37 (ObjNum 424 snap 132 seq_num 424) 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1204: finishing write tid 1 to trial08226312-16 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1204: finishing write tid 2 to trial08226312-16 2026-02-12T17:33:59.250 INFO:tasks.rados.rados.0.trial082.stdout:1204: finishing write tid 3 to trial08226312-16 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:1204: finishing write tid 4 to trial08226312-16 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:1204: finishing write tid 5 to trial08226312-16 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:1204: oid 16 updating version 0 to 735 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:1204: oid 16 updating version 735 to 736 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:1204: oid 16 updating version 736 to 738 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:1204: oid 16 version 738 is already newer than 737 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 738 (ObjNum 425 snap 132 seq_num 425) dirty exists 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:1204: left oid 16 (ObjNum 425 snap 132 seq_num 425) 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:1203: finishing copy_from racing read to trial08226312-38 2026-02-12T17:33:59.251 INFO:tasks.rados.rados.0.trial082.stdout:1205: expect (ObjNum 397 snap 116 seq_num 397) 2026-02-12T17:33:59.252 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 998930 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:1206: finishing copy_from racing read to trial08226312-5 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:1206: finishing copy_from to trial08226312-5 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 452 (ObjNum 408 snap 122 seq_num 408) dirty exists 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:1203: finishing copy_from to trial08226312-38 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 800 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:1202: done (5 left) 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:1203: done (4 left) 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:1204: done (3 left) 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:1205: done (2 left) 2026-02-12T17:33:59.302 INFO:tasks.rados.rados.0.trial082.stdout:1206: done (1 left) 2026-02-12T17:33:59.303 INFO:tasks.rados.rados.0.trial082.stdout:1208: delete oid 16 current snap is 132 2026-02-12T17:33:59.303 INFO:tasks.rados.rados.0.trial082.stdout:1207: finishing copy_from racing read to trial08226312-44 2026-02-12T17:33:59.303 INFO:tasks.rados.rados.0.trial082.stdout:1207: finishing copy_from to trial08226312-44 2026-02-12T17:33:59.303 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 807 (ObjNum 248 snap 70 seq_num 248) dirty exists 2026-02-12T17:33:59.303 INFO:tasks.rados.rados.0.trial082.stdout:1207: done (1 left) 2026-02-12T17:33:59.303 INFO:tasks.rados.rados.0.trial082.stdout:1208: done (0 left) 2026-02-12T17:33:59.303 INFO:tasks.rados.rados.0.trial082.stdout:1209: snap_create 2026-02-12T17:34:00.057 INFO:tasks.rados.rados.0.trial082.stdout:1209: done (0 left) 2026-02-12T17:34:00.057 INFO:tasks.rados.rados.0.trial082.stdout:1210: snap_create 2026-02-12T17:34:01.058 INFO:tasks.rados.rados.0.trial082.stdout:1210: done (0 left) 2026-02-12T17:34:01.058 INFO:tasks.rados.rados.0.trial082.stdout:1211: rollback oid 5 current snap is 134 2026-02-12T17:34:01.058 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 5 to 131 2026-02-12T17:34:01.058 INFO:tasks.rados.rados.0.trial082.stdout:1212: write (excl) oid 36 current snap is 134 2026-02-12T17:34:01.058 INFO:tasks.rados.rados.0.trial082.stdout:1212: seq_num 427 ranges {776589=647091,2070517=430801,3026559=150030} 2026-02-12T17:34:01.063 INFO:tasks.rados.rados.0.trial082.stdout:1212: writing trial08226312-36 from 776589 to 1423680 tid 1 2026-02-12T17:34:01.067 INFO:tasks.rados.rados.0.trial082.stdout:1212: writing trial08226312-36 from 2070517 to 2501318 tid 2 2026-02-12T17:34:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1212: writing trial08226312-36 from 3026559 to 3176589 tid 3 2026-02-12T17:34:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1213: delete oid 30 current snap is 134 2026-02-12T17:34:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1211: finishing rollback tid 0 to trial08226312-5 2026-02-12T17:34:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1211: finishing rollback tid 1 to trial08226312-5 2026-02-12T17:34:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1211: finishing rollback tid 2 to trial08226312-5 2026-02-12T17:34:01.070 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 810 (ObjNum 423 snap 131 seq_num 423) dirty exists 2026-02-12T17:34:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1212: finishing write tid 1 to trial08226312-36 2026-02-12T17:34:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1212: finishing write tid 2 to trial08226312-36 2026-02-12T17:34:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1212: finishing write tid 3 to trial08226312-36 2026-02-12T17:34:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1212: finishing write tid 4 to trial08226312-36 2026-02-12T17:34:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1212: finishing write tid 5 to trial08226312-36 2026-02-12T17:34:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1212: oid 36 updating version 0 to 809 2026-02-12T17:34:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1212: oid 36 version 809 is already newer than 808 2026-02-12T17:34:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1212: oid 36 updating version 809 to 811 2026-02-12T17:34:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1212: oid 36 version 811 is already newer than 810 2026-02-12T17:34:01.072 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 811 (ObjNum 427 snap 134 seq_num 427) dirty exists 2026-02-12T17:34:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1212: left oid 36 (ObjNum 427 snap 134 seq_num 427) 2026-02-12T17:34:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1211: done (2 left) 2026-02-12T17:34:01.073 INFO:tasks.rados.rados.0.trial082.stdout:1212: done (1 left) 2026-02-12T17:34:01.073 INFO:tasks.rados.rados.0.trial082.stdout:1213: done (0 left) 2026-02-12T17:34:01.073 INFO:tasks.rados.rados.0.trial082.stdout:1214: write oid 32 current snap is 134 2026-02-12T17:34:01.073 INFO:tasks.rados.rados.0.trial082.stdout:1214: seq_num 429 ranges {410203=797589,1787481=434470,2681405=528798} 2026-02-12T17:34:01.076 INFO:tasks.rados.rados.0.trial082.stdout:1214: writing trial08226312-32 from 410203 to 1207792 tid 1 2026-02-12T17:34:01.080 INFO:tasks.rados.rados.0.trial082.stdout:1214: writing trial08226312-32 from 1787481 to 2221951 tid 2 2026-02-12T17:34:01.084 INFO:tasks.rados.rados.0.trial082.stdout:1214: writing trial08226312-32 from 2681405 to 3210203 tid 3 2026-02-12T17:34:01.084 INFO:tasks.rados.rados.0.trial082.stdout:1215: snap_remove snap 133 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:1215: done (1 left) 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:1216: rollback oid 27 current snap is 134 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 125 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:1214: finishing write tid 1 to trial08226312-32 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:1214: finishing write tid 2 to trial08226312-32 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:1214: finishing write tid 3 to trial08226312-32 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:1214: finishing write tid 4 to trial08226312-32 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:1214: finishing write tid 5 to trial08226312-32 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:1214: oid 32 updating version 0 to 803 2026-02-12T17:34:02.062 INFO:tasks.rados.rados.0.trial082.stdout:1214: oid 32 version 803 is already newer than 802 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:1214: oid 32 version 803 is already newer than 801 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:1214: oid 32 updating version 803 to 804 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 804 (ObjNum 429 snap 134 seq_num 429) dirty exists 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:1214: left oid 32 (ObjNum 429 snap 134 seq_num 429) 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:1214: done (1 left) 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:1217: delete oid 13 current snap is 134 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:1217: done (1 left) 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:1218: read oid 34 snap 116 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:1218: expect (ObjNum 395 snap 116 seq_num 395) 2026-02-12T17:34:02.063 INFO:tasks.rados.rados.0.trial082.stdout:1219: write oid 19 current snap is 134 2026-02-12T17:34:02.064 INFO:tasks.rados.rados.0.trial082.stdout:1219: seq_num 431 ranges {443817=548087,1788092=438139,3019898=223919} 2026-02-12T17:34:02.067 INFO:tasks.rados.rados.0.trial082.stdout:1219: writing trial08226312-19 from 443817 to 991904 tid 1 2026-02-12T17:34:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1219: writing trial08226312-19 from 1788092 to 2226231 tid 2 2026-02-12T17:34:02.076 INFO:tasks.rados.rados.0.trial082.stdout:1219: writing trial08226312-19 from 3019898 to 3243817 tid 3 2026-02-12T17:34:02.076 INFO:tasks.rados.rados.0.trial082.stdout:1220: snap_remove snap 129 2026-02-12T17:34:03.033 INFO:tasks.rados.rados.0.trial082.stdout:1220: done (3 left) 2026-02-12T17:34:03.033 INFO:tasks.rados.rados.0.trial082.stdout:1221: snap_create 2026-02-12T17:34:03.033 INFO:tasks.rados.rados.0.trial082.stdout:1216: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:34:03.033 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 0 (ObjNum 33 snap 0 seq_num 27017309) dirty dne 2026-02-12T17:34:03.033 INFO:tasks.rados.rados.0.trial082.stdout:1218: expect (ObjNum 395 snap 116 seq_num 395) 2026-02-12T17:34:03.059 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:03.109 INFO:tasks.rados.rados.0.trial082.stdout:1219: finishing write tid 1 to trial08226312-19 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:1219: finishing write tid 2 to trial08226312-19 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:1219: finishing write tid 3 to trial08226312-19 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:1219: finishing write tid 4 to trial08226312-19 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:1219: finishing write tid 5 to trial08226312-19 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:1219: oid 19 updating version 0 to 829 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:1219: oid 19 version 829 is already newer than 826 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:1219: oid 19 version 829 is already newer than 828 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:1219: oid 19 version 829 is already newer than 827 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 829 (ObjNum 431 snap 134 seq_num 431) dirty exists 2026-02-12T17:34:03.110 INFO:tasks.rados.rados.0.trial082.stdout:1219: left oid 19 (ObjNum 431 snap 134 seq_num 431) 2026-02-12T17:34:04.035 INFO:tasks.rados.rados.0.trial082.stdout:1216: done (3 left) 2026-02-12T17:34:04.035 INFO:tasks.rados.rados.0.trial082.stdout:1218: done (2 left) 2026-02-12T17:34:04.035 INFO:tasks.rados.rados.0.trial082.stdout:1219: done (1 left) 2026-02-12T17:34:04.035 INFO:tasks.rados.rados.0.trial082.stdout:1221: done (0 left) 2026-02-12T17:34:04.035 INFO:tasks.rados.rados.0.trial082.stdout:1222: delete oid 45 current snap is 135 2026-02-12T17:34:04.521 INFO:tasks.rados.rados.0.trial082.stdout:1222: done (0 left) 2026-02-12T17:34:04.521 INFO:tasks.rados.rados.0.trial082.stdout:1223: read oid 49 snap 132 2026-02-12T17:34:04.521 INFO:tasks.rados.rados.0.trial082.stdout:1223: expect (ObjNum 372 snap 110 seq_num 372) 2026-02-12T17:34:04.522 INFO:tasks.rados.rados.0.trial082.stdout:1224: read oid 19 snap -1 2026-02-12T17:34:04.522 INFO:tasks.rados.rados.0.trial082.stdout:1224: expect (ObjNum 431 snap 134 seq_num 431) 2026-02-12T17:34:04.522 INFO:tasks.rados.rados.0.trial082.stdout:1225: copy_from oid 17 from oid 36 current snap is 135 2026-02-12T17:34:04.522 INFO:tasks.rados.rados.0.trial082.stdout:1226: snap_create 2026-02-12T17:34:04.524 INFO:tasks.rados.rados.0.trial082.stdout:1224: expect (ObjNum 431 snap 134 seq_num 431) 2026-02-12T17:34:04.582 INFO:tasks.rados.rados.0.trial082.stdout:1223: expect (ObjNum 372 snap 110 seq_num 372) 2026-02-12T17:34:04.582 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:04.605 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 539507 2026-02-12T17:34:04.624 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:04.647 INFO:tasks.rados.rados.0.trial082.stdout:1225: finishing copy_from racing read to trial08226312-17 2026-02-12T17:34:04.647 INFO:tasks.rados.rados.0.trial082.stdout:1225: finishing copy_from to trial08226312-17 2026-02-12T17:34:04.647 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 811 (ObjNum 427 snap 134 seq_num 427) dirty exists 2026-02-12T17:34:05.066 INFO:tasks.rados.rados.0.trial082.stdout:1223: done (3 left) 2026-02-12T17:34:05.066 INFO:tasks.rados.rados.0.trial082.stdout:1224: done (2 left) 2026-02-12T17:34:05.067 INFO:tasks.rados.rados.0.trial082.stdout:1225: done (1 left) 2026-02-12T17:34:05.067 INFO:tasks.rados.rados.0.trial082.stdout:1226: done (0 left) 2026-02-12T17:34:05.067 INFO:tasks.rados.rados.0.trial082.stdout:1227: read oid 38 snap -1 2026-02-12T17:34:05.067 INFO:tasks.rados.rados.0.trial082.stdout:1227: expect (ObjNum 395 snap 116 seq_num 395) 2026-02-12T17:34:05.067 INFO:tasks.rados.rados.0.trial082.stdout:1228: snap_create 2026-02-12T17:34:05.070 INFO:tasks.rados.rados.0.trial082.stdout:1227: expect (ObjNum 395 snap 116 seq_num 395) 2026-02-12T17:34:05.121 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:06.069 INFO:tasks.rados.rados.0.trial082.stdout:1227: done (1 left) 2026-02-12T17:34:06.069 INFO:tasks.rados.rados.0.trial082.stdout:1228: done (0 left) 2026-02-12T17:34:06.069 INFO:tasks.rados.rados.0.trial082.stdout:1229: read oid 11 snap -1 2026-02-12T17:34:06.069 INFO:tasks.rados.rados.0.trial082.stdout:1229: expect (ObjNum 376 snap 112 seq_num 376) 2026-02-12T17:34:06.069 INFO:tasks.rados.rados.0.trial082.stdout:1230: write oid 15 current snap is 137 2026-02-12T17:34:06.069 INFO:tasks.rados.rados.0.trial082.stdout:1230: seq_num 433 ranges {477431=698585,1905056=441808,3074744=202687} 2026-02-12T17:34:06.074 INFO:tasks.rados.rados.0.trial082.stdout:1230: writing trial08226312-15 from 477431 to 1176016 tid 1 2026-02-12T17:34:06.078 INFO:tasks.rados.rados.0.trial082.stdout:1230: writing trial08226312-15 from 1905056 to 2346864 tid 2 2026-02-12T17:34:06.082 INFO:tasks.rados.rados.0.trial082.stdout:1230: writing trial08226312-15 from 3074744 to 3277431 tid 3 2026-02-12T17:34:06.082 INFO:tasks.rados.rados.0.trial082.stdout:1231: copy_from oid 40 from oid 30 current snap is 137 2026-02-12T17:34:06.082 INFO:tasks.rados.rados.0.trial082.stdout:1229: expect (ObjNum 376 snap 112 seq_num 376) 2026-02-12T17:34:06.082 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:06.113 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:06.168 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2284667 2026-02-12T17:34:06.168 INFO:tasks.rados.rados.0.trial082.stdout:1230: finishing write tid 1 to trial08226312-15 2026-02-12T17:34:06.168 INFO:tasks.rados.rados.0.trial082.stdout:1230: finishing write tid 2 to trial08226312-15 2026-02-12T17:34:06.168 INFO:tasks.rados.rados.0.trial082.stdout:1229: done (2 left) 2026-02-12T17:34:06.168 INFO:tasks.rados.rados.0.trial082.stdout:1232: write oid 22 current snap is 137 2026-02-12T17:34:06.169 INFO:tasks.rados.rados.0.trial082.stdout:1232: seq_num 434 ranges {494238=490187,1563538=701819,2818520=475718} 2026-02-12T17:34:06.171 INFO:tasks.rados.rados.0.trial082.stdout:1232: writing trial08226312-22 from 494238 to 984425 tid 1 2026-02-12T17:34:06.176 INFO:tasks.rados.rados.0.trial082.stdout:1232: writing trial08226312-22 from 1563538 to 2265357 tid 2 2026-02-12T17:34:06.181 INFO:tasks.rados.rados.0.trial082.stdout:1232: writing trial08226312-22 from 2818520 to 3294238 tid 3 2026-02-12T17:34:06.181 INFO:tasks.rados.rados.0.trial082.stdout:1233: rollback oid 2 current snap is 137 2026-02-12T17:34:06.181 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 124 2026-02-12T17:34:06.181 INFO:tasks.rados.rados.0.trial082.stdout:1230: finishing write tid 3 to trial08226312-15 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1230: finishing write tid 4 to trial08226312-15 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1230: finishing write tid 5 to trial08226312-15 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1230: oid 15 updating version 0 to 814 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1230: oid 15 version 814 is already newer than 811 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1230: oid 15 version 814 is already newer than 813 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1230: oid 15 version 814 is already newer than 812 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 814 (ObjNum 433 snap 137 seq_num 433) dirty exists 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1230: left oid 15 (ObjNum 433 snap 137 seq_num 433) 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1231: finishing copy_from to trial08226312-40 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1231: got expected ENOENT (src dne) 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1231: finishing copy_from racing read to trial08226312-40 2026-02-12T17:34:06.182 INFO:tasks.rados.rados.0.trial082.stdout:1232: finishing write tid 1 to trial08226312-22 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1232: finishing write tid 2 to trial08226312-22 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1230: done (3 left) 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1231: done (2 left) 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1234: rollback oid 31 current snap is 137 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 31 to 125 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1235: read oid 48 snap 124 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1235: expect (ObjNum 381 snap 113 seq_num 381) 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1236: copy_from oid 42 from oid 24 current snap is 137 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1237: rollback oid 12 current snap is 137 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 122 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1238: write oid 39 current snap is 137 2026-02-12T17:34:06.183 INFO:tasks.rados.rados.0.trial082.stdout:1238: seq_num 435 ranges {511045=565436,1622020=445477,2729590=556855} 2026-02-12T17:34:06.185 INFO:tasks.rados.rados.0.trial082.stdout:1238: writing trial08226312-39 from 511045 to 1076481 tid 1 2026-02-12T17:34:06.189 INFO:tasks.rados.rados.0.trial082.stdout:1238: writing trial08226312-39 from 1622020 to 2067497 tid 2 2026-02-12T17:34:06.194 INFO:tasks.rados.rados.0.trial082.stdout:1238: writing trial08226312-39 from 2729590 to 3286445 tid 3 2026-02-12T17:34:06.194 INFO:tasks.rados.rados.0.trial082.stdout:1239: write (excl) oid 36 current snap is 137 2026-02-12T17:34:06.194 INFO:tasks.rados.rados.0.trial082.stdout:1239: seq_num 436 ranges {527852=640685,1680502=589135,2757013=570839} 2026-02-12T17:34:06.199 INFO:tasks.rados.rados.0.trial082.stdout:1239: writing trial08226312-36 from 527852 to 1168537 tid 1 2026-02-12T17:34:06.203 INFO:tasks.rados.rados.0.trial082.stdout:1239: writing trial08226312-36 from 1680502 to 2269637 tid 2 2026-02-12T17:34:06.207 INFO:tasks.rados.rados.0.trial082.stdout:1239: writing trial08226312-36 from 2757013 to 3327852 tid 3 2026-02-12T17:34:06.208 INFO:tasks.rados.rados.0.trial082.stdout:1240: write (excl) oid 37 current snap is 137 2026-02-12T17:34:06.208 INFO:tasks.rados.rados.0.trial082.stdout:1240: seq_num 437 ranges {544659=715934,1738984=449146,2784436=560223} 2026-02-12T17:34:06.212 INFO:tasks.rados.rados.0.trial082.stdout:1240: writing trial08226312-37 from 544659 to 1260593 tid 1 2026-02-12T17:34:06.216 INFO:tasks.rados.rados.0.trial082.stdout:1240: writing trial08226312-37 from 1738984 to 2188130 tid 2 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:1240: writing trial08226312-37 from 2784436 to 3344659 tid 3 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:1241: read oid 9 snap 116 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:1241: expect deleted 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:1242: rollback oid 19 current snap is 137 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 116 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:1232: finishing write tid 3 to trial08226312-22 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:1243: read oid 5 snap 128 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:1243: expect (ObjNum 384 snap 113 seq_num 384) 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:1244: write (excl) oid 47 current snap is 137 2026-02-12T17:34:06.221 INFO:tasks.rados.rados.0.trial082.stdout:1244: seq_num 438 ranges {561466=791183,2081113=592804,3095506=265960} 2026-02-12T17:34:06.225 INFO:tasks.rados.rados.0.trial082.stdout:1244: writing trial08226312-47 from 561466 to 1352649 tid 1 2026-02-12T17:34:06.230 INFO:tasks.rados.rados.0.trial082.stdout:1244: writing trial08226312-47 from 2081113 to 2673917 tid 2 2026-02-12T17:34:06.233 INFO:tasks.rados.rados.0.trial082.stdout:1244: writing trial08226312-47 from 3095506 to 3361466 tid 3 2026-02-12T17:34:06.233 INFO:tasks.rados.rados.0.trial082.stdout:1245: snap_remove snap 127 2026-02-12T17:34:06.233 INFO:tasks.rados.rados.0.trial082.stdout:1232: finishing write tid 4 to trial08226312-22 2026-02-12T17:34:06.233 INFO:tasks.rados.rados.0.trial082.stdout:1232: finishing write tid 5 to trial08226312-22 2026-02-12T17:34:06.233 INFO:tasks.rados.rados.0.trial082.stdout:1232: oid 22 updating version 0 to 802 2026-02-12T17:34:06.233 INFO:tasks.rados.rados.0.trial082.stdout:1232: oid 22 updating version 802 to 803 2026-02-12T17:34:06.233 INFO:tasks.rados.rados.0.trial082.stdout:1232: oid 22 updating version 803 to 805 2026-02-12T17:34:06.233 INFO:tasks.rados.rados.0.trial082.stdout:1232: oid 22 version 805 is already newer than 804 2026-02-12T17:34:06.234 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 805 (ObjNum 434 snap 137 seq_num 434) dirty exists 2026-02-12T17:34:06.234 INFO:tasks.rados.rados.0.trial082.stdout:1232: left oid 22 (ObjNum 434 snap 137 seq_num 434) 2026-02-12T17:34:06.234 INFO:tasks.rados.rados.0.trial082.stdout:1235: expect (ObjNum 381 snap 113 seq_num 381) 2026-02-12T17:34:06.242 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1635354 2026-02-12T17:34:06.256 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1051546 2026-02-12T17:34:06.284 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2011789 2026-02-12T17:34:06.292 INFO:tasks.rados.rados.0.trial082.stdout:1233: finishing rollback tid 0 to trial08226312-2 2026-02-12T17:34:06.292 INFO:tasks.rados.rados.0.trial082.stdout:1233: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:34:06.292 INFO:tasks.rados.rados.0.trial082.stdout:1237: finishing rollback tid 0 to trial08226312-12 2026-02-12T17:34:06.292 INFO:tasks.rados.rados.0.trial082.stdout:1237: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:34:06.292 INFO:tasks.rados.rados.0.trial082.stdout:1233: finishing rollback tid 2 to trial08226312-2 2026-02-12T17:34:06.292 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 276 (ObjNum 385 snap 113 seq_num 385) dirty exists 2026-02-12T17:34:06.292 INFO:tasks.rados.rados.0.trial082.stdout:1234: finishing rollback tid 0 to trial08226312-31 2026-02-12T17:34:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1232: done (13 left) 2026-02-12T17:34:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1233: done (12 left) 2026-02-12T17:34:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1235: done (11 left) 2026-02-12T17:34:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1245: done (10 left) 2026-02-12T17:34:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1246: write oid 6 current snap is 137 2026-02-12T17:34:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1246: seq_num 439 ranges {578273=466432,1739595=452815,2722929=655344} 2026-02-12T17:34:07.075 INFO:tasks.rados.rados.0.trial082.stdout:1246: writing trial08226312-6 from 578273 to 1044705 tid 1 2026-02-12T17:34:07.080 INFO:tasks.rados.rados.0.trial082.stdout:1246: writing trial08226312-6 from 1739595 to 2192410 tid 2 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:1246: writing trial08226312-6 from 2722929 to 3378273 tid 3 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:1247: read oid 41 snap -1 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:1247: expect (ObjNum 380 snap 113 seq_num 380) 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:1248: delete oid 3 current snap is 137 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:1234: finishing rollback tid 1 to trial08226312-31 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:1237: finishing rollback tid 2 to trial08226312-12 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 631 (ObjNum 297 snap 83 seq_num 297) dirty exists 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:1234: finishing rollback tid 2 to trial08226312-31 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 276 (ObjNum 227 snap 61 seq_num 227) dirty exists 2026-02-12T17:34:07.086 INFO:tasks.rados.rados.0.trial082.stdout:1236: finishing copy_from racing read to trial08226312-42 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1238: finishing write tid 1 to trial08226312-39 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1236: finishing copy_from to trial08226312-42 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 800 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1238: finishing write tid 2 to trial08226312-39 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1238: finishing write tid 3 to trial08226312-39 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1238: finishing write tid 4 to trial08226312-39 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1238: finishing write tid 5 to trial08226312-39 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1238: oid 39 updating version 0 to 280 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1238: oid 39 version 280 is already newer than 279 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1238: oid 39 version 280 is already newer than 277 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1238: oid 39 version 280 is already newer than 278 2026-02-12T17:34:07.087 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 280 (ObjNum 435 snap 137 seq_num 435) dirty exists 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1238: left oid 39 (ObjNum 435 snap 137 seq_num 435) 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: finishing write tid 1 to trial08226312-36 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: finishing write tid 2 to trial08226312-36 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: finishing write tid 3 to trial08226312-36 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: finishing write tid 4 to trial08226312-36 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: finishing write tid 5 to trial08226312-36 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: oid 36 updating version 0 to 815 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: oid 36 version 815 is already newer than 814 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: oid 36 version 815 is already newer than 812 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: oid 36 version 815 is already newer than 813 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 815 (ObjNum 436 snap 137 seq_num 436) dirty exists 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1239: left oid 36 (ObjNum 436 snap 137 seq_num 436) 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1240: finishing write tid 1 to trial08226312-37 2026-02-12T17:34:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1240: finishing write tid 2 to trial08226312-37 2026-02-12T17:34:07.089 INFO:tasks.rados.rados.0.trial082.stdout:1242: finishing rollback tid 0 to trial08226312-19 2026-02-12T17:34:07.089 INFO:tasks.rados.rados.0.trial082.stdout:1242: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:34:07.089 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 836 (ObjNum 49 snap 0 seq_num 26750679) dirty dne 2026-02-12T17:34:07.089 INFO:tasks.rados.rados.0.trial082.stdout:1243: expect (ObjNum 384 snap 113 seq_num 384) 2026-02-12T17:34:07.121 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 632655 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:1240: finishing write tid 3 to trial08226312-37 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:1240: finishing write tid 4 to trial08226312-37 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:1240: finishing write tid 5 to trial08226312-37 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:1240: oid 37 updating version 0 to 633 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:1240: oid 37 updating version 633 to 635 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:1240: oid 37 version 635 is already newer than 634 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:1240: oid 37 version 635 is already newer than 632 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 635 (ObjNum 437 snap 137 seq_num 437) dirty exists 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:1240: left oid 37 (ObjNum 437 snap 137 seq_num 437) 2026-02-12T17:34:07.189 INFO:tasks.rados.rados.0.trial082.stdout:1244: finishing write tid 1 to trial08226312-47 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1234: done (12 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1236: done (11 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1237: done (10 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1238: done (9 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1239: done (8 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1240: done (7 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1241: done (6 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1242: done (5 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1243: done (4 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1248: done (3 left) 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1249: write (excl) oid 10 current snap is 137 2026-02-12T17:34:07.190 INFO:tasks.rados.rados.0.trial082.stdout:1249: seq_num 441 ranges {611887=733283,1972912=456484,2894128=517759} 2026-02-12T17:34:07.193 INFO:tasks.rados.rados.0.trial082.stdout:1249: writing trial08226312-10 from 611887 to 1345170 tid 1 2026-02-12T17:34:07.197 INFO:tasks.rados.rados.0.trial082.stdout:1249: writing trial08226312-10 from 1972912 to 2429396 tid 2 2026-02-12T17:34:07.201 INFO:tasks.rados.rados.0.trial082.stdout:1249: writing trial08226312-10 from 2894128 to 3411887 tid 3 2026-02-12T17:34:07.201 INFO:tasks.rados.rados.0.trial082.stdout:1250: rollback oid 3 current snap is 137 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 115 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1244: finishing write tid 2 to trial08226312-47 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1244: finishing write tid 3 to trial08226312-47 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1244: finishing write tid 4 to trial08226312-47 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1244: finishing write tid 5 to trial08226312-47 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1244: oid 47 updating version 0 to 838 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1244: oid 47 updating version 838 to 840 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1244: oid 47 version 840 is already newer than 839 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1244: oid 47 updating version 840 to 841 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 841 (ObjNum 438 snap 137 seq_num 438) dirty exists 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1244: left oid 47 (ObjNum 438 snap 137 seq_num 438) 2026-02-12T17:34:07.202 INFO:tasks.rados.rados.0.trial082.stdout:1246: finishing write tid 1 to trial08226312-6 2026-02-12T17:34:07.203 INFO:tasks.rados.rados.0.trial082.stdout:1246: finishing write tid 2 to trial08226312-6 2026-02-12T17:34:07.203 INFO:tasks.rados.rados.0.trial082.stdout:1246: finishing write tid 3 to trial08226312-6 2026-02-12T17:34:07.203 INFO:tasks.rados.rados.0.trial082.stdout:1244: done (4 left) 2026-02-12T17:34:07.203 INFO:tasks.rados.rados.0.trial082.stdout:1251: read oid 17 snap -1 2026-02-12T17:34:07.203 INFO:tasks.rados.rados.0.trial082.stdout:1251: expect (ObjNum 427 snap 134 seq_num 427) 2026-02-12T17:34:07.203 INFO:tasks.rados.rados.0.trial082.stdout:1252: write oid 14 current snap is 137 2026-02-12T17:34:07.203 INFO:tasks.rados.rados.0.trial082.stdout:1252: seq_num 442 ranges {628694=408532,1515041=600142,2805198=552112} 2026-02-12T17:34:07.205 INFO:tasks.rados.rados.0.trial082.stdout:1252: writing trial08226312-14 from 628694 to 1037226 tid 1 2026-02-12T17:34:07.209 INFO:tasks.rados.rados.0.trial082.stdout:1252: writing trial08226312-14 from 1515041 to 2115183 tid 2 2026-02-12T17:34:07.214 INFO:tasks.rados.rados.0.trial082.stdout:1252: writing trial08226312-14 from 2805198 to 3357310 tid 3 2026-02-12T17:34:07.214 INFO:tasks.rados.rados.0.trial082.stdout:1253: read oid 50 snap -1 2026-02-12T17:34:07.214 INFO:tasks.rados.rados.0.trial082.stdout:1253: expect (ObjNum 413 snap 124 seq_num 413) 2026-02-12T17:34:07.214 INFO:tasks.rados.rados.0.trial082.stdout:1254: read oid 43 snap 121 2026-02-12T17:34:07.214 INFO:tasks.rados.rados.0.trial082.stdout:1254: expect (ObjNum 399 snap 119 seq_num 399) 2026-02-12T17:34:07.214 INFO:tasks.rados.rados.0.trial082.stdout:1255: write oid 45 current snap is 137 2026-02-12T17:34:07.214 INFO:tasks.rados.rados.0.trial082.stdout:1255: seq_num 443 ranges {645501=483781,1573523=460153,2548974=763384} 2026-02-12T17:34:07.217 INFO:tasks.rados.rados.0.trial082.stdout:1255: writing trial08226312-45 from 645501 to 1129282 tid 1 2026-02-12T17:34:07.221 INFO:tasks.rados.rados.0.trial082.stdout:1255: writing trial08226312-45 from 1573523 to 2033676 tid 2 2026-02-12T17:34:07.226 INFO:tasks.rados.rados.0.trial082.stdout:1255: writing trial08226312-45 from 2548974 to 3312358 tid 3 2026-02-12T17:34:07.226 INFO:tasks.rados.rados.0.trial082.stdout:1256: copy_from oid 49 from oid 24 current snap is 137 2026-02-12T17:34:07.226 INFO:tasks.rados.rados.0.trial082.stdout:1246: finishing write tid 4 to trial08226312-6 2026-02-12T17:34:07.226 INFO:tasks.rados.rados.0.trial082.stdout:1246: finishing write tid 5 to trial08226312-6 2026-02-12T17:34:07.226 INFO:tasks.rados.rados.0.trial082.stdout:1246: oid 6 updating version 0 to 273 2026-02-12T17:34:07.226 INFO:tasks.rados.rados.0.trial082.stdout:1246: oid 6 updating version 273 to 274 2026-02-12T17:34:07.227 INFO:tasks.rados.rados.0.trial082.stdout:1246: oid 6 updating version 274 to 275 2026-02-12T17:34:07.227 INFO:tasks.rados.rados.0.trial082.stdout:1246: oid 6 version 275 is already newer than 272 2026-02-12T17:34:07.227 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 275 (ObjNum 439 snap 137 seq_num 439) dirty exists 2026-02-12T17:34:07.227 INFO:tasks.rados.rados.0.trial082.stdout:1246: left oid 6 (ObjNum 439 snap 137 seq_num 439) 2026-02-12T17:34:07.227 INFO:tasks.rados.rados.0.trial082.stdout:1247: expect (ObjNum 380 snap 113 seq_num 380) 2026-02-12T17:34:07.247 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2062019 2026-02-12T17:34:07.248 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:07.266 INFO:tasks.rados.rados.0.trial082.stdout:1249: finishing write tid 1 to trial08226312-10 2026-02-12T17:34:07.266 INFO:tasks.rados.rados.0.trial082.stdout:1249: finishing write tid 2 to trial08226312-10 2026-02-12T17:34:07.266 INFO:tasks.rados.rados.0.trial082.stdout:1250: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:34:07.266 INFO:tasks.rados.rados.0.trial082.stdout:1249: finishing write tid 3 to trial08226312-10 2026-02-12T17:34:07.266 INFO:tasks.rados.rados.0.trial082.stdout:1250: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:34:07.266 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 817 (ObjNum 248 snap 70 seq_num 248) dirty exists 2026-02-12T17:34:07.266 INFO:tasks.rados.rados.0.trial082.stdout:1249: finishing write tid 4 to trial08226312-10 2026-02-12T17:34:07.266 INFO:tasks.rados.rados.0.trial082.stdout:1249: finishing write tid 5 to trial08226312-10 2026-02-12T17:34:07.266 INFO:tasks.rados.rados.0.trial082.stdout:1249: oid 10 updating version 0 to 809 2026-02-12T17:34:07.267 INFO:tasks.rados.rados.0.trial082.stdout:1249: oid 10 version 809 is already newer than 808 2026-02-12T17:34:07.267 INFO:tasks.rados.rados.0.trial082.stdout:1249: oid 10 version 809 is already newer than 807 2026-02-12T17:34:07.267 INFO:tasks.rados.rados.0.trial082.stdout:1249: oid 10 version 809 is already newer than 806 2026-02-12T17:34:07.267 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 809 (ObjNum 441 snap 137 seq_num 441) dirty exists 2026-02-12T17:34:07.267 INFO:tasks.rados.rados.0.trial082.stdout:1249: left oid 10 (ObjNum 441 snap 137 seq_num 441) 2026-02-12T17:34:07.267 INFO:tasks.rados.rados.0.trial082.stdout:1251: expect (ObjNum 427 snap 134 seq_num 427) 2026-02-12T17:34:07.283 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2582494 2026-02-12T17:34:07.291 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 625160 2026-02-12T17:34:07.347 INFO:tasks.rados.rados.0.trial082.stdout:1252: finishing write tid 1 to trial08226312-14 2026-02-12T17:34:07.348 INFO:tasks.rados.rados.0.trial082.stdout:1252: finishing write tid 2 to trial08226312-14 2026-02-12T17:34:07.348 INFO:tasks.rados.rados.0.trial082.stdout:1252: finishing write tid 3 to trial08226312-14 2026-02-12T17:34:07.348 INFO:tasks.rados.rados.0.trial082.stdout:1252: finishing write tid 4 to trial08226312-14 2026-02-12T17:34:07.348 INFO:tasks.rados.rados.0.trial082.stdout:1252: finishing write tid 5 to trial08226312-14 2026-02-12T17:34:07.348 INFO:tasks.rados.rados.0.trial082.stdout:1252: oid 14 updating version 0 to 821 2026-02-12T17:34:07.348 INFO:tasks.rados.rados.0.trial082.stdout:1252: oid 14 version 821 is already newer than 819 2026-02-12T17:34:07.348 INFO:tasks.rados.rados.0.trial082.stdout:1252: oid 14 version 821 is already newer than 820 2026-02-12T17:34:07.348 INFO:tasks.rados.rados.0.trial082.stdout:1252: oid 14 version 821 is already newer than 818 2026-02-12T17:34:07.349 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 821 (ObjNum 442 snap 137 seq_num 442) dirty exists 2026-02-12T17:34:07.349 INFO:tasks.rados.rados.0.trial082.stdout:1252: left oid 14 (ObjNum 442 snap 137 seq_num 442) 2026-02-12T17:34:07.349 INFO:tasks.rados.rados.0.trial082.stdout:1254: expect (ObjNum 399 snap 119 seq_num 399) 2026-02-12T17:34:07.358 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1425159 2026-02-12T17:34:07.412 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:07.450 INFO:tasks.rados.rados.0.trial082.stdout:1253: expect (ObjNum 413 snap 124 seq_num 413) 2026-02-12T17:34:07.474 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2300649 2026-02-12T17:34:07.561 INFO:tasks.rados.rados.0.trial082.stdout:1255: finishing write tid 1 to trial08226312-45 2026-02-12T17:34:07.561 INFO:tasks.rados.rados.0.trial082.stdout:1255: finishing write tid 2 to trial08226312-45 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:1255: finishing write tid 3 to trial08226312-45 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:1255: finishing write tid 4 to trial08226312-45 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:1255: finishing write tid 5 to trial08226312-45 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:1255: oid 45 updating version 0 to 818 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:1255: oid 45 updating version 818 to 819 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:1255: oid 45 version 819 is already newer than 816 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:1255: oid 45 version 819 is already newer than 817 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 819 (ObjNum 443 snap 137 seq_num 443) dirty exists 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:1255: left oid 45 (ObjNum 443 snap 137 seq_num 443) 2026-02-12T17:34:07.562 INFO:tasks.rados.rados.0.trial082.stdout:1256: finishing copy_from racing read to trial08226312-49 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1246: done (9 left) 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1247: done (8 left) 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1249: done (7 left) 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1250: done (6 left) 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1251: done (5 left) 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1252: done (4 left) 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1253: done (3 left) 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1254: done (2 left) 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1255: done (1 left) 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1257: rollback oid 8 current snap is 137 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 115 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1256: finishing copy_from to trial08226312-49 2026-02-12T17:34:07.563 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 800 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:34:07.564 INFO:tasks.rados.rados.0.trial082.stdout:1256: done (1 left) 2026-02-12T17:34:07.564 INFO:tasks.rados.rados.0.trial082.stdout:1258: read oid 15 snap -1 2026-02-12T17:34:07.564 INFO:tasks.rados.rados.0.trial082.stdout:1258: expect (ObjNum 433 snap 137 seq_num 433) 2026-02-12T17:34:07.564 INFO:tasks.rados.rados.0.trial082.stdout:1259: read oid 47 snap -1 2026-02-12T17:34:07.564 INFO:tasks.rados.rados.0.trial082.stdout:1259: expect (ObjNum 438 snap 137 seq_num 438) 2026-02-12T17:34:07.564 INFO:tasks.rados.rados.0.trial082.stdout:1260: snap_create 2026-02-12T17:34:07.565 INFO:tasks.rados.rados.0.trial082.stdout:1257: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:34:07.565 INFO:tasks.rados.rados.0.trial082.stdout:1258: expect (ObjNum 433 snap 137 seq_num 433) 2026-02-12T17:34:07.575 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3199271 2026-02-12T17:34:07.599 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:07.623 INFO:tasks.rados.rados.0.trial082.stdout:1257: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:34:07.623 INFO:tasks.rados.rados.0.trial082.stdout:1259: expect (ObjNum 438 snap 137 seq_num 438) 2026-02-12T17:34:07.701 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3121760 2026-02-12T17:34:07.748 INFO:tasks.rados.rados.0.trial082.stdout:1257: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:34:07.748 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 849 (ObjNum 308 snap 88 seq_num 308) dirty exists 2026-02-12T17:34:08.834 INFO:tasks.rados.rados.0.trial082.stdout:1257: done (3 left) 2026-02-12T17:34:08.834 INFO:tasks.rados.rados.0.trial082.stdout:1258: done (2 left) 2026-02-12T17:34:08.834 INFO:tasks.rados.rados.0.trial082.stdout:1259: done (1 left) 2026-02-12T17:34:08.835 INFO:tasks.rados.rados.0.trial082.stdout:1260: done (0 left) 2026-02-12T17:34:08.835 INFO:tasks.rados.rados.0.trial082.stdout:1261: write oid 30 current snap is 138 2026-02-12T17:34:08.835 INFO:tasks.rados.rados.0.trial082.stdout:1261: seq_num 444 ranges {662308=559030,1632005=603811,2860044=602264} 2026-02-12T17:34:08.839 INFO:tasks.rados.rados.0.trial082.stdout:1261: writing trial08226312-30 from 662308 to 1221338 tid 1 2026-02-12T17:34:08.843 INFO:tasks.rados.rados.0.trial082.stdout:1261: writing trial08226312-30 from 1632005 to 2235816 tid 2 2026-02-12T17:34:08.848 INFO:tasks.rados.rados.0.trial082.stdout:1261: writing trial08226312-30 from 2860044 to 3462308 tid 3 2026-02-12T17:34:08.848 INFO:tasks.rados.rados.0.trial082.stdout:1262: read oid 36 snap 117 2026-02-12T17:34:08.848 INFO:tasks.rados.rados.0.trial082.stdout:1262: expect (ObjNum 244 snap 68 seq_num 244) 2026-02-12T17:34:08.848 INFO:tasks.rados.rados.0.trial082.stdout:1263: read oid 13 snap 135 2026-02-12T17:34:08.848 INFO:tasks.rados.rados.0.trial082.stdout:1263: expect deleted 2026-02-12T17:34:08.848 INFO:tasks.rados.rados.0.trial082.stdout:1264: rollback oid 22 current snap is 138 2026-02-12T17:34:08.848 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 116 2026-02-12T17:34:08.849 INFO:tasks.rados.rados.0.trial082.stdout:1261: finishing write tid 1 to trial08226312-30 2026-02-12T17:34:08.849 INFO:tasks.rados.rados.0.trial082.stdout:1261: finishing write tid 2 to trial08226312-30 2026-02-12T17:34:08.849 INFO:tasks.rados.rados.0.trial082.stdout:1265: snap_remove snap 125 2026-02-12T17:34:09.835 INFO:tasks.rados.rados.0.trial082.stdout:1265: done (4 left) 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:1266: delete oid 35 current snap is 138 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:1261: finishing write tid 3 to trial08226312-30 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:1261: finishing write tid 4 to trial08226312-30 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:1261: finishing write tid 5 to trial08226312-30 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:1261: oid 30 updating version 0 to 811 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:1261: oid 30 updating version 811 to 813 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:1261: oid 30 version 813 is already newer than 810 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:1261: oid 30 version 813 is already newer than 812 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 813 (ObjNum 444 snap 138 seq_num 444) dirty exists 2026-02-12T17:34:09.836 INFO:tasks.rados.rados.0.trial082.stdout:1261: left oid 30 (ObjNum 444 snap 138 seq_num 444) 2026-02-12T17:34:09.837 INFO:tasks.rados.rados.0.trial082.stdout:1264: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:34:09.837 INFO:tasks.rados.rados.0.trial082.stdout:1264: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:34:09.837 INFO:tasks.rados.rados.0.trial082.stdout:1264: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:34:09.837 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 816 (ObjNum 341 snap 103 seq_num 341) dirty exists 2026-02-12T17:34:09.837 INFO:tasks.rados.rados.0.trial082.stdout:1262: expect (ObjNum 244 snap 68 seq_num 244) 2026-02-12T17:34:09.847 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:09.876 INFO:tasks.rados.rados.0.trial082.stdout:1261: done (4 left) 2026-02-12T17:34:09.876 INFO:tasks.rados.rados.0.trial082.stdout:1262: done (3 left) 2026-02-12T17:34:09.877 INFO:tasks.rados.rados.0.trial082.stdout:1263: done (2 left) 2026-02-12T17:34:09.877 INFO:tasks.rados.rados.0.trial082.stdout:1264: done (1 left) 2026-02-12T17:34:09.877 INFO:tasks.rados.rados.0.trial082.stdout:1266: done (0 left) 2026-02-12T17:34:09.877 INFO:tasks.rados.rados.0.trial082.stdout:1267: snap_create 2026-02-12T17:34:10.836 INFO:tasks.rados.rados.0.trial082.stdout:1267: done (0 left) 2026-02-12T17:34:10.836 INFO:tasks.rados.rados.0.trial082.stdout:1268: snap_remove snap 134 2026-02-12T17:34:11.836 INFO:tasks.rados.rados.0.trial082.stdout:1268: done (0 left) 2026-02-12T17:34:11.837 INFO:tasks.rados.rados.0.trial082.stdout:1269: snap_remove snap 135 2026-02-12T17:34:12.838 INFO:tasks.rados.rados.0.trial082.stdout:1269: done (0 left) 2026-02-12T17:34:12.838 INFO:tasks.rados.rados.0.trial082.stdout:1270: read oid 13 snap 124 2026-02-12T17:34:12.838 INFO:tasks.rados.rados.0.trial082.stdout:1270: expect deleted 2026-02-12T17:34:12.838 INFO:tasks.rados.rados.0.trial082.stdout:1271: snap_remove snap 131 2026-02-12T17:34:13.036 INFO:tasks.rados.rados.0.trial082.stdout:1271: done (1 left) 2026-02-12T17:34:13.036 INFO:tasks.rados.rados.0.trial082.stdout:1272: snap_create 2026-02-12T17:34:14.037 INFO:tasks.rados.rados.0.trial082.stdout:1270: done (1 left) 2026-02-12T17:34:14.037 INFO:tasks.rados.rados.0.trial082.stdout:1272: done (0 left) 2026-02-12T17:34:14.037 INFO:tasks.rados.rados.0.trial082.stdout:1273: delete oid 1 current snap is 140 2026-02-12T17:34:14.038 INFO:tasks.rados.rados.0.trial082.stdout:1273: done (0 left) 2026-02-12T17:34:14.038 INFO:tasks.rados.rados.0.trial082.stdout:1274: snap_create 2026-02-12T17:34:15.039 INFO:tasks.rados.rados.0.trial082.stdout:1274: done (0 left) 2026-02-12T17:34:15.040 INFO:tasks.rados.rados.0.trial082.stdout:1275: rollback oid 2 current snap is 141 2026-02-12T17:34:15.040 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 139 2026-02-12T17:34:15.040 INFO:tasks.rados.rados.0.trial082.stdout:1276: rollback oid 41 current snap is 141 2026-02-12T17:34:15.040 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 136 2026-02-12T17:34:15.040 INFO:tasks.rados.rados.0.trial082.stdout:1277: write (excl) oid 31 current snap is 141 2026-02-12T17:34:15.040 INFO:tasks.rados.rados.0.trial082.stdout:1277: seq_num 447 ranges {712729=784777,2091098=467491,3342313=170416} 2026-02-12T17:34:15.046 INFO:tasks.rados.rados.0.trial082.stdout:1277: writing trial08226312-31 from 712729 to 1497506 tid 1 2026-02-12T17:34:15.050 INFO:tasks.rados.rados.0.trial082.stdout:1277: writing trial08226312-31 from 2091098 to 2558589 tid 2 2026-02-12T17:34:15.055 INFO:tasks.rados.rados.0.trial082.stdout:1277: writing trial08226312-31 from 3342313 to 3512729 tid 3 2026-02-12T17:34:15.055 INFO:tasks.rados.rados.0.trial082.stdout:1278: rollback oid 5 current snap is 141 2026-02-12T17:34:15.055 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 5 to 130 2026-02-12T17:34:15.055 INFO:tasks.rados.rados.0.trial082.stdout:1276: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:34:15.055 INFO:tasks.rados.rados.0.trial082.stdout:1276: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:34:15.055 INFO:tasks.rados.rados.0.trial082.stdout:1275: finishing rollback tid 0 to trial08226312-2 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:1275: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:1276: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 638 (ObjNum 380 snap 113 seq_num 380) dirty exists 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:1275: finishing rollback tid 2 to trial08226312-2 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 283 (ObjNum 385 snap 113 seq_num 385) dirty exists 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:1277: finishing write tid 1 to trial08226312-31 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:1277: finishing write tid 2 to trial08226312-31 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:1275: done (3 left) 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:1276: done (2 left) 2026-02-12T17:34:15.056 INFO:tasks.rados.rados.0.trial082.stdout:1279: read oid 13 snap 137 2026-02-12T17:34:15.057 INFO:tasks.rados.rados.0.trial082.stdout:1279: expect deleted 2026-02-12T17:34:15.057 INFO:tasks.rados.rados.0.trial082.stdout:1280: snap_create 2026-02-12T17:34:15.057 INFO:tasks.rados.rados.0.trial082.stdout:1278: finishing rollback tid 0 to trial08226312-5 2026-02-12T17:34:15.058 INFO:tasks.rados.rados.0.trial082.stdout:1278: finishing rollback tid 1 to trial08226312-5 2026-02-12T17:34:15.058 INFO:tasks.rados.rados.0.trial082.stdout:1278: finishing rollback tid 2 to trial08226312-5 2026-02-12T17:34:15.058 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 824 (ObjNum 384 snap 113 seq_num 384) dirty exists 2026-02-12T17:34:15.065 INFO:tasks.rados.rados.0.trial082.stdout:1277: finishing write tid 3 to trial08226312-31 2026-02-12T17:34:15.065 INFO:tasks.rados.rados.0.trial082.stdout:1277: finishing write tid 4 to trial08226312-31 2026-02-12T17:34:15.065 INFO:tasks.rados.rados.0.trial082.stdout:1277: finishing write tid 5 to trial08226312-31 2026-02-12T17:34:15.065 INFO:tasks.rados.rados.0.trial082.stdout:1277: oid 31 updating version 0 to 280 2026-02-12T17:34:15.065 INFO:tasks.rados.rados.0.trial082.stdout:1277: oid 31 version 280 is already newer than 278 2026-02-12T17:34:15.065 INFO:tasks.rados.rados.0.trial082.stdout:1277: oid 31 version 280 is already newer than 277 2026-02-12T17:34:15.066 INFO:tasks.rados.rados.0.trial082.stdout:1277: oid 31 version 280 is already newer than 279 2026-02-12T17:34:15.066 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 280 (ObjNum 447 snap 141 seq_num 447) dirty exists 2026-02-12T17:34:15.066 INFO:tasks.rados.rados.0.trial082.stdout:1277: left oid 31 (ObjNum 447 snap 141 seq_num 447) 2026-02-12T17:34:16.040 INFO:tasks.rados.rados.0.trial082.stdout:1277: done (3 left) 2026-02-12T17:34:16.040 INFO:tasks.rados.rados.0.trial082.stdout:1278: done (2 left) 2026-02-12T17:34:16.040 INFO:tasks.rados.rados.0.trial082.stdout:1279: done (1 left) 2026-02-12T17:34:16.040 INFO:tasks.rados.rados.0.trial082.stdout:1280: done (0 left) 2026-02-12T17:34:16.040 INFO:tasks.rados.rados.0.trial082.stdout:1281: read oid 43 snap -1 2026-02-12T17:34:16.040 INFO:tasks.rados.rados.0.trial082.stdout:1281: expect (ObjNum 399 snap 119 seq_num 399) 2026-02-12T17:34:16.040 INFO:tasks.rados.rados.0.trial082.stdout:1282: read oid 36 snap -1 2026-02-12T17:34:16.040 INFO:tasks.rados.rados.0.trial082.stdout:1282: expect (ObjNum 436 snap 137 seq_num 436) 2026-02-12T17:34:16.040 INFO:tasks.rados.rados.0.trial082.stdout:1283: delete oid 21 current snap is 142 2026-02-12T17:34:16.041 INFO:tasks.rados.rados.0.trial082.stdout:1281: expect (ObjNum 399 snap 119 seq_num 399) 2026-02-12T17:34:16.148 INFO:tasks.rados.rados.0.trial082.stdout:1282: expect (ObjNum 436 snap 137 seq_num 436) 2026-02-12T17:34:16.148 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:16.225 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 74092 2026-02-12T17:34:16.264 INFO:tasks.rados.rados.0.trial082.stdout:1281: done (2 left) 2026-02-12T17:34:16.264 INFO:tasks.rados.rados.0.trial082.stdout:1282: done (1 left) 2026-02-12T17:34:16.264 INFO:tasks.rados.rados.0.trial082.stdout:1283: done (0 left) 2026-02-12T17:34:16.264 INFO:tasks.rados.rados.0.trial082.stdout:1284: read oid 46 snap 128 2026-02-12T17:34:16.265 INFO:tasks.rados.rados.0.trial082.stdout:1284: expect (ObjNum 408 snap 122 seq_num 408) 2026-02-12T17:34:16.265 INFO:tasks.rados.rados.0.trial082.stdout:1285: delete oid 39 current snap is 142 2026-02-12T17:34:16.266 INFO:tasks.rados.rados.0.trial082.stdout:1285: done (1 left) 2026-02-12T17:34:16.266 INFO:tasks.rados.rados.0.trial082.stdout:1286: read oid 36 snap -1 2026-02-12T17:34:16.266 INFO:tasks.rados.rados.0.trial082.stdout:1286: expect (ObjNum 436 snap 137 seq_num 436) 2026-02-12T17:34:16.266 INFO:tasks.rados.rados.0.trial082.stdout:1287: copy_from oid 30 from oid 37 current snap is 142 2026-02-12T17:34:16.266 INFO:tasks.rados.rados.0.trial082.stdout:1288: rollback oid 8 current snap is 142 2026-02-12T17:34:16.266 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 137 2026-02-12T17:34:16.266 INFO:tasks.rados.rados.0.trial082.stdout:1289: snap_remove snap 116 2026-02-12T17:34:17.047 INFO:tasks.rados.rados.0.trial082.stdout:1289: done (4 left) 2026-02-12T17:34:17.047 INFO:tasks.rados.rados.0.trial082.stdout:1290: write oid 22 current snap is 142 2026-02-12T17:34:17.047 INFO:tasks.rados.rados.0.trial082.stdout:1290: seq_num 450 ranges {763150=726877,1982897=614818,3024582=474994} 2026-02-12T17:34:17.053 INFO:tasks.rados.rados.0.trial082.stdout:1290: writing trial08226312-22 from 763150 to 1490027 tid 1 2026-02-12T17:34:17.057 INFO:tasks.rados.rados.0.trial082.stdout:1290: writing trial08226312-22 from 1982897 to 2597715 tid 2 2026-02-12T17:34:17.061 INFO:tasks.rados.rados.0.trial082.stdout:1290: writing trial08226312-22 from 3024582 to 3499576 tid 3 2026-02-12T17:34:17.061 INFO:tasks.rados.rados.0.trial082.stdout:1291: rollback oid 33 current snap is 142 2026-02-12T17:34:17.062 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 124 2026-02-12T17:34:17.062 INFO:tasks.rados.rados.0.trial082.stdout:1284: expect (ObjNum 408 snap 122 seq_num 408) 2026-02-12T17:34:17.094 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1549956 2026-02-12T17:34:17.140 INFO:tasks.rados.rados.0.trial082.stdout:1288: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:34:17.140 INFO:tasks.rados.rados.0.trial082.stdout:1286: expect (ObjNum 436 snap 137 seq_num 436) 2026-02-12T17:34:17.232 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1684561 2026-02-12T17:34:17.252 INFO:tasks.rados.rados.0.trial082.stdout:1288: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:34:17.252 INFO:tasks.rados.rados.0.trial082.stdout:1288: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:34:17.252 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 879 (ObjNum 308 snap 88 seq_num 308) dirty exists 2026-02-12T17:34:17.252 INFO:tasks.rados.rados.0.trial082.stdout:1287: finishing copy_from racing read to trial08226312-30 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1284: done (5 left) 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1286: done (4 left) 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1288: done (3 left) 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1292: copy_from oid 21 from oid 17 current snap is 142 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1287: finishing copy_from to trial08226312-30 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 635 (ObjNum 437 snap 137 seq_num 437) dirty exists 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1290: finishing write tid 1 to trial08226312-22 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1290: finishing write tid 2 to trial08226312-22 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1290: finishing write tid 3 to trial08226312-22 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1290: finishing write tid 4 to trial08226312-22 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1290: finishing write tid 5 to trial08226312-22 2026-02-12T17:34:17.253 INFO:tasks.rados.rados.0.trial082.stdout:1290: oid 22 updating version 0 to 821 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1290: oid 22 version 821 is already newer than 820 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1290: oid 22 version 821 is already newer than 818 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1290: oid 22 version 821 is already newer than 819 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 821 (ObjNum 450 snap 142 seq_num 450) dirty exists 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1290: left oid 22 (ObjNum 450 snap 142 seq_num 450) 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1291: finishing rollback tid 0 to trial08226312-33 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1291: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1291: finishing rollback tid 2 to trial08226312-33 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 641 (ObjNum 409 snap 122 seq_num 409) dirty exists 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1287: done (3 left) 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1290: done (2 left) 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1291: done (1 left) 2026-02-12T17:34:17.254 INFO:tasks.rados.rados.0.trial082.stdout:1293: delete oid 28 current snap is 142 2026-02-12T17:34:17.255 INFO:tasks.rados.rados.0.trial082.stdout:1293: done (1 left) 2026-02-12T17:34:17.255 INFO:tasks.rados.rados.0.trial082.stdout:1294: read oid 48 snap -1 2026-02-12T17:34:17.255 INFO:tasks.rados.rados.0.trial082.stdout:1294: expect (ObjNum 381 snap 113 seq_num 381) 2026-02-12T17:34:17.255 INFO:tasks.rados.rados.0.trial082.stdout:1295: write oid 27 current snap is 142 2026-02-12T17:34:17.255 INFO:tasks.rados.rados.0.trial082.stdout:1295: seq_num 452 ranges {796764=477375,1983508=618487,3363075=233689} 2026-02-12T17:34:17.257 INFO:tasks.rados.rados.0.trial082.stdout:1295: writing trial08226312-27 from 796764 to 1274139 tid 1 2026-02-12T17:34:17.263 INFO:tasks.rados.rados.0.trial082.stdout:1295: writing trial08226312-27 from 1983508 to 2601995 tid 2 2026-02-12T17:34:17.268 INFO:tasks.rados.rados.0.trial082.stdout:1295: writing trial08226312-27 from 3363075 to 3596764 tid 3 2026-02-12T17:34:17.268 INFO:tasks.rados.rados.0.trial082.stdout:1296: read oid 8 snap -1 2026-02-12T17:34:17.269 INFO:tasks.rados.rados.0.trial082.stdout:1296: expect (ObjNum 308 snap 88 seq_num 308) 2026-02-12T17:34:17.269 INFO:tasks.rados.rados.0.trial082.stdout:1297: write (excl) oid 50 current snap is 142 2026-02-12T17:34:17.269 INFO:tasks.rados.rados.0.trial082.stdout:1297: seq_num 453 ranges {413571=552624,1641990=762145,2990498=425163} 2026-02-12T17:34:17.271 INFO:tasks.rados.rados.0.trial082.stdout:1297: writing trial08226312-50 from 413571 to 966195 tid 1 2026-02-12T17:34:17.276 INFO:tasks.rados.rados.0.trial082.stdout:1297: writing trial08226312-50 from 1641990 to 2404135 tid 2 2026-02-12T17:34:17.280 INFO:tasks.rados.rados.0.trial082.stdout:1297: writing trial08226312-50 from 2990498 to 3415661 tid 3 2026-02-12T17:34:17.280 INFO:tasks.rados.rados.0.trial082.stdout:1298: write (excl) oid 47 current snap is 142 2026-02-12T17:34:17.280 INFO:tasks.rados.rados.0.trial082.stdout:1298: seq_num 454 ranges {430378=627873,1700472=622156,3017921=612457} 2026-02-12T17:34:17.284 INFO:tasks.rados.rados.0.trial082.stdout:1298: writing trial08226312-47 from 430378 to 1058251 tid 1 2026-02-12T17:34:17.289 INFO:tasks.rados.rados.0.trial082.stdout:1298: writing trial08226312-47 from 1700472 to 2322628 tid 2 2026-02-12T17:34:17.294 INFO:tasks.rados.rados.0.trial082.stdout:1298: writing trial08226312-47 from 3017921 to 3630378 tid 3 2026-02-12T17:34:17.294 INFO:tasks.rados.rados.0.trial082.stdout:1299: read oid 34 snap -1 2026-02-12T17:34:17.295 INFO:tasks.rados.rados.0.trial082.stdout:1299: expect (ObjNum 401 snap 119 seq_num 401) 2026-02-12T17:34:17.295 INFO:tasks.rados.rados.0.trial082.stdout:1300: rollback oid 38 current snap is 142 2026-02-12T17:34:17.295 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 132 2026-02-12T17:34:17.295 INFO:tasks.rados.rados.0.trial082.stdout:1292: finishing copy_from racing read to trial08226312-21 2026-02-12T17:34:17.295 INFO:tasks.rados.rados.0.trial082.stdout:1294: expect (ObjNum 381 snap 113 seq_num 381) 2026-02-12T17:34:17.317 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:17.368 INFO:tasks.rados.rados.0.trial082.stdout:1292: finishing copy_from to trial08226312-21 2026-02-12T17:34:17.368 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 811 (ObjNum 427 snap 134 seq_num 427) dirty exists 2026-02-12T17:34:17.368 INFO:tasks.rados.rados.0.trial082.stdout:1295: finishing write tid 1 to trial08226312-27 2026-02-12T17:34:17.368 INFO:tasks.rados.rados.0.trial082.stdout:1295: finishing write tid 2 to trial08226312-27 2026-02-12T17:34:17.368 INFO:tasks.rados.rados.0.trial082.stdout:1295: finishing write tid 3 to trial08226312-27 2026-02-12T17:34:17.368 INFO:tasks.rados.rados.0.trial082.stdout:1295: finishing write tid 4 to trial08226312-27 2026-02-12T17:34:17.369 INFO:tasks.rados.rados.0.trial082.stdout:1295: finishing write tid 5 to trial08226312-27 2026-02-12T17:34:17.369 INFO:tasks.rados.rados.0.trial082.stdout:1295: oid 27 updating version 0 to 283 2026-02-12T17:34:17.369 INFO:tasks.rados.rados.0.trial082.stdout:1295: oid 27 version 283 is already newer than 282 2026-02-12T17:34:17.369 INFO:tasks.rados.rados.0.trial082.stdout:1295: oid 27 updating version 283 to 284 2026-02-12T17:34:17.369 INFO:tasks.rados.rados.0.trial082.stdout:1295: oid 27 version 284 is already newer than 281 2026-02-12T17:34:17.369 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 284 (ObjNum 452 snap 142 seq_num 452) dirty exists 2026-02-12T17:34:17.369 INFO:tasks.rados.rados.0.trial082.stdout:1295: left oid 27 (ObjNum 452 snap 142 seq_num 452) 2026-02-12T17:34:17.369 INFO:tasks.rados.rados.0.trial082.stdout:1296: expect (ObjNum 308 snap 88 seq_num 308) 2026-02-12T17:34:17.429 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2728382 2026-02-12T17:34:17.436 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1297: finishing write tid 1 to trial08226312-50 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1297: finishing write tid 2 to trial08226312-50 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1297: finishing write tid 3 to trial08226312-50 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1297: finishing write tid 4 to trial08226312-50 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1292: done (7 left) 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1294: done (6 left) 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1295: done (5 left) 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1296: done (4 left) 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1301: write (excl) oid 30 current snap is 142 2026-02-12T17:34:17.475 INFO:tasks.rados.rados.0.trial082.stdout:1297: finishing write tid 5 to trial08226312-50 2026-02-12T17:34:17.476 INFO:tasks.rados.rados.0.trial082.stdout:1297: oid 50 updating version 0 to 291 2026-02-12T17:34:17.476 INFO:tasks.rados.rados.0.trial082.stdout:1297: oid 50 updating version 291 to 292 2026-02-12T17:34:17.476 INFO:tasks.rados.rados.0.trial082.stdout:1297: oid 50 version 292 is already newer than 290 2026-02-12T17:34:17.476 INFO:tasks.rados.rados.0.trial082.stdout:1297: oid 50 version 292 is already newer than 289 2026-02-12T17:34:17.476 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 292 (ObjNum 453 snap 142 seq_num 453) dirty exists 2026-02-12T17:34:17.476 INFO:tasks.rados.rados.0.trial082.stdout:1297: left oid 50 (ObjNum 453 snap 142 seq_num 453) 2026-02-12T17:34:17.476 INFO:tasks.rados.rados.0.trial082.stdout:1298: finishing write tid 1 to trial08226312-47 2026-02-12T17:34:17.476 INFO:tasks.rados.rados.0.trial082.stdout:1298: finishing write tid 2 to trial08226312-47 2026-02-12T17:34:17.476 INFO:tasks.rados.rados.0.trial082.stdout:1301: seq_num 455 ranges {447185=703122,1642601=765814,2928991=447707} 2026-02-12T17:34:17.479 INFO:tasks.rados.rados.0.trial082.stdout:1301: writing trial08226312-30 from 447185 to 1150307 tid 1 2026-02-12T17:34:17.484 INFO:tasks.rados.rados.0.trial082.stdout:1301: writing trial08226312-30 from 1642601 to 2408415 tid 2 2026-02-12T17:34:17.489 INFO:tasks.rados.rados.0.trial082.stdout:1301: writing trial08226312-30 from 2928991 to 3376698 tid 3 2026-02-12T17:34:17.489 INFO:tasks.rados.rados.0.trial082.stdout:1297: done (4 left) 2026-02-12T17:34:17.489 INFO:tasks.rados.rados.0.trial082.stdout:1302: copy_from oid 49 from oid 48 current snap is 142 2026-02-12T17:34:17.489 INFO:tasks.rados.rados.0.trial082.stdout:1298: finishing write tid 3 to trial08226312-47 2026-02-12T17:34:17.489 INFO:tasks.rados.rados.0.trial082.stdout:1298: finishing write tid 4 to trial08226312-47 2026-02-12T17:34:17.489 INFO:tasks.rados.rados.0.trial082.stdout:1298: finishing write tid 5 to trial08226312-47 2026-02-12T17:34:17.489 INFO:tasks.rados.rados.0.trial082.stdout:1298: oid 47 updating version 0 to 889 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:1298: oid 47 version 889 is already newer than 887 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:1298: oid 47 version 889 is already newer than 888 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:1298: oid 47 updating version 889 to 890 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 890 (ObjNum 454 snap 142 seq_num 454) dirty exists 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:1298: left oid 47 (ObjNum 454 snap 142 seq_num 454) 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:1300: finishing rollback tid 0 to trial08226312-38 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:1298: done (4 left) 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:1303: snap_create 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:1300: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:34:17.490 INFO:tasks.rados.rados.0.trial082.stdout:1300: finishing rollback tid 2 to trial08226312-38 2026-02-12T17:34:17.491 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 807 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:34:17.491 INFO:tasks.rados.rados.0.trial082.stdout:1299: expect (ObjNum 401 snap 119 seq_num 401) 2026-02-12T17:34:17.491 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:17.525 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 276568 2026-02-12T17:34:17.600 INFO:tasks.rados.rados.0.trial082.stdout:1301: finishing write tid 1 to trial08226312-30 2026-02-12T17:34:17.600 INFO:tasks.rados.rados.0.trial082.stdout:1301: finishing write tid 2 to trial08226312-30 2026-02-12T17:34:17.600 INFO:tasks.rados.rados.0.trial082.stdout:1301: finishing write tid 3 to trial08226312-30 2026-02-12T17:34:17.600 INFO:tasks.rados.rados.0.trial082.stdout:1301: finishing write tid 4 to trial08226312-30 2026-02-12T17:34:17.600 INFO:tasks.rados.rados.0.trial082.stdout:1301: finishing write tid 5 to trial08226312-30 2026-02-12T17:34:17.600 INFO:tasks.rados.rados.0.trial082.stdout:1301: oid 30 updating version 0 to 823 2026-02-12T17:34:17.600 INFO:tasks.rados.rados.0.trial082.stdout:1301: oid 30 version 823 is already newer than 822 2026-02-12T17:34:17.600 INFO:tasks.rados.rados.0.trial082.stdout:1301: oid 30 updating version 823 to 825 2026-02-12T17:34:17.601 INFO:tasks.rados.rados.0.trial082.stdout:1301: oid 30 version 825 is already newer than 824 2026-02-12T17:34:17.601 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 825 (ObjNum 455 snap 142 seq_num 455) dirty exists 2026-02-12T17:34:17.601 INFO:tasks.rados.rados.0.trial082.stdout:1301: left oid 30 (ObjNum 455 snap 142 seq_num 455) 2026-02-12T17:34:17.601 INFO:tasks.rados.rados.0.trial082.stdout:1302: finishing copy_from racing read to trial08226312-49 2026-02-12T17:34:17.601 INFO:tasks.rados.rados.0.trial082.stdout:1302: finishing copy_from to trial08226312-49 2026-02-12T17:34:17.601 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 74 (ObjNum 381 snap 113 seq_num 381) dirty exists 2026-02-12T17:34:18.052 INFO:tasks.rados.rados.0.trial082.stdout:1299: done (4 left) 2026-02-12T17:34:18.052 INFO:tasks.rados.rados.0.trial082.stdout:1300: done (3 left) 2026-02-12T17:34:18.052 INFO:tasks.rados.rados.0.trial082.stdout:1301: done (2 left) 2026-02-12T17:34:18.052 INFO:tasks.rados.rados.0.trial082.stdout:1302: done (1 left) 2026-02-12T17:34:18.052 INFO:tasks.rados.rados.0.trial082.stdout:1303: done (0 left) 2026-02-12T17:34:18.052 INFO:tasks.rados.rados.0.trial082.stdout:1304: rollback oid 15 current snap is 143 2026-02-12T17:34:18.053 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 15 to 121 2026-02-12T17:34:18.053 INFO:tasks.rados.rados.0.trial082.stdout:1305: snap_remove snap 126 2026-02-12T17:34:19.054 INFO:tasks.rados.rados.0.trial082.stdout:1305: done (1 left) 2026-02-12T17:34:19.054 INFO:tasks.rados.rados.0.trial082.stdout:1306: write (excl) oid 37 current snap is 143 2026-02-12T17:34:19.055 INFO:tasks.rados.rados.0.trial082.stdout:1304: finishing rollback tid 0 to trial08226312-15 2026-02-12T17:34:19.055 INFO:tasks.rados.rados.0.trial082.stdout:1306: seq_num 456 ranges {463992=778371,1701083=625825,2956414=658979} 2026-02-12T17:34:19.059 INFO:tasks.rados.rados.0.trial082.stdout:1306: writing trial08226312-37 from 463992 to 1242363 tid 1 2026-02-12T17:34:19.063 INFO:tasks.rados.rados.0.trial082.stdout:1306: writing trial08226312-37 from 1701083 to 2326908 tid 2 2026-02-12T17:34:19.068 INFO:tasks.rados.rados.0.trial082.stdout:1306: writing trial08226312-37 from 2956414 to 3615393 tid 3 2026-02-12T17:34:19.068 INFO:tasks.rados.rados.0.trial082.stdout:1307: write oid 29 current snap is 143 2026-02-12T17:34:19.068 INFO:tasks.rados.rados.0.trial082.stdout:1304: finishing rollback tid 1 to trial08226312-15 2026-02-12T17:34:19.068 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 826 (ObjNum 1728032000 snap 32621 seq_num 304) dirty dne 2026-02-12T17:34:19.068 INFO:tasks.rados.rados.0.trial082.stdout:1306: finishing write tid 1 to trial08226312-37 2026-02-12T17:34:19.068 INFO:tasks.rados.rados.0.trial082.stdout:1306: finishing write tid 2 to trial08226312-37 2026-02-12T17:34:19.068 INFO:tasks.rados.rados.0.trial082.stdout:1307: seq_num 457 ranges {480799=569973,1475918=769483,2700190=586604} 2026-02-12T17:34:19.071 INFO:tasks.rados.rados.0.trial082.stdout:1307: writing trial08226312-29 from 480799 to 1050772 tid 1 2026-02-12T17:34:19.076 INFO:tasks.rados.rados.0.trial082.stdout:1307: writing trial08226312-29 from 1475918 to 2245401 tid 2 2026-02-12T17:34:19.080 INFO:tasks.rados.rados.0.trial082.stdout:1307: writing trial08226312-29 from 2700190 to 3286794 tid 3 2026-02-12T17:34:19.080 INFO:tasks.rados.rados.0.trial082.stdout:1304: done (2 left) 2026-02-12T17:34:19.080 INFO:tasks.rados.rados.0.trial082.stdout:1308: snap_remove snap 130 2026-02-12T17:34:19.449 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-12T17:34:19.449 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-12T17:34:19.449 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T17:34:19.449 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T17:34:19.462 INFO:tasks.ceph.mon.a:Started 2026-02-12T17:34:19.462 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:34:19.463 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:34:19.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient: get_monmap_and_config 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient: build_initial_monmap 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient: monmap: 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:19.530884+0000 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:19.530884+0000 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:19.528 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:19.529 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:19.529 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 1 Processor -- start 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 1 -- start start 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient: init 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient(hunting): picked mon.noname-b con 0x7fac5c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient(hunting): picked mon.noname-a con 0x7fac5c08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient(hunting): picked mon.noname-c con 0x7fac5c08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c08d600 con 0x7fac5c08c730 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c08b1f0 con 0x7fac5c08cb30 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c08d1f0 con 0x7fac5c08ae20 2026-02-12T17:34:19.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:19.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac6279d640 10 monclient(hunting): authenticate will time out at 939.349782s 2026-02-12T17:34:19.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac5bfff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fac5c08ae20 0x7fac5c08c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36342/0 (socket says 10.20.193.57:36342) 2026-02-12T17:34:19.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac5bfff640 1 -- 10.20.193.57:0/2422044703 learned_addr learned my addr 10.20.193.57:0/2422044703 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:19.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.530+0000 7fac5b7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fac5c08c730 0x7fac5c181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40388/0 (socket says 10.20.193.57:40388) 2026-02-12T17:34:19.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.532+0000 7fac5b7fe640 1 -- 10.20.193.57:0/2422044703 >> v1:10.20.193.57:6789/0 conn(0x7fac5c08c730 legacy=0x7fac5c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.532+0000 7fac5bfff640 1 -- 10.20.193.57:0/2422044703 >> v1:10.20.193.57:6790/0 conn(0x7fac5c08ae20 legacy=0x7fac5c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 -- 10.20.193.57:0/2422044703 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1275051503 0 0) 0x7fac5c08d1f0 con 0x7fac5c08ae20 2026-02-12T17:34:19.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient(hunting): my global_id is 44213 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 -- 10.20.193.57:0/2422044703 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac400035e0 con 0x7fac5c08ae20 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 -- 10.20.193.57:0/2422044703 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1214421938 0 0) 0x7fac400035e0 con 0x7fac5c08ae20 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 -- 10.20.193.57:0/2422044703 >> v1:10.20.193.82:6789/0 conn(0x7fac5c08cb30 legacy=0x7fac5c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 -- 10.20.193.57:0/2422044703 >> v1:10.20.193.57:6789/0 conn(0x7fac5c08c730 legacy=0x7fac5c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: _finish_hunting 0 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 monclient: found mon.noname-b 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:34:19.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 -- 10.20.193.57:0/2422044703 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c057320 con 0x7fac5c08ae20 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: _finish_auth 0 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: _check_auth_tickets 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 -- 10.20.193.57:0/2422044703 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac48003140 con 0x7fac5c08ae20 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: dump: 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.537 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 5 monclient: authenticate success, global_id 44213 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 -- 10.20.193.57:0/2422044703 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac48003390 con 0x7fac5c08ae20 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:19.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 1 -- 10.20.193.57:0/2422044703 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac48004b10 con 0x7fac5c08ae20 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac5affd640 10 monclient: dump: 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.539 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 4 set_mon_vals no callback set 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 10 monclient: shutdown 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 1 -- 10.20.193.57:0/2422044703 >> v1:10.20.193.57:6790/0 conn(0x7fac5c08ae20 legacy=0x7fac5c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 1 -- 10.20.193.57:0/2422044703 shutdown_connections 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 1 -- 10.20.193.57:0/2422044703 >> 10.20.193.57:0/2422044703 conn(0x7fac5c091620 msgr2=0x7fac5c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 1 -- 10.20.193.57:0/2422044703 shutdown_connections 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.533+0000 7fac6279d640 1 -- 10.20.193.57:0/2422044703 wait complete. 2026-02-12T17:34:19.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient: build_initial_monmap 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient: monmap: 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 1 Processor -- start 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 1 -- start start 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient: init 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient(hunting): picked mon.noname-b con 0x7fac5c08ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient(hunting): picked mon.noname-a con 0x7fac5c08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient(hunting): picked mon.noname-c con 0x7fac5c08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c08d9c0 con 0x7fac5c08c730 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c05cac0 con 0x7fac5c08ae20 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c05aee0 con 0x7fac5c08cb30 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:19.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac6279d640 10 monclient(hunting): authenticate will time out at 939.353668s 2026-02-12T17:34:19.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac5b7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fac5c08c730 0x7fac5c119670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40404/0 (socket says 10.20.193.57:40404) 2026-02-12T17:34:19.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.534+0000 7fac5b7fe640 1 -- 10.20.193.57:0/1720767460 learned_addr learned my addr 10.20.193.57:0/1720767460 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:19.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.536+0000 7fac5b7fe640 1 -- 10.20.193.57:0/1720767460 >> v1:10.20.193.57:6789/0 conn(0x7fac5c08c730 legacy=0x7fac5c119670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.536+0000 7fac60d13640 1 -- 10.20.193.57:0/1720767460 >> v1:10.20.193.57:6790/0 conn(0x7fac5c08cb30 legacy=0x7fac5c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437499982 0 0) 0x7fac5c05aee0 con 0x7fac5c08cb30 2026-02-12T17:34:19.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient(hunting): my global_id is 44216 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac2c0035e0 con 0x7fac5c08cb30 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 978254312 0 0) 0x7fac2c0035e0 con 0x7fac5c08cb30 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac5c05aee0 con 0x7fac5c08cb30 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac500053d0 con 0x7fac5c08cb30 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient(hunting): dump: 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.547 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1582439082 0 0) 0x7fac5c05aee0 con 0x7fac5c08cb30 2026-02-12T17:34:19.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 >> v1:10.20.193.82:6789/0 conn(0x7fac5c08ae20 legacy=0x7fac5c118f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 >> v1:10.20.193.57:6789/0 conn(0x7fac5c08c730 legacy=0x7fac5c119670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 monclient: found mon.c 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c11cb40 con 0x7fac5c08cb30 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient: _finish_auth 0 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac6279d640 5 monclient: authenticate success, global_id 44216 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac6279d640 10 monclient: _renew_subs 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac6279d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:19.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c119d80 con 0x7fac5c08cb30 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac6279d640 10 monclient: _renew_subs 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac6279d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fac5c11c860 con 0x7fac5c08cb30 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac50003a70 con 0x7fac5c08cb30 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac50003d90 con 0x7fac5c08cb30 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac5a7fc640 4 set_mon_vals no callback set 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac58ff9640 10 monclient: dump: 2026-02-12T17:34:19.550 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.537+0000 7fac6279d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.538+0000 7fac6279d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.538+0000 7fac6279d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:19.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.538+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c0008d0 con 0x7fac5c08cb30 2026-02-12T17:34:19.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.538+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fac50004020 con 0x7fac5c08cb30 2026-02-12T17:34:19.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.538+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(297..297 src has 202..297) ==== 3975+0+0 (unknown 1632874419 0 0) 0x7fac5004fc20 con 0x7fac5c08cb30 2026-02-12T17:34:19.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.538+0000 7fac5bfff640 10 monclient: get_auth_request con 0x7fac2c03f680 auth_method 0 2026-02-12T17:34:19.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.540+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fac50018420 con 0x7fac5c08cb30 2026-02-12T17:34:19.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.540+0000 7fac58ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:19.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.540+0000 7fac58ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.687+0000 7fac6279d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:34:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.687+0000 7fac6279d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.687+0000 7fac6279d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.687+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fac5c08f500 con 0x7fac5c08cb30 2026-02-12T17:34:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.687+0000 7fac58ff9640 1 -- 10.20.193.57:0/1720767460 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2076729942) 0x7fac50017bd0 con 0x7fac5c08cb30 2026-02-12T17:34:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.687+0000 7fac58ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:19.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.687+0000 7fac58ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:19.686 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:34:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.689+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 >> v1:10.20.193.82:6800/2441377515 conn(0x7fac2c03f680 legacy=0x7fac2c05fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.689+0000 7fac6279d640 10 monclient: shutdown 2026-02-12T17:34:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.689+0000 7fac6279d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.689+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 >> v1:10.20.193.57:6790/0 conn(0x7fac5c08cb30 legacy=0x7fac5c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.689+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 shutdown_connections 2026-02-12T17:34:19.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.689+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 >> 10.20.193.57:0/1720767460 conn(0x7fac5c091620 msgr2=0x7fac5c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:19.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.689+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 shutdown_connections 2026-02-12T17:34:19.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.689+0000 7fac6279d640 1 -- 10.20.193.57:0/1720767460 wait complete. 2026-02-12T17:34:19.695 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:34:19.695 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:34:19.695 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:34:19.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.764+0000 7f1ec2b4c640 10 monclient: get_monmap_and_config 2026-02-12T17:34:19.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.764+0000 7f1ec2b4c640 10 monclient: build_initial_monmap 2026-02-12T17:34:19.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.764+0000 7f1ec2b4c640 10 monclient: monmap: 2026-02-12T17:34:19.763 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:19.765339+0000 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:19.765339+0000 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.764+0000 7f1ec2b4c640 1 Processor -- start 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.764+0000 7f1ec2b4c640 1 -- start start 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.764+0000 7f1ec2b4c640 10 monclient: init 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 10 monclient(hunting): picked mon.noname-a con 0x7f1ebc08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 10 monclient(hunting): picked mon.noname-b con 0x7f1ebc08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 10 monclient(hunting): picked mon.noname-c con 0x7f1ebc182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ebc08a820 con 0x7f1ebc08c250 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ebc089450 con 0x7f1ebc182cc0 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ebc089730 con 0x7f1ebc08c620 2026-02-12T17:34:19.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:19.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec2b4c640 10 monclient(hunting): authenticate will time out at 939.584234s 2026-02-12T17:34:19.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1eb3fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f1ebc08c620 0x7f1ebc08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36352/0 (socket says 10.20.193.57:36352) 2026-02-12T17:34:19.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1ec08c1640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1ebc08c250 0x7f1ebc08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40412/0 (socket says 10.20.193.57:40412) 2026-02-12T17:34:19.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.765+0000 7f1eb3fff640 1 -- 10.20.193.57:0/361361176 learned_addr learned my addr 10.20.193.57:0/361361176 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:19.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb3fff640 1 -- 10.20.193.57:0/361361176 >> v1:10.20.193.57:6790/0 conn(0x7f1ebc08c620 legacy=0x7f1ebc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1ec08c1640 1 -- 10.20.193.57:0/361361176 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc08c250 legacy=0x7f1ebc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1ec10c2640 1 -- 10.20.193.57:0/361361176 >> v1:10.20.193.82:6789/0 conn(0x7f1ebc182cc0 legacy=0x7f1ebc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561692649 0 0) 0x7f1ebc089730 con 0x7f1ebc08c620 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient(hunting): my global_id is 44219 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ea80035e0 con 0x7f1ebc08c620 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192307983 0 0) 0x7f1ebc089450 con 0x7f1ebc182cc0 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient(hunting): my global_id is 4654 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ebc089730 con 0x7f1ebc182cc0 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 151595561 0 0) 0x7f1ea80035e0 con 0x7f1ebc08c620 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 >> v1:10.20.193.82:6789/0 conn(0x7f1ebc182cc0 legacy=0x7f1ebc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc08c250 legacy=0x7f1ebc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient: _finish_hunting 0 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 monclient: found mon.noname-b 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:34:19.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc089a10 con 0x7f1ebc08c620 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient: _finish_auth 0 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient: _check_auth_tickets 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1ea40030d0 con 0x7f1ebc08c620 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1eb37fe640 10 monclient: dump: 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.778 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1ec2b4c640 5 monclient: authenticate success, global_id 44219 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.767+0000 7f1ec2b4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ea40033d0 con 0x7f1ebc08c620 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1eb37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:19.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 4 set_mon_vals no callback set 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1eb37fe640 1 -- 10.20.193.57:0/361361176 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1ea4004b10 con 0x7f1ebc08c620 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1eb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1eb37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1eb37fe640 10 monclient: dump: 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.780 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 10 monclient: shutdown 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/361361176 >> v1:10.20.193.57:6790/0 conn(0x7f1ebc08c620 legacy=0x7f1ebc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/361361176 shutdown_connections 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/361361176 >> 10.20.193.57:0/361361176 conn(0x7f1ebc0916b0 msgr2=0x7f1ebc091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:19.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/361361176 shutdown_connections 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/361361176 wait complete. 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 10 monclient: build_initial_monmap 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.768+0000 7f1ec2b4c640 10 monclient: monmap: 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:19.782 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 1 Processor -- start 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 1 -- start start 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 10 monclient: init 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 10 monclient(hunting): picked mon.noname-b con 0x7f1ebc08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 10 monclient(hunting): picked mon.noname-a con 0x7f1ebc08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 10 monclient(hunting): picked mon.noname-c con 0x7f1ebc182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ebc087360 con 0x7f1ebc08c620 2026-02-12T17:34:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ebc182ad0 con 0x7f1ebc08c250 2026-02-12T17:34:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ebc0888a0 con 0x7f1ebc182cc0 2026-02-12T17:34:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1ec2b4c640 10 monclient(hunting): authenticate will time out at 939.588477s 2026-02-12T17:34:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1eb3fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1ebc08c620 0x7f1ebc181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40420/0 (socket says 10.20.193.57:40420) 2026-02-12T17:34:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.769+0000 7f1eb3fff640 1 -- 10.20.193.57:0/42537814 learned_addr learned my addr 10.20.193.57:0/42537814 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb3fff640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc08c620 legacy=0x7f1ebc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1ec10c2640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6790/0 conn(0x7f1ebc182cc0 legacy=0x7f1ebc1823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1ec08c1640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.82:6789/0 conn(0x7f1ebc08c250 legacy=0x7f1ebc13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 429735920 0 0) 0x7f1ebc087360 con 0x7f1ebc08c620 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): my global_id is 54099 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e8c0035e0 con 0x7f1ebc08c620 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48680580 0 0) 0x7f1ebc0888a0 con 0x7f1ebc182cc0 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): my global_id is 44222 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ebc087360 con 0x7f1ebc182cc0 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2732799127 0 0) 0x7f1e8c0035e0 con 0x7f1ebc08c620 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ebc0888a0 con 0x7f1ebc08c620 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 205748971 0 0) 0x7f1ebc182ad0 con 0x7f1ebc08c250 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 10 monclient(hunting): my global_id is 4657 2026-02-12T17:34:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.771+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e8c0035e0 con 0x7f1ebc08c250 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1ea4004a50 con 0x7f1ebc08c620 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient(hunting): dump: 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.787 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2911396705 0 0) 0x7f1ebc087360 con 0x7f1ebc182cc0 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ebc182ad0 con 0x7f1ebc182cc0 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1eb8004490 con 0x7f1ebc182cc0 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient(hunting): dump: 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.789 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1165792923 0 0) 0x7f1ebc0888a0 con 0x7f1ebc08c620 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6790/0 conn(0x7f1ebc182cc0 legacy=0x7f1ebc1823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.82:6789/0 conn(0x7f1ebc08c250 legacy=0x7f1ebc13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient: _finish_hunting 0 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 monclient: found mon.a 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ebc13ed50 con 0x7f1ebc08c620 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient: _finish_auth 0 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient: _check_auth_tickets 2026-02-12T17:34:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1ec2b4c640 5 monclient: authenticate success, global_id 54099 2026-02-12T17:34:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1ec2b4c640 10 monclient: _renew_subs 2026-02-12T17:34:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1ec2b4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1ebc05ddc0 con 0x7f1ebc08c620 2026-02-12T17:34:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1ec2b4c640 10 monclient: _renew_subs 2026-02-12T17:34:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1ec2b4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1ebc085210 con 0x7f1ebc08c620 2026-02-12T17:34:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1ec2b4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1ebc090810 con 0x7f1ebc1a47c0 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ea4004bb0 con 0x7f1ebc08c620 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1ea4002b30 con 0x7f1ebc08c620 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 10 monclient: dump: 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.792 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb2ffd640 4 set_mon_vals no callback set 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1ea4011d30 con 0x7f1ebc08c620 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.772+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(297..297 src has 202..297) ==== 3975+0+0 (unknown 1632874419 0 0) 0x7f1ea404edd0 con 0x7f1ebc08c620 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.773+0000 7f1ec10c2640 10 monclient: get_auth_request con 0x7f1e8c03fcc0 auth_method 0 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1ec08c1640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc1a47c0 legacy=0x7f1ebc058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665978328 0 0) 0x7f1ebc090810 con 0x7f1ebc1a47c0 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 10 monclient(hunting): my global_id is 54102 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ebc0888a0 con 0x7f1ebc1a47c0 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2719023319 0 0) 0x7f1ebc0888a0 con 0x7f1ebc1a47c0 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ebc090810 con 0x7f1ebc1a47c0 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1eac003240 con 0x7f1ebc1a47c0 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.774+0000 7f1eb17fa640 10 monclient: dump: 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.775+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1813845928 0 0) 0x7f1ebc090810 con 0x7f1ebc1a47c0 2026-02-12T17:34:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.775+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ebc08f5b0 con 0x7f1ebc1a47c0 2026-02-12T17:34:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.775+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1eac0058d0 con 0x7f1ebc1a47c0 2026-02-12T17:34:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.775+0000 7f1eb17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.775+0000 7f1eb17fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.775+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc1a47c0 legacy=0x7f1ebc058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.775+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc1a47c0 legacy=0x7f1ebc058410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:19.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.778+0000 7f1ec2b4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:34:19.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.778+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1ebc055340 con 0x7f1ebc04d1c0 2026-02-12T17:34:19.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1ec08c1640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc04d1c0 legacy=0x7f1ebc11e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276663612 0 0) 0x7f1ebc055340 con 0x7f1ebc04d1c0 2026-02-12T17:34:19.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 10 monclient(hunting): my global_id is 54105 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ebc090810 con 0x7f1ebc04d1c0 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3753004419 0 0) 0x7f1ebc090810 con 0x7f1ebc04d1c0 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ebc055340 con 0x7f1ebc04d1c0 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1eac004eb0 con 0x7f1ebc04d1c0 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 10 monclient: dump: 2026-02-12T17:34:19.799 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1123630124 0 0) 0x7f1ebc055340 con 0x7f1ebc04d1c0 2026-02-12T17:34:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.780+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1ebc04d590 con 0x7f1ebc04d1c0 2026-02-12T17:34:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4335 (unknown 0 0 1648433886) 0x7f1eac005af0 con 0x7f1ebc04d1c0 2026-02-12T17:34:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1eb17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:34:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1eb17fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc04d1c0 legacy=0x7f1ebc11e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1eb17fa640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc04d1c0 legacy=0x7f1ebc11e7f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:19.801 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:34:19.801 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 28, 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 259, 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:19.802 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:34:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:34:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:19.809 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:34:19.810 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:34:19.811 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:34:19.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.82:6800/2441377515 conn(0x7f1e8c03fcc0 legacy=0x7f1e8c060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1ec2b4c640 10 monclient: shutdown 2026-02-12T17:34:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1ec2b4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1ec10c2640 1 -- 10.20.193.57:0/42537814 reap_dead start 2026-02-12T17:34:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 >> v1:10.20.193.57:6789/0 conn(0x7f1ebc08c620 legacy=0x7f1ebc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 shutdown_connections 2026-02-12T17:34:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 >> 10.20.193.57:0/42537814 conn(0x7f1ebc0916b0 msgr2=0x7f1ebc08b480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 shutdown_connections 2026-02-12T17:34:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.781+0000 7f1ec2b4c640 1 -- 10.20.193.57:0/42537814 wait complete. 2026-02-12T17:34:19.813 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:34:19.813 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:34:19.813 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:34:19.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient: get_monmap_and_config 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient: build_initial_monmap 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient: monmap: 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:19.883841+0000 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:19.883841+0000 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:19.882 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 1 Processor -- start 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 1 -- start start 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient: init 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient(hunting): picked mon.noname-b con 0x7f62b808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient(hunting): picked mon.noname-c con 0x7f62b808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient(hunting): picked mon.noname-a con 0x7f62b8182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b808a820 con 0x7f62b8182cc0 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b8089450 con 0x7f62b808c620 2026-02-12T17:34:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b8089730 con 0x7f62b808c250 2026-02-12T17:34:19.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:19.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bf5e5640 10 monclient(hunting): authenticate will time out at 939.702724s 2026-02-12T17:34:19.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bd35a640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f62b808c250 0x7f62b808a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36372/0 (socket says 10.20.193.57:36372) 2026-02-12T17:34:19.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.883+0000 7f62bd35a640 1 -- 10.20.193.57:0/1049107164 learned_addr learned my addr 10.20.193.57:0/1049107164 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:19.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.885+0000 7f62bd35a640 1 -- 10.20.193.57:0/1049107164 >> v1:10.20.193.57:6790/0 conn(0x7f62b808c250 legacy=0x7f62b808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.885+0000 7f62bdb5b640 1 -- 10.20.193.57:0/1049107164 >> v1:10.20.193.57:6789/0 conn(0x7f62b8182cc0 legacy=0x7f62b81a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bcb59640 1 -- 10.20.193.57:0/1049107164 >> v1:10.20.193.82:6789/0 conn(0x7f62b808c620 legacy=0x7f62b808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798808353 0 0) 0x7f62b4003d50 con 0x7f62b8182cc0 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): my global_id is 54108 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62a00035e0 con 0x7f62b8182cc0 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2328721654 0 0) 0x7f62b8089730 con 0x7f62b808c250 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): my global_id is 44225 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62b4003d50 con 0x7f62b808c250 2026-02-12T17:34:19.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448051741 0 0) 0x7f62b8089450 con 0x7f62b808c620 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient(hunting): my global_id is 4660 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62b8089730 con 0x7f62b808c620 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 921751583 0 0) 0x7f62a00035e0 con 0x7f62b8182cc0 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 >> v1:10.20.193.57:6790/0 conn(0x7f62b808c250 legacy=0x7f62b808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 >> v1:10.20.193.82:6789/0 conn(0x7f62b808c620 legacy=0x7f62b808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: _finish_hunting 0 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 monclient: found mon.noname-a 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b8089a10 con 0x7f62b8182cc0 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: _finish_auth 0 2026-02-12T17:34:19.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: _check_auth_tickets 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f62b4004390 con 0x7f62b8182cc0 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: dump: 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.888 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 5 monclient: authenticate success, global_id 54108 2026-02-12T17:34:19.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:19.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62b4004610 con 0x7f62b8182cc0 2026-02-12T17:34:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 1 -- 10.20.193.57:0/1049107164 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f62b4004960 con 0x7f62b8182cc0 2026-02-12T17:34:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62a7fff640 10 monclient: dump: 2026-02-12T17:34:19.894 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.895 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.895 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.895 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.895 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.895 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.895 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.895 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.895 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.895 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 4 set_mon_vals no callback set 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 10 monclient: shutdown 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 1 -- 10.20.193.57:0/1049107164 >> v1:10.20.193.57:6789/0 conn(0x7f62b8182cc0 legacy=0x7f62b81a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 1 -- 10.20.193.57:0/1049107164 shutdown_connections 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 1 -- 10.20.193.57:0/1049107164 >> 10.20.193.57:0/1049107164 conn(0x7f62b80916b0 msgr2=0x7f62b8091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 1 -- 10.20.193.57:0/1049107164 shutdown_connections 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.886+0000 7f62bf5e5640 1 -- 10.20.193.57:0/1049107164 wait complete. 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient: build_initial_monmap 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient: monmap: 2026-02-12T17:34:19.896 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 1 Processor -- start 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 1 -- start start 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient: init 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient(hunting): picked mon.noname-c con 0x7f62b808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient(hunting): picked mon.noname-b con 0x7f62b808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient(hunting): picked mon.noname-a con 0x7f62b8182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b805cb80 con 0x7f62b8182cc0 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b805c890 con 0x7f62b808c620 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b805b750 con 0x7f62b808c250 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bf5e5640 10 monclient(hunting): authenticate will time out at 939.706750s 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bd35a640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f62b808c250 0x7f62b805a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36380/0 (socket says 10.20.193.57:36380) 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bd35a640 1 -- 10.20.193.57:0/2828219064 learned_addr learned my addr 10.20.193.57:0/2828219064 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.887+0000 7f62bdb5b640 1 --1- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6789/0 conn(0x7f62b8182cc0 0x7f62b8193550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40464/0 (socket says 10.20.193.57:40464) 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.889+0000 7f62bdb5b640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6789/0 conn(0x7f62b8182cc0 legacy=0x7f62b8193550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.889+0000 7f62bd35a640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6790/0 conn(0x7f62b808c250 legacy=0x7f62b805a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041051580 0 0) 0x7f62b805cb80 con 0x7f62b8182cc0 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): my global_id is 54111 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62880035e0 con 0x7f62b8182cc0 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553292509 0 0) 0x7f62b805b750 con 0x7f62b808c250 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): my global_id is 44228 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62b805cb80 con 0x7f62b808c250 2026-02-12T17:34:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bcb59640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.82:6789/0 conn(0x7f62b808c620 legacy=0x7f62b805b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1964222878 0 0) 0x7f62880035e0 con 0x7f62b8182cc0 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62b805b750 con 0x7f62b8182cc0 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f62b4004960 con 0x7f62b8182cc0 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): dump: 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.900 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 749160605 0 0) 0x7f62b805cb80 con 0x7f62b808c250 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62880035e0 con 0x7f62b808c250 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f62a8003320 con 0x7f62b808c250 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient(hunting): dump: 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 865392734 0 0) 0x7f62b805b750 con 0x7f62b8182cc0 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6790/0 conn(0x7f62b808c250 legacy=0x7f62b805a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.82:6789/0 conn(0x7f62b808c620 legacy=0x7f62b805b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 monclient: found mon.a 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b805c650 con 0x7f62b8182cc0 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient: _finish_auth 0 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bf5e5640 5 monclient: authenticate success, global_id 54111 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bf5e5640 10 monclient: _renew_subs 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bf5e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f62b8088900 con 0x7f62b8182cc0 2026-02-12T17:34:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bf5e5640 10 monclient: _renew_subs 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bf5e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f62b813e880 con 0x7f62b8182cc0 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62b40045c0 con 0x7f62b8182cc0 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f62b4005120 con 0x7f62b8182cc0 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a77fe640 4 set_mon_vals no callback set 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62a5ffb640 10 monclient: dump: 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.903 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bf5e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.890+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62b80851f0 con 0x7f62b8084e20 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.891+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f62b40053b0 con 0x7f62b8182cc0 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.891+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(297..297 src has 202..297) ==== 3975+0+0 (unknown 1632874419 0 0) 0x7f62b404fb70 con 0x7f62b8182cc0 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.891+0000 7f62bcb59640 10 monclient: get_auth_request con 0x7f628803fb20 auth_method 0 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62bd35a640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6790/0 conn(0x7f62b8084e20 legacy=0x7f62b818d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4269164083 0 0) 0x7f62b80851f0 con 0x7f62b8084e20 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 10 monclient(hunting): my global_id is 44231 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62b805b750 con 0x7f62b8084e20 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 258689386 0 0) 0x7f62b805b750 con 0x7f62b8084e20 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62b80851f0 con 0x7f62b8084e20 2026-02-12T17:34:19.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f62a8004c40 con 0x7f62b8084e20 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 10 monclient: dump: 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2340900027 0 0) 0x7f62b80851f0 con 0x7f62b8084e20 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62b8090810 con 0x7f62b8084e20 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f62a8004fd0 con 0x7f62b8084e20 2026-02-12T17:34:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6790/0 conn(0x7f62b8084e20 legacy=0x7f62b818d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.893+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6790/0 conn(0x7f62b8084e20 legacy=0x7f62b818d340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.897+0000 7f62bf5e5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:34:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.897+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62b808a820 con 0x7f62b818da50 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62bd35a640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6790/0 conn(0x7f62b818da50 legacy=0x7f62b8195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544716901 0 0) 0x7f62880035e0 con 0x7f62b818da50 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 10 monclient(hunting): my global_id is 44234 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62b80851f0 con 0x7f62b818da50 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1884354160 0 0) 0x7f62b80851f0 con 0x7f62b818da50 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62880035e0 con 0x7f62b818da50 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f62a8005620 con 0x7f62b818da50 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 10 monclient: dump: 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:19.908 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 614568581 0 0) 0x7f62880035e0 con 0x7f62b818da50 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f62b808f580 con 0x7f62b818da50 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 2311137221) 0x7f62a8006c00 con 0x7f62b818da50 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6790/0 conn(0x7f62b818da50 legacy=0x7f62b8195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.899+0000 7f62a5ffb640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6790/0 conn(0x7f62b818da50 legacy=0x7f62b8195c80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 28, 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 136825, 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:34:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:34:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:34:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.916 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:34:19.918 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.82:6800/2441377515 conn(0x7f628803fb20 legacy=0x7f628805ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bf5e5640 10 monclient: shutdown 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bf5e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 >> v1:10.20.193.57:6789/0 conn(0x7f62b8182cc0 legacy=0x7f62b8193550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bdb5b640 1 -- 10.20.193.57:0/2828219064 reap_dead start 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bdb5b640 1 -- 10.20.193.57:0/2828219064 reap_dead start 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 shutdown_connections 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 >> 10.20.193.57:0/2828219064 conn(0x7f62b80916b0 msgr2=0x7f62b808a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 shutdown_connections 2026-02-12T17:34:19.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.900+0000 7f62bf5e5640 1 -- 10.20.193.57:0/2828219064 wait complete. 2026-02-12T17:34:19.920 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:34:19.920 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:34:19.920 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:34:19.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient: get_monmap_and_config 2026-02-12T17:34:19.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient: build_initial_monmap 2026-02-12T17:34:19.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient: monmap: 2026-02-12T17:34:19.993 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:19.994 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:19.994 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:19.996922+0000 2026-02-12T17:34:19.994 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:19.996922+0000 2026-02-12T17:34:19.994 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:19.994 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:19.994 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:19.994 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:19.994 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:19.994 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 1 Processor -- start 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 1 -- start start 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient: init 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient(hunting): picked mon.noname-c con 0x7fdd780906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient(hunting): picked mon.noname-b con 0x7fdd780911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient(hunting): picked mon.noname-a con 0x7fdd78185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd78090100 con 0x7fdd78185070 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd78091a70 con 0x7fdd780906d0 2026-02-12T17:34:19.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd78092360 con 0x7fdd780911b0 2026-02-12T17:34:19.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:19.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.996+0000 7fdd7df4c640 10 monclient(hunting): authenticate will time out at 939.815990s 2026-02-12T17:34:19.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.997+0000 7fdd77fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fdd78185070 0x7fdd781a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40478/0 (socket says 10.20.193.57:40478) 2026-02-12T17:34:19.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.997+0000 7fdd76ffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fdd780911b0 0x7fdd78183950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36412/0 (socket says 10.20.193.57:36412) 2026-02-12T17:34:19.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.997+0000 7fdd77fff640 1 -- 10.20.193.57:0/1919834707 learned_addr learned my addr 10.20.193.57:0/1919834707 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:19.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd76ffd640 1 -- 10.20.193.57:0/1919834707 >> v1:10.20.193.57:6790/0 conn(0x7fdd780911b0 legacy=0x7fdd78183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd77fff640 1 -- 10.20.193.57:0/1919834707 >> v1:10.20.193.57:6789/0 conn(0x7fdd78185070 legacy=0x7fdd781a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd777fe640 1 -- 10.20.193.57:0/1919834707 >> v1:10.20.193.82:6789/0 conn(0x7fdd780906d0 legacy=0x7fdd78090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:19.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188267524 0 0) 0x7fdd78092360 con 0x7fdd780911b0 2026-02-12T17:34:19.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient(hunting): my global_id is 44237 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd5c0035e0 con 0x7fdd780911b0 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636548904 0 0) 0x7fdd78090100 con 0x7fdd78185070 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient(hunting): my global_id is 54114 2026-02-12T17:34:20.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd78092360 con 0x7fdd78185070 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3243335391 0 0) 0x7fdd78092360 con 0x7fdd78185070 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 >> v1:10.20.193.57:6790/0 conn(0x7fdd780911b0 legacy=0x7fdd78183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 >> v1:10.20.193.82:6789/0 conn(0x7fdd780906d0 legacy=0x7fdd78090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient: _finish_hunting 0 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 monclient: found mon.noname-a 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7805cf80 con 0x7fdd78185070 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient: _finish_auth 0 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient: _check_auth_tickets 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd6c004230 con 0x7fdd78185070 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd7df4c640 5 monclient: authenticate success, global_id 54114 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd7df4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:20.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient: dump: 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd7df4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd77fff640 1 --1- 10.20.193.57:0/1919834707 >> v1:10.20.193.57:6789/0 conn(0x7fdd78185070 0x7fdd781a5450 :-1 s=OPENED pgs=280 gs=3 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fdd6c004480 config(0 keys) 2026-02-12T17:34:20.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd6c004480 con 0x7fdd78185070 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd767fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd7df4c640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd7df4c640 4 set_mon_vals no callback set 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd7df4c640 10 monclient: shutdown 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd7df4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:19.999+0000 7fdd7df4c640 1 -- 10.20.193.57:0/1919834707 >> v1:10.20.193.57:6789/0 conn(0x7fdd78185070 legacy=0x7fdd781a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd767fc640 1 -- 10.20.193.57:0/1919834707 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd6c005bf0 con 0x7fdd78185070 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd767fc640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 1 -- 10.20.193.57:0/1919834707 shutdown_connections 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 1 -- 10.20.193.57:0/1919834707 >> 10.20.193.57:0/1919834707 conn(0x7fdd78054330 msgr2=0x7fdd78054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 1 -- 10.20.193.57:0/1919834707 shutdown_connections 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 1 -- 10.20.193.57:0/1919834707 wait complete. 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient: build_initial_monmap 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient: monmap: 2026-02-12T17:34:20.003 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 1 Processor -- start 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 1 -- start start 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient: init 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient(hunting): picked mon.noname-a con 0x7fdd780906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:20.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient(hunting): picked mon.noname-b con 0x7fdd780911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient(hunting): picked mon.noname-c con 0x7fdd78185070 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd78133b20 con 0x7fdd780906d0 2026-02-12T17:34:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd78130c10 con 0x7fdd780911b0 2026-02-12T17:34:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd7808b630 con 0x7fdd78185070 2026-02-12T17:34:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd7df4c640 10 monclient(hunting): authenticate will time out at 939.819959s 2026-02-12T17:34:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd777fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fdd780906d0 0x7fdd7812fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40484/0 (socket says 10.20.193.57:40484) 2026-02-12T17:34:20.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.000+0000 7fdd777fe640 1 -- 10.20.193.57:0/3266479448 learned_addr learned my addr 10.20.193.57:0/3266479448 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd777fe640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.57:6789/0 conn(0x7fdd780906d0 legacy=0x7fdd7812fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd77fff640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.57:6790/0 conn(0x7fdd78185070 legacy=0x7fdd78174a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727340171 0 0) 0x7fdd78133b20 con 0x7fdd780906d0 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): my global_id is 54117 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd480035e0 con 0x7fdd780906d0 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439285272 0 0) 0x7fdd7808b630 con 0x7fdd78185070 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): my global_id is 44240 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd78133b20 con 0x7fdd78185070 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 426776514 0 0) 0x7fdd480035e0 con 0x7fdd780906d0 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd7808b630 con 0x7fdd780906d0 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd76ffd640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.82:6789/0 conn(0x7fdd780911b0 legacy=0x7fdd78130500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd640033e0 con 0x7fdd780906d0 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): dump: 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.010 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 539284035 0 0) 0x7fdd78133b20 con 0x7fdd78185070 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd480035e0 con 0x7fdd78185070 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd6c005b30 con 0x7fdd78185070 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient(hunting): dump: 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.011 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2213336483 0 0) 0x7fdd7808b630 con 0x7fdd780906d0 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.57:6790/0 conn(0x7fdd78185070 legacy=0x7fdd78174a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.82:6789/0 conn(0x7fdd780911b0 legacy=0x7fdd78130500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient: _finish_hunting 0 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 monclient: found mon.a 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd78062bb0 con 0x7fdd780906d0 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient: _finish_auth 0 2026-02-12T17:34:20.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient: _check_auth_tickets 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd7df4c640 5 monclient: authenticate success, global_id 54117 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd7df4c640 10 monclient: _renew_subs 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd7df4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd78132cb0 con 0x7fdd780906d0 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd7df4c640 10 monclient: _renew_subs 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd7df4c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd78133840 con 0x7fdd780906d0 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd640039f0 con 0x7fdd780906d0 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd64003d10 con 0x7fdd780906d0 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd53fff640 10 monclient: dump: 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.013 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd75ffb640 4 set_mon_vals no callback set 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd7df4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.003+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd78143520 con 0x7fdd78132550 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.004+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fdd64003f20 con 0x7fdd780906d0 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.004+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(297..297 src has 202..297) ==== 3975+0+0 (unknown 1632874419 0 0) 0x7fdd6404ecf0 con 0x7fdd780906d0 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.004+0000 7fdd77fff640 10 monclient: get_auth_request con 0x7fdd4803fae0 auth_method 0 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd76ffd640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.82:6789/0 conn(0x7fdd78132550 legacy=0x7fdd7808ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869609751 0 0) 0x7fdd78143520 con 0x7fdd78132550 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 10 monclient(hunting): my global_id is 4672 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd7808b630 con 0x7fdd78132550 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 870558986 0 0) 0x7fdd7808b630 con 0x7fdd78132550 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd78143520 con 0x7fdd78132550 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd68003530 con 0x7fdd78132550 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.006+0000 7fdd53fff640 10 monclient: dump: 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.015 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.007+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1852437076 0 0) 0x7fdd78143520 con 0x7fdd78132550 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.007+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd7805c950 con 0x7fdd78132550 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.007+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fdd680048a0 con 0x7fdd78132550 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.007+0000 7fdd53fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.007+0000 7fdd53fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.007+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.82:6789/0 conn(0x7fdd78132550 legacy=0x7fdd7808ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.007+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.82:6789/0 conn(0x7fdd78132550 legacy=0x7fdd7808ea20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.010+0000 7fdd7df4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:34:20.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.010+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd78092c50 con 0x7fdd7804d1c0 2026-02-12T17:34:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd76ffd640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.82:6789/0 conn(0x7fdd7804d1c0 legacy=0x7fdd78177180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3797537036 0 0) 0x7fdd78092c50 con 0x7fdd7804d1c0 2026-02-12T17:34:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 10 monclient(hunting): my global_id is 4675 2026-02-12T17:34:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd78143520 con 0x7fdd7804d1c0 2026-02-12T17:34:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 991839248 0 0) 0x7fdd78143520 con 0x7fdd7804d1c0 2026-02-12T17:34:20.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd78092c50 con 0x7fdd7804d1c0 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd68004db0 con 0x7fdd7804d1c0 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 10 monclient: dump: 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2439623292 0 0) 0x7fdd78092c50 con 0x7fdd7804d1c0 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd78092de0 con 0x7fdd7804d1c0 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 4195350219) 0x7fdd68005250 con 0x7fdd7804d1c0 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.82:6789/0 conn(0x7fdd7804d1c0 legacy=0x7fdd78177180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.013+0000 7fdd53fff640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.82:6789/0 conn(0x7fdd7804d1c0 legacy=0x7fdd78177180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:20.020 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 28, 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 381509, 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:20.021 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:20.022 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:34:20.023 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:20.024 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:20.025 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:20.026 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:20.027 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.028 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:34:20.029 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:20.030 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:20.030 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:20.030 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:20.030 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:20.030 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:20.030 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:20.030 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:34:20.030 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.82:6800/2441377515 conn(0x7fdd4803fae0 legacy=0x7fdd4805ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd7df4c640 10 monclient: shutdown 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd7df4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 >> v1:10.20.193.57:6789/0 conn(0x7fdd780906d0 legacy=0x7fdd7812fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd77fff640 1 -- 10.20.193.57:0/3266479448 reap_dead start 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd77fff640 1 -- 10.20.193.57:0/3266479448 reap_dead start 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 shutdown_connections 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 >> 10.20.193.57:0/3266479448 conn(0x7fdd78054330 msgr2=0x7fdd7808f800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 shutdown_connections 2026-02-12T17:34:20.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.014+0000 7fdd7df4c640 1 -- 10.20.193.57:0/3266479448 wait complete. 2026-02-12T17:34:20.032 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:34:20.032 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:34:20.032 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:34:20.056 INFO:tasks.rados.rados.0.trial082.stdout:1308: done (2 left) 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1309: rollback oid 41 current snap is 143 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 128 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1306: finishing write tid 3 to trial08226312-37 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1306: finishing write tid 4 to trial08226312-37 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1306: finishing write tid 5 to trial08226312-37 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1306: oid 37 updating version 0 to 643 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1306: oid 37 updating version 643 to 644 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1306: oid 37 version 644 is already newer than 642 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1306: oid 37 updating version 644 to 645 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 645 (ObjNum 456 snap 143 seq_num 456) dirty exists 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1306: left oid 37 (ObjNum 456 snap 143 seq_num 456) 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1307: finishing write tid 1 to trial08226312-29 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1307: finishing write tid 2 to trial08226312-29 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1307: finishing write tid 3 to trial08226312-29 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1307: finishing write tid 4 to trial08226312-29 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1307: finishing write tid 5 to trial08226312-29 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1307: oid 29 updating version 0 to 299 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1307: oid 29 version 299 is already newer than 298 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1307: oid 29 updating version 299 to 300 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:1307: oid 29 updating version 300 to 301 2026-02-12T17:34:20.057 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 301 (ObjNum 457 snap 143 seq_num 457) dirty exists 2026-02-12T17:34:20.058 INFO:tasks.rados.rados.0.trial082.stdout:1307: left oid 29 (ObjNum 457 snap 143 seq_num 457) 2026-02-12T17:34:20.058 INFO:tasks.rados.rados.0.trial082.stdout:1306: done (2 left) 2026-02-12T17:34:20.058 INFO:tasks.rados.rados.0.trial082.stdout:1307: done (1 left) 2026-02-12T17:34:20.058 INFO:tasks.rados.rados.0.trial082.stdout:1310: read oid 4 snap -1 2026-02-12T17:34:20.058 INFO:tasks.rados.rados.0.trial082.stdout:1310: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:34:20.058 INFO:tasks.rados.rados.0.trial082.stdout:1311: snap_remove snap 117 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.100+0000 7faaae68c640 10 monclient: get_monmap_and_config 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.100+0000 7faaae68c640 10 monclient: build_initial_monmap 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.100+0000 7faaae68c640 10 monclient: monmap: 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:20.101366+0000 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:20.101366+0000 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:20.098 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.100+0000 7faaae68c640 1 Processor -- start 2026-02-12T17:34:20.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.100+0000 7faaae68c640 1 -- start start 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.100+0000 7faaae68c640 10 monclient: init 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 10 monclient(hunting): picked mon.noname-a con 0x7faaa808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 10 monclient(hunting): picked mon.noname-b con 0x7faaa808c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 10 monclient(hunting): picked mon.noname-c con 0x7faaa808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa808d600 con 0x7faaa808ae20 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa808b1f0 con 0x7faaa808cb30 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa808d1f0 con 0x7faaa808c730 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaae68c640 10 monclient(hunting): authenticate will time out at 939.920244s 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaa77fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7faaa808c730 0x7faaa8181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36424/0 (socket says 10.20.193.57:36424) 2026-02-12T17:34:20.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaa7fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7faaa808ae20 0x7faaa808c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40496/0 (socket says 10.20.193.57:40496) 2026-02-12T17:34:20.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.101+0000 7faaa77fe640 1 -- 10.20.193.57:0/1189073864 learned_addr learned my addr 10.20.193.57:0/1189073864 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa77fe640 1 -- 10.20.193.57:0/1189073864 >> v1:10.20.193.57:6790/0 conn(0x7faaa808c730 legacy=0x7faaa8181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa7fff640 1 -- 10.20.193.57:0/1189073864 >> v1:10.20.193.57:6789/0 conn(0x7faaa808ae20 legacy=0x7faaa808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaacc02640 1 -- 10.20.193.57:0/1189073864 >> v1:10.20.193.82:6789/0 conn(0x7faaa808cb30 legacy=0x7faaa81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130705128 0 0) 0x7faaa808d600 con 0x7faaa808ae20 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient(hunting): my global_id is 54120 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa8c0035e0 con 0x7faaa808ae20 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219285075 0 0) 0x7faaa808d1f0 con 0x7faaa808c730 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient(hunting): my global_id is 44243 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa808d600 con 0x7faaa808c730 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 539570268 0 0) 0x7faa8c0035e0 con 0x7faaa808ae20 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 >> v1:10.20.193.57:6790/0 conn(0x7faaa808c730 legacy=0x7faaa8181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 >> v1:10.20.193.82:6789/0 conn(0x7faaa808cb30 legacy=0x7faaa81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 monclient: found mon.noname-a 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa8057320 con 0x7faaa808ae20 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient: _finish_auth 0 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:20.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faa94003000 con 0x7faaa808ae20 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaa6ffd640 10 monclient: dump: 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaae68c640 5 monclient: authenticate success, global_id 54120 2026-02-12T17:34:20.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.103+0000 7faaae68c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faa94003290 con 0x7faaa808ae20 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaa6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaa6ffd640 1 -- 10.20.193.57:0/1189073864 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faa940048a0 con 0x7faaa808ae20 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaa6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaa6ffd640 10 monclient: dump: 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.107 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 4 set_mon_vals no callback set 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 10 monclient: shutdown 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 1 -- 10.20.193.57:0/1189073864 >> v1:10.20.193.57:6789/0 conn(0x7faaa808ae20 legacy=0x7faaa808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 1 -- 10.20.193.57:0/1189073864 shutdown_connections 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 1 -- 10.20.193.57:0/1189073864 >> 10.20.193.57:0/1189073864 conn(0x7faaa8091620 msgr2=0x7faaa8091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 1 -- 10.20.193.57:0/1189073864 shutdown_connections 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 1 -- 10.20.193.57:0/1189073864 wait complete. 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 10 monclient: build_initial_monmap 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 10 monclient: monmap: 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:20.108 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 1 Processor -- start 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 1 -- start start 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.104+0000 7faaae68c640 10 monclient: init 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 10 monclient(hunting): picked mon.noname-b con 0x7faaa808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 10 monclient(hunting): picked mon.noname-a con 0x7faaa808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 10 monclient(hunting): picked mon.noname-c con 0x7faaa808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa808d9c0 con 0x7faaa808c730 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa8088810 con 0x7faaa808ae20 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa811ee10 con 0x7faaa808cb30 2026-02-12T17:34:20.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:20.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaae68c640 10 monclient(hunting): authenticate will time out at 939.924140s 2026-02-12T17:34:20.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaa77fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7faaa808c730 0x7faaa81a1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40504/0 (socket says 10.20.193.57:40504) 2026-02-12T17:34:20.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.105+0000 7faaa77fe640 1 -- 10.20.193.57:0/1262250496 learned_addr learned my addr 10.20.193.57:0/1262250496 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:20.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa77fe640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6789/0 conn(0x7faaa808c730 legacy=0x7faaa81a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaacc02640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6790/0 conn(0x7faaa808cb30 legacy=0x7faaa81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341034689 0 0) 0x7faaa808d9c0 con 0x7faaa808c730 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): my global_id is 54123 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa780035e0 con 0x7faaa808c730 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1067750306 0 0) 0x7faaa811ee10 con 0x7faaa808cb30 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): my global_id is 44246 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa808d9c0 con 0x7faaa808cb30 2026-02-12T17:34:20.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa7fff640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.82:6789/0 conn(0x7faaa808ae20 legacy=0x7faaa81330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3319718056 0 0) 0x7faa780035e0 con 0x7faaa808c730 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faaa811ee10 con 0x7faaa808c730 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faa98003540 con 0x7faaa808c730 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): dump: 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.116 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2793296678 0 0) 0x7faaa808d9c0 con 0x7faaa808cb30 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa780035e0 con 0x7faaa808cb30 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faa9c004420 con 0x7faaa808cb30 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): dump: 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.117 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179991320 0 0) 0x7faaa8088810 con 0x7faaa808ae20 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): my global_id is 4681 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa808d9c0 con 0x7faaa808ae20 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2544179909 0 0) 0x7faaa811ee10 con 0x7faaa808c730 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6790/0 conn(0x7faaa808cb30 legacy=0x7faaa81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.82:6789/0 conn(0x7faaa808ae20 legacy=0x7faaa81330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 monclient: found mon.a 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:20.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa805ca70 con 0x7faaa808c730 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient: _finish_auth 0 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaae68c640 5 monclient: authenticate success, global_id 54123 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaae68c640 10 monclient: _renew_subs 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaae68c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaae68c640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faaa805af60 con 0x7faaa808c730 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaae68c640 10 monclient: _renew_subs 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaae68c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaae68c640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faaa811f310 con 0x7faaa808c730 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa77fe640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6789/0 conn(0x7faaa808c730 legacy=0x7faaa81a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa77fe640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6789/0 conn(0x7faaa808c730 legacy=0x7faaa81a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa77fe640 1 --1- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6789/0 conn(0x7faaa808c730 0x7faaa81a1bf0 :-1 s=OPENED pgs=283 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa77fe640 1 --1- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6789/0 conn(0x7faaa808c730 0x7faaa81a1bf0 :-1 s=OPENED pgs=283 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:34:20.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient: ms_handle_reset current mon v1:10.20.193.57:6789/0 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6789/0 conn(0x7faaa808c730 legacy=0x7faaa81a1bf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): picked mon.c con 0x7faaa808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): picked mon.a con 0x7faa78004170 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): picked mon.b con 0x7faaa808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faaa811ee10 con 0x7faa78004170 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faaa8088810 con 0x7faaa808ae20 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faa7806c490 con 0x7faaa808cb30 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.107+0000 7faaa4ff9640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.108+0000 7faaae68c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.108+0000 7faaae68c640 10 monclient(hunting): _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa77fe640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6789/0 conn(0x7faa78004170 legacy=0x7faa78046ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa7fff640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6790/0 conn(0x7faaa808cb30 legacy=0x7faa780038c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091198521 0 0) 0x7faaa811ee10 con 0x7faa78004170 2026-02-12T17:34:20.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7faa7806c620 con 0x7faa78004170 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055358593 0 0) 0x7faa7806c490 con 0x7faaa808cb30 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7faaa811ee10 con 0x7faaa808cb30 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaacc02640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.82:6789/0 conn(0x7faaa808ae20 legacy=0x7faa78068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2134616797 0 0) 0x7faa7806c620 con 0x7faa78004170 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6790/0 conn(0x7faaa808cb30 legacy=0x7faa780038c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.82:6789/0 conn(0x7faaa808ae20 legacy=0x7faa78068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 monclient: found mon.a 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:20.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7faa7806d870 con 0x7faa78004170 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa80008d0 con 0x7faa78004170 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa811ee10 con 0x7faa78004170 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: _finish_auth 0 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faa980050a0 con 0x7faa78004170 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: dump: 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.122 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faa98005330 con 0x7faa78004170 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7faa980054a0 con 0x7faa78004170 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.110+0000 7faaa67fc640 4 set_mon_vals no callback set 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.111+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 6 ==== osd_map(298..298 src has 202..298) ==== 3975+0+0 (unknown 3935420895 0 0) 0x7faa9804ef90 con 0x7faa78004170 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.111+0000 7faaa7fff640 10 monclient: get_auth_request con 0x7faaa808c730 auth_method 0 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.112+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7faa980177a0 con 0x7faa78004170 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.112+0000 7faaa4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:20.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.112+0000 7faaa4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:20.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.114+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7faa9804bd50 con 0x7faa78004170 2026-02-12T17:34:20.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.114+0000 7faaa4ff9640 10 monclient: handle_mon_command_ack 1 not found 2026-02-12T17:34:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.257+0000 7faaae68c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:34:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.257+0000 7faaae68c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:34:20.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.257+0000 7faaae68c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.257+0000 7faaae68c640 1 -- 10.20.193.57:0/1262250496 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7faaa808a4b0 con 0x7faa78004170 2026-02-12T17:34:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.258+0000 7faaa4ff9640 1 -- 10.20.193.57:0/1262250496 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7faa98016f50 con 0x7faa78004170 2026-02-12T17:34:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.258+0000 7faaa4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:34:20.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.258+0000 7faaa4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.259+0000 7faaae68c640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.82:6800/2441377515 conn(0x7faaa808c730 legacy=0x7faa780c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.259+0000 7faaae68c640 10 monclient: shutdown 2026-02-12T17:34:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.259+0000 7faaae68c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.259+0000 7faaae68c640 1 -- 10.20.193.57:0/1262250496 >> v1:10.20.193.57:6789/0 conn(0x7faa78004170 legacy=0x7faa78046ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.259+0000 7faaae68c640 1 -- 10.20.193.57:0/1262250496 shutdown_connections 2026-02-12T17:34:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.259+0000 7faaae68c640 1 -- 10.20.193.57:0/1262250496 >> 10.20.193.57:0/1262250496 conn(0x7faaa8091620 msgr2=0x7faaa80597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.259+0000 7faaae68c640 1 -- 10.20.193.57:0/1262250496 shutdown_connections 2026-02-12T17:34:20.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:20.259+0000 7faaae68c640 1 -- 10.20.193.57:0/1262250496 wait complete. 2026-02-12T17:34:20.266 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.266 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=1,health=13,kv=9,logm=65} crc {auth=3334102786,config=1228700967,health=2716147082,kv=3918187302,logm=4190280501}) 2026-02-12T17:34:20.266 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=9,logm=64} crc {auth=3197402124,config=1618278320,health=3862863517,kv=3041806377,logm=603421638}) 2026-02-12T17:34:20.266 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.266 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=1,health=13,kv=9,logm=65} crc {auth=3334102786,config=1228700967,health=2716147082,kv=3918187302,logm=4190280501}) 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=11,config=2,health=13,kv=11,logm=63} crc {auth=255742784,config=1618278320,health=2716147082,kv=1466688342,logm=282623999}) 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1510094603}) 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3588157606}) 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1510094603}) 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1233998481}) 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2665331666}) 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2133778735}) 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2665331666}) 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1408073695}) 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3931495537}) 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=81855109}) 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3931495537}) 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3044808593}) 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=564598946}) 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=691651047}) 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.268 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=564598946}) 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=944840177}) 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3447043199}) 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2944589787}) 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3447043199}) 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=264667262}) 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=412833492}) 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=825708377}) 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=412833492}) 2026-02-12T17:34:20.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.257+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=496260707}) 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=738098854}) 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3289937166}) 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=738098854}) 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1267945740}) 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1486980270}) 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2784346264}) 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1486980270}) 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.258+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2062913121}) 2026-02-12T17:34:20.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3147890457}) 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=854975048}) 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3147890457}) 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1888929620}) 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2631749579}) 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528061981}) 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2631749579}) 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.259+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1628512228}) 2026-02-12T17:34:20.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3992024364}) 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3311135454}) 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3992024364}) 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2682049125}) 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2866766096}) 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3431187979}) 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2866766096}) 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.260+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2459449129}) 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.261+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.261+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=65,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3} crc {logm=207237971,mdsmap=2130131172,mgr=919603529,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3102222149,mon_config_key=383892656,monmap=2728086219}) 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.261+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=68,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=9,monmap=2} crc {logm=3347776147,mdsmap=2204869053,mgr=4185179831,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=596124105,mon_config_key=325234814,monmap=2432750869}) 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.261+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.261+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=65,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3} crc {logm=207237971,mdsmap=2130131172,mgr=919603529,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3102222149,mon_config_key=383892656,monmap=2728086219}) 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.261+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=69,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=8} crc {logm=450980384,mdsmap=2130131172,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3102222149,mon_config_key=1005603049}) 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=50,osdmap=40} crc {nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2177225543,osd_snap=360695071,osdmap=1862753077}) 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=50,osdmap=40} crc {nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2177225543,osd_snap=3123235189,osdmap=1026818859}) 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=50,osdmap=40} crc {nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2177225543,osd_snap=360695071,osdmap=1862753077}) 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=47,osdmap=43} crc {nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2177225543,osd_snap=795207922,osdmap=3791978089}) 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.273 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3253362814}) 2026-02-12T17:34:20.274 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2586401238}) 2026-02-12T17:34:20.274 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.274 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3253362814}) 2026-02-12T17:34:20.274 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.262+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1854681664}) 2026-02-12T17:34:20.274 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.263+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:34:20.274 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.263+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=17} crc {osdmap=2424438081}) 2026-02-12T17:34:20.274 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:34:20.263+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=16} crc {osdmap=4103205543}) 2026-02-12T17:34:20.275 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:34:21.058 INFO:tasks.rados.rados.0.trial082.stdout:1311: done (2 left) 2026-02-12T17:34:21.058 INFO:tasks.rados.rados.0.trial082.stdout:1312: delete oid 50 current snap is 143 2026-02-12T17:34:21.058 INFO:tasks.rados.rados.0.trial082.stdout:1309: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:34:21.058 INFO:tasks.rados.rados.0.trial082.stdout:1309: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:34:21.058 INFO:tasks.rados.rados.0.trial082.stdout:1309: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:34:21.058 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 648 (ObjNum 380 snap 113 seq_num 380) dirty exists 2026-02-12T17:34:21.058 INFO:tasks.rados.rados.0.trial082.stdout:1310: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:34:21.137 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2001392 2026-02-12T17:34:21.143 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:21.188 INFO:tasks.rados.rados.0.trial082.stdout:1309: done (2 left) 2026-02-12T17:34:21.188 INFO:tasks.rados.rados.0.trial082.stdout:1310: done (1 left) 2026-02-12T17:34:21.189 INFO:tasks.rados.rados.0.trial082.stdout:1312: done (0 left) 2026-02-12T17:34:21.189 INFO:tasks.rados.rados.0.trial082.stdout:1313: delete oid 48 current snap is 143 2026-02-12T17:34:21.190 INFO:tasks.rados.rados.0.trial082.stdout:1313: done (0 left) 2026-02-12T17:34:21.190 INFO:tasks.rados.rados.0.trial082.stdout:1314: rollback oid 1 current snap is 143 2026-02-12T17:34:21.190 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 141 2026-02-12T17:34:21.190 INFO:tasks.rados.rados.0.trial082.stdout:1315: read oid 2 snap 115 2026-02-12T17:34:21.190 INFO:tasks.rados.rados.0.trial082.stdout:1315: expect (ObjNum 385 snap 113 seq_num 385) 2026-02-12T17:34:21.190 INFO:tasks.rados.rados.0.trial082.stdout:1316: rollback oid 43 current snap is 143 2026-02-12T17:34:21.191 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 43 to 140 2026-02-12T17:34:21.191 INFO:tasks.rados.rados.0.trial082.stdout:1317: write oid 40 current snap is 143 2026-02-12T17:34:21.191 INFO:tasks.rados.rados.0.trial082.stdout:1317: seq_num 460 ranges {531220=795720,1935011=516810,3066106=420420} 2026-02-12T17:34:21.195 INFO:tasks.rados.rados.0.trial082.stdout:1317: writing trial08226312-40 from 531220 to 1326940 tid 1 2026-02-12T17:34:21.199 INFO:tasks.rados.rados.0.trial082.stdout:1317: writing trial08226312-40 from 1935011 to 2451821 tid 2 2026-02-12T17:34:21.203 INFO:tasks.rados.rados.0.trial082.stdout:1317: writing trial08226312-40 from 3066106 to 3486526 tid 3 2026-02-12T17:34:21.203 INFO:tasks.rados.rados.0.trial082.stdout:1318: copy_from oid 21 from oid 37 current snap is 143 2026-02-12T17:34:21.203 INFO:tasks.rados.rados.0.trial082.stdout:1314: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:34:21.204 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 439 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-12T17:34:21.204 INFO:tasks.rados.rados.0.trial082.stdout:1316: finishing rollback tid 0 to trial08226312-43 2026-02-12T17:34:21.204 INFO:tasks.rados.rados.0.trial082.stdout:1315: expect (ObjNum 385 snap 113 seq_num 385) 2026-02-12T17:34:21.245 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2358106 2026-02-12T17:34:21.269 INFO:tasks.rados.rados.0.trial082.stdout:1316: finishing rollback tid 1 to trial08226312-43 2026-02-12T17:34:21.269 INFO:tasks.rados.rados.0.trial082.stdout:1314: done (4 left) 2026-02-12T17:34:21.269 INFO:tasks.rados.rados.0.trial082.stdout:1315: done (3 left) 2026-02-12T17:34:21.269 INFO:tasks.rados.rados.0.trial082.stdout:1319: read oid 5 snap -1 2026-02-12T17:34:21.269 INFO:tasks.rados.rados.0.trial082.stdout:1319: expect (ObjNum 384 snap 113 seq_num 384) 2026-02-12T17:34:21.269 INFO:tasks.rados.rados.0.trial082.stdout:1320: snap_remove snap 115 2026-02-12T17:34:21.276 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:34:21.276 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:34:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.341+0000 7f0d6168c640 10 monclient: get_monmap_and_config 2026-02-12T17:34:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.341+0000 7f0d6168c640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.341+0000 7f0d6168c640 10 monclient: monmap: 2026-02-12T17:34:21.341 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.341 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.341 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:21.342759+0000 2026-02-12T17:34:21.341 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:21.342759+0000 2026-02-12T17:34:21.341 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.341 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 1 Processor -- start 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 1 -- start start 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 10 monclient: init 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:34:21.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 10 monclient(hunting): picked mon.noname-a con 0x7f0d5c08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 10 monclient(hunting): picked mon.noname-b con 0x7f0d5c08c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 10 monclient(hunting): picked mon.noname-c con 0x7f0d5c08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c08d600 con 0x7f0d5c08ae20 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c08b1f0 con 0x7f0d5c08cb30 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c08d1f0 con 0x7f0d5c08c730 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d6168c640 10 monclient(hunting): authenticate will time out at 941.161645s 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d5a7fc640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0d5c08c730 0x7f0d5c181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36436/0 (socket says 10.20.193.57:36436) 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d5a7fc640 1 -- 10.20.193.57:0/4053355420 learned_addr learned my addr 10.20.193.57:0/4053355420 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.342+0000 7f0d5affd640 1 --1- 10.20.193.57:0/4053355420 >> v1:10.20.193.57:6789/0 conn(0x7f0d5c08ae20 0x7f0d5c08c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40526/0 (socket says 10.20.193.57:40526) 2026-02-12T17:34:21.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.344+0000 7f0d5a7fc640 1 -- 10.20.193.57:0/4053355420 >> v1:10.20.193.57:6790/0 conn(0x7f0d5c08c730 legacy=0x7f0d5c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.344+0000 7f0d5affd640 1 -- 10.20.193.57:0/4053355420 >> v1:10.20.193.57:6789/0 conn(0x7f0d5c08ae20 legacy=0x7f0d5c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968244401 0 0) 0x7f0d5c08d1f0 con 0x7f0d5c08c730 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient(hunting): my global_id is 44249 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d480035e0 con 0x7f0d5c08c730 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231980441 0 0) 0x7f0d5c08d600 con 0x7f0d5c08ae20 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient(hunting): my global_id is 54126 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d5c08d1f0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d5b7fe640 1 -- 10.20.193.57:0/4053355420 >> v1:10.20.193.82:6789/0 conn(0x7f0d5c08cb30 legacy=0x7f0d5c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2900135497 0 0) 0x7f0d480035e0 con 0x7f0d5c08c730 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 >> v1:10.20.193.82:6789/0 conn(0x7f0d5c08cb30 legacy=0x7f0d5c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 >> v1:10.20.193.57:6789/0 conn(0x7f0d5c08ae20 legacy=0x7f0d5c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 monclient: found mon.noname-b 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c057320 con 0x7f0d5c08c730 2026-02-12T17:34:21.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0d440030c0 con 0x7f0d5c08c730 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: dump: 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.354 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 5 monclient: authenticate success, global_id 44249 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d44003350 con 0x7f0d5c08c730 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 4 set_mon_vals no callback set 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 1 -- 10.20.193.57:0/4053355420 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0d44004b10 con 0x7f0d5c08c730 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d59ffb640 10 monclient: dump: 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 10 monclient: shutdown 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 1 -- 10.20.193.57:0/4053355420 >> v1:10.20.193.57:6790/0 conn(0x7f0d5c08c730 legacy=0x7f0d5c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 1 -- 10.20.193.57:0/4053355420 shutdown_connections 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 1 -- 10.20.193.57:0/4053355420 >> 10.20.193.57:0/4053355420 conn(0x7f0d5c091620 msgr2=0x7f0d5c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 1 -- 10.20.193.57:0/4053355420 shutdown_connections 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.345+0000 7f0d6168c640 1 -- 10.20.193.57:0/4053355420 wait complete. 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient: monmap: 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:21.357 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 1 Processor -- start 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 1 -- start start 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient: init 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:21.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient(hunting): picked mon.noname-c con 0x7f0d5c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient(hunting): picked mon.noname-b con 0x7f0d5c08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient(hunting): picked mon.noname-a con 0x7f0d5c08cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c08d9c0 con 0x7f0d5c08cb30 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c05b0d0 con 0x7f0d5c08c730 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c088810 con 0x7f0d5c08ae20 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d6168c640 10 monclient(hunting): authenticate will time out at 941.165806s 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d5affd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0d5c08ae20 0x7f0d5c088d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36450/0 (socket says 10.20.193.57:36450) 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.346+0000 7f0d5affd640 1 -- 10.20.193.57:0/498160240 learned_addr learned my addr 10.20.193.57:0/498160240 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.348+0000 7f0d5affd640 1 -- 10.20.193.57:0/498160240 >> v1:10.20.193.57:6790/0 conn(0x7f0d5c08ae20 legacy=0x7f0d5c088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.348+0000 7f0d5b7fe640 1 -- 10.20.193.57:0/498160240 >> v1:10.20.193.57:6789/0 conn(0x7f0d5c08cb30 legacy=0x7f0d5c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4219601126 0 0) 0x7f0d5c088810 con 0x7f0d5c08ae20 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): my global_id is 44252 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d280035e0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450669551 0 0) 0x7f0d5c08d9c0 con 0x7f0d5c08cb30 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): my global_id is 54129 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d5c088810 con 0x7f0d5c08cb30 2026-02-12T17:34:21.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d5a7fc640 1 -- 10.20.193.57:0/498160240 >> v1:10.20.193.82:6789/0 conn(0x7f0d5c08c730 legacy=0x7f0d5c089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2940662168 0 0) 0x7f0d280035e0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d5c08d9c0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0d50003360 con 0x7f0d5c08ae20 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): dump: 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.361 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2968374539 0 0) 0x7f0d5c088810 con 0x7f0d5c08cb30 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d280035e0 con 0x7f0d5c08cb30 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0d4c004420 con 0x7f0d5c08cb30 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): dump: 2026-02-12T17:34:21.362 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430993304 0 0) 0x7f0d5c05b0d0 con 0x7f0d5c08c730 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient(hunting): my global_id is 4687 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d5c088810 con 0x7f0d5c08c730 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1321020033 0 0) 0x7f0d5c08d9c0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 >> v1:10.20.193.82:6789/0 conn(0x7f0d5c08c730 legacy=0x7f0d5c089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 >> v1:10.20.193.57:6789/0 conn(0x7f0d5c08cb30 legacy=0x7f0d5c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 monclient: found mon.c 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c11eed0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d6168c640 5 monclient: authenticate success, global_id 44252 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d6168c640 10 monclient: _renew_subs 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d6168c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c05ccb0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d6168c640 10 monclient: _renew_subs 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d6168c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0d5c123660 con 0x7f0d5c08ae20 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d50004bc0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0d50004ee0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.365 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d3b7fe640 10 monclient: dump: 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.366 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.349+0000 7f0d597fa640 4 set_mon_vals no callback set 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.350+0000 7f0d6168c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.350+0000 7f0d6168c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.350+0000 7f0d6168c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.350+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c0008d0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.350+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0d50005130 con 0x7f0d5c08ae20 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.350+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(299..299 src has 202..299) ==== 3975+0+0 (unknown 2479889403 0 0) 0x7f0d5004ecb0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.350+0000 7f0d5a7fc640 10 monclient: get_auth_request con 0x7f0d2803fd10 auth_method 0 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.353+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f0d500173a0 con 0x7f0d5c08ae20 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.353+0000 7f0d3b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.367 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.353+0000 7f0d3b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:21.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.498+0000 7f0d6168c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:34:21.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.498+0000 7f0d6168c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:21.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.498+0000 7f0d6168c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.498+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0d5c11ea10 con 0x7f0d5c08ae20 2026-02-12T17:34:21.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.498+0000 7f0d3b7fe640 1 -- 10.20.193.57:0/498160240 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2836107084) 0x7f0d50016b50 con 0x7f0d5c08ae20 2026-02-12T17:34:21.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.498+0000 7f0d3b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:21.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.498+0000 7f0d3b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:21.497 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:34:21.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.499+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 >> v1:10.20.193.82:6800/2441377515 conn(0x7f0d2803fd10 legacy=0x7f0d280601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.499+0000 7f0d6168c640 10 monclient: shutdown 2026-02-12T17:34:21.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.499+0000 7f0d6168c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:21.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.499+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 >> v1:10.20.193.57:6790/0 conn(0x7f0d5c08ae20 legacy=0x7f0d5c088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.499+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 shutdown_connections 2026-02-12T17:34:21.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.499+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 >> 10.20.193.57:0/498160240 conn(0x7f0d5c091620 msgr2=0x7f0d5c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:21.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.499+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 shutdown_connections 2026-02-12T17:34:21.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.499+0000 7f0d6168c640 1 -- 10.20.193.57:0/498160240 wait complete. 2026-02-12T17:34:21.506 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:34:21.506 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:34:21.506 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:34:21.506 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:34:21.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.574+0000 7faae34cc640 10 monclient: get_monmap_and_config 2026-02-12T17:34:21.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.574+0000 7faae34cc640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.574+0000 7faae34cc640 10 monclient: monmap: 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:21.575424+0000 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:21.575424+0000 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:21.574 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.574+0000 7faae34cc640 1 Processor -- start 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 1 -- start start 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 10 monclient: init 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 10 monclient(hunting): picked mon.noname-b con 0x7faadc08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 10 monclient(hunting): picked mon.noname-a con 0x7faadc08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 10 monclient(hunting): picked mon.noname-c con 0x7faadc182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faadc08a820 con 0x7faadc08c620 2026-02-12T17:34:21.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faadc089450 con 0x7faadc182cc0 2026-02-12T17:34:21.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faadc089730 con 0x7faadc08c250 2026-02-12T17:34:21.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae34cc640 10 monclient(hunting): authenticate will time out at 941.394318s 2026-02-12T17:34:21.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae1241640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7faadc08c250 0x7faadc08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36458/0 (socket says 10.20.193.57:36458) 2026-02-12T17:34:21.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae1241640 1 -- 10.20.193.57:0/954245258 learned_addr learned my addr 10.20.193.57:0/954245258 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.575+0000 7faae0a40640 1 --1- 10.20.193.57:0/954245258 >> v1:10.20.193.57:6789/0 conn(0x7faadc08c620 0x7faadc08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40538/0 (socket says 10.20.193.57:40538) 2026-02-12T17:34:21.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faae0a40640 1 -- 10.20.193.57:0/954245258 >> v1:10.20.193.57:6789/0 conn(0x7faadc08c620 legacy=0x7faadc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faae1241640 1 -- 10.20.193.57:0/954245258 >> v1:10.20.193.57:6790/0 conn(0x7faadc08c250 legacy=0x7faadc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1670129759 0 0) 0x7faad0002c20 con 0x7faadc08c620 2026-02-12T17:34:21.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 10 monclient(hunting): my global_id is 54132 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faac40035e0 con 0x7faadc08c620 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199650913 0 0) 0x7faadc089730 con 0x7faadc08c250 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 10 monclient(hunting): my global_id is 44255 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faad0002c20 con 0x7faadc08c250 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faae1a42640 1 -- 10.20.193.57:0/954245258 >> v1:10.20.193.82:6789/0 conn(0x7faadc182cc0 legacy=0x7faadc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1377716805 0 0) 0x7faad0002c20 con 0x7faadc08c250 2026-02-12T17:34:21.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.577+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 >> v1:10.20.193.82:6789/0 conn(0x7faadc182cc0 legacy=0x7faadc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 >> v1:10.20.193.57:6789/0 conn(0x7faadc08c620 legacy=0x7faadc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 1 monclient: found mon.noname-b 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faadc089a10 con 0x7faadc08c250 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faacc003080 con 0x7faadc08c250 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 5 monclient: authenticate success, global_id 44255 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:21.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: dump: 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.588 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faacc003250 con 0x7faadc08c250 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 1 -- 10.20.193.57:0/954245258 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faacc004960 con 0x7faadc08c250 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 4 set_mon_vals no callback set 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faacbfff640 10 monclient: dump: 2026-02-12T17:34:21.589 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 10 monclient: shutdown 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:21.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 1 -- 10.20.193.57:0/954245258 >> v1:10.20.193.57:6790/0 conn(0x7faadc08c250 legacy=0x7faadc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 1 -- 10.20.193.57:0/954245258 shutdown_connections 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 1 -- 10.20.193.57:0/954245258 >> 10.20.193.57:0/954245258 conn(0x7faadc0916b0 msgr2=0x7faadc091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 1 -- 10.20.193.57:0/954245258 shutdown_connections 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 1 -- 10.20.193.57:0/954245258 wait complete. 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.578+0000 7faae34cc640 10 monclient: monmap: 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:21.591 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 1 Processor -- start 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 1 -- start start 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 10 monclient: init 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 10 monclient(hunting): picked mon.noname-b con 0x7faadc08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 10 monclient(hunting): picked mon.noname-c con 0x7faadc08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 10 monclient(hunting): picked mon.noname-a con 0x7faadc182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faadc05c710 con 0x7faadc182cc0 2026-02-12T17:34:21.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faadc0888a0 con 0x7faadc08c250 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faadc05c270 con 0x7faadc08c620 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae34cc640 10 monclient(hunting): authenticate will time out at 941.398375s 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae0a40640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7faadc08c620 0x7faadc181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36468/0 (socket says 10.20.193.57:36468) 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.579+0000 7faae0a40640 1 -- 10.20.193.57:0/194434632 learned_addr learned my addr 10.20.193.57:0/194434632 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faae0a40640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6790/0 conn(0x7faadc08c620 legacy=0x7faadc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faae1a42640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6789/0 conn(0x7faadc182cc0 legacy=0x7faadc1823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faae1241640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.82:6789/0 conn(0x7faadc08c250 legacy=0x7faadc13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833928234 0 0) 0x7faadc05c270 con 0x7faadc08c620 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): my global_id is 44258 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaac0035e0 con 0x7faadc08c620 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112292834 0 0) 0x7faadc05c710 con 0x7faadc182cc0 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): my global_id is 54135 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faadc05c270 con 0x7faadc182cc0 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1722279117 0 0) 0x7faaac0035e0 con 0x7faadc08c620 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faadc05c710 con 0x7faadc08c620 2026-02-12T17:34:21.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faad00048a0 con 0x7faadc08c620 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): dump: 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.595 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309398780 0 0) 0x7faadc0888a0 con 0x7faadc08c250 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 10 monclient(hunting): my global_id is 4693 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.581+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaac0035e0 con 0x7faadc08c250 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1484623632 0 0) 0x7faadc05c270 con 0x7faadc182cc0 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faadc0888a0 con 0x7faadc182cc0 2026-02-12T17:34:21.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faad8004420 con 0x7faadc182cc0 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient(hunting): dump: 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.597 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3472745138 0 0) 0x7faadc05c710 con 0x7faadc08c620 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.82:6789/0 conn(0x7faadc08c250 legacy=0x7faadc13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6789/0 conn(0x7faadc182cc0 legacy=0x7faadc1823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 monclient: found mon.c 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faadc182ad0 con 0x7faadc08c620 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faae34cc640 5 monclient: authenticate success, global_id 44258 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faae34cc640 10 monclient: _renew_subs 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faae34cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faadc05c4d0 con 0x7faadc08c620 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faae34cc640 10 monclient: _renew_subs 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faae34cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faadc05cdd0 con 0x7faadc08c620 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faad0004cb0 con 0x7faadc08c620 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faad0004fd0 con 0x7faadc08c620 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faacb7fe640 4 set_mon_vals no callback set 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 10 monclient: dump: 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faae34cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faadc090810 con 0x7faadc18d340 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.582+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7faad0011c40 con 0x7faadc08c620 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.583+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(299..299 src has 202..299) ==== 3975+0+0 (unknown 2479889403 0 0) 0x7faad004eae0 con 0x7faadc08c620 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.583+0000 7faae1a42640 10 monclient: get_auth_request con 0x7faaac03fd10 auth_method 0 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.584+0000 7faae1241640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6789/0 conn(0x7faadc18d340 legacy=0x7faadc18d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.584+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702880032 0 0) 0x7faadc090810 con 0x7faadc18d340 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.584+0000 7faac9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.584+0000 7faac9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.584+0000 7faac9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.584+0000 7faac9ffb640 10 monclient(hunting): my global_id is 54138 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.584+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faadc05c710 con 0x7faadc18d340 2026-02-12T17:34:21.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3488840181 0 0) 0x7faadc05c710 con 0x7faadc18d340 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faadc090810 con 0x7faadc18d340 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faacc003570 con 0x7faadc18d340 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 10 monclient: dump: 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.602 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.603 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.603 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4134107858 0 0) 0x7faadc090810 con 0x7faadc18d340 2026-02-12T17:34:21.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faadc13f600 con 0x7faadc18d340 2026-02-12T17:34:21.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7faacc004b00 con 0x7faadc18d340 2026-02-12T17:34:21.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:21.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6789/0 conn(0x7faadc18d340 legacy=0x7faadc18d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.585+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6789/0 conn(0x7faadc18d340 legacy=0x7faadc18d710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:21.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.588+0000 7faae34cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:34:21.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.588+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faadc08a820 con 0x7faadc18de20 2026-02-12T17:34:21.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.590+0000 7faae1241640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6789/0 conn(0x7faadc18de20 legacy=0x7faadc195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734750959 0 0) 0x7faaac0035e0 con 0x7faadc18de20 2026-02-12T17:34:21.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 10 monclient(hunting): my global_id is 54141 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faadc090810 con 0x7faadc18de20 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2072265534 0 0) 0x7faadc090810 con 0x7faadc18de20 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faaac0035e0 con 0x7faadc18de20 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faacc005150 con 0x7faadc18de20 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 10 monclient: dump: 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.606 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3815065424 0 0) 0x7faaac0035e0 con 0x7faadc18de20 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faadc08f580 con 0x7faadc18de20 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4336 (unknown 0 0 3912470439) 0x7faacc007430 con 0x7faadc18de20 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6789/0 conn(0x7faadc18de20 legacy=0x7faadc195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faac9ffb640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6789/0 conn(0x7faadc18de20 legacy=0x7faadc195570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 28, 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 2069, 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:34:21.608 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:21.609 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:21.610 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:34:21.611 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:21.612 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:34:21.613 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:34:21.614 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:34:21.615 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:21.616 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:21.617 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:21.617 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.617 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.617 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.617 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:34:21.617 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.82:6800/2441377515 conn(0x7faaac03fd10 legacy=0x7faaac0601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae34cc640 10 monclient: shutdown 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae34cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 >> v1:10.20.193.57:6790/0 conn(0x7faadc08c620 legacy=0x7faadc181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae1a42640 1 -- 10.20.193.57:0/194434632 reap_dead start 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae1a42640 1 -- 10.20.193.57:0/194434632 reap_dead start 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 shutdown_connections 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 >> 10.20.193.57:0/194434632 conn(0x7faadc0916b0 msgr2=0x7faadc08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 shutdown_connections 2026-02-12T17:34:21.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.591+0000 7faae34cc640 1 -- 10.20.193.57:0/194434632 wait complete. 2026-02-12T17:34:21.619 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:34:21.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:34:21.619 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:34:21.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.686+0000 7f7700a5b640 10 monclient: get_monmap_and_config 2026-02-12T17:34:21.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.686+0000 7f7700a5b640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.686+0000 7f7700a5b640 10 monclient: monmap: 2026-02-12T17:34:21.684 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.684 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.684 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:21.687242+0000 2026-02-12T17:34:21.684 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:21.687242+0000 2026-02-12T17:34:21.684 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.685 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.685 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.685 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:21.685 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:21.685 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.686+0000 7f7700a5b640 1 Processor -- start 2026-02-12T17:34:21.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.686+0000 7f7700a5b640 1 -- start start 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.686+0000 7f7700a5b640 10 monclient: init 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f76fc08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f76fc08c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f76fc182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76fc08a820 con 0x7f76fc182cc0 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76fc089450 con 0x7f76fc08c620 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76fc089730 con 0x7f76fc08c250 2026-02-12T17:34:21.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f7700a5b640 10 monclient(hunting): authenticate will time out at 941.506138s 2026-02-12T17:34:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f76fa575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f76fc08c250 0x7f76fc08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36474/0 (socket says 10.20.193.57:36474) 2026-02-12T17:34:21.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.687+0000 7f76fa575640 1 -- 10.20.193.57:0/1219205364 learned_addr learned my addr 10.20.193.57:0/1219205364 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76fa575640 1 -- 10.20.193.57:0/1219205364 >> v1:10.20.193.57:6790/0 conn(0x7f76fc08c250 legacy=0x7f76fc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76fad76640 1 -- 10.20.193.57:0/1219205364 >> v1:10.20.193.57:6789/0 conn(0x7f76fc182cc0 legacy=0x7f76fc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262702622 0 0) 0x7f76fc089730 con 0x7f76fc08c250 2026-02-12T17:34:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient(hunting): my global_id is 44261 2026-02-12T17:34:21.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76e80035e0 con 0x7f76fc08c250 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9d74640 1 -- 10.20.193.57:0/1219205364 >> v1:10.20.193.82:6789/0 conn(0x7f76fc08c620 legacy=0x7f76fc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716142264 0 0) 0x7f76ec003d50 con 0x7f76fc182cc0 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient(hunting): my global_id is 54144 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76fc089730 con 0x7f76fc182cc0 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1485142570 0 0) 0x7f76e80035e0 con 0x7f76fc08c250 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 >> v1:10.20.193.82:6789/0 conn(0x7f76fc08c620 legacy=0x7f76fc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 >> v1:10.20.193.57:6789/0 conn(0x7f76fc182cc0 legacy=0x7f76fc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 monclient: found mon.noname-b 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76fc089a10 con 0x7f76fc08c250 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f76f00030d0 con 0x7f76fc08c250 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:34:21.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: dump: 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f7700a5b640 5 monclient: authenticate success, global_id 44261 2026-02-12T17:34:21.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f7700a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76f00033d0 con 0x7f76fc08c250 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f7700a5b640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f7700a5b640 4 set_mon_vals no callback set 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 1 -- 10.20.193.57:0/1219205364 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f76f0004b10 con 0x7f76fc08c250 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f76f9573640 10 monclient: dump: 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.701 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f7700a5b640 10 monclient: shutdown 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f7700a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.689+0000 7f7700a5b640 1 -- 10.20.193.57:0/1219205364 >> v1:10.20.193.57:6790/0 conn(0x7f76fc08c250 legacy=0x7f76fc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 1 -- 10.20.193.57:0/1219205364 shutdown_connections 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 1 -- 10.20.193.57:0/1219205364 >> 10.20.193.57:0/1219205364 conn(0x7f76fc0916b0 msgr2=0x7f76fc091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:21.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 1 -- 10.20.193.57:0/1219205364 shutdown_connections 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 1 -- 10.20.193.57:0/1219205364 wait complete. 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient: monmap: 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:21.703 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 1 Processor -- start 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 1 -- start start 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient: init 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient(hunting): picked mon.noname-c con 0x7f76fc08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient(hunting): picked mon.noname-a con 0x7f76fc08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient(hunting): picked mon.noname-b con 0x7f76fc182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76fc1387e0 con 0x7f76fc08c620 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76fc138570 con 0x7f76fc182cc0 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76fc13edc0 con 0x7f76fc08c250 2026-02-12T17:34:21.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f7700a5b640 10 monclient(hunting): authenticate will time out at 941.509838s 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f76fa575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f76fc08c250 0x7f76fc085fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36480/0 (socket says 10.20.193.57:36480) 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.690+0000 7f76fa575640 1 -- 10.20.193.57:0/662838554 learned_addr learned my addr 10.20.193.57:0/662838554 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.692+0000 7f76fa575640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6790/0 conn(0x7f76fc08c250 legacy=0x7f76fc085fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76f9d74640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6789/0 conn(0x7f76fc08c620 legacy=0x7f76fc0866d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300837695 0 0) 0x7f76fc13edc0 con 0x7f76fc08c250 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): my global_id is 44264 2026-02-12T17:34:21.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76fad76640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.82:6789/0 conn(0x7f76fc182cc0 legacy=0x7f76fc195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76c80035e0 con 0x7f76fc08c250 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3114440705 0 0) 0x7f76fc1387e0 con 0x7f76fc08c620 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): my global_id is 54147 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76fc13edc0 con 0x7f76fc08c620 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317429366 0 0) 0x7f76fc089730 con 0x7f76fc182cc0 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): my global_id is 4699 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76fc1387e0 con 0x7f76fc182cc0 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 633897271 0 0) 0x7f76c80035e0 con 0x7f76fc08c250 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76fc089730 con 0x7f76fc08c250 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f76f0004a50 con 0x7f76fc08c250 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): dump: 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.707 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2306774926 0 0) 0x7f76fc1387e0 con 0x7f76fc182cc0 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76c80035e0 con 0x7f76fc182cc0 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f76ec003d20 con 0x7f76fc182cc0 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): dump: 2026-02-12T17:34:21.708 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 313392715 0 0) 0x7f76fc13edc0 con 0x7f76fc08c620 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76fc1387e0 con 0x7f76fc08c620 2026-02-12T17:34:21.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f76e4003340 con 0x7f76fc08c620 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient(hunting): dump: 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.710 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1673105128 0 0) 0x7f76fc089730 con 0x7f76fc08c250 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.82:6789/0 conn(0x7f76fc182cc0 legacy=0x7f76fc195910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6789/0 conn(0x7f76fc08c620 legacy=0x7f76fc0866d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 monclient: found mon.c 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76fc086de0 con 0x7f76fc08c250 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f7700a5b640 5 monclient: authenticate success, global_id 44264 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f7700a5b640 10 monclient: _renew_subs 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f7700a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f76fc138ac0 con 0x7f76fc08c250 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f7700a5b640 10 monclient: _renew_subs 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f7700a5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f76fc13e520 con 0x7f76fc08c250 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76f0002b30 con 0x7f76fc08c250 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f76f0002d50 con 0x7f76fc08c250 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.712 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76e2ffd640 10 monclient: dump: 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.693+0000 7f76f8d72640 4 set_mon_vals no callback set 2026-02-12T17:34:21.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.694+0000 7f7700a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.694+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f76fc137320 con 0x7f76fc13d300 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.694+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f76f0011d30 con 0x7f76fc08c250 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.694+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(299..299 src has 202..299) ==== 3975+0+0 (unknown 2479889403 0 0) 0x7f76f004ed50 con 0x7f76fc08c250 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.694+0000 7f76fad76640 10 monclient: get_auth_request con 0x7f76c803ffd0 auth_method 0 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76f9d74640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6790/0 conn(0x7f76fc13d300 legacy=0x7f76fc18f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2189952009 0 0) 0x7f76fc1387e0 con 0x7f76fc13d300 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 10 monclient(hunting): my global_id is 44267 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76fc089730 con 0x7f76fc13d300 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1037418207 0 0) 0x7f76fc089730 con 0x7f76fc13d300 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76fc1387e0 con 0x7f76fc13d300 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f76e4003ab0 con 0x7f76fc13d300 2026-02-12T17:34:21.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 10 monclient: dump: 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1489166024 0 0) 0x7f76fc1387e0 con 0x7f76fc13d300 2026-02-12T17:34:21.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76fc1383f0 con 0x7f76fc13d300 2026-02-12T17:34:21.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f76e4005880 con 0x7f76fc13d300 2026-02-12T17:34:21.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:21.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6790/0 conn(0x7f76fc13d300 legacy=0x7f76fc18f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.696+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6790/0 conn(0x7f76fc13d300 legacy=0x7f76fc18f480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:21.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.700+0000 7f7700a5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.700+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f76fc090810 con 0x7f76fc18fb90 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76f9d74640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6790/0 conn(0x7f76fc18fb90 legacy=0x7f76fc198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683844390 0 0) 0x7f76fc090810 con 0x7f76fc18fb90 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 10 monclient(hunting): my global_id is 44270 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76fc1387e0 con 0x7f76fc18fb90 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 267424850 0 0) 0x7f76fc1387e0 con 0x7f76fc18fb90 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76fc090810 con 0x7f76fc18fb90 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f76e4004260 con 0x7f76fc18fb90 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 10 monclient: dump: 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3622657579 0 0) 0x7f76fc090810 con 0x7f76fc18fb90 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f76fc13d6d0 con 0x7f76fc18fb90 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 4227314862) 0x7f76e4005aa0 con 0x7f76fc18fb90 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:34:21.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6790/0 conn(0x7f76fc18fb90 legacy=0x7f76fc198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.702+0000 7f76e2ffd640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6790/0 conn(0x7f76fc18fb90 legacy=0x7f76fc198040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 28, 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 138628, 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:34:21.720 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:21.721 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:21.722 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:34:21.723 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:21.724 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:21.725 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:34:21.726 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:34:21.727 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:21.728 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:34:21.729 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:34:21.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.82:6800/2441377515 conn(0x7f76c803ffd0 legacy=0x7f76c8060480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f7700a5b640 10 monclient: shutdown 2026-02-12T17:34:21.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f7700a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:21.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 >> v1:10.20.193.57:6790/0 conn(0x7f76fc08c250 legacy=0x7f76fc085fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f76fad76640 1 -- 10.20.193.57:0/662838554 reap_dead start 2026-02-12T17:34:21.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f76fad76640 1 -- 10.20.193.57:0/662838554 reap_dead start 2026-02-12T17:34:21.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 shutdown_connections 2026-02-12T17:34:21.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 >> 10.20.193.57:0/662838554 conn(0x7f76fc0916b0 msgr2=0x7f76fc1915a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:21.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 shutdown_connections 2026-02-12T17:34:21.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.703+0000 7f7700a5b640 1 -- 10.20.193.57:0/662838554 wait complete. 2026-02-12T17:34:21.731 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:34:21.731 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:34:21.731 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:34:21.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.800+0000 7f0c730b8640 10 monclient: get_monmap_and_config 2026-02-12T17:34:21.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.800+0000 7f0c730b8640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.800+0000 7f0c730b8640 10 monclient: monmap: 2026-02-12T17:34:21.798 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.798 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.798 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:21.800939+0000 2026-02-12T17:34:21.798 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:21.800939+0000 2026-02-12T17:34:21.798 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.798 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.799 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.799 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:21.799 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:21.799 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.800+0000 7f0c730b8640 1 Processor -- start 2026-02-12T17:34:21.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.800+0000 7f0c730b8640 1 -- start start 2026-02-12T17:34:21.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.800+0000 7f0c730b8640 10 monclient: init 2026-02-12T17:34:21.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 10 monclient(hunting): picked mon.noname-c con 0x7f0c6c0906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 10 monclient(hunting): picked mon.noname-b con 0x7f0c6c0911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 10 monclient(hunting): picked mon.noname-a con 0x7f0c6c185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6c090100 con 0x7f0c6c185070 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6c091a70 con 0x7f0c6c0906d0 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6c092360 con 0x7f0c6c0911b0 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c730b8640 10 monclient(hunting): authenticate will time out at 941.620123s 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c63fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0c6c0911b0 0x7f0c6c183950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36502/0 (socket says 10.20.193.57:36502) 2026-02-12T17:34:21.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.801+0000 7f0c63fff640 1 -- 10.20.193.57:0/3542316408 learned_addr learned my addr 10.20.193.57:0/3542316408 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c63fff640 1 -- 10.20.193.57:0/3542316408 >> v1:10.20.193.57:6790/0 conn(0x7f0c6c0911b0 legacy=0x7f0c6c183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c7162e640 1 -- 10.20.193.57:0/3542316408 >> v1:10.20.193.57:6789/0 conn(0x7f0c6c185070 legacy=0x7f0c6c1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 998164869 0 0) 0x7f0c6c092360 con 0x7f0c6c0911b0 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient(hunting): my global_id is 44273 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c580035e0 con 0x7f0c6c0911b0 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126769059 0 0) 0x7f0c6c090100 con 0x7f0c6c185070 2026-02-12T17:34:21.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient(hunting): my global_id is 54150 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c6c092360 con 0x7f0c6c185070 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c70e2d640 1 -- 10.20.193.57:0/3542316408 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c0906d0 legacy=0x7f0c6c090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 125901314 0 0) 0x7f0c580035e0 con 0x7f0c6c0911b0 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c0906d0 legacy=0x7f0c6c090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 >> v1:10.20.193.57:6789/0 conn(0x7f0c6c185070 legacy=0x7f0c6c1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 monclient: found mon.noname-b 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.809 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c05cf80 con 0x7f0c6c0911b0 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0c540030d0 con 0x7f0c6c0911b0 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c730b8640 5 monclient: authenticate success, global_id 44273 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c730b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: dump: 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.810 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c730b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c54003360 con 0x7f0c6c0911b0 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c730b8640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c730b8640 4 set_mon_vals no callback set 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 1 -- 10.20.193.57:0/3542316408 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0c54004b10 con 0x7f0c6c0911b0 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.811 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.803+0000 7f0c637fe640 10 monclient: dump: 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 10 monclient: shutdown 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:21.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 1 -- 10.20.193.57:0/3542316408 >> v1:10.20.193.57:6790/0 conn(0x7f0c6c0911b0 legacy=0x7f0c6c183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 1 -- 10.20.193.57:0/3542316408 shutdown_connections 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 1 -- 10.20.193.57:0/3542316408 >> 10.20.193.57:0/3542316408 conn(0x7f0c6c054330 msgr2=0x7f0c6c054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 1 -- 10.20.193.57:0/3542316408 shutdown_connections 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 1 -- 10.20.193.57:0/3542316408 wait complete. 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 10 monclient: monmap: 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.813 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 1 Processor -- start 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 1 -- start start 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.804+0000 7f0c730b8640 10 monclient: init 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 10 monclient(hunting): picked mon.noname-c con 0x7f0c6c0906d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 10 monclient(hunting): picked mon.noname-b con 0x7f0c6c0911b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 10 monclient(hunting): picked mon.noname-a con 0x7f0c6c185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6c133cd0 con 0x7f0c6c185070 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6c132e60 con 0x7f0c6c0911b0 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6c131970 con 0x7f0c6c0906d0 2026-02-12T17:34:21.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c730b8640 10 monclient(hunting): authenticate will time out at 941.624216s 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c70e2d640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0c6c0906d0 0x7f0c6c12ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36506/0 (socket says 10.20.193.57:36506) 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.805+0000 7f0c70e2d640 1 -- 10.20.193.57:0/2732419833 learned_addr learned my addr 10.20.193.57:0/2732419833 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c70e2d640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.57:6790/0 conn(0x7f0c6c0906d0 legacy=0x7f0c6c12ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c7162e640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.57:6789/0 conn(0x7f0c6c185070 legacy=0x7f0c6c174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485042669 0 0) 0x7f0c6c131970 con 0x7f0c6c0906d0 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): my global_id is 44276 2026-02-12T17:34:21.815 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c3c0035e0 con 0x7f0c6c0906d0 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211776691 0 0) 0x7f0c6c133cd0 con 0x7f0c6c185070 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): my global_id is 54153 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c6c131970 con 0x7f0c6c185070 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c63fff640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c0911b0 legacy=0x7f0c6c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 498740376 0 0) 0x7f0c3c0035e0 con 0x7f0c6c0906d0 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c6c133cd0 con 0x7f0c6c0906d0 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 618395623 0 0) 0x7f0c6c131970 con 0x7f0c6c185070 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c3c0035e0 con 0x7f0c6c185070 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0c5c003460 con 0x7f0c6c0906d0 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): dump: 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0c68004490 con 0x7f0c6c185070 2026-02-12T17:34:21.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient(hunting): dump: 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1477854630 0 0) 0x7f0c6c133cd0 con 0x7f0c6c0906d0 2026-02-12T17:34:21.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c0911b0 legacy=0x7f0c6c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.57:6789/0 conn(0x7f0c6c185070 legacy=0x7f0c6c174c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 monclient: found mon.c 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c062bb0 con 0x7f0c6c0906d0 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c730b8640 5 monclient: authenticate success, global_id 44276 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c730b8640 10 monclient: _renew_subs 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c730b8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c133710 con 0x7f0c6c0906d0 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c730b8640 10 monclient: _renew_subs 2026-02-12T17:34:21.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c730b8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.807+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c6c08b860 con 0x7f0c6c0906d0 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c5c003980 con 0x7f0c6c0906d0 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c617fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0c5c003cd0 con 0x7f0c6c0906d0 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c617fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c617fa640 10 monclient: dump: 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.820 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c62ffd640 4 set_mon_vals no callback set 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c730b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0c6c1341a0 con 0x7f0c6c12c330 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0c5c003e70 con 0x7f0c6c0906d0 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(299..299 src has 202..299) ==== 3975+0+0 (unknown 2479889403 0 0) 0x7f0c5c04ecb0 con 0x7f0c6c0906d0 2026-02-12T17:34:21.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.808+0000 7f0c7162e640 10 monclient: get_auth_request con 0x7f0c3c03fa00 auth_method 0 2026-02-12T17:34:21.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c63fff640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c12c330 legacy=0x7f0c6c12c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263756662 0 0) 0x7f0c6c1341a0 con 0x7f0c6c12c330 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 10 monclient(hunting): my global_id is 4708 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c6c133cd0 con 0x7f0c6c12c330 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3649252187 0 0) 0x7f0c6c133cd0 con 0x7f0c6c12c330 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c6c1341a0 con 0x7f0c6c12c330 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0c54004a50 con 0x7f0c6c12c330 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 10 monclient: dump: 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.824 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4148067063 0 0) 0x7f0c6c1341a0 con 0x7f0c6c12c330 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.811+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c6c05c950 con 0x7f0c6c12c330 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.812+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0c54002f40 con 0x7f0c6c12c330 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.812+0000 7f0c617fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.812+0000 7f0c617fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.812+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c12c330 legacy=0x7f0c6c12c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.812+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c12c330 legacy=0x7f0c6c12c700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.815+0000 7f0c730b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.815+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0c6c055340 con 0x7f0c6c12ce10 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c63fff640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c12ce10 legacy=0x7f0c6c1773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152912274 0 0) 0x7f0c6c055340 con 0x7f0c6c12ce10 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 10 monclient(hunting): my global_id is 4711 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c6c1341a0 con 0x7f0c6c12ce10 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1996714676 0 0) 0x7f0c6c1341a0 con 0x7f0c6c12ce10 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c6c055340 con 0x7f0c6c12ce10 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0c540053a0 con 0x7f0c6c12ce10 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.817+0000 7f0c617fa640 10 monclient: dump: 2026-02-12T17:34:21.826 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2466440930 0 0) 0x7f0c6c055340 con 0x7f0c6c12ce10 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0c6c12d1e0 con 0x7f0c6c12ce10 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 1740336275) 0x7f0c54007540 con 0x7f0c6c12ce10 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c617fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c617fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:21.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c12ce10 legacy=0x7f0c6c1773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c617fa640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.82:6789/0 conn(0x7f0c6c12ce10 legacy=0x7f0c6c1773b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 28, 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 383314, 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:34:21.828 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:21.829 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:21.830 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:34:21.831 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:34:21.832 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:21.833 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:21.834 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:21.835 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.836 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:34:21.837 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:34:21.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.82:6800/2441377515 conn(0x7f0c3c03fa00 legacy=0x7f0c3c05feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c730b8640 10 monclient: shutdown 2026-02-12T17:34:21.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c730b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:21.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 >> v1:10.20.193.57:6790/0 conn(0x7f0c6c0906d0 legacy=0x7f0c6c12ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c7162e640 1 -- 10.20.193.57:0/2732419833 reap_dead start 2026-02-12T17:34:21.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 shutdown_connections 2026-02-12T17:34:21.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 >> 10.20.193.57:0/2732419833 conn(0x7f0c6c054330 msgr2=0x7f0c6c08cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:21.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 shutdown_connections 2026-02-12T17:34:21.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.818+0000 7f0c730b8640 1 -- 10.20.193.57:0/2732419833 wait complete. 2026-02-12T17:34:21.839 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:34:21.839 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-12T17:34:21.839 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T17:34:21.839 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-12T17:34:21.839 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-12T17:34:21.839 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T17:34:21.839 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:34:21.848 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T17:34:21.848 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:34:21.848 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:34:21.955 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 10 monclient: get_monmap_and_config 2026-02-12T17:34:21.955 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.955 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 10 monclient: monmap: 2026-02-12T17:34:21.955 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.955 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.955 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:21.957143+0000 2026-02-12T17:34:21.955 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:21.957143+0000 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 1 Processor -- start 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 1 -- start start 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 10 monclient: init 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 10 monclient(hunting): picked mon.noname-b con 0x7fd78c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.956+0000 7fd79114c640 10 monclient(hunting): picked mon.noname-c con 0x7fd78c08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.957+0000 7fd79114c640 10 monclient(hunting): picked mon.noname-a con 0x7fd78c08cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.957+0000 7fd79114c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c08d600 con 0x7fd78c08cb30 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.957+0000 7fd79114c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c08b1f0 con 0x7fd78c08c730 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.957+0000 7fd79114c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c08d1f0 con 0x7fd78c08ae20 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.957+0000 7fd79114c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.957+0000 7fd79114c640 10 monclient(hunting): authenticate will time out at 941.776025s 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.957+0000 7fd78ad76640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fd78c08ae20 legacy=0x7fd78c08c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.957+0000 7fd78b577640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd78c08cb30 0x7fd78c1a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40616/0 (socket says 10.20.193.57:40616) 2026-02-12T17:34:21.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.957+0000 7fd78b577640 1 -- 10.20.193.57:0/2337048470 learned_addr learned my addr 10.20.193.57:0/2337048470 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd78b577640 1 -- 10.20.193.57:0/2337048470 >> v1:10.20.193.57:6789/0 conn(0x7fd78c08cb30 legacy=0x7fd78c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd78a575640 1 -- 10.20.193.57:0/2337048470 >> v1:10.20.193.82:6789/0 conn(0x7fd78c08c730 legacy=0x7fd78c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378029355 0 0) 0x7fd78c08d600 con 0x7fd78c08cb30 2026-02-12T17:34:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient(hunting): my global_id is 54156 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7780035e0 con 0x7fd78c08cb30 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2329319206 0 0) 0x7fd78c08b1f0 con 0x7fd78c08c730 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient(hunting): my global_id is 4714 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd78c08d600 con 0x7fd78c08c730 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1512320387 0 0) 0x7fd7780035e0 con 0x7fd78c08cb30 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 >> v1:10.20.193.57:6790/0 conn(0x7fd78c08ae20 legacy=0x7fd78c08c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 >> v1:10.20.193.82:6789/0 conn(0x7fd78c08c730 legacy=0x7fd78c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 monclient: found mon.noname-a 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c057320 con 0x7fd78c08cb30 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd77c0030d0 con 0x7fd78c08cb30 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: dump: 2026-02-12T17:34:21.967 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd79114c640 5 monclient: authenticate success, global_id 54156 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd79114c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:21.968 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd77c003360 con 0x7fd78c08cb30 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 1 -- 10.20.193.57:0/2337048470 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd77c004960 con 0x7fd78c08cb30 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd789d74640 10 monclient: dump: 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.969 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd79114c640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.959+0000 7fd79114c640 4 set_mon_vals no callback set 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 10 monclient: shutdown 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 1 -- 10.20.193.57:0/2337048470 >> v1:10.20.193.57:6789/0 conn(0x7fd78c08cb30 legacy=0x7fd78c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 1 -- 10.20.193.57:0/2337048470 shutdown_connections 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 1 -- 10.20.193.57:0/2337048470 >> 10.20.193.57:0/2337048470 conn(0x7fd78c091620 msgr2=0x7fd78c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 1 -- 10.20.193.57:0/2337048470 shutdown_connections 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 1 -- 10.20.193.57:0/2337048470 wait complete. 2026-02-12T17:34:21.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 10 monclient: build_initial_monmap 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 10 monclient: monmap: 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 1 Processor -- start 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 1 -- start start 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.960+0000 7fd79114c640 10 monclient: init 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 10 monclient(hunting): picked mon.noname-c con 0x7fd78c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 10 monclient(hunting): picked mon.noname-b con 0x7fd78c08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 10 monclient(hunting): picked mon.noname-a con 0x7fd78c08cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c08d9c0 con 0x7fd78c08cb30 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c05b020 con 0x7fd78c08c730 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd78ad76640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fd78c08ae20 legacy=0x7fd78c088d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78c088810 con 0x7fd78c08ae20 2026-02-12T17:34:21.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd79114c640 10 monclient(hunting): authenticate will time out at 941.780126s 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd78b577640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd78c08cb30 0x7fd78c1a2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40618/0 (socket says 10.20.193.57:40618) 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.961+0000 7fd78b577640 1 -- 10.20.193.57:0/4283590717 learned_addr learned my addr 10.20.193.57:0/4283590717 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd78b577640 1 -- 10.20.193.57:0/4283590717 >> v1:10.20.193.57:6789/0 conn(0x7fd78c08cb30 legacy=0x7fd78c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd78a575640 1 -- 10.20.193.57:0/4283590717 >> v1:10.20.193.82:6789/0 conn(0x7fd78c08c730 legacy=0x7fd78c089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182850466 0 0) 0x7fd78c08d9c0 con 0x7fd78c08cb30 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): my global_id is 54159 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7580035e0 con 0x7fd78c08cb30 2026-02-12T17:34:21.973 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190557831 0 0) 0x7fd78c05b020 con 0x7fd78c08c730 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): my global_id is 4717 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd78c08d9c0 con 0x7fd78c08c730 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 155982216 0 0) 0x7fd7580035e0 con 0x7fd78c08cb30 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd78c05b020 con 0x7fd78c08cb30 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd77c0034d0 con 0x7fd78c08cb30 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): dump: 2026-02-12T17:34:21.974 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 504468660 0 0) 0x7fd78c05b020 con 0x7fd78c08cb30 2026-02-12T17:34:21.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 >> v1:10.20.193.57:6790/0 conn(0x7fd78c08ae20 legacy=0x7fd78c088d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 >> v1:10.20.193.82:6789/0 conn(0x7fd78c08c730 legacy=0x7fd78c089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 monclient: found mon.a 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd78c11e430 con 0x7fd78c08cb30 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd79114c640 5 monclient: authenticate success, global_id 54159 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd79114c640 10 monclient: _renew_subs 2026-02-12T17:34:21.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd79114c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd78c11e9f0 con 0x7fd78c08cb30 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd79114c640 10 monclient: _renew_subs 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd79114c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd78c123580 con 0x7fd78c08cb30 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd77c004f40 con 0x7fd78c08cb30 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd77c0048a0 con 0x7fd78c08cb30 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd789573640 4 set_mon_vals no callback set 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.963+0000 7fd76b7fe640 10 monclient: dump: 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:21.977 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.964+0000 7fd79114c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.964+0000 7fd79114c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.964+0000 7fd79114c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:21.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.964+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78c0008d0 con 0x7fd78c08cb30 2026-02-12T17:34:21.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.964+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fd77c011d70 con 0x7fd78c08cb30 2026-02-12T17:34:21.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.964+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(299..299 src has 202..299) ==== 3975+0+0 (unknown 2479889403 0 0) 0x7fd77c04ec20 con 0x7fd78c08cb30 2026-02-12T17:34:21.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.964+0000 7fd78ad76640 10 monclient: get_auth_request con 0x7fd75803f6d0 auth_method 0 2026-02-12T17:34:21.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.966+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fd77c013630 con 0x7fd78c08cb30 2026-02-12T17:34:21.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.966+0000 7fd76b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:21.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:21.966+0000 7fd76b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:22.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.112+0000 7fd79114c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:34:22.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.112+0000 7fd79114c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:22.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.112+0000 7fd79114c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:22.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.112+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd78c11d8a0 con 0x7fd78c08cb30 2026-02-12T17:34:22.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.112+0000 7fd76b7fe640 1 -- 10.20.193.57:0/4283590717 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 3684945555) 0x7fd77c016b70 con 0x7fd78c08cb30 2026-02-12T17:34:22.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.112+0000 7fd76b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:22.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.112+0000 7fd76b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:22.111 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:34:22.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.113+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 >> v1:10.20.193.82:6800/2441377515 conn(0x7fd75803f6d0 legacy=0x7fd75805fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:22.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.113+0000 7fd79114c640 10 monclient: shutdown 2026-02-12T17:34:22.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.113+0000 7fd79114c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:22.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.113+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 >> v1:10.20.193.57:6789/0 conn(0x7fd78c08cb30 legacy=0x7fd78c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:22.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.113+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 shutdown_connections 2026-02-12T17:34:22.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.113+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 >> 10.20.193.57:0/4283590717 conn(0x7fd78c091620 msgr2=0x7fd78c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:22.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.113+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 shutdown_connections 2026-02-12T17:34:22.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:22.113+0000 7fd79114c640 1 -- 10.20.193.57:0/4283590717 wait complete. 2026-02-12T17:34:25.119 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:34:25.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.186+0000 7f95bddb9640 10 monclient: get_monmap_and_config 2026-02-12T17:34:25.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.186+0000 7f95bddb9640 10 monclient: build_initial_monmap 2026-02-12T17:34:25.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.186+0000 7f95bddb9640 10 monclient: monmap: 2026-02-12T17:34:25.185 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:25.185 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:25.185 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:25.187229+0000 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:25.187229+0000 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.186+0000 7f95bddb9640 1 Processor -- start 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.186+0000 7f95bddb9640 1 -- start start 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.186+0000 7f95bddb9640 10 monclient: init 2026-02-12T17:34:25.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 10 monclient(hunting): picked mon.noname-a con 0x7f95b808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 10 monclient(hunting): picked mon.noname-b con 0x7f95b808c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 10 monclient(hunting): picked mon.noname-c con 0x7f95b808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b808d600 con 0x7f95b808ae20 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b808b1f0 con 0x7f95b808cb30 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b808d1f0 con 0x7f95b808c730 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95bddb9640 10 monclient(hunting): authenticate will time out at 945.006098s 2026-02-12T17:34:25.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95b6ffd640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f95b808c730 legacy=0x7f95b8181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:25.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95b77fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f95b808ae20 0x7f95b808c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:41818/0 (socket says 10.20.193.57:41818) 2026-02-12T17:34:25.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.187+0000 7f95b77fe640 1 -- 10.20.193.57:0/1880112881 learned_addr learned my addr 10.20.193.57:0/1880112881 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:25.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.189+0000 7f95b77fe640 1 -- 10.20.193.57:0/1880112881 >> v1:10.20.193.57:6789/0 conn(0x7f95b808ae20 legacy=0x7f95b808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:25.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.189+0000 7f95b7fff640 1 -- 10.20.193.57:0/1880112881 >> v1:10.20.193.82:6789/0 conn(0x7f95b808cb30 legacy=0x7f95b81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.189+0000 7f95b67fc640 1 -- 10.20.193.57:0/1880112881 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660799746 0 0) 0x7f95b808b1f0 con 0x7f95b808cb30 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.189+0000 7f95b67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.189+0000 7f95b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.189+0000 7f95b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.189+0000 7f95b67fc640 10 monclient(hunting): my global_id is 4720 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.189+0000 7f95b67fc640 1 -- 10.20.193.57:0/1880112881 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c0035e0 con 0x7f95b808cb30 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 1 -- 10.20.193.57:0/1880112881 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 520528698 0 0) 0x7f959c0035e0 con 0x7f95b808cb30 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 1 -- 10.20.193.57:0/1880112881 >> v1:10.20.193.57:6790/0 conn(0x7f95b808c730 legacy=0x7f95b8181be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 1 -- 10.20.193.57:0/1880112881 >> v1:10.20.193.57:6789/0 conn(0x7f95b808ae20 legacy=0x7f95b808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: _finish_hunting 0 2026-02-12T17:34:25.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 1 monclient: found mon.noname-c 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 1 -- 10.20.193.57:0/1880112881 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b8057320 con 0x7f95b808cb30 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: _finish_auth 0 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: _check_auth_tickets 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 1 -- 10.20.193.57:0/1880112881 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f95ac004200 con 0x7f95b808cb30 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: dump: 2026-02-12T17:34:25.196 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 5 monclient: authenticate success, global_id 4720 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:25.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 1 -- 10.20.193.57:0/1880112881 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95ac004490 con 0x7f95b808cb30 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 4 set_mon_vals no callback set 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 1 -- 10.20.193.57:0/1880112881 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f95ac004960 con 0x7f95b808cb30 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95b67fc640 10 monclient: dump: 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:25.198 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 10 monclient: shutdown 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 1 -- 10.20.193.57:0/1880112881 >> v1:10.20.193.82:6789/0 conn(0x7f95b808cb30 legacy=0x7f95b81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 1 -- 10.20.193.57:0/1880112881 shutdown_connections 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 1 -- 10.20.193.57:0/1880112881 >> 10.20.193.57:0/1880112881 conn(0x7f95b8091620 msgr2=0x7f95b8091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 1 -- 10.20.193.57:0/1880112881 shutdown_connections 2026-02-12T17:34:25.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.190+0000 7f95bddb9640 1 -- 10.20.193.57:0/1880112881 wait complete. 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient: build_initial_monmap 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient: monmap: 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:25.200 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 1 Processor -- start 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 1 -- start start 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient: init 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient(hunting): picked mon.noname-b con 0x7f95b808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient(hunting): picked mon.noname-a con 0x7f95b808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient(hunting): picked mon.noname-c con 0x7f95b808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b808d9c0 con 0x7f95b808c730 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b8088880 con 0x7f95b808ae20 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95b80879b0 con 0x7f95b808cb30 2026-02-12T17:34:25.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95bddb9640 10 monclient(hunting): authenticate will time out at 945.010720s 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95b7fff640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f95b808cb30 legacy=0x7f95b81950b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95b6ffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f95b808c730 0x7f95b8086ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:41824/0 (socket says 10.20.193.57:41824) 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.191+0000 7f95b6ffd640 1 -- 10.20.193.57:0/4078884535 learned_addr learned my addr 10.20.193.57:0/4078884535 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.193+0000 7f95b6ffd640 1 -- 10.20.193.57:0/4078884535 >> v1:10.20.193.57:6789/0 conn(0x7f95b808c730 legacy=0x7f95b8086ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f95b77fe640 1 -- 10.20.193.57:0/4078884535 >> v1:10.20.193.82:6789/0 conn(0x7f95b808ae20 legacy=0x7f95b8152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422106974 0 0) 0x7f95b808d600 con 0x7f95b808ae20 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:25.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient(hunting): my global_id is 4723 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95880035e0 con 0x7f95b808ae20 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1955440915 0 0) 0x7f95880035e0 con 0x7f95b808ae20 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95b808d600 con 0x7f95b808ae20 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f95a4003250 con 0x7f95b808ae20 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient(hunting): dump: 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:25.203 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1034249399 0 0) 0x7f95b808d600 con 0x7f95b808ae20 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 >> v1:10.20.193.57:6790/0 conn(0x7f95b808cb30 legacy=0x7f95b81950b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 >> v1:10.20.193.57:6789/0 conn(0x7f95b808c730 legacy=0x7f95b8086ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient: _finish_hunting 0 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 monclient: found mon.b 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:25.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b8083360 con 0x7f95b808ae20 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient: _finish_auth 0 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient: _check_auth_tickets 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f95bddb9640 5 monclient: authenticate success, global_id 4723 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f95bddb9640 10 monclient: _renew_subs 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f95bddb9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f95b80850b0 con 0x7f95b808ae20 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f95bddb9640 10 monclient: _renew_subs 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f95bddb9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f95b80872b0 con 0x7f95b808ae20 2026-02-12T17:34:25.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95a4004b50 con 0x7f95b808ae20 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f95a4004e70 con 0x7f95b808ae20 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f9593fff640 10 monclient: dump: 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:25.206 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.194+0000 7f95b5ffb640 4 set_mon_vals no callback set 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.195+0000 7f95bddb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.195+0000 7f95bddb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.195+0000 7f95bddb9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.195+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b80008d0 con 0x7f95b808ae20 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.195+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f95a4005100 con 0x7f95b808ae20 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.195+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(299..299 src has 202..299) ==== 3975+0+0 (unknown 2479889403 0 0) 0x7f95a404e960 con 0x7f95b808ae20 2026-02-12T17:34:25.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.195+0000 7f95b6ffd640 10 monclient: get_auth_request con 0x7f958803f6b0 auth_method 0 2026-02-12T17:34:25.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.198+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f95a40169e0 con 0x7f95b808ae20 2026-02-12T17:34:25.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.198+0000 7f9593fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:25.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.198+0000 7f9593fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.341+0000 7f95bddb9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:34:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.341+0000 7f95bddb9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.341+0000 7f95bddb9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:34:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.341+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f95b8088880 con 0x7f95b808ae20 2026-02-12T17:34:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.341+0000 7f9593fff640 1 -- 10.20.193.57:0/4078884535 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 3962609719) 0x7f95b8088880 con 0x7f95b808ae20 2026-02-12T17:34:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.341+0000 7f9593fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:25.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.341+0000 7f9593fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:25.340 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:34:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.342+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 >> v1:10.20.193.82:6800/2441377515 conn(0x7f958803f6b0 legacy=0x7f958805fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.342+0000 7f95bddb9640 10 monclient: shutdown 2026-02-12T17:34:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.342+0000 7f95bddb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.342+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 >> v1:10.20.193.82:6789/0 conn(0x7f95b808ae20 legacy=0x7f95b8152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.342+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 shutdown_connections 2026-02-12T17:34:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.342+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 >> 10.20.193.57:0/4078884535 conn(0x7f95b8091620 msgr2=0x7f95b8059e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.342+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 shutdown_connections 2026-02-12T17:34:25.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:25.342+0000 7f95bddb9640 1 -- 10.20.193.57:0/4078884535 wait complete. 2026-02-12T17:34:28.348 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:34:28.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.417+0000 7f7b9dff6640 10 monclient: get_monmap_and_config 2026-02-12T17:34:28.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.417+0000 7f7b9dff6640 10 monclient: build_initial_monmap 2026-02-12T17:34:28.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.417+0000 7f7b9dff6640 10 monclient: monmap: 2026-02-12T17:34:28.415 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:28.415 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:28.415 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:28.418305+0000 2026-02-12T17:34:28.416 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:28.418305+0000 2026-02-12T17:34:28.416 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:28.416 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:28.416 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:28.416 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:28.416 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:28.416 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:28.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.417+0000 7f7b9dff6640 1 Processor -- start 2026-02-12T17:34:28.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.417+0000 7f7b9dff6640 1 -- start start 2026-02-12T17:34:28.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.417+0000 7f7b9dff6640 10 monclient: init 2026-02-12T17:34:28.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:28.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:28.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 10 monclient(hunting): picked mon.noname-b con 0x7f7b9808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 10 monclient(hunting): picked mon.noname-c con 0x7f7b9808cc80 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 10 monclient(hunting): picked mon.noname-a con 0x7f7b981852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9808d600 con 0x7f7b981852d0 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b98089770 con 0x7f7b9808cc80 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9808b1f0 con 0x7f7b9808ae20 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b977fe640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b9808c570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b9dff6640 10 monclient(hunting): authenticate will time out at 948.237205s 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b97fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f7b981852d0 0x7f7b981a56b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:41832/0 (socket says 10.20.193.57:41832) 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.418+0000 7f7b97fff640 1 -- 10.20.193.57:0/66033600 learned_addr learned my addr 10.20.193.57:0/66033600 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:28.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.420+0000 7f7b97fff640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6789/0 conn(0x7f7b981852d0 legacy=0x7f7b981a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:28.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.420+0000 7f7b96ffd640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.82:6789/0 conn(0x7f7b9808cc80 legacy=0x7f7b98183bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:28.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:28.619+0000 7f7b977fe640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b9808c570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:29.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:29.020+0000 7f7b977fe640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b9808c570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:29.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:29.821+0000 7f7b977fe640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b9808c570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:31.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 10 monclient(hunting): tick 2026-02-12T17:34:31.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:34:31.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 1 monclient(hunting): continuing hunt 2026-02-12T17:34:31.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:34:31.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b9808c570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:34:31.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.82:6789/0 conn(0x7f7b9808cc80 legacy=0x7f7b98183bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:31.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6789/0 conn(0x7f7b981852d0 legacy=0x7f7b981a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:31.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:34:31.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 10 monclient(hunting): picked mon.noname-c con 0x7f7b9808cc80 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:31.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 10 monclient(hunting): picked mon.noname-b con 0x7f7b9808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:31.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 10 monclient(hunting): picked mon.noname-a con 0x7f7b981852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:31.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9808c020 con 0x7f7b981852d0 2026-02-12T17:34:31.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9808b1f0 con 0x7f7b9808cc80 2026-02-12T17:34:31.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b96ffd640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:31.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7406a080 con 0x7f7b9808ae20 2026-02-12T17:34:31.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.418+0000 7f7b957fa640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:31.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.420+0000 7f7b97fff640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6789/0 conn(0x7f7b981852d0 legacy=0x7f7b74066860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:31.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.420+0000 7f7b977fe640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.82:6789/0 conn(0x7f7b9808cc80 legacy=0x7f7b740238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:31.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:31.619+0000 7f7b96ffd640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:32.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:32.020+0000 7f7b96ffd640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:32.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:32.821+0000 7f7b96ffd640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:34.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 10 monclient(hunting): tick 2026-02-12T17:34:34.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:34:34.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 1 monclient(hunting): continuing hunt 2026-02-12T17:34:34.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:34:34.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.82:6789/0 conn(0x7f7b9808cc80 legacy=0x7f7b740238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6789/0 conn(0x7f7b981852d0 legacy=0x7f7b74066860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 10 monclient(hunting): picked mon.noname-a con 0x7f7b7406a340 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 10 monclient(hunting): picked mon.noname-b con 0x7f7b9808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 10 monclient(hunting): picked mon.noname-c con 0x7f7b9808cc80 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7406b2e0 con 0x7f7b7406a340 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7406a080 con 0x7f7b9808cc80 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 1 -- 10.20.193.57:0/66033600 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b740048b0 con 0x7f7b9808ae20 2026-02-12T17:34:34.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b957fa640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:34.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.418+0000 7f7b96ffd640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:34.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.420+0000 7f7b977fe640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6789/0 conn(0x7f7b7406a340 legacy=0x7f7b7406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:34.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.420+0000 7f7b97fff640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.82:6789/0 conn(0x7f7b9808cc80 legacy=0x7f7b740667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:34.617 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:34.620+0000 7f7b96ffd640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:35.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:35.021+0000 7f7b96ffd640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:35.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:35.822+0000 7f7b96ffd640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:36.073 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.072+0000 7f7b967fc640 1 -- 10.20.193.57:0/66033600 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210011411 0 0) 0x7f7b7406b2e0 con 0x7f7b7406a340 2026-02-12T17:34:36.073 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.072+0000 7f7b967fc640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.073 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.072+0000 7f7b967fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient(hunting): my global_id is 54162 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 1 -- 10.20.193.57:0/66033600 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b7c0035e0 con 0x7f7b7406a340 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 1 -- 10.20.193.57:0/66033600 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 986058459 0 0) 0x7f7b7c0035e0 con 0x7f7b7406a340 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6790/0 conn(0x7f7b9808ae20 legacy=0x7f7b74045060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.82:6789/0 conn(0x7f7b9808cc80 legacy=0x7f7b740667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: _finish_hunting 0 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 1 monclient: found mon.noname-a 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.074 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 1 -- 10.20.193.57:0/66033600 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b74005a50 con 0x7f7b7406a340 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: _finish_auth 0 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: _check_auth_tickets 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 1 -- 10.20.193.57:0/66033600 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7b84004510 con 0x7f7b7406a340 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: dump: 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.075 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 5 monclient: authenticate success, global_id 54162 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 1 -- 10.20.193.57:0/66033600 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b84004810 con 0x7f7b7406a340 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 1 -- 10.20.193.57:0/66033600 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7b84004b60 con 0x7f7b7406a340 2026-02-12T17:34:36.076 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b967fc640 10 monclient: dump: 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.077 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 4 set_mon_vals no callback set 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 10 monclient: shutdown 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 1 -- 10.20.193.57:0/66033600 >> v1:10.20.193.57:6789/0 conn(0x7f7b7406a340 legacy=0x7f7b7406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 1 -- 10.20.193.57:0/66033600 shutdown_connections 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 1 -- 10.20.193.57:0/66033600 >> 10.20.193.57:0/66033600 conn(0x7f7b98091620 msgr2=0x7f7b98091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 1 -- 10.20.193.57:0/66033600 shutdown_connections 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.073+0000 7f7b9dff6640 1 -- 10.20.193.57:0/66033600 wait complete. 2026-02-12T17:34:36.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.074+0000 7f7b9dff6640 10 monclient: build_initial_monmap 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.074+0000 7f7b9dff6640 10 monclient: monmap: 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:36.079 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.074+0000 7f7b9dff6640 1 Processor -- start 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.074+0000 7f7b9dff6640 1 -- start start 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.074+0000 7f7b9dff6640 10 monclient: init 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.074+0000 7f7b9dff6640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b9dff6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b9dff6640 10 monclient(hunting): picked mon.noname-c con 0x7f7b7406a340 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b9dff6640 10 monclient(hunting): picked mon.noname-b con 0x7f7b9808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b9dff6640 10 monclient(hunting): picked mon.noname-a con 0x7f7b9808cc80 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b9dff6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b980838a0 con 0x7f7b9808cc80 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b9dff6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b98088190 con 0x7f7b9808ae20 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b977fe640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f7b7406a340 legacy=0x7f7b98152e10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:36.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b9dff6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b98088810 con 0x7f7b7406a340 2026-02-12T17:34:36.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b9dff6640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:36.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b9dff6640 10 monclient(hunting): authenticate will time out at 955.894093s 2026-02-12T17:34:36.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b97fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f7b9808cc80 0x7f7b98175190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:59308/0 (socket says 10.20.193.57:59308) 2026-02-12T17:34:36.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.075+0000 7f7b97fff640 1 -- 10.20.193.57:0/1551355363 learned_addr learned my addr 10.20.193.57:0/1551355363 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:36.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b97fff640 1 -- 10.20.193.57:0/1551355363 >> v1:10.20.193.57:6789/0 conn(0x7f7b9808cc80 legacy=0x7f7b98175190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196947934 0 0) 0x7f7b980838a0 con 0x7f7b9808cc80 2026-02-12T17:34:36.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient(hunting): my global_id is 54165 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b680035e0 con 0x7f7b9808cc80 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3707393104 0 0) 0x7f7b680035e0 con 0x7f7b9808cc80 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b980838a0 con 0x7f7b9808cc80 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7b8c004260 con 0x7f7b9808cc80 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient(hunting): dump: 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.085 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b96ffd640 1 -- 10.20.193.57:0/1551355363 >> v1:10.20.193.82:6789/0 conn(0x7f7b9808ae20 legacy=0x7f7b98086780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2193876429 0 0) 0x7f7b980838a0 con 0x7f7b9808cc80 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 >> v1:10.20.193.57:6790/0 conn(0x7f7b7406a340 legacy=0x7f7b98152e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 >> v1:10.20.193.82:6789/0 conn(0x7f7b9808ae20 legacy=0x7f7b98086780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient: _finish_hunting 0 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 monclient: found mon.a 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b98084f90 con 0x7f7b9808cc80 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient: _finish_auth 0 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 10 monclient: _check_auth_tickets 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b73fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b9dff6640 5 monclient: authenticate success, global_id 54165 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b9dff6640 10 monclient: _renew_subs 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b9dff6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7b98085270 con 0x7f7b9808cc80 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b9dff6640 10 monclient: _renew_subs 2026-02-12T17:34:36.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b9dff6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.077+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7b98086e90 con 0x7f7b9808cc80 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b8c0045b0 con 0x7f7b9808cc80 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b73fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7b8c005de0 con 0x7f7b9808cc80 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b73fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b73fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b73fff640 10 monclient: dump: 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.088 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f7b8c005ff0 con 0x7f7b9808cc80 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b95ffb640 4 set_mon_vals no callback set 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b9dff6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(299..299 src has 202..299) ==== 3975+0+0 (unknown 2479889403 0 0) 0x7f7b8c04fa30 con 0x7f7b9808cc80 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b9dff6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b9dff6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b9807a9c0 con 0x7f7b9808cc80 2026-02-12T17:34:36.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.078+0000 7f7b977fe640 10 monclient: get_auth_request con 0x7f7b6803f680 auth_method 0 2026-02-12T17:34:36.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.081+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f7b8c018330 con 0x7f7b9808cc80 2026-02-12T17:34:36.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.081+0000 7f7b73fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:36.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.081+0000 7f7b73fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:36.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.228+0000 7f7b9dff6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:34:36.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.228+0000 7f7b9dff6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:36.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.228+0000 7f7b9dff6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.228+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7b98055340 con 0x7f7b9808cc80 2026-02-12T17:34:36.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.229+0000 7f7b73fff640 1 -- 10.20.193.57:0/1551355363 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 3517133026) 0x7f7b8c017ae0 con 0x7f7b9808cc80 2026-02-12T17:34:36.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.229+0000 7f7b73fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:34:36.227 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.229+0000 7f7b73fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:36.228 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":32,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:34:36.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.230+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 >> v1:10.20.193.82:6800/2441377515 conn(0x7f7b6803f680 legacy=0x7f7b6805fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.230+0000 7f7b9dff6640 10 monclient: shutdown 2026-02-12T17:34:36.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.230+0000 7f7b9dff6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:36.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.230+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 >> v1:10.20.193.57:6789/0 conn(0x7f7b9808cc80 legacy=0x7f7b98175190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.230+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 shutdown_connections 2026-02-12T17:34:36.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.230+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 >> 10.20.193.57:0/1551355363 conn(0x7f7b98091620 msgr2=0x7f7b9805d110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:36.229 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.230+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 shutdown_connections 2026-02-12T17:34:36.230 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.230+0000 7f7b9dff6640 1 -- 10.20.193.57:0/1551355363 wait complete. 2026-02-12T17:34:36.236 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:34:36.236 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-12T17:34:36.236 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:34:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.304+0000 7fbb08f0c640 10 monclient: get_monmap_and_config 2026-02-12T17:34:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.304+0000 7fbb08f0c640 10 monclient: build_initial_monmap 2026-02-12T17:34:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.304+0000 7fbb08f0c640 10 monclient: monmap: 2026-02-12T17:34:36.302 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:36.302 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.302 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:36.305371+0000 2026-02-12T17:34:36.302 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:36.305371+0000 2026-02-12T17:34:36.303 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:36.303 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.303 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:36.303 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:36.303 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:36.303 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.308 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.304+0000 7fbb08f0c640 1 Processor -- start 2026-02-12T17:34:36.308 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.304+0000 7fbb08f0c640 1 -- start start 2026-02-12T17:34:36.308 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.304+0000 7fbb08f0c640 10 monclient: init 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fbb0408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fbb0408c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fbb04182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0408a820 con 0x7fbb04182cc0 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb04089450 con 0x7fbb0408c620 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb04089730 con 0x7fbb0408c250 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb08f0c640 10 monclient(hunting): authenticate will time out at 956.124232s 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb02575640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fbb0408c250 legacy=0x7fbb0408a110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:36.309 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb02d76640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbb04182cc0 0x7fbb041a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:59312/0 (socket says 10.20.193.57:59312) 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.305+0000 7fbb02d76640 1 -- 10.20.193.57:0/930601231 learned_addr learned my addr 10.20.193.57:0/930601231 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb02d76640 1 -- 10.20.193.57:0/930601231 >> v1:10.20.193.57:6789/0 conn(0x7fbb04182cc0 legacy=0x7fbb041a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01d74640 1 -- 10.20.193.57:0/930601231 >> v1:10.20.193.82:6789/0 conn(0x7fbb0408c620 legacy=0x7fbb0408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347049107 0 0) 0x7fbaf4003d00 con 0x7fbb04182cc0 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient(hunting): my global_id is 54168 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf00035e0 con 0x7fbb04182cc0 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641423474 0 0) 0x7fbb04089450 con 0x7fbb0408c620 2026-02-12T17:34:36.310 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient(hunting): my global_id is 4729 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf4003d00 con 0x7fbb0408c620 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 541264874 0 0) 0x7fbaf00035e0 con 0x7fbb04182cc0 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 >> v1:10.20.193.57:6790/0 conn(0x7fbb0408c250 legacy=0x7fbb0408a110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 >> v1:10.20.193.82:6789/0 conn(0x7fbb0408c620 legacy=0x7fbb0408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: _finish_hunting 0 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 monclient: found mon.noname-a 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:36.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb04089a10 con 0x7fbb04182cc0 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: _finish_auth 0 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: _check_auth_tickets 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaf40043c0 con 0x7fbb04182cc0 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: dump: 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.312 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb08f0c640 5 monclient: authenticate success, global_id 54168 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb08f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbaf4005a40 con 0x7fbb04182cc0 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:36.313 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 1 -- 10.20.193.57:0/930601231 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaf4005dd0 con 0x7fbb04182cc0 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.307+0000 7fbb01573640 10 monclient: dump: 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.314 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 4 set_mon_vals no callback set 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 10 monclient: shutdown 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 1 -- 10.20.193.57:0/930601231 >> v1:10.20.193.57:6789/0 conn(0x7fbb04182cc0 legacy=0x7fbb041a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 1 -- 10.20.193.57:0/930601231 shutdown_connections 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 1 -- 10.20.193.57:0/930601231 >> 10.20.193.57:0/930601231 conn(0x7fbb040916b0 msgr2=0x7fbb04091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 1 -- 10.20.193.57:0/930601231 shutdown_connections 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 1 -- 10.20.193.57:0/930601231 wait complete. 2026-02-12T17:34:36.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 10 monclient: build_initial_monmap 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 10 monclient: monmap: 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.316 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.308+0000 7fbb08f0c640 1 Processor -- start 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 1 -- start start 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 10 monclient: init 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 10 monclient(hunting): picked mon.noname-c con 0x7fbb0408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 10 monclient(hunting): picked mon.noname-a con 0x7fbb0408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 10 monclient(hunting): picked mon.noname-b con 0x7fbb04182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb04138160 con 0x7fbb0408c620 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0418fdf0 con 0x7fbb04182cc0 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb02575640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fbb0408c250 legacy=0x7fbb0413dfd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:36.317 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0413aa80 con 0x7fbb0408c250 2026-02-12T17:34:36.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:36.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb08f0c640 10 monclient(hunting): authenticate will time out at 956.128239s 2026-02-12T17:34:36.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb01d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbb0408c620 0x7fbb04181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:59324/0 (socket says 10.20.193.57:59324) 2026-02-12T17:34:36.318 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.309+0000 7fbb01d74640 1 -- 10.20.193.57:0/1432444866 learned_addr learned my addr 10.20.193.57:0/1432444866 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:36.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbb01d74640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.57:6789/0 conn(0x7fbb0408c620 legacy=0x7fbb04181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444758019 0 0) 0x7fbaf4003d00 con 0x7fbb0408c620 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): my global_id is 54171 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad00035e0 con 0x7fbb0408c620 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbb02d76640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.82:6789/0 conn(0x7fbb04182cc0 legacy=0x7fbb041823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 394040985 0 0) 0x7fbad00035e0 con 0x7fbb0408c620 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbaf4003d00 con 0x7fbb0408c620 2026-02-12T17:34:36.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaec0033b0 con 0x7fbb0408c620 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): dump: 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.325 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2501672873 0 0) 0x7fbb0418fdf0 con 0x7fbb04182cc0 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 10 monclient(hunting): my global_id is 4732 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.311+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad00035e0 con 0x7fbb04182cc0 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1053905525 0 0) 0x7fbaf4003d00 con 0x7fbb0408c620 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.57:6790/0 conn(0x7fbb0408c250 legacy=0x7fbb0413dfd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:34:36.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.82:6789/0 conn(0x7fbb04182cc0 legacy=0x7fbb041823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 10 monclient: _finish_hunting 0 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 1 monclient: found mon.a 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb04182ad0 con 0x7fbb0408c620 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 10 monclient: _finish_auth 0 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 10 monclient: _check_auth_tickets 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb08f0c640 5 monclient: authenticate success, global_id 54171 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb08f0c640 10 monclient: _renew_subs 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb08f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0408ee90 con 0x7fbb0408c620 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb08f0c640 10 monclient: _renew_subs 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb08f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb04139550 con 0x7fbb0408c620 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbaec003980 con 0x7fbb0408c620 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaec003ca0 con 0x7fbb0408c620 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb00d72640 4 set_mon_vals no callback set 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 10 monclient: dump: 2026-02-12T17:34:36.328 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb08f0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbb0418f740 con 0x7fbb0418f370 2026-02-12T17:34:36.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.312+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fbaec003f30 con 0x7fbb0408c620 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.313+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(299..299 src has 202..299) ==== 3975+0+0 (unknown 2479889403 0 0) 0x7fbaec04eb80 con 0x7fbb0408c620 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.313+0000 7fbb02d76640 10 monclient: get_auth_request con 0x7fbad003f7c0 auth_method 0 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.314+0000 7fbb02575640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.57:6789/0 conn(0x7fbb0418f370 legacy=0x7fbb040868a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054900225 0 0) 0x7fbb0418f740 con 0x7fbb0418f370 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 10 monclient(hunting): my global_id is 54174 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf4003d00 con 0x7fbb0418f370 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1980493482 0 0) 0x7fbaf4003d00 con 0x7fbb0418f370 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb0418f740 con 0x7fbb0418f370 2026-02-12T17:34:36.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaf80042a0 con 0x7fbb0418f370 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 10 monclient: dump: 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.331 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3921739791 0 0) 0x7fbb0418f740 con 0x7fbb0418f370 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb04090810 con 0x7fbb0418f370 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fbaf8006690 con 0x7fbb0418f370 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.57:6789/0 conn(0x7fbb0418f370 legacy=0x7fbb040868a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.315+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.57:6789/0 conn(0x7fbb0418f370 legacy=0x7fbb040868a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.318+0000 7fbb08f0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.318+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbb0408f5b0 con 0x7fbb0404d1c0 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.320+0000 7fbb02575640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.57:6789/0 conn(0x7fbb0404d1c0 legacy=0x7fbb04197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4126442139 0 0) 0x7fbb0408f5b0 con 0x7fbb0404d1c0 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 10 monclient(hunting): my global_id is 54177 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb0418f740 con 0x7fbb0404d1c0 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1687658728 0 0) 0x7fbb0418f740 con 0x7fbb0404d1c0 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb0408f5b0 con 0x7fbb0404d1c0 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaf8004bc0 con 0x7fbb0404d1c0 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 10 monclient: dump: 2026-02-12T17:34:36.333 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3705605599 0 0) 0x7fbb0408f5b0 con 0x7fbb0404d1c0 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbb04139280 con 0x7fbb0404d1c0 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4493 (unknown 0 0 3611962275) 0x7fbaf8006180 con 0x7fbb0404d1c0 2026-02-12T17:34:36.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:34:36.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:36.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.57:6789/0 conn(0x7fbb0404d1c0 legacy=0x7fbb04197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbaeaffd640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.57:6789/0 conn(0x7fbb0404d1c0 legacy=0x7fbb04197d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:36.335 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:34:36.335 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:36.335 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:36.335 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:34:36.335 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 32, 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 16799, 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:36.336 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:34:36.337 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:36.338 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:34:36.339 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:36.340 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:36.341 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.342 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:36.343 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.344 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:36.345 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.346 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.347 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:34:36.347 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.82:6800/2441377515 conn(0x7fbad003f7c0 legacy=0x7fbad005fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb08f0c640 10 monclient: shutdown 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb08f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 >> v1:10.20.193.57:6789/0 conn(0x7fbb0408c620 legacy=0x7fbb04181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb02d76640 1 -- 10.20.193.57:0/1432444866 reap_dead start 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb02d76640 1 -- 10.20.193.57:0/1432444866 reap_dead start 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 shutdown_connections 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 >> 10.20.193.57:0/1432444866 conn(0x7fbb040916b0 msgr2=0x7fbb0418e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 shutdown_connections 2026-02-12T17:34:36.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.321+0000 7fbb08f0c640 1 -- 10.20.193.57:0/1432444866 wait complete. 2026-02-12T17:34:36.349 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:34:36.349 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:34:36.349 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:34:36.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient: get_monmap_and_config 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient: build_initial_monmap 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient: monmap: 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:34:36.417126+0000 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:34:36.417126+0000 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:34:36.414 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 1 Processor -- start 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 1 -- start start 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient: init 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient(hunting): picked mon.noname-b con 0x7efe5408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient(hunting): picked mon.noname-a con 0x7efe5408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient(hunting): picked mon.noname-c con 0x7efe54182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe5408a820 con 0x7efe5408c620 2026-02-12T17:34:36.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe54089450 con 0x7efe54182cc0 2026-02-12T17:34:36.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe54089730 con 0x7efe5408c250 2026-02-12T17:34:36.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:36.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe58b0c640 10 monclient(hunting): authenticate will time out at 956.235967s 2026-02-12T17:34:36.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.416+0000 7efe52575640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7efe5408c250 legacy=0x7efe5408a110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:36.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.417+0000 7efe51d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7efe5408c620 0x7efe5408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:59354/0 (socket says 10.20.193.57:59354) 2026-02-12T17:34:36.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.417+0000 7efe51d74640 1 -- 10.20.193.57:0/1238035303 learned_addr learned my addr 10.20.193.57:0/1238035303 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:36.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51d74640 1 -- 10.20.193.57:0/1238035303 >> v1:10.20.193.57:6789/0 conn(0x7efe5408c620 legacy=0x7efe5408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 -- 10.20.193.57:0/1238035303 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2182012997 0 0) 0x7efe3c002c20 con 0x7efe5408c620 2026-02-12T17:34:36.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe52d76640 1 -- 10.20.193.57:0/1238035303 >> v1:10.20.193.82:6789/0 conn(0x7efe54182cc0 legacy=0x7efe541a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient(hunting): my global_id is 54180 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 -- 10.20.193.57:0/1238035303 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe400035e0 con 0x7efe5408c620 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 -- 10.20.193.57:0/1238035303 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1675231650 0 0) 0x7efe400035e0 con 0x7efe5408c620 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 -- 10.20.193.57:0/1238035303 >> v1:10.20.193.57:6790/0 conn(0x7efe5408c250 legacy=0x7efe5408a110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 -- 10.20.193.57:0/1238035303 >> v1:10.20.193.82:6789/0 conn(0x7efe54182cc0 legacy=0x7efe541a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: _finish_hunting 0 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 monclient: found mon.noname-a 2026-02-12T17:34:36.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 -- 10.20.193.57:0/1238035303 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe54089a10 con 0x7efe5408c620 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: _finish_auth 0 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: _check_auth_tickets 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 -- 10.20.193.57:0/1238035303 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe3c003260 con 0x7efe5408c620 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe58b0c640 5 monclient: authenticate success, global_id 54180 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe58b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: dump: 2026-02-12T17:34:36.425 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe58b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 -- 10.20.193.57:0/1238035303 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe3c004960 con 0x7efe5408c620 2026-02-12T17:34:36.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 1 -- 10.20.193.57:0/1238035303 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe3c004cb0 con 0x7efe5408c620 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe58b0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe58b0c640 4 set_mon_vals no callback set 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe51573640 10 monclient: dump: 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.427 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe58b0c640 10 monclient: shutdown 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe58b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe58b0c640 1 -- 10.20.193.57:0/1238035303 >> v1:10.20.193.57:6789/0 conn(0x7efe5408c620 legacy=0x7efe5408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.419+0000 7efe58b0c640 1 -- 10.20.193.57:0/1238035303 shutdown_connections 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 1 -- 10.20.193.57:0/1238035303 >> 10.20.193.57:0/1238035303 conn(0x7efe540916b0 msgr2=0x7efe54091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 1 -- 10.20.193.57:0/1238035303 shutdown_connections 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 1 -- 10.20.193.57:0/1238035303 wait complete. 2026-02-12T17:34:36.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient: build_initial_monmap 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient: monmap: 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 1 Processor -- start 2026-02-12T17:34:36.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 1 -- start start 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient: init 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient(hunting): picked mon.noname-c con 0x7efe5408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient(hunting): picked mon.noname-a con 0x7efe5408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient(hunting): picked mon.noname-b con 0x7efe54182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe540888a0 con 0x7efe5408c620 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe5413b370 con 0x7efe54182cc0 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe5413b8a0 con 0x7efe5408c250 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe58b0c640 10 monclient(hunting): authenticate will time out at 956.239829s 2026-02-12T17:34:36.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe52575640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7efe5408c250 legacy=0x7efe54137f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe51d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7efe5408c620 0x7efe54138680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:59370/0 (socket says 10.20.193.57:59370) 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.420+0000 7efe51d74640 1 -- 10.20.193.57:0/1869117127 learned_addr learned my addr 10.20.193.57:0/1869117127 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.422+0000 7efe51d74640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.57:6789/0 conn(0x7efe5408c620 legacy=0x7efe54138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 594267668 0 0) 0x7efe540888a0 con 0x7efe5408c620 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): my global_id is 54183 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe200035e0 con 0x7efe5408c620 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe52d76640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.82:6789/0 conn(0x7efe54182cc0 legacy=0x7efe54195450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3273541833 0 0) 0x7efe5413b370 con 0x7efe54182cc0 2026-02-12T17:34:36.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): my global_id is 4738 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe540888a0 con 0x7efe54182cc0 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3805572688 0 0) 0x7efe200035e0 con 0x7efe5408c620 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe5413b370 con 0x7efe5408c620 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe3c004ad0 con 0x7efe5408c620 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): dump: 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.432 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 917925272 0 0) 0x7efe5413b370 con 0x7efe5408c620 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.57:6790/0 conn(0x7efe5408c250 legacy=0x7efe54137f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.82:6789/0 conn(0x7efe54182cc0 legacy=0x7efe54195450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient: _finish_hunting 0 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 monclient: found mon.a 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5413bb80 con 0x7efe5408c620 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient: _finish_auth 0 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient: _check_auth_tickets 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe58b0c640 5 monclient: authenticate success, global_id 54183 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe58b0c640 10 monclient: _renew_subs 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe58b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe54139880 con 0x7efe5408c620 2026-02-12T17:34:36.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe58b0c640 10 monclient: _renew_subs 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe58b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efe5413e420 con 0x7efe5408c620 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe3c002f00 con 0x7efe5408c620 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe3c005190 con 0x7efe5408c620 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe3affd640 10 monclient: dump: 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.435 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.423+0000 7efe50d72640 4 set_mon_vals no callback set 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.424+0000 7efe58b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.424+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efe54090810 con 0x7efe54138d90 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.424+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7efe3c011e00 con 0x7efe5408c620 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.424+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(299..299 src has 202..299) ==== 3975+0+0 (unknown 2479889403 0 0) 0x7efe3c04ec00 con 0x7efe5408c620 2026-02-12T17:34:36.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.424+0000 7efe52d76640 10 monclient: get_auth_request con 0x7efe2003f6d0 auth_method 0 2026-02-12T17:34:36.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe52575640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.82:6789/0 conn(0x7efe54138d90 legacy=0x7efe54085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004241900 0 0) 0x7efe54090810 con 0x7efe54138d90 2026-02-12T17:34:36.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 10 monclient(hunting): my global_id is 4741 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe5413b370 con 0x7efe54138d90 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2776314350 0 0) 0x7efe5413b370 con 0x7efe54138d90 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe54090810 con 0x7efe54138d90 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe480042d0 con 0x7efe54138d90 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 10 monclient: dump: 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.440 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 894266574 0 0) 0x7efe54090810 con 0x7efe54138d90 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.426+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe5413b060 con 0x7efe54138d90 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.427+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7efe480066c0 con 0x7efe54138d90 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.427+0000 7efe3affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:34:36.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.427+0000 7efe3affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.427+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.82:6789/0 conn(0x7efe54138d90 legacy=0x7efe54085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.427+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.82:6789/0 conn(0x7efe54138d90 legacy=0x7efe54085720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.430+0000 7efe58b0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.430+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efe5408a820 con 0x7efe54085e30 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.432+0000 7efe52575640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.82:6789/0 conn(0x7efe54085e30 legacy=0x7efe54197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695390837 0 0) 0x7efe48004820 con 0x7efe54085e30 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 10 monclient(hunting): _negotiate 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 10 monclient(hunting): my global_id is 4744 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe54090810 con 0x7efe54085e30 2026-02-12T17:34:36.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3854437449 0 0) 0x7efe54090810 con 0x7efe54085e30 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe48004820 con 0x7efe54085e30 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efe48004d80 con 0x7efe54085e30 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 10 monclient: dump: 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:34:36.443 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1325617941 0 0) 0x7efe48004820 con 0x7efe54085e30 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efe5413b500 con 0x7efe54085e30 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 3814832015) 0x7efe480062c0 con 0x7efe54085e30 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.82:6789/0 conn(0x7efe54085e30 legacy=0x7efe54197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe3affd640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.82:6789/0 conn(0x7efe54085e30 legacy=0x7efe54197b80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:34:36.444 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 32, 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 397930, 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:34:36.445 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:36.446 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:36.447 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:34:36.448 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:34:36.449 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:34:36.450 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:36.451 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:34:36.452 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:34:36.453 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.454 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:34:36.455 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:34:36.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.82:6800/2441377515 conn(0x7efe2003f6d0 legacy=0x7efe2005fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe58b0c640 10 monclient: shutdown 2026-02-12T17:34:36.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe58b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:34:36.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 >> v1:10.20.193.57:6789/0 conn(0x7efe5408c620 legacy=0x7efe54138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:34:36.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe52d76640 1 -- 10.20.193.57:0/1869117127 reap_dead start 2026-02-12T17:34:36.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe52d76640 1 -- 10.20.193.57:0/1869117127 reap_dead start 2026-02-12T17:34:36.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 shutdown_connections 2026-02-12T17:34:36.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 >> 10.20.193.57:0/1869117127 conn(0x7efe540916b0 msgr2=0x7efe5408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:34:36.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 shutdown_connections 2026-02-12T17:34:36.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:34:36.433+0000 7efe58b0c640 1 -- 10.20.193.57:0/1869117127 wait complete. 2026-02-12T17:34:36.457 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:34:36.457 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:34:37.073 INFO:tasks.rados.rados.0.trial082.stdout:1320: done (4 left) 2026-02-12T17:34:37.074 INFO:tasks.rados.rados.0.trial082.stdout:1321: write (excl) oid 19 current snap is 143 2026-02-12T17:34:37.074 INFO:tasks.rados.rados.0.trial082.stdout:1316: finishing rollback tid 2 to trial08226312-43 2026-02-12T17:34:37.074 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 828 (ObjNum 399 snap 119 seq_num 399) dirty exists 2026-02-12T17:34:37.074 INFO:tasks.rados.rados.0.trial082.stdout:1321: seq_num 461 ranges {548027=470969,1593493=776821,3093529=631692} 2026-02-12T17:34:37.077 INFO:tasks.rados.rados.0.trial082.stdout:1321: writing trial08226312-19 from 548027 to 1018996 tid 1 2026-02-12T17:34:37.083 INFO:tasks.rados.rados.0.trial082.stdout:1321: writing trial08226312-19 from 1593493 to 2370314 tid 2 2026-02-12T17:34:37.089 INFO:tasks.rados.rados.0.trial082.stdout:1321: writing trial08226312-19 from 3093529 to 3725221 tid 3 2026-02-12T17:34:37.089 INFO:tasks.rados.rados.0.trial082.stdout:1316: done (4 left) 2026-02-12T17:34:37.089 INFO:tasks.rados.rados.0.trial082.stdout:1322: snap_create 2026-02-12T17:34:37.089 INFO:tasks.rados.rados.0.trial082.stdout:1317: finishing write tid 1 to trial08226312-40 2026-02-12T17:34:37.089 INFO:tasks.rados.rados.0.trial082.stdout:1317: finishing write tid 2 to trial08226312-40 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1317: finishing write tid 3 to trial08226312-40 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1317: finishing write tid 4 to trial08226312-40 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1317: finishing write tid 5 to trial08226312-40 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1317: oid 40 updating version 0 to 802 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1317: oid 40 updating version 802 to 803 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1317: oid 40 updating version 803 to 804 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1317: oid 40 version 804 is already newer than 801 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 804 (ObjNum 460 snap 143 seq_num 460) dirty exists 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1317: left oid 40 (ObjNum 460 snap 143 seq_num 460) 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1318: finishing copy_from racing read to trial08226312-21 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1318: finishing copy_from to trial08226312-21 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 645 (ObjNum 456 snap 143 seq_num 456) dirty exists 2026-02-12T17:34:37.090 INFO:tasks.rados.rados.0.trial082.stdout:1319: expect (ObjNum 384 snap 113 seq_num 384) 2026-02-12T17:34:37.129 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 871285 2026-02-12T17:34:37.186 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2239423 2026-02-12T17:34:37.190 INFO:tasks.rados.rados.0.trial082.stdout:1321: finishing write tid 1 to trial08226312-19 2026-02-12T17:34:37.190 INFO:tasks.rados.rados.0.trial082.stdout:1321: finishing write tid 2 to trial08226312-19 2026-02-12T17:34:37.190 INFO:tasks.rados.rados.0.trial082.stdout:1321: finishing write tid 3 to trial08226312-19 2026-02-12T17:34:37.190 INFO:tasks.rados.rados.0.trial082.stdout:1321: finishing write tid 4 to trial08226312-19 2026-02-12T17:34:37.191 INFO:tasks.rados.rados.0.trial082.stdout:1321: finishing write tid 5 to trial08226312-19 2026-02-12T17:34:37.191 INFO:tasks.rados.rados.0.trial082.stdout:1321: oid 19 updating version 0 to 913 2026-02-12T17:34:37.191 INFO:tasks.rados.rados.0.trial082.stdout:1321: oid 19 updating version 913 to 920 2026-02-12T17:34:37.191 INFO:tasks.rados.rados.0.trial082.stdout:1321: oid 19 version 920 is already newer than 919 2026-02-12T17:34:37.191 INFO:tasks.rados.rados.0.trial082.stdout:1321: oid 19 version 920 is already newer than 918 2026-02-12T17:34:37.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 920 (ObjNum 461 snap 143 seq_num 461) dirty exists 2026-02-12T17:34:37.191 INFO:tasks.rados.rados.0.trial082.stdout:1321: left oid 19 (ObjNum 461 snap 143 seq_num 461) 2026-02-12T17:34:38.038 INFO:tasks.rados.rados.0.trial082.stdout:1317: done (4 left) 2026-02-12T17:34:38.039 INFO:tasks.rados.rados.0.trial082.stdout:1318: done (3 left) 2026-02-12T17:34:38.039 INFO:tasks.rados.rados.0.trial082.stdout:1319: done (2 left) 2026-02-12T17:34:38.039 INFO:tasks.rados.rados.0.trial082.stdout:1321: done (1 left) 2026-02-12T17:34:38.039 INFO:tasks.rados.rados.0.trial082.stdout:1322: done (0 left) 2026-02-12T17:34:38.039 INFO:tasks.rados.rados.0.trial082.stdout:1323: snap_create 2026-02-12T17:34:39.039 INFO:tasks.rados.rados.0.trial082.stdout:1323: done (0 left) 2026-02-12T17:34:39.039 INFO:tasks.rados.rados.0.trial082.stdout:1324: snap_remove snap 122 2026-02-12T17:34:40.040 INFO:tasks.rados.rados.0.trial082.stdout:1324: done (0 left) 2026-02-12T17:34:40.040 INFO:tasks.rados.rados.0.trial082.stdout:1325: copy_from oid 1 from oid 33 current snap is 145 2026-02-12T17:34:40.040 INFO:tasks.rados.rados.0.trial082.stdout:1326: copy_from oid 9 from oid 40 current snap is 145 2026-02-12T17:34:40.040 INFO:tasks.rados.rados.0.trial082.stdout:1327: rollback oid 12 current snap is 145 2026-02-12T17:34:40.040 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 144 2026-02-12T17:34:40.041 INFO:tasks.rados.rados.0.trial082.stdout:1328: write (excl) oid 23 current snap is 145 2026-02-12T17:34:40.041 INFO:tasks.rados.rados.0.trial082.stdout:1328: seq_num 462 ranges {564834=546218,1651975=520479,2720952=559317} 2026-02-12T17:34:40.044 INFO:tasks.rados.rados.0.trial082.stdout:1328: writing trial08226312-23 from 564834 to 1111052 tid 1 2026-02-12T17:34:40.048 INFO:tasks.rados.rados.0.trial082.stdout:1328: writing trial08226312-23 from 1651975 to 2172454 tid 2 2026-02-12T17:34:40.053 INFO:tasks.rados.rados.0.trial082.stdout:1328: writing trial08226312-23 from 2720952 to 3280269 tid 3 2026-02-12T17:34:40.053 INFO:tasks.rados.rados.0.trial082.stdout:1329: read oid 43 snap -1 2026-02-12T17:34:40.053 INFO:tasks.rados.rados.0.trial082.stdout:1329: expect (ObjNum 399 snap 119 seq_num 399) 2026-02-12T17:34:40.053 INFO:tasks.rados.rados.0.trial082.stdout:1330: read oid 17 snap -1 2026-02-12T17:34:40.053 INFO:tasks.rados.rados.0.trial082.stdout:1330: expect (ObjNum 427 snap 134 seq_num 427) 2026-02-12T17:34:40.053 INFO:tasks.rados.rados.0.trial082.stdout:1331: write (excl) oid 30 current snap is 145 2026-02-12T17:34:40.053 INFO:tasks.rados.rados.0.trial082.stdout:1327: finishing rollback tid 0 to trial08226312-12 2026-02-12T17:34:40.053 INFO:tasks.rados.rados.0.trial082.stdout:1327: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:34:40.053 INFO:tasks.rados.rados.0.trial082.stdout:1328: finishing write tid 1 to trial08226312-23 2026-02-12T17:34:40.054 INFO:tasks.rados.rados.0.trial082.stdout:1327: finishing rollback tid 2 to trial08226312-12 2026-02-12T17:34:40.054 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 651 (ObjNum 297 snap 83 seq_num 297) dirty exists 2026-02-12T17:34:40.054 INFO:tasks.rados.rados.0.trial082.stdout:1328: finishing write tid 2 to trial08226312-23 2026-02-12T17:34:40.054 INFO:tasks.rados.rados.0.trial082.stdout:1331: seq_num 463 ranges {581641=621467,1994104=780490,3432022=349619} 2026-02-12T17:34:40.056 INFO:tasks.rados.rados.0.trial082.stdout:1331: writing trial08226312-30 from 581641 to 1203108 tid 1 2026-02-12T17:34:40.062 INFO:tasks.rados.rados.0.trial082.stdout:1331: writing trial08226312-30 from 1994104 to 2774594 tid 2 2026-02-12T17:34:40.066 INFO:tasks.rados.rados.0.trial082.stdout:1331: writing trial08226312-30 from 3432022 to 3781641 tid 3 2026-02-12T17:34:40.067 INFO:tasks.rados.rados.0.trial082.stdout:1327: done (6 left) 2026-02-12T17:34:40.067 INFO:tasks.rados.rados.0.trial082.stdout:1332: snap_create 2026-02-12T17:34:40.067 INFO:tasks.rados.rados.0.trial082.stdout:1326: finishing copy_from racing read to trial08226312-9 2026-02-12T17:34:40.067 INFO:tasks.rados.rados.0.trial082.stdout:1326: finishing copy_from to trial08226312-9 2026-02-12T17:34:40.067 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 804 (ObjNum 460 snap 143 seq_num 460) dirty exists 2026-02-12T17:34:40.067 INFO:tasks.rados.rados.0.trial082.stdout:1330: expect (ObjNum 427 snap 134 seq_num 427) 2026-02-12T17:34:40.132 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 553463 2026-02-12T17:34:40.157 INFO:tasks.rados.rados.0.trial082.stdout:1325: finishing copy_from racing read to trial08226312-1 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1328: finishing write tid 3 to trial08226312-23 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1328: finishing write tid 4 to trial08226312-23 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1325: finishing copy_from to trial08226312-1 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 641 (ObjNum 409 snap 122 seq_num 409) dirty exists 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1328: finishing write tid 5 to trial08226312-23 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1328: oid 23 updating version 0 to 822 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1328: oid 23 updating version 822 to 823 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1328: oid 23 updating version 823 to 824 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1328: oid 23 version 824 is already newer than 821 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 824 (ObjNum 462 snap 145 seq_num 462) dirty exists 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1328: left oid 23 (ObjNum 462 snap 145 seq_num 462) 2026-02-12T17:34:40.158 INFO:tasks.rados.rados.0.trial082.stdout:1329: expect (ObjNum 399 snap 119 seq_num 399) 2026-02-12T17:34:40.159 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:40.195 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:40.272 INFO:tasks.rados.rados.0.trial082.stdout:1331: finishing write tid 1 to trial08226312-30 2026-02-12T17:34:40.272 INFO:tasks.rados.rados.0.trial082.stdout:1331: finishing write tid 2 to trial08226312-30 2026-02-12T17:34:40.272 INFO:tasks.rados.rados.0.trial082.stdout:1331: finishing write tid 3 to trial08226312-30 2026-02-12T17:34:40.272 INFO:tasks.rados.rados.0.trial082.stdout:1331: finishing write tid 4 to trial08226312-30 2026-02-12T17:34:40.272 INFO:tasks.rados.rados.0.trial082.stdout:1331: finishing write tid 5 to trial08226312-30 2026-02-12T17:34:40.272 INFO:tasks.rados.rados.0.trial082.stdout:1331: oid 30 updating version 0 to 832 2026-02-12T17:34:40.273 INFO:tasks.rados.rados.0.trial082.stdout:1331: oid 30 version 832 is already newer than 830 2026-02-12T17:34:40.273 INFO:tasks.rados.rados.0.trial082.stdout:1331: oid 30 version 832 is already newer than 831 2026-02-12T17:34:40.273 INFO:tasks.rados.rados.0.trial082.stdout:1331: oid 30 version 832 is already newer than 829 2026-02-12T17:34:40.273 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 832 (ObjNum 463 snap 145 seq_num 463) dirty exists 2026-02-12T17:34:40.273 INFO:tasks.rados.rados.0.trial082.stdout:1331: left oid 30 (ObjNum 463 snap 145 seq_num 463) 2026-02-12T17:34:41.045 INFO:tasks.rados.rados.0.trial082.stdout:1325: done (6 left) 2026-02-12T17:34:41.045 INFO:tasks.rados.rados.0.trial082.stdout:1326: done (5 left) 2026-02-12T17:34:41.045 INFO:tasks.rados.rados.0.trial082.stdout:1328: done (4 left) 2026-02-12T17:34:41.045 INFO:tasks.rados.rados.0.trial082.stdout:1329: done (3 left) 2026-02-12T17:34:41.046 INFO:tasks.rados.rados.0.trial082.stdout:1330: done (2 left) 2026-02-12T17:34:41.046 INFO:tasks.rados.rados.0.trial082.stdout:1331: done (1 left) 2026-02-12T17:34:41.046 INFO:tasks.rados.rados.0.trial082.stdout:1332: done (0 left) 2026-02-12T17:34:41.046 INFO:tasks.rados.rados.0.trial082.stdout:1333: rollback oid 44 current snap is 146 2026-02-12T17:34:41.046 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 124 2026-02-12T17:34:41.046 INFO:tasks.rados.rados.0.trial082.stdout:1334: write (excl) oid 18 current snap is 146 2026-02-12T17:34:41.047 INFO:tasks.rados.rados.0.trial082.stdout:1334: seq_num 464 ranges {598448=413069,1768939=524148,2775798=581861,3781488=16960} 2026-02-12T17:34:41.047 INFO:tasks.rados.rados.0.trial082.stdout:1334: writing trial08226312-18 from 598448 to 1011517 tid 1 2026-02-12T17:34:41.052 INFO:tasks.rados.rados.0.trial082.stdout:1334: writing trial08226312-18 from 1768939 to 2293087 tid 2 2026-02-12T17:34:41.056 INFO:tasks.rados.rados.0.trial082.stdout:1334: writing trial08226312-18 from 2775798 to 3357659 tid 3 2026-02-12T17:34:41.061 INFO:tasks.rados.rados.0.trial082.stdout:1334: writing trial08226312-18 from 3781488 to 3798448 tid 4 2026-02-12T17:34:41.061 INFO:tasks.rados.rados.0.trial082.stdout:1335: rollback oid 42 current snap is 146 2026-02-12T17:34:41.061 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 42 to 145 2026-02-12T17:34:41.061 INFO:tasks.rados.rados.0.trial082.stdout:1333: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:34:41.062 INFO:tasks.rados.rados.0.trial082.stdout:1333: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:34:41.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 826 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:34:41.062 INFO:tasks.rados.rados.0.trial082.stdout:1334: finishing write tid 1 to trial08226312-18 2026-02-12T17:34:41.062 INFO:tasks.rados.rados.0.trial082.stdout:1334: finishing write tid 2 to trial08226312-18 2026-02-12T17:34:41.062 INFO:tasks.rados.rados.0.trial082.stdout:1334: finishing write tid 3 to trial08226312-18 2026-02-12T17:34:41.062 INFO:tasks.rados.rados.0.trial082.stdout:1333: done (2 left) 2026-02-12T17:34:41.062 INFO:tasks.rados.rados.0.trial082.stdout:1336: read oid 9 snap 137 2026-02-12T17:34:41.062 INFO:tasks.rados.rados.0.trial082.stdout:1336: expect (ObjNum 297 snap 83 seq_num 297) 2026-02-12T17:34:41.062 INFO:tasks.rados.rados.0.trial082.stdout:1337: rollback oid 17 current snap is 146 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 136 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1338: read oid 1 snap -1 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1338: expect (ObjNum 409 snap 122 seq_num 409) 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1339: rollback oid 5 current snap is 146 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 5 to 140 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1340: read oid 44 snap -1 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1340: expect deleted 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1341: delete oid 21 current snap is 146 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1334: finishing write tid 4 to trial08226312-18 2026-02-12T17:34:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1334: finishing write tid 5 to trial08226312-18 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1334: finishing write tid 6 to trial08226312-18 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1334: oid 18 updating version 0 to 802 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1334: oid 18 updating version 802 to 804 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1334: oid 18 version 804 is already newer than 803 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1334: oid 18 version 804 is already newer than 801 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1334: oid 18 updating version 804 to 805 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 805 (ObjNum 464 snap 146 seq_num 464) dirty exists 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1334: left oid 18 (ObjNum 464 snap 146 seq_num 464) 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1339: finishing rollback tid 0 to trial08226312-5 2026-02-12T17:34:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1339: finishing rollback tid 1 to trial08226312-5 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:1339: finishing rollback tid 2 to trial08226312-5 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 829 (ObjNum 423 snap 131 seq_num 423) dirty exists 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:1337: finishing rollback tid 0 to trial08226312-17 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:1337: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:1337: finishing rollback tid 2 to trial08226312-17 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 930 (ObjNum 427 snap 134 seq_num 427) dirty exists 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:1334: done (7 left) 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:1337: done (6 left) 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:1339: done (5 left) 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:1340: done (4 left) 2026-02-12T17:34:41.065 INFO:tasks.rados.rados.0.trial082.stdout:1341: done (3 left) 2026-02-12T17:34:41.066 INFO:tasks.rados.rados.0.trial082.stdout:1342: snap_remove snap 124 2026-02-12T17:34:42.046 INFO:tasks.rados.rados.0.trial082.stdout:1342: done (3 left) 2026-02-12T17:34:42.046 INFO:tasks.rados.rados.0.trial082.stdout:1343: rollback oid 11 current snap is 146 2026-02-12T17:34:42.046 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 144 2026-02-12T17:34:42.046 INFO:tasks.rados.rados.0.trial082.stdout:1338: expect (ObjNum 409 snap 122 seq_num 409) 2026-02-12T17:34:42.159 INFO:tasks.rados.rados.0.trial082.stdout:1335: finishing rollback tid 0 to trial08226312-42 2026-02-12T17:34:42.159 INFO:tasks.rados.rados.0.trial082.stdout:1335: finishing rollback tid 1 to trial08226312-42 2026-02-12T17:34:42.159 INFO:tasks.rados.rados.0.trial082.stdout:1335: finishing rollback tid 2 to trial08226312-42 2026-02-12T17:34:42.159 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 809 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:34:42.159 INFO:tasks.rados.rados.0.trial082.stdout:1336: expect (ObjNum 297 snap 83 seq_num 297) 2026-02-12T17:34:42.159 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:42.238 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:42.278 INFO:tasks.rados.rados.0.trial082.stdout:1343: finishing rollback tid 0 to trial08226312-11 2026-02-12T17:34:42.278 INFO:tasks.rados.rados.0.trial082.stdout:1335: done (3 left) 2026-02-12T17:34:42.278 INFO:tasks.rados.rados.0.trial082.stdout:1336: done (2 left) 2026-02-12T17:34:42.278 INFO:tasks.rados.rados.0.trial082.stdout:1338: done (1 left) 2026-02-12T17:34:42.278 INFO:tasks.rados.rados.0.trial082.stdout:1344: copy_from oid 50 from oid 4 current snap is 146 2026-02-12T17:34:42.278 INFO:tasks.rados.rados.0.trial082.stdout:1343: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:34:42.278 INFO:tasks.rados.rados.0.trial082.stdout:1343: finishing rollback tid 2 to trial08226312-11 2026-02-12T17:34:42.278 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 455 (ObjNum 376 snap 112 seq_num 376) dirty exists 2026-02-12T17:34:42.279 INFO:tasks.rados.rados.0.trial082.stdout:1343: done (1 left) 2026-02-12T17:34:42.279 INFO:tasks.rados.rados.0.trial082.stdout:1345: write (excl) oid 19 current snap is 146 2026-02-12T17:34:42.279 INFO:tasks.rados.rados.0.trial082.stdout:1345: seq_num 466 ranges {632062=563567,1885903=527817,2830644=720758} 2026-02-12T17:34:42.282 INFO:tasks.rados.rados.0.trial082.stdout:1345: writing trial08226312-19 from 632062 to 1195629 tid 1 2026-02-12T17:34:42.286 INFO:tasks.rados.rados.0.trial082.stdout:1345: writing trial08226312-19 from 1885903 to 2413720 tid 2 2026-02-12T17:34:42.291 INFO:tasks.rados.rados.0.trial082.stdout:1345: writing trial08226312-19 from 2830644 to 3551402 tid 3 2026-02-12T17:34:42.291 INFO:tasks.rados.rados.0.trial082.stdout:1346: delete oid 6 current snap is 146 2026-02-12T17:34:42.291 INFO:tasks.rados.rados.0.trial082.stdout:1344: finishing copy_from racing read to trial08226312-50 2026-02-12T17:34:42.291 INFO:tasks.rados.rados.0.trial082.stdout:1344: finishing copy_from to trial08226312-50 2026-02-12T17:34:42.291 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 677 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:34:42.292 INFO:tasks.rados.rados.0.trial082.stdout:1345: finishing write tid 1 to trial08226312-19 2026-02-12T17:34:42.292 INFO:tasks.rados.rados.0.trial082.stdout:1345: finishing write tid 2 to trial08226312-19 2026-02-12T17:34:42.293 INFO:tasks.rados.rados.0.trial082.stdout:1345: finishing write tid 3 to trial08226312-19 2026-02-12T17:34:42.293 INFO:tasks.rados.rados.0.trial082.stdout:1344: done (2 left) 2026-02-12T17:34:42.293 INFO:tasks.rados.rados.0.trial082.stdout:1346: done (1 left) 2026-02-12T17:34:42.293 INFO:tasks.rados.rados.0.trial082.stdout:1347: write oid 7 current snap is 146 2026-02-12T17:34:42.293 INFO:tasks.rados.rados.0.trial082.stdout:1347: seq_num 468 ranges {665676=714065,1886514=531486,3169137=696539} 2026-02-12T17:34:42.298 INFO:tasks.rados.rados.0.trial082.stdout:1347: writing trial08226312-7 from 665676 to 1379741 tid 1 2026-02-12T17:34:42.302 INFO:tasks.rados.rados.0.trial082.stdout:1347: writing trial08226312-7 from 1886514 to 2418000 tid 2 2026-02-12T17:34:42.307 INFO:tasks.rados.rados.0.trial082.stdout:1347: writing trial08226312-7 from 3169137 to 3865676 tid 3 2026-02-12T17:34:42.308 INFO:tasks.rados.rados.0.trial082.stdout:1348: write (excl) oid 24 current snap is 146 2026-02-12T17:34:42.308 INFO:tasks.rados.rados.0.trial082.stdout:1348: seq_num 469 ranges {682483=789314,1944996=791497,3196560=554574} 2026-02-12T17:34:42.313 INFO:tasks.rados.rados.0.trial082.stdout:1348: writing trial08226312-24 from 682483 to 1471797 tid 1 2026-02-12T17:34:42.318 INFO:tasks.rados.rados.0.trial082.stdout:1348: writing trial08226312-24 from 1944996 to 2736493 tid 2 2026-02-12T17:34:42.322 INFO:tasks.rados.rados.0.trial082.stdout:1348: writing trial08226312-24 from 3196560 to 3751134 tid 3 2026-02-12T17:34:42.322 INFO:tasks.rados.rados.0.trial082.stdout:1345: finishing write tid 4 to trial08226312-19 2026-02-12T17:34:42.322 INFO:tasks.rados.rados.0.trial082.stdout:1345: finishing write tid 5 to trial08226312-19 2026-02-12T17:34:42.322 INFO:tasks.rados.rados.0.trial082.stdout:1345: oid 19 updating version 0 to 938 2026-02-12T17:34:42.322 INFO:tasks.rados.rados.0.trial082.stdout:1345: oid 19 updating version 938 to 941 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1345: oid 19 version 941 is already newer than 939 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1345: oid 19 version 941 is already newer than 940 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 941 (ObjNum 466 snap 146 seq_num 466) dirty exists 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1345: left oid 19 (ObjNum 466 snap 146 seq_num 466) 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1347: finishing write tid 1 to trial08226312-7 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1347: finishing write tid 2 to trial08226312-7 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1347: finishing write tid 3 to trial08226312-7 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1349: read oid 48 snap -1 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1349: expect deleted 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1345: done (3 left) 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1350: delete oid 44 current snap is 146 2026-02-12T17:34:42.323 INFO:tasks.rados.rados.0.trial082.stdout:1347: finishing write tid 4 to trial08226312-7 2026-02-12T17:34:42.324 INFO:tasks.rados.rados.0.trial082.stdout:1347: finishing write tid 5 to trial08226312-7 2026-02-12T17:34:42.324 INFO:tasks.rados.rados.0.trial082.stdout:1347: oid 7 updating version 0 to 822 2026-02-12T17:34:42.324 INFO:tasks.rados.rados.0.trial082.stdout:1347: oid 7 version 822 is already newer than 821 2026-02-12T17:34:42.324 INFO:tasks.rados.rados.0.trial082.stdout:1347: oid 7 version 822 is already newer than 820 2026-02-12T17:34:42.324 INFO:tasks.rados.rados.0.trial082.stdout:1347: oid 7 updating version 822 to 823 2026-02-12T17:34:42.324 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 823 (ObjNum 468 snap 146 seq_num 468) dirty exists 2026-02-12T17:34:42.324 INFO:tasks.rados.rados.0.trial082.stdout:1347: left oid 7 (ObjNum 468 snap 146 seq_num 468) 2026-02-12T17:34:42.324 INFO:tasks.rados.rados.0.trial082.stdout:1348: finishing write tid 1 to trial08226312-24 2026-02-12T17:34:42.324 INFO:tasks.rados.rados.0.trial082.stdout:1348: finishing write tid 2 to trial08226312-24 2026-02-12T17:34:42.325 INFO:tasks.rados.rados.0.trial082.stdout:1347: done (3 left) 2026-02-12T17:34:42.325 INFO:tasks.rados.rados.0.trial082.stdout:1349: done (2 left) 2026-02-12T17:34:42.325 INFO:tasks.rados.rados.0.trial082.stdout:1350: done (1 left) 2026-02-12T17:34:42.325 INFO:tasks.rados.rados.0.trial082.stdout:1351: read oid 4 snap -1 2026-02-12T17:34:42.326 INFO:tasks.rados.rados.0.trial082.stdout:1351: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:34:42.326 INFO:tasks.rados.rados.0.trial082.stdout:1352: read oid 18 snap -1 2026-02-12T17:34:42.326 INFO:tasks.rados.rados.0.trial082.stdout:1352: expect (ObjNum 464 snap 146 seq_num 464) 2026-02-12T17:34:42.326 INFO:tasks.rados.rados.0.trial082.stdout:1353: write oid 9 current snap is 146 2026-02-12T17:34:42.326 INFO:tasks.rados.rados.0.trial082.stdout:1353: seq_num 471 ranges {716097=539812,1945607=795166,3535053=381044} 2026-02-12T17:34:42.328 INFO:tasks.rados.rados.0.trial082.stdout:1353: writing trial08226312-9 from 716097 to 1255909 tid 1 2026-02-12T17:34:42.333 INFO:tasks.rados.rados.0.trial082.stdout:1353: writing trial08226312-9 from 1945607 to 2740773 tid 2 2026-02-12T17:34:42.339 INFO:tasks.rados.rados.0.trial082.stdout:1353: writing trial08226312-9 from 3535053 to 3916097 tid 3 2026-02-12T17:34:42.339 INFO:tasks.rados.rados.0.trial082.stdout:1354: read oid 28 snap 141 2026-02-12T17:34:42.339 INFO:tasks.rados.rados.0.trial082.stdout:1354: expect deleted 2026-02-12T17:34:42.339 INFO:tasks.rados.rados.0.trial082.stdout:1355: read oid 42 snap -1 2026-02-12T17:34:42.339 INFO:tasks.rados.rados.0.trial082.stdout:1355: expect (ObjNum 395 snap 116 seq_num 395) 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1356: read oid 34 snap -1 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1356: expect (ObjNum 401 snap 119 seq_num 401) 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1357: copy_from oid 33 from oid 21 current snap is 146 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1348: finishing write tid 3 to trial08226312-24 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1348: finishing write tid 4 to trial08226312-24 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1348: finishing write tid 5 to trial08226312-24 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1348: oid 24 updating version 0 to 944 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1348: oid 24 version 944 is already newer than 943 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1348: oid 24 updating version 944 to 946 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1348: oid 24 version 946 is already newer than 945 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 946 (ObjNum 469 snap 146 seq_num 469) dirty exists 2026-02-12T17:34:42.340 INFO:tasks.rados.rados.0.trial082.stdout:1348: left oid 24 (ObjNum 469 snap 146 seq_num 469) 2026-02-12T17:34:42.341 INFO:tasks.rados.rados.0.trial082.stdout:1351: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:34:42.341 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:42.401 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1650600 2026-02-12T17:34:42.457 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2224195 2026-02-12T17:34:42.462 INFO:tasks.rados.rados.0.trial082.stdout:1352: expect (ObjNum 464 snap 146 seq_num 464) 2026-02-12T17:34:42.531 INFO:tasks.rados.rados.0.trial082.stdout:1353: finishing write tid 1 to trial08226312-9 2026-02-12T17:34:42.531 INFO:tasks.rados.rados.0.trial082.stdout:1353: finishing write tid 2 to trial08226312-9 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1357: finishing copy_from to trial08226312-33 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1357: got expected ENOENT (src dne) 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1357: finishing copy_from racing read to trial08226312-33 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1348: done (7 left) 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1351: done (6 left) 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1352: done (5 left) 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1357: done (4 left) 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1358: rollback oid 11 current snap is 146 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 145 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1353: finishing write tid 3 to trial08226312-9 2026-02-12T17:34:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1356: expect (ObjNum 401 snap 119 seq_num 401) 2026-02-12T17:34:42.533 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 223055 2026-02-12T17:34:42.608 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1270132 2026-02-12T17:34:42.634 INFO:tasks.rados.rados.0.trial082.stdout:1353: finishing write tid 4 to trial08226312-9 2026-02-12T17:34:42.634 INFO:tasks.rados.rados.0.trial082.stdout:1353: finishing write tid 5 to trial08226312-9 2026-02-12T17:34:42.634 INFO:tasks.rados.rados.0.trial082.stdout:1353: oid 9 updating version 0 to 828 2026-02-12T17:34:42.634 INFO:tasks.rados.rados.0.trial082.stdout:1353: oid 9 version 828 is already newer than 827 2026-02-12T17:34:42.634 INFO:tasks.rados.rados.0.trial082.stdout:1353: oid 9 version 828 is already newer than 825 2026-02-12T17:34:42.635 INFO:tasks.rados.rados.0.trial082.stdout:1353: oid 9 version 828 is already newer than 826 2026-02-12T17:34:42.635 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 828 (ObjNum 471 snap 146 seq_num 471) dirty exists 2026-02-12T17:34:42.635 INFO:tasks.rados.rados.0.trial082.stdout:1353: left oid 9 (ObjNum 471 snap 146 seq_num 471) 2026-02-12T17:34:42.635 INFO:tasks.rados.rados.0.trial082.stdout:1355: expect (ObjNum 395 snap 116 seq_num 395) 2026-02-12T17:34:42.712 INFO:tasks.rados.rados.0.trial082.stdout:1358: finishing rollback tid 0 to trial08226312-11 2026-02-12T17:34:42.712 INFO:tasks.rados.rados.0.trial082.stdout:1358: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:34:42.712 INFO:tasks.rados.rados.0.trial082.stdout:1358: finishing rollback tid 2 to trial08226312-11 2026-02-12T17:34:42.713 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 458 (ObjNum 376 snap 112 seq_num 376) dirty exists 2026-02-12T17:34:42.713 INFO:tasks.rados.rados.0.trial082.stdout:1353: done (4 left) 2026-02-12T17:34:42.713 INFO:tasks.rados.rados.0.trial082.stdout:1354: done (3 left) 2026-02-12T17:34:42.713 INFO:tasks.rados.rados.0.trial082.stdout:1355: done (2 left) 2026-02-12T17:34:42.713 INFO:tasks.rados.rados.0.trial082.stdout:1356: done (1 left) 2026-02-12T17:34:42.713 INFO:tasks.rados.rados.0.trial082.stdout:1358: done (0 left) 2026-02-12T17:34:42.714 INFO:tasks.rados.rados.0.trial082.stdout:1359: write oid 16 current snap is 146 2026-02-12T17:34:42.714 INFO:tasks.rados.rados.0.trial082.stdout:1359: seq_num 472 ranges {732904=731414,2120442=538824,3278829=504743} 2026-02-12T17:34:42.717 INFO:tasks.rados.rados.0.trial082.stdout:1359: writing trial08226312-16 from 732904 to 1464318 tid 1 2026-02-12T17:34:42.721 INFO:tasks.rados.rados.0.trial082.stdout:1359: writing trial08226312-16 from 2120442 to 2659266 tid 2 2026-02-12T17:34:42.725 INFO:tasks.rados.rados.0.trial082.stdout:1359: writing trial08226312-16 from 3278829 to 3783572 tid 3 2026-02-12T17:34:42.725 INFO:tasks.rados.rados.0.trial082.stdout:1360: snap_remove snap 144 2026-02-12T17:34:43.039 INFO:tasks.rados.rados.0.trial082.stdout:1360: done (1 left) 2026-02-12T17:34:43.040 INFO:tasks.rados.rados.0.trial082.stdout:1361: write (excl) oid 8 current snap is 146 2026-02-12T17:34:43.040 INFO:tasks.rados.rados.0.trial082.stdout:1361: seq_num 473 ranges {749711=406663,1778924=682482,3189899=716015} 2026-02-12T17:34:43.044 INFO:tasks.rados.rados.0.trial082.stdout:1361: writing trial08226312-8 from 749711 to 1156374 tid 1 2026-02-12T17:34:43.048 INFO:tasks.rados.rados.0.trial082.stdout:1361: writing trial08226312-8 from 1778924 to 2461406 tid 2 2026-02-12T17:34:43.054 INFO:tasks.rados.rados.0.trial082.stdout:1361: writing trial08226312-8 from 3189899 to 3905914 tid 3 2026-02-12T17:34:43.054 INFO:tasks.rados.rados.0.trial082.stdout:1362: write oid 4 current snap is 146 2026-02-12T17:34:43.054 INFO:tasks.rados.rados.0.trial082.stdout:1362: seq_num 474 ranges {766518=481912,1837406=542493,2933675=527287,3876584=89934} 2026-02-12T17:34:43.059 INFO:tasks.rados.rados.0.trial082.stdout:1362: writing trial08226312-4 from 766518 to 1248430 tid 1 2026-02-12T17:34:43.064 INFO:tasks.rados.rados.0.trial082.stdout:1362: writing trial08226312-4 from 1837406 to 2379899 tid 2 2026-02-12T17:34:43.069 INFO:tasks.rados.rados.0.trial082.stdout:1362: writing trial08226312-4 from 2933675 to 3460962 tid 3 2026-02-12T17:34:43.071 INFO:tasks.rados.rados.0.trial082.stdout:1362: writing trial08226312-4 from 3876584 to 3966518 tid 4 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1363: delete oid 48 current snap is 146 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1359: finishing write tid 1 to trial08226312-16 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1359: finishing write tid 2 to trial08226312-16 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1359: finishing write tid 3 to trial08226312-16 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1359: finishing write tid 4 to trial08226312-16 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1359: finishing write tid 5 to trial08226312-16 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1359: oid 16 updating version 0 to 830 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1359: oid 16 updating version 830 to 831 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1359: oid 16 updating version 831 to 832 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:1359: oid 16 version 832 is already newer than 829 2026-02-12T17:34:43.072 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 832 (ObjNum 472 snap 146 seq_num 472) dirty exists 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1359: left oid 16 (ObjNum 472 snap 146 seq_num 472) 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: finishing write tid 1 to trial08226312-8 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: finishing write tid 2 to trial08226312-8 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: finishing write tid 3 to trial08226312-8 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: finishing write tid 4 to trial08226312-8 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: finishing write tid 5 to trial08226312-8 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: oid 8 updating version 0 to 948 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: oid 8 updating version 948 to 957 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: oid 8 version 957 is already newer than 955 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: oid 8 version 957 is already newer than 956 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 957 (ObjNum 473 snap 146 seq_num 473) dirty exists 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1361: left oid 8 (ObjNum 473 snap 146 seq_num 473) 2026-02-12T17:34:43.073 INFO:tasks.rados.rados.0.trial082.stdout:1362: finishing write tid 1 to trial08226312-4 2026-02-12T17:34:43.074 INFO:tasks.rados.rados.0.trial082.stdout:1362: finishing write tid 2 to trial08226312-4 2026-02-12T17:34:43.074 INFO:tasks.rados.rados.0.trial082.stdout:1362: finishing write tid 3 to trial08226312-4 2026-02-12T17:34:43.074 INFO:tasks.rados.rados.0.trial082.stdout:1359: done (3 left) 2026-02-12T17:34:43.074 INFO:tasks.rados.rados.0.trial082.stdout:1361: done (2 left) 2026-02-12T17:34:43.074 INFO:tasks.rados.rados.0.trial082.stdout:1363: done (1 left) 2026-02-12T17:34:43.074 INFO:tasks.rados.rados.0.trial082.stdout:1364: snap_remove snap 141 2026-02-12T17:34:44.847 INFO:tasks.rados.rados.0.trial082.stdout:1364: done (1 left) 2026-02-12T17:34:44.847 INFO:tasks.rados.rados.0.trial082.stdout:1365: delete oid 14 current snap is 146 2026-02-12T17:34:44.847 INFO:tasks.rados.rados.0.trial082.stdout:1362: finishing write tid 4 to trial08226312-4 2026-02-12T17:34:44.847 INFO:tasks.rados.rados.0.trial082.stdout:1362: finishing write tid 5 to trial08226312-4 2026-02-12T17:34:44.847 INFO:tasks.rados.rados.0.trial082.stdout:1362: finishing write tid 6 to trial08226312-4 2026-02-12T17:34:44.847 INFO:tasks.rados.rados.0.trial082.stdout:1362: oid 4 updating version 0 to 961 2026-02-12T17:34:44.847 INFO:tasks.rados.rados.0.trial082.stdout:1362: oid 4 updating version 961 to 963 2026-02-12T17:34:44.848 INFO:tasks.rados.rados.0.trial082.stdout:1362: oid 4 version 963 is already newer than 962 2026-02-12T17:34:44.848 INFO:tasks.rados.rados.0.trial082.stdout:1362: oid 4 version 963 is already newer than 960 2026-02-12T17:34:44.848 INFO:tasks.rados.rados.0.trial082.stdout:1362: oid 4 version 963 is already newer than 959 2026-02-12T17:34:44.848 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 963 (ObjNum 474 snap 146 seq_num 474) dirty exists 2026-02-12T17:34:44.848 INFO:tasks.rados.rados.0.trial082.stdout:1362: left oid 4 (ObjNum 474 snap 146 seq_num 474) 2026-02-12T17:34:44.849 INFO:tasks.rados.rados.0.trial082.stdout:1362: done (1 left) 2026-02-12T17:34:44.849 INFO:tasks.rados.rados.0.trial082.stdout:1365: done (0 left) 2026-02-12T17:34:44.849 INFO:tasks.rados.rados.0.trial082.stdout:1366: read oid 26 snap -1 2026-02-12T17:34:44.849 INFO:tasks.rados.rados.0.trial082.stdout:1366: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:34:44.849 INFO:tasks.rados.rados.0.trial082.stdout:1367: snap_create 2026-02-12T17:34:44.854 INFO:tasks.rados.rados.0.trial082.stdout:1366: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:34:44.854 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:44.950 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:45.054 INFO:tasks.rados.rados.0.trial082.stdout:1366: done (1 left) 2026-02-12T17:34:45.054 INFO:tasks.rados.rados.0.trial082.stdout:1367: done (0 left) 2026-02-12T17:34:45.055 INFO:tasks.rados.rados.0.trial082.stdout:1368: read oid 11 snap 145 2026-02-12T17:34:45.055 INFO:tasks.rados.rados.0.trial082.stdout:1368: expect (ObjNum 376 snap 112 seq_num 376) 2026-02-12T17:34:45.055 INFO:tasks.rados.rados.0.trial082.stdout:1369: delete oid 50 current snap is 147 2026-02-12T17:34:45.057 INFO:tasks.rados.rados.0.trial082.stdout:1369: done (1 left) 2026-02-12T17:34:45.058 INFO:tasks.rados.rados.0.trial082.stdout:1370: rollback oid 33 current snap is 147 2026-02-12T17:34:45.058 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 140 2026-02-12T17:34:45.058 INFO:tasks.rados.rados.0.trial082.stdout:1371: write oid 9 current snap is 147 2026-02-12T17:34:45.058 INFO:tasks.rados.rados.0.trial082.stdout:1371: seq_num 478 ranges {433746=782908,1954981=78765} 2026-02-12T17:34:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1371: writing trial08226312-9 from 433746 to 1216654 tid 1 2026-02-12T17:34:45.065 INFO:tasks.rados.rados.0.trial082.stdout:1371: writing trial08226312-9 from 1954981 to 2033746 tid 2 2026-02-12T17:34:45.066 INFO:tasks.rados.rados.0.trial082.stdout:1372: rollback oid 31 current snap is 147 2026-02-12T17:34:45.066 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 31 to 136 2026-02-12T17:34:45.066 INFO:tasks.rados.rados.0.trial082.stdout:1370: finishing rollback tid 0 to trial08226312-33 2026-02-12T17:34:45.066 INFO:tasks.rados.rados.0.trial082.stdout:1370: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:34:45.066 INFO:tasks.rados.rados.0.trial082.stdout:1370: finishing rollback tid 2 to trial08226312-33 2026-02-12T17:34:45.066 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 654 (ObjNum 343 snap 103 seq_num 343) dirty exists 2026-02-12T17:34:45.066 INFO:tasks.rados.rados.0.trial082.stdout:1368: expect (ObjNum 376 snap 112 seq_num 376) 2026-02-12T17:34:45.066 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:45.136 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 936774 2026-02-12T17:34:45.157 INFO:tasks.rados.rados.0.trial082.stdout:1371: finishing write tid 1 to trial08226312-9 2026-02-12T17:34:45.157 INFO:tasks.rados.rados.0.trial082.stdout:1371: finishing write tid 2 to trial08226312-9 2026-02-12T17:34:45.157 INFO:tasks.rados.rados.0.trial082.stdout:1368: done (3 left) 2026-02-12T17:34:45.157 INFO:tasks.rados.rados.0.trial082.stdout:1370: done (2 left) 2026-02-12T17:34:45.157 INFO:tasks.rados.rados.0.trial082.stdout:1373: copy_from oid 26 from oid 30 current snap is 147 2026-02-12T17:34:45.157 INFO:tasks.rados.rados.0.trial082.stdout:1371: finishing write tid 3 to trial08226312-9 2026-02-12T17:34:45.157 INFO:tasks.rados.rados.0.trial082.stdout:1371: finishing write tid 4 to trial08226312-9 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1371: oid 9 updating version 0 to 846 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1371: oid 9 version 846 is already newer than 845 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1371: oid 9 version 846 is already newer than 844 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 846 (ObjNum 478 snap 147 seq_num 478) dirty exists 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1371: left oid 9 (ObjNum 478 snap 147 seq_num 478) 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1372: finishing rollback tid 0 to trial08226312-31 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1372: finishing rollback tid 1 to trial08226312-31 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1372: finishing rollback tid 2 to trial08226312-31 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 287 (ObjNum 227 snap 61 seq_num 227) dirty exists 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1371: done (2 left) 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1372: done (1 left) 2026-02-12T17:34:45.158 INFO:tasks.rados.rados.0.trial082.stdout:1374: write (excl) oid 31 current snap is 147 2026-02-12T17:34:45.159 INFO:tasks.rados.rados.0.trial082.stdout:1374: seq_num 479 ranges {450553=574510,1613463=437090} 2026-02-12T17:34:45.160 INFO:tasks.rados.rados.0.trial082.stdout:1374: writing trial08226312-31 from 450553 to 1025063 tid 1 2026-02-12T17:34:45.164 INFO:tasks.rados.rados.0.trial082.stdout:1374: writing trial08226312-31 from 1613463 to 2050553 tid 2 2026-02-12T17:34:45.164 INFO:tasks.rados.rados.0.trial082.stdout:1375: snap_remove snap 140 2026-02-12T17:34:46.058 INFO:tasks.rados.rados.0.trial082.stdout:1375: done (2 left) 2026-02-12T17:34:46.058 INFO:tasks.rados.rados.0.trial082.stdout:1376: delete oid 25 current snap is 147 2026-02-12T17:34:46.058 INFO:tasks.rados.rados.0.trial082.stdout:1374: finishing write tid 1 to trial08226312-31 2026-02-12T17:34:46.058 INFO:tasks.rados.rados.0.trial082.stdout:1373: finishing copy_from racing read to trial08226312-26 2026-02-12T17:34:46.058 INFO:tasks.rados.rados.0.trial082.stdout:1374: finishing write tid 2 to trial08226312-31 2026-02-12T17:34:46.058 INFO:tasks.rados.rados.0.trial082.stdout:1374: finishing write tid 3 to trial08226312-31 2026-02-12T17:34:46.058 INFO:tasks.rados.rados.0.trial082.stdout:1374: finishing write tid 4 to trial08226312-31 2026-02-12T17:34:46.059 INFO:tasks.rados.rados.0.trial082.stdout:1374: oid 31 updating version 0 to 290 2026-02-12T17:34:46.059 INFO:tasks.rados.rados.0.trial082.stdout:1374: oid 31 version 290 is already newer than 289 2026-02-12T17:34:46.059 INFO:tasks.rados.rados.0.trial082.stdout:1374: oid 31 version 290 is already newer than 288 2026-02-12T17:34:46.059 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 290 (ObjNum 479 snap 147 seq_num 479) dirty exists 2026-02-12T17:34:46.059 INFO:tasks.rados.rados.0.trial082.stdout:1374: left oid 31 (ObjNum 479 snap 147 seq_num 479) 2026-02-12T17:34:46.059 INFO:tasks.rados.rados.0.trial082.stdout:1373: finishing copy_from to trial08226312-26 2026-02-12T17:34:46.059 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 832 (ObjNum 463 snap 145 seq_num 463) dirty exists 2026-02-12T17:34:46.065 INFO:tasks.rados.rados.0.trial082.stdout:1373: done (2 left) 2026-02-12T17:34:46.065 INFO:tasks.rados.rados.0.trial082.stdout:1374: done (1 left) 2026-02-12T17:34:46.065 INFO:tasks.rados.rados.0.trial082.stdout:1376: done (0 left) 2026-02-12T17:34:46.065 INFO:tasks.rados.rados.0.trial082.stdout:1377: write (excl) oid 44 current snap is 147 2026-02-12T17:34:46.065 INFO:tasks.rados.rados.0.trial082.stdout:1377: seq_num 481 ranges {484167=725008,1730427=353740} 2026-02-12T17:34:46.069 INFO:tasks.rados.rados.0.trial082.stdout:1377: writing trial08226312-44 from 484167 to 1209175 tid 1 2026-02-12T17:34:46.072 INFO:tasks.rados.rados.0.trial082.stdout:1377: writing trial08226312-44 from 1730427 to 2084167 tid 2 2026-02-12T17:34:46.073 INFO:tasks.rados.rados.0.trial082.stdout:1378: write oid 47 current snap is 147 2026-02-12T17:34:46.073 INFO:tasks.rados.rados.0.trial082.stdout:1378: seq_num 482 ranges {500974=400257,1388909=557169} 2026-02-12T17:34:46.076 INFO:tasks.rados.rados.0.trial082.stdout:1378: writing trial08226312-47 from 500974 to 901231 tid 1 2026-02-12T17:34:46.080 INFO:tasks.rados.rados.0.trial082.stdout:1378: writing trial08226312-47 from 1388909 to 1946078 tid 2 2026-02-12T17:34:46.080 INFO:tasks.rados.rados.0.trial082.stdout:1379: snap_remove snap 145 2026-02-12T17:34:47.058 INFO:tasks.rados.rados.0.trial082.stdout:1379: done (2 left) 2026-02-12T17:34:47.059 INFO:tasks.rados.rados.0.trial082.stdout:1380: snap_remove snap 128 2026-02-12T17:34:48.041 INFO:tasks.rados.rados.0.trial082.stdout:1380: done (2 left) 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1381: copy_from oid 48 from oid 32 current snap is 147 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1377: finishing write tid 1 to trial08226312-44 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1377: finishing write tid 2 to trial08226312-44 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1377: finishing write tid 3 to trial08226312-44 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1377: finishing write tid 4 to trial08226312-44 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1377: oid 44 updating version 0 to 833 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1377: oid 44 updating version 833 to 834 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1377: oid 44 updating version 834 to 835 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 835 (ObjNum 481 snap 147 seq_num 481) dirty exists 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1377: left oid 44 (ObjNum 481 snap 147 seq_num 481) 2026-02-12T17:34:48.042 INFO:tasks.rados.rados.0.trial082.stdout:1378: finishing write tid 1 to trial08226312-47 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:1377: done (2 left) 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:1382: snap_create 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:1378: finishing write tid 2 to trial08226312-47 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:1378: finishing write tid 3 to trial08226312-47 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:1378: finishing write tid 4 to trial08226312-47 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:1378: oid 47 updating version 0 to 985 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:1378: oid 47 updating version 985 to 987 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:1378: oid 47 version 987 is already newer than 986 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 987 (ObjNum 482 snap 147 seq_num 482) dirty exists 2026-02-12T17:34:48.043 INFO:tasks.rados.rados.0.trial082.stdout:1378: left oid 47 (ObjNum 482 snap 147 seq_num 482) 2026-02-12T17:34:48.051 INFO:tasks.rados.rados.0.trial082.stdout:1381: finishing copy_from racing read to trial08226312-48 2026-02-12T17:34:48.051 INFO:tasks.rados.rados.0.trial082.stdout:1381: finishing copy_from to trial08226312-48 2026-02-12T17:34:48.052 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 804 (ObjNum 429 snap 134 seq_num 429) dirty exists 2026-02-12T17:34:49.041 INFO:tasks.rados.rados.0.trial082.stdout:1378: done (2 left) 2026-02-12T17:34:49.041 INFO:tasks.rados.rados.0.trial082.stdout:1381: done (1 left) 2026-02-12T17:34:49.041 INFO:tasks.rados.rados.0.trial082.stdout:1382: done (0 left) 2026-02-12T17:34:49.041 INFO:tasks.rados.rados.0.trial082.stdout:1383: write (excl) oid 42 current snap is 148 2026-02-12T17:34:49.041 INFO:tasks.rados.rados.0.trial082.stdout:1383: seq_num 483 ranges {517781=475506,1731038=386743} 2026-02-12T17:34:49.045 INFO:tasks.rados.rados.0.trial082.stdout:1383: writing trial08226312-42 from 517781 to 993287 tid 1 2026-02-12T17:34:49.049 INFO:tasks.rados.rados.0.trial082.stdout:1383: writing trial08226312-42 from 1731038 to 2117781 tid 2 2026-02-12T17:34:49.049 INFO:tasks.rados.rados.0.trial082.stdout:1384: snap_remove snap 147 2026-02-12T17:34:50.042 INFO:tasks.rados.rados.0.trial082.stdout:1384: done (1 left) 2026-02-12T17:34:50.042 INFO:tasks.rados.rados.0.trial082.stdout:1385: snap_create 2026-02-12T17:34:50.042 INFO:tasks.rados.rados.0.trial082.stdout:1383: finishing write tid 1 to trial08226312-42 2026-02-12T17:34:50.042 INFO:tasks.rados.rados.0.trial082.stdout:1383: finishing write tid 2 to trial08226312-42 2026-02-12T17:34:50.042 INFO:tasks.rados.rados.0.trial082.stdout:1383: finishing write tid 3 to trial08226312-42 2026-02-12T17:34:50.042 INFO:tasks.rados.rados.0.trial082.stdout:1383: finishing write tid 4 to trial08226312-42 2026-02-12T17:34:50.043 INFO:tasks.rados.rados.0.trial082.stdout:1383: oid 42 updating version 0 to 868 2026-02-12T17:34:50.043 INFO:tasks.rados.rados.0.trial082.stdout:1383: oid 42 version 868 is already newer than 867 2026-02-12T17:34:50.043 INFO:tasks.rados.rados.0.trial082.stdout:1383: oid 42 version 868 is already newer than 866 2026-02-12T17:34:50.043 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 868 (ObjNum 483 snap 148 seq_num 483) dirty exists 2026-02-12T17:34:50.043 INFO:tasks.rados.rados.0.trial082.stdout:1383: left oid 42 (ObjNum 483 snap 148 seq_num 483) 2026-02-12T17:34:51.042 INFO:tasks.rados.rados.0.trial082.stdout:1383: done (1 left) 2026-02-12T17:34:51.043 INFO:tasks.rados.rados.0.trial082.stdout:1385: done (0 left) 2026-02-12T17:34:51.043 INFO:tasks.rados.rados.0.trial082.stdout:1386: copy_from oid 25 from oid 2 current snap is 149 2026-02-12T17:34:51.043 INFO:tasks.rados.rados.0.trial082.stdout:1387: write oid 49 current snap is 149 2026-02-12T17:34:51.043 INFO:tasks.rados.rados.0.trial082.stdout:1387: seq_num 484 ranges {534588=550755,1789520=345068} 2026-02-12T17:34:51.047 INFO:tasks.rados.rados.0.trial082.stdout:1387: writing trial08226312-49 from 534588 to 1085343 tid 1 2026-02-12T17:34:51.052 INFO:tasks.rados.rados.0.trial082.stdout:1387: writing trial08226312-49 from 1789520 to 2134588 tid 2 2026-02-12T17:34:51.052 INFO:tasks.rados.rados.0.trial082.stdout:1388: read oid 1 snap -1 2026-02-12T17:34:51.052 INFO:tasks.rados.rados.0.trial082.stdout:1388: expect (ObjNum 409 snap 122 seq_num 409) 2026-02-12T17:34:51.052 INFO:tasks.rados.rados.0.trial082.stdout:1389: snap_create 2026-02-12T17:34:51.052 INFO:tasks.rados.rados.0.trial082.stdout:1387: finishing write tid 1 to trial08226312-49 2026-02-12T17:34:51.052 INFO:tasks.rados.rados.0.trial082.stdout:1386: finishing copy_from racing read to trial08226312-25 2026-02-12T17:34:51.053 INFO:tasks.rados.rados.0.trial082.stdout:1386: finishing copy_from to trial08226312-25 2026-02-12T17:34:51.053 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 283 (ObjNum 385 snap 113 seq_num 385) dirty exists 2026-02-12T17:34:51.053 INFO:tasks.rados.rados.0.trial082.stdout:1387: finishing write tid 2 to trial08226312-49 2026-02-12T17:34:51.053 INFO:tasks.rados.rados.0.trial082.stdout:1387: finishing write tid 3 to trial08226312-49 2026-02-12T17:34:51.053 INFO:tasks.rados.rados.0.trial082.stdout:1387: finishing write tid 4 to trial08226312-49 2026-02-12T17:34:51.054 INFO:tasks.rados.rados.0.trial082.stdout:1387: oid 49 updating version 0 to 806 2026-02-12T17:34:51.054 INFO:tasks.rados.rados.0.trial082.stdout:1387: oid 49 updating version 806 to 807 2026-02-12T17:34:51.054 INFO:tasks.rados.rados.0.trial082.stdout:1387: oid 49 updating version 807 to 808 2026-02-12T17:34:51.054 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 808 (ObjNum 484 snap 149 seq_num 484) dirty exists 2026-02-12T17:34:51.054 INFO:tasks.rados.rados.0.trial082.stdout:1387: left oid 49 (ObjNum 484 snap 149 seq_num 484) 2026-02-12T17:34:51.054 INFO:tasks.rados.rados.0.trial082.stdout:1388: expect (ObjNum 409 snap 122 seq_num 409) 2026-02-12T17:34:51.055 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:52.046 INFO:tasks.rados.rados.0.trial082.stdout:1386: done (3 left) 2026-02-12T17:34:52.047 INFO:tasks.rados.rados.0.trial082.stdout:1387: done (2 left) 2026-02-12T17:34:52.047 INFO:tasks.rados.rados.0.trial082.stdout:1388: done (1 left) 2026-02-12T17:34:52.047 INFO:tasks.rados.rados.0.trial082.stdout:1389: done (0 left) 2026-02-12T17:34:52.047 INFO:tasks.rados.rados.0.trial082.stdout:1390: snap_create 2026-02-12T17:34:53.040 INFO:tasks.rados.rados.0.trial082.stdout:1390: done (0 left) 2026-02-12T17:34:53.040 INFO:tasks.rados.rados.0.trial082.stdout:1391: delete oid 28 current snap is 151 2026-02-12T17:34:53.043 INFO:tasks.rados.rados.0.trial082.stdout:1391: done (0 left) 2026-02-12T17:34:53.043 INFO:tasks.rados.rados.0.trial082.stdout:1392: snap_remove snap 121 2026-02-12T17:34:54.042 INFO:tasks.rados.rados.0.trial082.stdout:1392: done (0 left) 2026-02-12T17:34:54.042 INFO:tasks.rados.rados.0.trial082.stdout:1393: rollback oid 24 current snap is 151 2026-02-12T17:34:54.042 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 143 2026-02-12T17:34:54.042 INFO:tasks.rados.rados.0.trial082.stdout:1394: read oid 46 snap -1 2026-02-12T17:34:54.042 INFO:tasks.rados.rados.0.trial082.stdout:1394: expect (ObjNum 408 snap 122 seq_num 408) 2026-02-12T17:34:54.042 INFO:tasks.rados.rados.0.trial082.stdout:1395: copy_from oid 21 from oid 27 current snap is 151 2026-02-12T17:34:54.042 INFO:tasks.rados.rados.0.trial082.stdout:1396: delete oid 22 current snap is 151 2026-02-12T17:34:54.047 INFO:tasks.rados.rados.0.trial082.stdout:1394: expect (ObjNum 408 snap 122 seq_num 408) 2026-02-12T17:34:54.130 INFO:tasks.rados.rados.0.trial082.stdout:1395: finishing copy_from racing read to trial08226312-21 2026-02-12T17:34:54.130 INFO:tasks.rados.rados.0.trial082.stdout:1395: finishing copy_from to trial08226312-21 2026-02-12T17:34:54.130 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 284 (ObjNum 452 snap 142 seq_num 452) dirty exists 2026-02-12T17:34:54.130 INFO:tasks.rados.rados.0.trial082.stdout:1393: finishing rollback tid 0 to trial08226312-24 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1394: done (3 left) 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1395: done (2 left) 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1396: done (1 left) 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1397: rollback oid 16 current snap is 151 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 142 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1393: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1393: finishing rollback tid 2 to trial08226312-24 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1013 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1393: done (1 left) 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1398: read oid 10 snap -1 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1398: expect (ObjNum 441 snap 137 seq_num 441) 2026-02-12T17:34:54.131 INFO:tasks.rados.rados.0.trial082.stdout:1399: read oid 40 snap -1 2026-02-12T17:34:54.132 INFO:tasks.rados.rados.0.trial082.stdout:1399: expect (ObjNum 460 snap 143 seq_num 460) 2026-02-12T17:34:54.132 INFO:tasks.rados.rados.0.trial082.stdout:1400: write (excl) oid 3 current snap is 151 2026-02-12T17:34:54.132 INFO:tasks.rados.rados.0.trial082.stdout:1400: seq_num 487 ranges {585009=492855,1564966=620043} 2026-02-12T17:34:54.133 INFO:tasks.rados.rados.0.trial082.stdout:1400: writing trial08226312-3 from 585009 to 1077864 tid 1 2026-02-12T17:34:54.138 INFO:tasks.rados.rados.0.trial082.stdout:1400: writing trial08226312-3 from 1564966 to 2185009 tid 2 2026-02-12T17:34:54.138 INFO:tasks.rados.rados.0.trial082.stdout:1401: read oid 19 snap -1 2026-02-12T17:34:54.138 INFO:tasks.rados.rados.0.trial082.stdout:1401: expect (ObjNum 466 snap 146 seq_num 466) 2026-02-12T17:34:54.138 INFO:tasks.rados.rados.0.trial082.stdout:1402: snap_create 2026-02-12T17:34:54.138 INFO:tasks.rados.rados.0.trial082.stdout:1398: expect (ObjNum 441 snap 137 seq_num 441) 2026-02-12T17:34:54.138 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:54.189 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1382314 2026-02-12T17:34:54.206 INFO:tasks.rados.rados.0.trial082.stdout:1397: finishing rollback tid 0 to trial08226312-16 2026-02-12T17:34:54.206 INFO:tasks.rados.rados.0.trial082.stdout:1399: expect (ObjNum 460 snap 143 seq_num 460) 2026-02-12T17:34:54.313 INFO:tasks.rados.rados.0.trial082.stdout:1397: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:34:54.313 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 882 (ObjNum 1201 snap 0 seq_num 26842832) dirty dne 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:1400: finishing write tid 1 to trial08226312-3 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:1400: finishing write tid 2 to trial08226312-3 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:1400: finishing write tid 3 to trial08226312-3 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:1400: finishing write tid 4 to trial08226312-3 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:1400: oid 3 updating version 0 to 831 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:1400: oid 3 updating version 831 to 832 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:1400: oid 3 updating version 832 to 833 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 833 (ObjNum 487 snap 151 seq_num 487) dirty exists 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:1400: left oid 3 (ObjNum 487 snap 151 seq_num 487) 2026-02-12T17:34:54.314 INFO:tasks.rados.rados.0.trial082.stdout:1401: expect (ObjNum 466 snap 146 seq_num 466) 2026-02-12T17:34:54.386 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 915927 2026-02-12T17:34:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1397: done (5 left) 2026-02-12T17:34:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1398: done (4 left) 2026-02-12T17:34:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1399: done (3 left) 2026-02-12T17:34:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1400: done (2 left) 2026-02-12T17:34:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1401: done (1 left) 2026-02-12T17:34:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1402: done (0 left) 2026-02-12T17:34:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1403: read oid 48 snap -1 2026-02-12T17:34:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1403: expect (ObjNum 429 snap 134 seq_num 429) 2026-02-12T17:34:55.051 INFO:tasks.rados.rados.0.trial082.stdout:1404: read oid 5 snap -1 2026-02-12T17:34:55.052 INFO:tasks.rados.rados.0.trial082.stdout:1404: expect (ObjNum 423 snap 131 seq_num 423) 2026-02-12T17:34:55.052 INFO:tasks.rados.rados.0.trial082.stdout:1405: snap_remove snap 142 2026-02-12T17:34:56.053 INFO:tasks.rados.rados.0.trial082.stdout:1405: done (2 left) 2026-02-12T17:34:56.053 INFO:tasks.rados.rados.0.trial082.stdout:1406: snap_remove snap 146 2026-02-12T17:34:57.054 INFO:tasks.rados.rados.0.trial082.stdout:1406: done (2 left) 2026-02-12T17:34:57.054 INFO:tasks.rados.rados.0.trial082.stdout:1407: snap_create 2026-02-12T17:34:57.055 INFO:tasks.rados.rados.0.trial082.stdout:1404: expect (ObjNum 423 snap 131 seq_num 423) 2026-02-12T17:34:57.187 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2220715 2026-02-12T17:34:57.205 INFO:tasks.rados.rados.0.trial082.stdout:1403: expect (ObjNum 429 snap 134 seq_num 429) 2026-02-12T17:34:57.205 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:34:58.042 INFO:tasks.rados.rados.0.trial082.stdout:1403: done (2 left) 2026-02-12T17:34:58.042 INFO:tasks.rados.rados.0.trial082.stdout:1404: done (1 left) 2026-02-12T17:34:58.042 INFO:tasks.rados.rados.0.trial082.stdout:1407: done (0 left) 2026-02-12T17:34:58.042 INFO:tasks.rados.rados.0.trial082.stdout:1408: copy_from oid 30 from oid 35 current snap is 153 2026-02-12T17:34:58.042 INFO:tasks.rados.rados.0.trial082.stdout:1409: copy_from oid 4 from oid 40 current snap is 153 2026-02-12T17:34:58.042 INFO:tasks.rados.rados.0.trial082.stdout:1410: read oid 3 snap -1 2026-02-12T17:34:58.042 INFO:tasks.rados.rados.0.trial082.stdout:1410: expect (ObjNum 487 snap 151 seq_num 487) 2026-02-12T17:34:58.042 INFO:tasks.rados.rados.0.trial082.stdout:1411: snap_remove snap 152 2026-02-12T17:34:59.043 INFO:tasks.rados.rados.0.trial082.stdout:1411: done (3 left) 2026-02-12T17:34:59.044 INFO:tasks.rados.rados.0.trial082.stdout:1412: read oid 8 snap 151 2026-02-12T17:34:59.044 INFO:tasks.rados.rados.0.trial082.stdout:1412: expect (ObjNum 473 snap 146 seq_num 473) 2026-02-12T17:34:59.044 INFO:tasks.rados.rados.0.trial082.stdout:1413: read oid 27 snap -1 2026-02-12T17:34:59.044 INFO:tasks.rados.rados.0.trial082.stdout:1413: expect (ObjNum 452 snap 142 seq_num 452) 2026-02-12T17:34:59.044 INFO:tasks.rados.rados.0.trial082.stdout:1414: write oid 38 current snap is 153 2026-02-12T17:34:59.044 INFO:tasks.rados.rados.0.trial082.stdout:1414: seq_num 488 ranges {601816=568104,1623448=451823} 2026-02-12T17:34:59.048 INFO:tasks.rados.rados.0.trial082.stdout:1414: writing trial08226312-38 from 601816 to 1169920 tid 1 2026-02-12T17:34:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1414: writing trial08226312-38 from 1623448 to 2075271 tid 2 2026-02-12T17:34:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1415: copy_from oid 48 from oid 16 current snap is 153 2026-02-12T17:34:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1408: finishing copy_from to trial08226312-30 2026-02-12T17:34:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1408: got expected ENOENT (src dne) 2026-02-12T17:34:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1408: finishing copy_from racing read to trial08226312-30 2026-02-12T17:34:59.052 INFO:tasks.rados.rados.0.trial082.stdout:1410: expect (ObjNum 487 snap 151 seq_num 487) 2026-02-12T17:34:59.117 INFO:tasks.rados.rados.0.trial082.stdout:1409: finishing copy_from racing read to trial08226312-4 2026-02-12T17:34:59.118 INFO:tasks.rados.rados.0.trial082.stdout:1408: done (6 left) 2026-02-12T17:34:59.118 INFO:tasks.rados.rados.0.trial082.stdout:1410: done (5 left) 2026-02-12T17:34:59.118 INFO:tasks.rados.rados.0.trial082.stdout:1416: write (excl) oid 5 current snap is 153 2026-02-12T17:34:59.118 INFO:tasks.rados.rados.0.trial082.stdout:1409: finishing copy_from to trial08226312-4 2026-02-12T17:34:59.118 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 804 (ObjNum 460 snap 143 seq_num 460) dirty exists 2026-02-12T17:34:59.118 INFO:tasks.rados.rados.0.trial082.stdout:1413: expect (ObjNum 452 snap 142 seq_num 452) 2026-02-12T17:34:59.144 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 473937 2026-02-12T17:34:59.192 INFO:tasks.rados.rados.0.trial082.stdout:1414: finishing write tid 1 to trial08226312-38 2026-02-12T17:34:59.192 INFO:tasks.rados.rados.0.trial082.stdout:1416: seq_num 489 ranges {618623=643353,1681930=536693} 2026-02-12T17:34:59.197 INFO:tasks.rados.rados.0.trial082.stdout:1416: writing trial08226312-5 from 618623 to 1261976 tid 1 2026-02-12T17:34:59.200 INFO:tasks.rados.rados.0.trial082.stdout:1416: writing trial08226312-5 from 1681930 to 2218623 tid 2 2026-02-12T17:34:59.201 INFO:tasks.rados.rados.0.trial082.stdout:1409: done (5 left) 2026-02-12T17:34:59.201 INFO:tasks.rados.rados.0.trial082.stdout:1413: done (4 left) 2026-02-12T17:34:59.201 INFO:tasks.rados.rados.0.trial082.stdout:1417: write oid 2 current snap is 153 2026-02-12T17:34:59.201 INFO:tasks.rados.rados.0.trial082.stdout:1417: seq_num 490 ranges {635430=718602,2140412=95018} 2026-02-12T17:34:59.205 INFO:tasks.rados.rados.0.trial082.stdout:1417: writing trial08226312-2 from 635430 to 1354032 tid 1 2026-02-12T17:34:59.209 INFO:tasks.rados.rados.0.trial082.stdout:1417: writing trial08226312-2 from 2140412 to 2235430 tid 2 2026-02-12T17:34:59.209 INFO:tasks.rados.rados.0.trial082.stdout:1418: snap_remove snap 139 2026-02-12T17:35:00.063 INFO:tasks.rados.rados.0.trial082.stdout:1418: done (5 left) 2026-02-12T17:35:00.064 INFO:tasks.rados.rados.0.trial082.stdout:1419: write (excl) oid 21 current snap is 153 2026-02-12T17:35:00.064 INFO:tasks.rados.rados.0.trial082.stdout:1419: seq_num 491 ranges {652237=793851,2198894=53343} 2026-02-12T17:35:00.069 INFO:tasks.rados.rados.0.trial082.stdout:1419: writing trial08226312-21 from 652237 to 1446088 tid 1 2026-02-12T17:35:00.072 INFO:tasks.rados.rados.0.trial082.stdout:1419: writing trial08226312-21 from 2198894 to 2252237 tid 2 2026-02-12T17:35:00.072 INFO:tasks.rados.rados.0.trial082.stdout:1420: write (excl) oid 46 current snap is 153 2026-02-12T17:35:00.072 INFO:tasks.rados.rados.0.trial082.stdout:1420: seq_num 492 ranges {669044=469100,1741023=459161} 2026-02-12T17:35:00.076 INFO:tasks.rados.rados.0.trial082.stdout:1420: writing trial08226312-46 from 669044 to 1138144 tid 1 2026-02-12T17:35:00.080 INFO:tasks.rados.rados.0.trial082.stdout:1420: writing trial08226312-46 from 1741023 to 2200184 tid 2 2026-02-12T17:35:00.080 INFO:tasks.rados.rados.0.trial082.stdout:1421: read oid 20 snap -1 2026-02-12T17:35:00.081 INFO:tasks.rados.rados.0.trial082.stdout:1421: expect (ObjNum 416 snap 127 seq_num 416) 2026-02-12T17:35:00.081 INFO:tasks.rados.rados.0.trial082.stdout:1422: delete oid 50 current snap is 153 2026-02-12T17:35:00.081 INFO:tasks.rados.rados.0.trial082.stdout:1412: expect (ObjNum 473 snap 146 seq_num 473) 2026-02-12T17:35:00.081 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:00.193 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:00.251 INFO:tasks.rados.rados.0.trial082.stdout:1415: finishing copy_from to trial08226312-48 2026-02-12T17:35:00.251 INFO:tasks.rados.rados.0.trial082.stdout:1415: got expected ENOENT (src dne) 2026-02-12T17:35:00.251 INFO:tasks.rados.rados.0.trial082.stdout:1415: finishing copy_from racing read to trial08226312-48 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1414: finishing write tid 2 to trial08226312-38 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1414: finishing write tid 3 to trial08226312-38 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1414: finishing write tid 4 to trial08226312-38 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1414: oid 38 updating version 0 to 808 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1414: oid 38 updating version 808 to 809 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1414: oid 38 updating version 809 to 810 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 810 (ObjNum 488 snap 153 seq_num 488) dirty exists 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1414: left oid 38 (ObjNum 488 snap 153 seq_num 488) 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1416: finishing write tid 1 to trial08226312-5 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1412: done (8 left) 2026-02-12T17:35:00.252 INFO:tasks.rados.rados.0.trial082.stdout:1414: done (7 left) 2026-02-12T17:35:00.253 INFO:tasks.rados.rados.0.trial082.stdout:1415: done (6 left) 2026-02-12T17:35:00.253 INFO:tasks.rados.rados.0.trial082.stdout:1422: done (5 left) 2026-02-12T17:35:00.253 INFO:tasks.rados.rados.0.trial082.stdout:1423: snap_remove snap 136 2026-02-12T17:35:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1423: done (5 left) 2026-02-12T17:35:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1424: copy_from oid 30 from oid 35 current snap is 153 2026-02-12T17:35:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1416: finishing write tid 2 to trial08226312-5 2026-02-12T17:35:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1416: finishing write tid 3 to trial08226312-5 2026-02-12T17:35:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1416: finishing write tid 4 to trial08226312-5 2026-02-12T17:35:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1416: oid 5 updating version 0 to 835 2026-02-12T17:35:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1416: oid 5 updating version 835 to 836 2026-02-12T17:35:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1416: oid 5 version 836 is already newer than 834 2026-02-12T17:35:01.069 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 836 (ObjNum 489 snap 153 seq_num 489) dirty exists 2026-02-12T17:35:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1416: left oid 5 (ObjNum 489 snap 153 seq_num 489) 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1417: finishing write tid 1 to trial08226312-2 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1417: finishing write tid 2 to trial08226312-2 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1417: finishing write tid 3 to trial08226312-2 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1417: finishing write tid 4 to trial08226312-2 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1417: oid 2 updating version 0 to 286 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1417: oid 2 updating version 286 to 287 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1417: oid 2 version 287 is already newer than 285 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 287 (ObjNum 490 snap 153 seq_num 490) dirty exists 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1417: left oid 2 (ObjNum 490 snap 153 seq_num 490) 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1419: finishing write tid 1 to trial08226312-21 2026-02-12T17:35:01.070 INFO:tasks.rados.rados.0.trial082.stdout:1419: finishing write tid 2 to trial08226312-21 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1419: finishing write tid 3 to trial08226312-21 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1419: finishing write tid 4 to trial08226312-21 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1419: oid 21 updating version 0 to 836 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1419: oid 21 version 836 is already newer than 835 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1419: oid 21 updating version 836 to 837 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 837 (ObjNum 491 snap 153 seq_num 491) dirty exists 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1419: left oid 21 (ObjNum 491 snap 153 seq_num 491) 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1420: finishing write tid 1 to trial08226312-46 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1416: done (5 left) 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1417: done (4 left) 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1419: done (3 left) 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1425: rollback oid 4 current snap is 153 2026-02-12T17:35:01.071 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 4 to 143 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1420: finishing write tid 2 to trial08226312-46 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1420: finishing write tid 3 to trial08226312-46 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1420: finishing write tid 4 to trial08226312-46 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1420: oid 46 updating version 0 to 460 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1420: oid 46 version 460 is already newer than 459 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1420: oid 46 updating version 460 to 461 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 461 (ObjNum 492 snap 153 seq_num 492) dirty exists 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1420: left oid 46 (ObjNum 492 snap 153 seq_num 492) 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1421: expect (ObjNum 416 snap 127 seq_num 416) 2026-02-12T17:35:01.072 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:01.089 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:01.125 INFO:tasks.rados.rados.0.trial082.stdout:1424: finishing copy_from to trial08226312-30 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1424: got expected ENOENT (src dne) 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1424: finishing copy_from racing read to trial08226312-30 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1425: finishing rollback tid 0 to trial08226312-4 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1425: finishing rollback tid 1 to trial08226312-4 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1425: finishing rollback tid 2 to trial08226312-4 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 1052 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1420: done (3 left) 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1421: done (2 left) 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1424: done (1 left) 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1425: done (0 left) 2026-02-12T17:35:01.126 INFO:tasks.rados.rados.0.trial082.stdout:1426: read oid 26 snap -1 2026-02-12T17:35:01.127 INFO:tasks.rados.rados.0.trial082.stdout:1426: expect (ObjNum 463 snap 145 seq_num 463) 2026-02-12T17:35:01.127 INFO:tasks.rados.rados.0.trial082.stdout:1427: write (excl) oid 42 current snap is 153 2026-02-12T17:35:01.127 INFO:tasks.rados.rados.0.trial082.stdout:1427: seq_num 494 ranges {702658=619598,1857987=444671} 2026-02-12T17:35:01.130 INFO:tasks.rados.rados.0.trial082.stdout:1427: writing trial08226312-42 from 702658 to 1322256 tid 1 2026-02-12T17:35:01.133 INFO:tasks.rados.rados.0.trial082.stdout:1427: writing trial08226312-42 from 1857987 to 2302658 tid 2 2026-02-12T17:35:01.134 INFO:tasks.rados.rados.0.trial082.stdout:1428: rollback oid 21 current snap is 153 2026-02-12T17:35:01.134 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 150 2026-02-12T17:35:01.134 INFO:tasks.rados.rados.0.trial082.stdout:1426: expect (ObjNum 463 snap 145 seq_num 463) 2026-02-12T17:35:01.254 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1048617 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:1427: finishing write tid 1 to trial08226312-42 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:1426: done (2 left) 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:1429: delete oid 25 current snap is 153 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:1428: finishing rollback tid 0 to trial08226312-21 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:1428: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 839 (ObjNum 65 snap 0 seq_num 27022864) dirty dne 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:1427: finishing write tid 2 to trial08226312-42 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:1427: finishing write tid 3 to trial08226312-42 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:1427: finishing write tid 4 to trial08226312-42 2026-02-12T17:35:01.309 INFO:tasks.rados.rados.0.trial082.stdout:1427: oid 42 updating version 0 to 908 2026-02-12T17:35:01.310 INFO:tasks.rados.rados.0.trial082.stdout:1427: oid 42 updating version 908 to 909 2026-02-12T17:35:01.310 INFO:tasks.rados.rados.0.trial082.stdout:1427: oid 42 updating version 909 to 910 2026-02-12T17:35:01.310 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 910 (ObjNum 494 snap 153 seq_num 494) dirty exists 2026-02-12T17:35:01.310 INFO:tasks.rados.rados.0.trial082.stdout:1427: left oid 42 (ObjNum 494 snap 153 seq_num 494) 2026-02-12T17:35:01.311 INFO:tasks.rados.rados.0.trial082.stdout:1427: done (2 left) 2026-02-12T17:35:01.311 INFO:tasks.rados.rados.0.trial082.stdout:1428: done (1 left) 2026-02-12T17:35:01.311 INFO:tasks.rados.rados.0.trial082.stdout:1429: done (0 left) 2026-02-12T17:35:01.311 INFO:tasks.rados.rados.0.trial082.stdout:1430: read oid 46 snap -1 2026-02-12T17:35:01.311 INFO:tasks.rados.rados.0.trial082.stdout:1430: expect (ObjNum 492 snap 153 seq_num 492) 2026-02-12T17:35:01.311 INFO:tasks.rados.rados.0.trial082.stdout:1431: write oid 43 current snap is 153 2026-02-12T17:35:01.311 INFO:tasks.rados.rados.0.trial082.stdout:1431: seq_num 496 ranges {736272=486449,1974951=361321} 2026-02-12T17:35:01.314 INFO:tasks.rados.rados.0.trial082.stdout:1431: writing trial08226312-43 from 736272 to 1222721 tid 1 2026-02-12T17:35:01.319 INFO:tasks.rados.rados.0.trial082.stdout:1431: writing trial08226312-43 from 1974951 to 2336272 tid 2 2026-02-12T17:35:01.319 INFO:tasks.rados.rados.0.trial082.stdout:1432: snap_create 2026-02-12T17:35:01.319 INFO:tasks.rados.rados.0.trial082.stdout:1430: expect (ObjNum 492 snap 153 seq_num 492) 2026-02-12T17:35:01.402 INFO:tasks.rados.rados.0.trial082.stdout:1431: finishing write tid 1 to trial08226312-43 2026-02-12T17:35:01.402 INFO:tasks.rados.rados.0.trial082.stdout:1431: finishing write tid 2 to trial08226312-43 2026-02-12T17:35:01.402 INFO:tasks.rados.rados.0.trial082.stdout:1431: finishing write tid 3 to trial08226312-43 2026-02-12T17:35:01.402 INFO:tasks.rados.rados.0.trial082.stdout:1431: finishing write tid 4 to trial08226312-43 2026-02-12T17:35:01.402 INFO:tasks.rados.rados.0.trial082.stdout:1431: oid 43 updating version 0 to 841 2026-02-12T17:35:01.402 INFO:tasks.rados.rados.0.trial082.stdout:1431: oid 43 version 841 is already newer than 840 2026-02-12T17:35:01.403 INFO:tasks.rados.rados.0.trial082.stdout:1431: oid 43 updating version 841 to 842 2026-02-12T17:35:01.403 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 842 (ObjNum 496 snap 153 seq_num 496) dirty exists 2026-02-12T17:35:01.403 INFO:tasks.rados.rados.0.trial082.stdout:1431: left oid 43 (ObjNum 496 snap 153 seq_num 496) 2026-02-12T17:35:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1430: done (2 left) 2026-02-12T17:35:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1431: done (1 left) 2026-02-12T17:35:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1432: done (0 left) 2026-02-12T17:35:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1433: copy_from oid 15 from oid 22 current snap is 154 2026-02-12T17:35:02.073 INFO:tasks.rados.rados.0.trial082.stdout:1434: delete oid 49 current snap is 154 2026-02-12T17:35:02.073 INFO:tasks.rados.rados.0.trial082.stdout:1433: finishing copy_from to trial08226312-15 2026-02-12T17:35:02.073 INFO:tasks.rados.rados.0.trial082.stdout:1433: got expected ENOENT (src dne) 2026-02-12T17:35:02.073 INFO:tasks.rados.rados.0.trial082.stdout:1433: finishing copy_from racing read to trial08226312-15 2026-02-12T17:35:02.074 INFO:tasks.rados.rados.0.trial082.stdout:1433: done (1 left) 2026-02-12T17:35:02.074 INFO:tasks.rados.rados.0.trial082.stdout:1434: done (0 left) 2026-02-12T17:35:02.074 INFO:tasks.rados.rados.0.trial082.stdout:1435: delete oid 5 current snap is 154 2026-02-12T17:35:02.075 INFO:tasks.rados.rados.0.trial082.stdout:1435: done (0 left) 2026-02-12T17:35:02.075 INFO:tasks.rados.rados.0.trial082.stdout:1436: rollback oid 8 current snap is 154 2026-02-12T17:35:02.075 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 143 2026-02-12T17:35:02.075 INFO:tasks.rados.rados.0.trial082.stdout:1437: snap_create 2026-02-12T17:35:02.079 INFO:tasks.rados.rados.0.trial082.stdout:1436: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:35:02.079 INFO:tasks.rados.rados.0.trial082.stdout:1436: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:35:02.079 INFO:tasks.rados.rados.0.trial082.stdout:1436: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:35:02.079 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1068 (ObjNum 308 snap 88 seq_num 308) dirty exists 2026-02-12T17:35:03.043 INFO:tasks.rados.rados.0.trial082.stdout:1436: done (1 left) 2026-02-12T17:35:03.043 INFO:tasks.rados.rados.0.trial082.stdout:1437: done (0 left) 2026-02-12T17:35:03.043 INFO:tasks.rados.rados.0.trial082.stdout:1438: rollback oid 41 current snap is 155 2026-02-12T17:35:03.043 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 138 2026-02-12T17:35:03.043 INFO:tasks.rados.rados.0.trial082.stdout:1439: read oid 30 snap -1 2026-02-12T17:35:03.043 INFO:tasks.rados.rados.0.trial082.stdout:1439: expect (ObjNum 463 snap 145 seq_num 463) 2026-02-12T17:35:03.043 INFO:tasks.rados.rados.0.trial082.stdout:1440: rollback oid 38 current snap is 155 2026-02-12T17:35:03.043 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 149 2026-02-12T17:35:03.044 INFO:tasks.rados.rados.0.trial082.stdout:1441: rollback oid 17 current snap is 155 2026-02-12T17:35:03.044 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 154 2026-02-12T17:35:03.044 INFO:tasks.rados.rados.0.trial082.stdout:1442: read oid 35 snap -1 2026-02-12T17:35:03.044 INFO:tasks.rados.rados.0.trial082.stdout:1442: expect deleted 2026-02-12T17:35:03.044 INFO:tasks.rados.rados.0.trial082.stdout:1443: read oid 13 snap -1 2026-02-12T17:35:03.044 INFO:tasks.rados.rados.0.trial082.stdout:1443: expect deleted 2026-02-12T17:35:03.044 INFO:tasks.rados.rados.0.trial082.stdout:1444: read oid 26 snap 132 2026-02-12T17:35:03.044 INFO:tasks.rados.rados.0.trial082.stdout:1444: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:35:03.044 INFO:tasks.rados.rados.0.trial082.stdout:1445: snap_remove snap 151 2026-02-12T17:35:04.043 INFO:tasks.rados.rados.0.trial082.stdout:1445: done (7 left) 2026-02-12T17:35:04.043 INFO:tasks.rados.rados.0.trial082.stdout:1446: write oid 48 current snap is 155 2026-02-12T17:35:04.043 INFO:tasks.rados.rados.0.trial082.stdout:1446: seq_num 499 ranges {786693=712196,2150397=236296} 2026-02-12T17:35:04.049 INFO:tasks.rados.rados.0.trial082.stdout:1446: writing trial08226312-48 from 786693 to 1498889 tid 1 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:1446: writing trial08226312-48 from 2150397 to 2386693 tid 2 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:1447: copy_from oid 10 from oid 34 current snap is 155 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:1438: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:1438: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:1442: done (8 left) 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:1443: done (7 left) 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:1448: snap_create 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:1438: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 657 (ObjNum 380 snap 113 seq_num 380) dirty exists 2026-02-12T17:35:04.053 INFO:tasks.rados.rados.0.trial082.stdout:1439: expect (ObjNum 463 snap 145 seq_num 463) 2026-02-12T17:35:04.116 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:04.239 INFO:tasks.rados.rados.0.trial082.stdout:1441: finishing rollback tid 0 to trial08226312-17 2026-02-12T17:35:04.239 INFO:tasks.rados.rados.0.trial082.stdout:1441: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:35:04.240 INFO:tasks.rados.rados.0.trial082.stdout:1440: finishing rollback tid 0 to trial08226312-38 2026-02-12T17:35:04.240 INFO:tasks.rados.rados.0.trial082.stdout:1441: finishing rollback tid 2 to trial08226312-17 2026-02-12T17:35:04.240 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 1072 (ObjNum 427 snap 134 seq_num 427) dirty exists 2026-02-12T17:35:04.240 INFO:tasks.rados.rados.0.trial082.stdout:1440: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:35:04.240 INFO:tasks.rados.rados.0.trial082.stdout:1440: finishing rollback tid 2 to trial08226312-38 2026-02-12T17:35:04.240 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 813 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:35:04.240 INFO:tasks.rados.rados.0.trial082.stdout:1444: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:35:04.240 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:04.337 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1749561 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:1446: finishing write tid 1 to trial08226312-48 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:1446: finishing write tid 2 to trial08226312-48 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:1446: finishing write tid 3 to trial08226312-48 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:1446: finishing write tid 4 to trial08226312-48 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:1446: oid 48 updating version 0 to 807 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:1446: oid 48 version 807 is already newer than 805 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:1446: oid 48 version 807 is already newer than 806 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 807 (ObjNum 499 snap 155 seq_num 499) dirty exists 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:1446: left oid 48 (ObjNum 499 snap 155 seq_num 499) 2026-02-12T17:35:04.369 INFO:tasks.rados.rados.0.trial082.stdout:1447: finishing copy_from racing read to trial08226312-10 2026-02-12T17:35:04.370 INFO:tasks.rados.rados.0.trial082.stdout:1447: finishing copy_from to trial08226312-10 2026-02-12T17:35:04.370 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 767 (ObjNum 401 snap 119 seq_num 401) dirty exists 2026-02-12T17:35:05.047 INFO:tasks.rados.rados.0.trial082.stdout:1438: done (7 left) 2026-02-12T17:35:05.047 INFO:tasks.rados.rados.0.trial082.stdout:1439: done (6 left) 2026-02-12T17:35:05.047 INFO:tasks.rados.rados.0.trial082.stdout:1440: done (5 left) 2026-02-12T17:35:05.047 INFO:tasks.rados.rados.0.trial082.stdout:1441: done (4 left) 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:1444: done (3 left) 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:1446: done (2 left) 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:1447: done (1 left) 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:1448: done (0 left) 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:1449: read oid 24 snap -1 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:1449: expect (ObjNum 395 snap 116 seq_num 395) 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:1450: rollback oid 2 current snap is 156 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 155 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:1451: write oid 31 current snap is 156 2026-02-12T17:35:05.048 INFO:tasks.rados.rados.0.trial082.stdout:1451: seq_num 500 ranges {403500=787445,1692526=473837} 2026-02-12T17:35:05.051 INFO:tasks.rados.rados.0.trial082.stdout:1451: writing trial08226312-31 from 403500 to 1190945 tid 1 2026-02-12T17:35:05.055 INFO:tasks.rados.rados.0.trial082.stdout:1451: writing trial08226312-31 from 1692526 to 2166363 tid 2 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1452: read oid 32 snap 149 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1452: expect (ObjNum 429 snap 134 seq_num 429) 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1453: read oid 8 snap -1 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1453: expect (ObjNum 308 snap 88 seq_num 308) 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1454: rollback oid 13 current snap is 156 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 150 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1450: finishing rollback tid 0 to trial08226312-2 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1450: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1455: read oid 40 snap -1 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1455: expect (ObjNum 460 snap 143 seq_num 460) 2026-02-12T17:35:05.056 INFO:tasks.rados.rados.0.trial082.stdout:1456: read oid 37 snap -1 2026-02-12T17:35:05.057 INFO:tasks.rados.rados.0.trial082.stdout:1456: expect (ObjNum 456 snap 143 seq_num 456) 2026-02-12T17:35:05.057 INFO:tasks.rados.rados.0.trial082.stdout:1457: read oid 49 snap 132 2026-02-12T17:35:05.057 INFO:tasks.rados.rados.0.trial082.stdout:1457: expect (ObjNum 372 snap 110 seq_num 372) 2026-02-12T17:35:05.057 INFO:tasks.rados.rados.0.trial082.stdout:1458: write (excl) oid 15 current snap is 156 2026-02-12T17:35:05.057 INFO:tasks.rados.rados.0.trial082.stdout:1450: finishing rollback tid 2 to trial08226312-2 2026-02-12T17:35:05.057 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 297 (ObjNum 490 snap 153 seq_num 490) dirty exists 2026-02-12T17:35:05.057 INFO:tasks.rados.rados.0.trial082.stdout:1449: expect (ObjNum 395 snap 116 seq_num 395) 2026-02-12T17:35:05.079 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:05.107 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:05.134 INFO:tasks.rados.rados.0.trial082.stdout:1451: finishing write tid 1 to trial08226312-31 2026-02-12T17:35:05.134 INFO:tasks.rados.rados.0.trial082.stdout:1458: seq_num 501 ranges {420307=462694,1351008=617495} 2026-02-12T17:35:05.137 INFO:tasks.rados.rados.0.trial082.stdout:1458: writing trial08226312-15 from 420307 to 883001 tid 1 2026-02-12T17:35:05.142 INFO:tasks.rados.rados.0.trial082.stdout:1458: writing trial08226312-15 from 1351008 to 1968503 tid 2 2026-02-12T17:35:05.142 INFO:tasks.rados.rados.0.trial082.stdout:1449: done (9 left) 2026-02-12T17:35:05.142 INFO:tasks.rados.rados.0.trial082.stdout:1450: done (8 left) 2026-02-12T17:35:05.142 INFO:tasks.rados.rados.0.trial082.stdout:1459: read oid 28 snap 155 2026-02-12T17:35:05.143 INFO:tasks.rados.rados.0.trial082.stdout:1459: expect deleted 2026-02-12T17:35:05.143 INFO:tasks.rados.rados.0.trial082.stdout:1460: read oid 42 snap -1 2026-02-12T17:35:05.143 INFO:tasks.rados.rados.0.trial082.stdout:1460: expect (ObjNum 494 snap 153 seq_num 494) 2026-02-12T17:35:05.143 INFO:tasks.rados.rados.0.trial082.stdout:1461: snap_remove snap 138 2026-02-12T17:35:06.054 INFO:tasks.rados.rados.0.trial082.stdout:1461: done (10 left) 2026-02-12T17:35:06.055 INFO:tasks.rados.rados.0.trial082.stdout:1462: delete oid 48 current snap is 156 2026-02-12T17:35:06.055 INFO:tasks.rados.rados.0.trial082.stdout:1454: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:35:06.055 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 0 (ObjNum 129 snap 0 seq_num 28892440) dirty dne 2026-02-12T17:35:06.055 INFO:tasks.rados.rados.0.trial082.stdout:1452: expect (ObjNum 429 snap 134 seq_num 429) 2026-02-12T17:35:06.155 INFO:tasks.rados.rados.0.trial082.stdout:1451: finishing write tid 2 to trial08226312-31 2026-02-12T17:35:06.155 INFO:tasks.rados.rados.0.trial082.stdout:1451: finishing write tid 3 to trial08226312-31 2026-02-12T17:35:06.155 INFO:tasks.rados.rados.0.trial082.stdout:1451: finishing write tid 4 to trial08226312-31 2026-02-12T17:35:06.156 INFO:tasks.rados.rados.0.trial082.stdout:1451: oid 31 updating version 0 to 292 2026-02-12T17:35:06.156 INFO:tasks.rados.rados.0.trial082.stdout:1451: oid 31 updating version 292 to 293 2026-02-12T17:35:06.156 INFO:tasks.rados.rados.0.trial082.stdout:1451: oid 31 version 293 is already newer than 291 2026-02-12T17:35:06.156 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 293 (ObjNum 500 snap 156 seq_num 500) dirty exists 2026-02-12T17:35:06.156 INFO:tasks.rados.rados.0.trial082.stdout:1451: left oid 31 (ObjNum 500 snap 156 seq_num 500) 2026-02-12T17:35:06.156 INFO:tasks.rados.rados.0.trial082.stdout:1456: expect (ObjNum 456 snap 143 seq_num 456) 2026-02-12T17:35:06.314 INFO:tasks.rados.rados.0.trial082.stdout:1453: expect (ObjNum 308 snap 88 seq_num 308) 2026-02-12T17:35:06.366 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2125298 2026-02-12T17:35:06.419 INFO:tasks.rados.rados.0.trial082.stdout:1455: expect (ObjNum 460 snap 143 seq_num 460) 2026-02-12T17:35:06.419 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:06.474 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2906193 2026-02-12T17:35:06.519 INFO:tasks.rados.rados.0.trial082.stdout:1457: expect (ObjNum 372 snap 110 seq_num 372) 2026-02-12T17:35:06.541 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:06.586 INFO:tasks.rados.rados.0.trial082.stdout:1458: finishing write tid 1 to trial08226312-15 2026-02-12T17:35:06.586 INFO:tasks.rados.rados.0.trial082.stdout:1458: finishing write tid 2 to trial08226312-15 2026-02-12T17:35:06.586 INFO:tasks.rados.rados.0.trial082.stdout:1458: finishing write tid 3 to trial08226312-15 2026-02-12T17:35:06.586 INFO:tasks.rados.rados.0.trial082.stdout:1458: finishing write tid 4 to trial08226312-15 2026-02-12T17:35:06.586 INFO:tasks.rados.rados.0.trial082.stdout:1458: oid 15 updating version 0 to 839 2026-02-12T17:35:06.586 INFO:tasks.rados.rados.0.trial082.stdout:1458: oid 15 updating version 839 to 840 2026-02-12T17:35:06.587 INFO:tasks.rados.rados.0.trial082.stdout:1458: oid 15 version 840 is already newer than 838 2026-02-12T17:35:06.587 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 840 (ObjNum 501 snap 156 seq_num 501) dirty exists 2026-02-12T17:35:06.587 INFO:tasks.rados.rados.0.trial082.stdout:1458: left oid 15 (ObjNum 501 snap 156 seq_num 501) 2026-02-12T17:35:06.587 INFO:tasks.rados.rados.0.trial082.stdout:1460: expect (ObjNum 494 snap 153 seq_num 494) 2026-02-12T17:35:06.590 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1610853 2026-02-12T17:35:06.602 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:06.645 INFO:tasks.rados.rados.0.trial082.stdout:1451: done (10 left) 2026-02-12T17:35:06.645 INFO:tasks.rados.rados.0.trial082.stdout:1452: done (9 left) 2026-02-12T17:35:06.645 INFO:tasks.rados.rados.0.trial082.stdout:1453: done (8 left) 2026-02-12T17:35:06.645 INFO:tasks.rados.rados.0.trial082.stdout:1454: done (7 left) 2026-02-12T17:35:06.645 INFO:tasks.rados.rados.0.trial082.stdout:1455: done (6 left) 2026-02-12T17:35:06.645 INFO:tasks.rados.rados.0.trial082.stdout:1456: done (5 left) 2026-02-12T17:35:06.645 INFO:tasks.rados.rados.0.trial082.stdout:1457: done (4 left) 2026-02-12T17:35:06.645 INFO:tasks.rados.rados.0.trial082.stdout:1458: done (3 left) 2026-02-12T17:35:06.645 INFO:tasks.rados.rados.0.trial082.stdout:1459: done (2 left) 2026-02-12T17:35:06.646 INFO:tasks.rados.rados.0.trial082.stdout:1460: done (1 left) 2026-02-12T17:35:06.646 INFO:tasks.rados.rados.0.trial082.stdout:1462: done (0 left) 2026-02-12T17:35:06.646 INFO:tasks.rados.rados.0.trial082.stdout:1463: copy_from oid 35 from oid 50 current snap is 156 2026-02-12T17:35:06.646 INFO:tasks.rados.rados.0.trial082.stdout:1464: read oid 26 snap 143 2026-02-12T17:35:06.646 INFO:tasks.rados.rados.0.trial082.stdout:1464: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:35:06.646 INFO:tasks.rados.rados.0.trial082.stdout:1465: delete oid 16 current snap is 156 2026-02-12T17:35:06.647 INFO:tasks.rados.rados.0.trial082.stdout:1465: done (2 left) 2026-02-12T17:35:06.647 INFO:tasks.rados.rados.0.trial082.stdout:1466: rollback oid 6 current snap is 156 2026-02-12T17:35:06.647 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 6 to 143 2026-02-12T17:35:06.647 INFO:tasks.rados.rados.0.trial082.stdout:1467: write oid 45 current snap is 156 2026-02-12T17:35:06.647 INFO:tasks.rados.rados.0.trial082.stdout:1467: seq_num 504 ranges {470728=404794,1526454=481175} 2026-02-12T17:35:06.649 INFO:tasks.rados.rados.0.trial082.stdout:1467: writing trial08226312-45 from 470728 to 875522 tid 1 2026-02-12T17:35:06.654 INFO:tasks.rados.rados.0.trial082.stdout:1467: writing trial08226312-45 from 1526454 to 2007629 tid 2 2026-02-12T17:35:06.654 INFO:tasks.rados.rados.0.trial082.stdout:1468: read oid 47 snap 148 2026-02-12T17:35:06.654 INFO:tasks.rados.rados.0.trial082.stdout:1468: expect (ObjNum 482 snap 147 seq_num 482) 2026-02-12T17:35:06.654 INFO:tasks.rados.rados.0.trial082.stdout:1469: write (excl) oid 41 current snap is 156 2026-02-12T17:35:06.654 INFO:tasks.rados.rados.0.trial082.stdout:1469: seq_num 505 ranges {487535=480043,1584936=624833} 2026-02-12T17:35:06.657 INFO:tasks.rados.rados.0.trial082.stdout:1469: writing trial08226312-41 from 487535 to 967578 tid 1 2026-02-12T17:35:06.662 INFO:tasks.rados.rados.0.trial082.stdout:1469: writing trial08226312-41 from 1584936 to 2209769 tid 2 2026-02-12T17:35:06.662 INFO:tasks.rados.rados.0.trial082.stdout:1470: write (excl) oid 31 current snap is 156 2026-02-12T17:35:06.662 INFO:tasks.rados.rados.0.trial082.stdout:1470: seq_num 506 ranges {504342=555292,1643418=484844} 2026-02-12T17:35:06.666 INFO:tasks.rados.rados.0.trial082.stdout:1470: writing trial08226312-31 from 504342 to 1059634 tid 1 2026-02-12T17:35:06.670 INFO:tasks.rados.rados.0.trial082.stdout:1470: writing trial08226312-31 from 1643418 to 2128262 tid 2 2026-02-12T17:35:06.670 INFO:tasks.rados.rados.0.trial082.stdout:1471: copy_from oid 22 from oid 11 current snap is 156 2026-02-12T17:35:06.670 INFO:tasks.rados.rados.0.trial082.stdout:1464: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1466: finishing rollback tid 1 to trial08226312-6 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1466: finishing rollback tid 2 to trial08226312-6 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 681 (ObjNum 439 snap 137 seq_num 439) dirty exists 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1463: finishing copy_from to trial08226312-35 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1463: got expected ENOENT (src dne) 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1463: finishing copy_from racing read to trial08226312-35 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1467: finishing write tid 1 to trial08226312-45 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1463: done (7 left) 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1464: done (6 left) 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1466: done (5 left) 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1472: write oid 13 current snap is 156 2026-02-12T17:35:06.811 INFO:tasks.rados.rados.0.trial082.stdout:1472: seq_num 507 ranges {521149=630541,1701900=628502} 2026-02-12T17:35:06.815 INFO:tasks.rados.rados.0.trial082.stdout:1472: writing trial08226312-13 from 521149 to 1151690 tid 1 2026-02-12T17:35:06.819 INFO:tasks.rados.rados.0.trial082.stdout:1472: writing trial08226312-13 from 1701900 to 2330402 tid 2 2026-02-12T17:35:06.819 INFO:tasks.rados.rados.0.trial082.stdout:1473: write oid 43 current snap is 156 2026-02-12T17:35:06.819 INFO:tasks.rados.rados.0.trial082.stdout:1467: finishing write tid 2 to trial08226312-45 2026-02-12T17:35:06.819 INFO:tasks.rados.rados.0.trial082.stdout:1467: finishing write tid 3 to trial08226312-45 2026-02-12T17:35:06.819 INFO:tasks.rados.rados.0.trial082.stdout:1467: finishing write tid 4 to trial08226312-45 2026-02-12T17:35:06.820 INFO:tasks.rados.rados.0.trial082.stdout:1467: oid 45 updating version 0 to 838 2026-02-12T17:35:06.820 INFO:tasks.rados.rados.0.trial082.stdout:1467: oid 45 version 838 is already newer than 836 2026-02-12T17:35:06.820 INFO:tasks.rados.rados.0.trial082.stdout:1467: oid 45 version 838 is already newer than 837 2026-02-12T17:35:06.820 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 838 (ObjNum 504 snap 156 seq_num 504) dirty exists 2026-02-12T17:35:06.820 INFO:tasks.rados.rados.0.trial082.stdout:1467: left oid 45 (ObjNum 504 snap 156 seq_num 504) 2026-02-12T17:35:06.820 INFO:tasks.rados.rados.0.trial082.stdout:1468: expect (ObjNum 482 snap 147 seq_num 482) 2026-02-12T17:35:06.820 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:06.847 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:06.877 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 449320 2026-02-12T17:35:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1469: finishing write tid 1 to trial08226312-41 2026-02-12T17:35:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1469: finishing write tid 2 to trial08226312-41 2026-02-12T17:35:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1469: finishing write tid 3 to trial08226312-41 2026-02-12T17:35:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1469: finishing write tid 4 to trial08226312-41 2026-02-12T17:35:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1469: oid 41 updating version 0 to 660 2026-02-12T17:35:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1469: oid 41 version 660 is already newer than 659 2026-02-12T17:35:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1469: oid 41 version 660 is already newer than 658 2026-02-12T17:35:06.900 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 660 (ObjNum 505 snap 156 seq_num 505) dirty exists 2026-02-12T17:35:06.900 INFO:tasks.rados.rados.0.trial082.stdout:1469: left oid 41 (ObjNum 505 snap 156 seq_num 505) 2026-02-12T17:35:06.900 INFO:tasks.rados.rados.0.trial082.stdout:1470: finishing write tid 1 to trial08226312-31 2026-02-12T17:35:06.900 INFO:tasks.rados.rados.0.trial082.stdout:1473: seq_num 508 ranges {537956=705790,1644029=772160} 2026-02-12T17:35:06.903 INFO:tasks.rados.rados.0.trial082.stdout:1473: writing trial08226312-43 from 537956 to 1243746 tid 1 2026-02-12T17:35:06.909 INFO:tasks.rados.rados.0.trial082.stdout:1473: writing trial08226312-43 from 1644029 to 2416189 tid 2 2026-02-12T17:35:06.909 INFO:tasks.rados.rados.0.trial082.stdout:1467: done (6 left) 2026-02-12T17:35:06.909 INFO:tasks.rados.rados.0.trial082.stdout:1468: done (5 left) 2026-02-12T17:35:06.909 INFO:tasks.rados.rados.0.trial082.stdout:1469: done (4 left) 2026-02-12T17:35:06.909 INFO:tasks.rados.rados.0.trial082.stdout:1474: read oid 15 snap 150 2026-02-12T17:35:06.909 INFO:tasks.rados.rados.0.trial082.stdout:1474: expect deleted 2026-02-12T17:35:06.909 INFO:tasks.rados.rados.0.trial082.stdout:1475: copy_from oid 8 from oid 47 current snap is 156 2026-02-12T17:35:06.909 INFO:tasks.rados.rados.0.trial082.stdout:1470: finishing write tid 2 to trial08226312-31 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:1470: finishing write tid 3 to trial08226312-31 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:1470: finishing write tid 4 to trial08226312-31 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:1470: oid 31 updating version 0 to 294 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:1470: oid 31 updating version 294 to 295 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:1470: oid 31 updating version 295 to 296 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 296 (ObjNum 506 snap 156 seq_num 506) dirty exists 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:1470: left oid 31 (ObjNum 506 snap 156 seq_num 506) 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:1471: finishing copy_from racing read to trial08226312-22 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:1470: done (5 left) 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:1476: rollback oid 49 current snap is 156 2026-02-12T17:35:06.910 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 148 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1471: finishing copy_from to trial08226312-22 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 458 (ObjNum 376 snap 112 seq_num 376) dirty exists 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1472: finishing write tid 1 to trial08226312-13 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1472: finishing write tid 2 to trial08226312-13 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1472: finishing write tid 3 to trial08226312-13 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1472: finishing write tid 4 to trial08226312-13 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1472: oid 13 updating version 0 to 505 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1472: oid 13 updating version 505 to 506 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1472: oid 13 version 506 is already newer than 504 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 506 (ObjNum 507 snap 156 seq_num 507) dirty exists 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1472: left oid 13 (ObjNum 507 snap 156 seq_num 507) 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1473: finishing write tid 1 to trial08226312-43 2026-02-12T17:35:06.911 INFO:tasks.rados.rados.0.trial082.stdout:1471: done (5 left) 2026-02-12T17:35:06.912 INFO:tasks.rados.rados.0.trial082.stdout:1472: done (4 left) 2026-02-12T17:35:06.912 INFO:tasks.rados.rados.0.trial082.stdout:1477: delete oid 38 current snap is 156 2026-02-12T17:35:06.912 INFO:tasks.rados.rados.0.trial082.stdout:1476: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:35:06.912 INFO:tasks.rados.rados.0.trial082.stdout:1476: finishing rollback tid 2 to trial08226312-49 2026-02-12T17:35:06.912 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 811 (ObjNum 381 snap 113 seq_num 381) dirty exists 2026-02-12T17:35:06.913 INFO:tasks.rados.rados.0.trial082.stdout:1473: finishing write tid 2 to trial08226312-43 2026-02-12T17:35:06.913 INFO:tasks.rados.rados.0.trial082.stdout:1474: done (4 left) 2026-02-12T17:35:06.913 INFO:tasks.rados.rados.0.trial082.stdout:1476: done (3 left) 2026-02-12T17:35:06.913 INFO:tasks.rados.rados.0.trial082.stdout:1477: done (2 left) 2026-02-12T17:35:06.913 INFO:tasks.rados.rados.0.trial082.stdout:1478: read oid 33 snap -1 2026-02-12T17:35:06.913 INFO:tasks.rados.rados.0.trial082.stdout:1478: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:35:06.914 INFO:tasks.rados.rados.0.trial082.stdout:1479: write oid 27 current snap is 156 2026-02-12T17:35:06.914 INFO:tasks.rados.rados.0.trial082.stdout:1479: seq_num 510 ranges {571570=572641,1877346=694224} 2026-02-12T17:35:06.914 INFO:tasks.rados.rados.0.trial082.stdout:1479: writing trial08226312-27 from 571570 to 1144211 tid 1 2026-02-12T17:35:06.919 INFO:tasks.rados.rados.0.trial082.stdout:1479: writing trial08226312-27 from 1877346 to 2571570 tid 2 2026-02-12T17:35:06.920 INFO:tasks.rados.rados.0.trial082.stdout:1480: write oid 2 current snap is 156 2026-02-12T17:35:06.920 INFO:tasks.rados.rados.0.trial082.stdout:1480: seq_num 511 ranges {588377=647890,1935828=635840} 2026-02-12T17:35:06.924 INFO:tasks.rados.rados.0.trial082.stdout:1480: writing trial08226312-2 from 588377 to 1236267 tid 1 2026-02-12T17:35:06.929 INFO:tasks.rados.rados.0.trial082.stdout:1480: writing trial08226312-2 from 1935828 to 2571668 tid 2 2026-02-12T17:35:06.929 INFO:tasks.rados.rados.0.trial082.stdout:1481: delete oid 3 current snap is 156 2026-02-12T17:35:06.929 INFO:tasks.rados.rados.0.trial082.stdout:1473: finishing write tid 3 to trial08226312-43 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:1473: finishing write tid 4 to trial08226312-43 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:1473: oid 43 updating version 0 to 845 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:1473: oid 43 version 845 is already newer than 843 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:1473: oid 43 version 845 is already newer than 844 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 845 (ObjNum 508 snap 156 seq_num 508) dirty exists 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:1473: left oid 43 (ObjNum 508 snap 156 seq_num 508) 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:1475: finishing copy_from racing read to trial08226312-8 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:1475: finishing copy_from to trial08226312-8 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 987 (ObjNum 482 snap 147 seq_num 482) dirty exists 2026-02-12T17:35:06.930 INFO:tasks.rados.rados.0.trial082.stdout:1478: expect (ObjNum 343 snap 103 seq_num 343) 2026-02-12T17:35:06.975 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:07.022 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:07.069 INFO:tasks.rados.rados.0.trial082.stdout:1479: finishing write tid 1 to trial08226312-27 2026-02-12T17:35:07.069 INFO:tasks.rados.rados.0.trial082.stdout:1479: finishing write tid 2 to trial08226312-27 2026-02-12T17:35:07.069 INFO:tasks.rados.rados.0.trial082.stdout:1473: done (5 left) 2026-02-12T17:35:07.069 INFO:tasks.rados.rados.0.trial082.stdout:1475: done (4 left) 2026-02-12T17:35:07.069 INFO:tasks.rados.rados.0.trial082.stdout:1478: done (3 left) 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1481: done (2 left) 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1482: read oid 42 snap -1 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1482: expect (ObjNum 494 snap 153 seq_num 494) 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1483: rollback oid 16 current snap is 156 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 153 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1479: finishing write tid 3 to trial08226312-27 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1479: finishing write tid 4 to trial08226312-27 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1479: oid 27 updating version 0 to 297 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1479: oid 27 updating version 297 to 298 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1479: oid 27 updating version 298 to 299 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 299 (ObjNum 510 snap 156 seq_num 510) dirty exists 2026-02-12T17:35:07.070 INFO:tasks.rados.rados.0.trial082.stdout:1479: left oid 27 (ObjNum 510 snap 156 seq_num 510) 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1480: finishing write tid 1 to trial08226312-2 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1480: finishing write tid 2 to trial08226312-2 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1480: finishing write tid 3 to trial08226312-2 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1480: finishing write tid 4 to trial08226312-2 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1480: oid 2 updating version 0 to 303 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1480: oid 2 version 303 is already newer than 302 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1480: oid 2 updating version 303 to 304 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 304 (ObjNum 511 snap 156 seq_num 511) dirty exists 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1480: left oid 2 (ObjNum 511 snap 156 seq_num 511) 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1479: done (3 left) 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1480: done (2 left) 2026-02-12T17:35:07.071 INFO:tasks.rados.rados.0.trial082.stdout:1484: delete oid 3 current snap is 156 2026-02-12T17:35:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1484: done (2 left) 2026-02-12T17:35:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1485: write (excl) oid 41 current snap is 156 2026-02-12T17:35:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1485: seq_num 514 ranges {638798=473637,1594921=783167} 2026-02-12T17:35:07.074 INFO:tasks.rados.rados.0.trial082.stdout:1485: writing trial08226312-41 from 638798 to 1112435 tid 1 2026-02-12T17:35:07.079 INFO:tasks.rados.rados.0.trial082.stdout:1485: writing trial08226312-41 from 1594921 to 2378088 tid 2 2026-02-12T17:35:07.079 INFO:tasks.rados.rados.0.trial082.stdout:1486: write oid 38 current snap is 156 2026-02-12T17:35:07.079 INFO:tasks.rados.rados.0.trial082.stdout:1486: seq_num 515 ranges {655605=548886,1653403=643178} 2026-02-12T17:35:07.083 INFO:tasks.rados.rados.0.trial082.stdout:1486: writing trial08226312-38 from 655605 to 1204491 tid 1 2026-02-12T17:35:07.087 INFO:tasks.rados.rados.0.trial082.stdout:1486: writing trial08226312-38 from 1653403 to 2296581 tid 2 2026-02-12T17:35:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1487: read oid 5 snap -1 2026-02-12T17:35:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1487: expect deleted 2026-02-12T17:35:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1488: delete oid 33 current snap is 156 2026-02-12T17:35:07.088 INFO:tasks.rados.rados.0.trial082.stdout:1482: expect (ObjNum 494 snap 153 seq_num 494) 2026-02-12T17:35:07.092 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1376213 2026-02-12T17:35:07.105 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 262861 2026-02-12T17:35:07.149 INFO:tasks.rados.rados.0.trial082.stdout:1483: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:35:07.149 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 882 (ObjNum 129 snap 0 seq_num 27146524) dirty dne 2026-02-12T17:35:07.149 INFO:tasks.rados.rados.0.trial082.stdout:1485: finishing write tid 1 to trial08226312-41 2026-02-12T17:35:07.149 INFO:tasks.rados.rados.0.trial082.stdout:1485: finishing write tid 2 to trial08226312-41 2026-02-12T17:35:07.149 INFO:tasks.rados.rados.0.trial082.stdout:1485: finishing write tid 3 to trial08226312-41 2026-02-12T17:35:07.149 INFO:tasks.rados.rados.0.trial082.stdout:1485: finishing write tid 4 to trial08226312-41 2026-02-12T17:35:07.149 INFO:tasks.rados.rados.0.trial082.stdout:1485: oid 41 updating version 0 to 663 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1485: oid 41 version 663 is already newer than 661 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1485: oid 41 version 663 is already newer than 662 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 663 (ObjNum 514 snap 156 seq_num 514) dirty exists 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1485: left oid 41 (ObjNum 514 snap 156 seq_num 514) 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1486: finishing write tid 1 to trial08226312-38 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1486: finishing write tid 2 to trial08226312-38 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1486: finishing write tid 3 to trial08226312-38 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1486: finishing write tid 4 to trial08226312-38 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1486: oid 38 updating version 0 to 816 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1486: oid 38 updating version 816 to 817 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1486: oid 38 version 817 is already newer than 815 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 817 (ObjNum 515 snap 156 seq_num 515) dirty exists 2026-02-12T17:35:07.150 INFO:tasks.rados.rados.0.trial082.stdout:1486: left oid 38 (ObjNum 515 snap 156 seq_num 515) 2026-02-12T17:35:07.151 INFO:tasks.rados.rados.0.trial082.stdout:1482: done (5 left) 2026-02-12T17:35:07.151 INFO:tasks.rados.rados.0.trial082.stdout:1483: done (4 left) 2026-02-12T17:35:07.151 INFO:tasks.rados.rados.0.trial082.stdout:1485: done (3 left) 2026-02-12T17:35:07.151 INFO:tasks.rados.rados.0.trial082.stdout:1486: done (2 left) 2026-02-12T17:35:07.151 INFO:tasks.rados.rados.0.trial082.stdout:1487: done (1 left) 2026-02-12T17:35:07.151 INFO:tasks.rados.rados.0.trial082.stdout:1488: done (0 left) 2026-02-12T17:35:07.151 INFO:tasks.rados.rados.0.trial082.stdout:1489: snap_remove snap 153 2026-02-12T17:35:08.043 INFO:tasks.rados.rados.0.trial082.stdout:1489: done (0 left) 2026-02-12T17:35:08.043 INFO:tasks.rados.rados.0.trial082.stdout:1490: read oid 50 snap -1 2026-02-12T17:35:08.043 INFO:tasks.rados.rados.0.trial082.stdout:1490: expect deleted 2026-02-12T17:35:08.043 INFO:tasks.rados.rados.0.trial082.stdout:1491: snap_create 2026-02-12T17:35:09.045 INFO:tasks.rados.rados.0.trial082.stdout:1490: done (1 left) 2026-02-12T17:35:09.045 INFO:tasks.rados.rados.0.trial082.stdout:1491: done (0 left) 2026-02-12T17:35:09.045 INFO:tasks.rados.rados.0.trial082.stdout:1492: write oid 49 current snap is 157 2026-02-12T17:35:09.045 INFO:tasks.rados.rados.0.trial082.stdout:1492: seq_num 517 ranges {689219=415737,1770367=646847} 2026-02-12T17:35:09.049 INFO:tasks.rados.rados.0.trial082.stdout:1492: writing trial08226312-49 from 689219 to 1104956 tid 1 2026-02-12T17:35:09.054 INFO:tasks.rados.rados.0.trial082.stdout:1492: writing trial08226312-49 from 1770367 to 2417214 tid 2 2026-02-12T17:35:09.054 INFO:tasks.rados.rados.0.trial082.stdout:1493: read oid 21 snap -1 2026-02-12T17:35:09.055 INFO:tasks.rados.rados.0.trial082.stdout:1493: expect deleted 2026-02-12T17:35:09.055 INFO:tasks.rados.rados.0.trial082.stdout:1494: read oid 28 snap -1 2026-02-12T17:35:09.055 INFO:tasks.rados.rados.0.trial082.stdout:1494: expect deleted 2026-02-12T17:35:09.055 INFO:tasks.rados.rados.0.trial082.stdout:1495: snap_create 2026-02-12T17:35:09.055 INFO:tasks.rados.rados.0.trial082.stdout:1492: finishing write tid 1 to trial08226312-49 2026-02-12T17:35:09.057 INFO:tasks.rados.rados.0.trial082.stdout:1492: finishing write tid 2 to trial08226312-49 2026-02-12T17:35:09.057 INFO:tasks.rados.rados.0.trial082.stdout:1492: finishing write tid 3 to trial08226312-49 2026-02-12T17:35:09.057 INFO:tasks.rados.rados.0.trial082.stdout:1492: finishing write tid 4 to trial08226312-49 2026-02-12T17:35:09.057 INFO:tasks.rados.rados.0.trial082.stdout:1492: oid 49 updating version 0 to 812 2026-02-12T17:35:09.057 INFO:tasks.rados.rados.0.trial082.stdout:1492: oid 49 updating version 812 to 813 2026-02-12T17:35:09.057 INFO:tasks.rados.rados.0.trial082.stdout:1492: oid 49 updating version 813 to 814 2026-02-12T17:35:09.057 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 814 (ObjNum 517 snap 157 seq_num 517) dirty exists 2026-02-12T17:35:09.057 INFO:tasks.rados.rados.0.trial082.stdout:1492: left oid 49 (ObjNum 517 snap 157 seq_num 517) 2026-02-12T17:35:10.049 INFO:tasks.rados.rados.0.trial082.stdout:1492: done (3 left) 2026-02-12T17:35:10.049 INFO:tasks.rados.rados.0.trial082.stdout:1493: done (2 left) 2026-02-12T17:35:10.049 INFO:tasks.rados.rados.0.trial082.stdout:1494: done (1 left) 2026-02-12T17:35:10.049 INFO:tasks.rados.rados.0.trial082.stdout:1495: done (0 left) 2026-02-12T17:35:10.049 INFO:tasks.rados.rados.0.trial082.stdout:1496: write oid 1 current snap is 158 2026-02-12T17:35:10.049 INFO:tasks.rados.rados.0.trial082.stdout:1496: seq_num 518 ranges {706026=490986,1828849=790505} 2026-02-12T17:35:10.053 INFO:tasks.rados.rados.0.trial082.stdout:1496: writing trial08226312-1 from 706026 to 1197012 tid 1 2026-02-12T17:35:10.059 INFO:tasks.rados.rados.0.trial082.stdout:1496: writing trial08226312-1 from 1828849 to 2619354 tid 2 2026-02-12T17:35:10.059 INFO:tasks.rados.rados.0.trial082.stdout:1497: read oid 4 snap 157 2026-02-12T17:35:10.059 INFO:tasks.rados.rados.0.trial082.stdout:1497: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:35:10.060 INFO:tasks.rados.rados.0.trial082.stdout:1498: delete oid 29 current snap is 158 2026-02-12T17:35:10.060 INFO:tasks.rados.rados.0.trial082.stdout:1496: finishing write tid 1 to trial08226312-1 2026-02-12T17:35:10.061 INFO:tasks.rados.rados.0.trial082.stdout:1498: done (2 left) 2026-02-12T17:35:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1499: snap_create 2026-02-12T17:35:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1496: finishing write tid 2 to trial08226312-1 2026-02-12T17:35:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1496: finishing write tid 3 to trial08226312-1 2026-02-12T17:35:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1496: finishing write tid 4 to trial08226312-1 2026-02-12T17:35:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1496: oid 1 updating version 0 to 644 2026-02-12T17:35:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1496: oid 1 version 644 is already newer than 643 2026-02-12T17:35:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1496: oid 1 version 644 is already newer than 642 2026-02-12T17:35:10.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 644 (ObjNum 518 snap 158 seq_num 518) dirty exists 2026-02-12T17:35:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1496: left oid 1 (ObjNum 518 snap 158 seq_num 518) 2026-02-12T17:35:10.063 INFO:tasks.rados.rados.0.trial082.stdout:1497: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:35:11.542 INFO:tasks.rados.rados.0.trial082.stdout:1496: done (2 left) 2026-02-12T17:35:11.543 INFO:tasks.rados.rados.0.trial082.stdout:1497: done (1 left) 2026-02-12T17:35:11.543 INFO:tasks.rados.rados.0.trial082.stdout:1499: done (0 left) 2026-02-12T17:35:11.543 INFO:tasks.rados.rados.0.trial082.stdout:1500: snap_create 2026-02-12T17:35:13.197 INFO:tasks.rados.rados.0.trial082.stdout:1500: done (0 left) 2026-02-12T17:35:13.197 INFO:tasks.rados.rados.0.trial082.stdout:1501: rollback oid 6 current snap is 160 2026-02-12T17:35:13.197 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 6 to 148 2026-02-12T17:35:13.198 INFO:tasks.rados.rados.0.trial082.stdout:1502: read oid 32 snap -1 2026-02-12T17:35:13.198 INFO:tasks.rados.rados.0.trial082.stdout:1502: expect (ObjNum 429 snap 134 seq_num 429) 2026-02-12T17:35:13.198 INFO:tasks.rados.rados.0.trial082.stdout:1503: write (excl) oid 4 current snap is 160 2026-02-12T17:35:13.198 INFO:tasks.rados.rados.0.trial082.stdout:1503: seq_num 520 ranges {739640=641484,1829460=794174} 2026-02-12T17:35:13.203 INFO:tasks.rados.rados.0.trial082.stdout:1503: writing trial08226312-4 from 739640 to 1381124 tid 1 2026-02-12T17:35:13.208 INFO:tasks.rados.rados.0.trial082.stdout:1503: writing trial08226312-4 from 1829460 to 2623634 tid 2 2026-02-12T17:35:13.208 INFO:tasks.rados.rados.0.trial082.stdout:1504: read oid 1 snap -1 2026-02-12T17:35:13.208 INFO:tasks.rados.rados.0.trial082.stdout:1504: expect (ObjNum 518 snap 158 seq_num 518) 2026-02-12T17:35:13.208 INFO:tasks.rados.rados.0.trial082.stdout:1505: write oid 30 current snap is 160 2026-02-12T17:35:13.208 INFO:tasks.rados.rados.0.trial082.stdout:1505: seq_num 521 ranges {756447=716733,1887942=537832} 2026-02-12T17:35:13.213 INFO:tasks.rados.rados.0.trial082.stdout:1505: writing trial08226312-30 from 756447 to 1473180 tid 1 2026-02-12T17:35:13.217 INFO:tasks.rados.rados.0.trial082.stdout:1505: writing trial08226312-30 from 1887942 to 2425774 tid 2 2026-02-12T17:35:13.217 INFO:tasks.rados.rados.0.trial082.stdout:1506: write (excl) oid 46 current snap is 160 2026-02-12T17:35:13.217 INFO:tasks.rados.rados.0.trial082.stdout:1506: seq_num 522 ranges {773254=791982,2346424=426830} 2026-02-12T17:35:13.222 INFO:tasks.rados.rados.0.trial082.stdout:1506: writing trial08226312-46 from 773254 to 1565236 tid 1 2026-02-12T17:35:13.227 INFO:tasks.rados.rados.0.trial082.stdout:1506: writing trial08226312-46 from 2346424 to 2773254 tid 2 2026-02-12T17:35:13.228 INFO:tasks.rados.rados.0.trial082.stdout:1507: delete oid 47 current snap is 160 2026-02-12T17:35:13.228 INFO:tasks.rados.rados.0.trial082.stdout:1501: finishing rollback tid 0 to trial08226312-6 2026-02-12T17:35:13.228 INFO:tasks.rados.rados.0.trial082.stdout:1501: finishing rollback tid 1 to trial08226312-6 2026-02-12T17:35:13.228 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 684 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-12T17:35:13.228 INFO:tasks.rados.rados.0.trial082.stdout:1502: expect (ObjNum 429 snap 134 seq_num 429) 2026-02-12T17:35:13.228 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:13.311 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 926708 2026-02-12T17:35:13.343 INFO:tasks.rados.rados.0.trial082.stdout:1504: expect (ObjNum 518 snap 158 seq_num 518) 2026-02-12T17:35:13.344 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:13.468 INFO:tasks.rados.rados.0.trial082.stdout:1503: finishing write tid 1 to trial08226312-4 2026-02-12T17:35:13.468 INFO:tasks.rados.rados.0.trial082.stdout:1503: finishing write tid 2 to trial08226312-4 2026-02-12T17:35:13.468 INFO:tasks.rados.rados.0.trial082.stdout:1503: finishing write tid 3 to trial08226312-4 2026-02-12T17:35:13.468 INFO:tasks.rados.rados.0.trial082.stdout:1501: done (6 left) 2026-02-12T17:35:13.468 INFO:tasks.rados.rados.0.trial082.stdout:1502: done (5 left) 2026-02-12T17:35:13.468 INFO:tasks.rados.rados.0.trial082.stdout:1504: done (4 left) 2026-02-12T17:35:13.468 INFO:tasks.rados.rados.0.trial082.stdout:1507: done (3 left) 2026-02-12T17:35:13.468 INFO:tasks.rados.rados.0.trial082.stdout:1508: snap_remove snap 154 2026-02-12T17:35:14.046 INFO:tasks.rados.rados.0.trial082.stdout:1508: done (3 left) 2026-02-12T17:35:14.046 INFO:tasks.rados.rados.0.trial082.stdout:1509: write oid 11 current snap is 160 2026-02-12T17:35:14.046 INFO:tasks.rados.rados.0.trial082.stdout:1509: seq_num 524 ranges {406868=542480,1547035=401512,2690354=116514} 2026-02-12T17:35:14.050 INFO:tasks.rados.rados.0.trial082.stdout:1509: writing trial08226312-11 from 406868 to 949348 tid 1 2026-02-12T17:35:14.054 INFO:tasks.rados.rados.0.trial082.stdout:1509: writing trial08226312-11 from 1547035 to 1948547 tid 2 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1509: writing trial08226312-11 from 2690354 to 2806868 tid 3 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1510: rollback oid 47 current snap is 160 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 47 to 143 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1503: finishing write tid 4 to trial08226312-4 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1503: oid 4 updating version 0 to 1096 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1503: oid 4 updating version 1096 to 1098 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1503: oid 4 version 1098 is already newer than 1097 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 1098 (ObjNum 520 snap 160 seq_num 520) dirty exists 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1503: left oid 4 (ObjNum 520 snap 160 seq_num 520) 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1505: finishing write tid 1 to trial08226312-30 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1505: finishing write tid 2 to trial08226312-30 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1505: finishing write tid 3 to trial08226312-30 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1505: finishing write tid 4 to trial08226312-30 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1505: oid 30 updating version 0 to 847 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1505: oid 30 updating version 847 to 848 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1505: oid 30 version 848 is already newer than 846 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 848 (ObjNum 521 snap 160 seq_num 521) dirty exists 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1505: left oid 30 (ObjNum 521 snap 160 seq_num 521) 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1506: finishing write tid 1 to trial08226312-46 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1506: finishing write tid 2 to trial08226312-46 2026-02-12T17:35:14.058 INFO:tasks.rados.rados.0.trial082.stdout:1506: finishing write tid 3 to trial08226312-46 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1506: finishing write tid 4 to trial08226312-46 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1506: oid 46 updating version 0 to 463 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1506: oid 46 version 463 is already newer than 462 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1506: oid 46 updating version 463 to 464 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 464 (ObjNum 522 snap 160 seq_num 522) dirty exists 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1506: left oid 46 (ObjNum 522 snap 160 seq_num 522) 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1509: finishing write tid 1 to trial08226312-11 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1509: finishing write tid 2 to trial08226312-11 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1503: done (4 left) 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1505: done (3 left) 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1506: done (2 left) 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1511: read oid 6 snap -1 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1511: expect deleted 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1512: write oid 29 current snap is 160 2026-02-12T17:35:14.059 INFO:tasks.rados.rados.0.trial082.stdout:1512: seq_num 525 ranges {423675=734082,1721870=545170,2717777=105898} 2026-02-12T17:35:14.062 INFO:tasks.rados.rados.0.trial082.stdout:1512: writing trial08226312-29 from 423675 to 1157757 tid 1 2026-02-12T17:35:14.066 INFO:tasks.rados.rados.0.trial082.stdout:1512: writing trial08226312-29 from 1721870 to 2267040 tid 2 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1512: writing trial08226312-29 from 2717777 to 2823675 tid 3 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1513: copy_from oid 33 from oid 24 current snap is 160 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1509: finishing write tid 3 to trial08226312-11 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1509: finishing write tid 4 to trial08226312-11 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1509: finishing write tid 5 to trial08226312-11 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1509: oid 11 updating version 0 to 468 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1509: oid 11 version 468 is already newer than 465 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1509: oid 11 version 468 is already newer than 466 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1509: oid 11 version 468 is already newer than 467 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 468 (ObjNum 524 snap 160 seq_num 524) dirty exists 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1509: left oid 11 (ObjNum 524 snap 160 seq_num 524) 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1510: finishing rollback tid 1 to trial08226312-47 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1509: done (4 left) 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1511: done (3 left) 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1514: snap_create 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1510: finishing rollback tid 2 to trial08226312-47 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1110 (ObjNum 454 snap 142 seq_num 454) dirty exists 2026-02-12T17:35:14.069 INFO:tasks.rados.rados.0.trial082.stdout:1512: finishing write tid 1 to trial08226312-29 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:1512: finishing write tid 2 to trial08226312-29 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:1512: finishing write tid 3 to trial08226312-29 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:1512: finishing write tid 4 to trial08226312-29 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:1512: finishing write tid 5 to trial08226312-29 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:1512: oid 29 updating version 0 to 686 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:1512: oid 29 version 686 is already newer than 685 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:1512: oid 29 updating version 686 to 688 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:1512: oid 29 version 688 is already newer than 687 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 688 (ObjNum 525 snap 160 seq_num 525) dirty exists 2026-02-12T17:35:14.070 INFO:tasks.rados.rados.0.trial082.stdout:1512: left oid 29 (ObjNum 525 snap 160 seq_num 525) 2026-02-12T17:35:14.073 INFO:tasks.rados.rados.0.trial082.stdout:1513: finishing copy_from racing read to trial08226312-33 2026-02-12T17:35:14.074 INFO:tasks.rados.rados.0.trial082.stdout:1513: finishing copy_from to trial08226312-33 2026-02-12T17:35:14.074 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1013 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:35:15.048 INFO:tasks.rados.rados.0.trial082.stdout:1510: done (3 left) 2026-02-12T17:35:15.048 INFO:tasks.rados.rados.0.trial082.stdout:1512: done (2 left) 2026-02-12T17:35:15.048 INFO:tasks.rados.rados.0.trial082.stdout:1513: done (1 left) 2026-02-12T17:35:15.048 INFO:tasks.rados.rados.0.trial082.stdout:1514: done (0 left) 2026-02-12T17:35:15.048 INFO:tasks.rados.rados.0.trial082.stdout:1515: snap_create 2026-02-12T17:35:16.049 INFO:tasks.rados.rados.0.trial082.stdout:1515: done (0 left) 2026-02-12T17:35:16.049 INFO:tasks.rados.rados.0.trial082.stdout:1516: write (excl) oid 16 current snap is 162 2026-02-12T17:35:16.049 INFO:tasks.rados.rados.0.trial082.stdout:1516: seq_num 526 ranges {440482=409331,1380352=405181,2461553=378929} 2026-02-12T17:35:16.052 INFO:tasks.rados.rados.0.trial082.stdout:1516: writing trial08226312-16 from 440482 to 849813 tid 1 2026-02-12T17:35:16.055 INFO:tasks.rados.rados.0.trial082.stdout:1516: writing trial08226312-16 from 1380352 to 1785533 tid 2 2026-02-12T17:35:16.060 INFO:tasks.rados.rados.0.trial082.stdout:1516: writing trial08226312-16 from 2461553 to 2840482 tid 3 2026-02-12T17:35:16.060 INFO:tasks.rados.rados.0.trial082.stdout:1517: write (excl) oid 9 current snap is 162 2026-02-12T17:35:16.060 INFO:tasks.rados.rados.0.trial082.stdout:1517: seq_num 527 ranges {457289=484580,1438834=548839,2772623=84666} 2026-02-12T17:35:16.063 INFO:tasks.rados.rados.0.trial082.stdout:1517: writing trial08226312-9 from 457289 to 941869 tid 1 2026-02-12T17:35:16.067 INFO:tasks.rados.rados.0.trial082.stdout:1517: writing trial08226312-9 from 1438834 to 1987673 tid 2 2026-02-12T17:35:16.071 INFO:tasks.rados.rados.0.trial082.stdout:1517: writing trial08226312-9 from 2772623 to 2857289 tid 3 2026-02-12T17:35:16.071 INFO:tasks.rados.rados.0.trial082.stdout:1518: write (excl) oid 44 current snap is 162 2026-02-12T17:35:16.071 INFO:tasks.rados.rados.0.trial082.stdout:1518: seq_num 528 ranges {474096=559829,1780963=408850,2800046=74050} 2026-02-12T17:35:16.074 INFO:tasks.rados.rados.0.trial082.stdout:1518: writing trial08226312-44 from 474096 to 1033925 tid 1 2026-02-12T17:35:16.079 INFO:tasks.rados.rados.0.trial082.stdout:1518: writing trial08226312-44 from 1780963 to 2189813 tid 2 2026-02-12T17:35:16.081 INFO:tasks.rados.rados.0.trial082.stdout:1518: writing trial08226312-44 from 2800046 to 2874096 tid 3 2026-02-12T17:35:16.081 INFO:tasks.rados.rados.0.trial082.stdout:1519: snap_remove snap 156 2026-02-12T17:35:17.053 INFO:tasks.rados.rados.0.trial082.stdout:1519: done (3 left) 2026-02-12T17:35:17.053 INFO:tasks.rados.rados.0.trial082.stdout:1520: read oid 4 snap -1 2026-02-12T17:35:17.054 INFO:tasks.rados.rados.0.trial082.stdout:1520: expect (ObjNum 520 snap 160 seq_num 520) 2026-02-12T17:35:17.054 INFO:tasks.rados.rados.0.trial082.stdout:1521: snap_remove snap 158 2026-02-12T17:35:18.056 INFO:tasks.rados.rados.0.trial082.stdout:1521: done (4 left) 2026-02-12T17:35:18.056 INFO:tasks.rados.rados.0.trial082.stdout:1522: rollback oid 26 current snap is 162 2026-02-12T17:35:18.056 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 26 to 159 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: finishing write tid 1 to trial08226312-16 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: finishing write tid 2 to trial08226312-16 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: finishing write tid 3 to trial08226312-16 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: finishing write tid 4 to trial08226312-16 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: finishing write tid 5 to trial08226312-16 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: oid 16 updating version 0 to 921 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: oid 16 updating version 921 to 923 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: oid 16 updating version 923 to 924 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: oid 16 version 924 is already newer than 922 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 924 (ObjNum 526 snap 162 seq_num 526) dirty exists 2026-02-12T17:35:18.057 INFO:tasks.rados.rados.0.trial082.stdout:1516: left oid 16 (ObjNum 526 snap 162 seq_num 526) 2026-02-12T17:35:18.058 INFO:tasks.rados.rados.0.trial082.stdout:1517: finishing write tid 1 to trial08226312-9 2026-02-12T17:35:18.058 INFO:tasks.rados.rados.0.trial082.stdout:1517: finishing write tid 2 to trial08226312-9 2026-02-12T17:35:18.058 INFO:tasks.rados.rados.0.trial082.stdout:1516: done (4 left) 2026-02-12T17:35:18.058 INFO:tasks.rados.rados.0.trial082.stdout:1523: write oid 24 current snap is 162 2026-02-12T17:35:18.058 INFO:tasks.rados.rados.0.trial082.stdout:1523: seq_num 529 ranges {490903=635078,1839445=552508} 2026-02-12T17:35:18.060 INFO:tasks.rados.rados.0.trial082.stdout:1523: writing trial08226312-24 from 490903 to 1125981 tid 1 2026-02-12T17:35:18.066 INFO:tasks.rados.rados.0.trial082.stdout:1523: writing trial08226312-24 from 1839445 to 2391953 tid 2 2026-02-12T17:35:18.066 INFO:tasks.rados.rados.0.trial082.stdout:1524: write (excl) oid 5 current snap is 162 2026-02-12T17:35:18.066 INFO:tasks.rados.rados.0.trial082.stdout:1524: seq_num 530 ranges {507710=710327,1897927=412519,2854892=52818} 2026-02-12T17:35:18.070 INFO:tasks.rados.rados.0.trial082.stdout:1524: writing trial08226312-5 from 507710 to 1218037 tid 1 2026-02-12T17:35:18.074 INFO:tasks.rados.rados.0.trial082.stdout:1524: writing trial08226312-5 from 1897927 to 2310446 tid 2 2026-02-12T17:35:18.077 INFO:tasks.rados.rados.0.trial082.stdout:1524: writing trial08226312-5 from 2854892 to 2907710 tid 3 2026-02-12T17:35:18.077 INFO:tasks.rados.rados.0.trial082.stdout:1525: snap_create 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1517: finishing write tid 3 to trial08226312-9 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1517: finishing write tid 4 to trial08226312-9 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1517: finishing write tid 5 to trial08226312-9 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1517: oid 9 updating version 0 to 926 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1517: oid 9 updating version 926 to 927 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1517: oid 9 updating version 927 to 929 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1517: oid 9 version 929 is already newer than 928 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 929 (ObjNum 527 snap 162 seq_num 527) dirty exists 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1517: left oid 9 (ObjNum 527 snap 162 seq_num 527) 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1518: finishing write tid 1 to trial08226312-44 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1518: finishing write tid 2 to trial08226312-44 2026-02-12T17:35:18.078 INFO:tasks.rados.rados.0.trial082.stdout:1518: finishing write tid 3 to trial08226312-44 2026-02-12T17:35:18.079 INFO:tasks.rados.rados.0.trial082.stdout:1518: finishing write tid 4 to trial08226312-44 2026-02-12T17:35:18.079 INFO:tasks.rados.rados.0.trial082.stdout:1518: finishing write tid 5 to trial08226312-44 2026-02-12T17:35:18.079 INFO:tasks.rados.rados.0.trial082.stdout:1518: oid 44 updating version 0 to 841 2026-02-12T17:35:18.079 INFO:tasks.rados.rados.0.trial082.stdout:1518: oid 44 version 841 is already newer than 840 2026-02-12T17:35:18.079 INFO:tasks.rados.rados.0.trial082.stdout:1518: oid 44 updating version 841 to 842 2026-02-12T17:35:18.079 INFO:tasks.rados.rados.0.trial082.stdout:1518: oid 44 version 842 is already newer than 839 2026-02-12T17:35:18.079 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 842 (ObjNum 528 snap 162 seq_num 528) dirty exists 2026-02-12T17:35:18.079 INFO:tasks.rados.rados.0.trial082.stdout:1518: left oid 44 (ObjNum 528 snap 162 seq_num 528) 2026-02-12T17:35:18.079 INFO:tasks.rados.rados.0.trial082.stdout:1520: expect (ObjNum 520 snap 160 seq_num 520) 2026-02-12T17:35:18.169 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:1522: finishing rollback tid 0 to trial08226312-26 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:1522: finishing rollback tid 1 to trial08226312-26 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:1522: finishing rollback tid 2 to trial08226312-26 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 845 (ObjNum 463 snap 145 seq_num 463) dirty exists 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:1523: finishing write tid 1 to trial08226312-24 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:1523: finishing write tid 2 to trial08226312-24 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:1523: finishing write tid 3 to trial08226312-24 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:1523: finishing write tid 4 to trial08226312-24 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:1523: oid 24 updating version 0 to 1120 2026-02-12T17:35:18.218 INFO:tasks.rados.rados.0.trial082.stdout:1523: oid 24 updating version 1120 to 1121 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1523: oid 24 updating version 1121 to 1122 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1122 (ObjNum 529 snap 162 seq_num 529) dirty exists 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1523: left oid 24 (ObjNum 529 snap 162 seq_num 529) 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1524: finishing write tid 1 to trial08226312-5 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1524: finishing write tid 2 to trial08226312-5 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1524: finishing write tid 3 to trial08226312-5 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1524: finishing write tid 4 to trial08226312-5 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1524: finishing write tid 5 to trial08226312-5 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1524: oid 5 updating version 0 to 845 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1524: oid 5 version 845 is already newer than 842 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1524: oid 5 version 845 is already newer than 844 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:1524: oid 5 version 845 is already newer than 843 2026-02-12T17:35:18.219 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 845 (ObjNum 530 snap 162 seq_num 530) dirty exists 2026-02-12T17:35:18.220 INFO:tasks.rados.rados.0.trial082.stdout:1524: left oid 5 (ObjNum 530 snap 162 seq_num 530) 2026-02-12T17:35:19.059 INFO:tasks.rados.rados.0.trial082.stdout:1517: done (6 left) 2026-02-12T17:35:19.059 INFO:tasks.rados.rados.0.trial082.stdout:1518: done (5 left) 2026-02-12T17:35:19.059 INFO:tasks.rados.rados.0.trial082.stdout:1520: done (4 left) 2026-02-12T17:35:19.059 INFO:tasks.rados.rados.0.trial082.stdout:1522: done (3 left) 2026-02-12T17:35:19.059 INFO:tasks.rados.rados.0.trial082.stdout:1523: done (2 left) 2026-02-12T17:35:19.059 INFO:tasks.rados.rados.0.trial082.stdout:1524: done (1 left) 2026-02-12T17:35:19.059 INFO:tasks.rados.rados.0.trial082.stdout:1525: done (0 left) 2026-02-12T17:35:19.060 INFO:tasks.rados.rados.0.trial082.stdout:1526: rollback oid 36 current snap is 163 2026-02-12T17:35:19.060 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 36 to 157 2026-02-12T17:35:19.060 INFO:tasks.rados.rados.0.trial082.stdout:1527: write (excl) oid 3 current snap is 163 2026-02-12T17:35:19.060 INFO:tasks.rados.rados.0.trial082.stdout:1527: seq_num 531 ranges {524517=785576,1956409=556177} 2026-02-12T17:35:19.063 INFO:tasks.rados.rados.0.trial082.stdout:1527: writing trial08226312-3 from 524517 to 1310093 tid 1 2026-02-12T17:35:19.068 INFO:tasks.rados.rados.0.trial082.stdout:1527: writing trial08226312-3 from 1956409 to 2512586 tid 2 2026-02-12T17:35:19.068 INFO:tasks.rados.rados.0.trial082.stdout:1528: read oid 48 snap -1 2026-02-12T17:35:19.068 INFO:tasks.rados.rados.0.trial082.stdout:1528: expect deleted 2026-02-12T17:35:19.069 INFO:tasks.rados.rados.0.trial082.stdout:1529: write oid 22 current snap is 163 2026-02-12T17:35:19.069 INFO:tasks.rados.rados.0.trial082.stdout:1526: finishing rollback tid 0 to trial08226312-36 2026-02-12T17:35:19.069 INFO:tasks.rados.rados.0.trial082.stdout:1526: finishing rollback tid 1 to trial08226312-36 2026-02-12T17:35:19.069 INFO:tasks.rados.rados.0.trial082.stdout:1526: finishing rollback tid 2 to trial08226312-36 2026-02-12T17:35:19.069 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 848 (ObjNum 436 snap 137 seq_num 436) dirty exists 2026-02-12T17:35:19.069 INFO:tasks.rados.rados.0.trial082.stdout:1527: finishing write tid 1 to trial08226312-3 2026-02-12T17:35:19.069 INFO:tasks.rados.rados.0.trial082.stdout:1529: seq_num 532 ranges {541324=460825,1498538=416188,2393385=547939} 2026-02-12T17:35:19.071 INFO:tasks.rados.rados.0.trial082.stdout:1529: writing trial08226312-22 from 541324 to 1002149 tid 1 2026-02-12T17:35:19.075 INFO:tasks.rados.rados.0.trial082.stdout:1529: writing trial08226312-22 from 1498538 to 1914726 tid 2 2026-02-12T17:35:19.079 INFO:tasks.rados.rados.0.trial082.stdout:1529: writing trial08226312-22 from 2393385 to 2941324 tid 3 2026-02-12T17:35:19.079 INFO:tasks.rados.rados.0.trial082.stdout:1526: done (3 left) 2026-02-12T17:35:19.079 INFO:tasks.rados.rados.0.trial082.stdout:1530: copy_from oid 10 from oid 17 current snap is 163 2026-02-12T17:35:19.079 INFO:tasks.rados.rados.0.trial082.stdout:1527: finishing write tid 2 to trial08226312-3 2026-02-12T17:35:19.079 INFO:tasks.rados.rados.0.trial082.stdout:1527: finishing write tid 3 to trial08226312-3 2026-02-12T17:35:19.079 INFO:tasks.rados.rados.0.trial082.stdout:1528: done (3 left) 2026-02-12T17:35:19.080 INFO:tasks.rados.rados.0.trial082.stdout:1531: write (excl) oid 21 current snap is 163 2026-02-12T17:35:19.080 INFO:tasks.rados.rados.0.trial082.stdout:1531: seq_num 533 ranges {558131=652427,1673373=559846,2820808=137323} 2026-02-12T17:35:19.083 INFO:tasks.rados.rados.0.trial082.stdout:1531: writing trial08226312-21 from 558131 to 1210558 tid 1 2026-02-12T17:35:19.087 INFO:tasks.rados.rados.0.trial082.stdout:1531: writing trial08226312-21 from 1673373 to 2233219 tid 2 2026-02-12T17:35:19.090 INFO:tasks.rados.rados.0.trial082.stdout:1531: writing trial08226312-21 from 2820808 to 2958131 tid 3 2026-02-12T17:35:19.090 INFO:tasks.rados.rados.0.trial082.stdout:1532: read oid 39 snap -1 2026-02-12T17:35:19.090 INFO:tasks.rados.rados.0.trial082.stdout:1532: expect deleted 2026-02-12T17:35:19.090 INFO:tasks.rados.rados.0.trial082.stdout:1533: write (excl) oid 5 current snap is 163 2026-02-12T17:35:19.090 INFO:tasks.rados.rados.0.trial082.stdout:1533: seq_num 534 ranges {574938=727676,1731855=703504,2848231=126707} 2026-02-12T17:35:19.095 INFO:tasks.rados.rados.0.trial082.stdout:1533: writing trial08226312-5 from 574938 to 1302614 tid 1 2026-02-12T17:35:19.099 INFO:tasks.rados.rados.0.trial082.stdout:1533: writing trial08226312-5 from 1731855 to 2435359 tid 2 2026-02-12T17:35:19.102 INFO:tasks.rados.rados.0.trial082.stdout:1533: writing trial08226312-5 from 2848231 to 2974938 tid 3 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1534: read oid 36 snap -1 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1534: expect (ObjNum 436 snap 137 seq_num 436) 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1535: copy_from oid 20 from oid 15 current snap is 163 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1527: finishing write tid 4 to trial08226312-3 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1527: oid 3 updating version 0 to 848 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1527: oid 3 version 848 is already newer than 846 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1527: oid 3 version 848 is already newer than 847 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 848 (ObjNum 531 snap 163 seq_num 531) dirty exists 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1527: left oid 3 (ObjNum 531 snap 163 seq_num 531) 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1529: finishing write tid 1 to trial08226312-22 2026-02-12T17:35:19.103 INFO:tasks.rados.rados.0.trial082.stdout:1529: finishing write tid 2 to trial08226312-22 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1529: finishing write tid 3 to trial08226312-22 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1529: finishing write tid 4 to trial08226312-22 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1529: finishing write tid 5 to trial08226312-22 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1529: oid 22 updating version 0 to 852 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1529: oid 22 version 852 is already newer than 850 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1529: oid 22 version 852 is already newer than 849 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1529: oid 22 version 852 is already newer than 851 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 852 (ObjNum 532 snap 163 seq_num 532) dirty exists 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1529: left oid 22 (ObjNum 532 snap 163 seq_num 532) 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1530: finishing copy_from racing read to trial08226312-10 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1531: finishing write tid 1 to trial08226312-21 2026-02-12T17:35:19.104 INFO:tasks.rados.rados.0.trial082.stdout:1530: finishing copy_from to trial08226312-10 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1072 (ObjNum 427 snap 134 seq_num 427) dirty exists 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1531: finishing write tid 2 to trial08226312-21 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1531: finishing write tid 3 to trial08226312-21 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1531: finishing write tid 4 to trial08226312-21 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1531: finishing write tid 5 to trial08226312-21 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1531: oid 21 updating version 0 to 1074 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1531: oid 21 version 1074 is already newer than 853 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1531: oid 21 version 1074 is already newer than 1073 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1531: oid 21 updating version 1074 to 1075 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1075 (ObjNum 533 snap 163 seq_num 533) dirty exists 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1531: left oid 21 (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1533: finishing write tid 1 to trial08226312-5 2026-02-12T17:35:19.105 INFO:tasks.rados.rados.0.trial082.stdout:1527: done (7 left) 2026-02-12T17:35:19.106 INFO:tasks.rados.rados.0.trial082.stdout:1529: done (6 left) 2026-02-12T17:35:19.106 INFO:tasks.rados.rados.0.trial082.stdout:1530: done (5 left) 2026-02-12T17:35:19.106 INFO:tasks.rados.rados.0.trial082.stdout:1531: done (4 left) 2026-02-12T17:35:19.106 INFO:tasks.rados.rados.0.trial082.stdout:1532: done (3 left) 2026-02-12T17:35:19.106 INFO:tasks.rados.rados.0.trial082.stdout:1536: write oid 9 current snap is 163 2026-02-12T17:35:19.106 INFO:tasks.rados.rados.0.trial082.stdout:1536: seq_num 535 ranges {591745=402925,1790337=563515} 2026-02-12T17:35:19.106 INFO:tasks.rados.rados.0.trial082.stdout:1536: writing trial08226312-9 from 591745 to 994670 tid 1 2026-02-12T17:35:19.110 INFO:tasks.rados.rados.0.trial082.stdout:1536: writing trial08226312-9 from 1790337 to 2353852 tid 2 2026-02-12T17:35:19.110 INFO:tasks.rados.rados.0.trial082.stdout:1537: snap_remove snap 143 2026-02-12T17:35:20.063 INFO:tasks.rados.rados.0.trial082.stdout:1537: done (4 left) 2026-02-12T17:35:20.063 INFO:tasks.rados.rados.0.trial082.stdout:1538: write (excl) oid 35 current snap is 163 2026-02-12T17:35:20.063 INFO:tasks.rados.rados.0.trial082.stdout:1538: seq_num 536 ranges {608552=478174,1848819=707173} 2026-02-12T17:35:20.067 INFO:tasks.rados.rados.0.trial082.stdout:1538: writing trial08226312-35 from 608552 to 1086726 tid 1 2026-02-12T17:35:20.073 INFO:tasks.rados.rados.0.trial082.stdout:1538: writing trial08226312-35 from 1848819 to 2555992 tid 2 2026-02-12T17:35:20.073 INFO:tasks.rados.rados.0.trial082.stdout:1539: write oid 28 current snap is 163 2026-02-12T17:35:20.073 INFO:tasks.rados.rados.0.trial082.stdout:1539: seq_num 537 ranges {625359=553423,1790948=567184,2930500=94859} 2026-02-12T17:35:20.077 INFO:tasks.rados.rados.0.trial082.stdout:1539: writing trial08226312-28 from 625359 to 1178782 tid 1 2026-02-12T17:35:20.082 INFO:tasks.rados.rados.0.trial082.stdout:1539: writing trial08226312-28 from 1790948 to 2358132 tid 2 2026-02-12T17:35:20.085 INFO:tasks.rados.rados.0.trial082.stdout:1539: writing trial08226312-28 from 2930500 to 3025359 tid 3 2026-02-12T17:35:20.085 INFO:tasks.rados.rados.0.trial082.stdout:1540: snap_create 2026-02-12T17:35:20.085 INFO:tasks.rados.rados.0.trial082.stdout:1533: finishing write tid 2 to trial08226312-5 2026-02-12T17:35:20.085 INFO:tasks.rados.rados.0.trial082.stdout:1533: finishing write tid 3 to trial08226312-5 2026-02-12T17:35:20.085 INFO:tasks.rados.rados.0.trial082.stdout:1533: finishing write tid 4 to trial08226312-5 2026-02-12T17:35:20.085 INFO:tasks.rados.rados.0.trial082.stdout:1533: finishing write tid 5 to trial08226312-5 2026-02-12T17:35:20.086 INFO:tasks.rados.rados.0.trial082.stdout:1533: oid 5 updating version 0 to 851 2026-02-12T17:35:20.086 INFO:tasks.rados.rados.0.trial082.stdout:1533: oid 5 version 851 is already newer than 849 2026-02-12T17:35:20.086 INFO:tasks.rados.rados.0.trial082.stdout:1533: oid 5 version 851 is already newer than 850 2026-02-12T17:35:20.086 INFO:tasks.rados.rados.0.trial082.stdout:1533: oid 5 updating version 851 to 852 2026-02-12T17:35:20.086 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 852 (ObjNum 534 snap 163 seq_num 534) dirty exists 2026-02-12T17:35:20.086 INFO:tasks.rados.rados.0.trial082.stdout:1533: left oid 5 (ObjNum 534 snap 163 seq_num 534) 2026-02-12T17:35:20.086 INFO:tasks.rados.rados.0.trial082.stdout:1534: expect (ObjNum 436 snap 137 seq_num 436) 2026-02-12T17:35:20.086 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:20.154 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3299357 2026-02-12T17:35:20.160 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1111437 2026-02-12T17:35:20.190 INFO:tasks.rados.rados.0.trial082.stdout:1536: finishing write tid 1 to trial08226312-9 2026-02-12T17:35:20.190 INFO:tasks.rados.rados.0.trial082.stdout:1535: finishing copy_from racing read to trial08226312-20 2026-02-12T17:35:20.190 INFO:tasks.rados.rados.0.trial082.stdout:1535: finishing copy_from to trial08226312-20 2026-02-12T17:35:20.190 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 840 (ObjNum 501 snap 156 seq_num 501) dirty exists 2026-02-12T17:35:20.190 INFO:tasks.rados.rados.0.trial082.stdout:1536: finishing write tid 2 to trial08226312-9 2026-02-12T17:35:20.190 INFO:tasks.rados.rados.0.trial082.stdout:1536: finishing write tid 3 to trial08226312-9 2026-02-12T17:35:20.190 INFO:tasks.rados.rados.0.trial082.stdout:1536: finishing write tid 4 to trial08226312-9 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1536: oid 9 updating version 0 to 937 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1536: oid 9 version 937 is already newer than 935 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1536: oid 9 version 937 is already newer than 936 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 937 (ObjNum 535 snap 163 seq_num 535) dirty exists 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1536: left oid 9 (ObjNum 535 snap 163 seq_num 535) 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1538: finishing write tid 1 to trial08226312-35 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1538: finishing write tid 2 to trial08226312-35 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1538: finishing write tid 3 to trial08226312-35 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1538: finishing write tid 4 to trial08226312-35 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1538: oid 35 updating version 0 to 849 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1538: oid 35 updating version 849 to 851 2026-02-12T17:35:20.191 INFO:tasks.rados.rados.0.trial082.stdout:1538: oid 35 version 851 is already newer than 850 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 851 (ObjNum 536 snap 163 seq_num 536) dirty exists 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1538: left oid 35 (ObjNum 536 snap 163 seq_num 536) 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1539: finishing write tid 1 to trial08226312-28 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1539: finishing write tid 2 to trial08226312-28 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1539: finishing write tid 3 to trial08226312-28 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1539: finishing write tid 4 to trial08226312-28 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1539: finishing write tid 5 to trial08226312-28 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1539: oid 28 updating version 0 to 942 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1539: oid 28 updating version 942 to 943 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1539: oid 28 updating version 943 to 944 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:1539: oid 28 updating version 944 to 945 2026-02-12T17:35:20.192 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 945 (ObjNum 537 snap 163 seq_num 537) dirty exists 2026-02-12T17:35:20.193 INFO:tasks.rados.rados.0.trial082.stdout:1539: left oid 28 (ObjNum 537 snap 163 seq_num 537) 2026-02-12T17:35:21.067 INFO:tasks.rados.rados.0.trial082.stdout:1533: done (6 left) 2026-02-12T17:35:21.067 INFO:tasks.rados.rados.0.trial082.stdout:1534: done (5 left) 2026-02-12T17:35:21.067 INFO:tasks.rados.rados.0.trial082.stdout:1535: done (4 left) 2026-02-12T17:35:21.067 INFO:tasks.rados.rados.0.trial082.stdout:1536: done (3 left) 2026-02-12T17:35:21.067 INFO:tasks.rados.rados.0.trial082.stdout:1538: done (2 left) 2026-02-12T17:35:21.067 INFO:tasks.rados.rados.0.trial082.stdout:1539: done (1 left) 2026-02-12T17:35:21.067 INFO:tasks.rados.rados.0.trial082.stdout:1540: done (0 left) 2026-02-12T17:35:21.068 INFO:tasks.rados.rados.0.trial082.stdout:1541: snap_create 2026-02-12T17:35:22.067 INFO:tasks.rados.rados.0.trial082.stdout:1541: done (0 left) 2026-02-12T17:35:22.067 INFO:tasks.rados.rados.0.trial082.stdout:1542: snap_remove snap 157 2026-02-12T17:35:23.045 INFO:tasks.rados.rados.0.trial082.stdout:1542: done (0 left) 2026-02-12T17:35:23.045 INFO:tasks.rados.rados.0.trial082.stdout:1543: write oid 19 current snap is 165 2026-02-12T17:35:23.045 INFO:tasks.rados.rados.0.trial082.stdout:1543: seq_num 538 ranges {642166=628672,1849430=710842} 2026-02-12T17:35:23.050 INFO:tasks.rados.rados.0.trial082.stdout:1543: writing trial08226312-19 from 642166 to 1270838 tid 1 2026-02-12T17:35:23.055 INFO:tasks.rados.rados.0.trial082.stdout:1543: writing trial08226312-19 from 1849430 to 2560272 tid 2 2026-02-12T17:35:23.055 INFO:tasks.rados.rados.0.trial082.stdout:1544: snap_remove snap 164 2026-02-12T17:35:24.045 INFO:tasks.rados.rados.0.trial082.stdout:1544: done (1 left) 2026-02-12T17:35:24.046 INFO:tasks.rados.rados.0.trial082.stdout:1545: snap_remove snap 132 2026-02-12T17:35:25.047 INFO:tasks.rados.rados.0.trial082.stdout:1545: done (1 left) 2026-02-12T17:35:25.047 INFO:tasks.rados.rados.0.trial082.stdout:1546: copy_from oid 10 from oid 45 current snap is 165 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1543: finishing write tid 1 to trial08226312-19 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1543: finishing write tid 2 to trial08226312-19 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1543: finishing write tid 3 to trial08226312-19 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1543: finishing write tid 4 to trial08226312-19 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1543: oid 19 updating version 0 to 1149 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1543: oid 19 updating version 1149 to 1150 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1543: oid 19 version 1150 is already newer than 1148 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 1150 (ObjNum 538 snap 165 seq_num 538) dirty exists 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1543: left oid 19 (ObjNum 538 snap 165 seq_num 538) 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1543: done (1 left) 2026-02-12T17:35:25.048 INFO:tasks.rados.rados.0.trial082.stdout:1547: read oid 11 snap -1 2026-02-12T17:35:25.049 INFO:tasks.rados.rados.0.trial082.stdout:1547: expect (ObjNum 524 snap 160 seq_num 524) 2026-02-12T17:35:25.049 INFO:tasks.rados.rados.0.trial082.stdout:1548: read oid 15 snap -1 2026-02-12T17:35:25.049 INFO:tasks.rados.rados.0.trial082.stdout:1548: expect (ObjNum 501 snap 156 seq_num 501) 2026-02-12T17:35:25.049 INFO:tasks.rados.rados.0.trial082.stdout:1549: read oid 46 snap -1 2026-02-12T17:35:25.049 INFO:tasks.rados.rados.0.trial082.stdout:1549: expect (ObjNum 522 snap 160 seq_num 522) 2026-02-12T17:35:25.049 INFO:tasks.rados.rados.0.trial082.stdout:1550: snap_remove snap 155 2026-02-12T17:35:26.048 INFO:tasks.rados.rados.0.trial082.stdout:1550: done (4 left) 2026-02-12T17:35:26.048 INFO:tasks.rados.rados.0.trial082.stdout:1551: snap_create 2026-02-12T17:35:26.048 INFO:tasks.rados.rados.0.trial082.stdout:1548: expect (ObjNum 501 snap 156 seq_num 501) 2026-02-12T17:35:26.086 INFO:tasks.rados.rados.0.trial082.stdout:1547: expect (ObjNum 524 snap 160 seq_num 524) 2026-02-12T17:35:26.202 INFO:tasks.rados.rados.0.trial082.stdout:1549: expect (ObjNum 522 snap 160 seq_num 522) 2026-02-12T17:35:26.233 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:26.266 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:26.299 INFO:tasks.rados.rados.0.trial082.stdout:1546: finishing copy_from racing read to trial08226312-10 2026-02-12T17:35:26.299 INFO:tasks.rados.rados.0.trial082.stdout:1546: finishing copy_from to trial08226312-10 2026-02-12T17:35:26.300 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 838 (ObjNum 504 snap 156 seq_num 504) dirty exists 2026-02-12T17:35:27.049 INFO:tasks.rados.rados.0.trial082.stdout:1546: done (4 left) 2026-02-12T17:35:27.049 INFO:tasks.rados.rados.0.trial082.stdout:1547: done (3 left) 2026-02-12T17:35:27.049 INFO:tasks.rados.rados.0.trial082.stdout:1548: done (2 left) 2026-02-12T17:35:27.049 INFO:tasks.rados.rados.0.trial082.stdout:1549: done (1 left) 2026-02-12T17:35:27.050 INFO:tasks.rados.rados.0.trial082.stdout:1551: done (0 left) 2026-02-12T17:35:27.050 INFO:tasks.rados.rados.0.trial082.stdout:1552: write oid 34 current snap is 166 2026-02-12T17:35:27.050 INFO:tasks.rados.rados.0.trial082.stdout:1552: seq_num 539 ranges {658973=703921,1907912=570853,2985346=73627} 2026-02-12T17:35:27.054 INFO:tasks.rados.rados.0.trial082.stdout:1552: writing trial08226312-34 from 658973 to 1362894 tid 1 2026-02-12T17:35:27.058 INFO:tasks.rados.rados.0.trial082.stdout:1552: writing trial08226312-34 from 1907912 to 2478765 tid 2 2026-02-12T17:35:27.061 INFO:tasks.rados.rados.0.trial082.stdout:1552: writing trial08226312-34 from 2985346 to 3058973 tid 3 2026-02-12T17:35:27.061 INFO:tasks.rados.rados.0.trial082.stdout:1553: delete oid 23 current snap is 166 2026-02-12T17:35:27.061 INFO:tasks.rados.rados.0.trial082.stdout:1552: finishing write tid 1 to trial08226312-34 2026-02-12T17:35:27.061 INFO:tasks.rados.rados.0.trial082.stdout:1552: finishing write tid 2 to trial08226312-34 2026-02-12T17:35:27.062 INFO:tasks.rados.rados.0.trial082.stdout:1552: finishing write tid 3 to trial08226312-34 2026-02-12T17:35:27.062 INFO:tasks.rados.rados.0.trial082.stdout:1552: finishing write tid 4 to trial08226312-34 2026-02-12T17:35:27.062 INFO:tasks.rados.rados.0.trial082.stdout:1552: finishing write tid 5 to trial08226312-34 2026-02-12T17:35:27.062 INFO:tasks.rados.rados.0.trial082.stdout:1552: oid 34 updating version 0 to 817 2026-02-12T17:35:27.062 INFO:tasks.rados.rados.0.trial082.stdout:1552: oid 34 version 817 is already newer than 815 2026-02-12T17:35:27.062 INFO:tasks.rados.rados.0.trial082.stdout:1552: oid 34 updating version 817 to 818 2026-02-12T17:35:27.062 INFO:tasks.rados.rados.0.trial082.stdout:1552: oid 34 version 818 is already newer than 816 2026-02-12T17:35:27.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 818 (ObjNum 539 snap 166 seq_num 539) dirty exists 2026-02-12T17:35:27.063 INFO:tasks.rados.rados.0.trial082.stdout:1552: left oid 34 (ObjNum 539 snap 166 seq_num 539) 2026-02-12T17:35:27.063 INFO:tasks.rados.rados.0.trial082.stdout:1552: done (1 left) 2026-02-12T17:35:27.064 INFO:tasks.rados.rados.0.trial082.stdout:1553: done (0 left) 2026-02-12T17:35:27.064 INFO:tasks.rados.rados.0.trial082.stdout:1554: read oid 39 snap 150 2026-02-12T17:35:27.064 INFO:tasks.rados.rados.0.trial082.stdout:1554: expect deleted 2026-02-12T17:35:27.064 INFO:tasks.rados.rados.0.trial082.stdout:1555: snap_remove snap 161 2026-02-12T17:35:28.045 INFO:tasks.rados.rados.0.trial082.stdout:1555: done (1 left) 2026-02-12T17:35:28.045 INFO:tasks.rados.rados.0.trial082.stdout:1556: snap_create 2026-02-12T17:35:29.046 INFO:tasks.rados.rados.0.trial082.stdout:1554: done (1 left) 2026-02-12T17:35:29.047 INFO:tasks.rados.rados.0.trial082.stdout:1556: done (0 left) 2026-02-12T17:35:29.047 INFO:tasks.rados.rados.0.trial082.stdout:1557: delete oid 50 current snap is 167 2026-02-12T17:35:29.048 INFO:tasks.rados.rados.0.trial082.stdout:1557: done (0 left) 2026-02-12T17:35:29.048 INFO:tasks.rados.rados.0.trial082.stdout:1558: read oid 43 snap -1 2026-02-12T17:35:29.048 INFO:tasks.rados.rados.0.trial082.stdout:1558: expect (ObjNum 508 snap 156 seq_num 508) 2026-02-12T17:35:29.048 INFO:tasks.rados.rados.0.trial082.stdout:1559: write (excl) oid 11 current snap is 167 2026-02-12T17:35:29.048 INFO:tasks.rados.rados.0.trial082.stdout:1559: seq_num 542 ranges {709394=646021,2083358=718180} 2026-02-12T17:35:29.053 INFO:tasks.rados.rados.0.trial082.stdout:1559: writing trial08226312-11 from 709394 to 1355415 tid 1 2026-02-12T17:35:29.059 INFO:tasks.rados.rados.0.trial082.stdout:1559: writing trial08226312-11 from 2083358 to 2801538 tid 2 2026-02-12T17:35:29.059 INFO:tasks.rados.rados.0.trial082.stdout:1560: write (excl) oid 19 current snap is 167 2026-02-12T17:35:29.059 INFO:tasks.rados.rados.0.trial082.stdout:1560: seq_num 543 ranges {726201=721270,2141840=578191} 2026-02-12T17:35:29.064 INFO:tasks.rados.rados.0.trial082.stdout:1560: writing trial08226312-19 from 726201 to 1447471 tid 1 2026-02-12T17:35:29.069 INFO:tasks.rados.rados.0.trial082.stdout:1560: writing trial08226312-19 from 2141840 to 2720031 tid 2 2026-02-12T17:35:29.069 INFO:tasks.rados.rados.0.trial082.stdout:1561: snap_remove snap 162 2026-02-12T17:35:30.057 INFO:tasks.rados.rados.0.trial082.stdout:1561: done (3 left) 2026-02-12T17:35:30.057 INFO:tasks.rados.rados.0.trial082.stdout:1562: write oid 49 current snap is 167 2026-02-12T17:35:30.057 INFO:tasks.rados.rados.0.trial082.stdout:1562: seq_num 544 ranges {743008=796519,2200322=721849} 2026-02-12T17:35:30.063 INFO:tasks.rados.rados.0.trial082.stdout:1562: writing trial08226312-49 from 743008 to 1539527 tid 1 2026-02-12T17:35:30.068 INFO:tasks.rados.rados.0.trial082.stdout:1562: writing trial08226312-49 from 2200322 to 2922171 tid 2 2026-02-12T17:35:30.068 INFO:tasks.rados.rados.0.trial082.stdout:1563: write (excl) oid 4 current snap is 167 2026-02-12T17:35:30.068 INFO:tasks.rados.rados.0.trial082.stdout:1563: seq_num 545 ranges {759815=471768,1742451=465507,2917178=242637} 2026-02-12T17:35:30.073 INFO:tasks.rados.rados.0.trial082.stdout:1563: writing trial08226312-4 from 759815 to 1231583 tid 1 2026-02-12T17:35:30.077 INFO:tasks.rados.rados.0.trial082.stdout:1563: writing trial08226312-4 from 1742451 to 2207958 tid 2 2026-02-12T17:35:30.081 INFO:tasks.rados.rados.0.trial082.stdout:1563: writing trial08226312-4 from 2917178 to 3159815 tid 3 2026-02-12T17:35:30.081 INFO:tasks.rados.rados.0.trial082.stdout:1564: write oid 29 current snap is 167 2026-02-12T17:35:30.081 INFO:tasks.rados.rados.0.trial082.stdout:1564: seq_num 546 ranges {776622=547017,1800933=725518,2944601=232021} 2026-02-12T17:35:30.086 INFO:tasks.rados.rados.0.trial082.stdout:1564: writing trial08226312-29 from 776622 to 1323639 tid 1 2026-02-12T17:35:30.090 INFO:tasks.rados.rados.0.trial082.stdout:1564: writing trial08226312-29 from 1800933 to 2526451 tid 2 2026-02-12T17:35:30.093 INFO:tasks.rados.rados.0.trial082.stdout:1564: writing trial08226312-29 from 2944601 to 3176622 tid 3 2026-02-12T17:35:30.093 INFO:tasks.rados.rados.0.trial082.stdout:1565: delete oid 46 current snap is 167 2026-02-12T17:35:30.093 INFO:tasks.rados.rados.0.trial082.stdout:1558: expect (ObjNum 508 snap 156 seq_num 508) 2026-02-12T17:35:30.221 INFO:tasks.rados.rados.0.trial082.stdout:1559: finishing write tid 1 to trial08226312-11 2026-02-12T17:35:30.221 INFO:tasks.rados.rados.0.trial082.stdout:1559: finishing write tid 2 to trial08226312-11 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1559: finishing write tid 3 to trial08226312-11 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1559: finishing write tid 4 to trial08226312-11 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1559: oid 11 updating version 0 to 470 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1559: oid 11 updating version 470 to 471 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1559: oid 11 version 471 is already newer than 469 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 471 (ObjNum 542 snap 167 seq_num 542) dirty exists 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1559: left oid 11 (ObjNum 542 snap 167 seq_num 542) 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1560: finishing write tid 1 to trial08226312-19 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1560: finishing write tid 2 to trial08226312-19 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1558: done (6 left) 2026-02-12T17:35:30.222 INFO:tasks.rados.rados.0.trial082.stdout:1559: done (5 left) 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1565: done (4 left) 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1566: read oid 1 snap 165 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1566: expect (ObjNum 518 snap 158 seq_num 518) 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1560: finishing write tid 3 to trial08226312-19 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1560: finishing write tid 4 to trial08226312-19 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1560: oid 19 updating version 0 to 1184 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1560: oid 19 updating version 1184 to 1185 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1560: oid 19 updating version 1185 to 1186 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 1186 (ObjNum 543 snap 167 seq_num 543) dirty exists 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1560: left oid 19 (ObjNum 543 snap 167 seq_num 543) 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1562: finishing write tid 1 to trial08226312-49 2026-02-12T17:35:30.223 INFO:tasks.rados.rados.0.trial082.stdout:1562: finishing write tid 2 to trial08226312-49 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1562: finishing write tid 3 to trial08226312-49 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1562: finishing write tid 4 to trial08226312-49 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1562: oid 49 updating version 0 to 821 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1562: oid 49 version 821 is already newer than 820 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1562: oid 49 version 821 is already newer than 819 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 821 (ObjNum 544 snap 167 seq_num 544) dirty exists 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1562: left oid 49 (ObjNum 544 snap 167 seq_num 544) 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1563: finishing write tid 1 to trial08226312-4 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1563: finishing write tid 2 to trial08226312-4 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1567: read oid 47 snap -1 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1567: expect (ObjNum 454 snap 142 seq_num 454) 2026-02-12T17:35:30.224 INFO:tasks.rados.rados.0.trial082.stdout:1560: done (5 left) 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1562: done (4 left) 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1568: copy_from oid 30 from oid 20 current snap is 167 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1563: finishing write tid 3 to trial08226312-4 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1563: finishing write tid 4 to trial08226312-4 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1563: finishing write tid 5 to trial08226312-4 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1563: oid 4 updating version 0 to 1194 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1563: oid 4 version 1194 is already newer than 1193 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1563: oid 4 updating version 1194 to 1195 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1563: oid 4 version 1195 is already newer than 1192 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 1195 (ObjNum 545 snap 167 seq_num 545) dirty exists 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1563: left oid 4 (ObjNum 545 snap 167 seq_num 545) 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1564: finishing write tid 1 to trial08226312-29 2026-02-12T17:35:30.225 INFO:tasks.rados.rados.0.trial082.stdout:1564: finishing write tid 2 to trial08226312-29 2026-02-12T17:35:30.226 INFO:tasks.rados.rados.0.trial082.stdout:1564: finishing write tid 3 to trial08226312-29 2026-02-12T17:35:30.226 INFO:tasks.rados.rados.0.trial082.stdout:1563: done (4 left) 2026-02-12T17:35:30.226 INFO:tasks.rados.rados.0.trial082.stdout:1569: write oid 49 current snap is 167 2026-02-12T17:35:30.226 INFO:tasks.rados.rados.0.trial082.stdout:1569: seq_num 548 ranges {410236=413868,1234250=729187,2715800=423063} 2026-02-12T17:35:30.226 INFO:tasks.rados.rados.0.trial082.stdout:1569: writing trial08226312-49 from 410236 to 824104 tid 1 2026-02-12T17:35:30.228 INFO:tasks.rados.rados.0.trial082.stdout:1569: writing trial08226312-49 from 1234250 to 1963437 tid 2 2026-02-12T17:35:30.232 INFO:tasks.rados.rados.0.trial082.stdout:1569: writing trial08226312-49 from 2715800 to 3138863 tid 3 2026-02-12T17:35:30.233 INFO:tasks.rados.rados.0.trial082.stdout:1570: snap_remove snap 149 2026-02-12T17:35:31.061 INFO:tasks.rados.rados.0.trial082.stdout:1570: done (5 left) 2026-02-12T17:35:31.061 INFO:tasks.rados.rados.0.trial082.stdout:1571: copy_from oid 38 from oid 41 current snap is 167 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1564: finishing write tid 4 to trial08226312-29 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1564: finishing write tid 5 to trial08226312-29 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1564: oid 29 updating version 0 to 691 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1564: oid 29 updating version 691 to 692 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1564: oid 29 version 692 is already newer than 689 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1564: oid 29 version 692 is already newer than 690 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 692 (ObjNum 546 snap 167 seq_num 546) dirty exists 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1564: left oid 29 (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:1566: expect (ObjNum 518 snap 158 seq_num 518) 2026-02-12T17:35:31.062 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:31.148 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:31.190 INFO:tasks.rados.rados.0.trial082.stdout:1567: expect (ObjNum 454 snap 142 seq_num 454) 2026-02-12T17:35:31.245 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:1569: finishing write tid 1 to trial08226312-49 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:1564: done (5 left) 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:1566: done (4 left) 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:1567: done (3 left) 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:1572: write (excl) oid 14 current snap is 167 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:1568: finishing copy_from racing read to trial08226312-30 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:1569: finishing write tid 2 to trial08226312-49 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:1568: finishing copy_from to trial08226312-30 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 840 (ObjNum 501 snap 156 seq_num 501) dirty exists 2026-02-12T17:35:31.358 INFO:tasks.rados.rados.0.trial082.stdout:1569: finishing write tid 3 to trial08226312-49 2026-02-12T17:35:31.359 INFO:tasks.rados.rados.0.trial082.stdout:1569: finishing write tid 4 to trial08226312-49 2026-02-12T17:35:31.359 INFO:tasks.rados.rados.0.trial082.stdout:1572: seq_num 549 ranges {427043=489117,1576379=472845,2626870=600173} 2026-02-12T17:35:31.361 INFO:tasks.rados.rados.0.trial082.stdout:1572: writing trial08226312-14 from 427043 to 916160 tid 1 2026-02-12T17:35:31.365 INFO:tasks.rados.rados.0.trial082.stdout:1572: writing trial08226312-14 from 1576379 to 2049224 tid 2 2026-02-12T17:35:31.370 INFO:tasks.rados.rados.0.trial082.stdout:1572: writing trial08226312-14 from 2626870 to 3227043 tid 3 2026-02-12T17:35:31.370 INFO:tasks.rados.rados.0.trial082.stdout:1568: done (3 left) 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1573: read oid 8 snap 148 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1573: expect (ObjNum 473 snap 146 seq_num 473) 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1574: rollback oid 25 current snap is 167 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1569: finishing write tid 5 to trial08226312-49 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1569: oid 49 updating version 0 to 824 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1569: oid 49 updating version 824 to 825 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1569: oid 49 version 825 is already newer than 823 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1569: oid 49 version 825 is already newer than 822 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 825 (ObjNum 548 snap 167 seq_num 548) dirty exists 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1569: left oid 49 (ObjNum 548 snap 167 seq_num 548) 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1571: finishing copy_from racing read to trial08226312-38 2026-02-12T17:35:31.371 INFO:tasks.rados.rados.0.trial082.stdout:1571: finishing copy_from to trial08226312-38 2026-02-12T17:35:31.372 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 663 (ObjNum 514 snap 156 seq_num 514) dirty exists 2026-02-12T17:35:31.372 INFO:tasks.rados.rados.0.trial082.stdout:1572: finishing write tid 1 to trial08226312-14 2026-02-12T17:35:31.372 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 25 to 160 2026-02-12T17:35:31.372 INFO:tasks.rados.rados.0.trial082.stdout:1572: finishing write tid 2 to trial08226312-14 2026-02-12T17:35:31.372 INFO:tasks.rados.rados.0.trial082.stdout:1569: done (4 left) 2026-02-12T17:35:31.372 INFO:tasks.rados.rados.0.trial082.stdout:1571: done (3 left) 2026-02-12T17:35:31.372 INFO:tasks.rados.rados.0.trial082.stdout:1575: delete oid 44 current snap is 167 2026-02-12T17:35:31.373 INFO:tasks.rados.rados.0.trial082.stdout:1574: finishing rollback tid 1 to trial08226312-25 2026-02-12T17:35:31.373 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 503 (ObjNum 33 snap 0 seq_num 26774112) dirty dne 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1572: finishing write tid 3 to trial08226312-14 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1574: done (3 left) 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1575: done (2 left) 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1576: copy_from oid 42 from oid 48 current snap is 167 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1572: finishing write tid 4 to trial08226312-14 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1577: snap_create 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1572: finishing write tid 5 to trial08226312-14 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1572: oid 14 updating version 0 to 854 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1572: oid 14 updating version 854 to 855 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1572: oid 14 updating version 855 to 856 2026-02-12T17:35:31.374 INFO:tasks.rados.rados.0.trial082.stdout:1572: oid 14 version 856 is already newer than 853 2026-02-12T17:35:31.375 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 856 (ObjNum 549 snap 167 seq_num 549) dirty exists 2026-02-12T17:35:31.375 INFO:tasks.rados.rados.0.trial082.stdout:1572: left oid 14 (ObjNum 549 snap 167 seq_num 549) 2026-02-12T17:35:31.375 INFO:tasks.rados.rados.0.trial082.stdout:1576: finishing copy_from to trial08226312-42 2026-02-12T17:35:31.375 INFO:tasks.rados.rados.0.trial082.stdout:1576: got expected ENOENT (src dne) 2026-02-12T17:35:31.375 INFO:tasks.rados.rados.0.trial082.stdout:1576: finishing copy_from racing read to trial08226312-42 2026-02-12T17:35:31.375 INFO:tasks.rados.rados.0.trial082.stdout:1573: expect (ObjNum 473 snap 146 seq_num 473) 2026-02-12T17:35:31.478 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:32.064 INFO:tasks.rados.rados.0.trial082.stdout:1572: done (3 left) 2026-02-12T17:35:32.064 INFO:tasks.rados.rados.0.trial082.stdout:1573: done (2 left) 2026-02-12T17:35:32.064 INFO:tasks.rados.rados.0.trial082.stdout:1576: done (1 left) 2026-02-12T17:35:32.064 INFO:tasks.rados.rados.0.trial082.stdout:1577: done (0 left) 2026-02-12T17:35:32.064 INFO:tasks.rados.rados.0.trial082.stdout:1578: rollback oid 41 current snap is 168 2026-02-12T17:35:32.064 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 166 2026-02-12T17:35:32.064 INFO:tasks.rados.rados.0.trial082.stdout:1579: snap_remove snap 150 2026-02-12T17:35:33.046 INFO:tasks.rados.rados.0.trial082.stdout:1579: done (1 left) 2026-02-12T17:35:33.046 INFO:tasks.rados.rados.0.trial082.stdout:1580: write oid 3 current snap is 168 2026-02-12T17:35:33.047 INFO:tasks.rados.rados.0.trial082.stdout:1578: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:35:33.047 INFO:tasks.rados.rados.0.trial082.stdout:1578: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:35:33.047 INFO:tasks.rados.rados.0.trial082.stdout:1578: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:35:33.047 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1016 (ObjNum 514 snap 156 seq_num 514) dirty exists 2026-02-12T17:35:33.047 INFO:tasks.rados.rados.0.trial082.stdout:1580: seq_num 551 ranges {460657=639615,1693343=476514,2681716=578941} 2026-02-12T17:35:33.050 INFO:tasks.rados.rados.0.trial082.stdout:1580: writing trial08226312-3 from 460657 to 1100272 tid 1 2026-02-12T17:35:33.054 INFO:tasks.rados.rados.0.trial082.stdout:1580: writing trial08226312-3 from 1693343 to 2169857 tid 2 2026-02-12T17:35:33.058 INFO:tasks.rados.rados.0.trial082.stdout:1580: writing trial08226312-3 from 2681716 to 3260657 tid 3 2026-02-12T17:35:33.058 INFO:tasks.rados.rados.0.trial082.stdout:1578: done (1 left) 2026-02-12T17:35:33.059 INFO:tasks.rados.rados.0.trial082.stdout:1581: snap_create 2026-02-12T17:35:33.059 INFO:tasks.rados.rados.0.trial082.stdout:1580: finishing write tid 1 to trial08226312-3 2026-02-12T17:35:33.059 INFO:tasks.rados.rados.0.trial082.stdout:1580: finishing write tid 2 to trial08226312-3 2026-02-12T17:35:33.060 INFO:tasks.rados.rados.0.trial082.stdout:1580: finishing write tid 3 to trial08226312-3 2026-02-12T17:35:33.060 INFO:tasks.rados.rados.0.trial082.stdout:1580: finishing write tid 4 to trial08226312-3 2026-02-12T17:35:33.060 INFO:tasks.rados.rados.0.trial082.stdout:1580: finishing write tid 5 to trial08226312-3 2026-02-12T17:35:33.060 INFO:tasks.rados.rados.0.trial082.stdout:1580: oid 3 updating version 0 to 859 2026-02-12T17:35:33.060 INFO:tasks.rados.rados.0.trial082.stdout:1580: oid 3 version 859 is already newer than 858 2026-02-12T17:35:33.060 INFO:tasks.rados.rados.0.trial082.stdout:1580: oid 3 version 859 is already newer than 857 2026-02-12T17:35:33.060 INFO:tasks.rados.rados.0.trial082.stdout:1580: oid 3 updating version 859 to 860 2026-02-12T17:35:33.060 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 860 (ObjNum 551 snap 168 seq_num 551) dirty exists 2026-02-12T17:35:33.060 INFO:tasks.rados.rados.0.trial082.stdout:1580: left oid 3 (ObjNum 551 snap 168 seq_num 551) 2026-02-12T17:35:34.047 INFO:tasks.rados.rados.0.trial082.stdout:1580: done (1 left) 2026-02-12T17:35:34.048 INFO:tasks.rados.rados.0.trial082.stdout:1581: done (0 left) 2026-02-12T17:35:34.048 INFO:tasks.rados.rados.0.trial082.stdout:1582: read oid 12 snap -1 2026-02-12T17:35:34.048 INFO:tasks.rados.rados.0.trial082.stdout:1582: expect (ObjNum 297 snap 83 seq_num 297) 2026-02-12T17:35:34.048 INFO:tasks.rados.rados.0.trial082.stdout:1583: snap_remove snap 167 2026-02-12T17:35:35.048 INFO:tasks.rados.rados.0.trial082.stdout:1583: done (1 left) 2026-02-12T17:35:35.048 INFO:tasks.rados.rados.0.trial082.stdout:1584: rollback oid 33 current snap is 169 2026-02-12T17:35:35.048 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 159 2026-02-12T17:35:35.048 INFO:tasks.rados.rados.0.trial082.stdout:1582: expect (ObjNum 297 snap 83 seq_num 297) 2026-02-12T17:35:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1584: finishing rollback tid 0 to trial08226312-33 2026-02-12T17:35:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1584: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:35:35.167 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1018 (ObjNum 129 snap 0 seq_num 26859561) dirty dne 2026-02-12T17:35:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1582: done (1 left) 2026-02-12T17:35:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1584: done (0 left) 2026-02-12T17:35:35.168 INFO:tasks.rados.rados.0.trial082.stdout:1585: copy_from oid 47 from oid 27 current snap is 169 2026-02-12T17:35:35.168 INFO:tasks.rados.rados.0.trial082.stdout:1586: rollback oid 18 current snap is 169 2026-02-12T17:35:35.168 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 165 2026-02-12T17:35:35.168 INFO:tasks.rados.rados.0.trial082.stdout:1587: write (excl) oid 13 current snap is 169 2026-02-12T17:35:35.168 INFO:tasks.rados.rados.0.trial082.stdout:1587: seq_num 552 ranges {477464=714864,1751825=736525,3225492=51972} 2026-02-12T17:35:35.171 INFO:tasks.rados.rados.0.trial082.stdout:1587: writing trial08226312-13 from 477464 to 1192328 tid 1 2026-02-12T17:35:35.176 INFO:tasks.rados.rados.0.trial082.stdout:1587: writing trial08226312-13 from 1751825 to 2488350 tid 2 2026-02-12T17:35:35.180 INFO:tasks.rados.rados.0.trial082.stdout:1587: writing trial08226312-13 from 3225492 to 3277464 tid 3 2026-02-12T17:35:35.180 INFO:tasks.rados.rados.0.trial082.stdout:1588: rollback oid 49 current snap is 169 2026-02-12T17:35:35.180 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 166 2026-02-12T17:35:35.180 INFO:tasks.rados.rados.0.trial082.stdout:1586: finishing rollback tid 0 to trial08226312-18 2026-02-12T17:35:35.180 INFO:tasks.rados.rados.0.trial082.stdout:1586: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:35:35.180 INFO:tasks.rados.rados.0.trial082.stdout:1586: finishing rollback tid 2 to trial08226312-18 2026-02-12T17:35:35.180 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 828 (ObjNum 464 snap 146 seq_num 464) dirty exists 2026-02-12T17:35:35.180 INFO:tasks.rados.rados.0.trial082.stdout:1587: finishing write tid 1 to trial08226312-13 2026-02-12T17:35:35.180 INFO:tasks.rados.rados.0.trial082.stdout:1585: finishing copy_from racing read to trial08226312-47 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1585: finishing copy_from to trial08226312-47 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 299 (ObjNum 510 snap 156 seq_num 510) dirty exists 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1587: finishing write tid 2 to trial08226312-13 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1585: done (3 left) 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1586: done (2 left) 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1589: read oid 21 snap -1 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1589: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1590: rollback oid 23 current snap is 169 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 23 to 166 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1591: copy_from oid 1 from oid 16 current snap is 169 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1592: delete oid 26 current snap is 169 2026-02-12T17:35:35.181 INFO:tasks.rados.rados.0.trial082.stdout:1587: finishing write tid 3 to trial08226312-13 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:1587: finishing write tid 4 to trial08226312-13 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:1587: finishing write tid 5 to trial08226312-13 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:1587: oid 13 updating version 0 to 508 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:1587: oid 13 updating version 508 to 510 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:1587: oid 13 version 510 is already newer than 507 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:1587: oid 13 version 510 is already newer than 509 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 510 (ObjNum 552 snap 169 seq_num 552) dirty exists 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:1587: left oid 13 (ObjNum 552 snap 169 seq_num 552) 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:1590: finishing rollback tid 1 to trial08226312-23 2026-02-12T17:35:35.183 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 852 (ObjNum 145 snap 0 seq_num 27099219) dirty dne 2026-02-12T17:35:35.184 INFO:tasks.rados.rados.0.trial082.stdout:1588: finishing rollback tid 0 to trial08226312-49 2026-02-12T17:35:35.184 INFO:tasks.rados.rados.0.trial082.stdout:1587: done (5 left) 2026-02-12T17:35:35.184 INFO:tasks.rados.rados.0.trial082.stdout:1590: done (4 left) 2026-02-12T17:35:35.184 INFO:tasks.rados.rados.0.trial082.stdout:1592: done (3 left) 2026-02-12T17:35:35.184 INFO:tasks.rados.rados.0.trial082.stdout:1593: write oid 47 current snap is 169 2026-02-12T17:35:35.184 INFO:tasks.rados.rados.0.trial082.stdout:1593: seq_num 554 ranges {511078=465362,1752436=740194,3163985=147093} 2026-02-12T17:35:35.184 INFO:tasks.rados.rados.0.trial082.stdout:1593: writing trial08226312-47 from 511078 to 976440 tid 1 2026-02-12T17:35:35.190 INFO:tasks.rados.rados.0.trial082.stdout:1593: writing trial08226312-47 from 1752436 to 2492630 tid 2 2026-02-12T17:35:35.194 INFO:tasks.rados.rados.0.trial082.stdout:1593: writing trial08226312-47 from 3163985 to 3311078 tid 3 2026-02-12T17:35:35.194 INFO:tasks.rados.rados.0.trial082.stdout:1594: write (excl) oid 22 current snap is 169 2026-02-12T17:35:35.194 INFO:tasks.rados.rados.0.trial082.stdout:1588: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:35:35.194 INFO:tasks.rados.rados.0.trial082.stdout:1588: finishing rollback tid 2 to trial08226312-49 2026-02-12T17:35:35.194 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 831 (ObjNum 517 snap 157 seq_num 517) dirty exists 2026-02-12T17:35:35.194 INFO:tasks.rados.rados.0.trial082.stdout:1589: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:35:35.194 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:35.243 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1684664 2026-02-12T17:35:35.252 INFO:tasks.rados.rados.0.trial082.stdout:1593: finishing write tid 1 to trial08226312-47 2026-02-12T17:35:35.252 INFO:tasks.rados.rados.0.trial082.stdout:1593: finishing write tid 2 to trial08226312-47 2026-02-12T17:35:35.252 INFO:tasks.rados.rados.0.trial082.stdout:1591: finishing copy_from racing read to trial08226312-1 2026-02-12T17:35:35.252 INFO:tasks.rados.rados.0.trial082.stdout:1593: finishing write tid 3 to trial08226312-47 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:1593: finishing write tid 4 to trial08226312-47 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:1593: finishing write tid 5 to trial08226312-47 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:1593: oid 47 updating version 0 to 1228 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:1593: oid 47 version 1228 is already newer than 1227 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:1593: oid 47 updating version 1228 to 1229 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:1593: oid 47 version 1229 is already newer than 1226 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1229 (ObjNum 554 snap 169 seq_num 554) dirty exists 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:1593: left oid 47 (ObjNum 554 snap 169 seq_num 554) 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:1591: finishing copy_from to trial08226312-1 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 924 (ObjNum 526 snap 162 seq_num 526) dirty exists 2026-02-12T17:35:35.253 INFO:tasks.rados.rados.0.trial082.stdout:1594: seq_num 555 ranges {527885=656964,1927271=483852,3191408=136477} 2026-02-12T17:35:35.256 INFO:tasks.rados.rados.0.trial082.stdout:1594: writing trial08226312-22 from 527885 to 1184849 tid 1 2026-02-12T17:35:35.261 INFO:tasks.rados.rados.0.trial082.stdout:1594: writing trial08226312-22 from 1927271 to 2411123 tid 2 2026-02-12T17:35:35.264 INFO:tasks.rados.rados.0.trial082.stdout:1594: writing trial08226312-22 from 3191408 to 3327885 tid 3 2026-02-12T17:35:35.264 INFO:tasks.rados.rados.0.trial082.stdout:1588: done (4 left) 2026-02-12T17:35:35.264 INFO:tasks.rados.rados.0.trial082.stdout:1589: done (3 left) 2026-02-12T17:35:35.265 INFO:tasks.rados.rados.0.trial082.stdout:1591: done (2 left) 2026-02-12T17:35:35.265 INFO:tasks.rados.rados.0.trial082.stdout:1593: done (1 left) 2026-02-12T17:35:35.265 INFO:tasks.rados.rados.0.trial082.stdout:1595: delete oid 30 current snap is 169 2026-02-12T17:35:35.265 INFO:tasks.rados.rados.0.trial082.stdout:1594: finishing write tid 1 to trial08226312-22 2026-02-12T17:35:35.265 INFO:tasks.rados.rados.0.trial082.stdout:1594: finishing write tid 2 to trial08226312-22 2026-02-12T17:35:35.266 INFO:tasks.rados.rados.0.trial082.stdout:1594: finishing write tid 3 to trial08226312-22 2026-02-12T17:35:35.266 INFO:tasks.rados.rados.0.trial082.stdout:1594: finishing write tid 4 to trial08226312-22 2026-02-12T17:35:35.266 INFO:tasks.rados.rados.0.trial082.stdout:1594: finishing write tid 5 to trial08226312-22 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:1594: oid 22 updating version 0 to 1078 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:1594: oid 22 updating version 1078 to 1079 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:1594: oid 22 version 1079 is already newer than 1077 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:1594: oid 22 version 1079 is already newer than 1076 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 1079 (ObjNum 555 snap 169 seq_num 555) dirty exists 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:1594: left oid 22 (ObjNum 555 snap 169 seq_num 555) 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:1594: done (1 left) 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:1595: done (0 left) 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:1596: write oid 3 current snap is 169 2026-02-12T17:35:35.267 INFO:tasks.rados.rados.0.trial082.stdout:1596: seq_num 557 ranges {561499=407462,1527882=487521,2729901=557217} 2026-02-12T17:35:35.270 INFO:tasks.rados.rados.0.trial082.stdout:1596: writing trial08226312-3 from 561499 to 968961 tid 1 2026-02-12T17:35:35.273 INFO:tasks.rados.rados.0.trial082.stdout:1596: writing trial08226312-3 from 1527882 to 2015403 tid 2 2026-02-12T17:35:35.278 INFO:tasks.rados.rados.0.trial082.stdout:1596: writing trial08226312-3 from 2729901 to 3287118 tid 3 2026-02-12T17:35:35.278 INFO:tasks.rados.rados.0.trial082.stdout:1597: delete oid 16 current snap is 169 2026-02-12T17:35:35.279 INFO:tasks.rados.rados.0.trial082.stdout:1596: finishing write tid 1 to trial08226312-3 2026-02-12T17:35:35.279 INFO:tasks.rados.rados.0.trial082.stdout:1596: finishing write tid 2 to trial08226312-3 2026-02-12T17:35:35.280 INFO:tasks.rados.rados.0.trial082.stdout:1597: done (1 left) 2026-02-12T17:35:35.280 INFO:tasks.rados.rados.0.trial082.stdout:1598: read oid 15 snap -1 2026-02-12T17:35:35.280 INFO:tasks.rados.rados.0.trial082.stdout:1598: expect (ObjNum 501 snap 156 seq_num 501) 2026-02-12T17:35:35.280 INFO:tasks.rados.rados.0.trial082.stdout:1599: snap_create 2026-02-12T17:35:35.281 INFO:tasks.rados.rados.0.trial082.stdout:1596: finishing write tid 3 to trial08226312-3 2026-02-12T17:35:35.284 INFO:tasks.rados.rados.0.trial082.stdout:1598: expect (ObjNum 501 snap 156 seq_num 501) 2026-02-12T17:35:35.285 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:35.302 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:35.319 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:35.337 INFO:tasks.rados.rados.0.trial082.stdout:1596: finishing write tid 4 to trial08226312-3 2026-02-12T17:35:35.337 INFO:tasks.rados.rados.0.trial082.stdout:1596: finishing write tid 5 to trial08226312-3 2026-02-12T17:35:35.337 INFO:tasks.rados.rados.0.trial082.stdout:1596: oid 3 updating version 0 to 862 2026-02-12T17:35:35.337 INFO:tasks.rados.rados.0.trial082.stdout:1596: oid 3 version 862 is already newer than 861 2026-02-12T17:35:35.337 INFO:tasks.rados.rados.0.trial082.stdout:1596: oid 3 updating version 862 to 863 2026-02-12T17:35:35.337 INFO:tasks.rados.rados.0.trial082.stdout:1596: oid 3 updating version 863 to 864 2026-02-12T17:35:35.337 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 864 (ObjNum 557 snap 169 seq_num 557) dirty exists 2026-02-12T17:35:35.337 INFO:tasks.rados.rados.0.trial082.stdout:1596: left oid 3 (ObjNum 557 snap 169 seq_num 557) 2026-02-12T17:35:36.052 INFO:tasks.rados.rados.0.trial082.stdout:1596: done (2 left) 2026-02-12T17:35:36.052 INFO:tasks.rados.rados.0.trial082.stdout:1598: done (1 left) 2026-02-12T17:35:36.053 INFO:tasks.rados.rados.0.trial082.stdout:1599: done (0 left) 2026-02-12T17:35:36.053 INFO:tasks.rados.rados.0.trial082.stdout:1600: snap_create 2026-02-12T17:35:37.053 INFO:tasks.rados.rados.0.trial082.stdout:1600: done (0 left) 2026-02-12T17:35:37.054 INFO:tasks.rados.rados.0.trial082.stdout:1601: write (excl) oid 34 current snap is 171 2026-02-12T17:35:37.054 INFO:tasks.rados.rados.0.trial082.stdout:1601: seq_num 559 ranges {595113=557960,1644846=491190,2784747=610366} 2026-02-12T17:35:37.057 INFO:tasks.rados.rados.0.trial082.stdout:1601: writing trial08226312-34 from 595113 to 1153073 tid 1 2026-02-12T17:35:37.061 INFO:tasks.rados.rados.0.trial082.stdout:1601: writing trial08226312-34 from 1644846 to 2136036 tid 2 2026-02-12T17:35:37.066 INFO:tasks.rados.rados.0.trial082.stdout:1601: writing trial08226312-34 from 2784747 to 3395113 tid 3 2026-02-12T17:35:37.066 INFO:tasks.rados.rados.0.trial082.stdout:1602: snap_create 2026-02-12T17:35:37.066 INFO:tasks.rados.rados.0.trial082.stdout:1601: finishing write tid 1 to trial08226312-34 2026-02-12T17:35:37.066 INFO:tasks.rados.rados.0.trial082.stdout:1601: finishing write tid 2 to trial08226312-34 2026-02-12T17:35:37.068 INFO:tasks.rados.rados.0.trial082.stdout:1601: finishing write tid 3 to trial08226312-34 2026-02-12T17:35:37.068 INFO:tasks.rados.rados.0.trial082.stdout:1601: finishing write tid 4 to trial08226312-34 2026-02-12T17:35:37.068 INFO:tasks.rados.rados.0.trial082.stdout:1601: finishing write tid 5 to trial08226312-34 2026-02-12T17:35:37.068 INFO:tasks.rados.rados.0.trial082.stdout:1601: oid 34 updating version 0 to 834 2026-02-12T17:35:37.069 INFO:tasks.rados.rados.0.trial082.stdout:1601: oid 34 version 834 is already newer than 833 2026-02-12T17:35:37.069 INFO:tasks.rados.rados.0.trial082.stdout:1601: oid 34 updating version 834 to 835 2026-02-12T17:35:37.069 INFO:tasks.rados.rados.0.trial082.stdout:1601: oid 34 version 835 is already newer than 832 2026-02-12T17:35:37.069 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 835 (ObjNum 559 snap 171 seq_num 559) dirty exists 2026-02-12T17:35:37.069 INFO:tasks.rados.rados.0.trial082.stdout:1601: left oid 34 (ObjNum 559 snap 171 seq_num 559) 2026-02-12T17:35:38.048 INFO:tasks.rados.rados.0.trial082.stdout:1601: done (1 left) 2026-02-12T17:35:38.048 INFO:tasks.rados.rados.0.trial082.stdout:1602: done (0 left) 2026-02-12T17:35:38.048 INFO:tasks.rados.rados.0.trial082.stdout:1603: rollback oid 27 current snap is 172 2026-02-12T17:35:38.048 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 165 2026-02-12T17:35:38.048 INFO:tasks.rados.rados.0.trial082.stdout:1604: rollback oid 4 current snap is 172 2026-02-12T17:35:38.048 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 4 to 159 2026-02-12T17:35:38.048 INFO:tasks.rados.rados.0.trial082.stdout:1605: copy_from oid 17 from oid 14 current snap is 172 2026-02-12T17:35:38.048 INFO:tasks.rados.rados.0.trial082.stdout:1606: read oid 47 snap -1 2026-02-12T17:35:38.048 INFO:tasks.rados.rados.0.trial082.stdout:1606: expect (ObjNum 554 snap 169 seq_num 554) 2026-02-12T17:35:38.049 INFO:tasks.rados.rados.0.trial082.stdout:1607: rollback oid 43 current snap is 172 2026-02-12T17:35:38.049 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 43 to 165 2026-02-12T17:35:38.049 INFO:tasks.rados.rados.0.trial082.stdout:1608: snap_remove snap 169 2026-02-12T17:35:39.049 INFO:tasks.rados.rados.0.trial082.stdout:1608: done (5 left) 2026-02-12T17:35:39.049 INFO:tasks.rados.rados.0.trial082.stdout:1609: write (excl) oid 32 current snap is 172 2026-02-12T17:35:39.050 INFO:tasks.rados.rados.0.trial082.stdout:1609: seq_num 560 ranges {611920=633209,1703328=634848,2812170=507386} 2026-02-12T17:35:39.054 INFO:tasks.rados.rados.0.trial082.stdout:1609: writing trial08226312-32 from 611920 to 1245129 tid 1 2026-02-12T17:35:39.058 INFO:tasks.rados.rados.0.trial082.stdout:1609: writing trial08226312-32 from 1703328 to 2338176 tid 2 2026-02-12T17:35:39.062 INFO:tasks.rados.rados.0.trial082.stdout:1609: writing trial08226312-32 from 2812170 to 3319556 tid 3 2026-02-12T17:35:39.062 INFO:tasks.rados.rados.0.trial082.stdout:1610: snap_remove snap 166 2026-02-12T17:35:40.062 INFO:tasks.rados.rados.0.trial082.stdout:1610: done (6 left) 2026-02-12T17:35:40.062 INFO:tasks.rados.rados.0.trial082.stdout:1611: copy_from oid 15 from oid 37 current snap is 172 2026-02-12T17:35:40.062 INFO:tasks.rados.rados.0.trial082.stdout:1607: finishing rollback tid 0 to trial08226312-43 2026-02-12T17:35:40.062 INFO:tasks.rados.rados.0.trial082.stdout:1607: finishing rollback tid 1 to trial08226312-43 2026-02-12T17:35:40.062 INFO:tasks.rados.rados.0.trial082.stdout:1607: finishing rollback tid 2 to trial08226312-43 2026-02-12T17:35:40.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 1083 (ObjNum 508 snap 156 seq_num 508) dirty exists 2026-02-12T17:35:40.062 INFO:tasks.rados.rados.0.trial082.stdout:1603: finishing rollback tid 0 to trial08226312-27 2026-02-12T17:35:40.062 INFO:tasks.rados.rados.0.trial082.stdout:1603: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:35:40.062 INFO:tasks.rados.rados.0.trial082.stdout:1604: finishing rollback tid 0 to trial08226312-4 2026-02-12T17:35:40.063 INFO:tasks.rados.rados.0.trial082.stdout:1603: finishing rollback tid 2 to trial08226312-27 2026-02-12T17:35:40.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 302 (ObjNum 510 snap 156 seq_num 510) dirty exists 2026-02-12T17:35:40.063 INFO:tasks.rados.rados.0.trial082.stdout:1604: finishing rollback tid 1 to trial08226312-4 2026-02-12T17:35:40.063 INFO:tasks.rados.rados.0.trial082.stdout:1603: done (6 left) 2026-02-12T17:35:40.063 INFO:tasks.rados.rados.0.trial082.stdout:1607: done (5 left) 2026-02-12T17:35:40.063 INFO:tasks.rados.rados.0.trial082.stdout:1612: snap_remove snap 137 2026-02-12T17:35:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1612: done (5 left) 2026-02-12T17:35:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1613: delete oid 46 current snap is 172 2026-02-12T17:35:41.063 INFO:tasks.rados.rados.0.trial082.stdout:1604: finishing rollback tid 2 to trial08226312-4 2026-02-12T17:35:41.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 1233 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:35:41.064 INFO:tasks.rados.rados.0.trial082.stdout:1606: expect (ObjNum 554 snap 169 seq_num 554) 2026-02-12T17:35:41.112 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1200786 2026-02-12T17:35:41.164 INFO:tasks.rados.rados.0.trial082.stdout:1605: finishing copy_from racing read to trial08226312-17 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:1605: finishing copy_from to trial08226312-17 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 856 (ObjNum 549 snap 167 seq_num 549) dirty exists 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:1609: finishing write tid 1 to trial08226312-32 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:1609: finishing write tid 2 to trial08226312-32 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:1604: done (5 left) 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:1605: done (4 left) 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:1606: done (3 left) 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:1613: done (2 left) 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:1614: write oid 23 current snap is 172 2026-02-12T17:35:41.165 INFO:tasks.rados.rados.0.trial082.stdout:1609: finishing write tid 3 to trial08226312-32 2026-02-12T17:35:41.166 INFO:tasks.rados.rados.0.trial082.stdout:1609: finishing write tid 4 to trial08226312-32 2026-02-12T17:35:41.166 INFO:tasks.rados.rados.0.trial082.stdout:1614: seq_num 562 ranges {645534=783707,2103939=638517,3150663=294871} 2026-02-12T17:35:41.169 INFO:tasks.rados.rados.0.trial082.stdout:1614: writing trial08226312-23 from 645534 to 1429241 tid 1 2026-02-12T17:35:41.174 INFO:tasks.rados.rados.0.trial082.stdout:1614: writing trial08226312-23 from 2103939 to 2742456 tid 2 2026-02-12T17:35:41.177 INFO:tasks.rados.rados.0.trial082.stdout:1614: writing trial08226312-23 from 3150663 to 3445534 tid 3 2026-02-12T17:35:41.177 INFO:tasks.rados.rados.0.trial082.stdout:1615: snap_create 2026-02-12T17:35:41.177 INFO:tasks.rados.rados.0.trial082.stdout:1609: finishing write tid 5 to trial08226312-32 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:1609: oid 32 updating version 0 to 821 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:1609: oid 32 version 821 is already newer than 818 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:1609: oid 32 version 821 is already newer than 820 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:1609: oid 32 version 821 is already newer than 819 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 821 (ObjNum 560 snap 172 seq_num 560) dirty exists 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:1609: left oid 32 (ObjNum 560 snap 172 seq_num 560) 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:1611: finishing copy_from racing read to trial08226312-15 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:1611: finishing copy_from to trial08226312-15 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 645 (ObjNum 456 snap 143 seq_num 456) dirty exists 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:1614: finishing write tid 1 to trial08226312-23 2026-02-12T17:35:41.178 INFO:tasks.rados.rados.0.trial082.stdout:1614: finishing write tid 2 to trial08226312-23 2026-02-12T17:35:41.179 INFO:tasks.rados.rados.0.trial082.stdout:1614: finishing write tid 3 to trial08226312-23 2026-02-12T17:35:41.179 INFO:tasks.rados.rados.0.trial082.stdout:1614: finishing write tid 4 to trial08226312-23 2026-02-12T17:35:41.179 INFO:tasks.rados.rados.0.trial082.stdout:1614: finishing write tid 5 to trial08226312-23 2026-02-12T17:35:41.180 INFO:tasks.rados.rados.0.trial082.stdout:1614: oid 23 updating version 0 to 855 2026-02-12T17:35:41.180 INFO:tasks.rados.rados.0.trial082.stdout:1614: oid 23 updating version 855 to 857 2026-02-12T17:35:41.180 INFO:tasks.rados.rados.0.trial082.stdout:1614: oid 23 version 857 is already newer than 856 2026-02-12T17:35:41.180 INFO:tasks.rados.rados.0.trial082.stdout:1614: oid 23 updating version 857 to 858 2026-02-12T17:35:41.180 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 858 (ObjNum 562 snap 172 seq_num 562) dirty exists 2026-02-12T17:35:41.180 INFO:tasks.rados.rados.0.trial082.stdout:1614: left oid 23 (ObjNum 562 snap 172 seq_num 562) 2026-02-12T17:35:42.069 INFO:tasks.rados.rados.0.trial082.stdout:1609: done (3 left) 2026-02-12T17:35:42.069 INFO:tasks.rados.rados.0.trial082.stdout:1611: done (2 left) 2026-02-12T17:35:42.069 INFO:tasks.rados.rados.0.trial082.stdout:1614: done (1 left) 2026-02-12T17:35:42.069 INFO:tasks.rados.rados.0.trial082.stdout:1615: done (0 left) 2026-02-12T17:35:42.069 INFO:tasks.rados.rados.0.trial082.stdout:1616: read oid 28 snap -1 2026-02-12T17:35:42.069 INFO:tasks.rados.rados.0.trial082.stdout:1616: expect (ObjNum 537 snap 163 seq_num 537) 2026-02-12T17:35:42.070 INFO:tasks.rados.rados.0.trial082.stdout:1617: read oid 31 snap -1 2026-02-12T17:35:42.070 INFO:tasks.rados.rados.0.trial082.stdout:1617: expect (ObjNum 506 snap 156 seq_num 506) 2026-02-12T17:35:42.070 INFO:tasks.rados.rados.0.trial082.stdout:1618: rollback oid 24 current snap is 173 2026-02-12T17:35:42.070 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 148 2026-02-12T17:35:42.070 INFO:tasks.rados.rados.0.trial082.stdout:1619: read oid 41 snap -1 2026-02-12T17:35:42.070 INFO:tasks.rados.rados.0.trial082.stdout:1619: expect (ObjNum 514 snap 156 seq_num 514) 2026-02-12T17:35:42.070 INFO:tasks.rados.rados.0.trial082.stdout:1620: read oid 48 snap 172 2026-02-12T17:35:42.070 INFO:tasks.rados.rados.0.trial082.stdout:1620: expect deleted 2026-02-12T17:35:42.070 INFO:tasks.rados.rados.0.trial082.stdout:1621: snap_create 2026-02-12T17:35:42.071 INFO:tasks.rados.rados.0.trial082.stdout:1617: expect (ObjNum 506 snap 156 seq_num 506) 2026-02-12T17:35:42.190 INFO:tasks.rados.rados.0.trial082.stdout:1618: finishing rollback tid 0 to trial08226312-24 2026-02-12T17:35:42.190 INFO:tasks.rados.rados.0.trial082.stdout:1618: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:35:42.190 INFO:tasks.rados.rados.0.trial082.stdout:1618: finishing rollback tid 2 to trial08226312-24 2026-02-12T17:35:42.190 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1263 (ObjNum 469 snap 146 seq_num 469) dirty exists 2026-02-12T17:35:42.190 INFO:tasks.rados.rados.0.trial082.stdout:1619: expect (ObjNum 514 snap 156 seq_num 514) 2026-02-12T17:35:42.195 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 947693 2026-02-12T17:35:42.239 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2171255 2026-02-12T17:35:42.267 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1707376 2026-02-12T17:35:42.281 INFO:tasks.rados.rados.0.trial082.stdout:1616: expect (ObjNum 537 snap 163 seq_num 537) 2026-02-12T17:35:42.281 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:43.048 INFO:tasks.rados.rados.0.trial082.stdout:1616: done (5 left) 2026-02-12T17:35:43.048 INFO:tasks.rados.rados.0.trial082.stdout:1617: done (4 left) 2026-02-12T17:35:43.048 INFO:tasks.rados.rados.0.trial082.stdout:1618: done (3 left) 2026-02-12T17:35:43.048 INFO:tasks.rados.rados.0.trial082.stdout:1619: done (2 left) 2026-02-12T17:35:43.048 INFO:tasks.rados.rados.0.trial082.stdout:1620: done (1 left) 2026-02-12T17:35:43.048 INFO:tasks.rados.rados.0.trial082.stdout:1621: done (0 left) 2026-02-12T17:35:43.048 INFO:tasks.rados.rados.0.trial082.stdout:1622: snap_remove snap 173 2026-02-12T17:35:44.048 INFO:tasks.rados.rados.0.trial082.stdout:1622: done (0 left) 2026-02-12T17:35:44.048 INFO:tasks.rados.rados.0.trial082.stdout:1623: snap_remove snap 160 2026-02-12T17:35:45.051 INFO:tasks.rados.rados.0.trial082.stdout:1623: done (0 left) 2026-02-12T17:35:45.051 INFO:tasks.rados.rados.0.trial082.stdout:1624: read oid 41 snap 172 2026-02-12T17:35:45.051 INFO:tasks.rados.rados.0.trial082.stdout:1624: expect (ObjNum 514 snap 156 seq_num 514) 2026-02-12T17:35:45.051 INFO:tasks.rados.rados.0.trial082.stdout:1625: copy_from oid 33 from oid 38 current snap is 174 2026-02-12T17:35:45.052 INFO:tasks.rados.rados.0.trial082.stdout:1626: rollback oid 3 current snap is 174 2026-02-12T17:35:45.052 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 171 2026-02-12T17:35:45.052 INFO:tasks.rados.rados.0.trial082.stdout:1627: read oid 4 snap -1 2026-02-12T17:35:45.052 INFO:tasks.rados.rados.0.trial082.stdout:1627: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:35:45.052 INFO:tasks.rados.rados.0.trial082.stdout:1628: snap_create 2026-02-12T17:35:45.055 INFO:tasks.rados.rados.0.trial082.stdout:1626: finishing rollback tid 0 to trial08226312-3 2026-02-12T17:35:45.055 INFO:tasks.rados.rados.0.trial082.stdout:1627: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:35:45.089 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2069387 2026-02-12T17:35:45.137 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:45.182 INFO:tasks.rados.rados.0.trial082.stdout:1626: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:35:45.182 INFO:tasks.rados.rados.0.trial082.stdout:1626: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:35:45.182 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 867 (ObjNum 557 snap 169 seq_num 557) dirty exists 2026-02-12T17:35:45.183 INFO:tasks.rados.rados.0.trial082.stdout:1624: expect (ObjNum 514 snap 156 seq_num 514) 2026-02-12T17:35:45.212 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 91527 2026-02-12T17:35:45.246 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:45.281 INFO:tasks.rados.rados.0.trial082.stdout:1625: finishing copy_from racing read to trial08226312-33 2026-02-12T17:35:45.281 INFO:tasks.rados.rados.0.trial082.stdout:1625: finishing copy_from to trial08226312-33 2026-02-12T17:35:45.281 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 663 (ObjNum 514 snap 156 seq_num 514) dirty exists 2026-02-12T17:35:46.053 INFO:tasks.rados.rados.0.trial082.stdout:1624: done (4 left) 2026-02-12T17:35:46.053 INFO:tasks.rados.rados.0.trial082.stdout:1625: done (3 left) 2026-02-12T17:35:46.053 INFO:tasks.rados.rados.0.trial082.stdout:1626: done (2 left) 2026-02-12T17:35:46.054 INFO:tasks.rados.rados.0.trial082.stdout:1627: done (1 left) 2026-02-12T17:35:46.054 INFO:tasks.rados.rados.0.trial082.stdout:1628: done (0 left) 2026-02-12T17:35:46.054 INFO:tasks.rados.rados.0.trial082.stdout:1629: snap_create 2026-02-12T17:35:47.053 INFO:tasks.rados.rados.0.trial082.stdout:1629: done (0 left) 2026-02-12T17:35:47.053 INFO:tasks.rados.rados.0.trial082.stdout:1630: write (excl) oid 35 current snap is 176 2026-02-12T17:35:47.053 INFO:tasks.rados.rados.0.trial082.stdout:1630: seq_num 563 ranges {662341=575309,1878774=498528,2894439=457555} 2026-02-12T17:35:47.058 INFO:tasks.rados.rados.0.trial082.stdout:1630: writing trial08226312-35 from 662341 to 1237650 tid 1 2026-02-12T17:35:47.062 INFO:tasks.rados.rados.0.trial082.stdout:1630: writing trial08226312-35 from 1878774 to 2377302 tid 2 2026-02-12T17:35:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1630: writing trial08226312-35 from 2894439 to 3351994 tid 3 2026-02-12T17:35:47.066 INFO:tasks.rados.rados.0.trial082.stdout:1631: write oid 18 current snap is 176 2026-02-12T17:35:47.067 INFO:tasks.rados.rados.0.trial082.stdout:1631: seq_num 564 ranges {679148=650558,1937256=642186,3321862=157286} 2026-02-12T17:35:47.071 INFO:tasks.rados.rados.0.trial082.stdout:1631: writing trial08226312-18 from 679148 to 1329706 tid 1 2026-02-12T17:35:47.076 INFO:tasks.rados.rados.0.trial082.stdout:1631: writing trial08226312-18 from 1937256 to 2579442 tid 2 2026-02-12T17:35:47.080 INFO:tasks.rados.rados.0.trial082.stdout:1631: writing trial08226312-18 from 3321862 to 3479148 tid 3 2026-02-12T17:35:47.080 INFO:tasks.rados.rados.0.trial082.stdout:1632: copy_from oid 6 from oid 26 current snap is 176 2026-02-12T17:35:47.080 INFO:tasks.rados.rados.0.trial082.stdout:1630: finishing write tid 1 to trial08226312-35 2026-02-12T17:35:47.080 INFO:tasks.rados.rados.0.trial082.stdout:1633: write oid 28 current snap is 176 2026-02-12T17:35:47.080 INFO:tasks.rados.rados.0.trial082.stdout:1633: seq_num 565 ranges {695955=725807,1879385=502197,2949285=480099} 2026-02-12T17:35:47.084 INFO:tasks.rados.rados.0.trial082.stdout:1633: writing trial08226312-28 from 695955 to 1421762 tid 1 2026-02-12T17:35:47.088 INFO:tasks.rados.rados.0.trial082.stdout:1633: writing trial08226312-28 from 1879385 to 2381582 tid 2 2026-02-12T17:35:47.093 INFO:tasks.rados.rados.0.trial082.stdout:1633: writing trial08226312-28 from 2949285 to 3429384 tid 3 2026-02-12T17:35:47.094 INFO:tasks.rados.rados.0.trial082.stdout:1634: delete oid 27 current snap is 176 2026-02-12T17:35:47.094 INFO:tasks.rados.rados.0.trial082.stdout:1630: finishing write tid 2 to trial08226312-35 2026-02-12T17:35:47.094 INFO:tasks.rados.rados.0.trial082.stdout:1630: finishing write tid 3 to trial08226312-35 2026-02-12T17:35:47.094 INFO:tasks.rados.rados.0.trial082.stdout:1630: finishing write tid 4 to trial08226312-35 2026-02-12T17:35:47.094 INFO:tasks.rados.rados.0.trial082.stdout:1630: finishing write tid 5 to trial08226312-35 2026-02-12T17:35:47.094 INFO:tasks.rados.rados.0.trial082.stdout:1630: oid 35 updating version 0 to 862 2026-02-12T17:35:47.094 INFO:tasks.rados.rados.0.trial082.stdout:1630: oid 35 version 862 is already newer than 859 2026-02-12T17:35:47.094 INFO:tasks.rados.rados.0.trial082.stdout:1630: oid 35 version 862 is already newer than 861 2026-02-12T17:35:47.094 INFO:tasks.rados.rados.0.trial082.stdout:1630: oid 35 version 862 is already newer than 860 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 862 (ObjNum 563 snap 176 seq_num 563) dirty exists 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:1630: left oid 35 (ObjNum 563 snap 176 seq_num 563) 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:1631: finishing write tid 1 to trial08226312-18 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:1631: finishing write tid 2 to trial08226312-18 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:1632: finishing copy_from to trial08226312-6 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:1632: got expected ENOENT (src dne) 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:1632: finishing copy_from racing read to trial08226312-6 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:1631: finishing write tid 3 to trial08226312-18 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:1631: finishing write tid 4 to trial08226312-18 2026-02-12T17:35:47.095 INFO:tasks.rados.rados.0.trial082.stdout:1631: finishing write tid 5 to trial08226312-18 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1631: oid 18 updating version 0 to 838 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1631: oid 18 version 838 is already newer than 836 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1631: oid 18 updating version 838 to 839 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1631: oid 18 version 839 is already newer than 837 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 839 (ObjNum 564 snap 176 seq_num 564) dirty exists 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1631: left oid 18 (ObjNum 564 snap 176 seq_num 564) 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1633: finishing write tid 1 to trial08226312-28 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1633: finishing write tid 2 to trial08226312-28 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1630: done (4 left) 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1631: done (3 left) 2026-02-12T17:35:47.096 INFO:tasks.rados.rados.0.trial082.stdout:1632: done (2 left) 2026-02-12T17:35:47.097 INFO:tasks.rados.rados.0.trial082.stdout:1634: done (1 left) 2026-02-12T17:35:47.097 INFO:tasks.rados.rados.0.trial082.stdout:1635: rollback oid 7 current snap is 176 2026-02-12T17:35:47.097 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 7 to 159 2026-02-12T17:35:47.097 INFO:tasks.rados.rados.0.trial082.stdout:1636: write oid 30 current snap is 176 2026-02-12T17:35:47.097 INFO:tasks.rados.rados.0.trial082.stdout:1636: seq_num 567 ranges {729569=476305,1996349=505866,3004131=525438} 2026-02-12T17:35:47.098 INFO:tasks.rados.rados.0.trial082.stdout:1636: writing trial08226312-30 from 729569 to 1205874 tid 1 2026-02-12T17:35:47.103 INFO:tasks.rados.rados.0.trial082.stdout:1636: writing trial08226312-30 from 1996349 to 2502215 tid 2 2026-02-12T17:35:47.107 INFO:tasks.rados.rados.0.trial082.stdout:1636: writing trial08226312-30 from 3004131 to 3529569 tid 3 2026-02-12T17:35:47.108 INFO:tasks.rados.rados.0.trial082.stdout:1637: snap_remove snap 174 2026-02-12T17:35:48.049 INFO:tasks.rados.rados.0.trial082.stdout:1637: done (3 left) 2026-02-12T17:35:48.049 INFO:tasks.rados.rados.0.trial082.stdout:1638: copy_from oid 11 from oid 4 current snap is 176 2026-02-12T17:35:48.049 INFO:tasks.rados.rados.0.trial082.stdout:1633: finishing write tid 3 to trial08226312-28 2026-02-12T17:35:48.049 INFO:tasks.rados.rados.0.trial082.stdout:1633: finishing write tid 4 to trial08226312-28 2026-02-12T17:35:48.049 INFO:tasks.rados.rados.0.trial082.stdout:1633: finishing write tid 5 to trial08226312-28 2026-02-12T17:35:48.049 INFO:tasks.rados.rados.0.trial082.stdout:1633: oid 28 updating version 0 to 985 2026-02-12T17:35:48.050 INFO:tasks.rados.rados.0.trial082.stdout:1633: oid 28 updating version 985 to 988 2026-02-12T17:35:48.050 INFO:tasks.rados.rados.0.trial082.stdout:1633: oid 28 version 988 is already newer than 986 2026-02-12T17:35:48.050 INFO:tasks.rados.rados.0.trial082.stdout:1633: oid 28 version 988 is already newer than 987 2026-02-12T17:35:48.050 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 988 (ObjNum 565 snap 176 seq_num 565) dirty exists 2026-02-12T17:35:48.050 INFO:tasks.rados.rados.0.trial082.stdout:1633: left oid 28 (ObjNum 565 snap 176 seq_num 565) 2026-02-12T17:35:48.050 INFO:tasks.rados.rados.0.trial082.stdout:1635: finishing rollback tid 0 to trial08226312-7 2026-02-12T17:35:48.050 INFO:tasks.rados.rados.0.trial082.stdout:1633: done (3 left) 2026-02-12T17:35:48.050 INFO:tasks.rados.rados.0.trial082.stdout:1639: write (excl) oid 36 current snap is 176 2026-02-12T17:35:48.050 INFO:tasks.rados.rados.0.trial082.stdout:1639: seq_num 568 ranges {746376=551554,2054831=649524,3315201=231175} 2026-02-12T17:35:48.054 INFO:tasks.rados.rados.0.trial082.stdout:1639: writing trial08226312-36 from 746376 to 1297930 tid 1 2026-02-12T17:35:48.059 INFO:tasks.rados.rados.0.trial082.stdout:1639: writing trial08226312-36 from 2054831 to 2704355 tid 2 2026-02-12T17:35:48.064 INFO:tasks.rados.rados.0.trial082.stdout:1639: writing trial08226312-36 from 3315201 to 3546376 tid 3 2026-02-12T17:35:48.064 INFO:tasks.rados.rados.0.trial082.stdout:1640: read oid 21 snap 175 2026-02-12T17:35:48.064 INFO:tasks.rados.rados.0.trial082.stdout:1640: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:35:48.064 INFO:tasks.rados.rados.0.trial082.stdout:1641: read oid 8 snap -1 2026-02-12T17:35:48.064 INFO:tasks.rados.rados.0.trial082.stdout:1641: expect (ObjNum 482 snap 147 seq_num 482) 2026-02-12T17:35:48.064 INFO:tasks.rados.rados.0.trial082.stdout:1642: read oid 15 snap -1 2026-02-12T17:35:48.064 INFO:tasks.rados.rados.0.trial082.stdout:1642: expect (ObjNum 456 snap 143 seq_num 456) 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1643: rollback oid 47 current snap is 176 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 47 to 165 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1635: finishing rollback tid 1 to trial08226312-7 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1635: finishing rollback tid 2 to trial08226312-7 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 992 (ObjNum 468 snap 146 seq_num 468) dirty exists 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1636: finishing write tid 1 to trial08226312-30 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1635: done (7 left) 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1644: rollback oid 19 current snap is 176 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 170 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1636: finishing write tid 2 to trial08226312-30 2026-02-12T17:35:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1636: finishing write tid 3 to trial08226312-30 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1636: finishing write tid 4 to trial08226312-30 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1636: finishing write tid 5 to trial08226312-30 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1636: oid 30 updating version 0 to 1085 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1636: oid 30 updating version 1085 to 1086 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1636: oid 30 updating version 1086 to 1087 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1636: oid 30 version 1087 is already newer than 1084 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1087 (ObjNum 567 snap 176 seq_num 567) dirty exists 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1636: left oid 30 (ObjNum 567 snap 176 seq_num 567) 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1636: done (7 left) 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1645: read oid 39 snap -1 2026-02-12T17:35:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1645: expect deleted 2026-02-12T17:35:48.067 INFO:tasks.rados.rados.0.trial082.stdout:1646: write oid 3 current snap is 176 2026-02-12T17:35:48.067 INFO:tasks.rados.rados.0.trial082.stdout:1646: seq_num 569 ranges {763183=626803,1996960=793182,3226271=336912} 2026-02-12T17:35:48.068 INFO:tasks.rados.rados.0.trial082.stdout:1646: writing trial08226312-3 from 763183 to 1389986 tid 1 2026-02-12T17:35:48.073 INFO:tasks.rados.rados.0.trial082.stdout:1646: writing trial08226312-3 from 1996960 to 2790142 tid 2 2026-02-12T17:35:48.077 INFO:tasks.rados.rados.0.trial082.stdout:1646: writing trial08226312-3 from 3226271 to 3563183 tid 3 2026-02-12T17:35:48.077 INFO:tasks.rados.rados.0.trial082.stdout:1647: read oid 12 snap -1 2026-02-12T17:35:48.077 INFO:tasks.rados.rados.0.trial082.stdout:1647: expect (ObjNum 297 snap 83 seq_num 297) 2026-02-12T17:35:48.077 INFO:tasks.rados.rados.0.trial082.stdout:1648: read oid 14 snap -1 2026-02-12T17:35:48.077 INFO:tasks.rados.rados.0.trial082.stdout:1648: expect (ObjNum 549 snap 167 seq_num 549) 2026-02-12T17:35:48.077 INFO:tasks.rados.rados.0.trial082.stdout:1649: write (excl) oid 20 current snap is 176 2026-02-12T17:35:48.077 INFO:tasks.rados.rados.0.trial082.stdout:1639: finishing write tid 1 to trial08226312-36 2026-02-12T17:35:48.077 INFO:tasks.rados.rados.0.trial082.stdout:1638: finishing copy_from racing read to trial08226312-11 2026-02-12T17:35:48.078 INFO:tasks.rados.rados.0.trial082.stdout:1638: finishing copy_from to trial08226312-11 2026-02-12T17:35:48.078 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1233 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:35:48.078 INFO:tasks.rados.rados.0.trial082.stdout:1639: finishing write tid 2 to trial08226312-36 2026-02-12T17:35:48.078 INFO:tasks.rados.rados.0.trial082.stdout:1649: seq_num 570 ranges {779990=702052,2055442=653193,3253694=326296} 2026-02-12T17:35:48.081 INFO:tasks.rados.rados.0.trial082.stdout:1649: writing trial08226312-20 from 779990 to 1482042 tid 1 2026-02-12T17:35:48.086 INFO:tasks.rados.rados.0.trial082.stdout:1649: writing trial08226312-20 from 2055442 to 2708635 tid 2 2026-02-12T17:35:48.090 INFO:tasks.rados.rados.0.trial082.stdout:1649: writing trial08226312-20 from 3253694 to 3579990 tid 3 2026-02-12T17:35:48.090 INFO:tasks.rados.rados.0.trial082.stdout:1638: done (11 left) 2026-02-12T17:35:48.090 INFO:tasks.rados.rados.0.trial082.stdout:1650: snap_remove snap 171 2026-02-12T17:35:49.057 INFO:tasks.rados.rados.0.trial082.stdout:1650: done (11 left) 2026-02-12T17:35:49.058 INFO:tasks.rados.rados.0.trial082.stdout:1651: write (excl) oid 1 current snap is 176 2026-02-12T17:35:49.058 INFO:tasks.rados.rados.0.trial082.stdout:1651: seq_num 571 ranges {796797=493654,1830277=796851,3397470=199327} 2026-02-12T17:35:49.062 INFO:tasks.rados.rados.0.trial082.stdout:1651: writing trial08226312-1 from 796797 to 1290451 tid 1 2026-02-12T17:35:49.067 INFO:tasks.rados.rados.0.trial082.stdout:1651: writing trial08226312-1 from 1830277 to 2627128 tid 2 2026-02-12T17:35:49.071 INFO:tasks.rados.rados.0.trial082.stdout:1651: writing trial08226312-1 from 3397470 to 3596797 tid 3 2026-02-12T17:35:49.071 INFO:tasks.rados.rados.0.trial082.stdout:1652: write (excl) oid 45 current snap is 176 2026-02-12T17:35:49.071 INFO:tasks.rados.rados.0.trial082.stdout:1652: seq_num 572 ranges {413604=568903,1488759=656862,2624893=591709} 2026-02-12T17:35:49.074 INFO:tasks.rados.rados.0.trial082.stdout:1652: writing trial08226312-45 from 413604 to 982507 tid 1 2026-02-12T17:35:49.079 INFO:tasks.rados.rados.0.trial082.stdout:1652: writing trial08226312-45 from 1488759 to 2145621 tid 2 2026-02-12T17:35:49.083 INFO:tasks.rados.rados.0.trial082.stdout:1652: writing trial08226312-45 from 2624893 to 3216602 tid 3 2026-02-12T17:35:49.083 INFO:tasks.rados.rados.0.trial082.stdout:1653: copy_from oid 46 from oid 29 current snap is 176 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:1639: finishing write tid 3 to trial08226312-36 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:1639: finishing write tid 4 to trial08226312-36 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:1639: finishing write tid 5 to trial08226312-36 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:1639: oid 36 updating version 0 to 863 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:1639: oid 36 updating version 863 to 865 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:1639: oid 36 version 865 is already newer than 864 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:1639: oid 36 updating version 865 to 866 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 866 (ObjNum 568 snap 176 seq_num 568) dirty exists 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:1639: left oid 36 (ObjNum 568 snap 176 seq_num 568) 2026-02-12T17:35:49.084 INFO:tasks.rados.rados.0.trial082.stdout:1640: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:35:49.085 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:49.144 INFO:tasks.rados.rados.0.trial082.stdout:1641: expect (ObjNum 482 snap 147 seq_num 482) 2026-02-12T17:35:49.144 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:49.170 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:49.203 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 734778 2026-02-12T17:35:49.222 INFO:tasks.rados.rados.0.trial082.stdout:1643: finishing rollback tid 0 to trial08226312-47 2026-02-12T17:35:49.222 INFO:tasks.rados.rados.0.trial082.stdout:1642: expect (ObjNum 456 snap 143 seq_num 456) 2026-02-12T17:35:49.278 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 359329 2026-02-12T17:35:49.384 INFO:tasks.rados.rados.0.trial082.stdout:1643: finishing rollback tid 1 to trial08226312-47 2026-02-12T17:35:49.384 INFO:tasks.rados.rados.0.trial082.stdout:1643: finishing rollback tid 2 to trial08226312-47 2026-02-12T17:35:49.384 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1279 (ObjNum 454 snap 142 seq_num 454) dirty exists 2026-02-12T17:35:49.384 INFO:tasks.rados.rados.0.trial082.stdout:1644: finishing rollback tid 0 to trial08226312-19 2026-02-12T17:35:49.384 INFO:tasks.rados.rados.0.trial082.stdout:1644: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:35:49.384 INFO:tasks.rados.rados.0.trial082.stdout:1646: finishing write tid 1 to trial08226312-3 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1644: finishing rollback tid 2 to trial08226312-19 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 1283 (ObjNum 543 snap 167 seq_num 543) dirty exists 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1646: finishing write tid 2 to trial08226312-3 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1639: done (13 left) 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1640: done (12 left) 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1641: done (11 left) 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1642: done (10 left) 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1643: done (9 left) 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1644: done (8 left) 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1645: done (7 left) 2026-02-12T17:35:49.385 INFO:tasks.rados.rados.0.trial082.stdout:1654: write oid 23 current snap is 176 2026-02-12T17:35:49.386 INFO:tasks.rados.rados.0.trial082.stdout:1654: seq_num 573 ranges {430411=644152,1830888=400520,2935963=402981} 2026-02-12T17:35:49.388 INFO:tasks.rados.rados.0.trial082.stdout:1654: writing trial08226312-23 from 430411 to 1074563 tid 1 2026-02-12T17:35:49.392 INFO:tasks.rados.rados.0.trial082.stdout:1654: writing trial08226312-23 from 1830888 to 2231408 tid 2 2026-02-12T17:35:49.397 INFO:tasks.rados.rados.0.trial082.stdout:1654: writing trial08226312-23 from 2935963 to 3338944 tid 3 2026-02-12T17:35:49.397 INFO:tasks.rados.rados.0.trial082.stdout:1655: read oid 36 snap 170 2026-02-12T17:35:49.397 INFO:tasks.rados.rados.0.trial082.stdout:1655: expect (ObjNum 436 snap 137 seq_num 436) 2026-02-12T17:35:49.397 INFO:tasks.rados.rados.0.trial082.stdout:1656: delete oid 9 current snap is 176 2026-02-12T17:35:49.397 INFO:tasks.rados.rados.0.trial082.stdout:1646: finishing write tid 3 to trial08226312-3 2026-02-12T17:35:49.397 INFO:tasks.rados.rados.0.trial082.stdout:1646: finishing write tid 4 to trial08226312-3 2026-02-12T17:35:49.397 INFO:tasks.rados.rados.0.trial082.stdout:1646: finishing write tid 5 to trial08226312-3 2026-02-12T17:35:49.397 INFO:tasks.rados.rados.0.trial082.stdout:1646: oid 3 updating version 0 to 870 2026-02-12T17:35:49.398 INFO:tasks.rados.rados.0.trial082.stdout:1646: oid 3 version 870 is already newer than 869 2026-02-12T17:35:49.398 INFO:tasks.rados.rados.0.trial082.stdout:1646: oid 3 version 870 is already newer than 868 2026-02-12T17:35:49.398 INFO:tasks.rados.rados.0.trial082.stdout:1646: oid 3 updating version 870 to 871 2026-02-12T17:35:49.398 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 871 (ObjNum 569 snap 176 seq_num 569) dirty exists 2026-02-12T17:35:49.398 INFO:tasks.rados.rados.0.trial082.stdout:1646: left oid 3 (ObjNum 569 snap 176 seq_num 569) 2026-02-12T17:35:49.398 INFO:tasks.rados.rados.0.trial082.stdout:1647: expect (ObjNum 297 snap 83 seq_num 297) 2026-02-12T17:35:49.437 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 397152 2026-02-12T17:35:49.514 INFO:tasks.rados.rados.0.trial082.stdout:1648: expect (ObjNum 549 snap 167 seq_num 549) 2026-02-12T17:35:49.520 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1711068 2026-02-12T17:35:49.553 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:49.578 INFO:tasks.rados.rados.0.trial082.stdout:1649: finishing write tid 1 to trial08226312-20 2026-02-12T17:35:49.578 INFO:tasks.rados.rados.0.trial082.stdout:1649: finishing write tid 2 to trial08226312-20 2026-02-12T17:35:49.578 INFO:tasks.rados.rados.0.trial082.stdout:1649: finishing write tid 3 to trial08226312-20 2026-02-12T17:35:49.578 INFO:tasks.rados.rados.0.trial082.stdout:1649: finishing write tid 4 to trial08226312-20 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1649: finishing write tid 5 to trial08226312-20 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1649: oid 20 updating version 0 to 1286 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1649: oid 20 updating version 1286 to 1288 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1649: oid 20 version 1288 is already newer than 1287 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1649: oid 20 version 1288 is already newer than 1285 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 1288 (ObjNum 570 snap 176 seq_num 570) dirty exists 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1649: left oid 20 (ObjNum 570 snap 176 seq_num 570) 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1651: finishing write tid 1 to trial08226312-1 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1651: finishing write tid 2 to trial08226312-1 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1651: finishing write tid 3 to trial08226312-1 2026-02-12T17:35:49.579 INFO:tasks.rados.rados.0.trial082.stdout:1651: finishing write tid 4 to trial08226312-1 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1646: done (9 left) 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1647: done (8 left) 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1648: done (7 left) 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1649: done (6 left) 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1656: done (5 left) 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1657: copy_from oid 27 from oid 43 current snap is 176 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1651: finishing write tid 5 to trial08226312-1 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1651: oid 1 updating version 0 to 928 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1651: oid 1 version 928 is already newer than 927 2026-02-12T17:35:49.580 INFO:tasks.rados.rados.0.trial082.stdout:1651: oid 1 version 928 is already newer than 926 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1651: oid 1 version 928 is already newer than 925 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 928 (ObjNum 571 snap 176 seq_num 571) dirty exists 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1651: left oid 1 (ObjNum 571 snap 176 seq_num 571) 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1652: finishing write tid 1 to trial08226312-45 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1652: finishing write tid 2 to trial08226312-45 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1652: finishing write tid 3 to trial08226312-45 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1652: finishing write tid 4 to trial08226312-45 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1652: finishing write tid 5 to trial08226312-45 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1652: oid 45 updating version 0 to 867 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1652: oid 45 updating version 867 to 868 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1652: oid 45 updating version 868 to 870 2026-02-12T17:35:49.581 INFO:tasks.rados.rados.0.trial082.stdout:1652: oid 45 version 870 is already newer than 869 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 870 (ObjNum 572 snap 176 seq_num 572) dirty exists 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1652: left oid 45 (ObjNum 572 snap 176 seq_num 572) 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1653: finishing copy_from racing read to trial08226312-46 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1653: finishing copy_from to trial08226312-46 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 692 (ObjNum 546 snap 167 seq_num 546) dirty exists 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1654: finishing write tid 1 to trial08226312-23 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1654: finishing write tid 2 to trial08226312-23 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1654: finishing write tid 3 to trial08226312-23 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1654: finishing write tid 4 to trial08226312-23 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1654: finishing write tid 5 to trial08226312-23 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1654: oid 23 updating version 0 to 871 2026-02-12T17:35:49.582 INFO:tasks.rados.rados.0.trial082.stdout:1654: oid 23 updating version 871 to 872 2026-02-12T17:35:49.583 INFO:tasks.rados.rados.0.trial082.stdout:1654: oid 23 updating version 872 to 873 2026-02-12T17:35:49.583 INFO:tasks.rados.rados.0.trial082.stdout:1654: oid 23 updating version 873 to 874 2026-02-12T17:35:49.583 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 874 (ObjNum 573 snap 176 seq_num 573) dirty exists 2026-02-12T17:35:49.583 INFO:tasks.rados.rados.0.trial082.stdout:1654: left oid 23 (ObjNum 573 snap 176 seq_num 573) 2026-02-12T17:35:49.583 INFO:tasks.rados.rados.0.trial082.stdout:1655: expect (ObjNum 436 snap 137 seq_num 436) 2026-02-12T17:35:49.615 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:49.688 INFO:tasks.rados.rados.0.trial082.stdout:1657: finishing copy_from racing read to trial08226312-27 2026-02-12T17:35:49.688 INFO:tasks.rados.rados.0.trial082.stdout:1657: finishing copy_from to trial08226312-27 2026-02-12T17:35:49.689 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1083 (ObjNum 508 snap 156 seq_num 508) dirty exists 2026-02-12T17:35:49.689 INFO:tasks.rados.rados.0.trial082.stdout:1651: done (5 left) 2026-02-12T17:35:49.689 INFO:tasks.rados.rados.0.trial082.stdout:1652: done (4 left) 2026-02-12T17:35:49.689 INFO:tasks.rados.rados.0.trial082.stdout:1653: done (3 left) 2026-02-12T17:35:49.689 INFO:tasks.rados.rados.0.trial082.stdout:1654: done (2 left) 2026-02-12T17:35:49.689 INFO:tasks.rados.rados.0.trial082.stdout:1655: done (1 left) 2026-02-12T17:35:49.689 INFO:tasks.rados.rados.0.trial082.stdout:1657: done (0 left) 2026-02-12T17:35:49.689 INFO:tasks.rados.rados.0.trial082.stdout:1658: snap_remove snap 175 2026-02-12T17:35:50.062 INFO:tasks.rados.rados.0.trial082.stdout:1658: done (0 left) 2026-02-12T17:35:50.063 INFO:tasks.rados.rados.0.trial082.stdout:1659: write (excl) oid 12 current snap is 176 2026-02-12T17:35:50.063 INFO:tasks.rados.rados.0.trial082.stdout:1659: seq_num 575 ranges {464025=794650,1947852=404189,2990809=425525} 2026-02-12T17:35:50.067 INFO:tasks.rados.rados.0.trial082.stdout:1659: writing trial08226312-12 from 464025 to 1258675 tid 1 2026-02-12T17:35:50.071 INFO:tasks.rados.rados.0.trial082.stdout:1659: writing trial08226312-12 from 1947852 to 2352041 tid 2 2026-02-12T17:35:50.075 INFO:tasks.rados.rados.0.trial082.stdout:1659: writing trial08226312-12 from 2990809 to 3416334 tid 3 2026-02-12T17:35:50.076 INFO:tasks.rados.rados.0.trial082.stdout:1660: copy_from oid 47 from oid 14 current snap is 176 2026-02-12T17:35:50.076 INFO:tasks.rados.rados.0.trial082.stdout:1659: finishing write tid 1 to trial08226312-12 2026-02-12T17:35:50.076 INFO:tasks.rados.rados.0.trial082.stdout:1659: finishing write tid 2 to trial08226312-12 2026-02-12T17:35:50.076 INFO:tasks.rados.rados.0.trial082.stdout:1661: write oid 24 current snap is 176 2026-02-12T17:35:50.076 INFO:tasks.rados.rados.0.trial082.stdout:1661: seq_num 576 ranges {480832=469899,1606334=664200,3018232=662600} 2026-02-12T17:35:50.079 INFO:tasks.rados.rados.0.trial082.stdout:1661: writing trial08226312-24 from 480832 to 950731 tid 1 2026-02-12T17:35:50.084 INFO:tasks.rados.rados.0.trial082.stdout:1661: writing trial08226312-24 from 1606334 to 2270534 tid 2 2026-02-12T17:35:50.090 INFO:tasks.rados.rados.0.trial082.stdout:1661: writing trial08226312-24 from 3018232 to 3680832 tid 3 2026-02-12T17:35:50.090 INFO:tasks.rados.rados.0.trial082.stdout:1662: rollback oid 21 current snap is 176 2026-02-12T17:35:50.090 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 168 2026-02-12T17:35:50.090 INFO:tasks.rados.rados.0.trial082.stdout:1659: finishing write tid 3 to trial08226312-12 2026-02-12T17:35:50.090 INFO:tasks.rados.rados.0.trial082.stdout:1659: finishing write tid 4 to trial08226312-12 2026-02-12T17:35:50.090 INFO:tasks.rados.rados.0.trial082.stdout:1659: finishing write tid 5 to trial08226312-12 2026-02-12T17:35:50.090 INFO:tasks.rados.rados.0.trial082.stdout:1659: oid 12 updating version 0 to 1021 2026-02-12T17:35:50.090 INFO:tasks.rados.rados.0.trial082.stdout:1659: oid 12 version 1021 is already newer than 1019 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1659: oid 12 updating version 1021 to 1022 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1659: oid 12 version 1022 is already newer than 1020 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1022 (ObjNum 575 snap 176 seq_num 575) dirty exists 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1659: left oid 12 (ObjNum 575 snap 176 seq_num 575) 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1660: finishing copy_from racing read to trial08226312-47 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1660: finishing copy_from to trial08226312-47 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 856 (ObjNum 549 snap 167 seq_num 549) dirty exists 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1661: finishing write tid 1 to trial08226312-24 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1659: done (3 left) 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1660: done (2 left) 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1663: write (excl) oid 42 current snap is 176 2026-02-12T17:35:50.091 INFO:tasks.rados.rados.0.trial082.stdout:1663: seq_num 577 ranges {497639=545148,1548463=407858,2529302=564422,3528143=169496} 2026-02-12T17:35:50.094 INFO:tasks.rados.rados.0.trial082.stdout:1663: writing trial08226312-42 from 497639 to 1042787 tid 1 2026-02-12T17:35:50.098 INFO:tasks.rados.rados.0.trial082.stdout:1663: writing trial08226312-42 from 1548463 to 1956321 tid 2 2026-02-12T17:35:50.102 INFO:tasks.rados.rados.0.trial082.stdout:1663: writing trial08226312-42 from 2529302 to 3093724 tid 3 2026-02-12T17:35:50.105 INFO:tasks.rados.rados.0.trial082.stdout:1663: writing trial08226312-42 from 3528143 to 3697639 tid 4 2026-02-12T17:35:50.105 INFO:tasks.rados.rados.0.trial082.stdout:1664: rollback oid 34 current snap is 176 2026-02-12T17:35:50.105 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 168 2026-02-12T17:35:50.105 INFO:tasks.rados.rados.0.trial082.stdout:1661: finishing write tid 2 to trial08226312-24 2026-02-12T17:35:50.105 INFO:tasks.rados.rados.0.trial082.stdout:1661: finishing write tid 3 to trial08226312-24 2026-02-12T17:35:50.105 INFO:tasks.rados.rados.0.trial082.stdout:1661: finishing write tid 4 to trial08226312-24 2026-02-12T17:35:50.105 INFO:tasks.rados.rados.0.trial082.stdout:1661: finishing write tid 5 to trial08226312-24 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:1661: oid 24 updating version 0 to 1310 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:1661: oid 24 version 1310 is already newer than 1308 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:1661: oid 24 updating version 1310 to 1311 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:1661: oid 24 version 1311 is already newer than 1309 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1311 (ObjNum 576 snap 176 seq_num 576) dirty exists 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:1661: left oid 24 (ObjNum 576 snap 176 seq_num 576) 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:1662: finishing rollback tid 0 to trial08226312-21 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:1662: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:1662: finishing rollback tid 2 to trial08226312-21 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1090 (ObjNum 533 snap 163 seq_num 533) dirty exists 2026-02-12T17:35:50.106 INFO:tasks.rados.rados.0.trial082.stdout:1663: finishing write tid 1 to trial08226312-42 2026-02-12T17:35:50.107 INFO:tasks.rados.rados.0.trial082.stdout:1661: done (3 left) 2026-02-12T17:35:50.107 INFO:tasks.rados.rados.0.trial082.stdout:1662: done (2 left) 2026-02-12T17:35:50.107 INFO:tasks.rados.rados.0.trial082.stdout:1665: write oid 40 current snap is 176 2026-02-12T17:35:50.107 INFO:tasks.rados.rados.0.trial082.stdout:1665: seq_num 578 ranges {514446=736750,1723298=667869,3073078=641368} 2026-02-12T17:35:50.109 INFO:tasks.rados.rados.0.trial082.stdout:1665: writing trial08226312-40 from 514446 to 1251196 tid 1 2026-02-12T17:35:50.113 INFO:tasks.rados.rados.0.trial082.stdout:1665: writing trial08226312-40 from 1723298 to 2391167 tid 2 2026-02-12T17:35:50.118 INFO:tasks.rados.rados.0.trial082.stdout:1665: writing trial08226312-40 from 3073078 to 3714446 tid 3 2026-02-12T17:35:50.118 INFO:tasks.rados.rados.0.trial082.stdout:1666: write (excl) oid 41 current snap is 176 2026-02-12T17:35:50.119 INFO:tasks.rados.rados.0.trial082.stdout:1666: seq_num 579 ranges {531253=411999,1381780=411527,2300501=586966,3376974=354279} 2026-02-12T17:35:50.122 INFO:tasks.rados.rados.0.trial082.stdout:1666: writing trial08226312-41 from 531253 to 943252 tid 1 2026-02-12T17:35:50.125 INFO:tasks.rados.rados.0.trial082.stdout:1666: writing trial08226312-41 from 1381780 to 1793307 tid 2 2026-02-12T17:35:50.129 INFO:tasks.rados.rados.0.trial082.stdout:1666: writing trial08226312-41 from 2300501 to 2887467 tid 3 2026-02-12T17:35:50.132 INFO:tasks.rados.rados.0.trial082.stdout:1666: writing trial08226312-41 from 3376974 to 3731253 tid 4 2026-02-12T17:35:50.132 INFO:tasks.rados.rados.0.trial082.stdout:1667: write oid 13 current snap is 176 2026-02-12T17:35:50.132 INFO:tasks.rados.rados.0.trial082.stdout:1667: seq_num 580 ranges {548060=487248,1440262=671538,2844277=798238} 2026-02-12T17:35:50.136 INFO:tasks.rados.rados.0.trial082.stdout:1667: writing trial08226312-13 from 548060 to 1035308 tid 1 2026-02-12T17:35:50.140 INFO:tasks.rados.rados.0.trial082.stdout:1667: writing trial08226312-13 from 1440262 to 2111800 tid 2 2026-02-12T17:35:50.147 INFO:tasks.rados.rados.0.trial082.stdout:1667: writing trial08226312-13 from 2844277 to 3642515 tid 3 2026-02-12T17:35:50.147 INFO:tasks.rados.rados.0.trial082.stdout:1668: read oid 1 snap -1 2026-02-12T17:35:50.147 INFO:tasks.rados.rados.0.trial082.stdout:1668: expect (ObjNum 571 snap 176 seq_num 571) 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1669: read oid 50 snap -1 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1669: expect deleted 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1670: read oid 32 snap -1 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1670: expect (ObjNum 560 snap 172 seq_num 560) 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1671: copy_from oid 30 from oid 17 current snap is 176 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1663: finishing write tid 2 to trial08226312-42 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1663: finishing write tid 3 to trial08226312-42 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1663: finishing write tid 4 to trial08226312-42 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1663: finishing write tid 5 to trial08226312-42 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1663: finishing write tid 6 to trial08226312-42 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1663: oid 42 updating version 0 to 1014 2026-02-12T17:35:50.148 INFO:tasks.rados.rados.0.trial082.stdout:1663: oid 42 version 1014 is already newer than 1010 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1663: oid 42 version 1014 is already newer than 1012 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1663: oid 42 version 1014 is already newer than 1011 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1663: oid 42 version 1014 is already newer than 1013 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 1014 (ObjNum 577 snap 176 seq_num 577) dirty exists 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1663: left oid 42 (ObjNum 577 snap 176 seq_num 577) 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1664: finishing rollback tid 0 to trial08226312-34 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1664: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1664: finishing rollback tid 2 to trial08226312-34 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 842 (ObjNum 539 snap 166 seq_num 539) dirty exists 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1665: finishing write tid 1 to trial08226312-40 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1665: finishing write tid 2 to trial08226312-40 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1665: finishing write tid 3 to trial08226312-40 2026-02-12T17:35:50.149 INFO:tasks.rados.rados.0.trial082.stdout:1663: done (8 left) 2026-02-12T17:35:50.150 INFO:tasks.rados.rados.0.trial082.stdout:1664: done (7 left) 2026-02-12T17:35:50.150 INFO:tasks.rados.rados.0.trial082.stdout:1672: write oid 34 current snap is 176 2026-02-12T17:35:50.150 INFO:tasks.rados.rados.0.trial082.stdout:1672: seq_num 581 ranges {564867=562497,1898744=415196,2755347=725863} 2026-02-12T17:35:50.150 INFO:tasks.rados.rados.0.trial082.stdout:1672: writing trial08226312-34 from 564867 to 1127364 tid 1 2026-02-12T17:35:50.155 INFO:tasks.rados.rados.0.trial082.stdout:1672: writing trial08226312-34 from 1898744 to 2313940 tid 2 2026-02-12T17:35:50.159 INFO:tasks.rados.rados.0.trial082.stdout:1672: writing trial08226312-34 from 2755347 to 3481210 tid 3 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1673: write (excl) oid 39 current snap is 176 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1665: finishing write tid 4 to trial08226312-40 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1665: finishing write tid 5 to trial08226312-40 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1665: oid 40 updating version 0 to 1016 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1665: oid 40 updating version 1016 to 1018 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1665: oid 40 updating version 1018 to 1019 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1665: oid 40 version 1019 is already newer than 1017 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1019 (ObjNum 578 snap 176 seq_num 578) dirty exists 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1665: left oid 40 (ObjNum 578 snap 176 seq_num 578) 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1666: finishing write tid 1 to trial08226312-41 2026-02-12T17:35:50.160 INFO:tasks.rados.rados.0.trial082.stdout:1673: seq_num 582 ranges {581674=637746,1840873=558854,3066417=537135} 2026-02-12T17:35:50.163 INFO:tasks.rados.rados.0.trial082.stdout:1673: writing trial08226312-39 from 581674 to 1219420 tid 1 2026-02-12T17:35:50.168 INFO:tasks.rados.rados.0.trial082.stdout:1673: writing trial08226312-39 from 1840873 to 2399727 tid 2 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:1673: writing trial08226312-39 from 3066417 to 3603552 tid 3 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:1665: done (8 left) 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:1674: copy_from oid 28 from oid 43 current snap is 176 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:1666: finishing write tid 2 to trial08226312-41 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:1666: finishing write tid 3 to trial08226312-41 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:1666: finishing write tid 4 to trial08226312-41 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:1666: finishing write tid 5 to trial08226312-41 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:1675: rollback oid 36 current snap is 176 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 36 to 172 2026-02-12T17:35:50.174 INFO:tasks.rados.rados.0.trial082.stdout:1666: finishing write tid 6 to trial08226312-41 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1666: oid 41 updating version 0 to 1024 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1666: oid 41 version 1024 is already newer than 1023 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1666: oid 41 updating version 1024 to 1025 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1666: oid 41 updating version 1025 to 1027 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1666: oid 41 version 1027 is already newer than 1026 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1027 (ObjNum 579 snap 176 seq_num 579) dirty exists 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1666: left oid 41 (ObjNum 579 snap 176 seq_num 579) 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1667: finishing write tid 1 to trial08226312-13 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1666: done (9 left) 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1676: snap_create 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1667: finishing write tid 2 to trial08226312-13 2026-02-12T17:35:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1667: finishing write tid 3 to trial08226312-13 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:1667: finishing write tid 4 to trial08226312-13 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:1667: finishing write tid 5 to trial08226312-13 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:1667: oid 13 updating version 0 to 511 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:1667: oid 13 updating version 511 to 512 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:1667: oid 13 updating version 512 to 513 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:1667: oid 13 updating version 513 to 514 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 514 (ObjNum 580 snap 176 seq_num 580) dirty exists 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:1667: left oid 13 (ObjNum 580 snap 176 seq_num 580) 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:1671: finishing copy_from racing read to trial08226312-30 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:1670: expect (ObjNum 560 snap 172 seq_num 560) 2026-02-12T17:35:50.176 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:50.235 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2045132 2026-02-12T17:35:50.257 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 259829 2026-02-12T17:35:50.300 INFO:tasks.rados.rados.0.trial082.stdout:1671: finishing copy_from to trial08226312-30 2026-02-12T17:35:50.300 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 856 (ObjNum 549 snap 167 seq_num 549) dirty exists 2026-02-12T17:35:50.301 INFO:tasks.rados.rados.0.trial082.stdout:1668: expect (ObjNum 571 snap 176 seq_num 571) 2026-02-12T17:35:50.301 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:50.360 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:50.394 INFO:tasks.rados.rados.0.trial082.stdout:1672: finishing write tid 1 to trial08226312-34 2026-02-12T17:35:50.394 INFO:tasks.rados.rados.0.trial082.stdout:1672: finishing write tid 2 to trial08226312-34 2026-02-12T17:35:50.394 INFO:tasks.rados.rados.0.trial082.stdout:1672: finishing write tid 3 to trial08226312-34 2026-02-12T17:35:50.394 INFO:tasks.rados.rados.0.trial082.stdout:1672: finishing write tid 4 to trial08226312-34 2026-02-12T17:35:50.394 INFO:tasks.rados.rados.0.trial082.stdout:1672: finishing write tid 5 to trial08226312-34 2026-02-12T17:35:50.394 INFO:tasks.rados.rados.0.trial082.stdout:1672: oid 34 updating version 0 to 845 2026-02-12T17:35:50.394 INFO:tasks.rados.rados.0.trial082.stdout:1672: oid 34 version 845 is already newer than 844 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1672: oid 34 updating version 845 to 846 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1672: oid 34 version 846 is already newer than 843 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 846 (ObjNum 581 snap 176 seq_num 581) dirty exists 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1672: left oid 34 (ObjNum 581 snap 176 seq_num 581) 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1673: finishing write tid 1 to trial08226312-39 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1673: finishing write tid 2 to trial08226312-39 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1673: finishing write tid 3 to trial08226312-39 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1673: finishing write tid 4 to trial08226312-39 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1673: finishing write tid 5 to trial08226312-39 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1673: oid 39 updating version 0 to 327 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1673: oid 39 version 327 is already newer than 325 2026-02-12T17:35:50.395 INFO:tasks.rados.rados.0.trial082.stdout:1673: oid 39 version 327 is already newer than 326 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:1673: oid 39 updating version 327 to 328 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 328 (ObjNum 582 snap 176 seq_num 582) dirty exists 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:1673: left oid 39 (ObjNum 582 snap 176 seq_num 582) 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:1675: finishing rollback tid 0 to trial08226312-36 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:1675: finishing rollback tid 1 to trial08226312-36 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:1675: finishing rollback tid 2 to trial08226312-36 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 877 (ObjNum 436 snap 137 seq_num 436) dirty exists 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:1674: finishing copy_from racing read to trial08226312-28 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:1674: finishing copy_from to trial08226312-28 2026-02-12T17:35:50.396 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1083 (ObjNum 508 snap 156 seq_num 508) dirty exists 2026-02-12T17:35:51.067 INFO:tasks.rados.rados.0.trial082.stdout:1667: done (9 left) 2026-02-12T17:35:51.067 INFO:tasks.rados.rados.0.trial082.stdout:1668: done (8 left) 2026-02-12T17:35:51.067 INFO:tasks.rados.rados.0.trial082.stdout:1669: done (7 left) 2026-02-12T17:35:51.067 INFO:tasks.rados.rados.0.trial082.stdout:1670: done (6 left) 2026-02-12T17:35:51.067 INFO:tasks.rados.rados.0.trial082.stdout:1671: done (5 left) 2026-02-12T17:35:51.067 INFO:tasks.rados.rados.0.trial082.stdout:1672: done (4 left) 2026-02-12T17:35:51.068 INFO:tasks.rados.rados.0.trial082.stdout:1673: done (3 left) 2026-02-12T17:35:51.068 INFO:tasks.rados.rados.0.trial082.stdout:1674: done (2 left) 2026-02-12T17:35:51.068 INFO:tasks.rados.rados.0.trial082.stdout:1675: done (1 left) 2026-02-12T17:35:51.068 INFO:tasks.rados.rados.0.trial082.stdout:1676: done (0 left) 2026-02-12T17:35:51.068 INFO:tasks.rados.rados.0.trial082.stdout:1677: delete oid 31 current snap is 177 2026-02-12T17:35:51.070 INFO:tasks.rados.rados.0.trial082.stdout:1677: done (0 left) 2026-02-12T17:35:51.070 INFO:tasks.rados.rados.0.trial082.stdout:1678: copy_from oid 26 from oid 37 current snap is 177 2026-02-12T17:35:51.070 INFO:tasks.rados.rados.0.trial082.stdout:1679: snap_remove snap 165 2026-02-12T17:35:52.069 INFO:tasks.rados.rados.0.trial082.stdout:1679: done (1 left) 2026-02-12T17:35:52.070 INFO:tasks.rados.rados.0.trial082.stdout:1680: write (excl) oid 35 current snap is 177 2026-02-12T17:35:52.070 INFO:tasks.rados.rados.0.trial082.stdout:1678: finishing copy_from racing read to trial08226312-26 2026-02-12T17:35:52.070 INFO:tasks.rados.rados.0.trial082.stdout:1678: finishing copy_from to trial08226312-26 2026-02-12T17:35:52.070 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 645 (ObjNum 456 snap 143 seq_num 456) dirty exists 2026-02-12T17:35:52.070 INFO:tasks.rados.rados.0.trial082.stdout:1680: seq_num 584 ranges {615288=788244,1957837=562523,3121263=559679} 2026-02-12T17:35:52.074 INFO:tasks.rados.rados.0.trial082.stdout:1680: writing trial08226312-35 from 615288 to 1403532 tid 1 2026-02-12T17:35:52.078 INFO:tasks.rados.rados.0.trial082.stdout:1680: writing trial08226312-35 from 1957837 to 2520360 tid 2 2026-02-12T17:35:52.084 INFO:tasks.rados.rados.0.trial082.stdout:1680: writing trial08226312-35 from 3121263 to 3680942 tid 3 2026-02-12T17:35:52.084 INFO:tasks.rados.rados.0.trial082.stdout:1678: done (1 left) 2026-02-12T17:35:52.084 INFO:tasks.rados.rados.0.trial082.stdout:1681: read oid 41 snap -1 2026-02-12T17:35:52.084 INFO:tasks.rados.rados.0.trial082.stdout:1681: expect (ObjNum 579 snap 176 seq_num 579) 2026-02-12T17:35:52.084 INFO:tasks.rados.rados.0.trial082.stdout:1682: copy_from oid 17 from oid 48 current snap is 177 2026-02-12T17:35:52.084 INFO:tasks.rados.rados.0.trial082.stdout:1680: finishing write tid 1 to trial08226312-35 2026-02-12T17:35:52.084 INFO:tasks.rados.rados.0.trial082.stdout:1680: finishing write tid 2 to trial08226312-35 2026-02-12T17:35:52.084 INFO:tasks.rados.rados.0.trial082.stdout:1683: read oid 5 snap -1 2026-02-12T17:35:52.085 INFO:tasks.rados.rados.0.trial082.stdout:1683: expect (ObjNum 534 snap 163 seq_num 534) 2026-02-12T17:35:52.085 INFO:tasks.rados.rados.0.trial082.stdout:1684: read oid 7 snap -1 2026-02-12T17:35:52.085 INFO:tasks.rados.rados.0.trial082.stdout:1684: expect (ObjNum 468 snap 146 seq_num 468) 2026-02-12T17:35:52.085 INFO:tasks.rados.rados.0.trial082.stdout:1685: write (excl) oid 44 current snap is 177 2026-02-12T17:35:52.085 INFO:tasks.rados.rados.0.trial082.stdout:1685: seq_num 585 ranges {632095=463493,1616319=422534,2748686=487304} 2026-02-12T17:35:52.087 INFO:tasks.rados.rados.0.trial082.stdout:1685: writing trial08226312-44 from 632095 to 1095588 tid 1 2026-02-12T17:35:52.091 INFO:tasks.rados.rados.0.trial082.stdout:1685: writing trial08226312-44 from 1616319 to 2038853 tid 2 2026-02-12T17:35:52.097 INFO:tasks.rados.rados.0.trial082.stdout:1685: writing trial08226312-44 from 2748686 to 3235990 tid 3 2026-02-12T17:35:52.097 INFO:tasks.rados.rados.0.trial082.stdout:1686: read oid 14 snap -1 2026-02-12T17:35:52.097 INFO:tasks.rados.rados.0.trial082.stdout:1686: expect (ObjNum 549 snap 167 seq_num 549) 2026-02-12T17:35:52.097 INFO:tasks.rados.rados.0.trial082.stdout:1687: copy_from oid 12 from oid 25 current snap is 177 2026-02-12T17:35:52.097 INFO:tasks.rados.rados.0.trial082.stdout:1682: finishing copy_from to trial08226312-17 2026-02-12T17:35:52.097 INFO:tasks.rados.rados.0.trial082.stdout:1682: got expected ENOENT (src dne) 2026-02-12T17:35:52.097 INFO:tasks.rados.rados.0.trial082.stdout:1682: finishing copy_from racing read to trial08226312-17 2026-02-12T17:35:52.097 INFO:tasks.rados.rados.0.trial082.stdout:1680: finishing write tid 3 to trial08226312-35 2026-02-12T17:35:52.097 INFO:tasks.rados.rados.0.trial082.stdout:1680: finishing write tid 4 to trial08226312-35 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:1680: finishing write tid 5 to trial08226312-35 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:1680: oid 35 updating version 0 to 880 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:1680: oid 35 version 880 is already newer than 879 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:1680: oid 35 version 880 is already newer than 878 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:1680: oid 35 updating version 880 to 881 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 881 (ObjNum 584 snap 177 seq_num 584) dirty exists 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:1680: left oid 35 (ObjNum 584 snap 177 seq_num 584) 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:1685: finishing write tid 1 to trial08226312-44 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:1683: expect (ObjNum 534 snap 163 seq_num 534) 2026-02-12T17:35:52.098 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:52.154 INFO:tasks.rados.rados.0.trial082.stdout:1684: expect (ObjNum 468 snap 146 seq_num 468) 2026-02-12T17:35:52.227 INFO:tasks.rados.rados.0.trial082.stdout:1685: finishing write tid 2 to trial08226312-44 2026-02-12T17:35:52.228 INFO:tasks.rados.rados.0.trial082.stdout:1680: done (7 left) 2026-02-12T17:35:52.228 INFO:tasks.rados.rados.0.trial082.stdout:1682: done (6 left) 2026-02-12T17:35:52.228 INFO:tasks.rados.rados.0.trial082.stdout:1683: done (5 left) 2026-02-12T17:35:52.228 INFO:tasks.rados.rados.0.trial082.stdout:1684: done (4 left) 2026-02-12T17:35:52.228 INFO:tasks.rados.rados.0.trial082.stdout:1688: write (excl) oid 34 current snap is 177 2026-02-12T17:35:52.228 INFO:tasks.rados.rados.0.trial082.stdout:1681: expect (ObjNum 579 snap 176 seq_num 579) 2026-02-12T17:35:52.232 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 823868 2026-02-12T17:35:52.305 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:52.345 INFO:tasks.rados.rados.0.trial082.stdout:1687: finishing copy_from to trial08226312-12 2026-02-12T17:35:52.346 INFO:tasks.rados.rados.0.trial082.stdout:1687: got expected ENOENT (src dne) 2026-02-12T17:35:52.346 INFO:tasks.rados.rados.0.trial082.stdout:1688: seq_num 586 ranges {648902=655095,2074801=566192,3176109=672793} 2026-02-12T17:35:52.351 INFO:tasks.rados.rados.0.trial082.stdout:1688: writing trial08226312-34 from 648902 to 1303997 tid 1 2026-02-12T17:35:52.356 INFO:tasks.rados.rados.0.trial082.stdout:1688: writing trial08226312-34 from 2074801 to 2640993 tid 2 2026-02-12T17:35:52.361 INFO:tasks.rados.rados.0.trial082.stdout:1688: writing trial08226312-34 from 3176109 to 3848902 tid 3 2026-02-12T17:35:52.361 INFO:tasks.rados.rados.0.trial082.stdout:1681: done (4 left) 2026-02-12T17:35:52.361 INFO:tasks.rados.rados.0.trial082.stdout:1689: snap_remove snap 159 2026-02-12T17:35:53.051 INFO:tasks.rados.rados.0.trial082.stdout:1689: done (4 left) 2026-02-12T17:35:53.051 INFO:tasks.rados.rados.0.trial082.stdout:1690: rollback oid 30 current snap is 177 2026-02-12T17:35:53.051 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 170 2026-02-12T17:35:53.051 INFO:tasks.rados.rados.0.trial082.stdout:1687: finishing copy_from racing read to trial08226312-12 2026-02-12T17:35:53.051 INFO:tasks.rados.rados.0.trial082.stdout:1685: finishing write tid 3 to trial08226312-44 2026-02-12T17:35:53.051 INFO:tasks.rados.rados.0.trial082.stdout:1685: finishing write tid 4 to trial08226312-44 2026-02-12T17:35:53.052 INFO:tasks.rados.rados.0.trial082.stdout:1685: finishing write tid 5 to trial08226312-44 2026-02-12T17:35:53.052 INFO:tasks.rados.rados.0.trial082.stdout:1685: oid 44 updating version 0 to 885 2026-02-12T17:35:53.052 INFO:tasks.rados.rados.0.trial082.stdout:1685: oid 44 version 885 is already newer than 884 2026-02-12T17:35:53.052 INFO:tasks.rados.rados.0.trial082.stdout:1685: oid 44 version 885 is already newer than 882 2026-02-12T17:35:53.052 INFO:tasks.rados.rados.0.trial082.stdout:1685: oid 44 version 885 is already newer than 883 2026-02-12T17:35:53.052 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 885 (ObjNum 585 snap 177 seq_num 585) dirty exists 2026-02-12T17:35:53.052 INFO:tasks.rados.rados.0.trial082.stdout:1685: left oid 44 (ObjNum 585 snap 177 seq_num 585) 2026-02-12T17:35:53.052 INFO:tasks.rados.rados.0.trial082.stdout:1686: expect (ObjNum 549 snap 167 seq_num 549) 2026-02-12T17:35:53.091 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:53.115 INFO:tasks.rados.rados.0.trial082.stdout:1688: finishing write tid 1 to trial08226312-34 2026-02-12T17:35:53.115 INFO:tasks.rados.rados.0.trial082.stdout:1685: done (4 left) 2026-02-12T17:35:53.115 INFO:tasks.rados.rados.0.trial082.stdout:1686: done (3 left) 2026-02-12T17:35:53.115 INFO:tasks.rados.rados.0.trial082.stdout:1687: done (2 left) 2026-02-12T17:35:53.115 INFO:tasks.rados.rados.0.trial082.stdout:1691: copy_from oid 37 from oid 22 current snap is 177 2026-02-12T17:35:53.115 INFO:tasks.rados.rados.0.trial082.stdout:1688: finishing write tid 2 to trial08226312-34 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1688: finishing write tid 3 to trial08226312-34 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1688: finishing write tid 4 to trial08226312-34 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1688: finishing write tid 5 to trial08226312-34 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1688: oid 34 updating version 0 to 849 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1688: oid 34 version 849 is already newer than 847 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1688: oid 34 updating version 849 to 850 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1688: oid 34 version 850 is already newer than 848 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 850 (ObjNum 586 snap 177 seq_num 586) dirty exists 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1688: left oid 34 (ObjNum 586 snap 177 seq_num 586) 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1690: finishing rollback tid 0 to trial08226312-30 2026-02-12T17:35:53.116 INFO:tasks.rados.rados.0.trial082.stdout:1690: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:35:53.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1092 (ObjNum 33 snap 0 seq_num 4560176) dirty dne 2026-02-12T17:35:53.117 INFO:tasks.rados.rados.0.trial082.stdout:1688: done (2 left) 2026-02-12T17:35:53.117 INFO:tasks.rados.rados.0.trial082.stdout:1690: done (1 left) 2026-02-12T17:35:53.117 INFO:tasks.rados.rados.0.trial082.stdout:1692: rollback oid 26 current snap is 177 2026-02-12T17:35:53.117 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 26 to 163 2026-02-12T17:35:53.117 INFO:tasks.rados.rados.0.trial082.stdout:1693: delete oid 18 current snap is 177 2026-02-12T17:35:53.118 INFO:tasks.rados.rados.0.trial082.stdout:1693: done (2 left) 2026-02-12T17:35:53.118 INFO:tasks.rados.rados.0.trial082.stdout:1694: read oid 3 snap 148 2026-02-12T17:35:53.118 INFO:tasks.rados.rados.0.trial082.stdout:1694: expect (ObjNum 248 snap 70 seq_num 248) 2026-02-12T17:35:53.118 INFO:tasks.rados.rados.0.trial082.stdout:1695: snap_remove snap 172 2026-02-12T17:35:54.073 INFO:tasks.rados.rados.0.trial082.stdout:1695: done (3 left) 2026-02-12T17:35:54.073 INFO:tasks.rados.rados.0.trial082.stdout:1696: delete oid 38 current snap is 177 2026-02-12T17:35:54.073 INFO:tasks.rados.rados.0.trial082.stdout:1692: finishing rollback tid 0 to trial08226312-26 2026-02-12T17:35:54.073 INFO:tasks.rados.rados.0.trial082.stdout:1692: finishing rollback tid 1 to trial08226312-26 2026-02-12T17:35:54.073 INFO:tasks.rados.rados.0.trial082.stdout:1692: finishing rollback tid 2 to trial08226312-26 2026-02-12T17:35:54.073 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 888 (ObjNum 463 snap 145 seq_num 463) dirty exists 2026-02-12T17:35:54.073 INFO:tasks.rados.rados.0.trial082.stdout:1694: expect (ObjNum 248 snap 70 seq_num 248) 2026-02-12T17:35:54.103 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1501889 2026-02-12T17:35:54.119 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:54.146 INFO:tasks.rados.rados.0.trial082.stdout:1691: finishing copy_from racing read to trial08226312-37 2026-02-12T17:35:54.147 INFO:tasks.rados.rados.0.trial082.stdout:1691: finishing copy_from to trial08226312-37 2026-02-12T17:35:54.147 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1079 (ObjNum 555 snap 169 seq_num 555) dirty exists 2026-02-12T17:35:54.147 INFO:tasks.rados.rados.0.trial082.stdout:1691: done (3 left) 2026-02-12T17:35:54.147 INFO:tasks.rados.rados.0.trial082.stdout:1692: done (2 left) 2026-02-12T17:35:54.147 INFO:tasks.rados.rados.0.trial082.stdout:1694: done (1 left) 2026-02-12T17:35:54.147 INFO:tasks.rados.rados.0.trial082.stdout:1696: done (0 left) 2026-02-12T17:35:54.147 INFO:tasks.rados.rados.0.trial082.stdout:1697: read oid 40 snap 148 2026-02-12T17:35:54.147 INFO:tasks.rados.rados.0.trial082.stdout:1697: expect (ObjNum 460 snap 143 seq_num 460) 2026-02-12T17:35:54.147 INFO:tasks.rados.rados.0.trial082.stdout:1698: write (excl) oid 3 current snap is 177 2026-02-12T17:35:54.148 INFO:tasks.rados.rados.0.trial082.stdout:1698: seq_num 589 ranges {699323=480842,1850247=429872,2858378=532392} 2026-02-12T17:35:54.151 INFO:tasks.rados.rados.0.trial082.stdout:1698: writing trial08226312-3 from 699323 to 1180165 tid 1 2026-02-12T17:35:54.155 INFO:tasks.rados.rados.0.trial082.stdout:1698: writing trial08226312-3 from 1850247 to 2280119 tid 2 2026-02-12T17:35:54.159 INFO:tasks.rados.rados.0.trial082.stdout:1698: writing trial08226312-3 from 2858378 to 3390770 tid 3 2026-02-12T17:35:54.160 INFO:tasks.rados.rados.0.trial082.stdout:1699: snap_create 2026-02-12T17:35:54.160 INFO:tasks.rados.rados.0.trial082.stdout:1697: expect (ObjNum 460 snap 143 seq_num 460) 2026-02-12T17:35:54.160 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1698: finishing write tid 1 to trial08226312-3 2026-02-12T17:35:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1698: finishing write tid 2 to trial08226312-3 2026-02-12T17:35:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1698: finishing write tid 3 to trial08226312-3 2026-02-12T17:35:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1698: finishing write tid 4 to trial08226312-3 2026-02-12T17:35:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1698: finishing write tid 5 to trial08226312-3 2026-02-12T17:35:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1698: oid 3 updating version 0 to 872 2026-02-12T17:35:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1698: oid 3 updating version 872 to 873 2026-02-12T17:35:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1698: oid 3 updating version 873 to 874 2026-02-12T17:35:54.267 INFO:tasks.rados.rados.0.trial082.stdout:1698: oid 3 updating version 874 to 875 2026-02-12T17:35:54.268 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 875 (ObjNum 589 snap 177 seq_num 589) dirty exists 2026-02-12T17:35:54.268 INFO:tasks.rados.rados.0.trial082.stdout:1698: left oid 3 (ObjNum 589 snap 177 seq_num 589) 2026-02-12T17:35:55.077 INFO:tasks.rados.rados.0.trial082.stdout:1697: done (2 left) 2026-02-12T17:35:55.077 INFO:tasks.rados.rados.0.trial082.stdout:1698: done (1 left) 2026-02-12T17:35:55.077 INFO:tasks.rados.rados.0.trial082.stdout:1699: done (0 left) 2026-02-12T17:35:55.077 INFO:tasks.rados.rados.0.trial082.stdout:1700: read oid 50 snap -1 2026-02-12T17:35:55.077 INFO:tasks.rados.rados.0.trial082.stdout:1700: expect deleted 2026-02-12T17:35:55.077 INFO:tasks.rados.rados.0.trial082.stdout:1701: write (excl) oid 25 current snap is 178 2026-02-12T17:35:55.077 INFO:tasks.rados.rados.0.trial082.stdout:1701: seq_num 590 ranges {716130=556091,1792376=573530,2769448=460017,3821956=94174} 2026-02-12T17:35:55.081 INFO:tasks.rados.rados.0.trial082.stdout:1701: writing trial08226312-25 from 716130 to 1272221 tid 1 2026-02-12T17:35:55.085 INFO:tasks.rados.rados.0.trial082.stdout:1701: writing trial08226312-25 from 1792376 to 2365906 tid 2 2026-02-12T17:35:55.088 INFO:tasks.rados.rados.0.trial082.stdout:1701: writing trial08226312-25 from 2769448 to 3229465 tid 3 2026-02-12T17:35:55.091 INFO:tasks.rados.rados.0.trial082.stdout:1701: writing trial08226312-25 from 3821956 to 3916130 tid 4 2026-02-12T17:35:55.091 INFO:tasks.rados.rados.0.trial082.stdout:1702: delete oid 24 current snap is 178 2026-02-12T17:35:55.091 INFO:tasks.rados.rados.0.trial082.stdout:1701: finishing write tid 1 to trial08226312-25 2026-02-12T17:35:55.091 INFO:tasks.rados.rados.0.trial082.stdout:1701: finishing write tid 2 to trial08226312-25 2026-02-12T17:35:55.091 INFO:tasks.rados.rados.0.trial082.stdout:1701: finishing write tid 3 to trial08226312-25 2026-02-12T17:35:55.092 INFO:tasks.rados.rados.0.trial082.stdout:1701: finishing write tid 4 to trial08226312-25 2026-02-12T17:35:55.092 INFO:tasks.rados.rados.0.trial082.stdout:1701: finishing write tid 5 to trial08226312-25 2026-02-12T17:35:55.092 INFO:tasks.rados.rados.0.trial082.stdout:1701: finishing write tid 6 to trial08226312-25 2026-02-12T17:35:55.092 INFO:tasks.rados.rados.0.trial082.stdout:1701: oid 25 updating version 0 to 519 2026-02-12T17:35:55.093 INFO:tasks.rados.rados.0.trial082.stdout:1701: oid 25 version 519 is already newer than 517 2026-02-12T17:35:55.093 INFO:tasks.rados.rados.0.trial082.stdout:1701: oid 25 version 519 is already newer than 515 2026-02-12T17:35:55.093 INFO:tasks.rados.rados.0.trial082.stdout:1701: oid 25 version 519 is already newer than 516 2026-02-12T17:35:55.093 INFO:tasks.rados.rados.0.trial082.stdout:1701: oid 25 version 519 is already newer than 518 2026-02-12T17:35:55.093 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 519 (ObjNum 590 snap 178 seq_num 590) dirty exists 2026-02-12T17:35:55.093 INFO:tasks.rados.rados.0.trial082.stdout:1701: left oid 25 (ObjNum 590 snap 178 seq_num 590) 2026-02-12T17:35:55.093 INFO:tasks.rados.rados.0.trial082.stdout:1700: done (2 left) 2026-02-12T17:35:55.094 INFO:tasks.rados.rados.0.trial082.stdout:1701: done (1 left) 2026-02-12T17:35:55.094 INFO:tasks.rados.rados.0.trial082.stdout:1702: done (0 left) 2026-02-12T17:35:55.094 INFO:tasks.rados.rados.0.trial082.stdout:1703: snap_create 2026-02-12T17:35:56.079 INFO:tasks.rados.rados.0.trial082.stdout:1703: done (0 left) 2026-02-12T17:35:56.079 INFO:tasks.rados.rados.0.trial082.stdout:1704: read oid 47 snap -1 2026-02-12T17:35:56.079 INFO:tasks.rados.rados.0.trial082.stdout:1704: expect (ObjNum 549 snap 167 seq_num 549) 2026-02-12T17:35:56.079 INFO:tasks.rados.rados.0.trial082.stdout:1705: snap_create 2026-02-12T17:35:56.084 INFO:tasks.rados.rados.0.trial082.stdout:1704: expect (ObjNum 549 snap 167 seq_num 549) 2026-02-12T17:35:56.084 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:56.128 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:57.081 INFO:tasks.rados.rados.0.trial082.stdout:1704: done (1 left) 2026-02-12T17:35:57.081 INFO:tasks.rados.rados.0.trial082.stdout:1705: done (0 left) 2026-02-12T17:35:57.081 INFO:tasks.rados.rados.0.trial082.stdout:1706: rollback oid 17 current snap is 180 2026-02-12T17:35:57.081 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 179 2026-02-12T17:35:57.081 INFO:tasks.rados.rados.0.trial082.stdout:1707: delete oid 47 current snap is 180 2026-02-12T17:35:57.084 INFO:tasks.rados.rados.0.trial082.stdout:1706: finishing rollback tid 0 to trial08226312-17 2026-02-12T17:35:57.084 INFO:tasks.rados.rados.0.trial082.stdout:1706: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:35:57.085 INFO:tasks.rados.rados.0.trial082.stdout:1706: finishing rollback tid 2 to trial08226312-17 2026-02-12T17:35:57.085 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 1349 (ObjNum 549 snap 167 seq_num 549) dirty exists 2026-02-12T17:35:57.085 INFO:tasks.rados.rados.0.trial082.stdout:1706: done (1 left) 2026-02-12T17:35:57.085 INFO:tasks.rados.rados.0.trial082.stdout:1707: done (0 left) 2026-02-12T17:35:57.085 INFO:tasks.rados.rados.0.trial082.stdout:1708: write (excl) oid 44 current snap is 180 2026-02-12T17:35:57.085 INFO:tasks.rados.rados.0.trial082.stdout:1708: seq_num 593 ranges {766551=498191,1684175=720857,2851717=693833} 2026-02-12T17:35:57.089 INFO:tasks.rados.rados.0.trial082.stdout:1708: writing trial08226312-44 from 766551 to 1264742 tid 1 2026-02-12T17:35:57.094 INFO:tasks.rados.rados.0.trial082.stdout:1708: writing trial08226312-44 from 1684175 to 2405032 tid 2 2026-02-12T17:35:57.119 INFO:tasks.rados.rados.0.trial082.stdout:1708: writing trial08226312-44 from 2851717 to 3545550 tid 3 2026-02-12T17:35:57.119 INFO:tasks.rados.rados.0.trial082.stdout:1709: snap_create 2026-02-12T17:35:57.119 INFO:tasks.rados.rados.0.trial082.stdout:1708: finishing write tid 1 to trial08226312-44 2026-02-12T17:35:57.119 INFO:tasks.rados.rados.0.trial082.stdout:1708: finishing write tid 2 to trial08226312-44 2026-02-12T17:35:57.119 INFO:tasks.rados.rados.0.trial082.stdout:1708: finishing write tid 3 to trial08226312-44 2026-02-12T17:35:57.119 INFO:tasks.rados.rados.0.trial082.stdout:1708: finishing write tid 4 to trial08226312-44 2026-02-12T17:35:57.119 INFO:tasks.rados.rados.0.trial082.stdout:1708: finishing write tid 5 to trial08226312-44 2026-02-12T17:35:57.119 INFO:tasks.rados.rados.0.trial082.stdout:1708: oid 44 updating version 0 to 898 2026-02-12T17:35:57.120 INFO:tasks.rados.rados.0.trial082.stdout:1708: oid 44 updating version 898 to 900 2026-02-12T17:35:57.120 INFO:tasks.rados.rados.0.trial082.stdout:1708: oid 44 version 900 is already newer than 899 2026-02-12T17:35:57.120 INFO:tasks.rados.rados.0.trial082.stdout:1708: oid 44 version 900 is already newer than 897 2026-02-12T17:35:57.120 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 900 (ObjNum 593 snap 180 seq_num 593) dirty exists 2026-02-12T17:35:57.120 INFO:tasks.rados.rados.0.trial082.stdout:1708: left oid 44 (ObjNum 593 snap 180 seq_num 593) 2026-02-12T17:35:58.051 INFO:tasks.rados.rados.0.trial082.stdout:1708: done (1 left) 2026-02-12T17:35:58.051 INFO:tasks.rados.rados.0.trial082.stdout:1709: done (0 left) 2026-02-12T17:35:58.051 INFO:tasks.rados.rados.0.trial082.stdout:1710: delete oid 13 current snap is 181 2026-02-12T17:35:58.054 INFO:tasks.rados.rados.0.trial082.stdout:1710: done (0 left) 2026-02-12T17:35:58.054 INFO:tasks.rados.rados.0.trial082.stdout:1711: delete oid 4 current snap is 181 2026-02-12T17:35:58.057 INFO:tasks.rados.rados.0.trial082.stdout:1711: done (0 left) 2026-02-12T17:35:58.057 INFO:tasks.rados.rados.0.trial082.stdout:1712: read oid 47 snap 148 2026-02-12T17:35:58.057 INFO:tasks.rados.rados.0.trial082.stdout:1712: expect (ObjNum 482 snap 147 seq_num 482) 2026-02-12T17:35:58.057 INFO:tasks.rados.rados.0.trial082.stdout:1713: read oid 12 snap 179 2026-02-12T17:35:58.057 INFO:tasks.rados.rados.0.trial082.stdout:1713: expect (ObjNum 575 snap 176 seq_num 575) 2026-02-12T17:35:58.057 INFO:tasks.rados.rados.0.trial082.stdout:1714: snap_remove snap 178 2026-02-12T17:35:59.053 INFO:tasks.rados.rados.0.trial082.stdout:1714: done (2 left) 2026-02-12T17:35:59.054 INFO:tasks.rados.rados.0.trial082.stdout:1715: snap_create 2026-02-12T17:35:59.054 INFO:tasks.rados.rados.0.trial082.stdout:1712: expect (ObjNum 482 snap 147 seq_num 482) 2026-02-12T17:35:59.054 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:35:59.092 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1307552 2026-02-12T17:35:59.115 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1184873 2026-02-12T17:35:59.128 INFO:tasks.rados.rados.0.trial082.stdout:1713: expect (ObjNum 575 snap 176 seq_num 575) 2026-02-12T17:35:59.233 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:00.054 INFO:tasks.rados.rados.0.trial082.stdout:1712: done (2 left) 2026-02-12T17:36:00.055 INFO:tasks.rados.rados.0.trial082.stdout:1713: done (1 left) 2026-02-12T17:36:00.055 INFO:tasks.rados.rados.0.trial082.stdout:1715: done (0 left) 2026-02-12T17:36:00.055 INFO:tasks.rados.rados.0.trial082.stdout:1716: read oid 49 snap -1 2026-02-12T17:36:00.055 INFO:tasks.rados.rados.0.trial082.stdout:1716: expect (ObjNum 517 snap 157 seq_num 517) 2026-02-12T17:36:00.055 INFO:tasks.rados.rados.0.trial082.stdout:1717: rollback oid 30 current snap is 182 2026-02-12T17:36:00.055 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 179 2026-02-12T17:36:00.055 INFO:tasks.rados.rados.0.trial082.stdout:1718: snap_create 2026-02-12T17:36:00.056 INFO:tasks.rados.rados.0.trial082.stdout:1717: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:36:00.056 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1092 (ObjNum 529 snap 0 seq_num 26732698) dirty dne 2026-02-12T17:36:00.061 INFO:tasks.rados.rados.0.trial082.stdout:1716: expect (ObjNum 517 snap 157 seq_num 517) 2026-02-12T17:36:00.070 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1679555 2026-02-12T17:36:00.084 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 420678 2026-02-12T17:36:01.055 INFO:tasks.rados.rados.0.trial082.stdout:1716: done (2 left) 2026-02-12T17:36:01.055 INFO:tasks.rados.rados.0.trial082.stdout:1717: done (1 left) 2026-02-12T17:36:01.055 INFO:tasks.rados.rados.0.trial082.stdout:1718: done (0 left) 2026-02-12T17:36:01.055 INFO:tasks.rados.rados.0.trial082.stdout:1719: read oid 39 snap -1 2026-02-12T17:36:01.055 INFO:tasks.rados.rados.0.trial082.stdout:1719: expect (ObjNum 582 snap 176 seq_num 582) 2026-02-12T17:36:01.055 INFO:tasks.rados.rados.0.trial082.stdout:1720: write oid 8 current snap is 183 2026-02-12T17:36:01.055 INFO:tasks.rados.rados.0.trial082.stdout:1720: seq_num 596 ranges {416972=723938,1743268=273704} 2026-02-12T17:36:01.060 INFO:tasks.rados.rados.0.trial082.stdout:1720: writing trial08226312-8 from 416972 to 1140910 tid 1 2026-02-12T17:36:01.063 INFO:tasks.rados.rados.0.trial082.stdout:1720: writing trial08226312-8 from 1743268 to 2016972 tid 2 2026-02-12T17:36:01.063 INFO:tasks.rados.rados.0.trial082.stdout:1721: snap_remove snap 179 2026-02-12T17:36:02.059 INFO:tasks.rados.rados.0.trial082.stdout:1721: done (2 left) 2026-02-12T17:36:02.059 INFO:tasks.rados.rados.0.trial082.stdout:1722: write (excl) oid 24 current snap is 183 2026-02-12T17:36:02.060 INFO:tasks.rados.rados.0.trial082.stdout:1722: seq_num 597 ranges {433779=799187,1801750=232029} 2026-02-12T17:36:02.064 INFO:tasks.rados.rados.0.trial082.stdout:1722: writing trial08226312-24 from 433779 to 1232966 tid 1 2026-02-12T17:36:02.068 INFO:tasks.rados.rados.0.trial082.stdout:1722: writing trial08226312-24 from 1801750 to 2033779 tid 2 2026-02-12T17:36:02.068 INFO:tasks.rados.rados.0.trial082.stdout:1723: rollback oid 50 current snap is 183 2026-02-12T17:36:02.068 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 180 2026-02-12T17:36:02.068 INFO:tasks.rados.rados.0.trial082.stdout:1719: expect (ObjNum 582 snap 176 seq_num 582) 2026-02-12T17:36:02.068 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:02.095 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:02.149 INFO:tasks.rados.rados.0.trial082.stdout:1720: finishing write tid 1 to trial08226312-8 2026-02-12T17:36:02.149 INFO:tasks.rados.rados.0.trial082.stdout:1720: finishing write tid 2 to trial08226312-8 2026-02-12T17:36:02.149 INFO:tasks.rados.rados.0.trial082.stdout:1720: finishing write tid 3 to trial08226312-8 2026-02-12T17:36:02.149 INFO:tasks.rados.rados.0.trial082.stdout:1720: finishing write tid 4 to trial08226312-8 2026-02-12T17:36:02.149 INFO:tasks.rados.rados.0.trial082.stdout:1720: oid 8 updating version 0 to 1362 2026-02-12T17:36:02.149 INFO:tasks.rados.rados.0.trial082.stdout:1720: oid 8 updating version 1362 to 1363 2026-02-12T17:36:02.149 INFO:tasks.rados.rados.0.trial082.stdout:1720: oid 8 version 1363 is already newer than 1361 2026-02-12T17:36:02.149 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1363 (ObjNum 596 snap 183 seq_num 596) dirty exists 2026-02-12T17:36:02.149 INFO:tasks.rados.rados.0.trial082.stdout:1720: left oid 8 (ObjNum 596 snap 183 seq_num 596) 2026-02-12T17:36:02.150 INFO:tasks.rados.rados.0.trial082.stdout:1723: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:36:02.150 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 0 (ObjNum 225 snap 0 seq_num 26833344) dirty dne 2026-02-12T17:36:02.150 INFO:tasks.rados.rados.0.trial082.stdout:1722: finishing write tid 1 to trial08226312-24 2026-02-12T17:36:02.150 INFO:tasks.rados.rados.0.trial082.stdout:1722: finishing write tid 2 to trial08226312-24 2026-02-12T17:36:02.150 INFO:tasks.rados.rados.0.trial082.stdout:1719: done (3 left) 2026-02-12T17:36:02.150 INFO:tasks.rados.rados.0.trial082.stdout:1720: done (2 left) 2026-02-12T17:36:02.150 INFO:tasks.rados.rados.0.trial082.stdout:1723: done (1 left) 2026-02-12T17:36:02.150 INFO:tasks.rados.rados.0.trial082.stdout:1724: snap_remove snap 163 2026-02-12T17:36:03.051 INFO:tasks.rados.rados.0.trial082.stdout:1724: done (1 left) 2026-02-12T17:36:03.051 INFO:tasks.rados.rados.0.trial082.stdout:1725: snap_create 2026-02-12T17:36:03.051 INFO:tasks.rados.rados.0.trial082.stdout:1722: finishing write tid 3 to trial08226312-24 2026-02-12T17:36:03.051 INFO:tasks.rados.rados.0.trial082.stdout:1722: finishing write tid 4 to trial08226312-24 2026-02-12T17:36:03.052 INFO:tasks.rados.rados.0.trial082.stdout:1722: oid 24 updating version 0 to 1369 2026-02-12T17:36:03.052 INFO:tasks.rados.rados.0.trial082.stdout:1722: oid 24 updating version 1369 to 1370 2026-02-12T17:36:03.052 INFO:tasks.rados.rados.0.trial082.stdout:1722: oid 24 version 1370 is already newer than 1364 2026-02-12T17:36:03.052 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1370 (ObjNum 597 snap 183 seq_num 597) dirty exists 2026-02-12T17:36:03.052 INFO:tasks.rados.rados.0.trial082.stdout:1722: left oid 24 (ObjNum 597 snap 183 seq_num 597) 2026-02-12T17:36:04.052 INFO:tasks.rados.rados.0.trial082.stdout:1722: done (1 left) 2026-02-12T17:36:04.052 INFO:tasks.rados.rados.0.trial082.stdout:1725: done (0 left) 2026-02-12T17:36:04.052 INFO:tasks.rados.rados.0.trial082.stdout:1726: read oid 7 snap -1 2026-02-12T17:36:04.052 INFO:tasks.rados.rados.0.trial082.stdout:1726: expect (ObjNum 468 snap 146 seq_num 468) 2026-02-12T17:36:04.052 INFO:tasks.rados.rados.0.trial082.stdout:1727: delete oid 8 current snap is 184 2026-02-12T17:36:04.054 INFO:tasks.rados.rados.0.trial082.stdout:1726: expect (ObjNum 468 snap 146 seq_num 468) 2026-02-12T17:36:04.131 INFO:tasks.rados.rados.0.trial082.stdout:1726: done (1 left) 2026-02-12T17:36:04.131 INFO:tasks.rados.rados.0.trial082.stdout:1727: done (0 left) 2026-02-12T17:36:04.131 INFO:tasks.rados.rados.0.trial082.stdout:1728: read oid 50 snap -1 2026-02-12T17:36:04.131 INFO:tasks.rados.rados.0.trial082.stdout:1728: expect deleted 2026-02-12T17:36:04.132 INFO:tasks.rados.rados.0.trial082.stdout:1729: snap_create 2026-02-12T17:36:05.062 INFO:tasks.rados.rados.0.trial082.stdout:1728: done (1 left) 2026-02-12T17:36:05.062 INFO:tasks.rados.rados.0.trial082.stdout:1729: done (0 left) 2026-02-12T17:36:05.063 INFO:tasks.rados.rados.0.trial082.stdout:1730: snap_remove snap 184 2026-02-12T17:36:06.064 INFO:tasks.rados.rados.0.trial082.stdout:1730: done (0 left) 2026-02-12T17:36:06.064 INFO:tasks.rados.rados.0.trial082.stdout:1731: read oid 38 snap -1 2026-02-12T17:36:06.064 INFO:tasks.rados.rados.0.trial082.stdout:1731: expect deleted 2026-02-12T17:36:06.064 INFO:tasks.rados.rados.0.trial082.stdout:1732: read oid 15 snap 180 2026-02-12T17:36:06.064 INFO:tasks.rados.rados.0.trial082.stdout:1732: expect (ObjNum 456 snap 143 seq_num 456) 2026-02-12T17:36:06.065 INFO:tasks.rados.rados.0.trial082.stdout:1733: read oid 20 snap -1 2026-02-12T17:36:06.065 INFO:tasks.rados.rados.0.trial082.stdout:1733: expect (ObjNum 570 snap 176 seq_num 570) 2026-02-12T17:36:06.065 INFO:tasks.rados.rados.0.trial082.stdout:1734: write (excl) oid 14 current snap is 185 2026-02-12T17:36:06.065 INFO:tasks.rados.rados.0.trial082.stdout:1734: seq_num 599 ranges {467393=549685,1802361=265032} 2026-02-12T17:36:06.068 INFO:tasks.rados.rados.0.trial082.stdout:1734: writing trial08226312-14 from 467393 to 1017078 tid 1 2026-02-12T17:36:06.072 INFO:tasks.rados.rados.0.trial082.stdout:1734: writing trial08226312-14 from 1802361 to 2067393 tid 2 2026-02-12T17:36:06.073 INFO:tasks.rados.rados.0.trial082.stdout:1735: snap_create 2026-02-12T17:36:06.073 INFO:tasks.rados.rados.0.trial082.stdout:1732: expect (ObjNum 456 snap 143 seq_num 456) 2026-02-12T17:36:06.095 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1986912 2026-02-12T17:36:06.217 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3020201 2026-02-12T17:36:06.223 INFO:tasks.rados.rados.0.trial082.stdout:1733: expect (ObjNum 570 snap 176 seq_num 570) 2026-02-12T17:36:06.286 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:06.319 INFO:tasks.rados.rados.0.trial082.stdout:1734: finishing write tid 1 to trial08226312-14 2026-02-12T17:36:06.319 INFO:tasks.rados.rados.0.trial082.stdout:1734: finishing write tid 2 to trial08226312-14 2026-02-12T17:36:06.319 INFO:tasks.rados.rados.0.trial082.stdout:1734: finishing write tid 3 to trial08226312-14 2026-02-12T17:36:06.319 INFO:tasks.rados.rados.0.trial082.stdout:1734: finishing write tid 4 to trial08226312-14 2026-02-12T17:36:06.319 INFO:tasks.rados.rados.0.trial082.stdout:1734: oid 14 updating version 0 to 877 2026-02-12T17:36:06.319 INFO:tasks.rados.rados.0.trial082.stdout:1734: oid 14 updating version 877 to 878 2026-02-12T17:36:06.319 INFO:tasks.rados.rados.0.trial082.stdout:1734: oid 14 version 878 is already newer than 876 2026-02-12T17:36:06.319 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 878 (ObjNum 599 snap 185 seq_num 599) dirty exists 2026-02-12T17:36:06.320 INFO:tasks.rados.rados.0.trial082.stdout:1734: left oid 14 (ObjNum 599 snap 185 seq_num 599) 2026-02-12T17:36:06.458 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:36:06.458 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:36:06.459 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T17:36:06.459 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T17:36:06.472 INFO:tasks.ceph.mon.c:Started 2026-02-12T17:36:06.472 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:36:06.472 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:36:06.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.542+0000 7f7221da5640 10 monclient: get_monmap_and_config 2026-02-12T17:36:06.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.542+0000 7f7221da5640 10 monclient: build_initial_monmap 2026-02-12T17:36:06.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.542+0000 7f7221da5640 10 monclient: monmap: 2026-02-12T17:36:06.541 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:06.541 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.541 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:06.543249+0000 2026-02-12T17:36:06.541 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:06.543249+0000 2026-02-12T17:36:06.541 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:06.541 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.542+0000 7f7221da5640 1 Processor -- start 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.542+0000 7f7221da5640 1 -- start start 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.542+0000 7f7221da5640 10 monclient: init 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 10 monclient(hunting): picked mon.noname-c con 0x7f721c08ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 10 monclient(hunting): picked mon.noname-b con 0x7f721c08c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:06.542 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 10 monclient(hunting): picked mon.noname-a con 0x7f721c08cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721c08d600 con 0x7f721c08cb30 2026-02-12T17:36:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721c08b1f0 con 0x7f721c08ae20 2026-02-12T17:36:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721c08d1f0 con 0x7f721c08c730 2026-02-12T17:36:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f7221da5640 10 monclient(hunting): authenticate will time out at 1046.362116s 2026-02-12T17:36:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f721affd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f721c08c730 0x7f721c181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39674/0 (socket says 10.20.193.57:39674) 2026-02-12T17:36:06.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.543+0000 7f721affd640 1 -- 10.20.193.57:0/1822314808 learned_addr learned my addr 10.20.193.57:0/1822314808 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:06.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721affd640 1 -- 10.20.193.57:0/1822314808 >> v1:10.20.193.57:6790/0 conn(0x7f721c08c730 legacy=0x7f721c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721bfff640 1 -- 10.20.193.57:0/1822314808 >> v1:10.20.193.57:6789/0 conn(0x7f721c08cb30 legacy=0x7f721c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 -- 10.20.193.57:0/1822314808 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016460421 0 0) 0x7f721c08d600 con 0x7f721c08cb30 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient(hunting): my global_id is 54186 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 -- 10.20.193.57:0/1822314808 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72000035e0 con 0x7f721c08cb30 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 -- 10.20.193.57:0/1822314808 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1361198178 0 0) 0x7f72000035e0 con 0x7f721c08cb30 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 -- 10.20.193.57:0/1822314808 >> v1:10.20.193.57:6790/0 conn(0x7f721c08c730 legacy=0x7f721c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 -- 10.20.193.57:0/1822314808 >> v1:10.20.193.82:6789/0 conn(0x7f721c08ae20 legacy=0x7f721c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 monclient: found mon.noname-a 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 -- 10.20.193.57:0/1822314808 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c057320 con 0x7f721c08cb30 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: _finish_auth 0 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f7221da5640 5 monclient: authenticate success, global_id 54186 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f7221da5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 -- 10.20.193.57:0/1822314808 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7210004200 con 0x7f721c08cb30 2026-02-12T17:36:06.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: dump: 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.553 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f7221da5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 -- 10.20.193.57:0/1822314808 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7210004490 con 0x7f721c08cb30 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f7221da5640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f7221da5640 4 set_mon_vals no callback set 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 1 -- 10.20.193.57:0/1822314808 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7210004960 con 0x7f721c08cb30 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.545+0000 7f721a7fc640 10 monclient: dump: 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.554 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 10 monclient: shutdown 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 1 -- 10.20.193.57:0/1822314808 >> v1:10.20.193.57:6789/0 conn(0x7f721c08cb30 legacy=0x7f721c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 1 -- 10.20.193.57:0/1822314808 shutdown_connections 2026-02-12T17:36:06.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 1 -- 10.20.193.57:0/1822314808 >> 10.20.193.57:0/1822314808 conn(0x7f721c091620 msgr2=0x7f721c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 1 -- 10.20.193.57:0/1822314808 shutdown_connections 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 1 -- 10.20.193.57:0/1822314808 wait complete. 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 10 monclient: build_initial_monmap 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 10 monclient: monmap: 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:06.556 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 1 Processor -- start 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 1 -- start start 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.546+0000 7f7221da5640 10 monclient: init 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 10 monclient(hunting): picked mon.noname-c con 0x7f721c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 10 monclient(hunting): picked mon.noname-a con 0x7f721c08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 10 monclient(hunting): picked mon.noname-b con 0x7f721c08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721c08d9c0 con 0x7f721c08c730 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721c121850 con 0x7f721c08cb30 2026-02-12T17:36:06.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721c11baa0 con 0x7f721c08ae20 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f7221da5640 10 monclient(hunting): authenticate will time out at 1046.366131s 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f721b7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f721c08ae20 0x7f721c117e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39682/0 (socket says 10.20.193.57:39682) 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f721b7fe640 1 -- 10.20.193.57:0/179458544 learned_addr learned my addr 10.20.193.57:0/179458544 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.547+0000 7f721affd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f721c08c730 0x7f721c118580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35598/0 (socket says 10.20.193.57:35598) 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f721affd640 1 -- 10.20.193.57:0/179458544 >> v1:10.20.193.57:6789/0 conn(0x7f721c08c730 legacy=0x7f721c118580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f721b7fe640 1 -- 10.20.193.57:0/179458544 >> v1:10.20.193.57:6790/0 conn(0x7f721c08ae20 legacy=0x7f721c117e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f721bfff640 1 -- 10.20.193.57:0/179458544 >> v1:10.20.193.82:6789/0 conn(0x7f721c08cb30 legacy=0x7f721c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241136090 0 0) 0x7f721c057320 con 0x7f721c08cb30 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): my global_id is 4747 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71ec0035e0 con 0x7f721c08cb30 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179741382 0 0) 0x7f721c08d9c0 con 0x7f721c08c730 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): my global_id is 54189 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f721c057320 con 0x7f721c08c730 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4183592068 0 0) 0x7f71ec0035e0 con 0x7f721c08cb30 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f721c08d9c0 con 0x7f721c08cb30 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f72100047b0 con 0x7f721c08cb30 2026-02-12T17:36:06.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): dump: 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.560 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3215221954 0 0) 0x7f721c057320 con 0x7f721c08c730 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71ec0035e0 con 0x7f721c08c730 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f720c003280 con 0x7f721c08c730 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 10 monclient(hunting): dump: 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.561 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.549+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4122389112 0 0) 0x7f721c08d9c0 con 0x7f721c08cb30 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 >> v1:10.20.193.57:6790/0 conn(0x7f721c08ae20 legacy=0x7f721c117e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 >> v1:10.20.193.57:6789/0 conn(0x7f721c08c730 legacy=0x7f721c118580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 10 monclient: _finish_hunting 0 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 1 monclient: found mon.b 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:06.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c088810 con 0x7f721c08cb30 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 10 monclient: _finish_auth 0 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 10 monclient: _check_auth_tickets 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 5 monclient: authenticate success, global_id 4747 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 10 monclient: _renew_subs 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f721c118c90 con 0x7f721c08cb30 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 10 monclient: _renew_subs 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f721c119740 con 0x7f721c08cb30 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7210004f00 con 0x7f721c08cb30 2026-02-12T17:36:06.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7210005260 con 0x7f721c08cb30 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 10 monclient: dump: 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.564 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7219ffb640 4 set_mon_vals no callback set 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721c0008d0 con 0x7f721c08cb30 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.550+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f7210005400 con 0x7f721c08cb30 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.551+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(388..388 src has 202..388) ==== 3959+0+0 (unknown 3789686627 0 0) 0x7f721004fb70 con 0x7f721c08cb30 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.551+0000 7f721b7fe640 10 monclient: get_auth_request con 0x7f71ec03fb30 auth_method 0 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.553+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f7210017cb0 con 0x7f721c08cb30 2026-02-12T17:36:06.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.553+0000 7f71f7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:06.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.553+0000 7f71f7fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:06.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.697+0000 7f7221da5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:36:06.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.697+0000 7f7221da5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:06.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.697+0000 7f7221da5640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:06.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.697+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f721c121850 con 0x7f721c08cb30 2026-02-12T17:36:06.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.697+0000 7f71f7fff640 1 -- 10.20.193.57:0/179458544 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 4047902000) 0x7f721c121850 con 0x7f721c08cb30 2026-02-12T17:36:06.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.697+0000 7f71f7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:06.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.697+0000 7f71f7fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:06.696 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:36:06.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.698+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 >> v1:10.20.193.82:6800/2441377515 conn(0x7f71ec03fb30 legacy=0x7f71ec05ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.698+0000 7f7221da5640 10 monclient: shutdown 2026-02-12T17:36:06.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.698+0000 7f7221da5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:06.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.698+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 >> v1:10.20.193.82:6789/0 conn(0x7f721c08cb30 legacy=0x7f721c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.698+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 shutdown_connections 2026-02-12T17:36:06.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.698+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 >> 10.20.193.57:0/179458544 conn(0x7f721c091620 msgr2=0x7f721c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:06.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.698+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 shutdown_connections 2026-02-12T17:36:06.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.698+0000 7f7221da5640 1 -- 10.20.193.57:0/179458544 wait complete. 2026-02-12T17:36:06.704 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:36:06.704 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:36:06.704 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.773+0000 7f5f21852640 10 monclient: get_monmap_and_config 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.773+0000 7f5f21852640 10 monclient: build_initial_monmap 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.773+0000 7f5f21852640 10 monclient: monmap: 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:06.774339+0000 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:06.774339+0000 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.771 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:06.772 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:06.772 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:06.772 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.773+0000 7f5f21852640 1 Processor -- start 2026-02-12T17:36:06.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.773+0000 7f5f21852640 1 -- start start 2026-02-12T17:36:06.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.773+0000 7f5f21852640 10 monclient: init 2026-02-12T17:36:06.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:06.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:36:06.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 10 monclient(hunting): picked mon.noname-a con 0x7f5f1c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:06.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 10 monclient(hunting): picked mon.noname-c con 0x7f5f1c08c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:06.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 10 monclient(hunting): picked mon.noname-b con 0x7f5f1c182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:06.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c08a820 con 0x7f5f1c08c250 2026-02-12T17:36:06.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c089450 con 0x7f5f1c08c620 2026-02-12T17:36:06.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c089730 con 0x7f5f1c182cc0 2026-02-12T17:36:06.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:06.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f21852640 10 monclient(hunting): authenticate will time out at 1046.593206s 2026-02-12T17:36:06.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f1affd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f5f1c08c250 0x7f5f1c08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35612/0 (socket says 10.20.193.57:35612) 2026-02-12T17:36:06.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.774+0000 7f5f1affd640 1 -- 10.20.193.57:0/837271157 learned_addr learned my addr 10.20.193.57:0/837271157 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f1b7fe640 1 -- 10.20.193.57:0/837271157 >> v1:10.20.193.57:6790/0 conn(0x7f5f1c182cc0 legacy=0x7f5f1c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f1affd640 1 -- 10.20.193.57:0/837271157 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c08c250 legacy=0x7f5f1c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f1a7fc640 1 -- 10.20.193.57:0/837271157 >> v1:10.20.193.82:6789/0 conn(0x7f5f1c08c620 legacy=0x7f5f1c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663886918 0 0) 0x7f5f10002b50 con 0x7f5f1c08c250 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient(hunting): my global_id is 54192 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f080035e0 con 0x7f5f1c08c250 2026-02-12T17:36:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122772432 0 0) 0x7f5f1c089450 con 0x7f5f1c08c620 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient(hunting): my global_id is 4750 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f10002b50 con 0x7f5f1c08c620 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3923377581 0 0) 0x7f5f080035e0 con 0x7f5f1c08c250 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 >> v1:10.20.193.57:6790/0 conn(0x7f5f1c182cc0 legacy=0x7f5f1c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 >> v1:10.20.193.82:6789/0 conn(0x7f5f1c08c620 legacy=0x7f5f1c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 monclient: found mon.noname-a 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:06.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c089a10 con 0x7f5f1c08c250 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: _finish_auth 0 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f10003190 con 0x7f5f1c08c250 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: dump: 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.785 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f21852640 5 monclient: authenticate success, global_id 54192 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f21852640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f10003490 con 0x7f5f1c08c250 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 1 -- 10.20.193.57:0/837271157 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f10004b10 con 0x7f5f1c08c250 2026-02-12T17:36:06.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.776+0000 7f5f19ffb640 10 monclient: dump: 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 4 set_mon_vals no callback set 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 10 monclient: shutdown 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 1 -- 10.20.193.57:0/837271157 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c08c250 legacy=0x7f5f1c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 1 -- 10.20.193.57:0/837271157 shutdown_connections 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 1 -- 10.20.193.57:0/837271157 >> 10.20.193.57:0/837271157 conn(0x7f5f1c0916b0 msgr2=0x7f5f1c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 1 -- 10.20.193.57:0/837271157 shutdown_connections 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 1 -- 10.20.193.57:0/837271157 wait complete. 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 10 monclient: build_initial_monmap 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.777+0000 7f5f21852640 10 monclient: monmap: 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:06.788 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 1 Processor -- start 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 1 -- start start 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 10 monclient: init 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:06.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 10 monclient(hunting): picked mon.noname-a con 0x7f5f1c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 10 monclient(hunting): picked mon.noname-c con 0x7f5f1c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 10 monclient(hunting): picked mon.noname-b con 0x7f5f1c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c05cef0 con 0x7f5f1c08c250 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c05e130 con 0x7f5f1c182cc0 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c05cc70 con 0x7f5f1c08c620 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f21852640 10 monclient(hunting): authenticate will time out at 1046.597432s 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f1affd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f5f1c08c250 0x7f5f1c05a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35626/0 (socket says 10.20.193.57:35626) 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.778+0000 7f5f1affd640 1 -- 10.20.193.57:0/3803448539 learned_addr learned my addr 10.20.193.57:0/3803448539 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5f1a7fc640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6790/0 conn(0x7f5f1c08c620 legacy=0x7f5f1c05b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5f1affd640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c08c250 legacy=0x7f5f1c05a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702390182 0 0) 0x7f5f1c05cc70 con 0x7f5f1c08c620 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): my global_id is 64100 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eec0035e0 con 0x7f5f1c08c620 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432940942 0 0) 0x7f5f1c05cef0 con 0x7f5f1c08c250 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): my global_id is 54195 2026-02-12T17:36:06.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f1c05cc70 con 0x7f5f1c08c250 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5f1b7fe640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.82:6789/0 conn(0x7f5f1c182cc0 legacy=0x7f5f1c193530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3740051969 0 0) 0x7f5eec0035e0 con 0x7f5f1c08c620 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f1c05cef0 con 0x7f5f1c08c620 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f040033b0 con 0x7f5f1c08c620 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): dump: 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.792 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1374674176 0 0) 0x7f5f1c05cc70 con 0x7f5f1c08c250 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5eec0035e0 con 0x7f5f1c08c250 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f10003330 con 0x7f5f1c08c250 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:06.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.780+0000 7f5ef3fff640 10 monclient(hunting): dump: 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2078530712 0 0) 0x7f5f1c05cef0 con 0x7f5f1c08c620 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.82:6789/0 conn(0x7f5f1c182cc0 legacy=0x7f5f1c193530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c08c250 legacy=0x7f5f1c05a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 10 monclient: _finish_hunting 0 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 1 monclient: found mon.c 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c05b740 con 0x7f5f1c08c620 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 10 monclient: _finish_auth 0 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 10 monclient: _check_auth_tickets 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f21852640 5 monclient: authenticate success, global_id 64100 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f21852640 10 monclient: _renew_subs 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f21852640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:06.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1c05c830 con 0x7f5f1c08c620 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f21852640 10 monclient: _renew_subs 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f21852640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5f1c05de50 con 0x7f5f1c08c620 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f04003980 con 0x7f5f1c08c620 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f04003ca0 con 0x7f5f1c08c620 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 10 monclient: dump: 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.796 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f197fa640 4 set_mon_vals no callback set 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f21852640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5f1c085180 con 0x7f5f1c084db0 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5f04003ef0 con 0x7f5f1c08c620 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.781+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(388..388 src has 202..388) ==== 3959+0+0 (unknown 3789686627 0 0) 0x7f5f0404eb60 con 0x7f5f1c08c620 2026-02-12T17:36:06.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.782+0000 7f5f1b7fe640 10 monclient: get_auth_request con 0x7f5eec03fae0 auth_method 0 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.783+0000 7f5f1affd640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c084db0 legacy=0x7f5f1c18d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.783+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599555553 0 0) 0x7f5f1c085180 con 0x7f5f1c084db0 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.783+0000 7f5ef3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.783+0000 7f5ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.783+0000 7f5ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.783+0000 7f5ef3fff640 10 monclient(hunting): my global_id is 54198 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.783+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f1c05cef0 con 0x7f5f1c084db0 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 440674246 0 0) 0x7f5f1c05cef0 con 0x7f5f1c084db0 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f1c085180 con 0x7f5f1c084db0 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f10005160 con 0x7f5f1c084db0 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 10 monclient: dump: 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3904618696 0 0) 0x7f5f1c085180 con 0x7f5f1c084db0 2026-02-12T17:36:06.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f1c13e9a0 con 0x7f5f1c084db0 2026-02-12T17:36:06.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5f100053f0 con 0x7f5f1c084db0 2026-02-12T17:36:06.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:06.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:06.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c084db0 legacy=0x7f5f1c18d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.784+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c084db0 legacy=0x7f5f1c18d340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:06.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.787+0000 7f5f21852640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:36:06.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.787+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5f1c08e440 con 0x7f5f1c18da50 2026-02-12T17:36:06.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.789+0000 7f5f1affd640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c18da50 legacy=0x7f5f1c195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698726731 0 0) 0x7f5f1c08e440 con 0x7f5f1c18da50 2026-02-12T17:36:06.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 10 monclient(hunting): my global_id is 54201 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f1c085180 con 0x7f5f1c18da50 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 738411554 0 0) 0x7f5f1c085180 con 0x7f5f1c18da50 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f1c08e440 con 0x7f5f1c18da50 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5f10005a10 con 0x7f5f1c18da50 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 10 monclient: dump: 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.803 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2025454783 0 0) 0x7f5f1c08e440 con 0x7f5f1c18da50 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f1c08f580 con 0x7f5f1c18da50 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 800693344) 0x7f5f10005f00 con 0x7f5f1c18da50 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c18da50 legacy=0x7f5f1c195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5ef3fff640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6789/0 conn(0x7f5f1c18da50 legacy=0x7f5f1c195c60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:06.805 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:36:06.805 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:06.805 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:06.805 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:36:06.805 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 34, 2026-02-12T17:36:06.805 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 107268, 2026-02-12T17:36:06.805 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:36:06.805 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:06.806 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:06.807 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:36:06.808 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:36:06.809 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:06.810 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.811 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:06.812 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:06.813 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.814 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:06.815 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:06.816 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:36:06.816 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.816 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.816 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.816 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:36:06.816 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.82:6800/2441377515 conn(0x7f5eec03fae0 legacy=0x7f5eec05ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f21852640 10 monclient: shutdown 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f21852640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 >> v1:10.20.193.57:6790/0 conn(0x7f5f1c08c620 legacy=0x7f5f1c05b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f1b7fe640 1 -- 10.20.193.57:0/3803448539 reap_dead start 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f1b7fe640 1 -- 10.20.193.57:0/3803448539 reap_dead start 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 shutdown_connections 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 >> 10.20.193.57:0/3803448539 conn(0x7f5f1c0916b0 msgr2=0x7f5f1c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 shutdown_connections 2026-02-12T17:36:06.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.790+0000 7f5f21852640 1 -- 10.20.193.57:0/3803448539 wait complete. 2026-02-12T17:36:06.818 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:36:06.818 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:36:06.818 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:36:06.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.886+0000 7fd32285b640 10 monclient: get_monmap_and_config 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.886+0000 7fd32285b640 10 monclient: build_initial_monmap 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.886+0000 7fd32285b640 10 monclient: monmap: 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:06.887117+0000 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:06.887117+0000 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:06.885 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.886+0000 7fd32285b640 1 Processor -- start 2026-02-12T17:36:06.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.886+0000 7fd32285b640 1 -- start start 2026-02-12T17:36:06.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.886+0000 7fd32285b640 10 monclient: init 2026-02-12T17:36:06.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:06.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:36:06.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 10 monclient(hunting): picked mon.noname-a con 0x7fd31c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:06.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 10 monclient(hunting): picked mon.noname-b con 0x7fd31c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:06.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 10 monclient(hunting): picked mon.noname-c con 0x7fd31c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:06.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c08a820 con 0x7fd31c08c250 2026-02-12T17:36:06.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c089450 con 0x7fd31c182cc0 2026-02-12T17:36:06.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c089730 con 0x7fd31c08c620 2026-02-12T17:36:06.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:06.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd32285b640 10 monclient(hunting): authenticate will time out at 1046.706239s 2026-02-12T17:36:06.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd31bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd31c08c250 0x7fd31c08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35650/0 (socket says 10.20.193.57:35650) 2026-02-12T17:36:06.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.887+0000 7fd31bfff640 1 -- 10.20.193.57:0/2239346968 learned_addr learned my addr 10.20.193.57:0/2239346968 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:06.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31bfff640 1 -- 10.20.193.57:0/2239346968 >> v1:10.20.193.57:6789/0 conn(0x7fd31c08c250 legacy=0x7fd31c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31b7fe640 1 -- 10.20.193.57:0/2239346968 >> v1:10.20.193.57:6790/0 conn(0x7fd31c08c620 legacy=0x7fd31c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035911165 0 0) 0x7fd31c089730 con 0x7fd31c08c620 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient(hunting): my global_id is 64103 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3000035e0 con 0x7fd31c08c620 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345037387 0 0) 0x7fd308002c20 con 0x7fd31c08c250 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient(hunting): my global_id is 54204 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd31c089730 con 0x7fd31c08c250 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd320dd1640 1 -- 10.20.193.57:0/2239346968 >> v1:10.20.193.82:6789/0 conn(0x7fd31c182cc0 legacy=0x7fd31c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3083071997 0 0) 0x7fd3000035e0 con 0x7fd31c08c620 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 >> v1:10.20.193.82:6789/0 conn(0x7fd31c182cc0 legacy=0x7fd31c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 >> v1:10.20.193.57:6789/0 conn(0x7fd31c08c250 legacy=0x7fd31c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: _finish_hunting 0 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 monclient: found mon.noname-b 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c089a10 con 0x7fd31c08c620 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: _finish_auth 0 2026-02-12T17:36:06.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: _check_auth_tickets 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd30c003120 con 0x7fd31c08c620 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: dump: 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.896 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd32285b640 5 monclient: authenticate success, global_id 64103 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd32285b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd30c003420 con 0x7fd31c08c620 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 1 -- 10.20.193.57:0/2239346968 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd30c003880 con 0x7fd31c08c620 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:06.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd31affd640 10 monclient: dump: 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd32285b640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:06.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.889+0000 7fd32285b640 4 set_mon_vals no callback set 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 10 monclient: shutdown 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 1 -- 10.20.193.57:0/2239346968 >> v1:10.20.193.57:6790/0 conn(0x7fd31c08c620 legacy=0x7fd31c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 1 -- 10.20.193.57:0/2239346968 shutdown_connections 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 1 -- 10.20.193.57:0/2239346968 >> 10.20.193.57:0/2239346968 conn(0x7fd31c0916b0 msgr2=0x7fd31c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 1 -- 10.20.193.57:0/2239346968 shutdown_connections 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 1 -- 10.20.193.57:0/2239346968 wait complete. 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 10 monclient: build_initial_monmap 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 10 monclient: monmap: 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:06.899 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 1 Processor -- start 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 1 -- start start 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.890+0000 7fd32285b640 10 monclient: init 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:36:06.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 10 monclient(hunting): picked mon.noname-a con 0x7fd31c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 10 monclient(hunting): picked mon.noname-c con 0x7fd31c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 10 monclient(hunting): picked mon.noname-b con 0x7fd31c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c137a10 con 0x7fd31c08c250 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c138730 con 0x7fd31c182cc0 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c138a10 con 0x7fd31c08c620 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd32285b640 10 monclient(hunting): authenticate will time out at 1046.710049s 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd31b7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fd31c08c620 0x7fd31c18d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39726/0 (socket says 10.20.193.57:39726) 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd31bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd31c08c250 0x7fd31c18d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35664/0 (socket says 10.20.193.57:35664) 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.891+0000 7fd31b7fe640 1 -- 10.20.193.57:0/2901939400 learned_addr learned my addr 10.20.193.57:0/2901939400 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd31b7fe640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6790/0 conn(0x7fd31c08c620 legacy=0x7fd31c18d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd31bfff640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6789/0 conn(0x7fd31c08c250 legacy=0x7fd31c18d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796308330 0 0) 0x7fd31c138a10 con 0x7fd31c08c620 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): my global_id is 64106 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2ec0035e0 con 0x7fd31c08c620 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3817896936 0 0) 0x7fd31c137a10 con 0x7fd31c08c250 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): my global_id is 54207 2026-02-12T17:36:06.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd31c138a10 con 0x7fd31c08c250 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2430615317 0 0) 0x7fd2ec0035e0 con 0x7fd31c08c620 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd31c137a10 con 0x7fd31c08c620 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd30c0032c0 con 0x7fd31c08c620 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): dump: 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.903 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4004583036 0 0) 0x7fd31c138a10 con 0x7fd31c08c250 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2ec0035e0 con 0x7fd31c08c250 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd3080034f0 con 0x7fd31c08c250 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient(hunting): dump: 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.904 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2576604630 0 0) 0x7fd31c137a10 con 0x7fd31c08c620 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd320dd1640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.82:6789/0 conn(0x7fd31c182cc0 legacy=0x7fd31c1957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.82:6789/0 conn(0x7fd31c182cc0 legacy=0x7fd31c1957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6789/0 conn(0x7fd31c08c250 legacy=0x7fd31c18d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 monclient: found mon.c 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c136f90 con 0x7fd31c08c620 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient: _finish_auth 0 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd32285b640 5 monclient: authenticate success, global_id 64106 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd32285b640 10 monclient: _renew_subs 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd32285b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c18dfc0 con 0x7fd31c08c620 2026-02-12T17:36:06.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd32285b640 10 monclient: _renew_subs 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd32285b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd31c137210 con 0x7fd31c08c620 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd30c003e60 con 0x7fd31c08c620 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd30c0041c0 con 0x7fd31c08c620 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd31a7fc640 4 set_mon_vals no callback set 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.893+0000 7fd318ff9640 10 monclient: dump: 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.907 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.894+0000 7fd32285b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.894+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd31c090810 con 0x7fd31c138340 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.894+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fd30c012390 con 0x7fd31c08c620 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.894+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(388..388 src has 202..388) ==== 3959+0+0 (unknown 3789686627 0 0) 0x7fd30c04ee20 con 0x7fd31c08c620 2026-02-12T17:36:06.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.894+0000 7fd320dd1640 10 monclient: get_auth_request con 0x7fd2ec03fb50 auth_method 0 2026-02-12T17:36:06.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd31bfff640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6790/0 conn(0x7fd31c138340 legacy=0x7fd31c18f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433743446 0 0) 0x7fd31c090810 con 0x7fd31c138340 2026-02-12T17:36:06.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 10 monclient(hunting): my global_id is 64109 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd31c137a10 con 0x7fd31c138340 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 344010941 0 0) 0x7fd31c137a10 con 0x7fd31c138340 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd31c090810 con 0x7fd31c138340 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd308004a80 con 0x7fd31c138340 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 10 monclient: dump: 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.912 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 897477890 0 0) 0x7fd31c090810 con 0x7fd31c138340 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.896+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd31c08f5b0 con 0x7fd31c138340 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.897+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fd308005990 con 0x7fd31c138340 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.897+0000 7fd318ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.897+0000 7fd318ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:06.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.897+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6790/0 conn(0x7fd31c138340 legacy=0x7fd31c18f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.897+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6790/0 conn(0x7fd31c138340 legacy=0x7fd31c18f360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.900+0000 7fd32285b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.900+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd31c18ee20 con 0x7fd31c18ea50 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd31bfff640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6790/0 conn(0x7fd31c18ea50 legacy=0x7fd31c18fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3719970611 0 0) 0x7fd31c18ee20 con 0x7fd31c18ea50 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 10 monclient(hunting): my global_id is 64112 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd31c090810 con 0x7fd31c18ea50 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 81017632 0 0) 0x7fd31c090810 con 0x7fd31c18ea50 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd31c18ee20 con 0x7fd31c18ea50 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd308005380 con 0x7fd31c18ea50 2026-02-12T17:36:06.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 10 monclient: dump: 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2031735165 0 0) 0x7fd31c18ee20 con 0x7fd31c18ea50 2026-02-12T17:36:06.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.902+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd31c055340 con 0x7fd31c18ea50 2026-02-12T17:36:06.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4335 (unknown 0 0 986383864) 0x7fd308005bb0 con 0x7fd31c18ea50 2026-02-12T17:36:06.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd318ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:36:06.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd318ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:06.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6790/0 conn(0x7fd31c18ea50 legacy=0x7fd31c18fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd318ff9640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6790/0 conn(0x7fd31c18ea50 legacy=0x7fd31c18fa70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:06.916 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:36:06.916 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:06.916 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 34, 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 372, 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:36:06.917 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:36:06.918 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.919 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:36:06.920 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:06.921 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.922 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:06.923 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:06.924 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:06.925 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:36:06.926 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:36:06.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.82:6800/2441377515 conn(0x7fd2ec03fb50 legacy=0x7fd2ec060000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd32285b640 10 monclient: shutdown 2026-02-12T17:36:06.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd32285b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:06.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 >> v1:10.20.193.57:6790/0 conn(0x7fd31c08c620 legacy=0x7fd31c18d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:06.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd320dd1640 1 -- 10.20.193.57:0/2901939400 reap_dead start 2026-02-12T17:36:06.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 shutdown_connections 2026-02-12T17:36:06.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 >> 10.20.193.57:0/2901939400 conn(0x7fd31c0916b0 msgr2=0x7fd31c191410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:06.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 shutdown_connections 2026-02-12T17:36:06.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.903+0000 7fd32285b640 1 -- 10.20.193.57:0/2901939400 wait complete. 2026-02-12T17:36:06.928 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:36:06.928 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:36:06.928 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:36:06.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.996+0000 7f561bba5640 10 monclient: get_monmap_and_config 2026-02-12T17:36:06.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.996+0000 7f561bba5640 10 monclient: build_initial_monmap 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.996+0000 7f561bba5640 10 monclient: monmap: 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:06.997189+0000 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:06.997189+0000 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:06.994 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:06.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.996+0000 7f561bba5640 1 Processor -- start 2026-02-12T17:36:06.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.996+0000 7f561bba5640 1 -- start start 2026-02-12T17:36:06.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.996+0000 7f561bba5640 10 monclient: init 2026-02-12T17:36:06.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 10 monclient(hunting): picked mon.noname-a con 0x7f561408c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 10 monclient(hunting): picked mon.noname-c con 0x7f561408c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 10 monclient(hunting): picked mon.noname-b con 0x7f5614182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561408a820 con 0x7f561408c250 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5614089450 con 0x7f561408c620 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5614089730 con 0x7f5614182cc0 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561bba5640 10 monclient(hunting): authenticate will time out at 1046.816076s 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561991a640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f561408c250 0x7f561408a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35670/0 (socket says 10.20.193.57:35670) 2026-02-12T17:36:06.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.997+0000 7f561991a640 1 -- 10.20.193.57:0/1015865466 learned_addr learned my addr 10.20.193.57:0/1015865466 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:06.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f561a11b640 1 -- 10.20.193.57:0/1015865466 >> v1:10.20.193.57:6790/0 conn(0x7f5614182cc0 legacy=0x7f56141a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f561991a640 1 -- 10.20.193.57:0/1015865466 >> v1:10.20.193.57:6789/0 conn(0x7f561408c250 legacy=0x7f561408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:06.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045517871 0 0) 0x7f5604002c20 con 0x7f561408c250 2026-02-12T17:36:06.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient(hunting): _negotiate 2026-02-12T17:36:06.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:06.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient(hunting): my global_id is 54210 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55fc0035e0 con 0x7f561408c250 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2302448515 0 0) 0x7f5614089730 con 0x7f5614182cc0 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient(hunting): my global_id is 64115 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5604002c20 con 0x7f5614182cc0 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5619119640 1 -- 10.20.193.57:0/1015865466 >> v1:10.20.193.82:6789/0 conn(0x7f561408c620 legacy=0x7f561408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3832617405 0 0) 0x7f55fc0035e0 con 0x7f561408c250 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 >> v1:10.20.193.57:6790/0 conn(0x7f5614182cc0 legacy=0x7f56141a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 >> v1:10.20.193.82:6789/0 conn(0x7f561408c620 legacy=0x7f561408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient: _finish_hunting 0 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 monclient: found mon.noname-a 2026-02-12T17:36:07.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5614089a10 con 0x7f561408c250 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient: _finish_auth 0 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient: _check_auth_tickets 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5604003260 con 0x7f561408c250 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient: dump: 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.001 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f561bba5640 5 monclient: authenticate success, global_id 54210 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f561bba5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5604004960 con 0x7f561408c250 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f5618918640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f561bba5640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f561bba5640 4 set_mon_vals no callback set 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:06.999+0000 7f561991a640 1 --1- 10.20.193.57:0/1015865466 >> v1:10.20.193.57:6789/0 conn(0x7f561408c250 0x7f561408a110 :-1 s=OPENED pgs=343 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f5604004d30 mon_map magic: 0 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 10 monclient: shutdown 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 1 -- 10.20.193.57:0/1015865466 >> v1:10.20.193.57:6789/0 conn(0x7f561408c250 legacy=0x7f561408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f5618918640 1 -- 10.20.193.57:0/1015865466 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5604004d30 con 0x7f561408c250 2026-02-12T17:36:07.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f5618918640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 1 -- 10.20.193.57:0/1015865466 shutdown_connections 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 1 -- 10.20.193.57:0/1015865466 >> 10.20.193.57:0/1015865466 conn(0x7f56140916b0 msgr2=0x7f5614091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 1 -- 10.20.193.57:0/1015865466 shutdown_connections 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 1 -- 10.20.193.57:0/1015865466 wait complete. 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 10 monclient: build_initial_monmap 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 10 monclient: monmap: 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:07.003 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 1 Processor -- start 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 1 -- start start 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.000+0000 7f561bba5640 10 monclient: init 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 10 monclient(hunting): picked mon.noname-a con 0x7f561408c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 10 monclient(hunting): picked mon.noname-b con 0x7f561408c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 10 monclient(hunting): picked mon.noname-c con 0x7f5614182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561413edc0 con 0x7f561408c250 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561407ba60 con 0x7f561408c620 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56140888a0 con 0x7f5614182cc0 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561bba5640 10 monclient(hunting): authenticate will time out at 1046.820070s 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561991a640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f561408c250 0x7f56140847f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35674/0 (socket says 10.20.193.57:35674) 2026-02-12T17:36:07.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.001+0000 7f561991a640 1 -- 10.20.193.57:0/2598682077 learned_addr learned my addr 10.20.193.57:0/2598682077 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f561991a640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.57:6789/0 conn(0x7f561408c250 legacy=0x7f56140847f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f561a11b640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.57:6790/0 conn(0x7f5614182cc0 legacy=0x7f561411a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176278063 0 0) 0x7f56140888a0 con 0x7f5614182cc0 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): my global_id is 64118 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55e40035e0 con 0x7f5614182cc0 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832938883 0 0) 0x7f5614089a10 con 0x7f561408c250 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.009 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): my global_id is 54213 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56140888a0 con 0x7f561408c250 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f5619119640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.82:6789/0 conn(0x7f561408c620 legacy=0x7f561413de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2037077192 0 0) 0x7f55e40035e0 con 0x7f5614182cc0 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5614089a10 con 0x7f5614182cc0 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5610004d00 con 0x7f5614182cc0 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): dump: 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.010 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 723570451 0 0) 0x7f56140888a0 con 0x7f561408c250 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55e40035e0 con 0x7f561408c250 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5604003400 con 0x7f561408c250 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): dump: 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.011 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 787699104 0 0) 0x7f561407ba60 con 0x7f561408c620 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient(hunting): my global_id is 4765 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56140888a0 con 0x7f561408c620 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1813454726 0 0) 0x7f5614089a10 con 0x7f5614182cc0 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.82:6789/0 conn(0x7f561408c620 legacy=0x7f561413de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.57:6789/0 conn(0x7f561408c250 legacy=0x7f56140847f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient: _finish_hunting 0 2026-02-12T17:36:07.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 monclient: found mon.c 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561405ddc0 con 0x7f5614182cc0 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient: _finish_auth 0 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient: _check_auth_tickets 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f561bba5640 5 monclient: authenticate success, global_id 64118 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f561bba5640 10 monclient: _renew_subs 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f561bba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f561407b780 con 0x7f5614182cc0 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f561bba5640 10 monclient: _renew_subs 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f561bba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5614084f00 con 0x7f5614182cc0 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5610003c00 con 0x7f5614182cc0 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.003+0000 7f56027fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:07.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5610004200 con 0x7f5614182cc0 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f56027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f56027fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f56027fc640 10 monclient: dump: 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f5603fff640 4 set_mon_vals no callback set 2026-02-12T17:36:07.014 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f561bba5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5610004f60 con 0x7f5614182cc0 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f561407bca0 con 0x7f56141a47c0 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(388..388 src has 202..388) ==== 3959+0+0 (unknown 3789686627 0 0) 0x7f561004fcd0 con 0x7f5614182cc0 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.004+0000 7f5619119640 10 monclient: get_auth_request con 0x7f55e403fd10 auth_method 0 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.006+0000 7f561991a640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.82:6789/0 conn(0x7f56141a47c0 legacy=0x7f5614057290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.006+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295431631 0 0) 0x7f561407bca0 con 0x7f56141a47c0 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.006+0000 7f56027fc640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.006+0000 7f56027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.006+0000 7f56027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.006+0000 7f56027fc640 10 monclient(hunting): my global_id is 4768 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.006+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5614089a10 con 0x7f56141a47c0 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4166318878 0 0) 0x7f5614089a10 con 0x7f56141a47c0 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f561407bca0 con 0x7f56141a47c0 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5604005070 con 0x7f56141a47c0 2026-02-12T17:36:07.015 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 10 monclient: dump: 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 414749937 0 0) 0x7f561407bca0 con 0x7f56141a47c0 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5614090810 con 0x7f56141a47c0 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5604005300 con 0x7f56141a47c0 2026-02-12T17:36:07.016 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:07.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:07.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.82:6789/0 conn(0x7f56141a47c0 legacy=0x7f5614057290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.007+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.82:6789/0 conn(0x7f56141a47c0 legacy=0x7f5614057290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:07.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.011+0000 7f561bba5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:36:07.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.011+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f561413e8f0 con 0x7f561413e520 2026-02-12T17:36:07.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.013+0000 7f561991a640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.82:6789/0 conn(0x7f561413e520 legacy=0x7f56140579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.013+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574004905 0 0) 0x7f561413e8f0 con 0x7f561413e520 2026-02-12T17:36:07.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.013+0000 7f56027fc640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.013+0000 7f56027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.013+0000 7f56027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.013+0000 7f56027fc640 10 monclient(hunting): my global_id is 4771 2026-02-12T17:36:07.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.013+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f561407bca0 con 0x7f561413e520 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1885553674 0 0) 0x7f561407bca0 con 0x7f561413e520 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f561413e8f0 con 0x7f561413e520 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f56040059a0 con 0x7f561413e520 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 10 monclient: dump: 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.019 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1481111984 0 0) 0x7f561413e8f0 con 0x7f561413e520 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5614055340 con 0x7f561413e520 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 83885463) 0x7f5604007250 con 0x7f561413e520 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.82:6789/0 conn(0x7f561413e520 legacy=0x7f56140579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f56027fc640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.82:6789/0 conn(0x7f561413e520 legacy=0x7f56140579a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:07.020 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 34, 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 488511, 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:07.021 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:07.022 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:36:07.023 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:07.024 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.025 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:07.026 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:07.027 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:36:07.028 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:07.029 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:07.030 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:07.031 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:36:07.031 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.82:6800/2441377515 conn(0x7f55e403fd10 legacy=0x7f55e40601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561bba5640 10 monclient: shutdown 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561bba5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 >> v1:10.20.193.57:6790/0 conn(0x7f5614182cc0 legacy=0x7f561411a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561a11b640 1 -- 10.20.193.57:0/2598682077 reap_dead start 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561a11b640 1 -- 10.20.193.57:0/2598682077 reap_dead start 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 shutdown_connections 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 >> 10.20.193.57:0/2598682077 conn(0x7f56140916b0 msgr2=0x7f561408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 shutdown_connections 2026-02-12T17:36:07.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.014+0000 7f561bba5640 1 -- 10.20.193.57:0/2598682077 wait complete. 2026-02-12T17:36:07.032 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:36:07.032 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:36:07.033 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1731: done (4 left) 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1732: done (3 left) 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1733: done (2 left) 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1734: done (1 left) 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1735: done (0 left) 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1736: read oid 39 snap -1 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1736: expect (ObjNum 582 snap 176 seq_num 582) 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1737: read oid 27 snap -1 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1737: expect (ObjNum 508 snap 156 seq_num 508) 2026-02-12T17:36:07.068 INFO:tasks.rados.rados.0.trial082.stdout:1738: write oid 48 current snap is 186 2026-02-12T17:36:07.069 INFO:tasks.rados.rados.0.trial082.stdout:1738: seq_num 600 ranges {484200=624934,1860843=223357} 2026-02-12T17:36:07.072 INFO:tasks.rados.rados.0.trial082.stdout:1738: writing trial08226312-48 from 484200 to 1109134 tid 1 2026-02-12T17:36:07.076 INFO:tasks.rados.rados.0.trial082.stdout:1738: writing trial08226312-48 from 1860843 to 2084200 tid 2 2026-02-12T17:36:07.076 INFO:tasks.rados.rados.0.trial082.stdout:1739: write (excl) oid 7 current snap is 186 2026-02-12T17:36:07.076 INFO:tasks.rados.rados.0.trial082.stdout:1739: seq_num 601 ranges {501007=416536,1635678=465329} 2026-02-12T17:36:07.079 INFO:tasks.rados.rados.0.trial082.stdout:1739: writing trial08226312-7 from 501007 to 917543 tid 1 2026-02-12T17:36:07.084 INFO:tasks.rados.rados.0.trial082.stdout:1739: writing trial08226312-7 from 1635678 to 2101007 tid 2 2026-02-12T17:36:07.084 INFO:tasks.rados.rados.0.trial082.stdout:1740: snap_remove snap 182 2026-02-12T17:36:07.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.100+0000 7f1e4ea8c640 10 monclient: get_monmap_and_config 2026-02-12T17:36:07.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.100+0000 7f1e4ea8c640 10 monclient: build_initial_monmap 2026-02-12T17:36:07.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.100+0000 7f1e4ea8c640 10 monclient: monmap: 2026-02-12T17:36:07.098 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:07.098 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.099 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:07.101818+0000 2026-02-12T17:36:07.099 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:07.101818+0000 2026-02-12T17:36:07.099 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:07.099 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.099 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:07.099 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:07.099 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:07.099 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 1 Processor -- start 2026-02-12T17:36:07.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 1 -- start start 2026-02-12T17:36:07.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 10 monclient: init 2026-02-12T17:36:07.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:07.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 10 monclient(hunting): picked mon.noname-b con 0x7f1e4808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 10 monclient(hunting): picked mon.noname-c con 0x7f1e4808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 10 monclient(hunting): picked mon.noname-a con 0x7f1e4808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4808d600 con 0x7f1e4808cb30 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4808b1f0 con 0x7f1e4808c730 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4808d1f0 con 0x7f1e4808ae20 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4ea8c640 10 monclient(hunting): authenticate will time out at 1046.920711s 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4c801640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f1e4808ae20 0x7f1e4808c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39782/0 (socket says 10.20.193.57:39782) 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e4c801640 1 -- 10.20.193.57:0/2215402211 learned_addr learned my addr 10.20.193.57:0/2215402211 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:07.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e3ffff640 1 -- 10.20.193.57:0/2215402211 >> v1:10.20.193.82:6789/0 conn(0x7f1e4808c730 legacy=0x7f1e48181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e3ffff640 1 -- 10.20.193.57:0/2215402211 >> v1:10.20.193.82:6789/0 conn(0x7f1e4808c730 legacy=0x7f1e48181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.101+0000 7f1e3ffff640 1 --1- 10.20.193.57:0/2215402211 >> v1:10.20.193.82:6789/0 conn(0x7f1e4808c730 0x7f1e48181be0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=2 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.103+0000 7f1e4d002640 1 -- 10.20.193.57:0/2215402211 >> v1:10.20.193.57:6789/0 conn(0x7f1e4808cb30 legacy=0x7f1e481a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.103+0000 7f1e4c801640 1 -- 10.20.193.57:0/2215402211 >> v1:10.20.193.57:6790/0 conn(0x7f1e4808ae20 legacy=0x7f1e4808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774907224 0 0) 0x7f1e4808d1f0 con 0x7f1e4808ae20 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient(hunting): my global_id is 64121 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e340035e0 con 0x7f1e4808ae20 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702776289 0 0) 0x7f1e4808d600 con 0x7f1e4808cb30 2026-02-12T17:36:07.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient(hunting): my global_id is 54216 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e4808d1f0 con 0x7f1e4808cb30 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4009376307 0 0) 0x7f1e340035e0 con 0x7f1e4808ae20 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 >> v1:10.20.193.82:6789/0 conn(0x7f1e4808c730 legacy=0x7f1e48181be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 >> v1:10.20.193.57:6789/0 conn(0x7f1e4808cb30 legacy=0x7f1e481a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 monclient: found mon.noname-b 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:36:07.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e48057320 con 0x7f1e4808ae20 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: _finish_auth 0 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e380030c0 con 0x7f1e4808ae20 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: dump: 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.108 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 5 monclient: authenticate success, global_id 64121 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e38003350 con 0x7f1e4808ae20 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 1 -- 10.20.193.57:0/2215402211 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e38004960 con 0x7f1e4808ae20 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:07.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e3f7fe640 10 monclient: dump: 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 4 set_mon_vals no callback set 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 10 monclient: shutdown 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/2215402211 >> v1:10.20.193.57:6790/0 conn(0x7f1e4808ae20 legacy=0x7f1e4808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/2215402211 shutdown_connections 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/2215402211 >> 10.20.193.57:0/2215402211 conn(0x7f1e48091620 msgr2=0x7f1e48091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/2215402211 shutdown_connections 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.104+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/2215402211 wait complete. 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient: build_initial_monmap 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient: monmap: 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:07.111 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 1 Processor -- start 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 1 -- start start 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient: init 2026-02-12T17:36:07.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient(hunting): picked mon.noname-b con 0x7f1e4808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient(hunting): picked mon.noname-c con 0x7f1e4808c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient(hunting): picked mon.noname-a con 0x7f1e4808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4808d9c0 con 0x7f1e4808cb30 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e48122670 con 0x7f1e4808ae20 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e4811c9f0 con 0x7f1e4808c730 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4ea8c640 10 monclient(hunting): authenticate will time out at 1046.924760s 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4d002640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1e4808cb30 0x7f1e481a2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35680/0 (socket says 10.20.193.57:35680) 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e4d002640 1 -- 10.20.193.57:0/1982199007 learned_addr learned my addr 10.20.193.57:0/1982199007 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:07.113 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.105+0000 7f1e3ffff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f1e4808c730 0x7f1e481193c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39784/0 (socket says 10.20.193.57:39784) 2026-02-12T17:36:07.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.107+0000 7f1e4d002640 1 -- 10.20.193.57:0/1982199007 >> v1:10.20.193.57:6789/0 conn(0x7f1e4808cb30 legacy=0x7f1e481a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.107+0000 7f1e3ffff640 1 -- 10.20.193.57:0/1982199007 >> v1:10.20.193.57:6790/0 conn(0x7f1e4808c730 legacy=0x7f1e481193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183636457 0 0) 0x7f1e4811c9f0 con 0x7f1e4808c730 2026-02-12T17:36:07.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): my global_id is 64124 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e180035e0 con 0x7f1e4808c730 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380232059 0 0) 0x7f1e4808d9c0 con 0x7f1e4808cb30 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): my global_id is 54219 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e4811c9f0 con 0x7f1e4808cb30 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4c801640 1 -- 10.20.193.57:0/1982199007 >> v1:10.20.193.82:6789/0 conn(0x7f1e4808ae20 legacy=0x7f1e48118cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3ffff640 1 -- 10.20.193.57:0/1982199007 >> v1:10.20.193.57:6790/0 conn(0x7f1e4808c730 legacy=0x7f1e481193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3ffff640 1 -- 10.20.193.57:0/1982199007 >> v1:10.20.193.57:6790/0 conn(0x7f1e4808c730 legacy=0x7f1e481193c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:36:07.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3ffff640 1 --1- 10.20.193.57:0/1982199007 >> v1:10.20.193.57:6790/0 conn(0x7f1e4808c730 0x7f1e481193c0 :-1 s=OPENED pgs=176 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3ffff640 1 --1- 10.20.193.57:0/1982199007 >> v1:10.20.193.57:6790/0 conn(0x7f1e4808c730 0x7f1e481193c0 :-1 s=OPENED pgs=176 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.57:6790/0 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2698074421 0 0) 0x7f1e4811c9f0 con 0x7f1e4808cb30 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e4808d9c0 con 0x7f1e4808cb30 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e44004490 con 0x7f1e4808cb30 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): dump: 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.119 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402257604 0 0) 0x7f1e48122670 con 0x7f1e4808ae20 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:07.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient(hunting): my global_id is 4774 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e4811c9f0 con 0x7f1e4808ae20 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1135034706 0 0) 0x7f1e4808d9c0 con 0x7f1e4808cb30 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 >> v1:10.20.193.57:6790/0 conn(0x7f1e4808c730 legacy=0x7f1e481193c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 >> v1:10.20.193.82:6789/0 conn(0x7f1e4808ae20 legacy=0x7f1e48118cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient: _finish_hunting 0 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 monclient: found mon.a 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4811a690 con 0x7f1e4808cb30 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient: _finish_auth 0 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient: _check_auth_tickets 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:07.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 5 monclient: authenticate success, global_id 54219 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 10 monclient: _renew_subs 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4805aef0 con 0x7f1e4808cb30 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 10 monclient: _renew_subs 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1e48119ad0 con 0x7f1e4808cb30 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e44004a60 con 0x7f1e4808cb30 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e44004630 con 0x7f1e4808cb30 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3d7fa640 10 monclient: dump: 2026-02-12T17:36:07.122 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e3effd640 4 set_mon_vals no callback set 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:07.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:07.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.108+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e480008d0 con 0x7f1e4808cb30 2026-02-12T17:36:07.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.109+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1e44004ee0 con 0x7f1e4808cb30 2026-02-12T17:36:07.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.109+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(389..389 src has 202..389) ==== 3931+0+0 (unknown 3379446177 0 0) 0x7f1e4404fc50 con 0x7f1e4808cb30 2026-02-12T17:36:07.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.109+0000 7f1e4c801640 10 monclient: get_auth_request con 0x7f1e1803f9c0 auth_method 0 2026-02-12T17:36:07.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.111+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f1e440183d0 con 0x7f1e4808cb30 2026-02-12T17:36:07.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.111+0000 7f1e3d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:07.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.111+0000 7f1e3d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:07.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.254+0000 7f1e4ea8c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:36:07.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.254+0000 7f1e4ea8c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:36:07.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.254+0000 7f1e4ea8c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:07.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.254+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f1e48119d80 con 0x7f1e4808cb30 2026-02-12T17:36:07.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.256+0000 7f1e3d7fa640 1 -- 10.20.193.57:0/1982199007 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f1e44017b80 con 0x7f1e4808cb30 2026-02-12T17:36:07.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.256+0000 7f1e3d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:36:07.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.256+0000 7f1e3d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=13,kv=11,logm=62} crc {auth=3141141489,config=1618278320,health=481669536,kv=509058673,logm=543385981}) 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=13,config=2,health=12,kv=11,logm=62} crc {auth=1073938254,config=1618278320,health=466540461,kv=1466688342,logm=2767753147}) 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=13,kv=11,logm=62} crc {auth=3141141489,config=1618278320,health=481669536,kv=509058673,logm=543385981}) 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=10,kv=11,logm=63} crc {auth=4117045182,config=1618278320,health=3735402050,kv=1466688342,logm=576266257}) 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1208676625}) 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1661787333}) 2026-02-12T17:36:07.256 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1208676625}) 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.252+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1601779155}) 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.253+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.253+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2112937528}) 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.253+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=816777632}) 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.253+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.253+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2112937528}) 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.253+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1067170578}) 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1251379282}) 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3116700844}) 2026-02-12T17:36:07.257 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.258 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1251379282}) 2026-02-12T17:36:07.258 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3905226942}) 2026-02-12T17:36:07.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.257+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 >> v1:10.20.193.82:6800/2441377515 conn(0x7f1e1803f9c0 legacy=0x7f1e1805fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.257+0000 7f1e4ea8c640 10 monclient: shutdown 2026-02-12T17:36:07.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.257+0000 7f1e4ea8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:07.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.257+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 >> v1:10.20.193.57:6789/0 conn(0x7f1e4808cb30 legacy=0x7f1e481a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:07.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.257+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 shutdown_connections 2026-02-12T17:36:07.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.257+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 >> 10.20.193.57:0/1982199007 conn(0x7f1e48091620 msgr2=0x7f1e48125940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:07.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.257+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 shutdown_connections 2026-02-12T17:36:07.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:07.257+0000 7f1e4ea8c640 1 -- 10.20.193.57:0/1982199007 wait complete. 2026-02-12T17:36:07.262 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.262 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880333072}) 2026-02-12T17:36:07.262 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2340433053}) 2026-02-12T17:36:07.262 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.262 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3880333072}) 2026-02-12T17:36:07.262 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.254+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2303475527}) 2026-02-12T17:36:07.262 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.262 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1012211982}) 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1708745651}) 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1012211982}) 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1008592733}) 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2172064493}) 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2558926006}) 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2172064493}) 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.255+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=588340664}) 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.263 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=690727217}) 2026-02-12T17:36:07.264 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750597834}) 2026-02-12T17:36:07.264 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.264 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=690727217}) 2026-02-12T17:36:07.264 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.256+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1953628877}) 2026-02-12T17:36:07.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:36:07.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2239137348}) 2026-02-12T17:36:07.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2325385145}) 2026-02-12T17:36:07.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2239137348}) 2026-02-12T17:36:07.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4025692186}) 2026-02-12T17:36:07.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=481264511}) 2026-02-12T17:36:07.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859144833}) 2026-02-12T17:36:07.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=481264511}) 2026-02-12T17:36:07.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.268+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1488111653}) 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1338107530}) 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1937457334}) 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1338107530}) 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2676856995}) 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3064046271}) 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2266018524}) 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.275 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3064046271}) 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3458559886}) 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.270+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.270+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2031056938}) 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.270+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3870435109}) 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.270+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.270+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2031056938}) 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.270+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2172692800}) 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1916087392}) 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=952894158}) 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.276 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1916087392}) 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3045848638}) 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=272452301}) 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894322451}) 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=272452301}) 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.271+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1606054275}) 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.272+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.272+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2505797092}) 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.272+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2052981361}) 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.272+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.272+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2505797092}) 2026-02-12T17:36:07.277 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.272+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1257919754}) 2026-02-12T17:36:07.283 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.281+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.284 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.281+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=512088265}) 2026-02-12T17:36:07.284 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.281+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3575923923}) 2026-02-12T17:36:07.284 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.281+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.284 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.281+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=512088265}) 2026-02-12T17:36:07.284 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.281+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=787502522}) 2026-02-12T17:36:07.287 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.282+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.287 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.282+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2003367463,mdsmap=3394755738,mgr=2215873856,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=2300184870,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3140514009,osd_metadata=1885656438}) 2026-02-12T17:36:07.287 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.282+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=65,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=1} crc {logm=2644203607,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=1854040109,mon_config_key=383892656,monmap=3226443083}) 2026-02-12T17:36:07.287 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.282+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.287 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.282+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=2} crc {logm=2003367463,mdsmap=3394755738,mgr=2215873856,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=2300184870,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3140514009,osd_metadata=1885656438}) 2026-02-12T17:36:07.287 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.282+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=62,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=2} crc {logm=2133617433,mdsmap=2204869053,mgr=3845493477,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=1628623858,mon_config_key=383892656,monmap=2728086219,nvmeofgw=935146538}) 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=68,osdmap=27} crc {osd_metadata=3710917960,osd_pg_creating=11890937,osd_snap=3598578839,osdmap=4275427758}) 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=67,osdmap=28} crc {osd_metadata=3710917960,osd_pg_creating=11890937,osd_snap=3474214361,osdmap=1714959247}) 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=68,osdmap=27} crc {osd_metadata=3710917960,osd_pg_creating=11890937,osd_snap=3598578839,osdmap=4275427758}) 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=4,osd_pg_creating=1,osd_snap=67,osdmap=28} crc {osd_metadata=3710917960,osd_pg_creating=11890937,osd_snap=4131053270,osdmap=3825035815}) 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3268499115}) 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3065558371}) 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3268499115}) 2026-02-12T17:36:07.288 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.283+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2628427089}) 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3446240165}) 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3125817681}) 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3446240165}) 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2728687893}) 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=57} crc {osdmap=533748598}) 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=56} crc {osdmap=2690293059}) 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=57} crc {osdmap=533748598}) 2026-02-12T17:36:07.289 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:36:07.284+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=62} crc {osdmap=1469449302}) 2026-02-12T17:36:08.071 INFO:tasks.rados.rados.0.trial082.stdout:1740: done (4 left) 2026-02-12T17:36:08.072 INFO:tasks.rados.rados.0.trial082.stdout:1741: write (excl) oid 26 current snap is 186 2026-02-12T17:36:08.072 INFO:tasks.rados.rados.0.trial082.stdout:1741: seq_num 602 ranges {517814=491785,1577807=540007} 2026-02-12T17:36:08.075 INFO:tasks.rados.rados.0.trial082.stdout:1741: writing trial08226312-26 from 517814 to 1009599 tid 1 2026-02-12T17:36:08.080 INFO:tasks.rados.rados.0.trial082.stdout:1741: writing trial08226312-26 from 1577807 to 2117814 tid 2 2026-02-12T17:36:08.080 INFO:tasks.rados.rados.0.trial082.stdout:1742: snap_create 2026-02-12T17:36:08.080 INFO:tasks.rados.rados.0.trial082.stdout:1738: finishing write tid 1 to trial08226312-48 2026-02-12T17:36:08.080 INFO:tasks.rados.rados.0.trial082.stdout:1736: expect (ObjNum 582 snap 176 seq_num 582) 2026-02-12T17:36:08.110 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 720594 2026-02-12T17:36:08.131 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:08.158 INFO:tasks.rados.rados.0.trial082.stdout:1737: expect (ObjNum 508 snap 156 seq_num 508) 2026-02-12T17:36:08.158 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 366928 2026-02-12T17:36:08.246 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:08.266 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:36:08.266 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:36:08.291 INFO:tasks.rados.rados.0.trial082.stdout:1738: finishing write tid 2 to trial08226312-48 2026-02-12T17:36:08.291 INFO:tasks.rados.rados.0.trial082.stdout:1738: finishing write tid 3 to trial08226312-48 2026-02-12T17:36:08.291 INFO:tasks.rados.rados.0.trial082.stdout:1738: finishing write tid 4 to trial08226312-48 2026-02-12T17:36:08.291 INFO:tasks.rados.rados.0.trial082.stdout:1738: oid 48 updating version 0 to 810 2026-02-12T17:36:08.291 INFO:tasks.rados.rados.0.trial082.stdout:1738: oid 48 updating version 810 to 811 2026-02-12T17:36:08.291 INFO:tasks.rados.rados.0.trial082.stdout:1738: oid 48 version 811 is already newer than 809 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 811 (ObjNum 600 snap 186 seq_num 600) dirty exists 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1738: left oid 48 (ObjNum 600 snap 186 seq_num 600) 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1739: finishing write tid 1 to trial08226312-7 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1739: finishing write tid 2 to trial08226312-7 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1739: finishing write tid 3 to trial08226312-7 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1739: finishing write tid 4 to trial08226312-7 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1739: oid 7 updating version 0 to 1086 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1739: oid 7 version 1086 is already newer than 1085 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1739: oid 7 version 1086 is already newer than 1084 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 1086 (ObjNum 601 snap 186 seq_num 601) dirty exists 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1739: left oid 7 (ObjNum 601 snap 186 seq_num 601) 2026-02-12T17:36:08.292 INFO:tasks.rados.rados.0.trial082.stdout:1741: finishing write tid 1 to trial08226312-26 2026-02-12T17:36:08.293 INFO:tasks.rados.rados.0.trial082.stdout:1741: finishing write tid 2 to trial08226312-26 2026-02-12T17:36:08.293 INFO:tasks.rados.rados.0.trial082.stdout:1741: finishing write tid 3 to trial08226312-26 2026-02-12T17:36:08.293 INFO:tasks.rados.rados.0.trial082.stdout:1741: finishing write tid 4 to trial08226312-26 2026-02-12T17:36:08.293 INFO:tasks.rados.rados.0.trial082.stdout:1741: oid 26 updating version 0 to 919 2026-02-12T17:36:08.293 INFO:tasks.rados.rados.0.trial082.stdout:1741: oid 26 version 919 is already newer than 918 2026-02-12T17:36:08.293 INFO:tasks.rados.rados.0.trial082.stdout:1741: oid 26 updating version 919 to 920 2026-02-12T17:36:08.293 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 920 (ObjNum 602 snap 186 seq_num 602) dirty exists 2026-02-12T17:36:08.293 INFO:tasks.rados.rados.0.trial082.stdout:1741: left oid 26 (ObjNum 602 snap 186 seq_num 602) 2026-02-12T17:36:08.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.335+0000 7f089adc2640 10 monclient: get_monmap_and_config 2026-02-12T17:36:08.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.335+0000 7f089adc2640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.335+0000 7f089adc2640 10 monclient: monmap: 2026-02-12T17:36:08.334 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:08.336518+0000 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:08.336518+0000 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 1 Processor -- start 2026-02-12T17:36:08.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 1 -- start start 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 10 monclient: init 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 10 monclient(hunting): picked mon.noname-a con 0x7f089408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 10 monclient(hunting): picked mon.noname-b con 0x7f089408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 10 monclient(hunting): picked mon.noname-c con 0x7f089408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f089408d600 con 0x7f089408ae20 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f089408b1f0 con 0x7f089408cb30 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f089408d1f0 con 0x7f089408c730 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f089adc2640 10 monclient(hunting): authenticate will time out at 1048.155374s 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f0898b37640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f089408ae20 0x7f089408c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35682/0 (socket says 10.20.193.57:35682) 2026-02-12T17:36:08.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.336+0000 7f0898b37640 1 -- 10.20.193.57:0/2929548361 learned_addr learned my addr 10.20.193.57:0/2929548361 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088bfff640 1 -- 10.20.193.57:0/2929548361 >> v1:10.20.193.57:6790/0 conn(0x7f089408c730 legacy=0x7f0894181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f0898b37640 1 -- 10.20.193.57:0/2929548361 >> v1:10.20.193.57:6789/0 conn(0x7f089408ae20 legacy=0x7f089408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f0899338640 1 -- 10.20.193.57:0/2929548361 >> v1:10.20.193.82:6789/0 conn(0x7f089408cb30 legacy=0x7f08941a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080378621 0 0) 0x7f089408d600 con 0x7f089408ae20 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): my global_id is 54222 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08800035e0 con 0x7f089408ae20 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462072498 0 0) 0x7f089408d1f0 con 0x7f089408c730 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): my global_id is 64127 2026-02-12T17:36:08.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f089408d600 con 0x7f089408c730 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 360797369 0 0) 0x7f089408b1f0 con 0x7f089408cb30 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 10 monclient(hunting): my global_id is 4777 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.338+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f089408d1f0 con 0x7f089408cb30 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 771602250 0 0) 0x7f08800035e0 con 0x7f089408ae20 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 >> v1:10.20.193.57:6790/0 conn(0x7f089408c730 legacy=0x7f0894181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 >> v1:10.20.193.82:6789/0 conn(0x7f089408cb30 legacy=0x7f08941a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 1 monclient: found mon.noname-a 2026-02-12T17:36:08.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0894057320 con 0x7f089408ae20 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0884003000 con 0x7f089408ae20 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: dump: 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.347 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 5 monclient: authenticate success, global_id 54222 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0884003290 con 0x7f089408ae20 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 1 -- 10.20.193.57:0/2929548361 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0884004960 con 0x7f089408ae20 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 4 set_mon_vals no callback set 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f088b7fe640 10 monclient: dump: 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.349 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 10 monclient: shutdown 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 1 -- 10.20.193.57:0/2929548361 >> v1:10.20.193.57:6789/0 conn(0x7f089408ae20 legacy=0x7f089408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 1 -- 10.20.193.57:0/2929548361 shutdown_connections 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 1 -- 10.20.193.57:0/2929548361 >> 10.20.193.57:0/2929548361 conn(0x7f0894091620 msgr2=0x7f0894091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 1 -- 10.20.193.57:0/2929548361 shutdown_connections 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 1 -- 10.20.193.57:0/2929548361 wait complete. 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 10 monclient: monmap: 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.339+0000 7f089adc2640 1 Processor -- start 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 1 -- start start 2026-02-12T17:36:08.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 10 monclient: init 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 10 monclient(hunting): picked mon.noname-b con 0x7f089408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 10 monclient(hunting): picked mon.noname-a con 0x7f089408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 10 monclient(hunting): picked mon.noname-c con 0x7f089408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f089408d9c0 con 0x7f089408c730 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0894084d90 con 0x7f089408ae20 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0894153c70 con 0x7f089408cb30 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f089adc2640 10 monclient(hunting): authenticate will time out at 1048.159270s 2026-02-12T17:36:08.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f088bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f089408c730 0x7f08941940a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35696/0 (socket says 10.20.193.57:35696) 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f0899338640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f089408cb30 0x7f08941957c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39796/0 (socket says 10.20.193.57:39796) 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.340+0000 7f088bfff640 1 -- 10.20.193.57:0/3625222701 learned_addr learned my addr 10.20.193.57:0/3625222701 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f088bfff640 1 -- 10.20.193.57:0/3625222701 >> v1:10.20.193.57:6789/0 conn(0x7f089408c730 legacy=0x7f08941940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f0899338640 1 -- 10.20.193.57:0/3625222701 >> v1:10.20.193.57:6790/0 conn(0x7f089408cb30 legacy=0x7f08941957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923668678 0 0) 0x7f089408d9c0 con 0x7f089408c730 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): my global_id is 54225 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08640035e0 con 0x7f089408c730 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283116231 0 0) 0x7f0894153c70 con 0x7f089408cb30 2026-02-12T17:36:08.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): my global_id is 64130 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f089408d9c0 con 0x7f089408cb30 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1320329006 0 0) 0x7f08640035e0 con 0x7f089408c730 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f0898b37640 1 -- 10.20.193.57:0/3625222701 >> v1:10.20.193.82:6789/0 conn(0x7f089408ae20 legacy=0x7f0894086b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0894153c70 con 0x7f089408c730 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f087c003420 con 0x7f089408c730 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): dump: 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.354 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 856866001 0 0) 0x7f089408d9c0 con 0x7f089408cb30 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08640035e0 con 0x7f089408cb30 2026-02-12T17:36:08.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0890004460 con 0x7f089408cb30 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient(hunting): dump: 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.356 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2352325626 0 0) 0x7f0894153c70 con 0x7f089408c730 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 >> v1:10.20.193.57:6790/0 conn(0x7f089408cb30 legacy=0x7f08941957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 >> v1:10.20.193.82:6789/0 conn(0x7f089408ae20 legacy=0x7f0894086b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 monclient: found mon.a 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0894088040 con 0x7f089408c730 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f08897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f089adc2640 5 monclient: authenticate success, global_id 54225 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f089adc2640 10 monclient: _renew_subs 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f089adc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.342+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f08940832d0 con 0x7f089408c730 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f089adc2640 10 monclient: _renew_subs 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f089adc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0894087410 con 0x7f089408c730 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f087c003980 con 0x7f089408c730 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f08897fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f087c003ca0 con 0x7f089408c730 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f08897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f08897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f088affd640 4 set_mon_vals no callback set 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f08897fa640 10 monclient: dump: 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f089adc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f089adc2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f089adc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0894085200 con 0x7f089408c730 2026-02-12T17:36:08.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f087c003ef0 con 0x7f089408c730 2026-02-12T17:36:08.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(390..390 src has 202..390) ==== 3975+0+0 (unknown 2884364590 0 0) 0x7f087c04ecd0 con 0x7f089408c730 2026-02-12T17:36:08.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.343+0000 7f0898b37640 10 monclient: get_auth_request con 0x7f086403fb30 auth_method 0 2026-02-12T17:36:08.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.345+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f087c0173c0 con 0x7f089408c730 2026-02-12T17:36:08.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.345+0000 7f08897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.345+0000 7f08897fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:08.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.488+0000 7f089adc2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:36:08.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.488+0000 7f089adc2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:08.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.488+0000 7f089adc2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.488+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0894055340 con 0x7f089408c730 2026-02-12T17:36:08.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.488+0000 7f08897fa640 1 -- 10.20.193.57:0/3625222701 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 595982378) 0x7f087c016b70 con 0x7f089408c730 2026-02-12T17:36:08.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.488+0000 7f08897fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:08.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.488+0000 7f08897fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:08.487 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:36:08.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.489+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 >> v1:10.20.193.82:6800/2441377515 conn(0x7f086403fb30 legacy=0x7f086405ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.489+0000 7f089adc2640 10 monclient: shutdown 2026-02-12T17:36:08.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.489+0000 7f089adc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:08.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.489+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 >> v1:10.20.193.57:6789/0 conn(0x7f089408c730 legacy=0x7f08941940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.489+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 shutdown_connections 2026-02-12T17:36:08.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.489+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 >> 10.20.193.57:0/3625222701 conn(0x7f0894091620 msgr2=0x7f0894089310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:08.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.489+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 shutdown_connections 2026-02-12T17:36:08.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.489+0000 7f089adc2640 1 -- 10.20.193.57:0/3625222701 wait complete. 2026-02-12T17:36:08.494 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:36:08.495 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:36:08.495 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:36:08.495 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:36:08.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.563+0000 7fbda2a5b640 10 monclient: get_monmap_and_config 2026-02-12T17:36:08.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.563+0000 7fbda2a5b640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.563+0000 7fbda2a5b640 10 monclient: monmap: 2026-02-12T17:36:08.562 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.562 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.562 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:08.564311+0000 2026-02-12T17:36:08.562 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:08.564311+0000 2026-02-12T17:36:08.562 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.562 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.562 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.563+0000 7fbda2a5b640 1 Processor -- start 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.563+0000 7fbda2a5b640 1 -- start start 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.563+0000 7fbda2a5b640 10 monclient: init 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 10 monclient(hunting): picked mon.noname-c con 0x7fbd9c08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 10 monclient(hunting): picked mon.noname-b con 0x7fbd9c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 10 monclient(hunting): picked mon.noname-a con 0x7fbd9c182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c08a820 con 0x7fbd9c182cc0 2026-02-12T17:36:08.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c089450 con 0x7fbd9c08c250 2026-02-12T17:36:08.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c089730 con 0x7fbd9c08c620 2026-02-12T17:36:08.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda2a5b640 10 monclient(hunting): authenticate will time out at 1048.383166s 2026-02-12T17:36:08.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbd9b7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbd9c08c620 0x7fbd9c08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39810/0 (socket says 10.20.193.57:39810) 2026-02-12T17:36:08.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbda0fd1640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbd9c182cc0 0x7fbd9c1a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35702/0 (socket says 10.20.193.57:35702) 2026-02-12T17:36:08.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.564+0000 7fbd9b7fe640 1 -- 10.20.193.57:0/4114432852 learned_addr learned my addr 10.20.193.57:0/4114432852 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9b7fe640 1 -- 10.20.193.57:0/4114432852 >> v1:10.20.193.57:6790/0 conn(0x7fbd9c08c620 legacy=0x7fbd9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbda0fd1640 1 -- 10.20.193.57:0/4114432852 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c182cc0 legacy=0x7fbd9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9bfff640 1 -- 10.20.193.57:0/4114432852 >> v1:10.20.193.82:6789/0 conn(0x7fbd9c08c250 legacy=0x7fbd9c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192484007 0 0) 0x7fbd90003d00 con 0x7fbd9c182cc0 2026-02-12T17:36:08.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): my global_id is 54228 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd800035e0 con 0x7fbd9c182cc0 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 268109385 0 0) 0x7fbd9c089730 con 0x7fbd9c08c620 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): my global_id is 64133 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd90003d00 con 0x7fbd9c08c620 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980672198 0 0) 0x7fbd9c089450 con 0x7fbd9c08c250 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient(hunting): my global_id is 4783 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd9c089730 con 0x7fbd9c08c250 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 431318962 0 0) 0x7fbd800035e0 con 0x7fbd9c182cc0 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 >> v1:10.20.193.57:6790/0 conn(0x7fbd9c08c620 legacy=0x7fbd9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 >> v1:10.20.193.82:6789/0 conn(0x7fbd9c08c250 legacy=0x7fbd9c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 monclient: found mon.noname-a 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c089a10 con 0x7fbd9c182cc0 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbd900043c0 con 0x7fbd9c182cc0 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbd9affd640 10 monclient: dump: 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.576 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbda2a5b640 5 monclient: authenticate success, global_id 54228 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.566+0000 7fbda2a5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd90005980 con 0x7fbd9c182cc0 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbd9affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbd9affd640 1 -- 10.20.193.57:0/4114432852 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbd90005cd0 con 0x7fbd9c182cc0 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbd9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbd9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbd9affd640 10 monclient: dump: 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.577 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 4 set_mon_vals no callback set 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 10 monclient: shutdown 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:08.578 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4114432852 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c182cc0 legacy=0x7fbd9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4114432852 shutdown_connections 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4114432852 >> 10.20.193.57:0/4114432852 conn(0x7fbd9c0916b0 msgr2=0x7fbd9c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4114432852 shutdown_connections 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4114432852 wait complete. 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 10 monclient: monmap: 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.579 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 1 Processor -- start 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 1 -- start start 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.567+0000 7fbda2a5b640 10 monclient: init 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 10 monclient(hunting): picked mon.noname-a con 0x7fbd9c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 10 monclient(hunting): picked mon.noname-c con 0x7fbd9c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 10 monclient(hunting): picked mon.noname-b con 0x7fbd9c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.580 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c13ee30 con 0x7fbd9c08c250 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c0888a0 con 0x7fbd9c182cc0 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c05dd80 con 0x7fbd9c08c620 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbda2a5b640 10 monclient(hunting): authenticate will time out at 1048.387198s 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbd9bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbd9c08c250 0x7fbd9c136780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35716/0 (socket says 10.20.193.57:35716) 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbd9bfff640 1 -- 10.20.193.57:0/4076091903 learned_addr learned my addr 10.20.193.57:0/4076091903 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.568+0000 7fbd9b7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbd9c08c620 0x7fbd9c136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39816/0 (socket says 10.20.193.57:39816) 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd9bfff640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c08c250 legacy=0x7fbd9c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd9b7fe640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6790/0 conn(0x7fbd9c08c620 legacy=0x7fbd9c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504392209 0 0) 0x7fbd9c13ee30 con 0x7fbd9c08c250 2026-02-12T17:36:08.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): my global_id is 54231 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd6c0035e0 con 0x7fbd9c08c250 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621506502 0 0) 0x7fbd9c05dd80 con 0x7fbd9c08c620 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): my global_id is 64136 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd9c13ee30 con 0x7fbd9c08c620 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbda0fd1640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.82:6789/0 conn(0x7fbd9c182cc0 legacy=0x7fbd9c1932a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3264382780 0 0) 0x7fbd6c0035e0 con 0x7fbd9c08c250 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd9c05dd80 con 0x7fbd9c08c250 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbd880033b0 con 0x7fbd9c08c250 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): dump: 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.583 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575293975 0 0) 0x7fbd9c0888a0 con 0x7fbd9c182cc0 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): my global_id is 4786 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd6c0035e0 con 0x7fbd9c182cc0 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3049129662 0 0) 0x7fbd9c13ee30 con 0x7fbd9c08c620 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd9c0888a0 con 0x7fbd9c08c620 2026-02-12T17:36:08.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbd8c0032e0 con 0x7fbd9c08c620 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient(hunting): dump: 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.585 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1972557697 0 0) 0x7fbd9c05dd80 con 0x7fbd9c08c250 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6790/0 conn(0x7fbd9c08c620 legacy=0x7fbd9c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.82:6789/0 conn(0x7fbd9c182cc0 legacy=0x7fbd9c1932a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 monclient: found mon.a 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c1395a0 con 0x7fbd9c08c250 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbd98ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbda2a5b640 5 monclient: authenticate success, global_id 54231 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbda2a5b640 10 monclient: _renew_subs 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbda2a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c137da0 con 0x7fbd9c08c250 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbda2a5b640 10 monclient: _renew_subs 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbda2a5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.570+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd9c1375a0 con 0x7fbd9c08c250 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd88003980 con 0x7fbd9c08c250 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbd98ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbd88003ce0 con 0x7fbd9c08c250 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbd98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbd98ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbd98ff9640 10 monclient: dump: 2026-02-12T17:36:08.587 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbd9a7fc640 4 set_mon_vals no callback set 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbda2a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd9c090810 con 0x7fbd9c18e650 2026-02-12T17:36:08.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fbd88003f70 con 0x7fbd9c08c250 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(390..390 src has 202..390) ==== 3975+0+0 (unknown 2884364590 0 0) 0x7fbd8804ecb0 con 0x7fbd9c08c250 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.571+0000 7fbda0fd1640 10 monclient: get_auth_request con 0x7fbd6c03fd10 auth_method 0 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd9b7fe640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c18e650 legacy=0x7fbd9c0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900039737 0 0) 0x7fbd9c090810 con 0x7fbd9c18e650 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 10 monclient(hunting): my global_id is 54234 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd9c05dd80 con 0x7fbd9c18e650 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1588141686 0 0) 0x7fbd9c05dd80 con 0x7fbd9c18e650 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd9c090810 con 0x7fbd9c18e650 2026-02-12T17:36:08.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbd8c004c40 con 0x7fbd9c18e650 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.573+0000 7fbd98ff9640 10 monclient: dump: 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.590 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.574+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 792006165 0 0) 0x7fbd9c090810 con 0x7fbd9c18e650 2026-02-12T17:36:08.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.574+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd9c18ea20 con 0x7fbd9c18e650 2026-02-12T17:36:08.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.574+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fbd8c007a20 con 0x7fbd9c18e650 2026-02-12T17:36:08.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.574+0000 7fbd98ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.574+0000 7fbd98ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:08.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.574+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c18e650 legacy=0x7fbd9c0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.574+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c18e650 legacy=0x7fbd9c0582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:08.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.577+0000 7fbda2a5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:36:08.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.577+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd9c055340 con 0x7fbd9c0589d0 2026-02-12T17:36:08.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd9b7fe640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c0589d0 legacy=0x7fbd9c1959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987669363 0 0) 0x7fbd9c055340 con 0x7fbd9c0589d0 2026-02-12T17:36:08.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 10 monclient(hunting): my global_id is 54237 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd9c090810 con 0x7fbd9c0589d0 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1946843140 0 0) 0x7fbd9c090810 con 0x7fbd9c0589d0 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd9c055340 con 0x7fbd9c0589d0 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbd8c005470 con 0x7fbd9c0589d0 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.579+0000 7fbd98ff9640 10 monclient: dump: 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.594 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3002315795 0 0) 0x7fbd9c055340 con 0x7fbd9c0589d0 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd9c13e820 con 0x7fbd9c0589d0 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 178656600) 0x7fbd8c005610 con 0x7fbd9c0589d0 2026-02-12T17:36:08.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbd98ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:36:08.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbd98ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:08.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c0589d0 legacy=0x7fbd9c1959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbd98ff9640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c0589d0 legacy=0x7fbd9c1959d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:08.596 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:36:08.596 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:08.596 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:08.596 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:36:08.596 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 34, 2026-02-12T17:36:08.596 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 109058, 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:08.597 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:36:08.598 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:36:08.599 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:08.600 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:36:08.601 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:36:08.602 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.603 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.604 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:08.605 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.606 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.607 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:36:08.607 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.82:6800/2441377515 conn(0x7fbd6c03fd10 legacy=0x7fbd6c0601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda2a5b640 10 monclient: shutdown 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda2a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 >> v1:10.20.193.57:6789/0 conn(0x7fbd9c08c250 legacy=0x7fbd9c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda0fd1640 1 -- 10.20.193.57:0/4076091903 reap_dead start 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda0fd1640 1 -- 10.20.193.57:0/4076091903 reap_dead start 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 shutdown_connections 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 >> 10.20.193.57:0/4076091903 conn(0x7fbd9c0916b0 msgr2=0x7fbd9c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 shutdown_connections 2026-02-12T17:36:08.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.580+0000 7fbda2a5b640 1 -- 10.20.193.57:0/4076091903 wait complete. 2026-02-12T17:36:08.609 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:36:08.609 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:36:08.609 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.676+0000 7f758aec3640 10 monclient: get_monmap_and_config 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.676+0000 7f758aec3640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.676+0000 7f758aec3640 10 monclient: monmap: 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:08.677449+0000 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:08.677449+0000 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.674 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.675 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:08.675 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:08.675 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 1 Processor -- start 2026-02-12T17:36:08.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 1 -- start start 2026-02-12T17:36:08.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 10 monclient: init 2026-02-12T17:36:08.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:36:08.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 10 monclient(hunting): picked mon.noname-c con 0x7f758408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 10 monclient(hunting): picked mon.noname-a con 0x7f758408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 10 monclient(hunting): picked mon.noname-b con 0x7f7584182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758408a820 con 0x7f758408c620 2026-02-12T17:36:08.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7584089450 con 0x7f758408c250 2026-02-12T17:36:08.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7584089730 con 0x7f7584182cc0 2026-02-12T17:36:08.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f758aec3640 10 monclient(hunting): authenticate will time out at 1048.496561s 2026-02-12T17:36:08.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f757bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f758408c620 0x7f758408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35746/0 (socket says 10.20.193.57:35746) 2026-02-12T17:36:08.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.677+0000 7f757bfff640 1 -- 10.20.193.57:0/2625093031 learned_addr learned my addr 10.20.193.57:0/2625093031 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757bfff640 1 -- 10.20.193.57:0/2625093031 >> v1:10.20.193.57:6789/0 conn(0x7f758408c620 legacy=0x7f758408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f7589439640 1 -- 10.20.193.57:0/2625093031 >> v1:10.20.193.57:6790/0 conn(0x7f7584182cc0 legacy=0x7f75841a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f7588c38640 1 -- 10.20.193.57:0/2625093031 >> v1:10.20.193.82:6789/0 conn(0x7f758408c250 legacy=0x7f758408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3953210733 0 0) 0x7f756c002c20 con 0x7f758408c620 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 10 monclient(hunting): my global_id is 54240 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75700035e0 con 0x7f758408c620 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276186858 0 0) 0x7f7584089730 con 0x7f7584182cc0 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 10 monclient(hunting): my global_id is 64139 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.679+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f756c002c20 con 0x7f7584182cc0 2026-02-12T17:36:08.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 51745289 0 0) 0x7f75700035e0 con 0x7f758408c620 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 >> v1:10.20.193.57:6790/0 conn(0x7f7584182cc0 legacy=0x7f75841a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 >> v1:10.20.193.82:6789/0 conn(0x7f758408c250 legacy=0x7f758408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 1 monclient: found mon.noname-a 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7584089a10 con 0x7f758408c620 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f756c0032e0 con 0x7f758408c620 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: dump: 2026-02-12T17:36:08.682 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 5 monclient: authenticate success, global_id 54240 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f756c004960 con 0x7f758408c620 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 1 -- 10.20.193.57:0/2625093031 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f756c004cf0 con 0x7f758408c620 2026-02-12T17:36:08.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f757b7fe640 10 monclient: dump: 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:08.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 4 set_mon_vals no callback set 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 10 monclient: shutdown 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 1 -- 10.20.193.57:0/2625093031 >> v1:10.20.193.57:6789/0 conn(0x7f758408c620 legacy=0x7f758408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 1 -- 10.20.193.57:0/2625093031 shutdown_connections 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 1 -- 10.20.193.57:0/2625093031 >> 10.20.193.57:0/2625093031 conn(0x7f75840916b0 msgr2=0x7f7584091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 1 -- 10.20.193.57:0/2625093031 shutdown_connections 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.680+0000 7f758aec3640 1 -- 10.20.193.57:0/2625093031 wait complete. 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient: monmap: 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:08.685 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 1 Processor -- start 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 1 -- start start 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient: init 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient(hunting): picked mon.noname-a con 0x7f758408c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient(hunting): picked mon.noname-b con 0x7f758408c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient(hunting): picked mon.noname-c con 0x7f7584182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758418e5e0 con 0x7f758408c250 2026-02-12T17:36:08.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758413af80 con 0x7f758408c620 2026-02-12T17:36:08.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f758413b4b0 con 0x7f7584182cc0 2026-02-12T17:36:08.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f758aec3640 10 monclient(hunting): authenticate will time out at 1048.500488s 2026-02-12T17:36:08.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f7588c38640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f758408c250 0x7f7584137690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35750/0 (socket says 10.20.193.57:35750) 2026-02-12T17:36:08.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.681+0000 7f7588c38640 1 -- 10.20.193.57:0/2462329488 learned_addr learned my addr 10.20.193.57:0/2462329488 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f7588c38640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6789/0 conn(0x7f758408c250 legacy=0x7f7584137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f7589439640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6790/0 conn(0x7f7584182cc0 legacy=0x7f75841384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2540145300 0 0) 0x7f758418e5e0 con 0x7f758408c250 2026-02-12T17:36:08.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): my global_id is 54243 2026-02-12T17:36:08.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75540035e0 con 0x7f758408c250 2026-02-12T17:36:08.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848224806 0 0) 0x7f758413b4b0 con 0x7f7584182cc0 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): my global_id is 64142 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f758418e5e0 con 0x7f7584182cc0 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f757bfff640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.82:6789/0 conn(0x7f758408c620 legacy=0x7f7584137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2901482492 0 0) 0x7f75540035e0 con 0x7f758408c250 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f758413b4b0 con 0x7f758408c250 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f75740033e0 con 0x7f758408c250 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): dump: 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.693 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011231374 0 0) 0x7f758413af80 con 0x7f758408c620 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 10 monclient(hunting): my global_id is 4792 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75540035e0 con 0x7f758408c620 2026-02-12T17:36:08.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2972753321 0 0) 0x7f758418e5e0 con 0x7f7584182cc0 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.683+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f758413af80 con 0x7f7584182cc0 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7580004490 con 0x7f7584182cc0 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient(hunting): dump: 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2781883144 0 0) 0x7f758413b4b0 con 0x7f758408c250 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6790/0 conn(0x7f7584182cc0 legacy=0x7f75841384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.82:6789/0 conn(0x7f758408c620 legacy=0x7f7584137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 monclient: found mon.a 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7584139150 con 0x7f758408c250 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f758aec3640 5 monclient: authenticate success, global_id 54243 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f758aec3640 10 monclient: _renew_subs 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f758aec3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f758413a060 con 0x7f758408c250 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f758aec3640 10 monclient: _renew_subs 2026-02-12T17:36:08.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f758aec3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7584139cb0 con 0x7f758408c250 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75740039f0 con 0x7f758408c250 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7574003d10 con 0x7f758408c250 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 10 monclient: dump: 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.697 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f757affd640 4 set_mon_vals no callback set 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f758aec3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f758408f0d0 con 0x7f7584086730 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f7574003f20 con 0x7f758408c250 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.684+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(390..390 src has 202..390) ==== 3975+0+0 (unknown 2884364590 0 0) 0x7f757404ecd0 con 0x7f758408c250 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.685+0000 7f7589439640 10 monclient: get_auth_request con 0x7f755403fd10 auth_method 0 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.686+0000 7f757bfff640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6790/0 conn(0x7f7584086730 legacy=0x7f7584086b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.686+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770958726 0 0) 0x7f758408f0d0 con 0x7f7584086730 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.686+0000 7f75797fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.686+0000 7f75797fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.686+0000 7f75797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.686+0000 7f75797fa640 10 monclient(hunting): my global_id is 64145 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.686+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f758413b4b0 con 0x7f7584086730 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3026406633 0 0) 0x7f758413b4b0 con 0x7f7584086730 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f758408f0d0 con 0x7f7584086730 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f756c002f00 con 0x7f7584086730 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 10 monclient: dump: 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.699 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1238165611 0 0) 0x7f758408f0d0 con 0x7f7584086730 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f758413ad20 con 0x7f7584086730 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f756c003320 con 0x7f7584086730 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6790/0 conn(0x7f7584086730 legacy=0x7f7584086b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.687+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6790/0 conn(0x7f7584086730 legacy=0x7f7584086b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.690+0000 7f758aec3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.690+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f758408f580 con 0x7f7584087210 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.692+0000 7f757bfff640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6790/0 conn(0x7f7584087210 legacy=0x7f75841974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.692+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078009042 0 0) 0x7f758408f580 con 0x7f7584087210 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.692+0000 7f75797fa640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.692+0000 7f75797fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.692+0000 7f75797fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.692+0000 7f75797fa640 10 monclient(hunting): my global_id is 64148 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.692+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f758408f0d0 con 0x7f7584087210 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3288157150 0 0) 0x7f758408f0d0 con 0x7f7584087210 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f758408f580 con 0x7f7584087210 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f756c005210 con 0x7f7584087210 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 10 monclient: dump: 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.701 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 197507465 0 0) 0x7f758408f580 con 0x7f7584087210 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7584055340 con 0x7f7584087210 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4336 (unknown 0 0 1767097352) 0x7f756c007520 con 0x7f7584087210 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6790/0 conn(0x7f7584087210 legacy=0x7f75841974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f75797fa640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6790/0 conn(0x7f7584087210 legacy=0x7f75841974f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 34, 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 2162, 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:36:08.703 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:08.704 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:08.705 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:36:08.706 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:08.707 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:36:08.708 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.709 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.710 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:36:08.711 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.712 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:08.712 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:08.712 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:08.712 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.712 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.712 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.712 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:36:08.712 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.82:6800/2441377515 conn(0x7f755403fd10 legacy=0x7f75540601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f758aec3640 10 monclient: shutdown 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f758aec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 >> v1:10.20.193.57:6789/0 conn(0x7f758408c250 legacy=0x7f7584137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f7589439640 1 -- 10.20.193.57:0/2462329488 reap_dead start 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f7589439640 1 -- 10.20.193.57:0/2462329488 reap_dead start 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 shutdown_connections 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 >> 10.20.193.57:0/2462329488 conn(0x7f75840916b0 msgr2=0x7f758408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 shutdown_connections 2026-02-12T17:36:08.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.693+0000 7f758aec3640 1 -- 10.20.193.57:0/2462329488 wait complete. 2026-02-12T17:36:08.714 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:36:08.714 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:36:08.714 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:36:08.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.780+0000 7f02bb3e5640 10 monclient: get_monmap_and_config 2026-02-12T17:36:08.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.780+0000 7f02bb3e5640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.780+0000 7f02bb3e5640 10 monclient: monmap: 2026-02-12T17:36:08.779 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.779 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:08.781801+0000 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:08.781801+0000 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 1 Processor -- start 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 1 -- start start 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 10 monclient: init 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 10 monclient(hunting): picked mon.noname-c con 0x7f02b408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 10 monclient(hunting): picked mon.noname-a con 0x7f02b408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 10 monclient(hunting): picked mon.noname-b con 0x7f02b4182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b408a820 con 0x7f02b408c620 2026-02-12T17:36:08.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b4089450 con 0x7f02b408c250 2026-02-12T17:36:08.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b4089730 con 0x7f02b4182cc0 2026-02-12T17:36:08.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02bb3e5640 10 monclient(hunting): authenticate will time out at 1048.600700s 2026-02-12T17:36:08.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02b8959640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f02b408c620 0x7f02b408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35764/0 (socket says 10.20.193.57:35764) 2026-02-12T17:36:08.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02b8959640 1 -- 10.20.193.57:0/2853794512 learned_addr learned my addr 10.20.193.57:0/2853794512 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.781+0000 7f02b995b640 1 --1- 10.20.193.57:0/2853794512 >> v1:10.20.193.57:6790/0 conn(0x7f02b4182cc0 0x7f02b41a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39874/0 (socket says 10.20.193.57:39874) 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.783+0000 7f02b8959640 1 -- 10.20.193.57:0/2853794512 >> v1:10.20.193.57:6789/0 conn(0x7f02b408c620 legacy=0x7f02b408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.783+0000 7f02b995b640 1 -- 10.20.193.57:0/2853794512 >> v1:10.20.193.57:6790/0 conn(0x7f02b4182cc0 legacy=0x7f02b41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02b915a640 1 -- 10.20.193.57:0/2853794512 >> v1:10.20.193.82:6789/0 conn(0x7f02b408c250 legacy=0x7f02b408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783217124 0 0) 0x7f02a8002c20 con 0x7f02b408c620 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient(hunting): my global_id is 54246 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f029c0035e0 con 0x7f02b408c620 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559744444 0 0) 0x7f02b4089730 con 0x7f02b4182cc0 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient(hunting): my global_id is 64151 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a8002c20 con 0x7f02b4182cc0 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 114063955 0 0) 0x7f029c0035e0 con 0x7f02b408c620 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 >> v1:10.20.193.57:6790/0 conn(0x7f02b4182cc0 legacy=0x7f02b41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 >> v1:10.20.193.82:6789/0 conn(0x7f02b408c250 legacy=0x7f02b408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 monclient: found mon.noname-a 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b4089a10 con 0x7f02b408c620 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f02a80032e0 con 0x7f02b408c620 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:08.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: dump: 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 5 monclient: authenticate success, global_id 54246 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02a8003520 con 0x7f02b408c620 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 1 -- 10.20.193.57:0/2853794512 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f02a8004b40 con 0x7f02b408c620 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02a3fff640 10 monclient: dump: 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 4 set_mon_vals no callback set 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 10 monclient: shutdown 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 1 -- 10.20.193.57:0/2853794512 >> v1:10.20.193.57:6789/0 conn(0x7f02b408c620 legacy=0x7f02b408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 1 -- 10.20.193.57:0/2853794512 shutdown_connections 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 1 -- 10.20.193.57:0/2853794512 >> 10.20.193.57:0/2853794512 conn(0x7f02b40916b0 msgr2=0x7f02b4091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:08.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 1 -- 10.20.193.57:0/2853794512 shutdown_connections 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.784+0000 7f02bb3e5640 1 -- 10.20.193.57:0/2853794512 wait complete. 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient: monmap: 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 1 Processor -- start 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 1 -- start start 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient: init 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:36:08.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient(hunting): picked mon.noname-a con 0x7f02b408c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient(hunting): picked mon.noname-b con 0x7f02b408c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient(hunting): picked mon.noname-c con 0x7f02b4182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b405e220 con 0x7f02b408c250 2026-02-12T17:36:08.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b405d890 con 0x7f02b408c620 2026-02-12T17:36:08.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b408ee90 con 0x7f02b4182cc0 2026-02-12T17:36:08.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02bb3e5640 10 monclient(hunting): authenticate will time out at 1048.604647s 2026-02-12T17:36:08.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02b915a640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f02b408c250 0x7f02b413e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:35766/0 (socket says 10.20.193.57:35766) 2026-02-12T17:36:08.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.785+0000 7f02b915a640 1 -- 10.20.193.57:0/969291779 learned_addr learned my addr 10.20.193.57:0/969291779 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02b915a640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.57:6789/0 conn(0x7f02b408c250 legacy=0x7f02b413e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02b995b640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.57:6790/0 conn(0x7f02b4182cc0 legacy=0x7f02b41823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084517902 0 0) 0x7f02b405e220 con 0x7f02b408c250 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02b8959640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.82:6789/0 conn(0x7f02b408c620 legacy=0x7f02b4181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 10 monclient(hunting): my global_id is 54249 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02840035e0 con 0x7f02b408c250 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750288733 0 0) 0x7f02b408ee90 con 0x7f02b4182cc0 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 10 monclient(hunting): my global_id is 64154 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.787+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b405e220 con 0x7f02b4182cc0 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602415980 0 0) 0x7f02b405d890 con 0x7f02b408c620 2026-02-12T17:36:08.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): my global_id is 4798 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b408ee90 con 0x7f02b408c620 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1808503369 0 0) 0x7f02840035e0 con 0x7f02b408c250 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02b405d890 con 0x7f02b408c250 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f02a4003300 con 0x7f02b408c250 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): dump: 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.794 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3333852593 0 0) 0x7f02b405e220 con 0x7f02b4182cc0 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02840035e0 con 0x7f02b4182cc0 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f02b0004440 con 0x7f02b4182cc0 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient(hunting): dump: 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.795 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3827061016 0 0) 0x7f02b405d890 con 0x7f02b408c250 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.57:6790/0 conn(0x7f02b4182cc0 legacy=0x7f02b41823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.82:6789/0 conn(0x7f02b408c620 legacy=0x7f02b4181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 monclient: found mon.a 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b413eb70 con 0x7f02b408c250 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02bb3e5640 5 monclient: authenticate success, global_id 54249 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02bb3e5640 10 monclient: _renew_subs 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02bb3e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02b4138920 con 0x7f02b408c250 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02bb3e5640 10 monclient: _renew_subs 2026-02-12T17:36:08.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02bb3e5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f02b4138640 con 0x7f02b408c250 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02a4003980 con 0x7f02b408c250 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f02a4003cd0 con 0x7f02b408c250 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a37fe640 4 set_mon_vals no callback set 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 10 monclient: dump: 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.797 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02bb3e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02b4090810 con 0x7f02b405d0b0 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.788+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f02a4003f60 con 0x7f02b408c250 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.789+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(390..390 src has 202..390) ==== 3975+0+0 (unknown 2884364590 0 0) 0x7f02a404ec20 con 0x7f02b408c250 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.789+0000 7f02b995b640 10 monclient: get_auth_request con 0x7f028403fc90 auth_method 0 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02b8959640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.82:6789/0 conn(0x7f02b405d0b0 legacy=0x7f02b40582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879802541 0 0) 0x7f02b4090810 con 0x7f02b405d0b0 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 10 monclient(hunting): my global_id is 4801 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b405d890 con 0x7f02b405d0b0 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4294596147 0 0) 0x7f02b405d890 con 0x7f02b405d0b0 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02b4090810 con 0x7f02b405d0b0 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f02a80030b0 con 0x7f02b405d0b0 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 10 monclient: dump: 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1519080906 0 0) 0x7f02b4090810 con 0x7f02b405d0b0 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.791+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02b4138d70 con 0x7f02b405d0b0 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.792+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f02a8003340 con 0x7f02b405d0b0 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.792+0000 7f02a1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.792+0000 7f02a1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.792+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.82:6789/0 conn(0x7f02b405d0b0 legacy=0x7f02b40582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.792+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.82:6789/0 conn(0x7f02b405d0b0 legacy=0x7f02b40582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:08.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.795+0000 7f02bb3e5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:36:08.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.795+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02b408f580 con 0x7f02b40589d0 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.797+0000 7f02b8959640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.82:6789/0 conn(0x7f02b40589d0 legacy=0x7f02b4195360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.797+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190462171 0 0) 0x7f02b408f580 con 0x7f02b40589d0 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.797+0000 7f02a1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.797+0000 7f02a1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.797+0000 7f02a1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.797+0000 7f02a1ffb640 10 monclient(hunting): my global_id is 4804 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.797+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b4090810 con 0x7f02b40589d0 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.797+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2726577587 0 0) 0x7f02b4090810 con 0x7f02b40589d0 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02b408f580 con 0x7f02b40589d0 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f02a8005470 con 0x7f02b40589d0 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:36:08.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 10 monclient: dump: 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1247060133 0 0) 0x7f02b408f580 con 0x7f02b40589d0 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f02b4055340 con 0x7f02b40589d0 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 2711394397) 0x7f02a8007aa0 con 0x7f02b40589d0 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.82:6789/0 conn(0x7f02b40589d0 legacy=0x7f02b4195360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02a1ffb640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.82:6789/0 conn(0x7f02b40589d0 legacy=0x7f02b4195360 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 34, 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 490295, 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:36:08.803 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:36:08.804 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:36:08.805 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:08.806 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:08.807 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:08.808 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:08.809 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:36:08.810 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:08.811 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:36:08.812 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:36:08.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.82:6800/2441377515 conn(0x7f028403fc90 legacy=0x7f0284060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02bb3e5640 10 monclient: shutdown 2026-02-12T17:36:08.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02bb3e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:08.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 >> v1:10.20.193.57:6789/0 conn(0x7f02b408c250 legacy=0x7f02b413e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02b995b640 1 -- 10.20.193.57:0/969291779 reap_dead start 2026-02-12T17:36:08.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 shutdown_connections 2026-02-12T17:36:08.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 >> 10.20.193.57:0/969291779 conn(0x7f02b40916b0 msgr2=0x7f02b408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:08.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 shutdown_connections 2026-02-12T17:36:08.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.798+0000 7f02bb3e5640 1 -- 10.20.193.57:0/969291779 wait complete. 2026-02-12T17:36:08.814 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:36:08.814 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-12T17:36:08.814 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T17:36:08.814 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-12T17:36:08.814 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-12T17:36:08.814 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T17:36:08.814 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:36:08.823 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T17:36:08.823 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:36:08.823 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:36:08.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient: get_monmap_and_config 2026-02-12T17:36:08.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient: monmap: 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:08.932986+0000 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:08.932986+0000 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:08.930 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:08.931 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 1 Processor -- start 2026-02-12T17:36:08.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 1 -- start start 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient: init 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient(hunting): picked mon.noname-a con 0x7fe73808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient(hunting): picked mon.noname-c con 0x7fe73808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient(hunting): picked mon.noname-b con 0x7fe73808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73808d600 con 0x7fe73808ae20 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73808b1f0 con 0x7fe73808c730 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73808d1f0 con 0x7fe73808cb30 2026-02-12T17:36:08.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe74070c640 10 monclient(hunting): authenticate will time out at 1048.751877s 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe73e481640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7fe73808ae20 legacy=0x7fe73808c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe73ec82640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe73808cb30 0x7fe7381a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39900/0 (socket says 10.20.193.57:39900) 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.932+0000 7fe73ec82640 1 -- 10.20.193.57:0/1650605426 learned_addr learned my addr 10.20.193.57:0/1650605426 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73ec82640 1 -- 10.20.193.57:0/1650605426 >> v1:10.20.193.57:6790/0 conn(0x7fe73808cb30 legacy=0x7fe7381a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 -- 10.20.193.57:0/1650605426 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023403775 0 0) 0x7fe73808d1f0 con 0x7fe73808cb30 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient(hunting): my global_id is 64157 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 -- 10.20.193.57:0/1650605426 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7200035e0 con 0x7fe73808cb30 2026-02-12T17:36:08.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73dc80640 1 -- 10.20.193.57:0/1650605426 >> v1:10.20.193.82:6789/0 conn(0x7fe73808c730 legacy=0x7fe738181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 -- 10.20.193.57:0/1650605426 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 484237925 0 0) 0x7fe7200035e0 con 0x7fe73808cb30 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 -- 10.20.193.57:0/1650605426 >> v1:10.20.193.82:6789/0 conn(0x7fe73808c730 legacy=0x7fe738181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 -- 10.20.193.57:0/1650605426 >> v1:10.20.193.57:6789/0 conn(0x7fe73808ae20 legacy=0x7fe73808c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 monclient: found mon.noname-b 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 -- 10.20.193.57:0/1650605426 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe738057320 con 0x7fe73808cb30 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 -- 10.20.193.57:0/1650605426 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe7340041a0 con 0x7fe73808cb30 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: dump: 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.939 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 5 monclient: authenticate success, global_id 64157 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 -- 10.20.193.57:0/1650605426 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe734004430 con 0x7fe73808cb30 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 4 set_mon_vals no callback set 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 1 -- 10.20.193.57:0/1650605426 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe734005bf0 con 0x7fe73808cb30 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe73d47f640 10 monclient: dump: 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 10 monclient: shutdown 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 1 -- 10.20.193.57:0/1650605426 >> v1:10.20.193.57:6790/0 conn(0x7fe73808cb30 legacy=0x7fe7381a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 1 -- 10.20.193.57:0/1650605426 shutdown_connections 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 1 -- 10.20.193.57:0/1650605426 >> 10.20.193.57:0/1650605426 conn(0x7fe738091620 msgr2=0x7fe738091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.935+0000 7fe74070c640 1 -- 10.20.193.57:0/1650605426 shutdown_connections 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 1 -- 10.20.193.57:0/1650605426 wait complete. 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient: build_initial_monmap 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient: monmap: 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:08.942 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:08.943 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:08.943 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:08.943 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:08.943 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:08.943 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:08.943 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 1 Processor -- start 2026-02-12T17:36:08.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 1 -- start start 2026-02-12T17:36:08.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient: init 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient(hunting): picked mon.noname-a con 0x7fe73808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient(hunting): picked mon.noname-c con 0x7fe73808c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient(hunting): picked mon.noname-b con 0x7fe73808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73808d9c0 con 0x7fe73808ae20 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe73e481640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7fe73808ae20 legacy=0x7fe738118d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe738088810 con 0x7fe73808cb30 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe73811baf0 con 0x7fe73808c730 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe74070c640 10 monclient(hunting): authenticate will time out at 1048.755798s 2026-02-12T17:36:08.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe73dc80640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe73808c730 0x7fe738119480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39902/0 (socket says 10.20.193.57:39902) 2026-02-12T17:36:08.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.936+0000 7fe73dc80640 1 -- 10.20.193.57:0/849373255 learned_addr learned my addr 10.20.193.57:0/849373255 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:08.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.938+0000 7fe73dc80640 1 -- 10.20.193.57:0/849373255 >> v1:10.20.193.57:6790/0 conn(0x7fe73808c730 legacy=0x7fe738119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213526291 0 0) 0x7fe73811baf0 con 0x7fe73808c730 2026-02-12T17:36:08.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): my global_id is 64160 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe73ec82640 1 -- 10.20.193.57:0/849373255 >> v1:10.20.193.82:6789/0 conn(0x7fe73808cb30 legacy=0x7fe7381a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7080035e0 con 0x7fe73808c730 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839803873 0 0) 0x7fe738088810 con 0x7fe73808cb30 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): my global_id is 4810 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe73811baf0 con 0x7fe73808cb30 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1928071490 0 0) 0x7fe7080035e0 con 0x7fe73808c730 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe738088810 con 0x7fe73808c730 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe72c0033e0 con 0x7fe73808c730 2026-02-12T17:36:08.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): dump: 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.950 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1639565736 0 0) 0x7fe738088810 con 0x7fe73808c730 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 >> v1:10.20.193.82:6789/0 conn(0x7fe73808cb30 legacy=0x7fe7381a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 >> v1:10.20.193.57:6789/0 conn(0x7fe73808ae20 legacy=0x7fe738118d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient: _finish_hunting 0 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 monclient: found mon.c 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73811a0f0 con 0x7fe73808c730 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient: _finish_auth 0 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient: _check_auth_tickets 2026-02-12T17:36:08.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe74070c640 5 monclient: authenticate success, global_id 64160 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe74070c640 10 monclient: _renew_subs 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe74070c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe73811a700 con 0x7fe73808c730 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe74070c640 10 monclient: _renew_subs 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe74070c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe738119b90 con 0x7fe73808c730 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe72c0039f0 con 0x7fe73808c730 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe72c003d10 con 0x7fe73808c730 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:08.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe73cc7e640 4 set_mon_vals no callback set 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.939+0000 7fe71effd640 10 monclient: dump: 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:08.953 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.940+0000 7fe74070c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.940+0000 7fe74070c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.940+0000 7fe74070c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.940+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe738119e90 con 0x7fe73808c730 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.940+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe72c003f20 con 0x7fe73808c730 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.940+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(390..390 src has 202..390) ==== 3975+0+0 (unknown 2884364590 0 0) 0x7fe72c04ed70 con 0x7fe73808c730 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.940+0000 7fe73e481640 10 monclient: get_auth_request con 0x7fe70803f760 auth_method 0 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.942+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe72c004440 con 0x7fe73808c730 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.942+0000 7fe71effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:08.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:08.942+0000 7fe71effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:09.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.086+0000 7fe74070c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:36:09.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.086+0000 7fe74070c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:09.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.086+0000 7fe74070c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:09.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.086+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe738055340 con 0x7fe73808c730 2026-02-12T17:36:09.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.086+0000 7fe71effd640 1 -- 10.20.193.57:0/849373255 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 1361951221) 0x7fe72c016c10 con 0x7fe73808c730 2026-02-12T17:36:09.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.086+0000 7fe71effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:09.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.086+0000 7fe71effd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:09.085 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:36:09.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.087+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe70803f760 legacy=0x7fe70805fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:09.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.087+0000 7fe74070c640 10 monclient: shutdown 2026-02-12T17:36:09.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.087+0000 7fe74070c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:09.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.087+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 >> v1:10.20.193.57:6790/0 conn(0x7fe73808c730 legacy=0x7fe738119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:09.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.087+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 shutdown_connections 2026-02-12T17:36:09.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.087+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 >> 10.20.193.57:0/849373255 conn(0x7fe738091620 msgr2=0x7fe7380597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:09.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.087+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 shutdown_connections 2026-02-12T17:36:09.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:09.087+0000 7fe74070c640 1 -- 10.20.193.57:0/849373255 wait complete. 2026-02-12T17:36:12.093 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:36:12.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.162+0000 7f96b230c640 10 monclient: get_monmap_and_config 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.162+0000 7f96b230c640 10 monclient: build_initial_monmap 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.162+0000 7f96b230c640 10 monclient: monmap: 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:12.163169+0000 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:12.163169+0000 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:12.160 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:12.161 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:12.161 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:12.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.162+0000 7f96b230c640 1 Processor -- start 2026-02-12T17:36:12.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.162+0000 7f96b230c640 1 -- start start 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.162+0000 7f96b230c640 10 monclient: init 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 10 monclient(hunting): picked mon.noname-b con 0x7f96ac08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 10 monclient(hunting): picked mon.noname-c con 0x7f96ac08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 10 monclient(hunting): picked mon.noname-a con 0x7f96ac08cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ac08d600 con 0x7f96ac08cb30 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ac08b1f0 con 0x7f96ac08c730 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ac08d1f0 con 0x7f96ac08ae20 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b230c640 10 monclient(hunting): authenticate will time out at 1051.982084s 2026-02-12T17:36:12.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96b0882640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f96ac08cb30 legacy=0x7f96ac1a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96abfff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f96ac08ae20 0x7f96ac08c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39916/0 (socket says 10.20.193.57:39916) 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.163+0000 7f96abfff640 1 -- 10.20.193.57:0/3323344762 learned_addr learned my addr 10.20.193.57:0/3323344762 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.165+0000 7f96abfff640 1 -- 10.20.193.57:0/3323344762 >> v1:10.20.193.57:6790/0 conn(0x7f96ac08ae20 legacy=0x7f96ac08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.165+0000 7f96ab7fe640 1 -- 10.20.193.57:0/3323344762 >> v1:10.20.193.82:6789/0 conn(0x7f96ac08c730 legacy=0x7f96ac181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.165+0000 7f96aaffd640 1 -- 10.20.193.57:0/3323344762 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781238308 0 0) 0x7f96ac08b1f0 con 0x7f96ac08c730 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.165+0000 7f96aaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.165+0000 7f96aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.165+0000 7f96aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.165+0000 7f96aaffd640 10 monclient(hunting): my global_id is 4813 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.165+0000 7f96aaffd640 1 -- 10.20.193.57:0/3323344762 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96900035e0 con 0x7f96ac08c730 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 1 -- 10.20.193.57:0/3323344762 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4086923776 0 0) 0x7f96900035e0 con 0x7f96ac08c730 2026-02-12T17:36:12.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 1 -- 10.20.193.57:0/3323344762 >> v1:10.20.193.57:6790/0 conn(0x7f96ac08ae20 legacy=0x7f96ac08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 1 -- 10.20.193.57:0/3323344762 >> v1:10.20.193.57:6789/0 conn(0x7f96ac08cb30 legacy=0x7f96ac1a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: _finish_hunting 0 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 1 monclient: found mon.noname-c 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 1 -- 10.20.193.57:0/3323344762 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac057320 con 0x7f96ac08c730 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: _finish_auth 0 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: _check_auth_tickets 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 1 -- 10.20.193.57:0/3323344762 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f969c003120 con 0x7f96ac08c730 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 5 monclient: authenticate success, global_id 4813 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:12.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: dump: 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:12.169 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 1 -- 10.20.193.57:0/3323344762 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f969c0033b0 con 0x7f96ac08c730 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 1 -- 10.20.193.57:0/3323344762 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f969c003550 con 0x7f96ac08c730 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96aaffd640 10 monclient: dump: 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:12.170 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 4 set_mon_vals no callback set 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 10 monclient: shutdown 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 1 -- 10.20.193.57:0/3323344762 >> v1:10.20.193.82:6789/0 conn(0x7f96ac08c730 legacy=0x7f96ac181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 1 -- 10.20.193.57:0/3323344762 shutdown_connections 2026-02-12T17:36:12.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 1 -- 10.20.193.57:0/3323344762 >> 10.20.193.57:0/3323344762 conn(0x7f96ac091620 msgr2=0x7f96ac091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 1 -- 10.20.193.57:0/3323344762 shutdown_connections 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.166+0000 7f96b230c640 1 -- 10.20.193.57:0/3323344762 wait complete. 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient: build_initial_monmap 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient: monmap: 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:12.172 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 1 Processor -- start 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 1 -- start start 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient: init 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient(hunting): picked mon.noname-c con 0x7f96ac08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient(hunting): picked mon.noname-a con 0x7f96ac08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient(hunting): picked mon.noname-b con 0x7f96ac08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ac08d9c0 con 0x7f96ac08c730 2026-02-12T17:36:12.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ac08ab20 con 0x7f96ac08cb30 2026-02-12T17:36:12.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ac07a400 con 0x7f96ac08ae20 2026-02-12T17:36:12.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:12.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96b230c640 10 monclient(hunting): authenticate will time out at 1051.986674s 2026-02-12T17:36:12.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96ab7fe640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f96ac08c730 legacy=0x7f96ac140580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:12.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96abfff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f96ac08ae20 0x7f96ac13fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39932/0 (socket says 10.20.193.57:39932) 2026-02-12T17:36:12.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.167+0000 7f96abfff640 1 -- 10.20.193.57:0/3508483046 learned_addr learned my addr 10.20.193.57:0/3508483046 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:12.177 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.169+0000 7f96abfff640 1 -- 10.20.193.57:0/3508483046 >> v1:10.20.193.57:6790/0 conn(0x7f96ac08ae20 legacy=0x7f96ac13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:12.177 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96b0882640 1 -- 10.20.193.57:0/3508483046 >> v1:10.20.193.82:6789/0 conn(0x7f96ac08cb30 legacy=0x7f96ac195140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:12.177 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940779928 0 0) 0x7f96ac08ab20 con 0x7f96ac08cb30 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient(hunting): my global_id is 4816 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f967c0035e0 con 0x7f96ac08cb30 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 661391980 0 0) 0x7f967c0035e0 con 0x7f96ac08cb30 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96ac08ab20 con 0x7f96ac08cb30 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96a0005400 con 0x7f96ac08cb30 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient(hunting): dump: 2026-02-12T17:36:12.178 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3080279098 0 0) 0x7f96ac08ab20 con 0x7f96ac08cb30 2026-02-12T17:36:12.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 >> v1:10.20.193.57:6790/0 conn(0x7f96ac08ae20 legacy=0x7f96ac13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 >> v1:10.20.193.57:6789/0 conn(0x7f96ac08c730 legacy=0x7f96ac140580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 monclient: found mon.b 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac140c90 con 0x7f96ac08cb30 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient: _finish_auth 0 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96b230c640 5 monclient: authenticate success, global_id 4816 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96b230c640 10 monclient: _renew_subs 2026-02-12T17:36:12.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96b230c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f96ac089600 con 0x7f96ac08cb30 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96b230c640 10 monclient: _renew_subs 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96b230c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f96ac05cd90 con 0x7f96ac08cb30 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96a0005690 con 0x7f96ac08cb30 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f96a00059f0 con 0x7f96ac08cb30 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96aa7fc640 4 set_mon_vals no callback set 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.170+0000 7f96a8ff9640 10 monclient: dump: 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:12.181 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.171+0000 7f96b230c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.171+0000 7f96b230c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.171+0000 7f96b230c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:12.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.171+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ac08a560 con 0x7f96ac08cb30 2026-02-12T17:36:12.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.171+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f96a0005c80 con 0x7f96ac08cb30 2026-02-12T17:36:12.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.171+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(390..390 src has 202..390) ==== 3975+0+0 (unknown 2884364590 0 0) 0x7f96a004fb30 con 0x7f96ac08cb30 2026-02-12T17:36:12.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.171+0000 7f96abfff640 10 monclient: get_auth_request con 0x7f967c03f680 auth_method 0 2026-02-12T17:36:12.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.174+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f96a00064c0 con 0x7f96ac08cb30 2026-02-12T17:36:12.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.174+0000 7f96a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:12.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.174+0000 7f96a8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:12.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.333+0000 7f96b230c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:36:12.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.333+0000 7f96b230c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:12.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.333+0000 7f96b230c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:36:12.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.333+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f96ac089380 con 0x7f96ac08cb30 2026-02-12T17:36:12.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.333+0000 7f96a8ff9640 1 -- 10.20.193.57:0/3508483046 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 1723782993) 0x7f96a0017a20 con 0x7f96ac08cb30 2026-02-12T17:36:12.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.333+0000 7f96a8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:12.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.333+0000 7f96a8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:12.332 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:36:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.334+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 >> v1:10.20.193.82:6800/2441377515 conn(0x7f967c03f680 legacy=0x7f967c05fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.334+0000 7f96b230c640 10 monclient: shutdown 2026-02-12T17:36:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.334+0000 7f96b230c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.334+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 >> v1:10.20.193.82:6789/0 conn(0x7f96ac08cb30 legacy=0x7f96ac195140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.334+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 shutdown_connections 2026-02-12T17:36:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.334+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 >> 10.20.193.57:0/3508483046 conn(0x7f96ac091620 msgr2=0x7f96ac0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.334+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 shutdown_connections 2026-02-12T17:36:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:12.334+0000 7f96b230c640 1 -- 10.20.193.57:0/3508483046 wait complete. 2026-02-12T17:36:15.341 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:36:15.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.411+0000 7fdd94ec3640 10 monclient: get_monmap_and_config 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.411+0000 7fdd94ec3640 10 monclient: build_initial_monmap 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.411+0000 7fdd94ec3640 10 monclient: monmap: 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:15.412145+0000 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:15.412145+0000 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:15.409 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:15.410 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:15.410 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:15.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.411+0000 7fdd94ec3640 1 Processor -- start 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.411+0000 7fdd94ec3640 1 -- start start 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.411+0000 7fdd94ec3640 10 monclient: init 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 10 monclient(hunting): picked mon.noname-c con 0x7fdd9008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 10 monclient(hunting): picked mon.noname-a con 0x7fdd9008cc80 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 10 monclient(hunting): picked mon.noname-b con 0x7fdd901852d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd9008d600 con 0x7fdd9008cc80 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd90089770 con 0x7fdd9008ae20 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd9008b1f0 con 0x7fdd901852d0 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:15.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd94ec3640 10 monclient(hunting): authenticate will time out at 1055.231108s 2026-02-12T17:36:15.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd8dd74640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd90183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:15.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd8ed76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fdd901852d0 0x7fdd901a56b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:55074/0 (socket says 10.20.193.57:55074) 2026-02-12T17:36:15.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.412+0000 7fdd8ed76640 1 -- 10.20.193.57:0/473381373 learned_addr learned my addr 10.20.193.57:0/473381373 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:15.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.414+0000 7fdd8ed76640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6790/0 conn(0x7fdd901852d0 legacy=0x7fdd901a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:15.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.414+0000 7fdd8e575640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.82:6789/0 conn(0x7fdd9008ae20 legacy=0x7fdd9008c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:15.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:15.613+0000 7fdd8dd74640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd90183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:16.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:16.015+0000 7fdd8dd74640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd90183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:16.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:16.817+0000 7fdd8dd74640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd90183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:18.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 10 monclient(hunting): tick 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 1 monclient(hunting): continuing hunt 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6790/0 conn(0x7fdd901852d0 legacy=0x7fdd901a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.82:6789/0 conn(0x7fdd9008ae20 legacy=0x7fdd9008c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd90183bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 10 monclient(hunting): picked mon.noname-a con 0x7fdd9008cc80 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 10 monclient(hunting): picked mon.noname-b con 0x7fdd901852d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 10 monclient(hunting): picked mon.noname-c con 0x7fdd9008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:18.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd8e575640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:18.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd9008c020 con 0x7fdd9008cc80 2026-02-12T17:36:18.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd9008d600 con 0x7fdd9008ae20 2026-02-12T17:36:18.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6c06a0b0 con 0x7fdd901852d0 2026-02-12T17:36:18.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.412+0000 7fdd77fff640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:18.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.414+0000 7fdd8dd74640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6790/0 conn(0x7fdd901852d0 legacy=0x7fdd6c045060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:18.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.414+0000 7fdd8ed76640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.82:6789/0 conn(0x7fdd9008ae20 legacy=0x7fdd6c066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:18.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:18.613+0000 7fdd8e575640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:19.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:19.014+0000 7fdd8e575640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:19.816+0000 7fdd8e575640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:21.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 10 monclient(hunting): tick 2026-02-12T17:36:21.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:36:21.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 1 monclient(hunting): continuing hunt 2026-02-12T17:36:21.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:36:21.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6790/0 conn(0x7fdd901852d0 legacy=0x7fdd6c045060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:21.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.82:6789/0 conn(0x7fdd9008ae20 legacy=0x7fdd6c066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:21.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:36:21.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:36:21.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 10 monclient(hunting): picked mon.noname-a con 0x7fdd9008cc80 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:21.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 10 monclient(hunting): picked mon.noname-b con 0x7fdd901852d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:21.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 10 monclient(hunting): picked mon.noname-c con 0x7fdd9008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:21.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6c06b310 con 0x7fdd9008cc80 2026-02-12T17:36:21.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd9008c020 con 0x7fdd9008ae20 2026-02-12T17:36:21.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 1 -- 10.20.193.57:0/473381373 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6c066990 con 0x7fdd901852d0 2026-02-12T17:36:21.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd77fff640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:21.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.412+0000 7fdd8e575640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:21.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.414+0000 7fdd8dd74640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6790/0 conn(0x7fdd901852d0 legacy=0x7fdd6c069160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:21.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.414+0000 7fdd8ed76640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.82:6789/0 conn(0x7fdd9008ae20 legacy=0x7fdd6c069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:21.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:21.613+0000 7fdd8e575640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:22.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:22.014+0000 7fdd8e575640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:22.812 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:22.815+0000 7fdd8e575640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:23.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 -- 10.20.193.57:0/473381373 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476682781 0 0) 0x7fdd6c066990 con 0x7fdd901852d0 2026-02-12T17:36:23.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient(hunting): my global_id is 64163 2026-02-12T17:36:23.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 -- 10.20.193.57:0/473381373 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd7c0035e0 con 0x7fdd901852d0 2026-02-12T17:36:23.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 -- 10.20.193.57:0/473381373 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 941407108 0 0) 0x7fdd7c0035e0 con 0x7fdd901852d0 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.82:6789/0 conn(0x7fdd9008ae20 legacy=0x7fdd6c069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd6c023850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: _finish_hunting 0 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 monclient: found mon.noname-b 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 -- 10.20.193.57:0/473381373 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c066bc0 con 0x7fdd901852d0 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: _finish_auth 0 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: _check_auth_tickets 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:23.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 -- 10.20.193.57:0/473381373 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd78004510 con 0x7fdd901852d0 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: dump: 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.083 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd94ec3640 5 monclient: authenticate success, global_id 64163 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd94ec3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 -- 10.20.193.57:0/473381373 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd78004810 con 0x7fdd901852d0 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd94ec3640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd94ec3640 4 set_mon_vals no callback set 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 1 -- 10.20.193.57:0/473381373 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd78004be0 con 0x7fdd901852d0 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.080+0000 7fdd8d573640 10 monclient: dump: 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.084 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 10 monclient: shutdown 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 1 -- 10.20.193.57:0/473381373 >> v1:10.20.193.57:6790/0 conn(0x7fdd901852d0 legacy=0x7fdd6c069160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 1 -- 10.20.193.57:0/473381373 shutdown_connections 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 1 -- 10.20.193.57:0/473381373 >> 10.20.193.57:0/473381373 conn(0x7fdd90091620 msgr2=0x7fdd90091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 1 -- 10.20.193.57:0/473381373 shutdown_connections 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 1 -- 10.20.193.57:0/473381373 wait complete. 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 10 monclient: build_initial_monmap 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 10 monclient: monmap: 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:23.086 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 1 Processor -- start 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 1 -- start start 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 10 monclient: init 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.081+0000 7fdd94ec3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd94ec3640 10 monclient(hunting): picked mon.noname-c con 0x7fdd9008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd94ec3640 10 monclient(hunting): picked mon.noname-a con 0x7fdd9008cc80 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd94ec3640 10 monclient(hunting): picked mon.noname-b con 0x7fdd901852d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd94ec3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd90083780 con 0x7fdd9008cc80 2026-02-12T17:36:23.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd94ec3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd90084ca0 con 0x7fdd901852d0 2026-02-12T17:36:23.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd94ec3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd90084f80 con 0x7fdd9008ae20 2026-02-12T17:36:23.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd8dd74640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd900864b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:23.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd94ec3640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:23.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd94ec3640 10 monclient(hunting): authenticate will time out at 1062.901053s 2026-02-12T17:36:23.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd8e575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fdd9008ae20 0x7fdd90152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:41994/0 (socket says 10.20.193.57:41994) 2026-02-12T17:36:23.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.082+0000 7fdd8e575640 1 -- 10.20.193.57:0/763605596 learned_addr learned my addr 10.20.193.57:0/763605596 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:23.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd8e575640 1 -- 10.20.193.57:0/763605596 >> v1:10.20.193.57:6790/0 conn(0x7fdd9008ae20 legacy=0x7fdd90152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270989682 0 0) 0x7fdd90084f80 con 0x7fdd9008ae20 2026-02-12T17:36:23.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient(hunting): my global_id is 64166 2026-02-12T17:36:23.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd5c0035e0 con 0x7fdd9008ae20 2026-02-12T17:36:23.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd8ed76640 1 -- 10.20.193.57:0/763605596 >> v1:10.20.193.82:6789/0 conn(0x7fdd901852d0 legacy=0x7fdd90174f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1469581128 0 0) 0x7fdd5c0035e0 con 0x7fdd9008ae20 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd90084f80 con 0x7fdd9008ae20 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd840033e0 con 0x7fdd9008ae20 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient(hunting): dump: 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.093 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 92633419 0 0) 0x7fdd90084f80 con 0x7fdd9008ae20 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 >> v1:10.20.193.82:6789/0 conn(0x7fdd901852d0 legacy=0x7fdd90174f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 >> v1:10.20.193.57:6789/0 conn(0x7fdd9008cc80 legacy=0x7fdd900864b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 monclient: found mon.c 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9005e1f0 con 0x7fdd9008ae20 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient: _finish_auth 0 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd94ec3640 5 monclient: authenticate success, global_id 64166 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd94ec3640 10 monclient: _renew_subs 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd94ec3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd90088170 con 0x7fdd9008ae20 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd94ec3640 10 monclient: _renew_subs 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd94ec3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.084+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd90086bc0 con 0x7fdd9008ae20 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd840039f0 con 0x7fdd9008ae20 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd76ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:23.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdd84003d10 con 0x7fdd9008ae20 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd76ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd76ffd640 10 monclient: dump: 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.096 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd8cd72640 4 set_mon_vals no callback set 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fdd84003ee0 con 0x7fdd9008ae20 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd94ec3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(390..390 src has 202..390) ==== 3975+0+0 (unknown 2884364590 0 0) 0x7fdd8404ed90 con 0x7fdd9008ae20 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd94ec3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd94ec3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd900008d0 con 0x7fdd9008ae20 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.085+0000 7fdd8dd74640 10 monclient: get_auth_request con 0x7fdd5c03f660 auth_method 0 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.087+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fdd84017480 con 0x7fdd9008ae20 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.087+0000 7fdd76ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:23.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.087+0000 7fdd76ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:23.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.234+0000 7fdd94ec3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:36:23.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.234+0000 7fdd94ec3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:23.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.234+0000 7fdd94ec3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.234+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdd9008f520 con 0x7fdd9008ae20 2026-02-12T17:36:23.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.234+0000 7fdd76ffd640 1 -- 10.20.193.57:0/763605596 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 1513665976) 0x7fdd84016c30 con 0x7fdd9008ae20 2026-02-12T17:36:23.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.234+0000 7fdd76ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:36:23.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.234+0000 7fdd76ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:23.233 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":38,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:36:23.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.235+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 >> v1:10.20.193.82:6800/2441377515 conn(0x7fdd5c03f660 legacy=0x7fdd5c05fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.235+0000 7fdd94ec3640 10 monclient: shutdown 2026-02-12T17:36:23.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.235+0000 7fdd94ec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:23.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.235+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 >> v1:10.20.193.57:6790/0 conn(0x7fdd9008ae20 legacy=0x7fdd90152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.235+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 shutdown_connections 2026-02-12T17:36:23.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.235+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 >> 10.20.193.57:0/763605596 conn(0x7fdd90091620 msgr2=0x7fdd9007b150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:23.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.235+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 shutdown_connections 2026-02-12T17:36:23.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.235+0000 7fdd94ec3640 1 -- 10.20.193.57:0/763605596 wait complete. 2026-02-12T17:36:23.241 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:36:23.241 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-12T17:36:23.241 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:36:23.308 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.310+0000 7f0b7e8c3640 10 monclient: get_monmap_and_config 2026-02-12T17:36:23.308 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.310+0000 7f0b7e8c3640 10 monclient: build_initial_monmap 2026-02-12T17:36:23.308 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.310+0000 7f0b7e8c3640 10 monclient: monmap: 2026-02-12T17:36:23.308 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:23.308 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.308 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:23.311470+0000 2026-02-12T17:36:23.308 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:23.311470+0000 2026-02-12T17:36:23.309 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:23.309 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.309 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:23.309 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:23.309 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:23.309 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 1 Processor -- start 2026-02-12T17:36:23.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 1 -- start start 2026-02-12T17:36:23.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 10 monclient: init 2026-02-12T17:36:23.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:23.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:36:23.319 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 10 monclient(hunting): picked mon.noname-c con 0x7f0b78085720 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 10 monclient(hunting): picked mon.noname-b con 0x7f0b78086ea0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 10 monclient(hunting): picked mon.noname-a con 0x7f0b78086200 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b78088220 con 0x7f0b78086200 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b78089500 con 0x7f0b78085720 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b78087f40 con 0x7f0b78086ea0 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7e8c3640 10 monclient(hunting): authenticate will time out at 1063.130493s 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b7ce39640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f0b78086200 legacy=0x7f0b781a2180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b777fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0b78086ea0 0x7f0b78180a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42004/0 (socket says 10.20.193.57:42004) 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.311+0000 7f0b777fe640 1 -- 10.20.193.57:0/937211998 learned_addr learned my addr 10.20.193.57:0/937211998 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:23.320 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.313+0000 7f0b777fe640 1 -- 10.20.193.57:0/937211998 >> v1:10.20.193.57:6790/0 conn(0x7f0b78086ea0 legacy=0x7f0b78180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.313+0000 7f0b77fff640 1 -- 10.20.193.57:0/937211998 >> v1:10.20.193.82:6789/0 conn(0x7f0b78085720 legacy=0x7f0b78085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.313+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369797068 0 0) 0x7f0b78087f40 con 0x7f0b78086ea0 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.313+0000 7f0b76ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.313+0000 7f0b76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.313+0000 7f0b76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.313+0000 7f0b76ffd640 10 monclient(hunting): my global_id is 64169 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.313+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b5c0035e0 con 0x7f0b78086ea0 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687169580 0 0) 0x7f0b78089500 con 0x7f0b78085720 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.321 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient(hunting): my global_id is 4822 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b78087f40 con 0x7f0b78085720 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 510131250 0 0) 0x7f0b5c0035e0 con 0x7f0b78086ea0 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 >> v1:10.20.193.82:6789/0 conn(0x7f0b78085720 legacy=0x7f0b78085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 >> v1:10.20.193.57:6789/0 conn(0x7f0b78086200 legacy=0x7f0b781a2180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 monclient: found mon.noname-b 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b780867e0 con 0x7f0b78086ea0 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: _finish_auth 0 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:36:23.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0b680030d0 con 0x7f0b78086ea0 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: dump: 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.323 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 5 monclient: authenticate success, global_id 64169 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0b68003360 con 0x7f0b78086ea0 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 4 set_mon_vals no callback set 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 1 -- 10.20.193.57:0/937211998 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0b68004b10 con 0x7f0b78086ea0 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b76ffd640 10 monclient: dump: 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 10 monclient: shutdown 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/937211998 >> v1:10.20.193.57:6790/0 conn(0x7f0b78086ea0 legacy=0x7f0b78180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/937211998 shutdown_connections 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/937211998 >> 10.20.193.57:0/937211998 conn(0x7f0b780916b0 msgr2=0x7f0b78091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/937211998 shutdown_connections 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/937211998 wait complete. 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 10 monclient: build_initial_monmap 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.314+0000 7f0b7e8c3640 10 monclient: monmap: 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:23.326 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 1 Processor -- start 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 1 -- start start 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 10 monclient: init 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:23.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 10 monclient(hunting): picked mon.noname-c con 0x7f0b78085720 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 10 monclient(hunting): picked mon.noname-b con 0x7f0b78086200 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 10 monclient(hunting): picked mon.noname-a con 0x7f0b78086ea0 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b780888a0 con 0x7f0b78086ea0 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b7813f460 con 0x7f0b78086200 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b781da630 con 0x7f0b78085720 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7e8c3640 10 monclient(hunting): authenticate will time out at 1063.134524s 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b7ce39640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f0b78086ea0 legacy=0x7f0b7823bd80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b77fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0b78085720 0x7f0b781d9810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42018/0 (socket says 10.20.193.57:42018) 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.315+0000 7f0b77fff640 1 -- 10.20.193.57:0/3967252801 learned_addr learned my addr 10.20.193.57:0/3967252801 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:23.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b77fff640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.57:6790/0 conn(0x7f0b78085720 legacy=0x7f0b781d9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b777fe640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.82:6789/0 conn(0x7f0b78086200 legacy=0x7f0b781d9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248866992 0 0) 0x7f0b781da630 con 0x7f0b78085720 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 10 monclient(hunting): my global_id is 64172 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b480035e0 con 0x7f0b78085720 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743709320 0 0) 0x7f0b7813f460 con 0x7f0b78086200 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 10 monclient(hunting): my global_id is 4825 2026-02-12T17:36:23.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b781da630 con 0x7f0b78086200 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.317+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3953756367 0 0) 0x7f0b480035e0 con 0x7f0b78085720 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b7813f460 con 0x7f0b78085720 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0b64003450 con 0x7f0b78085720 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient(hunting): dump: 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.330 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2571347320 0 0) 0x7f0b7813f460 con 0x7f0b78085720 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b777fe640 1 --1- 10.20.193.57:0/3967252801 >> v1:10.20.193.82:6789/0 conn(0x7f0b78086200 0x7f0b781d9f20 :-1 s=OPENED pgs=429 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f0b781da630 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.82:6789/0 conn(0x7f0b78086200 legacy=0x7f0b781d9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.57:6789/0 conn(0x7f0b78086ea0 legacy=0x7f0b7823bd80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:36:23.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 monclient: found mon.c 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7808ada0 con 0x7f0b78085720 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient: _finish_auth 0 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0b680048a0 con 0x7f0b78086200 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b7e8c3640 5 monclient: authenticate success, global_id 64172 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b7e8c3640 10 monclient: _renew_subs 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b7e8c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7813d100 con 0x7f0b78085720 2026-02-12T17:36:23.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b7e8c3640 10 monclient: _renew_subs 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b7e8c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0b7813fb20 con 0x7f0b78085720 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0b64003b80 con 0x7f0b78085720 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0b64003750 con 0x7f0b78085720 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 10 monclient: dump: 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.333 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b767fc640 4 set_mon_vals no callback set 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b7e8c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0b7813f290 con 0x7f0b7805a610 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.318+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0b64003fc0 con 0x7f0b78085720 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.319+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(390..390 src has 202..390) ==== 3975+0+0 (unknown 2884364590 0 0) 0x7f0b6404ed20 con 0x7f0b78085720 2026-02-12T17:36:23.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.319+0000 7f0b7ce39640 10 monclient: get_auth_request con 0x7f0b4803f6a0 auth_method 0 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.320+0000 7f0b777fe640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.57:6790/0 conn(0x7f0b7805a610 legacy=0x7f0b7804d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.320+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233623585 0 0) 0x7f0b7813f290 con 0x7f0b7805a610 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.320+0000 7f0b74ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.320+0000 7f0b74ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.320+0000 7f0b74ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.320+0000 7f0b74ff9640 10 monclient(hunting): my global_id is 64175 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.320+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b7813f460 con 0x7f0b7805a610 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.320+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 242315414 0 0) 0x7f0b7813f460 con 0x7f0b7805a610 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b7813f290 con 0x7f0b7805a610 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0b68004bb0 con 0x7f0b7805a610 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 10 monclient: dump: 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 141660636 0 0) 0x7f0b7813f290 con 0x7f0b7805a610 2026-02-12T17:36:23.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b78087300 con 0x7f0b7805a610 2026-02-12T17:36:23.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0b68005320 con 0x7f0b7805a610 2026-02-12T17:36:23.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:23.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:23.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.57:6790/0 conn(0x7f0b7805a610 legacy=0x7f0b7804d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.321+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.57:6790/0 conn(0x7f0b7805a610 legacy=0x7f0b7804d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.324+0000 7f0b7e8c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:36:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.324+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0b7813fe20 con 0x7f0b7805a9e0 2026-02-12T17:36:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b777fe640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.57:6790/0 conn(0x7f0b7805a9e0 legacy=0x7f0b7825e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2936137118 0 0) 0x7f0b7813fe20 con 0x7f0b7805a9e0 2026-02-12T17:36:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 10 monclient(hunting): my global_id is 64178 2026-02-12T17:36:23.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b7813f290 con 0x7f0b7805a9e0 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3200350535 0 0) 0x7f0b7813f290 con 0x7f0b7805a9e0 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b7813fe20 con 0x7f0b7805a9e0 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0b68005940 con 0x7f0b7805a9e0 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 10 monclient: dump: 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.340 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3921551477 0 0) 0x7f0b7813fe20 con 0x7f0b7805a9e0 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.326+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0b78090810 con 0x7f0b7805a9e0 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4493 (unknown 0 0 744237337) 0x7f0b68007d90 con 0x7f0b7805a9e0 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b74ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b74ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.57:6790/0 conn(0x7f0b7805a9e0 legacy=0x7f0b7825e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b74ff9640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.57:6790/0 conn(0x7f0b7805a9e0 legacy=0x7f0b7825e4c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:23.342 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:36:23.342 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:23.342 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:23.342 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:36:23.342 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 38, 2026-02-12T17:36:23.342 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 16796, 2026-02-12T17:36:23.342 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:36:23.342 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:23.343 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:23.344 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:36:23.345 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:23.346 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.347 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:23.348 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:36:23.349 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.350 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:36:23.351 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:36:23.352 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:36:23.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.82:6800/2441377515 conn(0x7f0b4803f6a0 legacy=0x7f0b4805fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7e8c3640 10 monclient: shutdown 2026-02-12T17:36:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7e8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 >> v1:10.20.193.57:6790/0 conn(0x7f0b78085720 legacy=0x7f0b781d9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7ce39640 1 -- 10.20.193.57:0/3967252801 reap_dead start 2026-02-12T17:36:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7ce39640 1 -- 10.20.193.57:0/3967252801 reap_dead start 2026-02-12T17:36:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 shutdown_connections 2026-02-12T17:36:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 >> 10.20.193.57:0/3967252801 conn(0x7f0b780916b0 msgr2=0x7f0b78057d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 shutdown_connections 2026-02-12T17:36:23.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.327+0000 7f0b7e8c3640 1 -- 10.20.193.57:0/3967252801 wait complete. 2026-02-12T17:36:23.354 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:36:23.354 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:36:23.355 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:36:23.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient: get_monmap_and_config 2026-02-12T17:36:23.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient: build_initial_monmap 2026-02-12T17:36:23.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient: monmap: 2026-02-12T17:36:23.419 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:23.420 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.420 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:36:23.423087+0000 2026-02-12T17:36:23.420 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:36:23.423087+0000 2026-02-12T17:36:23.420 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:23.420 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.420 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:23.420 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:36:23.420 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:36:23.420 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 1 Processor -- start 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 1 -- start start 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient: init 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient(hunting): picked mon.noname-c con 0x7f6e4808c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient(hunting): picked mon.noname-a con 0x7f6e4808c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient(hunting): picked mon.noname-b con 0x7f6e48182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4808a820 con 0x7f6e4808c620 2026-02-12T17:36:23.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e48089450 con 0x7f6e4808c250 2026-02-12T17:36:23.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e48089730 con 0x7f6e48182cc0 2026-02-12T17:36:23.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:23.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4f647640 10 monclient(hunting): authenticate will time out at 1063.241972s 2026-02-12T17:36:23.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.422+0000 7f6e4cbbb640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f6e4808c620 legacy=0x7f6e4808caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:23.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.423+0000 7f6e4dbbd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f6e48182cc0 0x7f6e481a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42050/0 (socket says 10.20.193.57:42050) 2026-02-12T17:36:23.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.423+0000 7f6e4dbbd640 1 -- 10.20.193.57:0/3401558944 learned_addr learned my addr 10.20.193.57:0/3401558944 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:23.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.423+0000 7f6e4d3bc640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f6e4808c250 0x7f6e4808a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:35604/0 (socket says 10.20.193.57:35604) 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4dbbd640 1 -- 10.20.193.57:0/3401558944 >> v1:10.20.193.57:6790/0 conn(0x7f6e48182cc0 legacy=0x7f6e481a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4d3bc640 1 -- 10.20.193.57:0/3401558944 >> v1:10.20.193.82:6789/0 conn(0x7f6e4808c250 legacy=0x7f6e4808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518674428 0 0) 0x7f6e48089730 con 0x7f6e48182cc0 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient(hunting): my global_id is 64181 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e300035e0 con 0x7f6e48182cc0 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012728176 0 0) 0x7f6e48089450 con 0x7f6e4808c250 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient(hunting): my global_id is 4828 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e48089730 con 0x7f6e4808c250 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 332766074 0 0) 0x7f6e300035e0 con 0x7f6e48182cc0 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 >> v1:10.20.193.82:6789/0 conn(0x7f6e4808c250 legacy=0x7f6e4808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 >> v1:10.20.193.57:6789/0 conn(0x7f6e4808c620 legacy=0x7f6e4808caa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: _finish_hunting 0 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 monclient: found mon.noname-b 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e48089a10 con 0x7f6e48182cc0 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: _finish_auth 0 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: _check_auth_tickets 2026-02-12T17:36:23.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6e44004230 con 0x7f6e48182cc0 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: dump: 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.431 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4f647640 5 monclient: authenticate success, global_id 64181 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4f647640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e440044f0 con 0x7f6e48182cc0 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 1 -- 10.20.193.57:0/3401558944 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6e44005bf0 con 0x7f6e48182cc0 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4f647640 10 monclient: get_monmap_and_config success 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4f647640 4 set_mon_vals no callback set 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e37fff640 10 monclient: dump: 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.432 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4f647640 10 monclient: shutdown 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4f647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4f647640 1 -- 10.20.193.57:0/3401558944 >> v1:10.20.193.57:6790/0 conn(0x7f6e48182cc0 legacy=0x7f6e481a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4f647640 1 -- 10.20.193.57:0/3401558944 shutdown_connections 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.425+0000 7f6e4f647640 1 -- 10.20.193.57:0/3401558944 >> 10.20.193.57:0/3401558944 conn(0x7f6e480916b0 msgr2=0x7f6e48091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 1 -- 10.20.193.57:0/3401558944 shutdown_connections 2026-02-12T17:36:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 1 -- 10.20.193.57:0/3401558944 wait complete. 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient: build_initial_monmap 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient: monmap: 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 1 Processor -- start 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 1 -- start start 2026-02-12T17:36:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient: init 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient: _reopen_session rank -1 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient(hunting): picked mon.noname-a con 0x7f6e4808c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient(hunting): picked mon.noname-b con 0x7f6e4808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient(hunting): picked mon.noname-c con 0x7f6e48182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e481391d0 con 0x7f6e4808c250 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4d3bc640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f6e4808c250 legacy=0x7f6e48136780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e481375a0 con 0x7f6e4808c620 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4808ee50 con 0x7f6e48182cc0 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient(hunting): _renew_subs 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4f647640 10 monclient(hunting): authenticate will time out at 1063.245862s 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4dbbd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f6e48182cc0 0x7f6e48193320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:42054/0 (socket says 10.20.193.57:42054) 2026-02-12T17:36:23.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.426+0000 7f6e4dbbd640 1 -- 10.20.193.57:0/2819399189 learned_addr learned my addr 10.20.193.57:0/2819399189 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4dbbd640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.57:6790/0 conn(0x7f6e48182cc0 legacy=0x7f6e48193320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061315572 0 0) 0x7f6e4808ee50 con 0x7f6e48182cc0 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient(hunting): my global_id is 64184 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e180035e0 con 0x7f6e48182cc0 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3473161395 0 0) 0x7f6e180035e0 con 0x7f6e48182cc0 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e4808ee50 con 0x7f6e48182cc0 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6e44004230 con 0x7f6e48182cc0 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:36:23.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient(hunting): dump: 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4cbbb640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.82:6789/0 conn(0x7f6e4808c620 legacy=0x7f6e48136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1374624443 0 0) 0x7f6e4808ee50 con 0x7f6e48182cc0 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.82:6789/0 conn(0x7f6e4808c620 legacy=0x7f6e48136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.57:6789/0 conn(0x7f6e4808c250 legacy=0x7f6e48136780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 monclient: found mon.c 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4813eab0 con 0x7f6e48182cc0 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient: _finish_auth 0 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4f647640 5 monclient: authenticate success, global_id 64184 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4f647640 10 monclient: _renew_subs 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4f647640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e480888a0 con 0x7f6e48182cc0 2026-02-12T17:36:23.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4f647640 10 monclient: _renew_subs 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4f647640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e481379d0 con 0x7f6e48182cc0 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e440061d0 con 0x7f6e48182cc0 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6e440064f0 con 0x7f6e48182cc0 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e35ffb640 10 monclient: dump: 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.439 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e377fe640 4 set_mon_vals no callback set 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4f647640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.429+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6e48090810 con 0x7f6e4813ddb0 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.430+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f6e44013160 con 0x7f6e48182cc0 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.430+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(390..390 src has 202..390) ==== 3975+0+0 (unknown 2884364590 0 0) 0x7f6e4404fe60 con 0x7f6e48182cc0 2026-02-12T17:36:23.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.430+0000 7f6e4cbbb640 10 monclient: get_auth_request con 0x7f6e1803f680 auth_method 0 2026-02-12T17:36:23.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e4d3bc640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.82:6789/0 conn(0x7f6e4813ddb0 legacy=0x7f6e480582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859002663 0 0) 0x7f6e48090810 con 0x7f6e4813ddb0 2026-02-12T17:36:23.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 10 monclient(hunting): my global_id is 4834 2026-02-12T17:36:23.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e4808ee50 con 0x7f6e4813ddb0 2026-02-12T17:36:23.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1653212472 0 0) 0x7f6e4808ee50 con 0x7f6e4813ddb0 2026-02-12T17:36:23.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e48090810 con 0x7f6e4813ddb0 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6e38003220 con 0x7f6e4813ddb0 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.432+0000 7f6e35ffb640 10 monclient: dump: 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.444 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.433+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3393316610 0 0) 0x7f6e48090810 con 0x7f6e4813ddb0 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.433+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e48138b70 con 0x7f6e4813ddb0 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.433+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f6e380048a0 con 0x7f6e4813ddb0 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.433+0000 7f6e35ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.433+0000 7f6e35ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.433+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.82:6789/0 conn(0x7f6e4813ddb0 legacy=0x7f6e480582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.433+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.82:6789/0 conn(0x7f6e4813ddb0 legacy=0x7f6e480582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.436+0000 7f6e4f647640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.436+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6e4808f580 con 0x7f6e480589d0 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.438+0000 7f6e4d3bc640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.82:6789/0 conn(0x7f6e480589d0 legacy=0x7f6e48195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863619538 0 0) 0x7f6e4808f580 con 0x7f6e480589d0 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:36:23.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 10 monclient(hunting): my global_id is 4837 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e48090810 con 0x7f6e480589d0 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4139313879 0 0) 0x7f6e48090810 con 0x7f6e480589d0 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e4808f580 con 0x7f6e480589d0 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6e38004e60 con 0x7f6e480589d0 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 10 monclient: dump: 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:36:23.446 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 626341848 0 0) 0x7f6e4808f580 con 0x7f6e480589d0 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6e48055340 con 0x7f6e480589d0 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 3346246000) 0x7f6e380070e0 con 0x7f6e480589d0 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.82:6789/0 conn(0x7f6e480589d0 legacy=0x7f6e48195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.439+0000 7f6e35ffb640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.82:6789/0 conn(0x7f6e480589d0 legacy=0x7f6e48195a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 38, 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 504935, 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:23.448 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:23.449 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:23.450 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:36:23.451 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:36:23.452 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.453 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:36:23.454 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.455 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:36:23.456 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.457 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:36:23.458 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:36:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.82:6800/2441377515 conn(0x7f6e1803f680 legacy=0x7f6e1805fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4f647640 10 monclient: shutdown 2026-02-12T17:36:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4f647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:36:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 >> v1:10.20.193.57:6790/0 conn(0x7f6e48182cc0 legacy=0x7f6e48193320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:36:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4dbbd640 1 -- 10.20.193.57:0/2819399189 reap_dead start 2026-02-12T17:36:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4dbbd640 1 -- 10.20.193.57:0/2819399189 reap_dead start 2026-02-12T17:36:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 shutdown_connections 2026-02-12T17:36:23.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 >> 10.20.193.57:0/2819399189 conn(0x7f6e480916b0 msgr2=0x7f6e48089fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:36:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 shutdown_connections 2026-02-12T17:36:23.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:36:23.440+0000 7f6e4f647640 1 -- 10.20.193.57:0/2819399189 wait complete. 2026-02-12T17:36:23.460 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:36:23.460 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:36:24.082 INFO:tasks.rados.rados.0.trial082.stdout:1736: done (5 left) 2026-02-12T17:36:24.082 INFO:tasks.rados.rados.0.trial082.stdout:1737: done (4 left) 2026-02-12T17:36:24.082 INFO:tasks.rados.rados.0.trial082.stdout:1738: done (3 left) 2026-02-12T17:36:24.082 INFO:tasks.rados.rados.0.trial082.stdout:1739: done (2 left) 2026-02-12T17:36:24.082 INFO:tasks.rados.rados.0.trial082.stdout:1741: done (1 left) 2026-02-12T17:36:24.082 INFO:tasks.rados.rados.0.trial082.stdout:1742: done (0 left) 2026-02-12T17:36:24.083 INFO:tasks.rados.rados.0.trial082.stdout:1743: write oid 39 current snap is 187 2026-02-12T17:36:24.083 INFO:tasks.rados.rados.0.trial082.stdout:1743: seq_num 603 ranges {534621=567034,1636289=498332} 2026-02-12T17:36:24.086 INFO:tasks.rados.rados.0.trial082.stdout:1743: writing trial08226312-39 from 534621 to 1101655 tid 1 2026-02-12T17:36:24.090 INFO:tasks.rados.rados.0.trial082.stdout:1743: writing trial08226312-39 from 1636289 to 2134621 tid 2 2026-02-12T17:36:24.090 INFO:tasks.rados.rados.0.trial082.stdout:1744: snap_remove snap 181 2026-02-12T17:36:25.469 INFO:tasks.rados.rados.0.trial082.stdout:1744: done (1 left) 2026-02-12T17:36:25.469 INFO:tasks.rados.rados.0.trial082.stdout:1745: write oid 46 current snap is 187 2026-02-12T17:36:25.470 INFO:tasks.rados.rados.0.trial082.stdout:1745: seq_num 604 ranges {551428=642283,1694771=456657} 2026-02-12T17:36:25.474 INFO:tasks.rados.rados.0.trial082.stdout:1745: writing trial08226312-46 from 551428 to 1193711 tid 1 2026-02-12T17:36:25.478 INFO:tasks.rados.rados.0.trial082.stdout:1745: writing trial08226312-46 from 1694771 to 2151428 tid 2 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:1746: rollback oid 30 current snap is 187 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 180 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:1743: finishing write tid 1 to trial08226312-39 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:1743: finishing write tid 2 to trial08226312-39 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:1747: snap_create 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:1743: finishing write tid 3 to trial08226312-39 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:1743: finishing write tid 4 to trial08226312-39 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:1743: oid 39 updating version 0 to 332 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:1743: oid 39 version 332 is already newer than 331 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:1743: oid 39 version 332 is already newer than 330 2026-02-12T17:36:25.479 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 332 (ObjNum 603 snap 187 seq_num 603) dirty exists 2026-02-12T17:36:25.480 INFO:tasks.rados.rados.0.trial082.stdout:1743: left oid 39 (ObjNum 603 snap 187 seq_num 603) 2026-02-12T17:36:25.480 INFO:tasks.rados.rados.0.trial082.stdout:1746: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1092 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:1745: finishing write tid 1 to trial08226312-46 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:1745: finishing write tid 2 to trial08226312-46 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:1745: finishing write tid 3 to trial08226312-46 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:1745: finishing write tid 4 to trial08226312-46 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:1745: oid 46 updating version 0 to 1234 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:1745: oid 46 updating version 1234 to 1235 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:1745: oid 46 updating version 1235 to 1236 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1236 (ObjNum 604 snap 187 seq_num 604) dirty exists 2026-02-12T17:36:25.481 INFO:tasks.rados.rados.0.trial082.stdout:1745: left oid 46 (ObjNum 604 snap 187 seq_num 604) 2026-02-12T17:36:26.471 INFO:tasks.rados.rados.0.trial082.stdout:1743: done (3 left) 2026-02-12T17:36:26.471 INFO:tasks.rados.rados.0.trial082.stdout:1745: done (2 left) 2026-02-12T17:36:26.471 INFO:tasks.rados.rados.0.trial082.stdout:1746: done (1 left) 2026-02-12T17:36:26.472 INFO:tasks.rados.rados.0.trial082.stdout:1747: done (0 left) 2026-02-12T17:36:26.472 INFO:tasks.rados.rados.0.trial082.stdout:1748: write (excl) oid 36 current snap is 188 2026-02-12T17:36:26.472 INFO:tasks.rados.rados.0.trial082.stdout:1748: seq_num 605 ranges {568235=717532,1753253=414982} 2026-02-12T17:36:26.476 INFO:tasks.rados.rados.0.trial082.stdout:1748: writing trial08226312-36 from 568235 to 1285767 tid 1 2026-02-12T17:36:26.480 INFO:tasks.rados.rados.0.trial082.stdout:1748: writing trial08226312-36 from 1753253 to 2168235 tid 2 2026-02-12T17:36:26.480 INFO:tasks.rados.rados.0.trial082.stdout:1749: rollback oid 41 current snap is 188 2026-02-12T17:36:26.480 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 168 2026-02-12T17:36:26.480 INFO:tasks.rados.rados.0.trial082.stdout:1750: snap_remove snap 180 2026-02-12T17:36:27.474 INFO:tasks.rados.rados.0.trial082.stdout:1750: done (2 left) 2026-02-12T17:36:27.474 INFO:tasks.rados.rados.0.trial082.stdout:1751: delete oid 15 current snap is 188 2026-02-12T17:36:27.474 INFO:tasks.rados.rados.0.trial082.stdout:1748: finishing write tid 1 to trial08226312-36 2026-02-12T17:36:27.474 INFO:tasks.rados.rados.0.trial082.stdout:1748: finishing write tid 2 to trial08226312-36 2026-02-12T17:36:27.474 INFO:tasks.rados.rados.0.trial082.stdout:1748: finishing write tid 3 to trial08226312-36 2026-02-12T17:36:27.474 INFO:tasks.rados.rados.0.trial082.stdout:1748: finishing write tid 4 to trial08226312-36 2026-02-12T17:36:27.474 INFO:tasks.rados.rados.0.trial082.stdout:1748: oid 36 updating version 0 to 925 2026-02-12T17:36:27.475 INFO:tasks.rados.rados.0.trial082.stdout:1748: oid 36 updating version 925 to 926 2026-02-12T17:36:27.475 INFO:tasks.rados.rados.0.trial082.stdout:1748: oid 36 version 926 is already newer than 924 2026-02-12T17:36:27.475 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 926 (ObjNum 605 snap 188 seq_num 605) dirty exists 2026-02-12T17:36:27.475 INFO:tasks.rados.rados.0.trial082.stdout:1748: left oid 36 (ObjNum 605 snap 188 seq_num 605) 2026-02-12T17:36:27.475 INFO:tasks.rados.rados.0.trial082.stdout:1749: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:36:27.475 INFO:tasks.rados.rados.0.trial082.stdout:1749: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:36:27.475 INFO:tasks.rados.rados.0.trial082.stdout:1749: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:36:27.475 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1082 (ObjNum 514 snap 156 seq_num 514) dirty exists 2026-02-12T17:36:27.478 INFO:tasks.rados.rados.0.trial082.stdout:1748: done (2 left) 2026-02-12T17:36:27.478 INFO:tasks.rados.rados.0.trial082.stdout:1749: done (1 left) 2026-02-12T17:36:27.478 INFO:tasks.rados.rados.0.trial082.stdout:1751: done (0 left) 2026-02-12T17:36:27.478 INFO:tasks.rados.rados.0.trial082.stdout:1752: rollback oid 46 current snap is 188 2026-02-12T17:36:27.478 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 46 to 177 2026-02-12T17:36:27.478 INFO:tasks.rados.rados.0.trial082.stdout:1753: read oid 9 snap -1 2026-02-12T17:36:27.478 INFO:tasks.rados.rados.0.trial082.stdout:1753: expect deleted 2026-02-12T17:36:27.479 INFO:tasks.rados.rados.0.trial082.stdout:1754: copy_from oid 17 from oid 29 current snap is 188 2026-02-12T17:36:27.479 INFO:tasks.rados.rados.0.trial082.stdout:1755: rollback oid 38 current snap is 188 2026-02-12T17:36:27.479 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 148 2026-02-12T17:36:27.479 INFO:tasks.rados.rados.0.trial082.stdout:1756: delete oid 25 current snap is 188 2026-02-12T17:36:27.480 INFO:tasks.rados.rados.0.trial082.stdout:1752: finishing rollback tid 0 to trial08226312-46 2026-02-12T17:36:27.480 INFO:tasks.rados.rados.0.trial082.stdout:1752: finishing rollback tid 1 to trial08226312-46 2026-02-12T17:36:27.480 INFO:tasks.rados.rados.0.trial082.stdout:1753: done (4 left) 2026-02-12T17:36:27.480 INFO:tasks.rados.rados.0.trial082.stdout:1756: done (3 left) 2026-02-12T17:36:27.480 INFO:tasks.rados.rados.0.trial082.stdout:1757: write oid 14 current snap is 188 2026-02-12T17:36:27.480 INFO:tasks.rados.rados.0.trial082.stdout:1757: seq_num 608 ranges {618656=543279,1812346=406310} 2026-02-12T17:36:27.484 INFO:tasks.rados.rados.0.trial082.stdout:1757: writing trial08226312-14 from 618656 to 1161935 tid 1 2026-02-12T17:36:27.488 INFO:tasks.rados.rados.0.trial082.stdout:1757: writing trial08226312-14 from 1812346 to 2218656 tid 2 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:1758: write oid 3 current snap is 188 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:1752: finishing rollback tid 2 to trial08226312-46 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1239 (ObjNum 546 snap 167 seq_num 546) dirty exists 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:1755: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:1755: finishing rollback tid 2 to trial08226312-38 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 824 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:1754: finishing copy_from racing read to trial08226312-17 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:1754: finishing copy_from to trial08226312-17 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 692 (ObjNum 546 snap 167 seq_num 546) dirty exists 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:1757: finishing write tid 1 to trial08226312-14 2026-02-12T17:36:27.489 INFO:tasks.rados.rados.0.trial082.stdout:1758: seq_num 609 ranges {635463=734881,1987181=248282} 2026-02-12T17:36:27.493 INFO:tasks.rados.rados.0.trial082.stdout:1758: writing trial08226312-3 from 635463 to 1370344 tid 1 2026-02-12T17:36:27.497 INFO:tasks.rados.rados.0.trial082.stdout:1758: writing trial08226312-3 from 1987181 to 2235463 tid 2 2026-02-12T17:36:27.497 INFO:tasks.rados.rados.0.trial082.stdout:1752: done (4 left) 2026-02-12T17:36:27.497 INFO:tasks.rados.rados.0.trial082.stdout:1754: done (3 left) 2026-02-12T17:36:27.497 INFO:tasks.rados.rados.0.trial082.stdout:1755: done (2 left) 2026-02-12T17:36:27.497 INFO:tasks.rados.rados.0.trial082.stdout:1759: write oid 36 current snap is 188 2026-02-12T17:36:27.497 INFO:tasks.rados.rados.0.trial082.stdout:1759: seq_num 610 ranges {652270=410130,1529310=493867} 2026-02-12T17:36:27.500 INFO:tasks.rados.rados.0.trial082.stdout:1759: writing trial08226312-36 from 652270 to 1062400 tid 1 2026-02-12T17:36:27.505 INFO:tasks.rados.rados.0.trial082.stdout:1759: writing trial08226312-36 from 1529310 to 2023177 tid 2 2026-02-12T17:36:27.505 INFO:tasks.rados.rados.0.trial082.stdout:1760: rollback oid 49 current snap is 188 2026-02-12T17:36:27.505 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 170 2026-02-12T17:36:27.505 INFO:tasks.rados.rados.0.trial082.stdout:1757: finishing write tid 2 to trial08226312-14 2026-02-12T17:36:27.505 INFO:tasks.rados.rados.0.trial082.stdout:1757: finishing write tid 3 to trial08226312-14 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1757: finishing write tid 4 to trial08226312-14 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1757: oid 14 updating version 0 to 881 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1757: oid 14 updating version 881 to 882 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1757: oid 14 version 882 is already newer than 880 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 882 (ObjNum 608 snap 188 seq_num 608) dirty exists 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1757: left oid 14 (ObjNum 608 snap 188 seq_num 608) 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1758: finishing write tid 1 to trial08226312-3 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1758: finishing write tid 2 to trial08226312-3 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1758: finishing write tid 3 to trial08226312-3 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1757: done (3 left) 2026-02-12T17:36:27.506 INFO:tasks.rados.rados.0.trial082.stdout:1761: copy_from oid 21 from oid 9 current snap is 188 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1758: finishing write tid 4 to trial08226312-3 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1758: oid 3 updating version 0 to 883 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1758: oid 3 updating version 883 to 885 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1758: oid 3 version 885 is already newer than 884 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 885 (ObjNum 609 snap 188 seq_num 609) dirty exists 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1758: left oid 3 (ObjNum 609 snap 188 seq_num 609) 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1758: done (3 left) 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1762: copy_from oid 27 from oid 29 current snap is 188 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1759: finishing write tid 1 to trial08226312-36 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1763: read oid 7 snap 148 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1763: expect (ObjNum 468 snap 146 seq_num 468) 2026-02-12T17:36:27.507 INFO:tasks.rados.rados.0.trial082.stdout:1764: snap_create 2026-02-12T17:36:27.509 INFO:tasks.rados.rados.0.trial082.stdout:1759: finishing write tid 2 to trial08226312-36 2026-02-12T17:36:27.509 INFO:tasks.rados.rados.0.trial082.stdout:1759: finishing write tid 3 to trial08226312-36 2026-02-12T17:36:27.509 INFO:tasks.rados.rados.0.trial082.stdout:1759: finishing write tid 4 to trial08226312-36 2026-02-12T17:36:27.509 INFO:tasks.rados.rados.0.trial082.stdout:1759: oid 36 updating version 0 to 931 2026-02-12T17:36:27.509 INFO:tasks.rados.rados.0.trial082.stdout:1759: oid 36 updating version 931 to 933 2026-02-12T17:36:27.509 INFO:tasks.rados.rados.0.trial082.stdout:1759: oid 36 version 933 is already newer than 932 2026-02-12T17:36:27.509 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 933 (ObjNum 610 snap 188 seq_num 610) dirty exists 2026-02-12T17:36:27.510 INFO:tasks.rados.rados.0.trial082.stdout:1759: left oid 36 (ObjNum 610 snap 188 seq_num 610) 2026-02-12T17:36:27.510 INFO:tasks.rados.rados.0.trial082.stdout:1760: finishing rollback tid 0 to trial08226312-49 2026-02-12T17:36:27.510 INFO:tasks.rados.rados.0.trial082.stdout:1760: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:36:27.510 INFO:tasks.rados.rados.0.trial082.stdout:1760: finishing rollback tid 2 to trial08226312-49 2026-02-12T17:36:27.510 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 854 (ObjNum 517 snap 157 seq_num 517) dirty exists 2026-02-12T17:36:27.510 INFO:tasks.rados.rados.0.trial082.stdout:1762: finishing copy_from racing read to trial08226312-27 2026-02-12T17:36:27.510 INFO:tasks.rados.rados.0.trial082.stdout:1761: finishing copy_from to trial08226312-21 2026-02-12T17:36:27.510 INFO:tasks.rados.rados.0.trial082.stdout:1761: got expected ENOENT (src dne) 2026-02-12T17:36:27.510 INFO:tasks.rados.rados.0.trial082.stdout:1761: finishing copy_from racing read to trial08226312-21 2026-02-12T17:36:27.511 INFO:tasks.rados.rados.0.trial082.stdout:1763: expect (ObjNum 468 snap 146 seq_num 468) 2026-02-12T17:36:27.540 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 736401 2026-02-12T17:36:27.582 INFO:tasks.rados.rados.0.trial082.stdout:1762: finishing copy_from to trial08226312-27 2026-02-12T17:36:27.582 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 692 (ObjNum 546 snap 167 seq_num 546) dirty exists 2026-02-12T17:36:28.055 INFO:tasks.rados.rados.0.trial082.stdout:1759: done (5 left) 2026-02-12T17:36:28.055 INFO:tasks.rados.rados.0.trial082.stdout:1760: done (4 left) 2026-02-12T17:36:28.055 INFO:tasks.rados.rados.0.trial082.stdout:1761: done (3 left) 2026-02-12T17:36:28.055 INFO:tasks.rados.rados.0.trial082.stdout:1762: done (2 left) 2026-02-12T17:36:28.055 INFO:tasks.rados.rados.0.trial082.stdout:1763: done (1 left) 2026-02-12T17:36:28.055 INFO:tasks.rados.rados.0.trial082.stdout:1764: done (0 left) 2026-02-12T17:36:28.056 INFO:tasks.rados.rados.0.trial082.stdout:1765: read oid 40 snap -1 2026-02-12T17:36:28.056 INFO:tasks.rados.rados.0.trial082.stdout:1765: expect (ObjNum 578 snap 176 seq_num 578) 2026-02-12T17:36:28.056 INFO:tasks.rados.rados.0.trial082.stdout:1766: read oid 1 snap -1 2026-02-12T17:36:28.056 INFO:tasks.rados.rados.0.trial082.stdout:1766: expect (ObjNum 571 snap 176 seq_num 571) 2026-02-12T17:36:28.056 INFO:tasks.rados.rados.0.trial082.stdout:1767: rollback oid 39 current snap is 189 2026-02-12T17:36:28.056 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 39 to 187 2026-02-12T17:36:28.056 INFO:tasks.rados.rados.0.trial082.stdout:1768: snap_remove snap 185 2026-02-12T17:36:29.054 INFO:tasks.rados.rados.0.trial082.stdout:1768: done (3 left) 2026-02-12T17:36:29.054 INFO:tasks.rados.rados.0.trial082.stdout:1769: write oid 18 current snap is 189 2026-02-12T17:36:29.054 INFO:tasks.rados.rados.0.trial082.stdout:1769: seq_num 611 ranges {669077=485379,1587792=681285} 2026-02-12T17:36:29.059 INFO:tasks.rados.rados.0.trial082.stdout:1769: writing trial08226312-18 from 669077 to 1154456 tid 1 2026-02-12T17:36:29.063 INFO:tasks.rados.rados.0.trial082.stdout:1769: writing trial08226312-18 from 1587792 to 2269077 tid 2 2026-02-12T17:36:29.063 INFO:tasks.rados.rados.0.trial082.stdout:1767: finishing rollback tid 0 to trial08226312-39 2026-02-12T17:36:29.063 INFO:tasks.rados.rados.0.trial082.stdout:1767: finishing rollback tid 1 to trial08226312-39 2026-02-12T17:36:29.063 INFO:tasks.rados.rados.0.trial082.stdout:1766: expect (ObjNum 571 snap 176 seq_num 571) 2026-02-12T17:36:29.090 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:29.158 INFO:tasks.rados.rados.0.trial082.stdout:1767: finishing rollback tid 2 to trial08226312-39 2026-02-12T17:36:29.158 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 340 (ObjNum 603 snap 187 seq_num 603) dirty exists 2026-02-12T17:36:29.158 INFO:tasks.rados.rados.0.trial082.stdout:1765: expect (ObjNum 578 snap 176 seq_num 578) 2026-02-12T17:36:29.158 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:29.267 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2128131 2026-02-12T17:36:29.290 INFO:tasks.rados.rados.0.trial082.stdout:1769: finishing write tid 1 to trial08226312-18 2026-02-12T17:36:29.290 INFO:tasks.rados.rados.0.trial082.stdout:1770: read oid 28 snap 168 2026-02-12T17:36:29.290 INFO:tasks.rados.rados.0.trial082.stdout:1770: expect (ObjNum 537 snap 163 seq_num 537) 2026-02-12T17:36:29.290 INFO:tasks.rados.rados.0.trial082.stdout:1765: done (4 left) 2026-02-12T17:36:29.290 INFO:tasks.rados.rados.0.trial082.stdout:1766: done (3 left) 2026-02-12T17:36:29.290 INFO:tasks.rados.rados.0.trial082.stdout:1767: done (2 left) 2026-02-12T17:36:29.290 INFO:tasks.rados.rados.0.trial082.stdout:1771: snap_remove snap 148 2026-02-12T17:36:30.055 INFO:tasks.rados.rados.0.trial082.stdout:1771: done (2 left) 2026-02-12T17:36:30.056 INFO:tasks.rados.rados.0.trial082.stdout:1772: delete oid 12 current snap is 189 2026-02-12T17:36:30.056 INFO:tasks.rados.rados.0.trial082.stdout:1769: finishing write tid 2 to trial08226312-18 2026-02-12T17:36:30.056 INFO:tasks.rados.rados.0.trial082.stdout:1769: finishing write tid 3 to trial08226312-18 2026-02-12T17:36:30.056 INFO:tasks.rados.rados.0.trial082.stdout:1769: finishing write tid 4 to trial08226312-18 2026-02-12T17:36:30.056 INFO:tasks.rados.rados.0.trial082.stdout:1769: oid 18 updating version 0 to 856 2026-02-12T17:36:30.056 INFO:tasks.rados.rados.0.trial082.stdout:1769: oid 18 version 856 is already newer than 855 2026-02-12T17:36:30.056 INFO:tasks.rados.rados.0.trial082.stdout:1769: oid 18 updating version 856 to 857 2026-02-12T17:36:30.057 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 857 (ObjNum 611 snap 189 seq_num 611) dirty exists 2026-02-12T17:36:30.057 INFO:tasks.rados.rados.0.trial082.stdout:1769: left oid 18 (ObjNum 611 snap 189 seq_num 611) 2026-02-12T17:36:30.057 INFO:tasks.rados.rados.0.trial082.stdout:1770: expect (ObjNum 537 snap 163 seq_num 537) 2026-02-12T17:36:30.057 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:30.078 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:30.116 INFO:tasks.rados.rados.0.trial082.stdout:1769: done (2 left) 2026-02-12T17:36:30.116 INFO:tasks.rados.rados.0.trial082.stdout:1770: done (1 left) 2026-02-12T17:36:30.116 INFO:tasks.rados.rados.0.trial082.stdout:1772: done (0 left) 2026-02-12T17:36:30.116 INFO:tasks.rados.rados.0.trial082.stdout:1773: read oid 37 snap 183 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1773: expect (ObjNum 555 snap 169 seq_num 555) 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1774: copy_from oid 4 from oid 45 current snap is 189 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1775: copy_from oid 42 from oid 6 current snap is 189 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1776: delete oid 18 current snap is 189 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1775: finishing copy_from to trial08226312-42 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1775: got expected ENOENT (src dne) 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1775: finishing copy_from racing read to trial08226312-42 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1775: done (3 left) 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1776: done (2 left) 2026-02-12T17:36:30.117 INFO:tasks.rados.rados.0.trial082.stdout:1777: write (excl) oid 12 current snap is 189 2026-02-12T17:36:30.118 INFO:tasks.rados.rados.0.trial082.stdout:1777: seq_num 614 ranges {719498=711126,2046885=272613} 2026-02-12T17:36:30.122 INFO:tasks.rados.rados.0.trial082.stdout:1777: writing trial08226312-12 from 719498 to 1430624 tid 1 2026-02-12T17:36:30.126 INFO:tasks.rados.rados.0.trial082.stdout:1777: writing trial08226312-12 from 2046885 to 2319498 tid 2 2026-02-12T17:36:30.126 INFO:tasks.rados.rados.0.trial082.stdout:1778: delete oid 32 current snap is 189 2026-02-12T17:36:30.126 INFO:tasks.rados.rados.0.trial082.stdout:1773: expect (ObjNum 555 snap 169 seq_num 555) 2026-02-12T17:36:30.134 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 991231 2026-02-12T17:36:30.176 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 633383 2026-02-12T17:36:30.255 INFO:tasks.rados.rados.0.trial082.stdout:1774: finishing copy_from racing read to trial08226312-4 2026-02-12T17:36:30.255 INFO:tasks.rados.rados.0.trial082.stdout:1773: done (3 left) 2026-02-12T17:36:30.255 INFO:tasks.rados.rados.0.trial082.stdout:1778: done (2 left) 2026-02-12T17:36:30.255 INFO:tasks.rados.rados.0.trial082.stdout:1779: write (excl) oid 28 current snap is 189 2026-02-12T17:36:30.255 INFO:tasks.rados.rados.0.trial082.stdout:1774: finishing copy_from to trial08226312-4 2026-02-12T17:36:30.256 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 870 (ObjNum 572 snap 176 seq_num 572) dirty exists 2026-02-12T17:36:30.256 INFO:tasks.rados.rados.0.trial082.stdout:1777: finishing write tid 1 to trial08226312-12 2026-02-12T17:36:30.256 INFO:tasks.rados.rados.0.trial082.stdout:1777: finishing write tid 2 to trial08226312-12 2026-02-12T17:36:30.256 INFO:tasks.rados.rados.0.trial082.stdout:1779: seq_num 616 ranges {753112=577977,1880202=472910} 2026-02-12T17:36:30.260 INFO:tasks.rados.rados.0.trial082.stdout:1779: writing trial08226312-28 from 753112 to 1331089 tid 1 2026-02-12T17:36:30.264 INFO:tasks.rados.rados.0.trial082.stdout:1779: writing trial08226312-28 from 1880202 to 2353112 tid 2 2026-02-12T17:36:30.264 INFO:tasks.rados.rados.0.trial082.stdout:1774: done (2 left) 2026-02-12T17:36:30.264 INFO:tasks.rados.rados.0.trial082.stdout:1780: snap_remove snap 187 2026-02-12T17:36:31.068 INFO:tasks.rados.rados.0.trial082.stdout:1780: done (2 left) 2026-02-12T17:36:31.068 INFO:tasks.rados.rados.0.trial082.stdout:1781: rollback oid 22 current snap is 189 2026-02-12T17:36:31.068 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 168 2026-02-12T17:36:31.068 INFO:tasks.rados.rados.0.trial082.stdout:1777: finishing write tid 3 to trial08226312-12 2026-02-12T17:36:31.068 INFO:tasks.rados.rados.0.trial082.stdout:1777: finishing write tid 4 to trial08226312-12 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1777: oid 12 updating version 0 to 1084 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1777: oid 12 updating version 1084 to 1086 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1777: oid 12 version 1086 is already newer than 1085 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1086 (ObjNum 614 snap 189 seq_num 614) dirty exists 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1777: left oid 12 (ObjNum 614 snap 189 seq_num 614) 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1779: finishing write tid 1 to trial08226312-28 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1779: finishing write tid 2 to trial08226312-28 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1779: finishing write tid 3 to trial08226312-28 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1779: finishing write tid 4 to trial08226312-28 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1779: oid 28 updating version 0 to 1088 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1779: oid 28 updating version 1088 to 1089 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:1779: oid 28 version 1089 is already newer than 1087 2026-02-12T17:36:31.069 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1089 (ObjNum 616 snap 189 seq_num 616) dirty exists 2026-02-12T17:36:31.070 INFO:tasks.rados.rados.0.trial082.stdout:1779: left oid 28 (ObjNum 616 snap 189 seq_num 616) 2026-02-12T17:36:31.070 INFO:tasks.rados.rados.0.trial082.stdout:1777: done (2 left) 2026-02-12T17:36:31.070 INFO:tasks.rados.rados.0.trial082.stdout:1779: done (1 left) 2026-02-12T17:36:31.070 INFO:tasks.rados.rados.0.trial082.stdout:1782: rollback oid 46 current snap is 189 2026-02-12T17:36:31.070 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 46 to 183 2026-02-12T17:36:31.070 INFO:tasks.rados.rados.0.trial082.stdout:1783: read oid 11 snap 176 2026-02-12T17:36:31.070 INFO:tasks.rados.rados.0.trial082.stdout:1783: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:36:31.070 INFO:tasks.rados.rados.0.trial082.stdout:1784: write oid 50 current snap is 189 2026-02-12T17:36:31.070 INFO:tasks.rados.rados.0.trial082.stdout:1784: seq_num 617 ranges {769919=653226,1938684=431235} 2026-02-12T17:36:31.072 INFO:tasks.rados.rados.0.trial082.stdout:1784: writing trial08226312-50 from 769919 to 1423145 tid 1 2026-02-12T17:36:31.076 INFO:tasks.rados.rados.0.trial082.stdout:1784: writing trial08226312-50 from 1938684 to 2369919 tid 2 2026-02-12T17:36:31.076 INFO:tasks.rados.rados.0.trial082.stdout:1785: snap_remove snap 186 2026-02-12T17:36:32.070 INFO:tasks.rados.rados.0.trial082.stdout:1785: done (4 left) 2026-02-12T17:36:32.070 INFO:tasks.rados.rados.0.trial082.stdout:1786: read oid 2 snap -1 2026-02-12T17:36:32.070 INFO:tasks.rados.rados.0.trial082.stdout:1786: expect (ObjNum 511 snap 156 seq_num 511) 2026-02-12T17:36:32.070 INFO:tasks.rados.rados.0.trial082.stdout:1787: snap_remove snap 177 2026-02-12T17:36:33.054 INFO:tasks.rados.rados.0.trial082.stdout:1787: done (5 left) 2026-02-12T17:36:33.054 INFO:tasks.rados.rados.0.trial082.stdout:1788: copy_from oid 43 from oid 49 current snap is 189 2026-02-12T17:36:33.054 INFO:tasks.rados.rados.0.trial082.stdout:1781: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:36:33.055 INFO:tasks.rados.rados.0.trial082.stdout:1781: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:36:33.055 INFO:tasks.rados.rados.0.trial082.stdout:1781: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:36:33.055 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 1095 (ObjNum 532 snap 163 seq_num 532) dirty exists 2026-02-12T17:36:33.055 INFO:tasks.rados.rados.0.trial082.stdout:1782: finishing rollback tid 0 to trial08226312-46 2026-02-12T17:36:33.055 INFO:tasks.rados.rados.0.trial082.stdout:1782: finishing rollback tid 1 to trial08226312-46 2026-02-12T17:36:33.055 INFO:tasks.rados.rados.0.trial082.stdout:1782: finishing rollback tid 2 to trial08226312-46 2026-02-12T17:36:33.055 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1242 (ObjNum 546 snap 167 seq_num 546) dirty exists 2026-02-12T17:36:33.055 INFO:tasks.rados.rados.0.trial082.stdout:1783: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:36:33.089 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2216844 2026-02-12T17:36:33.135 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:33.180 INFO:tasks.rados.rados.0.trial082.stdout:1784: finishing write tid 1 to trial08226312-50 2026-02-12T17:36:33.180 INFO:tasks.rados.rados.0.trial082.stdout:1781: done (5 left) 2026-02-12T17:36:33.180 INFO:tasks.rados.rados.0.trial082.stdout:1782: done (4 left) 2026-02-12T17:36:33.180 INFO:tasks.rados.rados.0.trial082.stdout:1783: done (3 left) 2026-02-12T17:36:33.181 INFO:tasks.rados.rados.0.trial082.stdout:1789: snap_remove snap 183 2026-02-12T17:36:34.073 INFO:tasks.rados.rados.0.trial082.stdout:1789: done (3 left) 2026-02-12T17:36:34.074 INFO:tasks.rados.rados.0.trial082.stdout:1790: read oid 41 snap -1 2026-02-12T17:36:34.074 INFO:tasks.rados.rados.0.trial082.stdout:1790: expect (ObjNum 514 snap 156 seq_num 514) 2026-02-12T17:36:34.074 INFO:tasks.rados.rados.0.trial082.stdout:1791: snap_create 2026-02-12T17:36:34.074 INFO:tasks.rados.rados.0.trial082.stdout:1784: finishing write tid 2 to trial08226312-50 2026-02-12T17:36:34.074 INFO:tasks.rados.rados.0.trial082.stdout:1784: finishing write tid 3 to trial08226312-50 2026-02-12T17:36:34.074 INFO:tasks.rados.rados.0.trial082.stdout:1784: finishing write tid 4 to trial08226312-50 2026-02-12T17:36:34.074 INFO:tasks.rados.rados.0.trial082.stdout:1784: oid 50 updating version 0 to 693 2026-02-12T17:36:34.074 INFO:tasks.rados.rados.0.trial082.stdout:1784: oid 50 updating version 693 to 695 2026-02-12T17:36:34.074 INFO:tasks.rados.rados.0.trial082.stdout:1784: oid 50 version 695 is already newer than 694 2026-02-12T17:36:34.075 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 695 (ObjNum 617 snap 189 seq_num 617) dirty exists 2026-02-12T17:36:34.075 INFO:tasks.rados.rados.0.trial082.stdout:1784: left oid 50 (ObjNum 617 snap 189 seq_num 617) 2026-02-12T17:36:34.075 INFO:tasks.rados.rados.0.trial082.stdout:1786: expect (ObjNum 511 snap 156 seq_num 511) 2026-02-12T17:36:34.118 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1344445 2026-02-12T17:36:34.173 INFO:tasks.rados.rados.0.trial082.stdout:1788: finishing copy_from racing read to trial08226312-43 2026-02-12T17:36:34.173 INFO:tasks.rados.rados.0.trial082.stdout:1788: finishing copy_from to trial08226312-43 2026-02-12T17:36:34.173 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 854 (ObjNum 517 snap 157 seq_num 517) dirty exists 2026-02-12T17:36:34.173 INFO:tasks.rados.rados.0.trial082.stdout:1790: expect (ObjNum 514 snap 156 seq_num 514) 2026-02-12T17:36:34.193 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2467237 2026-02-12T17:36:35.074 INFO:tasks.rados.rados.0.trial082.stdout:1784: done (4 left) 2026-02-12T17:36:35.074 INFO:tasks.rados.rados.0.trial082.stdout:1786: done (3 left) 2026-02-12T17:36:35.074 INFO:tasks.rados.rados.0.trial082.stdout:1788: done (2 left) 2026-02-12T17:36:35.075 INFO:tasks.rados.rados.0.trial082.stdout:1790: done (1 left) 2026-02-12T17:36:35.075 INFO:tasks.rados.rados.0.trial082.stdout:1791: done (0 left) 2026-02-12T17:36:35.075 INFO:tasks.rados.rados.0.trial082.stdout:1792: read oid 14 snap -1 2026-02-12T17:36:35.075 INFO:tasks.rados.rados.0.trial082.stdout:1792: expect (ObjNum 608 snap 188 seq_num 608) 2026-02-12T17:36:35.075 INFO:tasks.rados.rados.0.trial082.stdout:1793: write oid 44 current snap is 190 2026-02-12T17:36:35.075 INFO:tasks.rados.rados.0.trial082.stdout:1793: seq_num 618 ranges {786726=728475,2280813=105913} 2026-02-12T17:36:35.079 INFO:tasks.rados.rados.0.trial082.stdout:1793: writing trial08226312-44 from 786726 to 1515201 tid 1 2026-02-12T17:36:35.083 INFO:tasks.rados.rados.0.trial082.stdout:1793: writing trial08226312-44 from 2280813 to 2386726 tid 2 2026-02-12T17:36:35.083 INFO:tasks.rados.rados.0.trial082.stdout:1794: rollback oid 38 current snap is 190 2026-02-12T17:36:35.083 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 189 2026-02-12T17:36:35.083 INFO:tasks.rados.rados.0.trial082.stdout:1792: expect (ObjNum 608 snap 188 seq_num 608) 2026-02-12T17:36:35.083 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:35.165 INFO:tasks.rados.rados.0.trial082.stdout:1793: finishing write tid 1 to trial08226312-44 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:1793: finishing write tid 2 to trial08226312-44 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:1793: finishing write tid 3 to trial08226312-44 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:1793: finishing write tid 4 to trial08226312-44 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:1793: oid 44 updating version 0 to 963 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:1793: oid 44 updating version 963 to 965 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:1793: oid 44 version 965 is already newer than 964 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 965 (ObjNum 618 snap 190 seq_num 618) dirty exists 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:1793: left oid 44 (ObjNum 618 snap 190 seq_num 618) 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:1794: finishing rollback tid 0 to trial08226312-38 2026-02-12T17:36:35.166 INFO:tasks.rados.rados.0.trial082.stdout:1794: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1794: finishing rollback tid 2 to trial08226312-38 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 828 (ObjNum 395 snap 116 seq_num 395) dirty exists 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1792: done (2 left) 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1793: done (1 left) 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1794: done (0 left) 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1795: rollback oid 40 current snap is 190 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 40 to 170 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1796: read oid 50 snap -1 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1796: expect (ObjNum 617 snap 189 seq_num 617) 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1797: copy_from oid 37 from oid 2 current snap is 190 2026-02-12T17:36:35.167 INFO:tasks.rados.rados.0.trial082.stdout:1798: delete oid 45 current snap is 190 2026-02-12T17:36:35.168 INFO:tasks.rados.rados.0.trial082.stdout:1798: done (3 left) 2026-02-12T17:36:35.168 INFO:tasks.rados.rados.0.trial082.stdout:1799: snap_remove snap 188 2026-02-12T17:36:36.079 INFO:tasks.rados.rados.0.trial082.stdout:1799: done (3 left) 2026-02-12T17:36:36.079 INFO:tasks.rados.rados.0.trial082.stdout:1800: snap_remove snap 189 2026-02-12T17:36:37.080 INFO:tasks.rados.rados.0.trial082.stdout:1800: done (3 left) 2026-02-12T17:36:37.080 INFO:tasks.rados.rados.0.trial082.stdout:1801: snap_remove snap 176 2026-02-12T17:36:38.055 INFO:tasks.rados.rados.0.trial082.stdout:1801: done (3 left) 2026-02-12T17:36:38.055 INFO:tasks.rados.rados.0.trial082.stdout:1802: delete oid 4 current snap is 190 2026-02-12T17:36:38.055 INFO:tasks.rados.rados.0.trial082.stdout:1795: finishing rollback tid 0 to trial08226312-40 2026-02-12T17:36:38.055 INFO:tasks.rados.rados.0.trial082.stdout:1795: finishing rollback tid 1 to trial08226312-40 2026-02-12T17:36:38.055 INFO:tasks.rados.rados.0.trial082.stdout:1795: finishing rollback tid 2 to trial08226312-40 2026-02-12T17:36:38.055 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1104 (ObjNum 460 snap 143 seq_num 460) dirty exists 2026-02-12T17:36:38.055 INFO:tasks.rados.rados.0.trial082.stdout:1796: expect (ObjNum 617 snap 189 seq_num 617) 2026-02-12T17:36:38.067 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:38.101 INFO:tasks.rados.rados.0.trial082.stdout:1797: finishing copy_from racing read to trial08226312-37 2026-02-12T17:36:38.101 INFO:tasks.rados.rados.0.trial082.stdout:1795: done (3 left) 2026-02-12T17:36:38.101 INFO:tasks.rados.rados.0.trial082.stdout:1796: done (2 left) 2026-02-12T17:36:38.102 INFO:tasks.rados.rados.0.trial082.stdout:1802: done (1 left) 2026-02-12T17:36:38.102 INFO:tasks.rados.rados.0.trial082.stdout:1803: snap_create 2026-02-12T17:36:38.102 INFO:tasks.rados.rados.0.trial082.stdout:1797: finishing copy_from to trial08226312-37 2026-02-12T17:36:38.102 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 304 (ObjNum 511 snap 156 seq_num 511) dirty exists 2026-02-12T17:36:39.088 INFO:tasks.rados.rados.0.trial082.stdout:1797: done (1 left) 2026-02-12T17:36:39.088 INFO:tasks.rados.rados.0.trial082.stdout:1803: done (0 left) 2026-02-12T17:36:39.089 INFO:tasks.rados.rados.0.trial082.stdout:1804: rollback oid 40 current snap is 191 2026-02-12T17:36:39.089 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 40 to 170 2026-02-12T17:36:39.089 INFO:tasks.rados.rados.0.trial082.stdout:1805: delete oid 24 current snap is 191 2026-02-12T17:36:39.089 INFO:tasks.rados.rados.0.trial082.stdout:1805: done (1 left) 2026-02-12T17:36:39.090 INFO:tasks.rados.rados.0.trial082.stdout:1806: snap_remove snap 190 2026-02-12T17:36:40.091 INFO:tasks.rados.rados.0.trial082.stdout:1806: done (1 left) 2026-02-12T17:36:40.091 INFO:tasks.rados.rados.0.trial082.stdout:1807: read oid 20 snap -1 2026-02-12T17:36:40.091 INFO:tasks.rados.rados.0.trial082.stdout:1807: expect (ObjNum 570 snap 176 seq_num 570) 2026-02-12T17:36:40.091 INFO:tasks.rados.rados.0.trial082.stdout:1808: copy_from oid 12 from oid 21 current snap is 191 2026-02-12T17:36:40.091 INFO:tasks.rados.rados.0.trial082.stdout:1804: finishing rollback tid 0 to trial08226312-40 2026-02-12T17:36:40.091 INFO:tasks.rados.rados.0.trial082.stdout:1804: finishing rollback tid 1 to trial08226312-40 2026-02-12T17:36:40.092 INFO:tasks.rados.rados.0.trial082.stdout:1804: finishing rollback tid 2 to trial08226312-40 2026-02-12T17:36:40.092 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1120 (ObjNum 460 snap 143 seq_num 460) dirty exists 2026-02-12T17:36:40.092 INFO:tasks.rados.rados.0.trial082.stdout:1804: done (2 left) 2026-02-12T17:36:40.092 INFO:tasks.rados.rados.0.trial082.stdout:1809: snap_remove snap 170 2026-02-12T17:36:41.094 INFO:tasks.rados.rados.0.trial082.stdout:1809: done (2 left) 2026-02-12T17:36:41.094 INFO:tasks.rados.rados.0.trial082.stdout:1810: snap_remove snap 168 2026-02-12T17:36:42.363 INFO:tasks.rados.rados.0.trial082.stdout:1810: done (2 left) 2026-02-12T17:36:42.363 INFO:tasks.rados.rados.0.trial082.stdout:1811: rollback oid 16 current snap is 191 2026-02-12T17:36:42.363 INFO:tasks.rados.rados.0.trial082.stdout:1811: done (2 left) 2026-02-12T17:36:42.363 INFO:tasks.rados.rados.0.trial082.stdout:1812: copy_from oid 2 from oid 26 current snap is 191 2026-02-12T17:36:42.363 INFO:tasks.rados.rados.0.trial082.stdout:1807: expect (ObjNum 570 snap 176 seq_num 570) 2026-02-12T17:36:42.382 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3118724 2026-02-12T17:36:42.388 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:42.421 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:42.454 INFO:tasks.rados.rados.0.trial082.stdout:1808: finishing copy_from racing read to trial08226312-12 2026-02-12T17:36:42.454 INFO:tasks.rados.rados.0.trial082.stdout:1808: finishing copy_from to trial08226312-12 2026-02-12T17:36:42.454 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1090 (ObjNum 533 snap 163 seq_num 533) dirty exists 2026-02-12T17:36:42.455 INFO:tasks.rados.rados.0.trial082.stdout:1812: finishing copy_from racing read to trial08226312-2 2026-02-12T17:36:42.455 INFO:tasks.rados.rados.0.trial082.stdout:1807: done (2 left) 2026-02-12T17:36:42.455 INFO:tasks.rados.rados.0.trial082.stdout:1808: done (1 left) 2026-02-12T17:36:42.455 INFO:tasks.rados.rados.0.trial082.stdout:1813: write oid 40 current snap is 191 2026-02-12T17:36:42.455 INFO:tasks.rados.rados.0.trial082.stdout:1812: finishing copy_from to trial08226312-2 2026-02-12T17:36:42.455 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 920 (ObjNum 602 snap 186 seq_num 602) dirty exists 2026-02-12T17:36:42.455 INFO:tasks.rados.rados.0.trial082.stdout:1813: seq_num 622 ranges {453954=629471,1598388=515881} 2026-02-12T17:36:42.458 INFO:tasks.rados.rados.0.trial082.stdout:1813: writing trial08226312-40 from 453954 to 1083425 tid 1 2026-02-12T17:36:42.462 INFO:tasks.rados.rados.0.trial082.stdout:1813: writing trial08226312-40 from 1598388 to 2114269 tid 2 2026-02-12T17:36:42.462 INFO:tasks.rados.rados.0.trial082.stdout:1812: done (1 left) 2026-02-12T17:36:42.462 INFO:tasks.rados.rados.0.trial082.stdout:1814: write (excl) oid 9 current snap is 191 2026-02-12T17:36:42.462 INFO:tasks.rados.rados.0.trial082.stdout:1814: seq_num 623 ranges {470761=704720,1656870=659539} 2026-02-12T17:36:42.466 INFO:tasks.rados.rados.0.trial082.stdout:1814: writing trial08226312-9 from 470761 to 1175481 tid 1 2026-02-12T17:36:42.472 INFO:tasks.rados.rados.0.trial082.stdout:1814: writing trial08226312-9 from 1656870 to 2316409 tid 2 2026-02-12T17:36:42.472 INFO:tasks.rados.rados.0.trial082.stdout:1815: read oid 48 snap -1 2026-02-12T17:36:42.472 INFO:tasks.rados.rados.0.trial082.stdout:1815: expect (ObjNum 600 snap 186 seq_num 600) 2026-02-12T17:36:42.472 INFO:tasks.rados.rados.0.trial082.stdout:1816: write (excl) oid 50 current snap is 191 2026-02-12T17:36:42.472 INFO:tasks.rados.rados.0.trial082.stdout:1813: finishing write tid 1 to trial08226312-40 2026-02-12T17:36:42.472 INFO:tasks.rados.rados.0.trial082.stdout:1813: finishing write tid 2 to trial08226312-40 2026-02-12T17:36:42.472 INFO:tasks.rados.rados.0.trial082.stdout:1813: finishing write tid 3 to trial08226312-40 2026-02-12T17:36:42.472 INFO:tasks.rados.rados.0.trial082.stdout:1816: seq_num 624 ranges {487568=496322,1431705=519550} 2026-02-12T17:36:42.475 INFO:tasks.rados.rados.0.trial082.stdout:1816: writing trial08226312-50 from 487568 to 983890 tid 1 2026-02-12T17:36:42.480 INFO:tasks.rados.rados.0.trial082.stdout:1816: writing trial08226312-50 from 1431705 to 1951255 tid 2 2026-02-12T17:36:42.480 INFO:tasks.rados.rados.0.trial082.stdout:1817: copy_from oid 44 from oid 13 current snap is 191 2026-02-12T17:36:42.480 INFO:tasks.rados.rados.0.trial082.stdout:1813: finishing write tid 4 to trial08226312-40 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1813: oid 40 updating version 0 to 1145 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1813: oid 40 updating version 1145 to 1147 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1813: oid 40 version 1147 is already newer than 1146 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1147 (ObjNum 622 snap 191 seq_num 622) dirty exists 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1813: left oid 40 (ObjNum 622 snap 191 seq_num 622) 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1814: finishing write tid 1 to trial08226312-9 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1813: done (4 left) 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1818: read oid 8 snap -1 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1818: expect deleted 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1819: delete oid 12 current snap is 191 2026-02-12T17:36:42.481 INFO:tasks.rados.rados.0.trial082.stdout:1814: finishing write tid 2 to trial08226312-9 2026-02-12T17:36:42.482 INFO:tasks.rados.rados.0.trial082.stdout:1814: finishing write tid 3 to trial08226312-9 2026-02-12T17:36:42.482 INFO:tasks.rados.rados.0.trial082.stdout:1814: finishing write tid 4 to trial08226312-9 2026-02-12T17:36:42.482 INFO:tasks.rados.rados.0.trial082.stdout:1814: oid 9 updating version 0 to 1150 2026-02-12T17:36:42.482 INFO:tasks.rados.rados.0.trial082.stdout:1814: oid 9 version 1150 is already newer than 1149 2026-02-12T17:36:42.482 INFO:tasks.rados.rados.0.trial082.stdout:1814: oid 9 version 1150 is already newer than 1148 2026-02-12T17:36:42.482 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 1150 (ObjNum 623 snap 191 seq_num 623) dirty exists 2026-02-12T17:36:42.482 INFO:tasks.rados.rados.0.trial082.stdout:1814: left oid 9 (ObjNum 623 snap 191 seq_num 623) 2026-02-12T17:36:42.482 INFO:tasks.rados.rados.0.trial082.stdout:1815: expect (ObjNum 600 snap 186 seq_num 600) 2026-02-12T17:36:42.506 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 49107 2026-02-12T17:36:42.522 INFO:tasks.rados.rados.0.trial082.stdout:1816: finishing write tid 1 to trial08226312-50 2026-02-12T17:36:42.522 INFO:tasks.rados.rados.0.trial082.stdout:1814: done (5 left) 2026-02-12T17:36:42.522 INFO:tasks.rados.rados.0.trial082.stdout:1815: done (4 left) 2026-02-12T17:36:42.522 INFO:tasks.rados.rados.0.trial082.stdout:1819: done (3 left) 2026-02-12T17:36:42.522 INFO:tasks.rados.rados.0.trial082.stdout:1820: write (excl) oid 38 current snap is 191 2026-02-12T17:36:42.522 INFO:tasks.rados.rados.0.trial082.stdout:1820: seq_num 626 ranges {521182=646820,1948669=523219} 2026-02-12T17:36:42.526 INFO:tasks.rados.rados.0.trial082.stdout:1820: writing trial08226312-38 from 521182 to 1168002 tid 1 2026-02-12T17:36:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1820: writing trial08226312-38 from 1948669 to 2471888 tid 2 2026-02-12T17:36:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1821: rollback oid 3 current snap is 191 2026-02-12T17:36:42.532 INFO:tasks.rados.rados.0.trial082.stdout:1821: done (4 left) 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1822: copy_from oid 34 from oid 42 current snap is 191 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1817: finishing copy_from to trial08226312-44 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1817: got expected ENOENT (src dne) 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1817: finishing copy_from racing read to trial08226312-44 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1816: finishing write tid 2 to trial08226312-50 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1816: finishing write tid 3 to trial08226312-50 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1816: finishing write tid 4 to trial08226312-50 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1816: oid 50 updating version 0 to 697 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1816: oid 50 updating version 697 to 698 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1816: oid 50 version 698 is already newer than 696 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 698 (ObjNum 624 snap 191 seq_num 624) dirty exists 2026-02-12T17:36:42.533 INFO:tasks.rados.rados.0.trial082.stdout:1816: left oid 50 (ObjNum 624 snap 191 seq_num 624) 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1820: finishing write tid 1 to trial08226312-38 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1816: done (4 left) 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1817: done (3 left) 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1818: done (2 left) 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1823: delete oid 45 current snap is 191 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1823: done (2 left) 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1824: read oid 7 snap -1 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1824: expect (ObjNum 601 snap 186 seq_num 601) 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1825: rollback oid 39 current snap is 191 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1825: done (3 left) 2026-02-12T17:36:42.534 INFO:tasks.rados.rados.0.trial082.stdout:1826: snap_create 2026-02-12T17:36:42.535 INFO:tasks.rados.rados.0.trial082.stdout:1820: finishing write tid 2 to trial08226312-38 2026-02-12T17:36:42.535 INFO:tasks.rados.rados.0.trial082.stdout:1820: finishing write tid 3 to trial08226312-38 2026-02-12T17:36:42.535 INFO:tasks.rados.rados.0.trial082.stdout:1820: finishing write tid 4 to trial08226312-38 2026-02-12T17:36:42.535 INFO:tasks.rados.rados.0.trial082.stdout:1820: oid 38 updating version 0 to 829 2026-02-12T17:36:42.535 INFO:tasks.rados.rados.0.trial082.stdout:1820: oid 38 updating version 829 to 830 2026-02-12T17:36:42.536 INFO:tasks.rados.rados.0.trial082.stdout:1820: oid 38 updating version 830 to 831 2026-02-12T17:36:42.536 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 831 (ObjNum 626 snap 191 seq_num 626) dirty exists 2026-02-12T17:36:42.536 INFO:tasks.rados.rados.0.trial082.stdout:1820: left oid 38 (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:36:42.537 INFO:tasks.rados.rados.0.trial082.stdout:1824: expect (ObjNum 601 snap 186 seq_num 601) 2026-02-12T17:36:42.566 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 704770 2026-02-12T17:36:42.579 INFO:tasks.rados.rados.0.trial082.stdout:1822: finishing copy_from racing read to trial08226312-34 2026-02-12T17:36:42.579 INFO:tasks.rados.rados.0.trial082.stdout:1822: finishing copy_from to trial08226312-34 2026-02-12T17:36:42.580 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1014 (ObjNum 577 snap 176 seq_num 577) dirty exists 2026-02-12T17:36:43.056 INFO:tasks.rados.rados.0.trial082.stdout:1820: done (3 left) 2026-02-12T17:36:43.056 INFO:tasks.rados.rados.0.trial082.stdout:1822: done (2 left) 2026-02-12T17:36:43.056 INFO:tasks.rados.rados.0.trial082.stdout:1824: done (1 left) 2026-02-12T17:36:43.056 INFO:tasks.rados.rados.0.trial082.stdout:1826: done (0 left) 2026-02-12T17:36:43.056 INFO:tasks.rados.rados.0.trial082.stdout:1827: snap_remove snap 191 2026-02-12T17:36:44.057 INFO:tasks.rados.rados.0.trial082.stdout:1827: done (0 left) 2026-02-12T17:36:44.057 INFO:tasks.rados.rados.0.trial082.stdout:1828: write oid 26 current snap is 192 2026-02-12T17:36:44.057 INFO:tasks.rados.rados.0.trial082.stdout:1828: seq_num 628 ranges {554796=797318,1949280=526888} 2026-02-12T17:36:44.062 INFO:tasks.rados.rados.0.trial082.stdout:1828: writing trial08226312-26 from 554796 to 1352114 tid 1 2026-02-12T17:36:44.067 INFO:tasks.rados.rados.0.trial082.stdout:1828: writing trial08226312-26 from 1949280 to 2476168 tid 2 2026-02-12T17:36:44.067 INFO:tasks.rados.rados.0.trial082.stdout:1829: delete oid 29 current snap is 192 2026-02-12T17:36:44.069 INFO:tasks.rados.rados.0.trial082.stdout:1828: finishing write tid 1 to trial08226312-26 2026-02-12T17:36:44.069 INFO:tasks.rados.rados.0.trial082.stdout:1829: done (1 left) 2026-02-12T17:36:44.070 INFO:tasks.rados.rados.0.trial082.stdout:1830: read oid 34 snap -1 2026-02-12T17:36:44.070 INFO:tasks.rados.rados.0.trial082.stdout:1830: expect (ObjNum 577 snap 176 seq_num 577) 2026-02-12T17:36:44.070 INFO:tasks.rados.rados.0.trial082.stdout:1831: write (excl) oid 2 current snap is 192 2026-02-12T17:36:44.070 INFO:tasks.rados.rados.0.trial082.stdout:1831: seq_num 630 ranges {588410=547816,1666244=414204,2484603=103807} 2026-02-12T17:36:44.074 INFO:tasks.rados.rados.0.trial082.stdout:1831: writing trial08226312-2 from 588410 to 1136226 tid 1 2026-02-12T17:36:44.077 INFO:tasks.rados.rados.0.trial082.stdout:1831: writing trial08226312-2 from 1666244 to 2080448 tid 2 2026-02-12T17:36:44.079 INFO:tasks.rados.rados.0.trial082.stdout:1831: writing trial08226312-2 from 2484603 to 2588410 tid 3 2026-02-12T17:36:44.079 INFO:tasks.rados.rados.0.trial082.stdout:1832: rollback oid 32 current snap is 192 2026-02-12T17:36:44.080 INFO:tasks.rados.rados.0.trial082.stdout:1832: done (3 left) 2026-02-12T17:36:44.080 INFO:tasks.rados.rados.0.trial082.stdout:1833: rollback oid 37 current snap is 192 2026-02-12T17:36:44.080 INFO:tasks.rados.rados.0.trial082.stdout:1833: done (3 left) 2026-02-12T17:36:44.080 INFO:tasks.rados.rados.0.trial082.stdout:1834: write (excl) oid 7 current snap is 192 2026-02-12T17:36:44.080 INFO:tasks.rados.rados.0.trial082.stdout:1834: seq_num 631 ranges {605217=739418,2124726=480491} 2026-02-12T17:36:44.084 INFO:tasks.rados.rados.0.trial082.stdout:1834: writing trial08226312-7 from 605217 to 1344635 tid 1 2026-02-12T17:36:44.089 INFO:tasks.rados.rados.0.trial082.stdout:1834: writing trial08226312-7 from 2124726 to 2605217 tid 2 2026-02-12T17:36:44.089 INFO:tasks.rados.rados.0.trial082.stdout:1835: read oid 48 snap -1 2026-02-12T17:36:44.089 INFO:tasks.rados.rados.0.trial082.stdout:1835: expect (ObjNum 600 snap 186 seq_num 600) 2026-02-12T17:36:44.089 INFO:tasks.rados.rados.0.trial082.stdout:1836: write (excl) oid 1 current snap is 192 2026-02-12T17:36:44.089 INFO:tasks.rados.rados.0.trial082.stdout:1836: seq_num 632 ranges {622024=414667,1783208=417873} 2026-02-12T17:36:44.093 INFO:tasks.rados.rados.0.trial082.stdout:1836: writing trial08226312-1 from 622024 to 1036691 tid 1 2026-02-12T17:36:44.097 INFO:tasks.rados.rados.0.trial082.stdout:1836: writing trial08226312-1 from 1783208 to 2201081 tid 2 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1837: delete oid 18 current snap is 192 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1828: finishing write tid 2 to trial08226312-26 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1828: finishing write tid 3 to trial08226312-26 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1828: finishing write tid 4 to trial08226312-26 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1828: oid 26 updating version 0 to 998 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1828: oid 26 updating version 998 to 999 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1828: oid 26 version 999 is already newer than 997 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 999 (ObjNum 628 snap 192 seq_num 628) dirty exists 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1828: left oid 26 (ObjNum 628 snap 192 seq_num 628) 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1831: finishing write tid 1 to trial08226312-2 2026-02-12T17:36:44.098 INFO:tasks.rados.rados.0.trial082.stdout:1830: expect (ObjNum 577 snap 176 seq_num 577) 2026-02-12T17:36:44.135 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 171095 2026-02-12T17:36:44.203 INFO:tasks.rados.rados.0.trial082.stdout:1831: finishing write tid 2 to trial08226312-2 2026-02-12T17:36:44.203 INFO:tasks.rados.rados.0.trial082.stdout:1831: finishing write tid 3 to trial08226312-2 2026-02-12T17:36:44.203 INFO:tasks.rados.rados.0.trial082.stdout:1828: done (6 left) 2026-02-12T17:36:44.203 INFO:tasks.rados.rados.0.trial082.stdout:1830: done (5 left) 2026-02-12T17:36:44.203 INFO:tasks.rados.rados.0.trial082.stdout:1837: done (4 left) 2026-02-12T17:36:44.203 INFO:tasks.rados.rados.0.trial082.stdout:1838: read oid 46 snap -1 2026-02-12T17:36:44.203 INFO:tasks.rados.rados.0.trial082.stdout:1838: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:36:44.203 INFO:tasks.rados.rados.0.trial082.stdout:1839: read oid 47 snap -1 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1839: expect deleted 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1840: copy_from oid 9 from oid 35 current snap is 192 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1831: finishing write tid 4 to trial08226312-2 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1831: finishing write tid 5 to trial08226312-2 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1831: oid 2 updating version 0 to 924 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1831: oid 2 version 924 is already newer than 923 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1831: oid 2 version 924 is already newer than 922 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1831: oid 2 version 924 is already newer than 921 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 924 (ObjNum 630 snap 192 seq_num 630) dirty exists 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1831: left oid 2 (ObjNum 630 snap 192 seq_num 630) 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1834: finishing write tid 1 to trial08226312-7 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1831: done (6 left) 2026-02-12T17:36:44.204 INFO:tasks.rados.rados.0.trial082.stdout:1841: rollback oid 30 current snap is 192 2026-02-12T17:36:44.205 INFO:tasks.rados.rados.0.trial082.stdout:1841: done (6 left) 2026-02-12T17:36:44.205 INFO:tasks.rados.rados.0.trial082.stdout:1842: snap_create 2026-02-12T17:36:44.205 INFO:tasks.rados.rados.0.trial082.stdout:1835: expect (ObjNum 600 snap 186 seq_num 600) 2026-02-12T17:36:44.241 INFO:tasks.rados.rados.0.trial082.stdout:1834: finishing write tid 2 to trial08226312-7 2026-02-12T17:36:44.241 INFO:tasks.rados.rados.0.trial082.stdout:1834: finishing write tid 3 to trial08226312-7 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1834: finishing write tid 4 to trial08226312-7 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1834: oid 7 updating version 0 to 1153 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1834: oid 7 version 1153 is already newer than 1152 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1834: oid 7 version 1153 is already newer than 1151 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 1153 (ObjNum 631 snap 192 seq_num 631) dirty exists 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1834: left oid 7 (ObjNum 631 snap 192 seq_num 631) 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1836: finishing write tid 1 to trial08226312-1 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1836: finishing write tid 2 to trial08226312-1 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1836: finishing write tid 3 to trial08226312-1 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1836: finishing write tid 4 to trial08226312-1 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1836: oid 1 updating version 0 to 929 2026-02-12T17:36:44.242 INFO:tasks.rados.rados.0.trial082.stdout:1836: oid 1 updating version 929 to 931 2026-02-12T17:36:44.243 INFO:tasks.rados.rados.0.trial082.stdout:1836: oid 1 version 931 is already newer than 930 2026-02-12T17:36:44.243 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 931 (ObjNum 632 snap 192 seq_num 632) dirty exists 2026-02-12T17:36:44.243 INFO:tasks.rados.rados.0.trial082.stdout:1836: left oid 1 (ObjNum 632 snap 192 seq_num 632) 2026-02-12T17:36:44.243 INFO:tasks.rados.rados.0.trial082.stdout:1838: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:36:44.278 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2559911 2026-02-12T17:36:44.289 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:44.320 INFO:tasks.rados.rados.0.trial082.stdout:1840: finishing copy_from racing read to trial08226312-9 2026-02-12T17:36:44.320 INFO:tasks.rados.rados.0.trial082.stdout:1840: finishing copy_from to trial08226312-9 2026-02-12T17:36:44.320 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 881 (ObjNum 584 snap 177 seq_num 584) dirty exists 2026-02-12T17:36:45.061 INFO:tasks.rados.rados.0.trial082.stdout:1834: done (6 left) 2026-02-12T17:36:45.061 INFO:tasks.rados.rados.0.trial082.stdout:1835: done (5 left) 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1836: done (4 left) 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1838: done (3 left) 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1839: done (2 left) 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1840: done (1 left) 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1842: done (0 left) 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1843: rollback oid 40 current snap is 193 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 40 to 192 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1844: read oid 13 snap -1 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1844: expect deleted 2026-02-12T17:36:45.062 INFO:tasks.rados.rados.0.trial082.stdout:1845: read oid 15 snap 192 2026-02-12T17:36:45.063 INFO:tasks.rados.rados.0.trial082.stdout:1845: expect deleted 2026-02-12T17:36:45.063 INFO:tasks.rados.rados.0.trial082.stdout:1846: copy_from oid 9 from oid 42 current snap is 193 2026-02-12T17:36:45.063 INFO:tasks.rados.rados.0.trial082.stdout:1847: read oid 34 snap -1 2026-02-12T17:36:45.063 INFO:tasks.rados.rados.0.trial082.stdout:1847: expect (ObjNum 577 snap 176 seq_num 577) 2026-02-12T17:36:45.063 INFO:tasks.rados.rados.0.trial082.stdout:1848: copy_from oid 19 from oid 4 current snap is 193 2026-02-12T17:36:45.063 INFO:tasks.rados.rados.0.trial082.stdout:1849: write oid 43 current snap is 193 2026-02-12T17:36:45.063 INFO:tasks.rados.rados.0.trial082.stdout:1849: seq_num 634 ranges {655638=565165,1900172=421542} 2026-02-12T17:36:45.064 INFO:tasks.rados.rados.0.trial082.stdout:1849: writing trial08226312-43 from 655638 to 1220803 tid 1 2026-02-12T17:36:45.069 INFO:tasks.rados.rados.0.trial082.stdout:1849: writing trial08226312-43 from 1900172 to 2321714 tid 2 2026-02-12T17:36:45.069 INFO:tasks.rados.rados.0.trial082.stdout:1850: snap_create 2026-02-12T17:36:45.069 INFO:tasks.rados.rados.0.trial082.stdout:1848: finishing copy_from to trial08226312-19 2026-02-12T17:36:45.070 INFO:tasks.rados.rados.0.trial082.stdout:1848: got expected ENOENT (src dne) 2026-02-12T17:36:45.070 INFO:tasks.rados.rados.0.trial082.stdout:1848: finishing copy_from racing read to trial08226312-19 2026-02-12T17:36:45.070 INFO:tasks.rados.rados.0.trial082.stdout:1843: finishing rollback tid 0 to trial08226312-40 2026-02-12T17:36:45.070 INFO:tasks.rados.rados.0.trial082.stdout:1843: finishing rollback tid 1 to trial08226312-40 2026-02-12T17:36:45.070 INFO:tasks.rados.rados.0.trial082.stdout:1847: expect (ObjNum 577 snap 176 seq_num 577) 2026-02-12T17:36:45.162 INFO:tasks.rados.rados.0.trial082.stdout:1843: finishing rollback tid 2 to trial08226312-40 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1158 (ObjNum 622 snap 191 seq_num 622) dirty exists 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:1849: finishing write tid 1 to trial08226312-43 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:1846: finishing copy_from racing read to trial08226312-9 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:1849: finishing write tid 2 to trial08226312-43 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:1849: finishing write tid 3 to trial08226312-43 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:1849: finishing write tid 4 to trial08226312-43 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:1849: oid 43 updating version 0 to 1096 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:1849: oid 43 updating version 1096 to 1097 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:1849: oid 43 updating version 1097 to 1098 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 1098 (ObjNum 634 snap 193 seq_num 634) dirty exists 2026-02-12T17:36:45.163 INFO:tasks.rados.rados.0.trial082.stdout:1849: left oid 43 (ObjNum 634 snap 193 seq_num 634) 2026-02-12T17:36:45.164 INFO:tasks.rados.rados.0.trial082.stdout:1846: finishing copy_from to trial08226312-9 2026-02-12T17:36:45.164 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 1014 (ObjNum 577 snap 176 seq_num 577) dirty exists 2026-02-12T17:36:46.062 INFO:tasks.rados.rados.0.trial082.stdout:1843: done (7 left) 2026-02-12T17:36:46.062 INFO:tasks.rados.rados.0.trial082.stdout:1844: done (6 left) 2026-02-12T17:36:46.062 INFO:tasks.rados.rados.0.trial082.stdout:1845: done (5 left) 2026-02-12T17:36:46.062 INFO:tasks.rados.rados.0.trial082.stdout:1846: done (4 left) 2026-02-12T17:36:46.063 INFO:tasks.rados.rados.0.trial082.stdout:1847: done (3 left) 2026-02-12T17:36:46.063 INFO:tasks.rados.rados.0.trial082.stdout:1848: done (2 left) 2026-02-12T17:36:46.063 INFO:tasks.rados.rados.0.trial082.stdout:1849: done (1 left) 2026-02-12T17:36:46.063 INFO:tasks.rados.rados.0.trial082.stdout:1850: done (0 left) 2026-02-12T17:36:46.063 INFO:tasks.rados.rados.0.trial082.stdout:1851: snap_remove snap 192 2026-02-12T17:36:47.063 INFO:tasks.rados.rados.0.trial082.stdout:1851: done (0 left) 2026-02-12T17:36:47.063 INFO:tasks.rados.rados.0.trial082.stdout:1852: snap_create 2026-02-12T17:36:48.056 INFO:tasks.rados.rados.0.trial082.stdout:1852: done (0 left) 2026-02-12T17:36:48.056 INFO:tasks.rados.rados.0.trial082.stdout:1853: write oid 5 current snap is 195 2026-02-12T17:36:48.056 INFO:tasks.rados.rados.0.trial082.stdout:1853: seq_num 635 ranges {672445=640414,1842301=681553} 2026-02-12T17:36:48.060 INFO:tasks.rados.rados.0.trial082.stdout:1853: writing trial08226312-5 from 672445 to 1312859 tid 1 2026-02-12T17:36:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1853: writing trial08226312-5 from 1842301 to 2523854 tid 2 2026-02-12T17:36:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1854: read oid 2 snap -1 2026-02-12T17:36:48.065 INFO:tasks.rados.rados.0.trial082.stdout:1854: expect (ObjNum 630 snap 192 seq_num 630) 2026-02-12T17:36:48.066 INFO:tasks.rados.rados.0.trial082.stdout:1855: snap_create 2026-02-12T17:36:48.068 INFO:tasks.rados.rados.0.trial082.stdout:1853: finishing write tid 1 to trial08226312-5 2026-02-12T17:36:48.068 INFO:tasks.rados.rados.0.trial082.stdout:1853: finishing write tid 2 to trial08226312-5 2026-02-12T17:36:48.068 INFO:tasks.rados.rados.0.trial082.stdout:1853: finishing write tid 3 to trial08226312-5 2026-02-12T17:36:48.069 INFO:tasks.rados.rados.0.trial082.stdout:1853: finishing write tid 4 to trial08226312-5 2026-02-12T17:36:48.069 INFO:tasks.rados.rados.0.trial082.stdout:1853: oid 5 updating version 0 to 888 2026-02-12T17:36:48.069 INFO:tasks.rados.rados.0.trial082.stdout:1853: oid 5 version 888 is already newer than 887 2026-02-12T17:36:48.069 INFO:tasks.rados.rados.0.trial082.stdout:1853: oid 5 version 888 is already newer than 886 2026-02-12T17:36:48.069 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 888 (ObjNum 635 snap 195 seq_num 635) dirty exists 2026-02-12T17:36:48.069 INFO:tasks.rados.rados.0.trial082.stdout:1853: left oid 5 (ObjNum 635 snap 195 seq_num 635) 2026-02-12T17:36:48.070 INFO:tasks.rados.rados.0.trial082.stdout:1854: expect (ObjNum 630 snap 192 seq_num 630) 2026-02-12T17:36:48.177 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1311666 2026-02-12T17:36:49.068 INFO:tasks.rados.rados.0.trial082.stdout:1853: done (2 left) 2026-02-12T17:36:49.069 INFO:tasks.rados.rados.0.trial082.stdout:1854: done (1 left) 2026-02-12T17:36:49.069 INFO:tasks.rados.rados.0.trial082.stdout:1855: done (0 left) 2026-02-12T17:36:49.069 INFO:tasks.rados.rados.0.trial082.stdout:1856: write (excl) oid 28 current snap is 196 2026-02-12T17:36:49.069 INFO:tasks.rados.rados.0.trial082.stdout:1856: seq_num 636 ranges {689252=715663,1900783=425211} 2026-02-12T17:36:49.074 INFO:tasks.rados.rados.0.trial082.stdout:1856: writing trial08226312-28 from 689252 to 1404915 tid 1 2026-02-12T17:36:49.078 INFO:tasks.rados.rados.0.trial082.stdout:1856: writing trial08226312-28 from 1900783 to 2325994 tid 2 2026-02-12T17:36:49.078 INFO:tasks.rados.rados.0.trial082.stdout:1857: read oid 44 snap -1 2026-02-12T17:36:49.078 INFO:tasks.rados.rados.0.trial082.stdout:1857: expect (ObjNum 618 snap 190 seq_num 618) 2026-02-12T17:36:49.078 INFO:tasks.rados.rados.0.trial082.stdout:1858: delete oid 33 current snap is 196 2026-02-12T17:36:49.079 INFO:tasks.rados.rados.0.trial082.stdout:1856: finishing write tid 1 to trial08226312-28 2026-02-12T17:36:49.079 INFO:tasks.rados.rados.0.trial082.stdout:1856: finishing write tid 2 to trial08226312-28 2026-02-12T17:36:49.080 INFO:tasks.rados.rados.0.trial082.stdout:1856: finishing write tid 3 to trial08226312-28 2026-02-12T17:36:49.080 INFO:tasks.rados.rados.0.trial082.stdout:1858: done (2 left) 2026-02-12T17:36:49.080 INFO:tasks.rados.rados.0.trial082.stdout:1859: snap_remove snap 193 2026-02-12T17:36:50.072 INFO:tasks.rados.rados.0.trial082.stdout:1859: done (2 left) 2026-02-12T17:36:50.072 INFO:tasks.rados.rados.0.trial082.stdout:1860: write (excl) oid 46 current snap is 196 2026-02-12T17:36:50.072 INFO:tasks.rados.rados.0.trial082.stdout:1860: seq_num 638 ranges {722866=466161,1617747=428880,2587634=135232} 2026-02-12T17:36:50.076 INFO:tasks.rados.rados.0.trial082.stdout:1860: writing trial08226312-46 from 722866 to 1189027 tid 1 2026-02-12T17:36:50.079 INFO:tasks.rados.rados.0.trial082.stdout:1860: writing trial08226312-46 from 1617747 to 2046627 tid 2 2026-02-12T17:36:50.082 INFO:tasks.rados.rados.0.trial082.stdout:1860: writing trial08226312-46 from 2587634 to 2722866 tid 3 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:1861: read oid 38 snap 195 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:1861: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:1862: write (excl) oid 14 current snap is 196 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:1856: finishing write tid 4 to trial08226312-28 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:1856: oid 28 updating version 0 to 1168 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:1856: oid 28 version 1168 is already newer than 1167 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:1856: oid 28 version 1168 is already newer than 1166 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1168 (ObjNum 636 snap 196 seq_num 636) dirty exists 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:1856: left oid 28 (ObjNum 636 snap 196 seq_num 636) 2026-02-12T17:36:50.083 INFO:tasks.rados.rados.0.trial082.stdout:1857: expect (ObjNum 618 snap 190 seq_num 618) 2026-02-12T17:36:50.091 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1588546 2026-02-12T17:36:50.108 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:50.159 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2356877 2026-02-12T17:36:50.159 INFO:tasks.rados.rados.0.trial082.stdout:1860: finishing write tid 1 to trial08226312-46 2026-02-12T17:36:50.159 INFO:tasks.rados.rados.0.trial082.stdout:1860: finishing write tid 2 to trial08226312-46 2026-02-12T17:36:50.159 INFO:tasks.rados.rados.0.trial082.stdout:1862: seq_num 639 ranges {739673=657763,2076229=663444} 2026-02-12T17:36:50.165 INFO:tasks.rados.rados.0.trial082.stdout:1862: writing trial08226312-14 from 739673 to 1397436 tid 1 2026-02-12T17:36:50.170 INFO:tasks.rados.rados.0.trial082.stdout:1862: writing trial08226312-14 from 2076229 to 2739673 tid 2 2026-02-12T17:36:50.170 INFO:tasks.rados.rados.0.trial082.stdout:1856: done (4 left) 2026-02-12T17:36:50.170 INFO:tasks.rados.rados.0.trial082.stdout:1857: done (3 left) 2026-02-12T17:36:50.170 INFO:tasks.rados.rados.0.trial082.stdout:1863: write (excl) oid 32 current snap is 196 2026-02-12T17:36:50.170 INFO:tasks.rados.rados.0.trial082.stdout:1863: seq_num 640 ranges {756480=733012,2134711=432549} 2026-02-12T17:36:50.175 INFO:tasks.rados.rados.0.trial082.stdout:1863: writing trial08226312-32 from 756480 to 1489492 tid 1 2026-02-12T17:36:50.180 INFO:tasks.rados.rados.0.trial082.stdout:1863: writing trial08226312-32 from 2134711 to 2567260 tid 2 2026-02-12T17:36:50.180 INFO:tasks.rados.rados.0.trial082.stdout:1864: rollback oid 35 current snap is 196 2026-02-12T17:36:50.180 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 35 to 194 2026-02-12T17:36:50.180 INFO:tasks.rados.rados.0.trial082.stdout:1860: finishing write tid 3 to trial08226312-46 2026-02-12T17:36:50.180 INFO:tasks.rados.rados.0.trial082.stdout:1860: finishing write tid 4 to trial08226312-46 2026-02-12T17:36:50.180 INFO:tasks.rados.rados.0.trial082.stdout:1860: finishing write tid 5 to trial08226312-46 2026-02-12T17:36:50.180 INFO:tasks.rados.rados.0.trial082.stdout:1860: oid 46 updating version 0 to 1243 2026-02-12T17:36:50.181 INFO:tasks.rados.rados.0.trial082.stdout:1860: oid 46 updating version 1243 to 1245 2026-02-12T17:36:50.181 INFO:tasks.rados.rados.0.trial082.stdout:1860: oid 46 updating version 1245 to 1246 2026-02-12T17:36:50.181 INFO:tasks.rados.rados.0.trial082.stdout:1860: oid 46 version 1246 is already newer than 1244 2026-02-12T17:36:50.181 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1246 (ObjNum 638 snap 196 seq_num 638) dirty exists 2026-02-12T17:36:50.181 INFO:tasks.rados.rados.0.trial082.stdout:1860: left oid 46 (ObjNum 638 snap 196 seq_num 638) 2026-02-12T17:36:50.181 INFO:tasks.rados.rados.0.trial082.stdout:1861: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:36:50.181 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 314796 2026-02-12T17:36:50.212 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:50.245 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:36:50.279 INFO:tasks.rados.rados.0.trial082.stdout:1862: finishing write tid 1 to trial08226312-14 2026-02-12T17:36:50.279 INFO:tasks.rados.rados.0.trial082.stdout:1862: finishing write tid 2 to trial08226312-14 2026-02-12T17:36:50.279 INFO:tasks.rados.rados.0.trial082.stdout:1862: finishing write tid 3 to trial08226312-14 2026-02-12T17:36:50.279 INFO:tasks.rados.rados.0.trial082.stdout:1862: finishing write tid 4 to trial08226312-14 2026-02-12T17:36:50.279 INFO:tasks.rados.rados.0.trial082.stdout:1862: oid 14 updating version 0 to 889 2026-02-12T17:36:50.279 INFO:tasks.rados.rados.0.trial082.stdout:1862: oid 14 updating version 889 to 890 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1862: oid 14 updating version 890 to 891 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 891 (ObjNum 639 snap 196 seq_num 639) dirty exists 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1862: left oid 14 (ObjNum 639 snap 196 seq_num 639) 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1863: finishing write tid 1 to trial08226312-32 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1863: finishing write tid 2 to trial08226312-32 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1863: finishing write tid 3 to trial08226312-32 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1863: finishing write tid 4 to trial08226312-32 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1863: oid 32 updating version 0 to 834 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1863: oid 32 version 834 is already newer than 833 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1863: oid 32 version 834 is already newer than 832 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 834 (ObjNum 640 snap 196 seq_num 640) dirty exists 2026-02-12T17:36:50.280 INFO:tasks.rados.rados.0.trial082.stdout:1863: left oid 32 (ObjNum 640 snap 196 seq_num 640) 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1864: finishing rollback tid 0 to trial08226312-35 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1864: finishing rollback tid 1 to trial08226312-35 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1864: finishing rollback tid 2 to trial08226312-35 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1003 (ObjNum 584 snap 177 seq_num 584) dirty exists 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1860: done (4 left) 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1861: done (3 left) 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1862: done (2 left) 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1863: done (1 left) 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1864: done (0 left) 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1865: read oid 25 snap 195 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1865: expect deleted 2026-02-12T17:36:50.281 INFO:tasks.rados.rados.0.trial082.stdout:1866: snap_create 2026-02-12T17:36:51.076 INFO:tasks.rados.rados.0.trial082.stdout:1865: done (1 left) 2026-02-12T17:36:51.077 INFO:tasks.rados.rados.0.trial082.stdout:1866: done (0 left) 2026-02-12T17:36:51.077 INFO:tasks.rados.rados.0.trial082.stdout:1867: write (excl) oid 45 current snap is 197 2026-02-12T17:36:51.077 INFO:tasks.rados.rados.0.trial082.stdout:1867: seq_num 641 ranges {773287=408261,1793193=576207} 2026-02-12T17:36:51.080 INFO:tasks.rados.rados.0.trial082.stdout:1867: writing trial08226312-45 from 773287 to 1181548 tid 1 2026-02-12T17:36:51.085 INFO:tasks.rados.rados.0.trial082.stdout:1867: writing trial08226312-45 from 1793193 to 2369400 tid 2 2026-02-12T17:36:51.085 INFO:tasks.rados.rados.0.trial082.stdout:1868: read oid 27 snap -1 2026-02-12T17:36:51.085 INFO:tasks.rados.rados.0.trial082.stdout:1868: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:36:51.086 INFO:tasks.rados.rados.0.trial082.stdout:1869: write (excl) oid 24 current snap is 197 2026-02-12T17:36:51.086 INFO:tasks.rados.rados.0.trial082.stdout:1869: seq_num 642 ranges {790094=483510,1851675=436218} 2026-02-12T17:36:51.090 INFO:tasks.rados.rados.0.trial082.stdout:1869: writing trial08226312-24 from 790094 to 1273604 tid 1 2026-02-12T17:36:51.094 INFO:tasks.rados.rados.0.trial082.stdout:1869: writing trial08226312-24 from 1851675 to 2287893 tid 2 2026-02-12T17:36:51.094 INFO:tasks.rados.rados.0.trial082.stdout:1870: delete oid 6 current snap is 197 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:1867: finishing write tid 1 to trial08226312-45 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:1867: finishing write tid 2 to trial08226312-45 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:1867: finishing write tid 3 to trial08226312-45 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:1867: finishing write tid 4 to trial08226312-45 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:1867: oid 45 updating version 0 to 1006 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:1867: oid 45 version 1006 is already newer than 1005 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:1867: oid 45 version 1006 is already newer than 1004 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1006 (ObjNum 641 snap 197 seq_num 641) dirty exists 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:1867: left oid 45 (ObjNum 641 snap 197 seq_num 641) 2026-02-12T17:36:51.095 INFO:tasks.rados.rados.0.trial082.stdout:1868: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:36:51.127 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 962192 2026-02-12T17:36:51.182 INFO:tasks.rados.rados.0.trial082.stdout:1869: finishing write tid 1 to trial08226312-24 2026-02-12T17:36:51.182 INFO:tasks.rados.rados.0.trial082.stdout:1869: finishing write tid 2 to trial08226312-24 2026-02-12T17:36:51.182 INFO:tasks.rados.rados.0.trial082.stdout:1869: finishing write tid 3 to trial08226312-24 2026-02-12T17:36:51.182 INFO:tasks.rados.rados.0.trial082.stdout:1869: finishing write tid 4 to trial08226312-24 2026-02-12T17:36:51.182 INFO:tasks.rados.rados.0.trial082.stdout:1869: oid 24 updating version 0 to 1480 2026-02-12T17:36:51.182 INFO:tasks.rados.rados.0.trial082.stdout:1869: oid 24 updating version 1480 to 1481 2026-02-12T17:36:51.182 INFO:tasks.rados.rados.0.trial082.stdout:1869: oid 24 version 1481 is already newer than 1479 2026-02-12T17:36:51.182 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1481 (ObjNum 642 snap 197 seq_num 642) dirty exists 2026-02-12T17:36:51.183 INFO:tasks.rados.rados.0.trial082.stdout:1869: left oid 24 (ObjNum 642 snap 197 seq_num 642) 2026-02-12T17:36:51.183 INFO:tasks.rados.rados.0.trial082.stdout:1867: done (3 left) 2026-02-12T17:36:51.183 INFO:tasks.rados.rados.0.trial082.stdout:1868: done (2 left) 2026-02-12T17:36:51.183 INFO:tasks.rados.rados.0.trial082.stdout:1869: done (1 left) 2026-02-12T17:36:51.183 INFO:tasks.rados.rados.0.trial082.stdout:1870: done (0 left) 2026-02-12T17:36:51.183 INFO:tasks.rados.rados.0.trial082.stdout:1871: write (excl) oid 40 current snap is 197 2026-02-12T17:36:51.183 INFO:tasks.rados.rados.0.trial082.stdout:1871: seq_num 644 ranges {423708=634008,1852286=439887,2752172=71536} 2026-02-12T17:36:51.185 INFO:tasks.rados.rados.0.trial082.stdout:1871: writing trial08226312-40 from 423708 to 1057716 tid 1 2026-02-12T17:36:51.190 INFO:tasks.rados.rados.0.trial082.stdout:1871: writing trial08226312-40 from 1852286 to 2292173 tid 2 2026-02-12T17:36:51.192 INFO:tasks.rados.rados.0.trial082.stdout:1871: writing trial08226312-40 from 2752172 to 2823708 tid 3 2026-02-12T17:36:51.192 INFO:tasks.rados.rados.0.trial082.stdout:1872: write oid 24 current snap is 197 2026-02-12T17:36:51.192 INFO:tasks.rados.rados.0.trial082.stdout:1872: seq_num 645 ranges {440515=709257,1910768=583545} 2026-02-12T17:36:51.196 INFO:tasks.rados.rados.0.trial082.stdout:1872: writing trial08226312-24 from 440515 to 1149772 tid 1 2026-02-12T17:36:51.202 INFO:tasks.rados.rados.0.trial082.stdout:1872: writing trial08226312-24 from 1910768 to 2494313 tid 2 2026-02-12T17:36:51.202 INFO:tasks.rados.rados.0.trial082.stdout:1873: read oid 29 snap -1 2026-02-12T17:36:51.202 INFO:tasks.rados.rados.0.trial082.stdout:1873: expect deleted 2026-02-12T17:36:51.202 INFO:tasks.rados.rados.0.trial082.stdout:1874: snap_create 2026-02-12T17:36:51.202 INFO:tasks.rados.rados.0.trial082.stdout:1871: finishing write tid 1 to trial08226312-40 2026-02-12T17:36:51.202 INFO:tasks.rados.rados.0.trial082.stdout:1871: finishing write tid 2 to trial08226312-40 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:1871: finishing write tid 3 to trial08226312-40 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:1871: finishing write tid 4 to trial08226312-40 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:1871: finishing write tid 5 to trial08226312-40 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:1871: oid 40 updating version 0 to 1175 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:1871: oid 40 version 1175 is already newer than 1173 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:1871: oid 40 version 1175 is already newer than 1174 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:1871: oid 40 version 1175 is already newer than 1172 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1175 (ObjNum 644 snap 197 seq_num 644) dirty exists 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:1871: left oid 40 (ObjNum 644 snap 197 seq_num 644) 2026-02-12T17:36:51.203 INFO:tasks.rados.rados.0.trial082.stdout:1872: finishing write tid 1 to trial08226312-24 2026-02-12T17:36:51.204 INFO:tasks.rados.rados.0.trial082.stdout:1872: finishing write tid 2 to trial08226312-24 2026-02-12T17:36:51.204 INFO:tasks.rados.rados.0.trial082.stdout:1872: finishing write tid 3 to trial08226312-24 2026-02-12T17:36:51.204 INFO:tasks.rados.rados.0.trial082.stdout:1872: finishing write tid 4 to trial08226312-24 2026-02-12T17:36:51.204 INFO:tasks.rados.rados.0.trial082.stdout:1872: oid 24 updating version 0 to 1484 2026-02-12T17:36:51.204 INFO:tasks.rados.rados.0.trial082.stdout:1872: oid 24 version 1484 is already newer than 1483 2026-02-12T17:36:51.205 INFO:tasks.rados.rados.0.trial082.stdout:1872: oid 24 version 1484 is already newer than 1482 2026-02-12T17:36:51.205 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1484 (ObjNum 645 snap 197 seq_num 645) dirty exists 2026-02-12T17:36:51.205 INFO:tasks.rados.rados.0.trial082.stdout:1872: left oid 24 (ObjNum 645 snap 197 seq_num 645) 2026-02-12T17:36:52.079 INFO:tasks.rados.rados.0.trial082.stdout:1871: done (3 left) 2026-02-12T17:36:52.079 INFO:tasks.rados.rados.0.trial082.stdout:1872: done (2 left) 2026-02-12T17:36:52.079 INFO:tasks.rados.rados.0.trial082.stdout:1873: done (1 left) 2026-02-12T17:36:52.079 INFO:tasks.rados.rados.0.trial082.stdout:1874: done (0 left) 2026-02-12T17:36:52.080 INFO:tasks.rados.rados.0.trial082.stdout:1875: snap_remove snap 196 2026-02-12T17:36:53.056 INFO:tasks.rados.rados.0.trial082.stdout:1875: done (0 left) 2026-02-12T17:36:53.056 INFO:tasks.rados.rados.0.trial082.stdout:1876: snap_remove snap 197 2026-02-12T17:36:54.057 INFO:tasks.rados.rados.0.trial082.stdout:1876: done (0 left) 2026-02-12T17:36:54.057 INFO:tasks.rados.rados.0.trial082.stdout:1877: snap_create 2026-02-12T17:36:55.058 INFO:tasks.rados.rados.0.trial082.stdout:1877: done (0 left) 2026-02-12T17:36:55.058 INFO:tasks.rados.rados.0.trial082.stdout:1878: snap_create 2026-02-12T17:36:56.059 INFO:tasks.rados.rados.0.trial082.stdout:1878: done (0 left) 2026-02-12T17:36:56.059 INFO:tasks.rados.rados.0.trial082.stdout:1879: rollback oid 19 current snap is 200 2026-02-12T17:36:56.059 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 198 2026-02-12T17:36:56.059 INFO:tasks.rados.rados.0.trial082.stdout:1880: snap_create 2026-02-12T17:36:56.062 INFO:tasks.rados.rados.0.trial082.stdout:1879: finishing rollback tid 0 to trial08226312-19 2026-02-12T17:36:56.062 INFO:tasks.rados.rados.0.trial082.stdout:1879: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:36:56.062 INFO:tasks.rados.rados.0.trial082.stdout:1879: finishing rollback tid 2 to trial08226312-19 2026-02-12T17:36:56.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 1488 (ObjNum 543 snap 167 seq_num 543) dirty exists 2026-02-12T17:36:57.060 INFO:tasks.rados.rados.0.trial082.stdout:1879: done (1 left) 2026-02-12T17:36:57.061 INFO:tasks.rados.rados.0.trial082.stdout:1880: done (0 left) 2026-02-12T17:36:57.061 INFO:tasks.rados.rados.0.trial082.stdout:1881: snap_remove snap 195 2026-02-12T17:36:58.058 INFO:tasks.rados.rados.0.trial082.stdout:1881: done (0 left) 2026-02-12T17:36:58.058 INFO:tasks.rados.rados.0.trial082.stdout:1882: read oid 30 snap 198 2026-02-12T17:36:58.058 INFO:tasks.rados.rados.0.trial082.stdout:1882: expect deleted 2026-02-12T17:36:58.058 INFO:tasks.rados.rados.0.trial082.stdout:1883: copy_from oid 44 from oid 27 current snap is 201 2026-02-12T17:36:58.058 INFO:tasks.rados.rados.0.trial082.stdout:1884: delete oid 9 current snap is 201 2026-02-12T17:36:58.061 INFO:tasks.rados.rados.0.trial082.stdout:1882: done (2 left) 2026-02-12T17:36:58.061 INFO:tasks.rados.rados.0.trial082.stdout:1884: done (1 left) 2026-02-12T17:36:58.061 INFO:tasks.rados.rados.0.trial082.stdout:1885: copy_from oid 3 from oid 15 current snap is 201 2026-02-12T17:36:58.061 INFO:tasks.rados.rados.0.trial082.stdout:1886: snap_remove snap 198 2026-02-12T17:36:59.060 INFO:tasks.rados.rados.0.trial082.stdout:1886: done (2 left) 2026-02-12T17:36:59.060 INFO:tasks.rados.rados.0.trial082.stdout:1887: read oid 24 snap -1 2026-02-12T17:36:59.061 INFO:tasks.rados.rados.0.trial082.stdout:1887: expect (ObjNum 645 snap 197 seq_num 645) 2026-02-12T17:36:59.061 INFO:tasks.rados.rados.0.trial082.stdout:1888: snap_remove snap 200 2026-02-12T17:37:00.062 INFO:tasks.rados.rados.0.trial082.stdout:1888: done (3 left) 2026-02-12T17:37:00.063 INFO:tasks.rados.rados.0.trial082.stdout:1889: delete oid 23 current snap is 201 2026-02-12T17:37:00.063 INFO:tasks.rados.rados.0.trial082.stdout:1885: finishing copy_from to trial08226312-3 2026-02-12T17:37:00.063 INFO:tasks.rados.rados.0.trial082.stdout:1885: got expected ENOENT (src dne) 2026-02-12T17:37:00.063 INFO:tasks.rados.rados.0.trial082.stdout:1885: finishing copy_from racing read to trial08226312-3 2026-02-12T17:37:00.063 INFO:tasks.rados.rados.0.trial082.stdout:1883: finishing copy_from racing read to trial08226312-44 2026-02-12T17:37:00.063 INFO:tasks.rados.rados.0.trial082.stdout:1883: finishing copy_from to trial08226312-44 2026-02-12T17:37:00.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 692 (ObjNum 546 snap 167 seq_num 546) dirty exists 2026-02-12T17:37:00.063 INFO:tasks.rados.rados.0.trial082.stdout:1887: expect (ObjNum 645 snap 197 seq_num 645) 2026-02-12T17:37:00.091 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1332974 2026-02-12T17:37:00.117 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1615127 2026-02-12T17:37:00.136 INFO:tasks.rados.rados.0.trial082.stdout:1883: done (3 left) 2026-02-12T17:37:00.136 INFO:tasks.rados.rados.0.trial082.stdout:1885: done (2 left) 2026-02-12T17:37:00.137 INFO:tasks.rados.rados.0.trial082.stdout:1887: done (1 left) 2026-02-12T17:37:00.137 INFO:tasks.rados.rados.0.trial082.stdout:1889: done (0 left) 2026-02-12T17:37:00.137 INFO:tasks.rados.rados.0.trial082.stdout:1890: delete oid 4 current snap is 201 2026-02-12T17:37:00.137 INFO:tasks.rados.rados.0.trial082.stdout:1890: done (0 left) 2026-02-12T17:37:00.138 INFO:tasks.rados.rados.0.trial082.stdout:1891: copy_from oid 23 from oid 43 current snap is 201 2026-02-12T17:37:00.138 INFO:tasks.rados.rados.0.trial082.stdout:1892: write (excl) oid 18 current snap is 201 2026-02-12T17:37:00.138 INFO:tasks.rados.rados.0.trial082.stdout:1892: seq_num 649 ranges {507743=726606,1744696=590883,2772934=134809} 2026-02-12T17:37:00.142 INFO:tasks.rados.rados.0.trial082.stdout:1892: writing trial08226312-18 from 507743 to 1234349 tid 1 2026-02-12T17:37:00.146 INFO:tasks.rados.rados.0.trial082.stdout:1892: writing trial08226312-18 from 1744696 to 2335579 tid 2 2026-02-12T17:37:00.149 INFO:tasks.rados.rados.0.trial082.stdout:1892: writing trial08226312-18 from 2772934 to 2907743 tid 3 2026-02-12T17:37:00.149 INFO:tasks.rados.rados.0.trial082.stdout:1893: copy_from oid 20 from oid 38 current snap is 201 2026-02-12T17:37:00.149 INFO:tasks.rados.rados.0.trial082.stdout:1891: finishing copy_from racing read to trial08226312-23 2026-02-12T17:37:00.149 INFO:tasks.rados.rados.0.trial082.stdout:1891: finishing copy_from to trial08226312-23 2026-02-12T17:37:00.149 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 1098 (ObjNum 634 snap 193 seq_num 634) dirty exists 2026-02-12T17:37:00.149 INFO:tasks.rados.rados.0.trial082.stdout:1891: done (2 left) 2026-02-12T17:37:00.150 INFO:tasks.rados.rados.0.trial082.stdout:1894: write (excl) oid 10 current snap is 201 2026-02-12T17:37:00.150 INFO:tasks.rados.rados.0.trial082.stdout:1894: seq_num 650 ranges {524550=401855,1403178=450894,2516710=407840} 2026-02-12T17:37:00.152 INFO:tasks.rados.rados.0.trial082.stdout:1894: writing trial08226312-10 from 524550 to 926405 tid 1 2026-02-12T17:37:00.156 INFO:tasks.rados.rados.0.trial082.stdout:1894: writing trial08226312-10 from 1403178 to 1854072 tid 2 2026-02-12T17:37:00.160 INFO:tasks.rados.rados.0.trial082.stdout:1894: writing trial08226312-10 from 2516710 to 2924550 tid 3 2026-02-12T17:37:00.160 INFO:tasks.rados.rados.0.trial082.stdout:1895: write (excl) oid 50 current snap is 201 2026-02-12T17:37:00.160 INFO:tasks.rados.rados.0.trial082.stdout:1895: seq_num 651 ranges {541357=477104,1745307=594552} 2026-02-12T17:37:00.163 INFO:tasks.rados.rados.0.trial082.stdout:1895: writing trial08226312-50 from 541357 to 1018461 tid 1 2026-02-12T17:37:00.169 INFO:tasks.rados.rados.0.trial082.stdout:1895: writing trial08226312-50 from 1745307 to 2339859 tid 2 2026-02-12T17:37:00.169 INFO:tasks.rados.rados.0.trial082.stdout:1896: snap_create 2026-02-12T17:37:00.169 INFO:tasks.rados.rados.0.trial082.stdout:1892: finishing write tid 1 to trial08226312-18 2026-02-12T17:37:00.169 INFO:tasks.rados.rados.0.trial082.stdout:1892: finishing write tid 2 to trial08226312-18 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1892: finishing write tid 3 to trial08226312-18 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1892: finishing write tid 4 to trial08226312-18 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1892: finishing write tid 5 to trial08226312-18 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1892: oid 18 updating version 0 to 1016 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1892: oid 18 updating version 1016 to 1018 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1892: oid 18 version 1018 is already newer than 1015 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1892: oid 18 version 1018 is already newer than 1017 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 1018 (ObjNum 649 snap 201 seq_num 649) dirty exists 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1892: left oid 18 (ObjNum 649 snap 201 seq_num 649) 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1893: finishing copy_from racing read to trial08226312-20 2026-02-12T17:37:00.170 INFO:tasks.rados.rados.0.trial082.stdout:1893: finishing copy_from to trial08226312-20 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 831 (ObjNum 626 snap 191 seq_num 626) dirty exists 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: finishing write tid 1 to trial08226312-10 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: finishing write tid 2 to trial08226312-10 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: finishing write tid 3 to trial08226312-10 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: finishing write tid 4 to trial08226312-10 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: finishing write tid 5 to trial08226312-10 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: oid 10 updating version 0 to 1101 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: oid 10 version 1101 is already newer than 1099 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: oid 10 updating version 1101 to 1102 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: oid 10 version 1102 is already newer than 1100 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1102 (ObjNum 650 snap 201 seq_num 650) dirty exists 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1894: left oid 10 (ObjNum 650 snap 201 seq_num 650) 2026-02-12T17:37:00.171 INFO:tasks.rados.rados.0.trial082.stdout:1895: finishing write tid 1 to trial08226312-50 2026-02-12T17:37:00.172 INFO:tasks.rados.rados.0.trial082.stdout:1895: finishing write tid 2 to trial08226312-50 2026-02-12T17:37:00.172 INFO:tasks.rados.rados.0.trial082.stdout:1895: finishing write tid 3 to trial08226312-50 2026-02-12T17:37:00.172 INFO:tasks.rados.rados.0.trial082.stdout:1895: finishing write tid 4 to trial08226312-50 2026-02-12T17:37:00.172 INFO:tasks.rados.rados.0.trial082.stdout:1895: oid 50 updating version 0 to 701 2026-02-12T17:37:00.173 INFO:tasks.rados.rados.0.trial082.stdout:1895: oid 50 version 701 is already newer than 700 2026-02-12T17:37:00.173 INFO:tasks.rados.rados.0.trial082.stdout:1895: oid 50 updating version 701 to 702 2026-02-12T17:37:00.173 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 702 (ObjNum 651 snap 201 seq_num 651) dirty exists 2026-02-12T17:37:00.173 INFO:tasks.rados.rados.0.trial082.stdout:1895: left oid 50 (ObjNum 651 snap 201 seq_num 651) 2026-02-12T17:37:01.067 INFO:tasks.rados.rados.0.trial082.stdout:1892: done (4 left) 2026-02-12T17:37:01.067 INFO:tasks.rados.rados.0.trial082.stdout:1893: done (3 left) 2026-02-12T17:37:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1894: done (2 left) 2026-02-12T17:37:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1895: done (1 left) 2026-02-12T17:37:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1896: done (0 left) 2026-02-12T17:37:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1897: read oid 3 snap -1 2026-02-12T17:37:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1897: expect (ObjNum 609 snap 188 seq_num 609) 2026-02-12T17:37:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1898: copy_from oid 49 from oid 1 current snap is 202 2026-02-12T17:37:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1899: read oid 45 snap -1 2026-02-12T17:37:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1899: expect (ObjNum 641 snap 197 seq_num 641) 2026-02-12T17:37:01.068 INFO:tasks.rados.rados.0.trial082.stdout:1900: delete oid 39 current snap is 202 2026-02-12T17:37:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1900: done (3 left) 2026-02-12T17:37:01.069 INFO:tasks.rados.rados.0.trial082.stdout:1901: delete oid 7 current snap is 202 2026-02-12T17:37:01.071 INFO:tasks.rados.rados.0.trial082.stdout:1901: done (3 left) 2026-02-12T17:37:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1902: read oid 11 snap -1 2026-02-12T17:37:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1902: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:37:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1903: write (excl) oid 19 current snap is 202 2026-02-12T17:37:01.072 INFO:tasks.rados.rados.0.trial082.stdout:1903: seq_num 654 ranges {591778=419204,1637106=741879,2910049=81729} 2026-02-12T17:37:01.075 INFO:tasks.rados.rados.0.trial082.stdout:1903: writing trial08226312-19 from 591778 to 1010982 tid 1 2026-02-12T17:37:01.081 INFO:tasks.rados.rados.0.trial082.stdout:1903: writing trial08226312-19 from 1637106 to 2378985 tid 2 2026-02-12T17:37:01.083 INFO:tasks.rados.rados.0.trial082.stdout:1903: writing trial08226312-19 from 2910049 to 2991778 tid 3 2026-02-12T17:37:01.083 INFO:tasks.rados.rados.0.trial082.stdout:1904: write (excl) oid 35 current snap is 202 2026-02-12T17:37:01.083 INFO:tasks.rados.rados.0.trial082.stdout:1904: seq_num 655 ranges {608585=494453,1579235=601890,2821119=187466} 2026-02-12T17:37:01.087 INFO:tasks.rados.rados.0.trial082.stdout:1904: writing trial08226312-35 from 608585 to 1103038 tid 1 2026-02-12T17:37:01.091 INFO:tasks.rados.rados.0.trial082.stdout:1904: writing trial08226312-35 from 1579235 to 2181125 tid 2 2026-02-12T17:37:01.095 INFO:tasks.rados.rados.0.trial082.stdout:1904: writing trial08226312-35 from 2821119 to 3008585 tid 3 2026-02-12T17:37:01.095 INFO:tasks.rados.rados.0.trial082.stdout:1905: delete oid 5 current snap is 202 2026-02-12T17:37:01.095 INFO:tasks.rados.rados.0.trial082.stdout:1899: expect (ObjNum 641 snap 197 seq_num 641) 2026-02-12T17:37:01.108 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:01.149 INFO:tasks.rados.rados.0.trial082.stdout:1897: expect (ObjNum 609 snap 188 seq_num 609) 2026-02-12T17:37:01.165 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1662156 2026-02-12T17:37:01.183 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 578463 2026-02-12T17:37:01.211 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:01.246 INFO:tasks.rados.rados.0.trial082.stdout:1902: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:37:01.382 INFO:tasks.rados.rados.0.trial082.stdout:1898: finishing copy_from racing read to trial08226312-49 2026-02-12T17:37:01.382 INFO:tasks.rados.rados.0.trial082.stdout:1898: finishing copy_from to trial08226312-49 2026-02-12T17:37:01.382 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 931 (ObjNum 632 snap 192 seq_num 632) dirty exists 2026-02-12T17:37:01.382 INFO:tasks.rados.rados.0.trial082.stdout:1903: finishing write tid 1 to trial08226312-19 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1903: finishing write tid 2 to trial08226312-19 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1903: finishing write tid 3 to trial08226312-19 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1903: finishing write tid 4 to trial08226312-19 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1903: finishing write tid 5 to trial08226312-19 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1903: oid 19 updating version 0 to 1499 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1903: oid 19 version 1499 is already newer than 1497 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1903: oid 19 version 1499 is already newer than 1498 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1903: oid 19 updating version 1499 to 1500 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 1500 (ObjNum 654 snap 202 seq_num 654) dirty exists 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1903: left oid 19 (ObjNum 654 snap 202 seq_num 654) 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1904: finishing write tid 1 to trial08226312-35 2026-02-12T17:37:01.383 INFO:tasks.rados.rados.0.trial082.stdout:1904: finishing write tid 2 to trial08226312-35 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1897: done (6 left) 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1898: done (5 left) 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1899: done (4 left) 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1902: done (3 left) 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1903: done (2 left) 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1905: done (1 left) 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1906: snap_create 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1904: finishing write tid 3 to trial08226312-35 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1904: finishing write tid 4 to trial08226312-35 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1904: finishing write tid 5 to trial08226312-35 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1904: oid 35 updating version 0 to 1100 2026-02-12T17:37:01.384 INFO:tasks.rados.rados.0.trial082.stdout:1904: oid 35 updating version 1100 to 1101 2026-02-12T17:37:01.385 INFO:tasks.rados.rados.0.trial082.stdout:1904: oid 35 version 1101 is already newer than 1099 2026-02-12T17:37:01.385 INFO:tasks.rados.rados.0.trial082.stdout:1904: oid 35 updating version 1101 to 1102 2026-02-12T17:37:01.385 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1102 (ObjNum 655 snap 202 seq_num 655) dirty exists 2026-02-12T17:37:01.385 INFO:tasks.rados.rados.0.trial082.stdout:1904: left oid 35 (ObjNum 655 snap 202 seq_num 655) 2026-02-12T17:37:02.071 INFO:tasks.rados.rados.0.trial082.stdout:1904: done (1 left) 2026-02-12T17:37:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1906: done (0 left) 2026-02-12T17:37:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1907: read oid 20 snap -1 2026-02-12T17:37:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1907: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:37:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1908: copy_from oid 4 from oid 34 current snap is 203 2026-02-12T17:37:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1909: write oid 35 current snap is 203 2026-02-12T17:37:02.072 INFO:tasks.rados.rados.0.trial082.stdout:1909: seq_num 657 ranges {642199=644951,1696199=605559,2992318=49881} 2026-02-12T17:37:02.076 INFO:tasks.rados.rados.0.trial082.stdout:1909: writing trial08226312-35 from 642199 to 1287150 tid 1 2026-02-12T17:37:02.079 INFO:tasks.rados.rados.0.trial082.stdout:1909: writing trial08226312-35 from 1696199 to 2301758 tid 2 2026-02-12T17:37:02.082 INFO:tasks.rados.rados.0.trial082.stdout:1909: writing trial08226312-35 from 2992318 to 3042199 tid 3 2026-02-12T17:37:02.082 INFO:tasks.rados.rados.0.trial082.stdout:1910: snap_remove snap 199 2026-02-12T17:37:03.059 INFO:tasks.rados.rados.0.trial082.stdout:1910: done (3 left) 2026-02-12T17:37:03.060 INFO:tasks.rados.rados.0.trial082.stdout:1911: delete oid 18 current snap is 203 2026-02-12T17:37:03.060 INFO:tasks.rados.rados.0.trial082.stdout:1907: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:37:03.060 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:03.129 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 761194 2026-02-12T17:37:03.156 INFO:tasks.rados.rados.0.trial082.stdout:1909: finishing write tid 1 to trial08226312-35 2026-02-12T17:37:03.156 INFO:tasks.rados.rados.0.trial082.stdout:1909: finishing write tid 2 to trial08226312-35 2026-02-12T17:37:03.157 INFO:tasks.rados.rados.0.trial082.stdout:1907: done (3 left) 2026-02-12T17:37:03.157 INFO:tasks.rados.rados.0.trial082.stdout:1911: done (2 left) 2026-02-12T17:37:03.157 INFO:tasks.rados.rados.0.trial082.stdout:1912: snap_remove snap 201 2026-02-12T17:37:04.541 INFO:tasks.rados.rados.0.trial082.stdout:1912: done (2 left) 2026-02-12T17:37:04.541 INFO:tasks.rados.rados.0.trial082.stdout:1913: snap_create 2026-02-12T17:37:04.541 INFO:tasks.rados.rados.0.trial082.stdout:1908: finishing copy_from racing read to trial08226312-4 2026-02-12T17:37:04.541 INFO:tasks.rados.rados.0.trial082.stdout:1908: finishing copy_from to trial08226312-4 2026-02-12T17:37:04.541 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 1014 (ObjNum 577 snap 176 seq_num 577) dirty exists 2026-02-12T17:37:04.541 INFO:tasks.rados.rados.0.trial082.stdout:1909: finishing write tid 3 to trial08226312-35 2026-02-12T17:37:04.541 INFO:tasks.rados.rados.0.trial082.stdout:1909: finishing write tid 4 to trial08226312-35 2026-02-12T17:37:04.541 INFO:tasks.rados.rados.0.trial082.stdout:1909: finishing write tid 5 to trial08226312-35 2026-02-12T17:37:04.541 INFO:tasks.rados.rados.0.trial082.stdout:1909: oid 35 updating version 0 to 1105 2026-02-12T17:37:04.542 INFO:tasks.rados.rados.0.trial082.stdout:1909: oid 35 updating version 1105 to 1106 2026-02-12T17:37:04.542 INFO:tasks.rados.rados.0.trial082.stdout:1909: oid 35 version 1106 is already newer than 1103 2026-02-12T17:37:04.542 INFO:tasks.rados.rados.0.trial082.stdout:1909: oid 35 version 1106 is already newer than 1104 2026-02-12T17:37:04.542 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1106 (ObjNum 657 snap 203 seq_num 657) dirty exists 2026-02-12T17:37:04.542 INFO:tasks.rados.rados.0.trial082.stdout:1909: left oid 35 (ObjNum 657 snap 203 seq_num 657) 2026-02-12T17:37:05.543 INFO:tasks.rados.rados.0.trial082.stdout:1908: done (2 left) 2026-02-12T17:37:05.543 INFO:tasks.rados.rados.0.trial082.stdout:1909: done (1 left) 2026-02-12T17:37:05.543 INFO:tasks.rados.rados.0.trial082.stdout:1913: done (0 left) 2026-02-12T17:37:05.544 INFO:tasks.rados.rados.0.trial082.stdout:1914: write oid 47 current snap is 204 2026-02-12T17:37:05.544 INFO:tasks.rados.rados.0.trial082.stdout:1914: seq_num 659 ranges {675813=795449,2096810=609228} 2026-02-12T17:37:05.548 INFO:tasks.rados.rados.0.trial082.stdout:1914: writing trial08226312-47 from 675813 to 1471262 tid 1 2026-02-12T17:37:05.553 INFO:tasks.rados.rados.0.trial082.stdout:1914: writing trial08226312-47 from 2096810 to 2706038 tid 2 2026-02-12T17:37:05.554 INFO:tasks.rados.rados.0.trial082.stdout:1915: rollback oid 28 current snap is 204 2026-02-12T17:37:05.554 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 203 2026-02-12T17:37:05.554 INFO:tasks.rados.rados.0.trial082.stdout:1914: finishing write tid 1 to trial08226312-47 2026-02-12T17:37:05.554 INFO:tasks.rados.rados.0.trial082.stdout:1916: delete oid 42 current snap is 204 2026-02-12T17:37:05.555 INFO:tasks.rados.rados.0.trial082.stdout:1914: finishing write tid 2 to trial08226312-47 2026-02-12T17:37:05.556 INFO:tasks.rados.rados.0.trial082.stdout:1914: finishing write tid 3 to trial08226312-47 2026-02-12T17:37:05.556 INFO:tasks.rados.rados.0.trial082.stdout:1914: finishing write tid 4 to trial08226312-47 2026-02-12T17:37:05.556 INFO:tasks.rados.rados.0.trial082.stdout:1914: oid 47 updating version 0 to 1508 2026-02-12T17:37:05.556 INFO:tasks.rados.rados.0.trial082.stdout:1914: oid 47 updating version 1508 to 1510 2026-02-12T17:37:05.556 INFO:tasks.rados.rados.0.trial082.stdout:1914: oid 47 version 1510 is already newer than 1509 2026-02-12T17:37:05.556 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1510 (ObjNum 659 snap 204 seq_num 659) dirty exists 2026-02-12T17:37:05.556 INFO:tasks.rados.rados.0.trial082.stdout:1914: left oid 47 (ObjNum 659 snap 204 seq_num 659) 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1915: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1915: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1915: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1199 (ObjNum 636 snap 196 seq_num 636) dirty exists 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1914: done (2 left) 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1915: done (1 left) 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1916: done (0 left) 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1917: read oid 31 snap 203 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1917: expect deleted 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1918: read oid 20 snap -1 2026-02-12T17:37:05.558 INFO:tasks.rados.rados.0.trial082.stdout:1918: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:37:05.559 INFO:tasks.rados.rados.0.trial082.stdout:1919: read oid 21 snap -1 2026-02-12T17:37:05.559 INFO:tasks.rados.rados.0.trial082.stdout:1919: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:37:05.559 INFO:tasks.rados.rados.0.trial082.stdout:1920: rollback oid 48 current snap is 204 2026-02-12T17:37:05.559 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 194 2026-02-12T17:37:05.559 INFO:tasks.rados.rados.0.trial082.stdout:1921: read oid 50 snap -1 2026-02-12T17:37:05.559 INFO:tasks.rados.rados.0.trial082.stdout:1921: expect (ObjNum 651 snap 201 seq_num 651) 2026-02-12T17:37:05.559 INFO:tasks.rados.rados.0.trial082.stdout:1922: snap_remove snap 202 2026-02-12T17:37:06.546 INFO:tasks.rados.rados.0.trial082.stdout:1922: done (5 left) 2026-02-12T17:37:06.546 INFO:tasks.rados.rados.0.trial082.stdout:1923: read oid 36 snap -1 2026-02-12T17:37:06.546 INFO:tasks.rados.rados.0.trial082.stdout:1923: expect (ObjNum 610 snap 188 seq_num 610) 2026-02-12T17:37:06.547 INFO:tasks.rados.rados.0.trial082.stdout:1924: write oid 40 current snap is 204 2026-02-12T17:37:06.547 INFO:tasks.rados.rados.0.trial082.stdout:1924: seq_num 661 ranges {709427=545947,1813774=612897,2985657=123770} 2026-02-12T17:37:06.551 INFO:tasks.rados.rados.0.trial082.stdout:1924: writing trial08226312-40 from 709427 to 1255374 tid 1 2026-02-12T17:37:06.555 INFO:tasks.rados.rados.0.trial082.stdout:1924: writing trial08226312-40 from 1813774 to 2426671 tid 2 2026-02-12T17:37:06.558 INFO:tasks.rados.rados.0.trial082.stdout:1924: writing trial08226312-40 from 2985657 to 3109427 tid 3 2026-02-12T17:37:06.558 INFO:tasks.rados.rados.0.trial082.stdout:1925: snap_create 2026-02-12T17:37:06.558 INFO:tasks.rados.rados.0.trial082.stdout:1919: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:37:06.589 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1252591 2026-02-12T17:37:06.604 INFO:tasks.rados.rados.0.trial082.stdout:1918: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:37:06.639 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 693551 2026-02-12T17:37:06.667 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:06.701 INFO:tasks.rados.rados.0.trial082.stdout:1920: finishing rollback tid 0 to trial08226312-48 2026-02-12T17:37:06.701 INFO:tasks.rados.rados.0.trial082.stdout:1920: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:37:06.701 INFO:tasks.rados.rados.0.trial082.stdout:1920: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:37:06.701 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 814 (ObjNum 600 snap 186 seq_num 600) dirty exists 2026-02-12T17:37:06.701 INFO:tasks.rados.rados.0.trial082.stdout:1921: expect (ObjNum 651 snap 201 seq_num 651) 2026-02-12T17:37:06.701 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:06.768 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:06.805 INFO:tasks.rados.rados.0.trial082.stdout:1923: expect (ObjNum 610 snap 188 seq_num 610) 2026-02-12T17:37:06.862 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1597781 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1924: finishing write tid 1 to trial08226312-40 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1924: finishing write tid 2 to trial08226312-40 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1924: finishing write tid 3 to trial08226312-40 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1924: finishing write tid 4 to trial08226312-40 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1924: finishing write tid 5 to trial08226312-40 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1924: oid 40 updating version 0 to 1210 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1924: oid 40 version 1210 is already newer than 1208 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1924: oid 40 version 1210 is already newer than 1207 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:1924: oid 40 version 1210 is already newer than 1209 2026-02-12T17:37:06.899 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1210 (ObjNum 661 snap 204 seq_num 661) dirty exists 2026-02-12T17:37:06.900 INFO:tasks.rados.rados.0.trial082.stdout:1924: left oid 40 (ObjNum 661 snap 204 seq_num 661) 2026-02-12T17:37:07.549 INFO:tasks.rados.rados.0.trial082.stdout:1917: done (7 left) 2026-02-12T17:37:07.549 INFO:tasks.rados.rados.0.trial082.stdout:1918: done (6 left) 2026-02-12T17:37:07.549 INFO:tasks.rados.rados.0.trial082.stdout:1919: done (5 left) 2026-02-12T17:37:07.549 INFO:tasks.rados.rados.0.trial082.stdout:1920: done (4 left) 2026-02-12T17:37:07.549 INFO:tasks.rados.rados.0.trial082.stdout:1921: done (3 left) 2026-02-12T17:37:07.549 INFO:tasks.rados.rados.0.trial082.stdout:1923: done (2 left) 2026-02-12T17:37:07.549 INFO:tasks.rados.rados.0.trial082.stdout:1924: done (1 left) 2026-02-12T17:37:07.550 INFO:tasks.rados.rados.0.trial082.stdout:1925: done (0 left) 2026-02-12T17:37:07.550 INFO:tasks.rados.rados.0.trial082.stdout:1926: delete oid 39 current snap is 205 2026-02-12T17:37:07.551 INFO:tasks.rados.rados.0.trial082.stdout:1926: done (0 left) 2026-02-12T17:37:07.551 INFO:tasks.rados.rados.0.trial082.stdout:1927: write (excl) oid 40 current snap is 205 2026-02-12T17:37:07.551 INFO:tasks.rados.rados.0.trial082.stdout:1927: seq_num 663 ranges {743041=412798,1930738=616566,3040503=102538} 2026-02-12T17:37:07.555 INFO:tasks.rados.rados.0.trial082.stdout:1927: writing trial08226312-40 from 743041 to 1155839 tid 1 2026-02-12T17:37:07.560 INFO:tasks.rados.rados.0.trial082.stdout:1927: writing trial08226312-40 from 1930738 to 2547304 tid 2 2026-02-12T17:37:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1927: writing trial08226312-40 from 3040503 to 3143041 tid 3 2026-02-12T17:37:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1928: read oid 31 snap -1 2026-02-12T17:37:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1928: expect deleted 2026-02-12T17:37:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1929: rollback oid 6 current snap is 205 2026-02-12T17:37:07.563 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 6 to 194 2026-02-12T17:37:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1927: finishing write tid 1 to trial08226312-40 2026-02-12T17:37:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1927: finishing write tid 2 to trial08226312-40 2026-02-12T17:37:07.563 INFO:tasks.rados.rados.0.trial082.stdout:1930: snap_remove snap 204 2026-02-12T17:37:08.062 INFO:tasks.rados.rados.0.trial082.stdout:1930: done (3 left) 2026-02-12T17:37:08.062 INFO:tasks.rados.rados.0.trial082.stdout:1931: copy_from oid 49 from oid 19 current snap is 205 2026-02-12T17:37:08.062 INFO:tasks.rados.rados.0.trial082.stdout:1929: finishing rollback tid 1 to trial08226312-6 2026-02-12T17:37:08.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 0 (ObjNum 65 snap 0 seq_num 1634300532) dirty dne 2026-02-12T17:37:08.062 INFO:tasks.rados.rados.0.trial082.stdout:1927: finishing write tid 3 to trial08226312-40 2026-02-12T17:37:08.062 INFO:tasks.rados.rados.0.trial082.stdout:1927: finishing write tid 4 to trial08226312-40 2026-02-12T17:37:08.062 INFO:tasks.rados.rados.0.trial082.stdout:1927: finishing write tid 5 to trial08226312-40 2026-02-12T17:37:08.062 INFO:tasks.rados.rados.0.trial082.stdout:1927: oid 40 updating version 0 to 1213 2026-02-12T17:37:08.062 INFO:tasks.rados.rados.0.trial082.stdout:1927: oid 40 version 1213 is already newer than 1212 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1927: oid 40 updating version 1213 to 1215 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1927: oid 40 version 1215 is already newer than 1214 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1215 (ObjNum 663 snap 205 seq_num 663) dirty exists 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1927: left oid 40 (ObjNum 663 snap 205 seq_num 663) 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1927: done (3 left) 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1928: done (2 left) 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1929: done (1 left) 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1932: rollback oid 20 current snap is 205 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 20 to 203 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1933: read oid 18 snap 203 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1933: expect deleted 2026-02-12T17:37:08.063 INFO:tasks.rados.rados.0.trial082.stdout:1934: rollback oid 38 current snap is 205 2026-02-12T17:37:08.064 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 194 2026-02-12T17:37:08.064 INFO:tasks.rados.rados.0.trial082.stdout:1935: write oid 50 current snap is 205 2026-02-12T17:37:08.064 INFO:tasks.rados.rados.0.trial082.stdout:1935: seq_num 664 ranges {759848=488047,1989220=760224} 2026-02-12T17:37:08.066 INFO:tasks.rados.rados.0.trial082.stdout:1935: writing trial08226312-50 from 759848 to 1247895 tid 1 2026-02-12T17:37:08.071 INFO:tasks.rados.rados.0.trial082.stdout:1935: writing trial08226312-50 from 1989220 to 2749444 tid 2 2026-02-12T17:37:08.072 INFO:tasks.rados.rados.0.trial082.stdout:1936: read oid 41 snap -1 2026-02-12T17:37:08.072 INFO:tasks.rados.rados.0.trial082.stdout:1936: expect (ObjNum 514 snap 156 seq_num 514) 2026-02-12T17:37:08.072 INFO:tasks.rados.rados.0.trial082.stdout:1937: read oid 14 snap 203 2026-02-12T17:37:08.072 INFO:tasks.rados.rados.0.trial082.stdout:1937: expect (ObjNum 639 snap 196 seq_num 639) 2026-02-12T17:37:08.072 INFO:tasks.rados.rados.0.trial082.stdout:1938: write oid 15 current snap is 205 2026-02-12T17:37:08.072 INFO:tasks.rados.rados.0.trial082.stdout:1938: seq_num 665 ranges {776655=563296,2047702=620235,3095349=81306} 2026-02-12T17:37:08.077 INFO:tasks.rados.rados.0.trial082.stdout:1938: writing trial08226312-15 from 776655 to 1339951 tid 1 2026-02-12T17:37:08.082 INFO:tasks.rados.rados.0.trial082.stdout:1938: writing trial08226312-15 from 2047702 to 2667937 tid 2 2026-02-12T17:37:08.084 INFO:tasks.rados.rados.0.trial082.stdout:1938: writing trial08226312-15 from 3095349 to 3176655 tid 3 2026-02-12T17:37:08.084 INFO:tasks.rados.rados.0.trial082.stdout:1939: write (excl) oid 16 current snap is 205 2026-02-12T17:37:08.084 INFO:tasks.rados.rados.0.trial082.stdout:1939: seq_num 666 ranges {793462=638545,2106184=763893} 2026-02-12T17:37:08.089 INFO:tasks.rados.rados.0.trial082.stdout:1939: writing trial08226312-16 from 793462 to 1432007 tid 1 2026-02-12T17:37:08.095 INFO:tasks.rados.rados.0.trial082.stdout:1939: writing trial08226312-16 from 2106184 to 2870077 tid 2 2026-02-12T17:37:08.095 INFO:tasks.rados.rados.0.trial082.stdout:1940: write oid 32 current snap is 205 2026-02-12T17:37:08.095 INFO:tasks.rados.rados.0.trial082.stdout:1940: seq_num 667 ranges {410269=713794,1648313=507551,2917489=292780} 2026-02-12T17:37:08.099 INFO:tasks.rados.rados.0.trial082.stdout:1940: writing trial08226312-32 from 410269 to 1124063 tid 1 2026-02-12T17:37:08.102 INFO:tasks.rados.rados.0.trial082.stdout:1940: writing trial08226312-32 from 1648313 to 2155864 tid 2 2026-02-12T17:37:08.107 INFO:tasks.rados.rados.0.trial082.stdout:1940: writing trial08226312-32 from 2917489 to 3210269 tid 3 2026-02-12T17:37:08.107 INFO:tasks.rados.rados.0.trial082.stdout:1941: read oid 23 snap -1 2026-02-12T17:37:08.107 INFO:tasks.rados.rados.0.trial082.stdout:1941: expect (ObjNum 634 snap 193 seq_num 634) 2026-02-12T17:37:08.107 INFO:tasks.rados.rados.0.trial082.stdout:1942: write (excl) oid 40 current snap is 205 2026-02-12T17:37:08.107 INFO:tasks.rados.rados.0.trial082.stdout:1942: seq_num 668 ranges {427076=789043,1706795=767562,2944912=282164} 2026-02-12T17:37:08.111 INFO:tasks.rados.rados.0.trial082.stdout:1942: writing trial08226312-40 from 427076 to 1216119 tid 1 2026-02-12T17:37:08.116 INFO:tasks.rados.rados.0.trial082.stdout:1942: writing trial08226312-40 from 1706795 to 2474357 tid 2 2026-02-12T17:37:08.119 INFO:tasks.rados.rados.0.trial082.stdout:1942: writing trial08226312-40 from 2944912 to 3227076 tid 3 2026-02-12T17:37:08.120 INFO:tasks.rados.rados.0.trial082.stdout:1943: rollback oid 21 current snap is 205 2026-02-12T17:37:08.120 INFO:tasks.rados.rados.0.trial082.stdout:1932: finishing rollback tid 0 to trial08226312-20 2026-02-12T17:37:08.120 INFO:tasks.rados.rados.0.trial082.stdout:1932: finishing rollback tid 1 to trial08226312-20 2026-02-12T17:37:08.120 INFO:tasks.rados.rados.0.trial082.stdout:1932: finishing rollback tid 2 to trial08226312-20 2026-02-12T17:37:08.120 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 1514 (ObjNum 626 snap 191 seq_num 626) dirty exists 2026-02-12T17:37:08.120 INFO:tasks.rados.rados.0.trial082.stdout:1931: finishing copy_from racing read to trial08226312-49 2026-02-12T17:37:08.120 INFO:tasks.rados.rados.0.trial082.stdout:1935: finishing write tid 1 to trial08226312-50 2026-02-12T17:37:08.120 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 194 2026-02-12T17:37:08.120 INFO:tasks.rados.rados.0.trial082.stdout:1935: finishing write tid 2 to trial08226312-50 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:1935: finishing write tid 3 to trial08226312-50 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:1935: finishing write tid 4 to trial08226312-50 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:1935: oid 50 updating version 0 to 704 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:1935: oid 50 version 704 is already newer than 703 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:1935: oid 50 updating version 704 to 705 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 705 (ObjNum 664 snap 205 seq_num 664) dirty exists 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:1935: left oid 50 (ObjNum 664 snap 205 seq_num 664) 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:1934: finishing rollback tid 0 to trial08226312-38 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:1934: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:37:08.121 INFO:tasks.rados.rados.0.trial082.stdout:1936: expect (ObjNum 514 snap 156 seq_num 514) 2026-02-12T17:37:08.123 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 824169 2026-02-12T17:37:08.150 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:08.214 INFO:tasks.rados.rados.0.trial082.stdout:1931: finishing copy_from to trial08226312-49 2026-02-12T17:37:08.214 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 1500 (ObjNum 654 snap 202 seq_num 654) dirty exists 2026-02-12T17:37:08.214 INFO:tasks.rados.rados.0.trial082.stdout:1934: finishing rollback tid 2 to trial08226312-38 2026-02-12T17:37:08.214 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 837 (ObjNum 626 snap 191 seq_num 626) dirty exists 2026-02-12T17:37:08.214 INFO:tasks.rados.rados.0.trial082.stdout:1937: expect (ObjNum 639 snap 196 seq_num 639) 2026-02-12T17:37:08.215 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:08.292 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 562079 2026-02-12T17:37:08.325 INFO:tasks.rados.rados.0.trial082.stdout:1938: finishing write tid 1 to trial08226312-15 2026-02-12T17:37:08.325 INFO:tasks.rados.rados.0.trial082.stdout:1938: finishing write tid 2 to trial08226312-15 2026-02-12T17:37:08.325 INFO:tasks.rados.rados.0.trial082.stdout:1931: done (12 left) 2026-02-12T17:37:08.325 INFO:tasks.rados.rados.0.trial082.stdout:1932: done (11 left) 2026-02-12T17:37:08.325 INFO:tasks.rados.rados.0.trial082.stdout:1933: done (10 left) 2026-02-12T17:37:08.325 INFO:tasks.rados.rados.0.trial082.stdout:1934: done (9 left) 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1935: done (8 left) 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1936: done (7 left) 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1937: done (6 left) 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1944: delete oid 25 current snap is 205 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1938: finishing write tid 3 to trial08226312-15 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1938: finishing write tid 4 to trial08226312-15 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1938: finishing write tid 5 to trial08226312-15 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1938: oid 15 updating version 0 to 893 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1938: oid 15 updating version 893 to 896 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1938: oid 15 version 896 is already newer than 895 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:1938: oid 15 version 896 is already newer than 894 2026-02-12T17:37:08.326 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 896 (ObjNum 665 snap 205 seq_num 665) dirty exists 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1938: left oid 15 (ObjNum 665 snap 205 seq_num 665) 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1939: finishing write tid 1 to trial08226312-16 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1939: finishing write tid 2 to trial08226312-16 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1939: finishing write tid 3 to trial08226312-16 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1939: finishing write tid 4 to trial08226312-16 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1939: oid 16 updating version 0 to 1220 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1939: oid 16 version 1220 is already newer than 1218 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1939: oid 16 version 1220 is already newer than 1219 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1220 (ObjNum 666 snap 205 seq_num 666) dirty exists 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1939: left oid 16 (ObjNum 666 snap 205 seq_num 666) 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1940: finishing write tid 1 to trial08226312-32 2026-02-12T17:37:08.327 INFO:tasks.rados.rados.0.trial082.stdout:1940: finishing write tid 2 to trial08226312-32 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:1940: finishing write tid 3 to trial08226312-32 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:1940: finishing write tid 4 to trial08226312-32 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:1940: finishing write tid 5 to trial08226312-32 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:1940: oid 32 updating version 0 to 838 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:1940: oid 32 updating version 838 to 840 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:1940: oid 32 updating version 840 to 841 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:1940: oid 32 version 841 is already newer than 839 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 841 (ObjNum 667 snap 205 seq_num 667) dirty exists 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:1940: left oid 32 (ObjNum 667 snap 205 seq_num 667) 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:1941: expect (ObjNum 634 snap 193 seq_num 634) 2026-02-12T17:37:08.328 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:08.359 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 339205 2026-02-12T17:37:08.392 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:08.428 INFO:tasks.rados.rados.0.trial082.stdout:1942: finishing write tid 1 to trial08226312-40 2026-02-12T17:37:08.428 INFO:tasks.rados.rados.0.trial082.stdout:1942: finishing write tid 2 to trial08226312-40 2026-02-12T17:37:08.428 INFO:tasks.rados.rados.0.trial082.stdout:1942: finishing write tid 3 to trial08226312-40 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1942: finishing write tid 4 to trial08226312-40 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1942: finishing write tid 5 to trial08226312-40 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1942: oid 40 updating version 0 to 1223 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1942: oid 40 version 1223 is already newer than 1221 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1942: oid 40 version 1223 is already newer than 1222 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1942: oid 40 updating version 1223 to 1224 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1224 (ObjNum 668 snap 205 seq_num 668) dirty exists 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1942: left oid 40 (ObjNum 668 snap 205 seq_num 668) 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1943: finishing rollback tid 0 to trial08226312-21 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1943: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1938: done (6 left) 2026-02-12T17:37:08.429 INFO:tasks.rados.rados.0.trial082.stdout:1939: done (5 left) 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1940: done (4 left) 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1941: done (3 left) 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1942: done (2 left) 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1944: done (1 left) 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1945: read oid 6 snap -1 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1945: expect deleted 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1946: rollback oid 28 current snap is 205 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 203 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1943: finishing rollback tid 2 to trial08226312-21 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1105 (ObjNum 533 snap 163 seq_num 533) dirty exists 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1943: done (2 left) 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1947: copy_from oid 22 from oid 18 current snap is 205 2026-02-12T17:37:08.430 INFO:tasks.rados.rados.0.trial082.stdout:1948: write (excl) oid 1 current snap is 205 2026-02-12T17:37:08.431 INFO:tasks.rados.rados.0.trial082.stdout:1948: seq_num 670 ranges {460690=655894,1540112=771231,2716111=539778} 2026-02-12T17:37:08.431 INFO:tasks.rados.rados.0.trial082.stdout:1948: writing trial08226312-1 from 460690 to 1116584 tid 1 2026-02-12T17:37:08.436 INFO:tasks.rados.rados.0.trial082.stdout:1948: writing trial08226312-1 from 1540112 to 2311343 tid 2 2026-02-12T17:37:08.440 INFO:tasks.rados.rados.0.trial082.stdout:1948: writing trial08226312-1 from 2716111 to 3255889 tid 3 2026-02-12T17:37:08.440 INFO:tasks.rados.rados.0.trial082.stdout:1949: delete oid 33 current snap is 205 2026-02-12T17:37:08.440 INFO:tasks.rados.rados.0.trial082.stdout:1947: finishing copy_from to trial08226312-22 2026-02-12T17:37:08.440 INFO:tasks.rados.rados.0.trial082.stdout:1947: got expected ENOENT (src dne) 2026-02-12T17:37:08.440 INFO:tasks.rados.rados.0.trial082.stdout:1947: finishing copy_from racing read to trial08226312-22 2026-02-12T17:37:08.440 INFO:tasks.rados.rados.0.trial082.stdout:1946: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:37:08.440 INFO:tasks.rados.rados.0.trial082.stdout:1946: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:37:08.441 INFO:tasks.rados.rados.0.trial082.stdout:1946: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:37:08.441 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1227 (ObjNum 636 snap 196 seq_num 636) dirty exists 2026-02-12T17:37:08.441 INFO:tasks.rados.rados.0.trial082.stdout:1948: finishing write tid 1 to trial08226312-1 2026-02-12T17:37:08.441 INFO:tasks.rados.rados.0.trial082.stdout:1948: finishing write tid 2 to trial08226312-1 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1945: done (4 left) 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1946: done (3 left) 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1947: done (2 left) 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1949: done (1 left) 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1950: snap_create 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1948: finishing write tid 3 to trial08226312-1 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1948: finishing write tid 4 to trial08226312-1 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1948: finishing write tid 5 to trial08226312-1 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1948: oid 1 updating version 0 to 932 2026-02-12T17:37:08.442 INFO:tasks.rados.rados.0.trial082.stdout:1948: oid 1 updating version 932 to 934 2026-02-12T17:37:08.443 INFO:tasks.rados.rados.0.trial082.stdout:1948: oid 1 version 934 is already newer than 933 2026-02-12T17:37:08.443 INFO:tasks.rados.rados.0.trial082.stdout:1948: oid 1 updating version 934 to 935 2026-02-12T17:37:08.443 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 935 (ObjNum 670 snap 205 seq_num 670) dirty exists 2026-02-12T17:37:08.443 INFO:tasks.rados.rados.0.trial082.stdout:1948: left oid 1 (ObjNum 670 snap 205 seq_num 670) 2026-02-12T17:37:09.060 INFO:tasks.rados.rados.0.trial082.stdout:1948: done (1 left) 2026-02-12T17:37:09.061 INFO:tasks.rados.rados.0.trial082.stdout:1950: done (0 left) 2026-02-12T17:37:09.061 INFO:tasks.rados.rados.0.trial082.stdout:1951: copy_from oid 10 from oid 28 current snap is 206 2026-02-12T17:37:09.061 INFO:tasks.rados.rados.0.trial082.stdout:1952: rollback oid 36 current snap is 206 2026-02-12T17:37:09.061 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 36 to 205 2026-02-12T17:37:09.061 INFO:tasks.rados.rados.0.trial082.stdout:1953: snap_remove snap 194 2026-02-12T17:37:10.061 INFO:tasks.rados.rados.0.trial082.stdout:1953: done (2 left) 2026-02-12T17:37:10.061 INFO:tasks.rados.rados.0.trial082.stdout:1954: write oid 21 current snap is 206 2026-02-12T17:37:10.061 INFO:tasks.rados.rados.0.trial082.stdout:1952: finishing rollback tid 0 to trial08226312-36 2026-02-12T17:37:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1952: finishing rollback tid 1 to trial08226312-36 2026-02-12T17:37:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1952: finishing rollback tid 2 to trial08226312-36 2026-02-12T17:37:10.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 1109 (ObjNum 610 snap 188 seq_num 610) dirty exists 2026-02-12T17:37:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1951: finishing copy_from racing read to trial08226312-10 2026-02-12T17:37:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1951: finishing copy_from to trial08226312-10 2026-02-12T17:37:10.062 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1227 (ObjNum 636 snap 196 seq_num 636) dirty exists 2026-02-12T17:37:10.062 INFO:tasks.rados.rados.0.trial082.stdout:1954: seq_num 672 ranges {494304=406392,1540723=774900,2770957=523347} 2026-02-12T17:37:10.065 INFO:tasks.rados.rados.0.trial082.stdout:1954: writing trial08226312-21 from 494304 to 900696 tid 1 2026-02-12T17:37:10.070 INFO:tasks.rados.rados.0.trial082.stdout:1954: writing trial08226312-21 from 1540723 to 2315623 tid 2 2026-02-12T17:37:10.074 INFO:tasks.rados.rados.0.trial082.stdout:1954: writing trial08226312-21 from 2770957 to 3294304 tid 3 2026-02-12T17:37:10.074 INFO:tasks.rados.rados.0.trial082.stdout:1951: done (2 left) 2026-02-12T17:37:10.074 INFO:tasks.rados.rados.0.trial082.stdout:1952: done (1 left) 2026-02-12T17:37:10.074 INFO:tasks.rados.rados.0.trial082.stdout:1955: delete oid 42 current snap is 206 2026-02-12T17:37:10.074 INFO:tasks.rados.rados.0.trial082.stdout:1954: finishing write tid 1 to trial08226312-21 2026-02-12T17:37:10.074 INFO:tasks.rados.rados.0.trial082.stdout:1954: finishing write tid 2 to trial08226312-21 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1955: done (1 left) 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1956: read oid 17 snap -1 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1956: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1957: copy_from oid 35 from oid 24 current snap is 206 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1958: snap_create 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1954: finishing write tid 3 to trial08226312-21 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1954: finishing write tid 4 to trial08226312-21 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1954: finishing write tid 5 to trial08226312-21 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1954: oid 21 updating version 0 to 1229 2026-02-12T17:37:10.076 INFO:tasks.rados.rados.0.trial082.stdout:1954: oid 21 updating version 1229 to 1231 2026-02-12T17:37:10.077 INFO:tasks.rados.rados.0.trial082.stdout:1954: oid 21 version 1231 is already newer than 1230 2026-02-12T17:37:10.077 INFO:tasks.rados.rados.0.trial082.stdout:1954: oid 21 version 1231 is already newer than 1228 2026-02-12T17:37:10.077 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1231 (ObjNum 672 snap 206 seq_num 672) dirty exists 2026-02-12T17:37:10.077 INFO:tasks.rados.rados.0.trial082.stdout:1954: left oid 21 (ObjNum 672 snap 206 seq_num 672) 2026-02-12T17:37:10.078 INFO:tasks.rados.rados.0.trial082.stdout:1956: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:10.162 INFO:tasks.rados.rados.0.trial082.stdout:1957: finishing copy_from racing read to trial08226312-35 2026-02-12T17:37:10.162 INFO:tasks.rados.rados.0.trial082.stdout:1957: finishing copy_from to trial08226312-35 2026-02-12T17:37:10.162 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1484 (ObjNum 645 snap 197 seq_num 645) dirty exists 2026-02-12T17:37:11.064 INFO:tasks.rados.rados.0.trial082.stdout:1954: done (3 left) 2026-02-12T17:37:11.064 INFO:tasks.rados.rados.0.trial082.stdout:1956: done (2 left) 2026-02-12T17:37:11.064 INFO:tasks.rados.rados.0.trial082.stdout:1957: done (1 left) 2026-02-12T17:37:11.064 INFO:tasks.rados.rados.0.trial082.stdout:1958: done (0 left) 2026-02-12T17:37:11.064 INFO:tasks.rados.rados.0.trial082.stdout:1959: write (excl) oid 25 current snap is 207 2026-02-12T17:37:11.064 INFO:tasks.rados.rados.0.trial082.stdout:1959: seq_num 674 ranges {527918=556890,1657687=778569,3225803=102115} 2026-02-12T17:37:11.068 INFO:tasks.rados.rados.0.trial082.stdout:1959: writing trial08226312-25 from 527918 to 1084808 tid 1 2026-02-12T17:37:11.073 INFO:tasks.rados.rados.0.trial082.stdout:1959: writing trial08226312-25 from 1657687 to 2436256 tid 2 2026-02-12T17:37:11.077 INFO:tasks.rados.rados.0.trial082.stdout:1959: writing trial08226312-25 from 3225803 to 3327918 tid 3 2026-02-12T17:37:11.077 INFO:tasks.rados.rados.0.trial082.stdout:1960: write (excl) oid 2 current snap is 207 2026-02-12T17:37:11.077 INFO:tasks.rados.rados.0.trial082.stdout:1960: seq_num 675 ranges {544725=632139,1716169=522227,2736873=512491} 2026-02-12T17:37:11.081 INFO:tasks.rados.rados.0.trial082.stdout:1960: writing trial08226312-2 from 544725 to 1176864 tid 1 2026-02-12T17:37:11.085 INFO:tasks.rados.rados.0.trial082.stdout:1960: writing trial08226312-2 from 1716169 to 2238396 tid 2 2026-02-12T17:37:11.089 INFO:tasks.rados.rados.0.trial082.stdout:1960: writing trial08226312-2 from 2736873 to 3249364 tid 3 2026-02-12T17:37:11.089 INFO:tasks.rados.rados.0.trial082.stdout:1961: read oid 49 snap 203 2026-02-12T17:37:11.089 INFO:tasks.rados.rados.0.trial082.stdout:1961: expect (ObjNum 632 snap 192 seq_num 632) 2026-02-12T17:37:11.089 INFO:tasks.rados.rados.0.trial082.stdout:1962: write oid 26 current snap is 207 2026-02-12T17:37:11.090 INFO:tasks.rados.rados.0.trial082.stdout:1962: seq_num 676 ranges {561532=707388,2058298=782238} 2026-02-12T17:37:11.093 INFO:tasks.rados.rados.0.trial082.stdout:1962: writing trial08226312-26 from 561532 to 1268920 tid 1 2026-02-12T17:37:11.099 INFO:tasks.rados.rados.0.trial082.stdout:1962: writing trial08226312-26 from 2058298 to 2840536 tid 2 2026-02-12T17:37:11.100 INFO:tasks.rados.rados.0.trial082.stdout:1963: snap_remove snap 206 2026-02-12T17:37:11.100 INFO:tasks.rados.rados.0.trial082.stdout:1959: finishing write tid 1 to trial08226312-25 2026-02-12T17:37:11.100 INFO:tasks.rados.rados.0.trial082.stdout:1959: finishing write tid 2 to trial08226312-25 2026-02-12T17:37:11.100 INFO:tasks.rados.rados.0.trial082.stdout:1959: finishing write tid 3 to trial08226312-25 2026-02-12T17:37:12.066 INFO:tasks.rados.rados.0.trial082.stdout:1963: done (4 left) 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1964: delete oid 28 current snap is 207 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1959: finishing write tid 4 to trial08226312-25 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1959: finishing write tid 5 to trial08226312-25 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1959: oid 25 updating version 0 to 524 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1959: oid 25 version 524 is already newer than 522 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1959: oid 25 version 524 is already newer than 523 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1959: oid 25 updating version 524 to 525 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 525 (ObjNum 674 snap 207 seq_num 674) dirty exists 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1959: left oid 25 (ObjNum 674 snap 207 seq_num 674) 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1960: finishing write tid 1 to trial08226312-2 2026-02-12T17:37:12.067 INFO:tasks.rados.rados.0.trial082.stdout:1960: finishing write tid 2 to trial08226312-2 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:1960: finishing write tid 3 to trial08226312-2 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:1960: finishing write tid 4 to trial08226312-2 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:1960: finishing write tid 5 to trial08226312-2 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:1960: oid 2 updating version 0 to 928 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:1960: oid 2 version 928 is already newer than 927 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:1960: oid 2 updating version 928 to 929 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:1960: oid 2 version 929 is already newer than 926 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 929 (ObjNum 675 snap 207 seq_num 675) dirty exists 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:1960: left oid 2 (ObjNum 675 snap 207 seq_num 675) 2026-02-12T17:37:12.068 INFO:tasks.rados.rados.0.trial082.stdout:1961: expect (ObjNum 632 snap 192 seq_num 632) 2026-02-12T17:37:12.093 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:12.154 INFO:tasks.rados.rados.0.trial082.stdout:1962: finishing write tid 1 to trial08226312-26 2026-02-12T17:37:12.154 INFO:tasks.rados.rados.0.trial082.stdout:1962: finishing write tid 2 to trial08226312-26 2026-02-12T17:37:12.154 INFO:tasks.rados.rados.0.trial082.stdout:1962: finishing write tid 3 to trial08226312-26 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1962: finishing write tid 4 to trial08226312-26 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1962: oid 26 updating version 0 to 1487 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1962: oid 26 version 1487 is already newer than 1485 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1962: oid 26 version 1487 is already newer than 1486 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1487 (ObjNum 676 snap 207 seq_num 676) dirty exists 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1962: left oid 26 (ObjNum 676 snap 207 seq_num 676) 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1959: done (4 left) 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1960: done (3 left) 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1961: done (2 left) 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1962: done (1 left) 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1964: done (0 left) 2026-02-12T17:37:12.155 INFO:tasks.rados.rados.0.trial082.stdout:1965: copy_from oid 28 from oid 22 current snap is 207 2026-02-12T17:37:12.156 INFO:tasks.rados.rados.0.trial082.stdout:1966: copy_from oid 26 from oid 50 current snap is 207 2026-02-12T17:37:12.156 INFO:tasks.rados.rados.0.trial082.stdout:1967: write (excl) oid 38 current snap is 207 2026-02-12T17:37:12.156 INFO:tasks.rados.rados.0.trial082.stdout:1967: seq_num 678 ranges {595146=574239,1891615=669554,3219142=176004} 2026-02-12T17:37:12.158 INFO:tasks.rados.rados.0.trial082.stdout:1967: writing trial08226312-38 from 595146 to 1169385 tid 1 2026-02-12T17:37:12.163 INFO:tasks.rados.rados.0.trial082.stdout:1967: writing trial08226312-38 from 1891615 to 2561169 tid 2 2026-02-12T17:37:12.166 INFO:tasks.rados.rados.0.trial082.stdout:1967: writing trial08226312-38 from 3219142 to 3395146 tid 3 2026-02-12T17:37:12.167 INFO:tasks.rados.rados.0.trial082.stdout:1968: write (excl) oid 13 current snap is 207 2026-02-12T17:37:12.167 INFO:tasks.rados.rados.0.trial082.stdout:1967: finishing write tid 1 to trial08226312-38 2026-02-12T17:37:12.167 INFO:tasks.rados.rados.0.trial082.stdout:1965: finishing copy_from racing read to trial08226312-28 2026-02-12T17:37:12.167 INFO:tasks.rados.rados.0.trial082.stdout:1966: finishing copy_from racing read to trial08226312-26 2026-02-12T17:37:12.167 INFO:tasks.rados.rados.0.trial082.stdout:1968: seq_num 679 ranges {611953=649488,1950097=529565,3246565=165388} 2026-02-12T17:37:12.171 INFO:tasks.rados.rados.0.trial082.stdout:1968: writing trial08226312-13 from 611953 to 1261441 tid 1 2026-02-12T17:37:12.175 INFO:tasks.rados.rados.0.trial082.stdout:1968: writing trial08226312-13 from 1950097 to 2479662 tid 2 2026-02-12T17:37:12.179 INFO:tasks.rados.rados.0.trial082.stdout:1968: writing trial08226312-13 from 3246565 to 3411953 tid 3 2026-02-12T17:37:12.179 INFO:tasks.rados.rados.0.trial082.stdout:1969: write oid 36 current snap is 207 2026-02-12T17:37:12.179 INFO:tasks.rados.rados.0.trial082.stdout:1969: seq_num 680 ranges {628760=724737,1892226=673223,3157635=271125} 2026-02-12T17:37:12.184 INFO:tasks.rados.rados.0.trial082.stdout:1969: writing trial08226312-36 from 628760 to 1353497 tid 1 2026-02-12T17:37:12.188 INFO:tasks.rados.rados.0.trial082.stdout:1969: writing trial08226312-36 from 1892226 to 2565449 tid 2 2026-02-12T17:37:12.192 INFO:tasks.rados.rados.0.trial082.stdout:1969: writing trial08226312-36 from 3157635 to 3428760 tid 3 2026-02-12T17:37:12.192 INFO:tasks.rados.rados.0.trial082.stdout:1970: write (excl) oid 5 current snap is 207 2026-02-12T17:37:12.192 INFO:tasks.rados.rados.0.trial082.stdout:1970: seq_num 681 ranges {645567=799986,1950708=533234,3185058=260509} 2026-02-12T17:37:12.197 INFO:tasks.rados.rados.0.trial082.stdout:1970: writing trial08226312-5 from 645567 to 1445553 tid 1 2026-02-12T17:37:12.201 INFO:tasks.rados.rados.0.trial082.stdout:1970: writing trial08226312-5 from 1950708 to 2483942 tid 2 2026-02-12T17:37:12.206 INFO:tasks.rados.rados.0.trial082.stdout:1970: writing trial08226312-5 from 3185058 to 3445567 tid 3 2026-02-12T17:37:12.206 INFO:tasks.rados.rados.0.trial082.stdout:1971: rollback oid 21 current snap is 207 2026-02-12T17:37:12.206 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 203 2026-02-12T17:37:12.206 INFO:tasks.rados.rados.0.trial082.stdout:1967: finishing write tid 2 to trial08226312-38 2026-02-12T17:37:12.206 INFO:tasks.rados.rados.0.trial082.stdout:1966: finishing copy_from to trial08226312-26 2026-02-12T17:37:12.206 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 705 (ObjNum 664 snap 205 seq_num 664) dirty exists 2026-02-12T17:37:12.206 INFO:tasks.rados.rados.0.trial082.stdout:1965: finishing copy_from to trial08226312-28 2026-02-12T17:37:12.206 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1095 (ObjNum 532 snap 163 seq_num 532) dirty exists 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1967: finishing write tid 3 to trial08226312-38 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1967: finishing write tid 4 to trial08226312-38 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1967: finishing write tid 5 to trial08226312-38 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1967: oid 38 updating version 0 to 845 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1967: oid 38 version 845 is already newer than 844 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1967: oid 38 version 845 is already newer than 842 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1967: oid 38 version 845 is already newer than 843 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 845 (ObjNum 678 snap 207 seq_num 678) dirty exists 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1967: left oid 38 (ObjNum 678 snap 207 seq_num 678) 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1968: finishing write tid 1 to trial08226312-13 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1968: finishing write tid 2 to trial08226312-13 2026-02-12T17:37:12.207 INFO:tasks.rados.rados.0.trial082.stdout:1968: finishing write tid 3 to trial08226312-13 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1968: finishing write tid 4 to trial08226312-13 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1968: finishing write tid 5 to trial08226312-13 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1968: oid 13 updating version 0 to 527 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1968: oid 13 version 527 is already newer than 526 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1968: oid 13 updating version 527 to 528 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1968: oid 13 updating version 528 to 529 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 529 (ObjNum 679 snap 207 seq_num 679) dirty exists 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1968: left oid 13 (ObjNum 679 snap 207 seq_num 679) 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1969: finishing write tid 1 to trial08226312-36 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1965: done (6 left) 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1966: done (5 left) 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1967: done (4 left) 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1968: done (3 left) 2026-02-12T17:37:12.208 INFO:tasks.rados.rados.0.trial082.stdout:1972: write (excl) oid 23 current snap is 207 2026-02-12T17:37:12.209 INFO:tasks.rados.rados.0.trial082.stdout:1972: seq_num 682 ranges {662374=475235,1609190=676892,2812481=624101} 2026-02-12T17:37:12.209 INFO:tasks.rados.rados.0.trial082.stdout:1972: writing trial08226312-23 from 662374 to 1137609 tid 1 2026-02-12T17:37:12.213 INFO:tasks.rados.rados.0.trial082.stdout:1972: writing trial08226312-23 from 1609190 to 2286082 tid 2 2026-02-12T17:37:12.218 INFO:tasks.rados.rados.0.trial082.stdout:1972: writing trial08226312-23 from 2812481 to 3436582 tid 3 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1973: copy_from oid 7 from oid 14 current snap is 207 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1969: finishing write tid 2 to trial08226312-36 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1969: finishing write tid 3 to trial08226312-36 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1969: finishing write tid 4 to trial08226312-36 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1969: finishing write tid 5 to trial08226312-36 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1969: oid 36 updating version 0 to 1490 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1969: oid 36 updating version 1490 to 1491 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1969: oid 36 version 1491 is already newer than 1488 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1969: oid 36 version 1491 is already newer than 1489 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 1491 (ObjNum 680 snap 207 seq_num 680) dirty exists 2026-02-12T17:37:12.219 INFO:tasks.rados.rados.0.trial082.stdout:1969: left oid 36 (ObjNum 680 snap 207 seq_num 680) 2026-02-12T17:37:12.220 INFO:tasks.rados.rados.0.trial082.stdout:1970: finishing write tid 1 to trial08226312-5 2026-02-12T17:37:12.220 INFO:tasks.rados.rados.0.trial082.stdout:1970: finishing write tid 2 to trial08226312-5 2026-02-12T17:37:12.220 INFO:tasks.rados.rados.0.trial082.stdout:1969: done (4 left) 2026-02-12T17:37:12.220 INFO:tasks.rados.rados.0.trial082.stdout:1974: write (excl) oid 10 current snap is 207 2026-02-12T17:37:12.220 INFO:tasks.rados.rados.0.trial082.stdout:1974: seq_num 683 ranges {679181=550484,1667672=536903,2839904=435373} 2026-02-12T17:37:12.223 INFO:tasks.rados.rados.0.trial082.stdout:1974: writing trial08226312-10 from 679181 to 1229665 tid 1 2026-02-12T17:37:12.226 INFO:tasks.rados.rados.0.trial082.stdout:1974: writing trial08226312-10 from 1667672 to 2204575 tid 2 2026-02-12T17:37:12.231 INFO:tasks.rados.rados.0.trial082.stdout:1974: writing trial08226312-10 from 2839904 to 3275277 tid 3 2026-02-12T17:37:12.231 INFO:tasks.rados.rados.0.trial082.stdout:1975: rollback oid 12 current snap is 207 2026-02-12T17:37:12.231 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 203 2026-02-12T17:37:12.231 INFO:tasks.rados.rados.0.trial082.stdout:1970: finishing write tid 3 to trial08226312-5 2026-02-12T17:37:12.231 INFO:tasks.rados.rados.0.trial082.stdout:1970: finishing write tid 4 to trial08226312-5 2026-02-12T17:37:12.231 INFO:tasks.rados.rados.0.trial082.stdout:1970: finishing write tid 5 to trial08226312-5 2026-02-12T17:37:12.232 INFO:tasks.rados.rados.0.trial082.stdout:1970: oid 5 updating version 0 to 898 2026-02-12T17:37:12.232 INFO:tasks.rados.rados.0.trial082.stdout:1970: oid 5 updating version 898 to 899 2026-02-12T17:37:12.232 INFO:tasks.rados.rados.0.trial082.stdout:1970: oid 5 version 899 is already newer than 897 2026-02-12T17:37:12.232 INFO:tasks.rados.rados.0.trial082.stdout:1970: oid 5 updating version 899 to 900 2026-02-12T17:37:12.232 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 900 (ObjNum 681 snap 207 seq_num 681) dirty exists 2026-02-12T17:37:12.232 INFO:tasks.rados.rados.0.trial082.stdout:1970: left oid 5 (ObjNum 681 snap 207 seq_num 681) 2026-02-12T17:37:12.232 INFO:tasks.rados.rados.0.trial082.stdout:1971: finishing rollback tid 0 to trial08226312-21 2026-02-12T17:37:12.232 INFO:tasks.rados.rados.0.trial082.stdout:1970: done (5 left) 2026-02-12T17:37:12.232 INFO:tasks.rados.rados.0.trial082.stdout:1976: snap_remove snap 205 2026-02-12T17:37:13.062 INFO:tasks.rados.rados.0.trial082.stdout:1976: done (5 left) 2026-02-12T17:37:13.063 INFO:tasks.rados.rados.0.trial082.stdout:1977: copy_from oid 13 from oid 29 current snap is 207 2026-02-12T17:37:13.063 INFO:tasks.rados.rados.0.trial082.stdout:1971: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:37:13.063 INFO:tasks.rados.rados.0.trial082.stdout:1971: finishing rollback tid 2 to trial08226312-21 2026-02-12T17:37:13.063 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1234 (ObjNum 533 snap 163 seq_num 533) dirty exists 2026-02-12T17:37:13.063 INFO:tasks.rados.rados.0.trial082.stdout:1972: finishing write tid 1 to trial08226312-23 2026-02-12T17:37:13.063 INFO:tasks.rados.rados.0.trial082.stdout:1972: finishing write tid 2 to trial08226312-23 2026-02-12T17:37:13.063 INFO:tasks.rados.rados.0.trial082.stdout:1972: finishing write tid 3 to trial08226312-23 2026-02-12T17:37:13.063 INFO:tasks.rados.rados.0.trial082.stdout:1972: finishing write tid 4 to trial08226312-23 2026-02-12T17:37:13.063 INFO:tasks.rados.rados.0.trial082.stdout:1972: finishing write tid 5 to trial08226312-23 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1972: oid 23 updating version 0 to 1494 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1972: oid 23 version 1494 is already newer than 1493 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1972: oid 23 updating version 1494 to 1495 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1972: oid 23 version 1495 is already newer than 1492 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 1495 (ObjNum 682 snap 207 seq_num 682) dirty exists 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1972: left oid 23 (ObjNum 682 snap 207 seq_num 682) 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1973: finishing copy_from racing read to trial08226312-7 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1971: done (5 left) 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1972: done (4 left) 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1978: write (excl) oid 9 current snap is 207 2026-02-12T17:37:13.064 INFO:tasks.rados.rados.0.trial082.stdout:1978: seq_num 684 ranges {695988=625733,2009801=680561,3150974=345014} 2026-02-12T17:37:13.067 INFO:tasks.rados.rados.0.trial082.stdout:1978: writing trial08226312-9 from 695988 to 1321721 tid 1 2026-02-12T17:37:13.072 INFO:tasks.rados.rados.0.trial082.stdout:1978: writing trial08226312-9 from 2009801 to 2690362 tid 2 2026-02-12T17:37:13.075 INFO:tasks.rados.rados.0.trial082.stdout:1978: writing trial08226312-9 from 3150974 to 3495988 tid 3 2026-02-12T17:37:13.075 INFO:tasks.rados.rados.0.trial082.stdout:1979: write oid 26 current snap is 207 2026-02-12T17:37:13.075 INFO:tasks.rados.rados.0.trial082.stdout:1979: seq_num 685 ranges {712795=417335,1784636=540572,2894750=457917} 2026-02-12T17:37:13.079 INFO:tasks.rados.rados.0.trial082.stdout:1979: writing trial08226312-26 from 712795 to 1130130 tid 1 2026-02-12T17:37:13.084 INFO:tasks.rados.rados.0.trial082.stdout:1979: writing trial08226312-26 from 1784636 to 2325208 tid 2 2026-02-12T17:37:13.088 INFO:tasks.rados.rados.0.trial082.stdout:1979: writing trial08226312-26 from 2894750 to 3352667 tid 3 2026-02-12T17:37:13.088 INFO:tasks.rados.rados.0.trial082.stdout:1980: write (excl) oid 8 current snap is 207 2026-02-12T17:37:13.088 INFO:tasks.rados.rados.0.trial082.stdout:1980: seq_num 686 ranges {729602=492584,1843118=684230,3322173=207429} 2026-02-12T17:37:13.092 INFO:tasks.rados.rados.0.trial082.stdout:1980: writing trial08226312-8 from 729602 to 1222186 tid 1 2026-02-12T17:37:13.097 INFO:tasks.rados.rados.0.trial082.stdout:1980: writing trial08226312-8 from 1843118 to 2527348 tid 2 2026-02-12T17:37:13.101 INFO:tasks.rados.rados.0.trial082.stdout:1980: writing trial08226312-8 from 3322173 to 3529602 tid 3 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:1981: write oid 37 current snap is 207 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:1973: finishing copy_from to trial08226312-7 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 891 (ObjNum 639 snap 196 seq_num 639) dirty exists 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:1974: finishing write tid 1 to trial08226312-10 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:1974: finishing write tid 2 to trial08226312-10 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:1975: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 0 (ObjNum 33 snap 0 seq_num 26940880) dirty dne 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:1974: finishing write tid 3 to trial08226312-10 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:1974: finishing write tid 4 to trial08226312-10 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:1974: finishing write tid 5 to trial08226312-10 2026-02-12T17:37:13.102 INFO:tasks.rados.rados.0.trial082.stdout:1974: oid 10 updating version 0 to 1238 2026-02-12T17:37:13.103 INFO:tasks.rados.rados.0.trial082.stdout:1974: oid 10 version 1238 is already newer than 1237 2026-02-12T17:37:13.103 INFO:tasks.rados.rados.0.trial082.stdout:1974: oid 10 version 1238 is already newer than 1236 2026-02-12T17:37:13.103 INFO:tasks.rados.rados.0.trial082.stdout:1974: oid 10 version 1238 is already newer than 1235 2026-02-12T17:37:13.103 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1238 (ObjNum 683 snap 207 seq_num 683) dirty exists 2026-02-12T17:37:13.103 INFO:tasks.rados.rados.0.trial082.stdout:1974: left oid 10 (ObjNum 683 snap 207 seq_num 683) 2026-02-12T17:37:13.103 INFO:tasks.rados.rados.0.trial082.stdout:1981: seq_num 687 ranges {746409=567833,1901600=544241,3065949=480460} 2026-02-12T17:37:13.105 INFO:tasks.rados.rados.0.trial082.stdout:1981: writing trial08226312-37 from 746409 to 1314242 tid 1 2026-02-12T17:37:13.110 INFO:tasks.rados.rados.0.trial082.stdout:1981: writing trial08226312-37 from 1901600 to 2445841 tid 2 2026-02-12T17:37:13.115 INFO:tasks.rados.rados.0.trial082.stdout:1981: writing trial08226312-37 from 3065949 to 3546409 tid 3 2026-02-12T17:37:13.115 INFO:tasks.rados.rados.0.trial082.stdout:1973: done (7 left) 2026-02-12T17:37:13.115 INFO:tasks.rados.rados.0.trial082.stdout:1974: done (6 left) 2026-02-12T17:37:13.115 INFO:tasks.rados.rados.0.trial082.stdout:1975: done (5 left) 2026-02-12T17:37:13.115 INFO:tasks.rados.rados.0.trial082.stdout:1982: read oid 33 snap -1 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1982: expect deleted 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1983: read oid 44 snap -1 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1983: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1984: snap_remove snap 203 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1977: finishing copy_from to trial08226312-13 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1977: got expected ENOENT (src dne) 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1977: finishing copy_from racing read to trial08226312-13 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1978: finishing write tid 1 to trial08226312-9 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1978: finishing write tid 2 to trial08226312-9 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1978: finishing write tid 3 to trial08226312-9 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1978: finishing write tid 4 to trial08226312-9 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1978: finishing write tid 5 to trial08226312-9 2026-02-12T17:37:13.116 INFO:tasks.rados.rados.0.trial082.stdout:1978: oid 9 updating version 0 to 1246 2026-02-12T17:37:13.117 INFO:tasks.rados.rados.0.trial082.stdout:1978: oid 9 updating version 1246 to 1247 2026-02-12T17:37:13.117 INFO:tasks.rados.rados.0.trial082.stdout:1978: oid 9 updating version 1247 to 1248 2026-02-12T17:37:13.117 INFO:tasks.rados.rados.0.trial082.stdout:1978: oid 9 version 1248 is already newer than 1245 2026-02-12T17:37:13.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 1248 (ObjNum 684 snap 207 seq_num 684) dirty exists 2026-02-12T17:37:13.117 INFO:tasks.rados.rados.0.trial082.stdout:1978: left oid 9 (ObjNum 684 snap 207 seq_num 684) 2026-02-12T17:37:13.117 INFO:tasks.rados.rados.0.trial082.stdout:1979: finishing write tid 1 to trial08226312-26 2026-02-12T17:37:13.117 INFO:tasks.rados.rados.0.trial082.stdout:1979: finishing write tid 2 to trial08226312-26 2026-02-12T17:37:13.117 INFO:tasks.rados.rados.0.trial082.stdout:1979: finishing write tid 3 to trial08226312-26 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1977: done (7 left) 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1978: done (6 left) 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1984: done (5 left) 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1985: read oid 27 snap -1 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1985: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1986: read oid 39 snap -1 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1986: expect deleted 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1987: delete oid 41 current snap is 207 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1979: finishing write tid 4 to trial08226312-26 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1979: finishing write tid 5 to trial08226312-26 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1979: oid 26 updating version 0 to 1498 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1979: oid 26 version 1498 is already newer than 1497 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1979: oid 26 updating version 1498 to 1499 2026-02-12T17:37:14.071 INFO:tasks.rados.rados.0.trial082.stdout:1979: oid 26 version 1499 is already newer than 1496 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1499 (ObjNum 685 snap 207 seq_num 685) dirty exists 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1979: left oid 26 (ObjNum 685 snap 207 seq_num 685) 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: finishing write tid 1 to trial08226312-8 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: finishing write tid 2 to trial08226312-8 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: finishing write tid 3 to trial08226312-8 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: finishing write tid 4 to trial08226312-8 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: finishing write tid 5 to trial08226312-8 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: oid 8 updating version 0 to 1521 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: oid 8 version 1521 is already newer than 1519 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: oid 8 version 1521 is already newer than 1520 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: oid 8 updating version 1521 to 1522 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1522 (ObjNum 686 snap 207 seq_num 686) dirty exists 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1980: left oid 8 (ObjNum 686 snap 207 seq_num 686) 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: finishing write tid 1 to trial08226312-37 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: finishing write tid 2 to trial08226312-37 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: finishing write tid 3 to trial08226312-37 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: finishing write tid 4 to trial08226312-37 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: finishing write tid 5 to trial08226312-37 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: oid 37 updating version 0 to 1095 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: oid 37 version 1095 is already newer than 1094 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: oid 37 updating version 1095 to 1096 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: oid 37 version 1096 is already newer than 1093 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1096 (ObjNum 687 snap 207 seq_num 687) dirty exists 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1981: left oid 37 (ObjNum 687 snap 207 seq_num 687) 2026-02-12T17:37:14.072 INFO:tasks.rados.rados.0.trial082.stdout:1983: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:14.099 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:14.161 INFO:tasks.rados.rados.0.trial082.stdout:1979: done (7 left) 2026-02-12T17:37:14.161 INFO:tasks.rados.rados.0.trial082.stdout:1980: done (6 left) 2026-02-12T17:37:14.161 INFO:tasks.rados.rados.0.trial082.stdout:1981: done (5 left) 2026-02-12T17:37:14.161 INFO:tasks.rados.rados.0.trial082.stdout:1982: done (4 left) 2026-02-12T17:37:14.161 INFO:tasks.rados.rados.0.trial082.stdout:1983: done (3 left) 2026-02-12T17:37:14.161 INFO:tasks.rados.rados.0.trial082.stdout:1986: done (2 left) 2026-02-12T17:37:14.161 INFO:tasks.rados.rados.0.trial082.stdout:1987: done (1 left) 2026-02-12T17:37:14.161 INFO:tasks.rados.rados.0.trial082.stdout:1988: snap_create 2026-02-12T17:37:14.161 INFO:tasks.rados.rados.0.trial082.stdout:1985: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:14.165 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1433633 2026-02-12T17:37:14.188 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:15.074 INFO:tasks.rados.rados.0.trial082.stdout:1985: done (1 left) 2026-02-12T17:37:15.074 INFO:tasks.rados.rados.0.trial082.stdout:1988: done (0 left) 2026-02-12T17:37:15.075 INFO:tasks.rados.rados.0.trial082.stdout:1989: snap_remove snap 207 2026-02-12T17:37:16.076 INFO:tasks.rados.rados.0.trial082.stdout:1989: done (0 left) 2026-02-12T17:37:16.076 INFO:tasks.rados.rados.0.trial082.stdout:1990: rollback oid 4 current snap is 208 2026-02-12T17:37:16.076 INFO:tasks.rados.rados.0.trial082.stdout:1990: done (0 left) 2026-02-12T17:37:16.076 INFO:tasks.rados.rados.0.trial082.stdout:1991: copy_from oid 37 from oid 1 current snap is 208 2026-02-12T17:37:16.076 INFO:tasks.rados.rados.0.trial082.stdout:1992: delete oid 2 current snap is 208 2026-02-12T17:37:16.078 INFO:tasks.rados.rados.0.trial082.stdout:1992: done (1 left) 2026-02-12T17:37:16.078 INFO:tasks.rados.rados.0.trial082.stdout:1993: write oid 12 current snap is 208 2026-02-12T17:37:16.078 INFO:tasks.rados.rados.0.trial082.stdout:1993: seq_num 690 ranges {796830=793580,2360693=691568} 2026-02-12T17:37:16.085 INFO:tasks.rados.rados.0.trial082.stdout:1993: writing trial08226312-12 from 796830 to 1590410 tid 1 2026-02-12T17:37:16.091 INFO:tasks.rados.rados.0.trial082.stdout:1993: writing trial08226312-12 from 2360693 to 3052261 tid 2 2026-02-12T17:37:16.091 INFO:tasks.rados.rados.0.trial082.stdout:1994: write oid 50 current snap is 208 2026-02-12T17:37:16.091 INFO:tasks.rados.rados.0.trial082.stdout:1994: seq_num 691 ranges {413637=468829,1619175=435226,2542935=758255} 2026-02-12T17:37:16.094 INFO:tasks.rados.rados.0.trial082.stdout:1994: writing trial08226312-50 from 413637 to 882466 tid 1 2026-02-12T17:37:16.098 INFO:tasks.rados.rados.0.trial082.stdout:1994: writing trial08226312-50 from 1619175 to 2054401 tid 2 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1994: writing trial08226312-50 from 2542935 to 3301190 tid 3 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1995: read oid 17 snap -1 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1995: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1996: copy_from oid 40 from oid 34 current snap is 208 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1991: finishing copy_from racing read to trial08226312-37 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1991: finishing copy_from to trial08226312-37 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 935 (ObjNum 670 snap 205 seq_num 670) dirty exists 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1993: finishing write tid 1 to trial08226312-12 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1993: finishing write tid 2 to trial08226312-12 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1993: finishing write tid 3 to trial08226312-12 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1993: finishing write tid 4 to trial08226312-12 2026-02-12T17:37:16.103 INFO:tasks.rados.rados.0.trial082.stdout:1993: oid 12 updating version 0 to 1100 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1993: oid 12 version 1100 is already newer than 1099 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1993: oid 12 version 1100 is already newer than 1098 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1100 (ObjNum 690 snap 208 seq_num 690) dirty exists 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1993: left oid 12 (ObjNum 690 snap 208 seq_num 690) 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1994: finishing write tid 1 to trial08226312-50 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1991: done (4 left) 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1993: done (3 left) 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1997: read oid 2 snap -1 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1997: expect deleted 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1998: read oid 21 snap -1 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1998: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1999: copy_from oid 37 from oid 4 current snap is 208 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:1994: finishing write tid 2 to trial08226312-50 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:2000: write (excl) oid 33 current snap is 208 2026-02-12T17:37:16.104 INFO:tasks.rados.rados.0.trial082.stdout:2000: seq_num 692 ranges {430444=660431,1677657=695237,2970358=569527} 2026-02-12T17:37:16.107 INFO:tasks.rados.rados.0.trial082.stdout:2000: writing trial08226312-33 from 430444 to 1090875 tid 1 2026-02-12T17:37:16.112 INFO:tasks.rados.rados.0.trial082.stdout:2000: writing trial08226312-33 from 1677657 to 2372894 tid 2 2026-02-12T17:37:16.116 INFO:tasks.rados.rados.0.trial082.stdout:2000: writing trial08226312-33 from 2970358 to 3539885 tid 3 2026-02-12T17:37:16.116 INFO:tasks.rados.rados.0.trial082.stdout:2001: write (excl) oid 22 current snap is 208 2026-02-12T17:37:16.116 INFO:tasks.rados.rados.0.trial082.stdout:2001: seq_num 693 ranges {447251=735680,1736139=438895,2597781=780799} 2026-02-12T17:37:16.120 INFO:tasks.rados.rados.0.trial082.stdout:2001: writing trial08226312-22 from 447251 to 1182931 tid 1 2026-02-12T17:37:16.124 INFO:tasks.rados.rados.0.trial082.stdout:2001: writing trial08226312-22 from 1736139 to 2175034 tid 2 2026-02-12T17:37:16.129 INFO:tasks.rados.rados.0.trial082.stdout:2001: writing trial08226312-22 from 2597781 to 3378580 tid 3 2026-02-12T17:37:16.129 INFO:tasks.rados.rados.0.trial082.stdout:2002: read oid 29 snap -1 2026-02-12T17:37:16.129 INFO:tasks.rados.rados.0.trial082.stdout:2002: expect deleted 2026-02-12T17:37:16.129 INFO:tasks.rados.rados.0.trial082.stdout:2003: delete oid 14 current snap is 208 2026-02-12T17:37:16.129 INFO:tasks.rados.rados.0.trial082.stdout:1995: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:16.133 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1329059 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:1994: finishing write tid 3 to trial08226312-50 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:1994: finishing write tid 4 to trial08226312-50 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:1994: finishing write tid 5 to trial08226312-50 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:1994: oid 50 updating version 0 to 707 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:1994: oid 50 updating version 707 to 708 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:1994: oid 50 updating version 708 to 709 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:1994: oid 50 version 709 is already newer than 706 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 709 (ObjNum 691 snap 208 seq_num 691) dirty exists 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:1994: left oid 50 (ObjNum 691 snap 208 seq_num 691) 2026-02-12T17:37:16.213 INFO:tasks.rados.rados.0.trial082.stdout:1998: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:37:16.234 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:1996: finishing copy_from racing read to trial08226312-40 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:1994: done (9 left) 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:1995: done (8 left) 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:1997: done (7 left) 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:1998: done (6 left) 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:2003: done (5 left) 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:2004: read oid 10 snap -1 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:2004: expect (ObjNum 683 snap 207 seq_num 683) 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:1996: finishing copy_from to trial08226312-40 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1014 (ObjNum 577 snap 176 seq_num 577) dirty exists 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:1999: finishing copy_from racing read to trial08226312-37 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:2000: finishing write tid 1 to trial08226312-33 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:1996: done (5 left) 2026-02-12T17:37:16.276 INFO:tasks.rados.rados.0.trial082.stdout:2005: write (excl) oid 48 current snap is 208 2026-02-12T17:37:16.277 INFO:tasks.rados.rados.0.trial082.stdout:2005: seq_num 695 ranges {480865=486178,1453103=442564,2652627=519696} 2026-02-12T17:37:16.279 INFO:tasks.rados.rados.0.trial082.stdout:2005: writing trial08226312-48 from 480865 to 967043 tid 1 2026-02-12T17:37:16.283 INFO:tasks.rados.rados.0.trial082.stdout:2005: writing trial08226312-48 from 1453103 to 1895667 tid 2 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2005: writing trial08226312-48 from 2652627 to 3172323 tid 3 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2006: rollback oid 14 current snap is 208 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2006: done (6 left) 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2007: delete oid 43 current snap is 208 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:1999: finishing copy_from to trial08226312-37 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1014 (ObjNum 577 snap 176 seq_num 577) dirty exists 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2000: finishing write tid 2 to trial08226312-33 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2000: finishing write tid 3 to trial08226312-33 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2000: finishing write tid 4 to trial08226312-33 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2000: finishing write tid 5 to trial08226312-33 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2000: oid 33 updating version 0 to 1101 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2000: oid 33 updating version 1101 to 1102 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2000: oid 33 updating version 1102 to 1104 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2000: oid 33 version 1104 is already newer than 1103 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1104 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2000: left oid 33 (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: finishing write tid 1 to trial08226312-22 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: finishing write tid 2 to trial08226312-22 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: finishing write tid 3 to trial08226312-22 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: finishing write tid 4 to trial08226312-22 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: finishing write tid 5 to trial08226312-22 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: oid 22 updating version 0 to 1240 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: oid 22 updating version 1240 to 1242 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: oid 22 version 1242 is already newer than 1241 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: oid 22 version 1242 is already newer than 1239 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 1242 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2001: left oid 22 (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:37:16.288 INFO:tasks.rados.rados.0.trial082.stdout:2004: expect (ObjNum 683 snap 207 seq_num 683) 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2005: finishing write tid 1 to trial08226312-48 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:1999: done (6 left) 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2000: done (5 left) 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2001: done (4 left) 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2002: done (3 left) 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2004: done (2 left) 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2007: done (1 left) 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2008: rollback oid 30 current snap is 208 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2008: done (1 left) 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2009: snap_create 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2005: finishing write tid 2 to trial08226312-48 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2005: finishing write tid 3 to trial08226312-48 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2005: finishing write tid 4 to trial08226312-48 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2005: finishing write tid 5 to trial08226312-48 2026-02-12T17:37:16.486 INFO:tasks.rados.rados.0.trial082.stdout:2005: oid 48 updating version 0 to 817 2026-02-12T17:37:16.487 INFO:tasks.rados.rados.0.trial082.stdout:2005: oid 48 version 817 is already newer than 815 2026-02-12T17:37:16.487 INFO:tasks.rados.rados.0.trial082.stdout:2005: oid 48 version 817 is already newer than 816 2026-02-12T17:37:16.487 INFO:tasks.rados.rados.0.trial082.stdout:2005: oid 48 updating version 817 to 818 2026-02-12T17:37:16.487 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 818 (ObjNum 695 snap 208 seq_num 695) dirty exists 2026-02-12T17:37:16.487 INFO:tasks.rados.rados.0.trial082.stdout:2005: left oid 48 (ObjNum 695 snap 208 seq_num 695) 2026-02-12T17:37:17.082 INFO:tasks.rados.rados.0.trial082.stdout:2005: done (1 left) 2026-02-12T17:37:17.082 INFO:tasks.rados.rados.0.trial082.stdout:2009: done (0 left) 2026-02-12T17:37:17.082 INFO:tasks.rados.rados.0.trial082.stdout:2010: read oid 21 snap -1 2026-02-12T17:37:17.082 INFO:tasks.rados.rados.0.trial082.stdout:2010: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:37:17.082 INFO:tasks.rados.rados.0.trial082.stdout:2011: read oid 25 snap -1 2026-02-12T17:37:17.082 INFO:tasks.rados.rados.0.trial082.stdout:2011: expect (ObjNum 674 snap 207 seq_num 674) 2026-02-12T17:37:17.082 INFO:tasks.rados.rados.0.trial082.stdout:2012: rollback oid 11 current snap is 209 2026-02-12T17:37:17.083 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 208 2026-02-12T17:37:17.083 INFO:tasks.rados.rados.0.trial082.stdout:2013: delete oid 32 current snap is 209 2026-02-12T17:37:17.083 INFO:tasks.rados.rados.0.trial082.stdout:2013: done (3 left) 2026-02-12T17:37:17.084 INFO:tasks.rados.rados.0.trial082.stdout:2014: read oid 14 snap -1 2026-02-12T17:37:17.084 INFO:tasks.rados.rados.0.trial082.stdout:2014: expect deleted 2026-02-12T17:37:17.084 INFO:tasks.rados.rados.0.trial082.stdout:2015: write oid 46 current snap is 209 2026-02-12T17:37:17.084 INFO:tasks.rados.rados.0.trial082.stdout:2015: seq_num 698 ranges {531286=711925,1912196=706244,3018543=712743} 2026-02-12T17:37:17.088 INFO:tasks.rados.rados.0.trial082.stdout:2015: writing trial08226312-46 from 531286 to 1243211 tid 1 2026-02-12T17:37:17.093 INFO:tasks.rados.rados.0.trial082.stdout:2015: writing trial08226312-46 from 1912196 to 2618440 tid 2 2026-02-12T17:37:17.098 INFO:tasks.rados.rados.0.trial082.stdout:2015: writing trial08226312-46 from 3018543 to 3731286 tid 3 2026-02-12T17:37:17.098 INFO:tasks.rados.rados.0.trial082.stdout:2016: read oid 38 snap 208 2026-02-12T17:37:17.098 INFO:tasks.rados.rados.0.trial082.stdout:2016: expect (ObjNum 678 snap 207 seq_num 678) 2026-02-12T17:37:17.098 INFO:tasks.rados.rados.0.trial082.stdout:2017: copy_from oid 45 from oid 48 current snap is 209 2026-02-12T17:37:17.098 INFO:tasks.rados.rados.0.trial082.stdout:2012: finishing rollback tid 0 to trial08226312-11 2026-02-12T17:37:17.098 INFO:tasks.rados.rados.0.trial082.stdout:2012: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:37:17.098 INFO:tasks.rados.rados.0.trial082.stdout:2012: finishing rollback tid 2 to trial08226312-11 2026-02-12T17:37:17.099 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1249 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:37:17.099 INFO:tasks.rados.rados.0.trial082.stdout:2010: expect (ObjNum 533 snap 163 seq_num 533) 2026-02-12T17:37:17.099 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:17.119 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 185212 2026-02-12T17:37:17.157 INFO:tasks.rados.rados.0.trial082.stdout:2011: expect (ObjNum 674 snap 207 seq_num 674) 2026-02-12T17:37:17.157 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:17.216 INFO:tasks.rados.rados.0.trial082.stdout:2015: finishing write tid 1 to trial08226312-46 2026-02-12T17:37:17.217 INFO:tasks.rados.rados.0.trial082.stdout:2015: finishing write tid 2 to trial08226312-46 2026-02-12T17:37:17.217 INFO:tasks.rados.rados.0.trial082.stdout:2015: finishing write tid 3 to trial08226312-46 2026-02-12T17:37:17.217 INFO:tasks.rados.rados.0.trial082.stdout:2015: finishing write tid 4 to trial08226312-46 2026-02-12T17:37:17.217 INFO:tasks.rados.rados.0.trial082.stdout:2015: finishing write tid 5 to trial08226312-46 2026-02-12T17:37:17.217 INFO:tasks.rados.rados.0.trial082.stdout:2015: oid 46 updating version 0 to 1252 2026-02-12T17:37:17.217 INFO:tasks.rados.rados.0.trial082.stdout:2015: oid 46 updating version 1252 to 1253 2026-02-12T17:37:17.217 INFO:tasks.rados.rados.0.trial082.stdout:2015: oid 46 version 1253 is already newer than 1251 2026-02-12T17:37:17.217 INFO:tasks.rados.rados.0.trial082.stdout:2015: oid 46 version 1253 is already newer than 1250 2026-02-12T17:37:17.217 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1253 (ObjNum 698 snap 209 seq_num 698) dirty exists 2026-02-12T17:37:17.218 INFO:tasks.rados.rados.0.trial082.stdout:2015: left oid 46 (ObjNum 698 snap 209 seq_num 698) 2026-02-12T17:37:17.218 INFO:tasks.rados.rados.0.trial082.stdout:2016: expect (ObjNum 678 snap 207 seq_num 678) 2026-02-12T17:37:17.246 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3184687 2026-02-12T17:37:17.293 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:17.338 INFO:tasks.rados.rados.0.trial082.stdout:2017: finishing copy_from racing read to trial08226312-45 2026-02-12T17:37:17.338 INFO:tasks.rados.rados.0.trial082.stdout:2017: finishing copy_from to trial08226312-45 2026-02-12T17:37:17.338 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 818 (ObjNum 695 snap 208 seq_num 695) dirty exists 2026-02-12T17:37:17.338 INFO:tasks.rados.rados.0.trial082.stdout:2010: done (6 left) 2026-02-12T17:37:17.338 INFO:tasks.rados.rados.0.trial082.stdout:2011: done (5 left) 2026-02-12T17:37:17.338 INFO:tasks.rados.rados.0.trial082.stdout:2012: done (4 left) 2026-02-12T17:37:17.339 INFO:tasks.rados.rados.0.trial082.stdout:2014: done (3 left) 2026-02-12T17:37:17.339 INFO:tasks.rados.rados.0.trial082.stdout:2015: done (2 left) 2026-02-12T17:37:17.339 INFO:tasks.rados.rados.0.trial082.stdout:2016: done (1 left) 2026-02-12T17:37:17.339 INFO:tasks.rados.rados.0.trial082.stdout:2017: done (0 left) 2026-02-12T17:37:17.339 INFO:tasks.rados.rados.0.trial082.stdout:2018: snap_create 2026-02-12T17:37:18.062 INFO:tasks.rados.rados.0.trial082.stdout:2018: done (0 left) 2026-02-12T17:37:18.063 INFO:tasks.rados.rados.0.trial082.stdout:2019: snap_create 2026-02-12T17:37:19.062 INFO:tasks.rados.rados.0.trial082.stdout:2019: done (0 left) 2026-02-12T17:37:19.063 INFO:tasks.rados.rados.0.trial082.stdout:2020: write (excl) oid 43 current snap is 211 2026-02-12T17:37:19.063 INFO:tasks.rados.rados.0.trial082.stdout:2020: seq_num 699 ranges {548093=787174,1970678=449902,3045966=681137} 2026-02-12T17:37:19.068 INFO:tasks.rados.rados.0.trial082.stdout:2020: writing trial08226312-43 from 548093 to 1335267 tid 1 2026-02-12T17:37:19.072 INFO:tasks.rados.rados.0.trial082.stdout:2020: writing trial08226312-43 from 1970678 to 2420580 tid 2 2026-02-12T17:37:19.077 INFO:tasks.rados.rados.0.trial082.stdout:2020: writing trial08226312-43 from 3045966 to 3727103 tid 3 2026-02-12T17:37:19.077 INFO:tasks.rados.rados.0.trial082.stdout:2021: snap_create 2026-02-12T17:37:19.077 INFO:tasks.rados.rados.0.trial082.stdout:2020: finishing write tid 1 to trial08226312-43 2026-02-12T17:37:19.077 INFO:tasks.rados.rados.0.trial082.stdout:2020: finishing write tid 2 to trial08226312-43 2026-02-12T17:37:19.079 INFO:tasks.rados.rados.0.trial082.stdout:2020: finishing write tid 3 to trial08226312-43 2026-02-12T17:37:19.079 INFO:tasks.rados.rados.0.trial082.stdout:2020: finishing write tid 4 to trial08226312-43 2026-02-12T17:37:19.079 INFO:tasks.rados.rados.0.trial082.stdout:2020: finishing write tid 5 to trial08226312-43 2026-02-12T17:37:19.079 INFO:tasks.rados.rados.0.trial082.stdout:2020: oid 43 updating version 0 to 1244 2026-02-12T17:37:19.079 INFO:tasks.rados.rados.0.trial082.stdout:2020: oid 43 updating version 1244 to 1245 2026-02-12T17:37:19.079 INFO:tasks.rados.rados.0.trial082.stdout:2020: oid 43 updating version 1245 to 1246 2026-02-12T17:37:19.079 INFO:tasks.rados.rados.0.trial082.stdout:2020: oid 43 updating version 1246 to 1247 2026-02-12T17:37:19.080 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 1247 (ObjNum 699 snap 211 seq_num 699) dirty exists 2026-02-12T17:37:19.080 INFO:tasks.rados.rados.0.trial082.stdout:2020: left oid 43 (ObjNum 699 snap 211 seq_num 699) 2026-02-12T17:37:20.063 INFO:tasks.rados.rados.0.trial082.stdout:2020: done (1 left) 2026-02-12T17:37:20.063 INFO:tasks.rados.rados.0.trial082.stdout:2021: done (0 left) 2026-02-12T17:37:20.063 INFO:tasks.rados.rados.0.trial082.stdout:2022: snap_remove snap 208 2026-02-12T17:37:21.064 INFO:tasks.rados.rados.0.trial082.stdout:2022: done (0 left) 2026-02-12T17:37:21.064 INFO:tasks.rados.rados.0.trial082.stdout:2023: copy_from oid 34 from oid 6 current snap is 212 2026-02-12T17:37:21.064 INFO:tasks.rados.rados.0.trial082.stdout:2024: rollback oid 13 current snap is 212 2026-02-12T17:37:21.064 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 209 2026-02-12T17:37:21.064 INFO:tasks.rados.rados.0.trial082.stdout:2025: delete oid 30 current snap is 212 2026-02-12T17:37:21.067 INFO:tasks.rados.rados.0.trial082.stdout:2024: finishing rollback tid 0 to trial08226312-13 2026-02-12T17:37:21.067 INFO:tasks.rados.rados.0.trial082.stdout:2024: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:37:21.068 INFO:tasks.rados.rados.0.trial082.stdout:2025: done (2 left) 2026-02-12T17:37:21.068 INFO:tasks.rados.rados.0.trial082.stdout:2026: read oid 20 snap 211 2026-02-12T17:37:21.068 INFO:tasks.rados.rados.0.trial082.stdout:2026: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:37:21.068 INFO:tasks.rados.rados.0.trial082.stdout:2027: write oid 19 current snap is 212 2026-02-12T17:37:21.068 INFO:tasks.rados.rados.0.trial082.stdout:2024: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:37:21.068 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 532 (ObjNum 679 snap 207 seq_num 679) dirty exists 2026-02-12T17:37:21.068 INFO:tasks.rados.rados.0.trial082.stdout:2027: seq_num 701 ranges {581707=654025,1687642=453571,2700812=703681} 2026-02-12T17:37:21.072 INFO:tasks.rados.rados.0.trial082.stdout:2027: writing trial08226312-19 from 581707 to 1235732 tid 1 2026-02-12T17:37:21.075 INFO:tasks.rados.rados.0.trial082.stdout:2027: writing trial08226312-19 from 1687642 to 2141213 tid 2 2026-02-12T17:37:21.080 INFO:tasks.rados.rados.0.trial082.stdout:2027: writing trial08226312-19 from 2700812 to 3404493 tid 3 2026-02-12T17:37:21.081 INFO:tasks.rados.rados.0.trial082.stdout:2024: done (3 left) 2026-02-12T17:37:21.081 INFO:tasks.rados.rados.0.trial082.stdout:2028: rollback oid 8 current snap is 212 2026-02-12T17:37:21.081 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 210 2026-02-12T17:37:21.081 INFO:tasks.rados.rados.0.trial082.stdout:2023: finishing copy_from to trial08226312-34 2026-02-12T17:37:21.081 INFO:tasks.rados.rados.0.trial082.stdout:2023: got expected ENOENT (src dne) 2026-02-12T17:37:21.081 INFO:tasks.rados.rados.0.trial082.stdout:2023: finishing copy_from racing read to trial08226312-34 2026-02-12T17:37:21.081 INFO:tasks.rados.rados.0.trial082.stdout:2026: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:37:21.180 INFO:tasks.rados.rados.0.trial082.stdout:2027: finishing write tid 1 to trial08226312-19 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:2027: finishing write tid 2 to trial08226312-19 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:2027: finishing write tid 3 to trial08226312-19 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:2027: finishing write tid 4 to trial08226312-19 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:2027: finishing write tid 5 to trial08226312-19 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:2027: oid 19 updating version 0 to 1527 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:2027: oid 19 version 1527 is already newer than 1526 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:2027: oid 19 updating version 1527 to 1529 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:2027: oid 19 version 1529 is already newer than 1528 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 1529 (ObjNum 701 snap 212 seq_num 701) dirty exists 2026-02-12T17:37:21.181 INFO:tasks.rados.rados.0.trial082.stdout:2027: left oid 19 (ObjNum 701 snap 212 seq_num 701) 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2028: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2028: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2023: done (3 left) 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2026: done (2 left) 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2027: done (1 left) 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2029: rollback oid 3 current snap is 212 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 211 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2028: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1533 (ObjNum 686 snap 207 seq_num 686) dirty exists 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2028: done (1 left) 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2030: write (excl) oid 25 current snap is 212 2026-02-12T17:37:21.182 INFO:tasks.rados.rados.0.trial082.stdout:2030: seq_num 702 ranges {598514=729274,1746124=597229,3128235=514953} 2026-02-12T17:37:21.184 INFO:tasks.rados.rados.0.trial082.stdout:2030: writing trial08226312-25 from 598514 to 1327788 tid 1 2026-02-12T17:37:21.188 INFO:tasks.rados.rados.0.trial082.stdout:2030: writing trial08226312-25 from 1746124 to 2343353 tid 2 2026-02-12T17:37:21.194 INFO:tasks.rados.rados.0.trial082.stdout:2030: writing trial08226312-25 from 3128235 to 3643188 tid 3 2026-02-12T17:37:21.194 INFO:tasks.rados.rados.0.trial082.stdout:2031: read oid 46 snap -1 2026-02-12T17:37:21.194 INFO:tasks.rados.rados.0.trial082.stdout:2031: expect (ObjNum 698 snap 209 seq_num 698) 2026-02-12T17:37:21.194 INFO:tasks.rados.rados.0.trial082.stdout:2032: copy_from oid 40 from oid 37 current snap is 212 2026-02-12T17:37:21.194 INFO:tasks.rados.rados.0.trial082.stdout:2029: finishing rollback tid 0 to trial08226312-3 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2029: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2029: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 904 (ObjNum 609 snap 188 seq_num 609) dirty exists 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2030: finishing write tid 1 to trial08226312-25 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2030: finishing write tid 2 to trial08226312-25 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2029: done (3 left) 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2033: copy_from oid 10 from oid 24 current snap is 212 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2034: read oid 43 snap -1 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2034: expect (ObjNum 699 snap 211 seq_num 699) 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2035: write (excl) oid 1 current snap is 212 2026-02-12T17:37:21.195 INFO:tasks.rados.rados.0.trial082.stdout:2035: seq_num 703 ranges {615321=404523,1804606=457240,2755658=726225} 2026-02-12T17:37:21.197 INFO:tasks.rados.rados.0.trial082.stdout:2035: writing trial08226312-1 from 615321 to 1019844 tid 1 2026-02-12T17:37:21.202 INFO:tasks.rados.rados.0.trial082.stdout:2035: writing trial08226312-1 from 1804606 to 2261846 tid 2 2026-02-12T17:37:21.207 INFO:tasks.rados.rados.0.trial082.stdout:2035: writing trial08226312-1 from 2755658 to 3481883 tid 3 2026-02-12T17:37:21.207 INFO:tasks.rados.rados.0.trial082.stdout:2036: delete oid 4 current snap is 212 2026-02-12T17:37:21.207 INFO:tasks.rados.rados.0.trial082.stdout:2030: finishing write tid 3 to trial08226312-25 2026-02-12T17:37:21.207 INFO:tasks.rados.rados.0.trial082.stdout:2030: finishing write tid 4 to trial08226312-25 2026-02-12T17:37:21.208 INFO:tasks.rados.rados.0.trial082.stdout:2030: finishing write tid 5 to trial08226312-25 2026-02-12T17:37:21.208 INFO:tasks.rados.rados.0.trial082.stdout:2030: oid 25 updating version 0 to 534 2026-02-12T17:37:21.208 INFO:tasks.rados.rados.0.trial082.stdout:2030: oid 25 version 534 is already newer than 533 2026-02-12T17:37:21.208 INFO:tasks.rados.rados.0.trial082.stdout:2030: oid 25 updating version 534 to 536 2026-02-12T17:37:21.208 INFO:tasks.rados.rados.0.trial082.stdout:2030: oid 25 version 536 is already newer than 535 2026-02-12T17:37:21.208 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 536 (ObjNum 702 snap 212 seq_num 702) dirty exists 2026-02-12T17:37:21.208 INFO:tasks.rados.rados.0.trial082.stdout:2030: left oid 25 (ObjNum 702 snap 212 seq_num 702) 2026-02-12T17:37:21.208 INFO:tasks.rados.rados.0.trial082.stdout:2034: expect (ObjNum 699 snap 211 seq_num 699) 2026-02-12T17:37:21.224 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:21.250 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:21.276 INFO:tasks.rados.rados.0.trial082.stdout:2035: finishing write tid 1 to trial08226312-1 2026-02-12T17:37:21.276 INFO:tasks.rados.rados.0.trial082.stdout:2031: expect (ObjNum 698 snap 209 seq_num 698) 2026-02-12T17:37:21.284 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1553884 2026-02-12T17:37:21.315 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 776778 2026-02-12T17:37:21.352 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 800166 2026-02-12T17:37:21.384 INFO:tasks.rados.rados.0.trial082.stdout:2032: finishing copy_from racing read to trial08226312-40 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:2033: finishing copy_from racing read to trial08226312-10 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:2035: finishing write tid 2 to trial08226312-1 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:2030: done (6 left) 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:2031: done (5 left) 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:2034: done (4 left) 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:2036: done (3 left) 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:2037: write (excl) oid 35 current snap is 212 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:2032: finishing copy_from to trial08226312-40 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1014 (ObjNum 577 snap 176 seq_num 577) dirty exists 2026-02-12T17:37:21.385 INFO:tasks.rados.rados.0.trial082.stdout:2033: finishing copy_from to trial08226312-10 2026-02-12T17:37:21.386 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1484 (ObjNum 645 snap 197 seq_num 645) dirty exists 2026-02-12T17:37:21.386 INFO:tasks.rados.rados.0.trial082.stdout:2035: finishing write tid 3 to trial08226312-1 2026-02-12T17:37:21.386 INFO:tasks.rados.rados.0.trial082.stdout:2035: finishing write tid 4 to trial08226312-1 2026-02-12T17:37:21.386 INFO:tasks.rados.rados.0.trial082.stdout:2037: seq_num 705 ranges {648935=555021,1805217=460909,2694151=465122,3817442=31493} 2026-02-12T17:37:21.389 INFO:tasks.rados.rados.0.trial082.stdout:2037: writing trial08226312-35 from 648935 to 1203956 tid 1 2026-02-12T17:37:21.392 INFO:tasks.rados.rados.0.trial082.stdout:2037: writing trial08226312-35 from 1805217 to 2266126 tid 2 2026-02-12T17:37:21.396 INFO:tasks.rados.rados.0.trial082.stdout:2037: writing trial08226312-35 from 2694151 to 3159273 tid 3 2026-02-12T17:37:21.399 INFO:tasks.rados.rados.0.trial082.stdout:2037: writing trial08226312-35 from 3817442 to 3848935 tid 4 2026-02-12T17:37:21.399 INFO:tasks.rados.rados.0.trial082.stdout:2032: done (3 left) 2026-02-12T17:37:21.399 INFO:tasks.rados.rados.0.trial082.stdout:2033: done (2 left) 2026-02-12T17:37:21.399 INFO:tasks.rados.rados.0.trial082.stdout:2038: write (excl) oid 9 current snap is 212 2026-02-12T17:37:21.399 INFO:tasks.rados.rados.0.trial082.stdout:2038: seq_num 706 ranges {665742=630270,1863699=604567,3121574=676394} 2026-02-12T17:37:21.403 INFO:tasks.rados.rados.0.trial082.stdout:2038: writing trial08226312-9 from 665742 to 1296012 tid 1 2026-02-12T17:37:21.408 INFO:tasks.rados.rados.0.trial082.stdout:2038: writing trial08226312-9 from 1863699 to 2468266 tid 2 2026-02-12T17:37:21.413 INFO:tasks.rados.rados.0.trial082.stdout:2038: writing trial08226312-9 from 3121574 to 3797968 tid 3 2026-02-12T17:37:21.414 INFO:tasks.rados.rados.0.trial082.stdout:2039: read oid 39 snap -1 2026-02-12T17:37:21.414 INFO:tasks.rados.rados.0.trial082.stdout:2039: expect deleted 2026-02-12T17:37:21.414 INFO:tasks.rados.rados.0.trial082.stdout:2040: read oid 24 snap -1 2026-02-12T17:37:21.414 INFO:tasks.rados.rados.0.trial082.stdout:2040: expect (ObjNum 645 snap 197 seq_num 645) 2026-02-12T17:37:21.414 INFO:tasks.rados.rados.0.trial082.stdout:2041: read oid 47 snap -1 2026-02-12T17:37:21.414 INFO:tasks.rados.rados.0.trial082.stdout:2041: expect (ObjNum 659 snap 204 seq_num 659) 2026-02-12T17:37:21.414 INFO:tasks.rados.rados.0.trial082.stdout:2042: write oid 10 current snap is 212 2026-02-12T17:37:21.414 INFO:tasks.rados.rados.0.trial082.stdout:2042: seq_num 707 ranges {682549=705519,1922181=464578,3148997=487666} 2026-02-12T17:37:21.418 INFO:tasks.rados.rados.0.trial082.stdout:2042: writing trial08226312-10 from 682549 to 1388068 tid 1 2026-02-12T17:37:21.422 INFO:tasks.rados.rados.0.trial082.stdout:2042: writing trial08226312-10 from 1922181 to 2386759 tid 2 2026-02-12T17:37:21.427 INFO:tasks.rados.rados.0.trial082.stdout:2042: writing trial08226312-10 from 3148997 to 3636663 tid 3 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:2043: delete oid 50 current snap is 212 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:2035: finishing write tid 5 to trial08226312-1 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:2035: oid 1 updating version 0 to 938 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:2035: oid 1 updating version 938 to 939 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:2035: oid 1 version 939 is already newer than 936 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:2035: oid 1 version 939 is already newer than 937 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 939 (ObjNum 703 snap 212 seq_num 703) dirty exists 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:2035: left oid 1 (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:2037: finishing write tid 1 to trial08226312-35 2026-02-12T17:37:21.428 INFO:tasks.rados.rados.0.trial082.stdout:2037: finishing write tid 2 to trial08226312-35 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: finishing write tid 3 to trial08226312-35 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: finishing write tid 4 to trial08226312-35 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: finishing write tid 5 to trial08226312-35 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: finishing write tid 6 to trial08226312-35 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: oid 35 updating version 0 to 1504 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: oid 35 version 1504 is already newer than 1503 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: oid 35 version 1504 is already newer than 1501 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: oid 35 version 1504 is already newer than 1502 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: oid 35 version 1504 is already newer than 1500 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1504 (ObjNum 705 snap 212 seq_num 705) dirty exists 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2037: left oid 35 (ObjNum 705 snap 212 seq_num 705) 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2038: finishing write tid 1 to trial08226312-9 2026-02-12T17:37:21.429 INFO:tasks.rados.rados.0.trial082.stdout:2038: finishing write tid 2 to trial08226312-9 2026-02-12T17:37:21.430 INFO:tasks.rados.rados.0.trial082.stdout:2040: expect (ObjNum 645 snap 197 seq_num 645) 2026-02-12T17:37:21.433 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1581617 2026-02-12T17:37:21.467 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2339901 2026-02-12T17:37:21.504 INFO:tasks.rados.rados.0.trial082.stdout:2038: finishing write tid 3 to trial08226312-9 2026-02-12T17:37:21.504 INFO:tasks.rados.rados.0.trial082.stdout:2038: finishing write tid 4 to trial08226312-9 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2035: done (7 left) 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2037: done (6 left) 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2039: done (5 left) 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2040: done (4 left) 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2043: done (3 left) 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2044: delete oid 15 current snap is 212 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2038: finishing write tid 5 to trial08226312-9 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2038: oid 9 updating version 0 to 1259 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2038: oid 9 updating version 1259 to 1260 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2038: oid 9 updating version 1260 to 1262 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:2038: oid 9 version 1262 is already newer than 1261 2026-02-12T17:37:21.505 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 1262 (ObjNum 706 snap 212 seq_num 706) dirty exists 2026-02-12T17:37:21.506 INFO:tasks.rados.rados.0.trial082.stdout:2038: left oid 9 (ObjNum 706 snap 212 seq_num 706) 2026-02-12T17:37:21.506 INFO:tasks.rados.rados.0.trial082.stdout:2041: expect (ObjNum 659 snap 204 seq_num 659) 2026-02-12T17:37:21.554 INFO:tasks.rados.rados.0.trial082.stdout:2042: finishing write tid 1 to trial08226312-10 2026-02-12T17:37:21.554 INFO:tasks.rados.rados.0.trial082.stdout:2042: finishing write tid 2 to trial08226312-10 2026-02-12T17:37:21.554 INFO:tasks.rados.rados.0.trial082.stdout:2042: finishing write tid 3 to trial08226312-10 2026-02-12T17:37:21.554 INFO:tasks.rados.rados.0.trial082.stdout:2042: finishing write tid 4 to trial08226312-10 2026-02-12T17:37:21.554 INFO:tasks.rados.rados.0.trial082.stdout:2042: finishing write tid 5 to trial08226312-10 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2042: oid 10 updating version 0 to 1486 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2042: oid 10 updating version 1486 to 1488 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2042: oid 10 version 1488 is already newer than 1485 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2042: oid 10 version 1488 is already newer than 1487 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1488 (ObjNum 707 snap 212 seq_num 707) dirty exists 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2042: left oid 10 (ObjNum 707 snap 212 seq_num 707) 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2038: done (3 left) 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2041: done (2 left) 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2042: done (1 left) 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2044: done (0 left) 2026-02-12T17:37:21.555 INFO:tasks.rados.rados.0.trial082.stdout:2045: snap_create 2026-02-12T17:37:22.068 INFO:tasks.rados.rados.0.trial082.stdout:2045: done (0 left) 2026-02-12T17:37:22.068 INFO:tasks.rados.rados.0.trial082.stdout:2046: write oid 15 current snap is 213 2026-02-12T17:37:22.069 INFO:tasks.rados.rados.0.trial082.stdout:2046: seq_num 710 ranges {732970=647619,2097627=611905,3231266=437835} 2026-02-12T17:37:22.074 INFO:tasks.rados.rados.0.trial082.stdout:2046: writing trial08226312-15 from 732970 to 1380589 tid 1 2026-02-12T17:37:22.079 INFO:tasks.rados.rados.0.trial082.stdout:2046: writing trial08226312-15 from 2097627 to 2709532 tid 2 2026-02-12T17:37:22.082 INFO:tasks.rados.rados.0.trial082.stdout:2046: writing trial08226312-15 from 3231266 to 3669101 tid 3 2026-02-12T17:37:22.082 INFO:tasks.rados.rados.0.trial082.stdout:2047: write oid 43 current snap is 213 2026-02-12T17:37:22.083 INFO:tasks.rados.rados.0.trial082.stdout:2047: seq_num 711 ranges {749777=722868,2156109=471916,3258689=649107} 2026-02-12T17:37:22.088 INFO:tasks.rados.rados.0.trial082.stdout:2047: writing trial08226312-43 from 749777 to 1472645 tid 1 2026-02-12T17:37:22.092 INFO:tasks.rados.rados.0.trial082.stdout:2047: writing trial08226312-43 from 2156109 to 2628025 tid 2 2026-02-12T17:37:22.097 INFO:tasks.rados.rados.0.trial082.stdout:2047: writing trial08226312-43 from 3258689 to 3907796 tid 3 2026-02-12T17:37:22.097 INFO:tasks.rados.rados.0.trial082.stdout:2048: read oid 11 snap -1 2026-02-12T17:37:22.097 INFO:tasks.rados.rados.0.trial082.stdout:2048: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2049: rollback oid 8 current snap is 213 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 212 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2046: finishing write tid 1 to trial08226312-15 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2046: finishing write tid 2 to trial08226312-15 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2046: finishing write tid 3 to trial08226312-15 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2046: finishing write tid 4 to trial08226312-15 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2046: finishing write tid 5 to trial08226312-15 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2046: oid 15 updating version 0 to 909 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2046: oid 15 version 909 is already newer than 907 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2046: oid 15 version 909 is already newer than 908 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:2046: oid 15 version 909 is already newer than 906 2026-02-12T17:37:22.098 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 909 (ObjNum 710 snap 213 seq_num 710) dirty exists 2026-02-12T17:37:22.099 INFO:tasks.rados.rados.0.trial082.stdout:2046: left oid 15 (ObjNum 710 snap 213 seq_num 710) 2026-02-12T17:37:22.099 INFO:tasks.rados.rados.0.trial082.stdout:2047: finishing write tid 1 to trial08226312-43 2026-02-12T17:37:22.099 INFO:tasks.rados.rados.0.trial082.stdout:2047: finishing write tid 2 to trial08226312-43 2026-02-12T17:37:22.099 INFO:tasks.rados.rados.0.trial082.stdout:2046: done (3 left) 2026-02-12T17:37:22.099 INFO:tasks.rados.rados.0.trial082.stdout:2050: delete oid 47 current snap is 213 2026-02-12T17:37:22.100 INFO:tasks.rados.rados.0.trial082.stdout:2047: finishing write tid 3 to trial08226312-43 2026-02-12T17:37:22.100 INFO:tasks.rados.rados.0.trial082.stdout:2047: finishing write tid 4 to trial08226312-43 2026-02-12T17:37:22.100 INFO:tasks.rados.rados.0.trial082.stdout:2047: finishing write tid 5 to trial08226312-43 2026-02-12T17:37:22.100 INFO:tasks.rados.rados.0.trial082.stdout:2047: oid 43 updating version 0 to 1491 2026-02-12T17:37:22.100 INFO:tasks.rados.rados.0.trial082.stdout:2047: oid 43 version 1491 is already newer than 1489 2026-02-12T17:37:22.100 INFO:tasks.rados.rados.0.trial082.stdout:2047: oid 43 version 1491 is already newer than 1490 2026-02-12T17:37:22.100 INFO:tasks.rados.rados.0.trial082.stdout:2047: oid 43 updating version 1491 to 1492 2026-02-12T17:37:22.100 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 1492 (ObjNum 711 snap 213 seq_num 711) dirty exists 2026-02-12T17:37:22.100 INFO:tasks.rados.rados.0.trial082.stdout:2047: left oid 43 (ObjNum 711 snap 213 seq_num 711) 2026-02-12T17:37:22.101 INFO:tasks.rados.rados.0.trial082.stdout:2049: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:2049: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:2049: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1539 (ObjNum 686 snap 207 seq_num 686) dirty exists 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:2047: done (3 left) 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:2049: done (2 left) 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:2050: done (1 left) 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:2051: read oid 26 snap 209 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:2051: expect (ObjNum 685 snap 207 seq_num 685) 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:2052: write (excl) oid 8 current snap is 213 2026-02-12T17:37:22.102 INFO:tasks.rados.rados.0.trial082.stdout:2052: seq_num 713 ranges {783391=473366,1756720=475585,2797182=788004} 2026-02-12T17:37:22.105 INFO:tasks.rados.rados.0.trial082.stdout:2052: writing trial08226312-8 from 783391 to 1256757 tid 1 2026-02-12T17:37:22.109 INFO:tasks.rados.rados.0.trial082.stdout:2052: writing trial08226312-8 from 1756720 to 2232305 tid 2 2026-02-12T17:37:22.114 INFO:tasks.rados.rados.0.trial082.stdout:2052: writing trial08226312-8 from 2797182 to 3585186 tid 3 2026-02-12T17:37:22.114 INFO:tasks.rados.rados.0.trial082.stdout:2053: copy_from oid 35 from oid 17 current snap is 213 2026-02-12T17:37:22.114 INFO:tasks.rados.rados.0.trial082.stdout:2048: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:37:22.158 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 607566 2026-02-12T17:37:22.240 INFO:tasks.rados.rados.0.trial082.stdout:2051: expect (ObjNum 685 snap 207 seq_num 685) 2026-02-12T17:37:22.406 INFO:tasks.rados.rados.0.trial082.stdout:2052: finishing write tid 1 to trial08226312-8 2026-02-12T17:37:22.406 INFO:tasks.rados.rados.0.trial082.stdout:2052: finishing write tid 2 to trial08226312-8 2026-02-12T17:37:22.406 INFO:tasks.rados.rados.0.trial082.stdout:2052: finishing write tid 3 to trial08226312-8 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2048: done (3 left) 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2051: done (2 left) 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2054: delete oid 42 current snap is 213 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2052: finishing write tid 4 to trial08226312-8 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2052: finishing write tid 5 to trial08226312-8 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2052: oid 8 updating version 0 to 1544 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2052: oid 8 version 1544 is already newer than 1542 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2052: oid 8 version 1544 is already newer than 1543 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2052: oid 8 updating version 1544 to 1545 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1545 (ObjNum 713 snap 213 seq_num 713) dirty exists 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2052: left oid 8 (ObjNum 713 snap 213 seq_num 713) 2026-02-12T17:37:22.407 INFO:tasks.rados.rados.0.trial082.stdout:2053: finishing copy_from racing read to trial08226312-35 2026-02-12T17:37:22.408 INFO:tasks.rados.rados.0.trial082.stdout:2053: finishing copy_from to trial08226312-35 2026-02-12T17:37:22.408 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 692 (ObjNum 546 snap 167 seq_num 546) dirty exists 2026-02-12T17:37:22.408 INFO:tasks.rados.rados.0.trial082.stdout:2052: done (2 left) 2026-02-12T17:37:22.408 INFO:tasks.rados.rados.0.trial082.stdout:2053: done (1 left) 2026-02-12T17:37:22.408 INFO:tasks.rados.rados.0.trial082.stdout:2054: done (0 left) 2026-02-12T17:37:22.408 INFO:tasks.rados.rados.0.trial082.stdout:2055: snap_remove snap 210 2026-02-12T17:37:23.064 INFO:tasks.rados.rados.0.trial082.stdout:2055: done (0 left) 2026-02-12T17:37:23.064 INFO:tasks.rados.rados.0.trial082.stdout:2056: delete oid 25 current snap is 213 2026-02-12T17:37:23.067 INFO:tasks.rados.rados.0.trial082.stdout:2056: done (0 left) 2026-02-12T17:37:23.068 INFO:tasks.rados.rados.0.trial082.stdout:2057: read oid 45 snap -1 2026-02-12T17:37:23.068 INFO:tasks.rados.rados.0.trial082.stdout:2057: expect (ObjNum 695 snap 208 seq_num 695) 2026-02-12T17:37:23.068 INFO:tasks.rados.rados.0.trial082.stdout:2058: write (excl) oid 35 current snap is 213 2026-02-12T17:37:23.068 INFO:tasks.rados.rados.0.trial082.stdout:2058: seq_num 716 ranges {433812=415466,1648519=385293} 2026-02-12T17:37:23.071 INFO:tasks.rados.rados.0.trial082.stdout:2058: writing trial08226312-35 from 433812 to 849278 tid 1 2026-02-12T17:37:23.075 INFO:tasks.rados.rados.0.trial082.stdout:2058: writing trial08226312-35 from 1648519 to 2033812 tid 2 2026-02-12T17:37:23.076 INFO:tasks.rados.rados.0.trial082.stdout:2059: copy_from oid 28 from oid 33 current snap is 213 2026-02-12T17:37:23.076 INFO:tasks.rados.rados.0.trial082.stdout:2057: expect (ObjNum 695 snap 208 seq_num 695) 2026-02-12T17:37:23.076 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:23.113 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 268249 2026-02-12T17:37:23.149 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:23.187 INFO:tasks.rados.rados.0.trial082.stdout:2058: finishing write tid 1 to trial08226312-35 2026-02-12T17:37:23.187 INFO:tasks.rados.rados.0.trial082.stdout:2058: finishing write tid 2 to trial08226312-35 2026-02-12T17:37:23.187 INFO:tasks.rados.rados.0.trial082.stdout:2058: finishing write tid 3 to trial08226312-35 2026-02-12T17:37:23.187 INFO:tasks.rados.rados.0.trial082.stdout:2058: finishing write tid 4 to trial08226312-35 2026-02-12T17:37:23.187 INFO:tasks.rados.rados.0.trial082.stdout:2058: oid 35 updating version 0 to 1505 2026-02-12T17:37:23.187 INFO:tasks.rados.rados.0.trial082.stdout:2058: oid 35 updating version 1505 to 1507 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:2058: oid 35 version 1507 is already newer than 1506 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1507 (ObjNum 716 snap 213 seq_num 716) dirty exists 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:2058: left oid 35 (ObjNum 716 snap 213 seq_num 716) 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:2059: finishing copy_from racing read to trial08226312-28 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:2059: finishing copy_from to trial08226312-28 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1104 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:2057: done (2 left) 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:2058: done (1 left) 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:2059: done (0 left) 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:2060: write (excl) oid 48 current snap is 213 2026-02-12T17:37:23.188 INFO:tasks.rados.rados.0.trial082.stdout:2060: seq_num 717 ranges {450619=490715,1590648=459971} 2026-02-12T17:37:23.190 INFO:tasks.rados.rados.0.trial082.stdout:2060: writing trial08226312-48 from 450619 to 941334 tid 1 2026-02-12T17:37:23.195 INFO:tasks.rados.rados.0.trial082.stdout:2060: writing trial08226312-48 from 1590648 to 2050619 tid 2 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:2061: copy_from oid 19 from oid 47 current snap is 213 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:2060: finishing write tid 1 to trial08226312-48 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:2062: rollback oid 13 current snap is 213 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 209 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:2063: rollback oid 33 current snap is 213 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 209 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:2064: read oid 20 snap -1 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:2064: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:2065: copy_from oid 9 from oid 42 current snap is 213 2026-02-12T17:37:23.196 INFO:tasks.rados.rados.0.trial082.stdout:2066: copy_from oid 26 from oid 50 current snap is 213 2026-02-12T17:37:23.197 INFO:tasks.rados.rados.0.trial082.stdout:2067: rollback oid 25 current snap is 213 2026-02-12T17:37:23.197 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 25 to 212 2026-02-12T17:37:23.197 INFO:tasks.rados.rados.0.trial082.stdout:2068: copy_from oid 34 from oid 3 current snap is 213 2026-02-12T17:37:23.197 INFO:tasks.rados.rados.0.trial082.stdout:2069: snap_remove snap 211 2026-02-12T17:37:24.075 INFO:tasks.rados.rados.0.trial082.stdout:2069: done (9 left) 2026-02-12T17:37:24.075 INFO:tasks.rados.rados.0.trial082.stdout:2070: delete oid 31 current snap is 213 2026-02-12T17:37:24.075 INFO:tasks.rados.rados.0.trial082.stdout:2065: finishing copy_from to trial08226312-9 2026-02-12T17:37:24.075 INFO:tasks.rados.rados.0.trial082.stdout:2065: got expected ENOENT (src dne) 2026-02-12T17:37:24.075 INFO:tasks.rados.rados.0.trial082.stdout:2066: finishing copy_from to trial08226312-26 2026-02-12T17:37:24.076 INFO:tasks.rados.rados.0.trial082.stdout:2066: got expected ENOENT (src dne) 2026-02-12T17:37:24.076 INFO:tasks.rados.rados.0.trial082.stdout:2066: finishing copy_from racing read to trial08226312-26 2026-02-12T17:37:24.076 INFO:tasks.rados.rados.0.trial082.stdout:2065: finishing copy_from racing read to trial08226312-9 2026-02-12T17:37:24.076 INFO:tasks.rados.rados.0.trial082.stdout:2064: expect (ObjNum 626 snap 191 seq_num 626) 2026-02-12T17:37:24.108 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:24.141 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:24.175 INFO:tasks.rados.rados.0.trial082.stdout:2061: finishing copy_from to trial08226312-19 2026-02-12T17:37:24.175 INFO:tasks.rados.rados.0.trial082.stdout:2061: got expected ENOENT (src dne) 2026-02-12T17:37:24.175 INFO:tasks.rados.rados.0.trial082.stdout:2064: done (9 left) 2026-02-12T17:37:24.175 INFO:tasks.rados.rados.0.trial082.stdout:2065: done (8 left) 2026-02-12T17:37:24.175 INFO:tasks.rados.rados.0.trial082.stdout:2066: done (7 left) 2026-02-12T17:37:24.176 INFO:tasks.rados.rados.0.trial082.stdout:2070: done (6 left) 2026-02-12T17:37:24.176 INFO:tasks.rados.rados.0.trial082.stdout:2071: write (excl) oid 50 current snap is 213 2026-02-12T17:37:24.176 INFO:tasks.rados.rados.0.trial082.stdout:2061: finishing copy_from racing read to trial08226312-19 2026-02-12T17:37:24.176 INFO:tasks.rados.rados.0.trial082.stdout:2060: finishing write tid 2 to trial08226312-48 2026-02-12T17:37:24.176 INFO:tasks.rados.rados.0.trial082.stdout:2060: finishing write tid 3 to trial08226312-48 2026-02-12T17:37:24.176 INFO:tasks.rados.rados.0.trial082.stdout:2071: seq_num 719 ranges {484233=641213,1707612=376621} 2026-02-12T17:37:24.179 INFO:tasks.rados.rados.0.trial082.stdout:2071: writing trial08226312-50 from 484233 to 1125446 tid 1 2026-02-12T17:37:24.185 INFO:tasks.rados.rados.0.trial082.stdout:2071: writing trial08226312-50 from 1707612 to 2084233 tid 2 2026-02-12T17:37:24.185 INFO:tasks.rados.rados.0.trial082.stdout:2061: done (6 left) 2026-02-12T17:37:24.185 INFO:tasks.rados.rados.0.trial082.stdout:2072: rollback oid 30 current snap is 213 2026-02-12T17:37:24.186 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 212 2026-02-12T17:37:24.186 INFO:tasks.rados.rados.0.trial082.stdout:2060: finishing write tid 4 to trial08226312-48 2026-02-12T17:37:24.186 INFO:tasks.rados.rados.0.trial082.stdout:2060: oid 48 updating version 0 to 820 2026-02-12T17:37:24.186 INFO:tasks.rados.rados.0.trial082.stdout:2060: oid 48 updating version 820 to 821 2026-02-12T17:37:24.186 INFO:tasks.rados.rados.0.trial082.stdout:2060: oid 48 version 821 is already newer than 819 2026-02-12T17:37:24.186 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 821 (ObjNum 717 snap 213 seq_num 717) dirty exists 2026-02-12T17:37:24.186 INFO:tasks.rados.rados.0.trial082.stdout:2060: left oid 48 (ObjNum 717 snap 213 seq_num 717) 2026-02-12T17:37:24.187 INFO:tasks.rados.rados.0.trial082.stdout:2062: finishing rollback tid 0 to trial08226312-13 2026-02-12T17:37:24.187 INFO:tasks.rados.rados.0.trial082.stdout:2062: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:37:24.187 INFO:tasks.rados.rados.0.trial082.stdout:2062: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:37:24.187 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 540 (ObjNum 679 snap 207 seq_num 679) dirty exists 2026-02-12T17:37:24.187 INFO:tasks.rados.rados.0.trial082.stdout:2067: finishing rollback tid 1 to trial08226312-25 2026-02-12T17:37:24.187 INFO:tasks.rados.rados.0.trial082.stdout:2067: finishing rollback tid 2 to trial08226312-25 2026-02-12T17:37:24.187 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 542 (ObjNum 702 snap 212 seq_num 702) dirty exists 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:2063: finishing rollback tid 0 to trial08226312-33 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:2063: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:2063: finishing rollback tid 2 to trial08226312-33 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1107 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:2068: finishing copy_from racing read to trial08226312-34 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:2068: finishing copy_from to trial08226312-34 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 904 (ObjNum 609 snap 188 seq_num 609) dirty exists 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:2071: finishing write tid 1 to trial08226312-50 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:2060: done (6 left) 2026-02-12T17:37:24.188 INFO:tasks.rados.rados.0.trial082.stdout:2062: done (5 left) 2026-02-12T17:37:24.189 INFO:tasks.rados.rados.0.trial082.stdout:2063: done (4 left) 2026-02-12T17:37:24.189 INFO:tasks.rados.rados.0.trial082.stdout:2067: done (3 left) 2026-02-12T17:37:24.189 INFO:tasks.rados.rados.0.trial082.stdout:2068: done (2 left) 2026-02-12T17:37:24.189 INFO:tasks.rados.rados.0.trial082.stdout:2073: copy_from oid 45 from oid 22 current snap is 213 2026-02-12T17:37:24.189 INFO:tasks.rados.rados.0.trial082.stdout:2074: write oid 36 current snap is 213 2026-02-12T17:37:24.189 INFO:tasks.rados.rados.0.trial082.stdout:2074: seq_num 720 ranges {501040=716462,1766094=334946} 2026-02-12T17:37:24.190 INFO:tasks.rados.rados.0.trial082.stdout:2074: writing trial08226312-36 from 501040 to 1217502 tid 1 2026-02-12T17:37:24.191 INFO:tasks.rados.rados.0.trial082.stdout:2074: writing trial08226312-36 from 1766094 to 2101040 tid 2 2026-02-12T17:37:24.191 INFO:tasks.rados.rados.0.trial082.stdout:2075: delete oid 7 current snap is 213 2026-02-12T17:37:24.192 INFO:tasks.rados.rados.0.trial082.stdout:2072: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:37:24.192 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 0 (ObjNum 49 snap 0 seq_num 1634300532) dirty dne 2026-02-12T17:37:24.192 INFO:tasks.rados.rados.0.trial082.stdout:2071: finishing write tid 2 to trial08226312-50 2026-02-12T17:37:24.192 INFO:tasks.rados.rados.0.trial082.stdout:2071: finishing write tid 3 to trial08226312-50 2026-02-12T17:37:24.192 INFO:tasks.rados.rados.0.trial082.stdout:2071: finishing write tid 4 to trial08226312-50 2026-02-12T17:37:24.192 INFO:tasks.rados.rados.0.trial082.stdout:2071: oid 50 updating version 0 to 712 2026-02-12T17:37:24.192 INFO:tasks.rados.rados.0.trial082.stdout:2071: oid 50 updating version 712 to 713 2026-02-12T17:37:24.193 INFO:tasks.rados.rados.0.trial082.stdout:2071: oid 50 version 713 is already newer than 711 2026-02-12T17:37:24.193 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 713 (ObjNum 719 snap 213 seq_num 719) dirty exists 2026-02-12T17:37:24.193 INFO:tasks.rados.rados.0.trial082.stdout:2071: left oid 50 (ObjNum 719 snap 213 seq_num 719) 2026-02-12T17:37:24.193 INFO:tasks.rados.rados.0.trial082.stdout:2073: finishing copy_from racing read to trial08226312-45 2026-02-12T17:37:24.194 INFO:tasks.rados.rados.0.trial082.stdout:2071: done (4 left) 2026-02-12T17:37:24.194 INFO:tasks.rados.rados.0.trial082.stdout:2072: done (3 left) 2026-02-12T17:37:24.194 INFO:tasks.rados.rados.0.trial082.stdout:2075: done (2 left) 2026-02-12T17:37:24.194 INFO:tasks.rados.rados.0.trial082.stdout:2076: write oid 38 current snap is 213 2026-02-12T17:37:24.194 INFO:tasks.rados.rados.0.trial082.stdout:2076: seq_num 722 ranges {534654=466960,1766705=367949} 2026-02-12T17:37:24.196 INFO:tasks.rados.rados.0.trial082.stdout:2076: writing trial08226312-38 from 534654 to 1001614 tid 1 2026-02-12T17:37:24.201 INFO:tasks.rados.rados.0.trial082.stdout:2076: writing trial08226312-38 from 1766705 to 2134654 tid 2 2026-02-12T17:37:24.201 INFO:tasks.rados.rados.0.trial082.stdout:2077: read oid 50 snap -1 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2077: expect (ObjNum 719 snap 213 seq_num 719) 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2078: rollback oid 3 current snap is 213 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 209 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2073: finishing copy_from to trial08226312-45 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1242 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2074: finishing write tid 1 to trial08226312-36 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2074: finishing write tid 2 to trial08226312-36 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2074: finishing write tid 3 to trial08226312-36 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2074: finishing write tid 4 to trial08226312-36 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2074: oid 36 updating version 0 to 1510 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2074: oid 36 version 1510 is already newer than 1509 2026-02-12T17:37:24.202 INFO:tasks.rados.rados.0.trial082.stdout:2074: oid 36 version 1510 is already newer than 1508 2026-02-12T17:37:24.203 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 1510 (ObjNum 720 snap 213 seq_num 720) dirty exists 2026-02-12T17:37:24.203 INFO:tasks.rados.rados.0.trial082.stdout:2074: left oid 36 (ObjNum 720 snap 213 seq_num 720) 2026-02-12T17:37:24.203 INFO:tasks.rados.rados.0.trial082.stdout:2076: finishing write tid 1 to trial08226312-38 2026-02-12T17:37:24.203 INFO:tasks.rados.rados.0.trial082.stdout:2073: done (4 left) 2026-02-12T17:37:24.203 INFO:tasks.rados.rados.0.trial082.stdout:2074: done (3 left) 2026-02-12T17:37:24.203 INFO:tasks.rados.rados.0.trial082.stdout:2079: write (excl) oid 6 current snap is 213 2026-02-12T17:37:24.203 INFO:tasks.rados.rados.0.trial082.stdout:2079: seq_num 723 ranges {551461=658562,1941540=209921} 2026-02-12T17:37:24.205 INFO:tasks.rados.rados.0.trial082.stdout:2079: writing trial08226312-6 from 551461 to 1210023 tid 1 2026-02-12T17:37:24.209 INFO:tasks.rados.rados.0.trial082.stdout:2079: writing trial08226312-6 from 1941540 to 2151461 tid 2 2026-02-12T17:37:24.209 INFO:tasks.rados.rados.0.trial082.stdout:2080: read oid 18 snap -1 2026-02-12T17:37:24.209 INFO:tasks.rados.rados.0.trial082.stdout:2080: expect deleted 2026-02-12T17:37:24.209 INFO:tasks.rados.rados.0.trial082.stdout:2081: delete oid 7 current snap is 213 2026-02-12T17:37:24.209 INFO:tasks.rados.rados.0.trial082.stdout:2076: finishing write tid 2 to trial08226312-38 2026-02-12T17:37:24.209 INFO:tasks.rados.rados.0.trial082.stdout:2076: finishing write tid 3 to trial08226312-38 2026-02-12T17:37:24.210 INFO:tasks.rados.rados.0.trial082.stdout:2076: finishing write tid 4 to trial08226312-38 2026-02-12T17:37:24.210 INFO:tasks.rados.rados.0.trial082.stdout:2076: oid 38 updating version 0 to 847 2026-02-12T17:37:24.210 INFO:tasks.rados.rados.0.trial082.stdout:2076: oid 38 updating version 847 to 849 2026-02-12T17:37:24.210 INFO:tasks.rados.rados.0.trial082.stdout:2076: oid 38 version 849 is already newer than 848 2026-02-12T17:37:24.210 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 849 (ObjNum 722 snap 213 seq_num 722) dirty exists 2026-02-12T17:37:24.210 INFO:tasks.rados.rados.0.trial082.stdout:2076: left oid 38 (ObjNum 722 snap 213 seq_num 722) 2026-02-12T17:37:24.210 INFO:tasks.rados.rados.0.trial082.stdout:2077: expect (ObjNum 719 snap 213 seq_num 719) 2026-02-12T17:37:24.210 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:24.223 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:24.253 INFO:tasks.rados.rados.0.trial082.stdout:2078: finishing rollback tid 0 to trial08226312-3 2026-02-12T17:37:24.253 INFO:tasks.rados.rados.0.trial082.stdout:2078: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:37:24.253 INFO:tasks.rados.rados.0.trial082.stdout:2078: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:37:24.253 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 912 (ObjNum 609 snap 188 seq_num 609) dirty exists 2026-02-12T17:37:24.254 INFO:tasks.rados.rados.0.trial082.stdout:2079: finishing write tid 1 to trial08226312-6 2026-02-12T17:37:24.254 INFO:tasks.rados.rados.0.trial082.stdout:2079: finishing write tid 2 to trial08226312-6 2026-02-12T17:37:24.254 INFO:tasks.rados.rados.0.trial082.stdout:2079: finishing write tid 3 to trial08226312-6 2026-02-12T17:37:24.254 INFO:tasks.rados.rados.0.trial082.stdout:2079: finishing write tid 4 to trial08226312-6 2026-02-12T17:37:24.254 INFO:tasks.rados.rados.0.trial082.stdout:2079: oid 6 updating version 0 to 716 2026-02-12T17:37:24.254 INFO:tasks.rados.rados.0.trial082.stdout:2079: oid 6 version 716 is already newer than 714 2026-02-12T17:37:24.254 INFO:tasks.rados.rados.0.trial082.stdout:2079: oid 6 version 716 is already newer than 715 2026-02-12T17:37:24.254 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 716 (ObjNum 723 snap 213 seq_num 723) dirty exists 2026-02-12T17:37:24.254 INFO:tasks.rados.rados.0.trial082.stdout:2079: left oid 6 (ObjNum 723 snap 213 seq_num 723) 2026-02-12T17:37:24.255 INFO:tasks.rados.rados.0.trial082.stdout:2076: done (5 left) 2026-02-12T17:37:24.255 INFO:tasks.rados.rados.0.trial082.stdout:2077: done (4 left) 2026-02-12T17:37:24.255 INFO:tasks.rados.rados.0.trial082.stdout:2078: done (3 left) 2026-02-12T17:37:24.255 INFO:tasks.rados.rados.0.trial082.stdout:2079: done (2 left) 2026-02-12T17:37:24.255 INFO:tasks.rados.rados.0.trial082.stdout:2080: done (1 left) 2026-02-12T17:37:24.255 INFO:tasks.rados.rados.0.trial082.stdout:2081: done (0 left) 2026-02-12T17:37:24.256 INFO:tasks.rados.rados.0.trial082.stdout:2082: snap_remove snap 212 2026-02-12T17:37:25.080 INFO:tasks.rados.rados.0.trial082.stdout:2082: done (0 left) 2026-02-12T17:37:25.080 INFO:tasks.rados.rados.0.trial082.stdout:2083: snap_create 2026-02-12T17:37:26.083 INFO:tasks.rados.rados.0.trial082.stdout:2083: done (0 left) 2026-02-12T17:37:26.083 INFO:tasks.rados.rados.0.trial082.stdout:2084: read oid 28 snap -1 2026-02-12T17:37:26.083 INFO:tasks.rados.rados.0.trial082.stdout:2084: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:26.083 INFO:tasks.rados.rados.0.trial082.stdout:2085: rollback oid 33 current snap is 214 2026-02-12T17:37:26.083 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 213 2026-02-12T17:37:26.083 INFO:tasks.rados.rados.0.trial082.stdout:2086: write (excl) oid 17 current snap is 214 2026-02-12T17:37:26.084 INFO:tasks.rados.rados.0.trial082.stdout:2086: seq_num 725 ranges {585075=409060,1542151=642924} 2026-02-12T17:37:26.087 INFO:tasks.rados.rados.0.trial082.stdout:2086: writing trial08226312-17 from 585075 to 994135 tid 1 2026-02-12T17:37:26.091 INFO:tasks.rados.rados.0.trial082.stdout:2086: writing trial08226312-17 from 1542151 to 2185075 tid 2 2026-02-12T17:37:26.091 INFO:tasks.rados.rados.0.trial082.stdout:2087: write oid 2 current snap is 214 2026-02-12T17:37:26.091 INFO:tasks.rados.rados.0.trial082.stdout:2087: seq_num 726 ranges {601882=484309,1600633=524904} 2026-02-12T17:37:26.095 INFO:tasks.rados.rados.0.trial082.stdout:2087: writing trial08226312-2 from 601882 to 1086191 tid 1 2026-02-12T17:37:26.099 INFO:tasks.rados.rados.0.trial082.stdout:2087: writing trial08226312-2 from 1600633 to 2125537 tid 2 2026-02-12T17:37:26.099 INFO:tasks.rados.rados.0.trial082.stdout:2088: write oid 21 current snap is 214 2026-02-12T17:37:26.099 INFO:tasks.rados.rados.0.trial082.stdout:2088: seq_num 727 ranges {618689=559558,1659115=559574} 2026-02-12T17:37:26.103 INFO:tasks.rados.rados.0.trial082.stdout:2088: writing trial08226312-21 from 618689 to 1178247 tid 1 2026-02-12T17:37:26.107 INFO:tasks.rados.rados.0.trial082.stdout:2088: writing trial08226312-21 from 1659115 to 2218689 tid 2 2026-02-12T17:37:26.107 INFO:tasks.rados.rados.0.trial082.stdout:2089: write (excl) oid 46 current snap is 214 2026-02-12T17:37:26.107 INFO:tasks.rados.rados.0.trial082.stdout:2089: seq_num 728 ranges {635496=634807,1717597=517899} 2026-02-12T17:37:26.112 INFO:tasks.rados.rados.0.trial082.stdout:2089: writing trial08226312-46 from 635496 to 1270303 tid 1 2026-02-12T17:37:26.115 INFO:tasks.rados.rados.0.trial082.stdout:2089: writing trial08226312-46 from 1717597 to 2235496 tid 2 2026-02-12T17:37:26.115 INFO:tasks.rados.rados.0.trial082.stdout:2090: snap_create 2026-02-12T17:37:26.115 INFO:tasks.rados.rados.0.trial082.stdout:2085: finishing rollback tid 0 to trial08226312-33 2026-02-12T17:37:26.115 INFO:tasks.rados.rados.0.trial082.stdout:2085: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:37:26.115 INFO:tasks.rados.rados.0.trial082.stdout:2085: finishing rollback tid 2 to trial08226312-33 2026-02-12T17:37:26.115 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1110 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:37:26.115 INFO:tasks.rados.rados.0.trial082.stdout:2084: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:26.170 INFO:tasks.rados.rados.0.trial082.stdout:2086: finishing write tid 1 to trial08226312-17 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2086: finishing write tid 2 to trial08226312-17 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2086: finishing write tid 3 to trial08226312-17 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2086: finishing write tid 4 to trial08226312-17 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2086: oid 17 updating version 0 to 1568 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2086: oid 17 updating version 1568 to 1569 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2086: oid 17 version 1569 is already newer than 1567 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 1569 (ObjNum 725 snap 214 seq_num 725) dirty exists 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2086: left oid 17 (ObjNum 725 snap 214 seq_num 725) 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2087: finishing write tid 1 to trial08226312-2 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2087: finishing write tid 2 to trial08226312-2 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2088: finishing write tid 1 to trial08226312-21 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2087: finishing write tid 3 to trial08226312-2 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2088: finishing write tid 2 to trial08226312-21 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2087: finishing write tid 4 to trial08226312-2 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2087: oid 2 updating version 0 to 932 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2087: oid 2 updating version 932 to 933 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2087: oid 2 version 933 is already newer than 931 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 933 (ObjNum 726 snap 214 seq_num 726) dirty exists 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2087: left oid 2 (ObjNum 726 snap 214 seq_num 726) 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2088: finishing write tid 3 to trial08226312-21 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2088: finishing write tid 4 to trial08226312-21 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2088: oid 21 updating version 0 to 1493 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2088: oid 21 updating version 1493 to 1495 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2088: oid 21 version 1495 is already newer than 1494 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1495 (ObjNum 727 snap 214 seq_num 727) dirty exists 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2088: left oid 21 (ObjNum 727 snap 214 seq_num 727) 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2089: finishing write tid 1 to trial08226312-46 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2089: finishing write tid 2 to trial08226312-46 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2089: finishing write tid 3 to trial08226312-46 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2089: finishing write tid 4 to trial08226312-46 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2089: oid 46 updating version 0 to 1256 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2089: oid 46 version 1256 is already newer than 1255 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2089: oid 46 version 1256 is already newer than 1254 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1256 (ObjNum 728 snap 214 seq_num 728) dirty exists 2026-02-12T17:37:26.171 INFO:tasks.rados.rados.0.trial082.stdout:2089: left oid 46 (ObjNum 728 snap 214 seq_num 728) 2026-02-12T17:37:27.086 INFO:tasks.rados.rados.0.trial082.stdout:2084: done (6 left) 2026-02-12T17:37:27.086 INFO:tasks.rados.rados.0.trial082.stdout:2085: done (5 left) 2026-02-12T17:37:27.086 INFO:tasks.rados.rados.0.trial082.stdout:2086: done (4 left) 2026-02-12T17:37:27.086 INFO:tasks.rados.rados.0.trial082.stdout:2087: done (3 left) 2026-02-12T17:37:27.086 INFO:tasks.rados.rados.0.trial082.stdout:2088: done (2 left) 2026-02-12T17:37:27.086 INFO:tasks.rados.rados.0.trial082.stdout:2089: done (1 left) 2026-02-12T17:37:27.086 INFO:tasks.rados.rados.0.trial082.stdout:2090: done (0 left) 2026-02-12T17:37:27.086 INFO:tasks.rados.rados.0.trial082.stdout:2091: snap_create 2026-02-12T17:37:28.398 INFO:tasks.rados.rados.0.trial082.stdout:2091: done (0 left) 2026-02-12T17:37:28.398 INFO:tasks.rados.rados.0.trial082.stdout:2092: read oid 33 snap -1 2026-02-12T17:37:28.398 INFO:tasks.rados.rados.0.trial082.stdout:2092: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:28.398 INFO:tasks.rados.rados.0.trial082.stdout:2093: write oid 34 current snap is 216 2026-02-12T17:37:28.398 INFO:tasks.rados.rados.0.trial082.stdout:2093: seq_num 729 ranges {652303=710056,2059726=192577} 2026-02-12T17:37:28.403 INFO:tasks.rados.rados.0.trial082.stdout:2093: writing trial08226312-34 from 652303 to 1362359 tid 1 2026-02-12T17:37:28.407 INFO:tasks.rados.rados.0.trial082.stdout:2093: writing trial08226312-34 from 2059726 to 2252303 tid 2 2026-02-12T17:37:28.407 INFO:tasks.rados.rados.0.trial082.stdout:2094: read oid 42 snap -1 2026-02-12T17:37:28.407 INFO:tasks.rados.rados.0.trial082.stdout:2094: expect deleted 2026-02-12T17:37:28.407 INFO:tasks.rados.rados.0.trial082.stdout:2095: snap_remove snap 214 2026-02-12T17:37:29.093 INFO:tasks.rados.rados.0.trial082.stdout:2095: done (3 left) 2026-02-12T17:37:29.093 INFO:tasks.rados.rados.0.trial082.stdout:2096: snap_create 2026-02-12T17:37:29.093 INFO:tasks.rados.rados.0.trial082.stdout:2092: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:29.093 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:29.124 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2674747 2026-02-12T17:37:29.136 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1657683 2026-02-12T17:37:29.153 INFO:tasks.rados.rados.0.trial082.stdout:2093: finishing write tid 1 to trial08226312-34 2026-02-12T17:37:29.153 INFO:tasks.rados.rados.0.trial082.stdout:2093: finishing write tid 2 to trial08226312-34 2026-02-12T17:37:29.153 INFO:tasks.rados.rados.0.trial082.stdout:2093: finishing write tid 3 to trial08226312-34 2026-02-12T17:37:29.154 INFO:tasks.rados.rados.0.trial082.stdout:2093: finishing write tid 4 to trial08226312-34 2026-02-12T17:37:29.154 INFO:tasks.rados.rados.0.trial082.stdout:2093: oid 34 updating version 0 to 1501 2026-02-12T17:37:29.154 INFO:tasks.rados.rados.0.trial082.stdout:2093: oid 34 updating version 1501 to 1503 2026-02-12T17:37:29.154 INFO:tasks.rados.rados.0.trial082.stdout:2093: oid 34 version 1503 is already newer than 1502 2026-02-12T17:37:29.154 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1503 (ObjNum 729 snap 216 seq_num 729) dirty exists 2026-02-12T17:37:29.154 INFO:tasks.rados.rados.0.trial082.stdout:2093: left oid 34 (ObjNum 729 snap 216 seq_num 729) 2026-02-12T17:37:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2092: done (3 left) 2026-02-12T17:37:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2093: done (2 left) 2026-02-12T17:37:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2094: done (1 left) 2026-02-12T17:37:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2096: done (0 left) 2026-02-12T17:37:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2097: rollback oid 22 current snap is 217 2026-02-12T17:37:30.094 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 216 2026-02-12T17:37:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2098: write (excl) oid 14 current snap is 217 2026-02-12T17:37:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2098: seq_num 730 ranges {669110=501658,1834561=434549} 2026-02-12T17:37:30.098 INFO:tasks.rados.rados.0.trial082.stdout:2098: writing trial08226312-14 from 669110 to 1170768 tid 1 2026-02-12T17:37:30.102 INFO:tasks.rados.rados.0.trial082.stdout:2098: writing trial08226312-14 from 1834561 to 2269110 tid 2 2026-02-12T17:37:30.102 INFO:tasks.rados.rados.0.trial082.stdout:2099: write oid 39 current snap is 217 2026-02-12T17:37:30.103 INFO:tasks.rados.rados.0.trial082.stdout:2097: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:37:30.103 INFO:tasks.rados.rados.0.trial082.stdout:2097: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:37:30.103 INFO:tasks.rados.rados.0.trial082.stdout:2097: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:37:30.103 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 1498 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:37:30.103 INFO:tasks.rados.rados.0.trial082.stdout:2098: finishing write tid 1 to trial08226312-14 2026-02-12T17:37:30.103 INFO:tasks.rados.rados.0.trial082.stdout:2099: seq_num 731 ranges {685917=576907,1893043=392874} 2026-02-12T17:37:30.107 INFO:tasks.rados.rados.0.trial082.stdout:2099: writing trial08226312-39 from 685917 to 1262824 tid 1 2026-02-12T17:37:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2099: writing trial08226312-39 from 1893043 to 2285917 tid 2 2026-02-12T17:37:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2097: done (2 left) 2026-02-12T17:37:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2100: copy_from oid 19 from oid 9 current snap is 217 2026-02-12T17:37:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2098: finishing write tid 2 to trial08226312-14 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2098: finishing write tid 3 to trial08226312-14 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2098: finishing write tid 4 to trial08226312-14 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2098: oid 14 updating version 0 to 915 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2098: oid 14 version 915 is already newer than 913 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2098: oid 14 version 915 is already newer than 914 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 915 (ObjNum 730 snap 217 seq_num 730) dirty exists 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2098: left oid 14 (ObjNum 730 snap 217 seq_num 730) 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2099: finishing write tid 1 to trial08226312-39 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2098: done (2 left) 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2101: copy_from oid 40 from oid 11 current snap is 217 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2102: read oid 31 snap -1 2026-02-12T17:37:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2102: expect deleted 2026-02-12T17:37:30.113 INFO:tasks.rados.rados.0.trial082.stdout:2103: read oid 42 snap -1 2026-02-12T17:37:30.113 INFO:tasks.rados.rados.0.trial082.stdout:2103: expect deleted 2026-02-12T17:37:30.113 INFO:tasks.rados.rados.0.trial082.stdout:2104: snap_remove snap 215 2026-02-12T17:37:31.098 INFO:tasks.rados.rados.0.trial082.stdout:2104: done (5 left) 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2105: rollback oid 37 current snap is 217 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 37 to 209 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2099: finishing write tid 2 to trial08226312-39 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2099: finishing write tid 3 to trial08226312-39 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2099: finishing write tid 4 to trial08226312-39 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2099: oid 39 updating version 0 to 936 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2099: oid 39 version 936 is already newer than 934 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2099: oid 39 version 936 is already newer than 935 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 936 (ObjNum 731 snap 217 seq_num 731) dirty exists 2026-02-12T17:37:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2099: left oid 39 (ObjNum 731 snap 217 seq_num 731) 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2101: finishing copy_from racing read to trial08226312-40 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2101: finishing copy_from to trial08226312-40 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1249 (ObjNum 270 snap 79 seq_num 270) dirty exists 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2100: finishing copy_from racing read to trial08226312-19 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2100: finishing copy_from to trial08226312-19 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 1262 (ObjNum 706 snap 212 seq_num 706) dirty exists 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2099: done (5 left) 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2100: done (4 left) 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2101: done (3 left) 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2102: done (2 left) 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2103: done (1 left) 2026-02-12T17:37:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2106: write (excl) oid 21 current snap is 217 2026-02-12T17:37:31.101 INFO:tasks.rados.rados.0.trial082.stdout:2106: seq_num 732 ranges {702724=652156,1951525=351199} 2026-02-12T17:37:31.102 INFO:tasks.rados.rados.0.trial082.stdout:2106: writing trial08226312-21 from 702724 to 1354880 tid 1 2026-02-12T17:37:31.106 INFO:tasks.rados.rados.0.trial082.stdout:2106: writing trial08226312-21 from 1951525 to 2302724 tid 2 2026-02-12T17:37:31.106 INFO:tasks.rados.rados.0.trial082.stdout:2107: read oid 14 snap 216 2026-02-12T17:37:31.107 INFO:tasks.rados.rados.0.trial082.stdout:2107: expect deleted 2026-02-12T17:37:31.107 INFO:tasks.rados.rados.0.trial082.stdout:2108: write oid 40 current snap is 217 2026-02-12T17:37:31.107 INFO:tasks.rados.rados.0.trial082.stdout:2108: seq_num 733 ranges {719531=727405,1893654=425877} 2026-02-12T17:37:31.111 INFO:tasks.rados.rados.0.trial082.stdout:2108: writing trial08226312-40 from 719531 to 1446936 tid 1 2026-02-12T17:37:31.116 INFO:tasks.rados.rados.0.trial082.stdout:2108: writing trial08226312-40 from 1893654 to 2319531 tid 2 2026-02-12T17:37:31.116 INFO:tasks.rados.rados.0.trial082.stdout:2109: read oid 43 snap 209 2026-02-12T17:37:31.116 INFO:tasks.rados.rados.0.trial082.stdout:2109: expect deleted 2026-02-12T17:37:31.116 INFO:tasks.rados.rados.0.trial082.stdout:2110: snap_create 2026-02-12T17:37:31.116 INFO:tasks.rados.rados.0.trial082.stdout:2105: finishing rollback tid 0 to trial08226312-37 2026-02-12T17:37:31.116 INFO:tasks.rados.rados.0.trial082.stdout:2105: finishing rollback tid 1 to trial08226312-37 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2105: finishing rollback tid 2 to trial08226312-37 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1113 (ObjNum 577 snap 176 seq_num 577) dirty exists 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2106: finishing write tid 1 to trial08226312-21 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2106: finishing write tid 2 to trial08226312-21 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2106: finishing write tid 3 to trial08226312-21 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2106: finishing write tid 4 to trial08226312-21 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2106: oid 21 updating version 0 to 1500 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2106: oid 21 version 1500 is already newer than 1499 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2106: oid 21 updating version 1500 to 1501 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1501 (ObjNum 732 snap 217 seq_num 732) dirty exists 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2106: left oid 21 (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:37:31.117 INFO:tasks.rados.rados.0.trial082.stdout:2108: finishing write tid 1 to trial08226312-40 2026-02-12T17:37:31.118 INFO:tasks.rados.rados.0.trial082.stdout:2108: finishing write tid 2 to trial08226312-40 2026-02-12T17:37:31.118 INFO:tasks.rados.rados.0.trial082.stdout:2108: finishing write tid 3 to trial08226312-40 2026-02-12T17:37:31.119 INFO:tasks.rados.rados.0.trial082.stdout:2108: finishing write tid 4 to trial08226312-40 2026-02-12T17:37:31.119 INFO:tasks.rados.rados.0.trial082.stdout:2108: oid 40 updating version 0 to 1289 2026-02-12T17:37:31.119 INFO:tasks.rados.rados.0.trial082.stdout:2108: oid 40 version 1289 is already newer than 1288 2026-02-12T17:37:31.119 INFO:tasks.rados.rados.0.trial082.stdout:2108: oid 40 version 1289 is already newer than 1287 2026-02-12T17:37:31.119 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1289 (ObjNum 733 snap 217 seq_num 733) dirty exists 2026-02-12T17:37:31.119 INFO:tasks.rados.rados.0.trial082.stdout:2108: left oid 40 (ObjNum 733 snap 217 seq_num 733) 2026-02-12T17:37:32.101 INFO:tasks.rados.rados.0.trial082.stdout:2105: done (5 left) 2026-02-12T17:37:32.102 INFO:tasks.rados.rados.0.trial082.stdout:2106: done (4 left) 2026-02-12T17:37:32.102 INFO:tasks.rados.rados.0.trial082.stdout:2107: done (3 left) 2026-02-12T17:37:32.102 INFO:tasks.rados.rados.0.trial082.stdout:2108: done (2 left) 2026-02-12T17:37:32.102 INFO:tasks.rados.rados.0.trial082.stdout:2109: done (1 left) 2026-02-12T17:37:32.102 INFO:tasks.rados.rados.0.trial082.stdout:2110: done (0 left) 2026-02-12T17:37:32.102 INFO:tasks.rados.rados.0.trial082.stdout:2111: read oid 25 snap -1 2026-02-12T17:37:32.102 INFO:tasks.rados.rados.0.trial082.stdout:2111: expect (ObjNum 702 snap 212 seq_num 702) 2026-02-12T17:37:32.102 INFO:tasks.rados.rados.0.trial082.stdout:2112: write oid 29 current snap is 218 2026-02-12T17:37:32.102 INFO:tasks.rados.rados.0.trial082.stdout:2112: seq_num 734 ranges {736338=402654,1552136=539580} 2026-02-12T17:37:32.106 INFO:tasks.rados.rados.0.trial082.stdout:2112: writing trial08226312-29 from 736338 to 1138992 tid 1 2026-02-12T17:37:32.110 INFO:tasks.rados.rados.0.trial082.stdout:2112: writing trial08226312-29 from 1552136 to 2091716 tid 2 2026-02-12T17:37:32.110 INFO:tasks.rados.rados.0.trial082.stdout:2113: rollback oid 14 current snap is 218 2026-02-12T17:37:32.110 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 14 to 209 2026-02-12T17:37:32.110 INFO:tasks.rados.rados.0.trial082.stdout:2111: expect (ObjNum 702 snap 212 seq_num 702) 2026-02-12T17:37:32.151 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 742083 2026-02-12T17:37:32.198 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3007420 2026-02-12T17:37:32.213 INFO:tasks.rados.rados.0.trial082.stdout:2112: finishing write tid 1 to trial08226312-29 2026-02-12T17:37:32.213 INFO:tasks.rados.rados.0.trial082.stdout:2112: finishing write tid 2 to trial08226312-29 2026-02-12T17:37:32.213 INFO:tasks.rados.rados.0.trial082.stdout:2112: finishing write tid 3 to trial08226312-29 2026-02-12T17:37:32.213 INFO:tasks.rados.rados.0.trial082.stdout:2113: finishing rollback tid 0 to trial08226312-14 2026-02-12T17:37:32.213 INFO:tasks.rados.rados.0.trial082.stdout:2113: finishing rollback tid 1 to trial08226312-14 2026-02-12T17:37:32.213 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 917 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:2112: finishing write tid 4 to trial08226312-29 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:2112: oid 29 updating version 0 to 718 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:2112: oid 29 updating version 718 to 719 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:2112: oid 29 version 719 is already newer than 717 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 719 (ObjNum 734 snap 218 seq_num 734) dirty exists 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:2112: left oid 29 (ObjNum 734 snap 218 seq_num 734) 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:2111: done (2 left) 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:2112: done (1 left) 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:2113: done (0 left) 2026-02-12T17:37:32.214 INFO:tasks.rados.rados.0.trial082.stdout:2114: snap_create 2026-02-12T17:37:33.063 INFO:tasks.rados.rados.0.trial082.stdout:2114: done (0 left) 2026-02-12T17:37:33.063 INFO:tasks.rados.rados.0.trial082.stdout:2115: write (excl) oid 25 current snap is 219 2026-02-12T17:37:33.063 INFO:tasks.rados.rados.0.trial082.stdout:2115: seq_num 735 ranges {753145=477903,2010618=342527} 2026-02-12T17:37:33.067 INFO:tasks.rados.rados.0.trial082.stdout:2115: writing trial08226312-25 from 753145 to 1231048 tid 1 2026-02-12T17:37:33.072 INFO:tasks.rados.rados.0.trial082.stdout:2115: writing trial08226312-25 from 2010618 to 2353145 tid 2 2026-02-12T17:37:33.072 INFO:tasks.rados.rados.0.trial082.stdout:2116: rollback oid 50 current snap is 219 2026-02-12T17:37:33.072 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 217 2026-02-12T17:37:33.072 INFO:tasks.rados.rados.0.trial082.stdout:2115: finishing write tid 1 to trial08226312-25 2026-02-12T17:37:33.072 INFO:tasks.rados.rados.0.trial082.stdout:2117: snap_remove snap 209 2026-02-12T17:37:34.066 INFO:tasks.rados.rados.0.trial082.stdout:2117: done (2 left) 2026-02-12T17:37:34.066 INFO:tasks.rados.rados.0.trial082.stdout:2118: snap_create 2026-02-12T17:37:34.066 INFO:tasks.rados.rados.0.trial082.stdout:2116: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:37:34.066 INFO:tasks.rados.rados.0.trial082.stdout:2116: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:37:34.066 INFO:tasks.rados.rados.0.trial082.stdout:2115: finishing write tid 2 to trial08226312-25 2026-02-12T17:37:34.066 INFO:tasks.rados.rados.0.trial082.stdout:2115: finishing write tid 3 to trial08226312-25 2026-02-12T17:37:34.066 INFO:tasks.rados.rados.0.trial082.stdout:2116: finishing rollback tid 2 to trial08226312-50 2026-02-12T17:37:34.066 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 722 (ObjNum 719 snap 213 seq_num 719) dirty exists 2026-02-12T17:37:34.067 INFO:tasks.rados.rados.0.trial082.stdout:2115: finishing write tid 4 to trial08226312-25 2026-02-12T17:37:34.067 INFO:tasks.rados.rados.0.trial082.stdout:2115: oid 25 updating version 0 to 544 2026-02-12T17:37:34.067 INFO:tasks.rados.rados.0.trial082.stdout:2115: oid 25 updating version 544 to 545 2026-02-12T17:37:34.067 INFO:tasks.rados.rados.0.trial082.stdout:2115: oid 25 version 545 is already newer than 543 2026-02-12T17:37:34.067 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 545 (ObjNum 735 snap 219 seq_num 735) dirty exists 2026-02-12T17:37:34.067 INFO:tasks.rados.rados.0.trial082.stdout:2115: left oid 25 (ObjNum 735 snap 219 seq_num 735) 2026-02-12T17:37:35.067 INFO:tasks.rados.rados.0.trial082.stdout:2115: done (2 left) 2026-02-12T17:37:35.067 INFO:tasks.rados.rados.0.trial082.stdout:2116: done (1 left) 2026-02-12T17:37:35.067 INFO:tasks.rados.rados.0.trial082.stdout:2118: done (0 left) 2026-02-12T17:37:35.067 INFO:tasks.rados.rados.0.trial082.stdout:2119: snap_remove snap 219 2026-02-12T17:37:36.068 INFO:tasks.rados.rados.0.trial082.stdout:2119: done (0 left) 2026-02-12T17:37:36.068 INFO:tasks.rados.rados.0.trial082.stdout:2120: snap_remove snap 218 2026-02-12T17:37:37.069 INFO:tasks.rados.rados.0.trial082.stdout:2120: done (0 left) 2026-02-12T17:37:37.069 INFO:tasks.rados.rados.0.trial082.stdout:2121: read oid 34 snap -1 2026-02-12T17:37:37.069 INFO:tasks.rados.rados.0.trial082.stdout:2121: expect (ObjNum 729 snap 216 seq_num 729) 2026-02-12T17:37:37.069 INFO:tasks.rados.rados.0.trial082.stdout:2122: snap_create 2026-02-12T17:37:37.076 INFO:tasks.rados.rados.0.trial082.stdout:2121: expect (ObjNum 729 snap 216 seq_num 729) 2026-02-12T17:37:37.127 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 663673 2026-02-12T17:37:37.158 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:38.064 INFO:tasks.rados.rados.0.trial082.stdout:2121: done (1 left) 2026-02-12T17:37:38.064 INFO:tasks.rados.rados.0.trial082.stdout:2122: done (0 left) 2026-02-12T17:37:38.064 INFO:tasks.rados.rados.0.trial082.stdout:2123: copy_from oid 29 from oid 9 current snap is 221 2026-02-12T17:37:38.064 INFO:tasks.rados.rados.0.trial082.stdout:2124: copy_from oid 26 from oid 6 current snap is 221 2026-02-12T17:37:38.064 INFO:tasks.rados.rados.0.trial082.stdout:2125: snap_create 2026-02-12T17:37:38.072 INFO:tasks.rados.rados.0.trial082.stdout:2123: finishing copy_from racing read to trial08226312-29 2026-02-12T17:37:38.072 INFO:tasks.rados.rados.0.trial082.stdout:2124: finishing copy_from racing read to trial08226312-26 2026-02-12T17:37:38.073 INFO:tasks.rados.rados.0.trial082.stdout:2123: finishing copy_from to trial08226312-29 2026-02-12T17:37:38.073 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 1262 (ObjNum 706 snap 212 seq_num 706) dirty exists 2026-02-12T17:37:38.073 INFO:tasks.rados.rados.0.trial082.stdout:2124: finishing copy_from to trial08226312-26 2026-02-12T17:37:38.073 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 716 (ObjNum 723 snap 213 seq_num 723) dirty exists 2026-02-12T17:37:39.553 INFO:tasks.rados.rados.0.trial082.stdout:2123: done (2 left) 2026-02-12T17:37:39.553 INFO:tasks.rados.rados.0.trial082.stdout:2124: done (1 left) 2026-02-12T17:37:39.553 INFO:tasks.rados.rados.0.trial082.stdout:2125: done (0 left) 2026-02-12T17:37:39.553 INFO:tasks.rados.rados.0.trial082.stdout:2126: copy_from oid 23 from oid 14 current snap is 222 2026-02-12T17:37:39.553 INFO:tasks.rados.rados.0.trial082.stdout:2127: snap_create 2026-02-12T17:37:39.554 INFO:tasks.rados.rados.0.trial082.stdout:2126: finishing copy_from to trial08226312-23 2026-02-12T17:37:39.554 INFO:tasks.rados.rados.0.trial082.stdout:2126: got expected ENOENT (src dne) 2026-02-12T17:37:39.554 INFO:tasks.rados.rados.0.trial082.stdout:2126: finishing copy_from racing read to trial08226312-23 2026-02-12T17:37:40.555 INFO:tasks.rados.rados.0.trial082.stdout:2126: done (1 left) 2026-02-12T17:37:40.555 INFO:tasks.rados.rados.0.trial082.stdout:2127: done (0 left) 2026-02-12T17:37:40.555 INFO:tasks.rados.rados.0.trial082.stdout:2128: copy_from oid 36 from oid 33 current snap is 223 2026-02-12T17:37:40.555 INFO:tasks.rados.rados.0.trial082.stdout:2129: snap_create 2026-02-12T17:37:40.563 INFO:tasks.rados.rados.0.trial082.stdout:2128: finishing copy_from racing read to trial08226312-36 2026-02-12T17:37:40.565 INFO:tasks.rados.rados.0.trial082.stdout:2128: finishing copy_from to trial08226312-36 2026-02-12T17:37:40.565 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 1110 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:37:41.556 INFO:tasks.rados.rados.0.trial082.stdout:2128: done (1 left) 2026-02-12T17:37:41.556 INFO:tasks.rados.rados.0.trial082.stdout:2129: done (0 left) 2026-02-12T17:37:41.556 INFO:tasks.rados.rados.0.trial082.stdout:2130: snap_remove snap 213 2026-02-12T17:37:42.557 INFO:tasks.rados.rados.0.trial082.stdout:2130: done (0 left) 2026-02-12T17:37:42.557 INFO:tasks.rados.rados.0.trial082.stdout:2131: write oid 37 current snap is 224 2026-02-12T17:37:42.557 INFO:tasks.rados.rados.0.trial082.stdout:2131: seq_num 736 ranges {769952=553152,2069100=300852} 2026-02-12T17:37:42.562 INFO:tasks.rados.rados.0.trial082.stdout:2131: writing trial08226312-37 from 769952 to 1323104 tid 1 2026-02-12T17:37:42.566 INFO:tasks.rados.rados.0.trial082.stdout:2131: writing trial08226312-37 from 2069100 to 2369952 tid 2 2026-02-12T17:37:42.567 INFO:tasks.rados.rados.0.trial082.stdout:2132: rollback oid 48 current snap is 224 2026-02-12T17:37:42.567 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 223 2026-02-12T17:37:42.567 INFO:tasks.rados.rados.0.trial082.stdout:2131: finishing write tid 1 to trial08226312-37 2026-02-12T17:37:42.567 INFO:tasks.rados.rados.0.trial082.stdout:2133: snap_remove snap 222 2026-02-12T17:37:43.065 INFO:tasks.rados.rados.0.trial082.stdout:2133: done (2 left) 2026-02-12T17:37:43.065 INFO:tasks.rados.rados.0.trial082.stdout:2134: delete oid 47 current snap is 224 2026-02-12T17:37:43.065 INFO:tasks.rados.rados.0.trial082.stdout:2131: finishing write tid 2 to trial08226312-37 2026-02-12T17:37:43.065 INFO:tasks.rados.rados.0.trial082.stdout:2131: finishing write tid 3 to trial08226312-37 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:2131: finishing write tid 4 to trial08226312-37 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:2131: oid 37 updating version 0 to 1114 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:2131: oid 37 updating version 1114 to 1115 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:2131: oid 37 updating version 1115 to 1116 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1116 (ObjNum 736 snap 224 seq_num 736) dirty exists 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:2131: left oid 37 (ObjNum 736 snap 224 seq_num 736) 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:2132: finishing rollback tid 0 to trial08226312-48 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:2132: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:2132: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:37:43.066 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 824 (ObjNum 717 snap 213 seq_num 717) dirty exists 2026-02-12T17:37:43.067 INFO:tasks.rados.rados.0.trial082.stdout:2131: done (2 left) 2026-02-12T17:37:43.067 INFO:tasks.rados.rados.0.trial082.stdout:2132: done (1 left) 2026-02-12T17:37:43.067 INFO:tasks.rados.rados.0.trial082.stdout:2134: done (0 left) 2026-02-12T17:37:43.068 INFO:tasks.rados.rados.0.trial082.stdout:2135: rollback oid 50 current snap is 224 2026-02-12T17:37:43.068 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 216 2026-02-12T17:37:43.068 INFO:tasks.rados.rados.0.trial082.stdout:2136: delete oid 11 current snap is 224 2026-02-12T17:37:43.074 INFO:tasks.rados.rados.0.trial082.stdout:2135: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:37:43.075 INFO:tasks.rados.rados.0.trial082.stdout:2135: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2135: finishing rollback tid 2 to trial08226312-50 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 1265 (ObjNum 719 snap 213 seq_num 719) dirty exists 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2135: done (1 left) 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2136: done (0 left) 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2137: read oid 32 snap -1 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2137: expect deleted 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2138: read oid 8 snap -1 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2138: expect (ObjNum 713 snap 213 seq_num 713) 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2139: read oid 7 snap -1 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2139: expect deleted 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2140: write (excl) oid 14 current snap is 224 2026-02-12T17:37:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2140: seq_num 739 ranges {420373=495252,1444546=690576} 2026-02-12T17:37:43.079 INFO:tasks.rados.rados.0.trial082.stdout:2140: writing trial08226312-14 from 420373 to 915625 tid 1 2026-02-12T17:37:43.084 INFO:tasks.rados.rados.0.trial082.stdout:2140: writing trial08226312-14 from 1444546 to 2135122 tid 2 2026-02-12T17:37:43.084 INFO:tasks.rados.rados.0.trial082.stdout:2141: snap_create 2026-02-12T17:37:43.084 INFO:tasks.rados.rados.0.trial082.stdout:2140: finishing write tid 1 to trial08226312-14 2026-02-12T17:37:43.084 INFO:tasks.rados.rados.0.trial082.stdout:2138: expect (ObjNum 713 snap 213 seq_num 713) 2026-02-12T17:37:43.084 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:43.125 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:43.166 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:43.207 INFO:tasks.rados.rados.0.trial082.stdout:2140: finishing write tid 2 to trial08226312-14 2026-02-12T17:37:43.207 INFO:tasks.rados.rados.0.trial082.stdout:2140: finishing write tid 3 to trial08226312-14 2026-02-12T17:37:43.207 INFO:tasks.rados.rados.0.trial082.stdout:2140: finishing write tid 4 to trial08226312-14 2026-02-12T17:37:43.207 INFO:tasks.rados.rados.0.trial082.stdout:2140: oid 14 updating version 0 to 918 2026-02-12T17:37:43.207 INFO:tasks.rados.rados.0.trial082.stdout:2140: oid 14 updating version 918 to 920 2026-02-12T17:37:43.207 INFO:tasks.rados.rados.0.trial082.stdout:2140: oid 14 version 920 is already newer than 919 2026-02-12T17:37:43.207 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 920 (ObjNum 739 snap 224 seq_num 739) dirty exists 2026-02-12T17:37:43.208 INFO:tasks.rados.rados.0.trial082.stdout:2140: left oid 14 (ObjNum 739 snap 224 seq_num 739) 2026-02-12T17:37:44.068 INFO:tasks.rados.rados.0.trial082.stdout:2137: done (4 left) 2026-02-12T17:37:44.068 INFO:tasks.rados.rados.0.trial082.stdout:2138: done (3 left) 2026-02-12T17:37:44.068 INFO:tasks.rados.rados.0.trial082.stdout:2139: done (2 left) 2026-02-12T17:37:44.068 INFO:tasks.rados.rados.0.trial082.stdout:2140: done (1 left) 2026-02-12T17:37:44.068 INFO:tasks.rados.rados.0.trial082.stdout:2141: done (0 left) 2026-02-12T17:37:44.068 INFO:tasks.rados.rados.0.trial082.stdout:2142: write oid 39 current snap is 225 2026-02-12T17:37:44.068 INFO:tasks.rados.rados.0.trial082.stdout:2142: seq_num 740 ranges {437180=570501,1503028=550587} 2026-02-12T17:37:44.071 INFO:tasks.rados.rados.0.trial082.stdout:2142: writing trial08226312-39 from 437180 to 1007681 tid 1 2026-02-12T17:37:44.075 INFO:tasks.rados.rados.0.trial082.stdout:2142: writing trial08226312-39 from 1503028 to 2053615 tid 2 2026-02-12T17:37:44.076 INFO:tasks.rados.rados.0.trial082.stdout:2143: read oid 49 snap -1 2026-02-12T17:37:44.076 INFO:tasks.rados.rados.0.trial082.stdout:2143: expect (ObjNum 654 snap 202 seq_num 654) 2026-02-12T17:37:44.076 INFO:tasks.rados.rados.0.trial082.stdout:2144: write (excl) oid 25 current snap is 225 2026-02-12T17:37:44.076 INFO:tasks.rados.rados.0.trial082.stdout:2142: finishing write tid 1 to trial08226312-39 2026-02-12T17:37:44.076 INFO:tasks.rados.rados.0.trial082.stdout:2144: seq_num 741 ranges {453987=645750,1845157=608830} 2026-02-12T17:37:44.079 INFO:tasks.rados.rados.0.trial082.stdout:2144: writing trial08226312-25 from 453987 to 1099737 tid 1 2026-02-12T17:37:44.085 INFO:tasks.rados.rados.0.trial082.stdout:2144: writing trial08226312-25 from 1845157 to 2453987 tid 2 2026-02-12T17:37:44.085 INFO:tasks.rados.rados.0.trial082.stdout:2145: read oid 44 snap 224 2026-02-12T17:37:44.085 INFO:tasks.rados.rados.0.trial082.stdout:2145: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:44.085 INFO:tasks.rados.rados.0.trial082.stdout:2146: delete oid 19 current snap is 225 2026-02-12T17:37:44.085 INFO:tasks.rados.rados.0.trial082.stdout:2142: finishing write tid 2 to trial08226312-39 2026-02-12T17:37:44.086 INFO:tasks.rados.rados.0.trial082.stdout:2142: finishing write tid 3 to trial08226312-39 2026-02-12T17:37:44.086 INFO:tasks.rados.rados.0.trial082.stdout:2142: finishing write tid 4 to trial08226312-39 2026-02-12T17:37:44.086 INFO:tasks.rados.rados.0.trial082.stdout:2142: oid 39 updating version 0 to 937 2026-02-12T17:37:44.086 INFO:tasks.rados.rados.0.trial082.stdout:2142: oid 39 updating version 937 to 938 2026-02-12T17:37:44.086 INFO:tasks.rados.rados.0.trial082.stdout:2142: oid 39 updating version 938 to 939 2026-02-12T17:37:44.086 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 939 (ObjNum 740 snap 225 seq_num 740) dirty exists 2026-02-12T17:37:44.086 INFO:tasks.rados.rados.0.trial082.stdout:2142: left oid 39 (ObjNum 740 snap 225 seq_num 740) 2026-02-12T17:37:44.086 INFO:tasks.rados.rados.0.trial082.stdout:2143: expect (ObjNum 654 snap 202 seq_num 654) 2026-02-12T17:37:44.147 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1722362 2026-02-12T17:37:44.187 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1817252 2026-02-12T17:37:44.211 INFO:tasks.rados.rados.0.trial082.stdout:2144: finishing write tid 1 to trial08226312-25 2026-02-12T17:37:44.211 INFO:tasks.rados.rados.0.trial082.stdout:2142: done (4 left) 2026-02-12T17:37:44.211 INFO:tasks.rados.rados.0.trial082.stdout:2143: done (3 left) 2026-02-12T17:37:44.211 INFO:tasks.rados.rados.0.trial082.stdout:2146: done (2 left) 2026-02-12T17:37:44.212 INFO:tasks.rados.rados.0.trial082.stdout:2147: copy_from oid 36 from oid 32 current snap is 225 2026-02-12T17:37:44.212 INFO:tasks.rados.rados.0.trial082.stdout:2144: finishing write tid 2 to trial08226312-25 2026-02-12T17:37:44.212 INFO:tasks.rados.rados.0.trial082.stdout:2145: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:44.212 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:2144: finishing write tid 3 to trial08226312-25 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:2144: finishing write tid 4 to trial08226312-25 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:2144: oid 25 updating version 0 to 548 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:2144: oid 25 version 548 is already newer than 546 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:2144: oid 25 version 548 is already newer than 547 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 548 (ObjNum 741 snap 225 seq_num 741) dirty exists 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:2144: left oid 25 (ObjNum 741 snap 225 seq_num 741) 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:2147: finishing copy_from to trial08226312-36 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:2147: got expected ENOENT (src dne) 2026-02-12T17:37:44.297 INFO:tasks.rados.rados.0.trial082.stdout:2147: finishing copy_from racing read to trial08226312-36 2026-02-12T17:37:44.298 INFO:tasks.rados.rados.0.trial082.stdout:2144: done (2 left) 2026-02-12T17:37:44.298 INFO:tasks.rados.rados.0.trial082.stdout:2145: done (1 left) 2026-02-12T17:37:44.298 INFO:tasks.rados.rados.0.trial082.stdout:2147: done (0 left) 2026-02-12T17:37:44.298 INFO:tasks.rados.rados.0.trial082.stdout:2148: delete oid 38 current snap is 225 2026-02-12T17:37:44.299 INFO:tasks.rados.rados.0.trial082.stdout:2148: done (0 left) 2026-02-12T17:37:44.299 INFO:tasks.rados.rados.0.trial082.stdout:2149: delete oid 11 current snap is 225 2026-02-12T17:37:44.300 INFO:tasks.rados.rados.0.trial082.stdout:2149: done (0 left) 2026-02-12T17:37:44.300 INFO:tasks.rados.rados.0.trial082.stdout:2150: snap_create 2026-02-12T17:37:45.069 INFO:tasks.rados.rados.0.trial082.stdout:2150: done (0 left) 2026-02-12T17:37:45.069 INFO:tasks.rados.rados.0.trial082.stdout:2151: rollback oid 8 current snap is 226 2026-02-12T17:37:45.069 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 225 2026-02-12T17:37:45.069 INFO:tasks.rados.rados.0.trial082.stdout:2152: snap_create 2026-02-12T17:37:45.073 INFO:tasks.rados.rados.0.trial082.stdout:2151: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:37:45.073 INFO:tasks.rados.rados.0.trial082.stdout:2151: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:37:45.074 INFO:tasks.rados.rados.0.trial082.stdout:2151: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:37:45.074 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1594 (ObjNum 713 snap 213 seq_num 713) dirty exists 2026-02-12T17:37:46.071 INFO:tasks.rados.rados.0.trial082.stdout:2151: done (1 left) 2026-02-12T17:37:46.071 INFO:tasks.rados.rados.0.trial082.stdout:2152: done (0 left) 2026-02-12T17:37:46.071 INFO:tasks.rados.rados.0.trial082.stdout:2153: read oid 11 snap 220 2026-02-12T17:37:46.071 INFO:tasks.rados.rados.0.trial082.stdout:2153: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:37:46.071 INFO:tasks.rados.rados.0.trial082.stdout:2154: write (excl) oid 30 current snap is 227 2026-02-12T17:37:46.071 INFO:tasks.rados.rados.0.trial082.stdout:2154: seq_num 745 ranges {521215=546746,1562732=701583} 2026-02-12T17:37:46.075 INFO:tasks.rados.rados.0.trial082.stdout:2154: writing trial08226312-30 from 521215 to 1067961 tid 1 2026-02-12T17:37:46.080 INFO:tasks.rados.rados.0.trial082.stdout:2154: writing trial08226312-30 from 1562732 to 2264315 tid 2 2026-02-12T17:37:46.080 INFO:tasks.rados.rados.0.trial082.stdout:2155: write oid 4 current snap is 227 2026-02-12T17:37:46.080 INFO:tasks.rados.rados.0.trial082.stdout:2155: seq_num 746 ranges {538022=738348,1737567=561594} 2026-02-12T17:37:46.084 INFO:tasks.rados.rados.0.trial082.stdout:2155: writing trial08226312-4 from 538022 to 1276370 tid 1 2026-02-12T17:37:46.088 INFO:tasks.rados.rados.0.trial082.stdout:2155: writing trial08226312-4 from 1737567 to 2299161 tid 2 2026-02-12T17:37:46.088 INFO:tasks.rados.rados.0.trial082.stdout:2156: write (excl) oid 3 current snap is 227 2026-02-12T17:37:46.088 INFO:tasks.rados.rados.0.trial082.stdout:2156: seq_num 747 ranges {554829=413597,1396049=705252} 2026-02-12T17:37:46.091 INFO:tasks.rados.rados.0.trial082.stdout:2156: writing trial08226312-3 from 554829 to 968426 tid 1 2026-02-12T17:37:46.096 INFO:tasks.rados.rados.0.trial082.stdout:2156: writing trial08226312-3 from 1396049 to 2101301 tid 2 2026-02-12T17:37:46.096 INFO:tasks.rados.rados.0.trial082.stdout:2157: read oid 2 snap -1 2026-02-12T17:37:46.096 INFO:tasks.rados.rados.0.trial082.stdout:2157: expect (ObjNum 726 snap 214 seq_num 726) 2026-02-12T17:37:46.096 INFO:tasks.rados.rados.0.trial082.stdout:2158: rollback oid 10 current snap is 227 2026-02-12T17:37:46.096 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 10 to 217 2026-02-12T17:37:46.097 INFO:tasks.rados.rados.0.trial082.stdout:2153: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:37:46.217 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2066564 2026-02-12T17:37:46.222 INFO:tasks.rados.rados.0.trial082.stdout:2154: finishing write tid 1 to trial08226312-30 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2154: finishing write tid 2 to trial08226312-30 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2154: finishing write tid 3 to trial08226312-30 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2154: finishing write tid 4 to trial08226312-30 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2154: oid 30 updating version 0 to 1504 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2154: oid 30 version 1504 is already newer than 1503 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2154: oid 30 version 1504 is already newer than 1502 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1504 (ObjNum 745 snap 227 seq_num 745) dirty exists 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2154: left oid 30 (ObjNum 745 snap 227 seq_num 745) 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2155: finishing write tid 1 to trial08226312-4 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2155: finishing write tid 2 to trial08226312-4 2026-02-12T17:37:46.223 INFO:tasks.rados.rados.0.trial082.stdout:2155: finishing write tid 3 to trial08226312-4 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2155: finishing write tid 4 to trial08226312-4 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2155: oid 4 updating version 0 to 1595 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2155: oid 4 updating version 1595 to 1597 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2155: oid 4 version 1597 is already newer than 1596 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 1597 (ObjNum 746 snap 227 seq_num 746) dirty exists 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2155: left oid 4 (ObjNum 746 snap 227 seq_num 746) 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2156: finishing write tid 1 to trial08226312-3 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2158: finishing rollback tid 0 to trial08226312-10 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2158: finishing rollback tid 1 to trial08226312-10 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2158: finishing rollback tid 2 to trial08226312-10 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1507 (ObjNum 707 snap 212 seq_num 707) dirty exists 2026-02-12T17:37:46.224 INFO:tasks.rados.rados.0.trial082.stdout:2156: finishing write tid 2 to trial08226312-3 2026-02-12T17:37:46.225 INFO:tasks.rados.rados.0.trial082.stdout:2157: expect (ObjNum 726 snap 214 seq_num 726) 2026-02-12T17:37:46.246 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 425038 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:2156: finishing write tid 3 to trial08226312-3 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:2156: finishing write tid 4 to trial08226312-3 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:2156: oid 3 updating version 0 to 922 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:2156: oid 3 version 922 is already newer than 921 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:2156: oid 3 updating version 922 to 923 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 923 (ObjNum 747 snap 227 seq_num 747) dirty exists 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:2156: left oid 3 (ObjNum 747 snap 227 seq_num 747) 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:2153: done (5 left) 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:2154: done (4 left) 2026-02-12T17:37:46.261 INFO:tasks.rados.rados.0.trial082.stdout:2155: done (3 left) 2026-02-12T17:37:46.262 INFO:tasks.rados.rados.0.trial082.stdout:2156: done (2 left) 2026-02-12T17:37:46.262 INFO:tasks.rados.rados.0.trial082.stdout:2157: done (1 left) 2026-02-12T17:37:46.262 INFO:tasks.rados.rados.0.trial082.stdout:2158: done (0 left) 2026-02-12T17:37:46.262 INFO:tasks.rados.rados.0.trial082.stdout:2159: rollback oid 34 current snap is 227 2026-02-12T17:37:46.262 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 226 2026-02-12T17:37:46.262 INFO:tasks.rados.rados.0.trial082.stdout:2160: snap_remove snap 221 2026-02-12T17:37:47.075 INFO:tasks.rados.rados.0.trial082.stdout:2160: done (1 left) 2026-02-12T17:37:47.075 INFO:tasks.rados.rados.0.trial082.stdout:2161: read oid 49 snap -1 2026-02-12T17:37:47.075 INFO:tasks.rados.rados.0.trial082.stdout:2161: expect (ObjNum 654 snap 202 seq_num 654) 2026-02-12T17:37:47.076 INFO:tasks.rados.rados.0.trial082.stdout:2162: read oid 27 snap -1 2026-02-12T17:37:47.076 INFO:tasks.rados.rados.0.trial082.stdout:2162: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:47.076 INFO:tasks.rados.rados.0.trial082.stdout:2163: write oid 47 current snap is 227 2026-02-12T17:37:47.076 INFO:tasks.rados.rados.0.trial082.stdout:2159: finishing rollback tid 0 to trial08226312-34 2026-02-12T17:37:47.076 INFO:tasks.rados.rados.0.trial082.stdout:2159: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:37:47.076 INFO:tasks.rados.rados.0.trial082.stdout:2159: finishing rollback tid 2 to trial08226312-34 2026-02-12T17:37:47.076 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1506 (ObjNum 729 snap 216 seq_num 729) dirty exists 2026-02-12T17:37:47.076 INFO:tasks.rados.rados.0.trial082.stdout:2163: seq_num 748 ranges {571636=488846,1854531=565263} 2026-02-12T17:37:47.078 INFO:tasks.rados.rados.0.trial082.stdout:2163: writing trial08226312-47 from 571636 to 1060482 tid 1 2026-02-12T17:37:47.084 INFO:tasks.rados.rados.0.trial082.stdout:2163: writing trial08226312-47 from 1854531 to 2419794 tid 2 2026-02-12T17:37:47.084 INFO:tasks.rados.rados.0.trial082.stdout:2159: done (3 left) 2026-02-12T17:37:47.084 INFO:tasks.rados.rados.0.trial082.stdout:2164: write (excl) oid 11 current snap is 227 2026-02-12T17:37:47.084 INFO:tasks.rados.rados.0.trial082.stdout:2164: seq_num 749 ranges {588443=564095,1796660=708921} 2026-02-12T17:37:47.088 INFO:tasks.rados.rados.0.trial082.stdout:2164: writing trial08226312-11 from 588443 to 1152538 tid 1 2026-02-12T17:37:47.093 INFO:tasks.rados.rados.0.trial082.stdout:2164: writing trial08226312-11 from 1796660 to 2505581 tid 2 2026-02-12T17:37:47.093 INFO:tasks.rados.rados.0.trial082.stdout:2165: write oid 40 current snap is 227 2026-02-12T17:37:47.093 INFO:tasks.rados.rados.0.trial082.stdout:2165: seq_num 750 ranges {605250=639344,1855142=452579} 2026-02-12T17:37:47.097 INFO:tasks.rados.rados.0.trial082.stdout:2165: writing trial08226312-40 from 605250 to 1244594 tid 1 2026-02-12T17:37:47.102 INFO:tasks.rados.rados.0.trial082.stdout:2165: writing trial08226312-40 from 1855142 to 2307721 tid 2 2026-02-12T17:37:47.102 INFO:tasks.rados.rados.0.trial082.stdout:2166: read oid 13 snap -1 2026-02-12T17:37:47.102 INFO:tasks.rados.rados.0.trial082.stdout:2166: expect (ObjNum 679 snap 207 seq_num 679) 2026-02-12T17:37:47.102 INFO:tasks.rados.rados.0.trial082.stdout:2167: snap_create 2026-02-12T17:37:47.102 INFO:tasks.rados.rados.0.trial082.stdout:2162: expect (ObjNum 546 snap 167 seq_num 546) 2026-02-12T17:37:47.102 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 393534 2026-02-12T17:37:47.131 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:47.194 INFO:tasks.rados.rados.0.trial082.stdout:2161: expect (ObjNum 654 snap 202 seq_num 654) 2026-02-12T17:37:47.209 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1649439 2026-02-12T17:37:47.325 INFO:tasks.rados.rados.0.trial082.stdout:2163: finishing write tid 1 to trial08226312-47 2026-02-12T17:37:47.325 INFO:tasks.rados.rados.0.trial082.stdout:2163: finishing write tid 2 to trial08226312-47 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2163: finishing write tid 3 to trial08226312-47 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2163: finishing write tid 4 to trial08226312-47 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2163: oid 47 updating version 0 to 1603 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2163: oid 47 updating version 1603 to 1604 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2163: oid 47 version 1604 is already newer than 1602 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1604 (ObjNum 748 snap 227 seq_num 748) dirty exists 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2163: left oid 47 (ObjNum 748 snap 227 seq_num 748) 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2164: finishing write tid 1 to trial08226312-11 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2164: finishing write tid 2 to trial08226312-11 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2164: finishing write tid 3 to trial08226312-11 2026-02-12T17:37:47.326 INFO:tasks.rados.rados.0.trial082.stdout:2164: finishing write tid 4 to trial08226312-11 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2164: oid 11 updating version 0 to 1260 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2164: oid 11 version 1260 is already newer than 1259 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2164: oid 11 version 1260 is already newer than 1258 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1260 (ObjNum 749 snap 227 seq_num 749) dirty exists 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2164: left oid 11 (ObjNum 749 snap 227 seq_num 749) 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2165: finishing write tid 1 to trial08226312-40 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2165: finishing write tid 2 to trial08226312-40 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2165: finishing write tid 3 to trial08226312-40 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2165: finishing write tid 4 to trial08226312-40 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2165: oid 40 updating version 0 to 1302 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2165: oid 40 updating version 1302 to 1303 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:2165: oid 40 version 1303 is already newer than 1301 2026-02-12T17:37:47.327 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1303 (ObjNum 750 snap 227 seq_num 750) dirty exists 2026-02-12T17:37:47.328 INFO:tasks.rados.rados.0.trial082.stdout:2165: left oid 40 (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:37:47.328 INFO:tasks.rados.rados.0.trial082.stdout:2166: expect (ObjNum 679 snap 207 seq_num 679) 2026-02-12T17:37:47.328 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1451265 2026-02-12T17:37:47.345 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:48.067 INFO:tasks.rados.rados.0.trial082.stdout:2161: done (6 left) 2026-02-12T17:37:48.067 INFO:tasks.rados.rados.0.trial082.stdout:2162: done (5 left) 2026-02-12T17:37:48.067 INFO:tasks.rados.rados.0.trial082.stdout:2163: done (4 left) 2026-02-12T17:37:48.067 INFO:tasks.rados.rados.0.trial082.stdout:2164: done (3 left) 2026-02-12T17:37:48.067 INFO:tasks.rados.rados.0.trial082.stdout:2165: done (2 left) 2026-02-12T17:37:48.067 INFO:tasks.rados.rados.0.trial082.stdout:2166: done (1 left) 2026-02-12T17:37:48.067 INFO:tasks.rados.rados.0.trial082.stdout:2167: done (0 left) 2026-02-12T17:37:48.067 INFO:tasks.rados.rados.0.trial082.stdout:2168: rollback oid 5 current snap is 228 2026-02-12T17:37:48.068 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 5 to 226 2026-02-12T17:37:48.068 INFO:tasks.rados.rados.0.trial082.stdout:2169: copy_from oid 23 from oid 21 current snap is 228 2026-02-12T17:37:48.068 INFO:tasks.rados.rados.0.trial082.stdout:2170: copy_from oid 19 from oid 26 current snap is 228 2026-02-12T17:37:48.068 INFO:tasks.rados.rados.0.trial082.stdout:2171: snap_remove snap 220 2026-02-12T17:37:49.066 INFO:tasks.rados.rados.0.trial082.stdout:2171: done (3 left) 2026-02-12T17:37:49.066 INFO:tasks.rados.rados.0.trial082.stdout:2172: snap_create 2026-02-12T17:37:49.066 INFO:tasks.rados.rados.0.trial082.stdout:2168: finishing rollback tid 0 to trial08226312-5 2026-02-12T17:37:49.066 INFO:tasks.rados.rados.0.trial082.stdout:2168: finishing rollback tid 1 to trial08226312-5 2026-02-12T17:37:49.067 INFO:tasks.rados.rados.0.trial082.stdout:2168: finishing rollback tid 2 to trial08226312-5 2026-02-12T17:37:49.067 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 926 (ObjNum 681 snap 207 seq_num 681) dirty exists 2026-02-12T17:37:49.067 INFO:tasks.rados.rados.0.trial082.stdout:2170: finishing copy_from racing read to trial08226312-19 2026-02-12T17:37:49.067 INFO:tasks.rados.rados.0.trial082.stdout:2169: finishing copy_from racing read to trial08226312-23 2026-02-12T17:37:49.067 INFO:tasks.rados.rados.0.trial082.stdout:2169: finishing copy_from to trial08226312-23 2026-02-12T17:37:49.067 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 1501 (ObjNum 732 snap 217 seq_num 732) dirty exists 2026-02-12T17:37:49.067 INFO:tasks.rados.rados.0.trial082.stdout:2170: finishing copy_from to trial08226312-19 2026-02-12T17:37:49.067 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 716 (ObjNum 723 snap 213 seq_num 723) dirty exists 2026-02-12T17:37:50.067 INFO:tasks.rados.rados.0.trial082.stdout:2168: done (3 left) 2026-02-12T17:37:50.068 INFO:tasks.rados.rados.0.trial082.stdout:2169: done (2 left) 2026-02-12T17:37:50.068 INFO:tasks.rados.rados.0.trial082.stdout:2170: done (1 left) 2026-02-12T17:37:50.068 INFO:tasks.rados.rados.0.trial082.stdout:2172: done (0 left) 2026-02-12T17:37:50.068 INFO:tasks.rados.rados.0.trial082.stdout:2173: read oid 46 snap -1 2026-02-12T17:37:50.068 INFO:tasks.rados.rados.0.trial082.stdout:2173: expect (ObjNum 728 snap 214 seq_num 728) 2026-02-12T17:37:50.068 INFO:tasks.rados.rados.0.trial082.stdout:2174: copy_from oid 36 from oid 40 current snap is 229 2026-02-12T17:37:50.068 INFO:tasks.rados.rados.0.trial082.stdout:2175: snap_create 2026-02-12T17:37:50.073 INFO:tasks.rados.rados.0.trial082.stdout:2173: expect (ObjNum 728 snap 214 seq_num 728) 2026-02-12T17:37:50.143 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1553468 2026-02-12T17:37:50.157 INFO:tasks.rados.rados.0.trial082.stdout:2174: finishing copy_from racing read to trial08226312-36 2026-02-12T17:37:50.157 INFO:tasks.rados.rados.0.trial082.stdout:2174: finishing copy_from to trial08226312-36 2026-02-12T17:37:50.157 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 1303 (ObjNum 750 snap 227 seq_num 750) dirty exists 2026-02-12T17:37:51.070 INFO:tasks.rados.rados.0.trial082.stdout:2173: done (2 left) 2026-02-12T17:37:51.070 INFO:tasks.rados.rados.0.trial082.stdout:2174: done (1 left) 2026-02-12T17:37:51.070 INFO:tasks.rados.rados.0.trial082.stdout:2175: done (0 left) 2026-02-12T17:37:51.070 INFO:tasks.rados.rados.0.trial082.stdout:2176: read oid 33 snap -1 2026-02-12T17:37:51.070 INFO:tasks.rados.rados.0.trial082.stdout:2176: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:51.070 INFO:tasks.rados.rados.0.trial082.stdout:2177: read oid 28 snap 217 2026-02-12T17:37:51.070 INFO:tasks.rados.rados.0.trial082.stdout:2177: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:51.071 INFO:tasks.rados.rados.0.trial082.stdout:2178: read oid 48 snap 229 2026-02-12T17:37:51.071 INFO:tasks.rados.rados.0.trial082.stdout:2178: expect (ObjNum 717 snap 213 seq_num 717) 2026-02-12T17:37:51.071 INFO:tasks.rados.rados.0.trial082.stdout:2179: copy_from oid 6 from oid 17 current snap is 230 2026-02-12T17:37:51.071 INFO:tasks.rados.rados.0.trial082.stdout:2180: read oid 39 snap -1 2026-02-12T17:37:51.071 INFO:tasks.rados.rados.0.trial082.stdout:2180: expect (ObjNum 740 snap 225 seq_num 740) 2026-02-12T17:37:51.071 INFO:tasks.rados.rados.0.trial082.stdout:2181: write (excl) oid 10 current snap is 230 2026-02-12T17:37:51.071 INFO:tasks.rados.rados.0.trial082.stdout:2181: seq_num 751 ranges {622057=714593,1913624=708433} 2026-02-12T17:37:51.074 INFO:tasks.rados.rados.0.trial082.stdout:2181: writing trial08226312-10 from 622057 to 1336650 tid 1 2026-02-12T17:37:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2181: writing trial08226312-10 from 1913624 to 2622057 tid 2 2026-02-12T17:37:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2182: read oid 9 snap -1 2026-02-12T17:37:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2182: expect (ObjNum 706 snap 212 seq_num 706) 2026-02-12T17:37:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2183: write (excl) oid 30 current snap is 230 2026-02-12T17:37:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2183: seq_num 752 ranges {638864=789842,1972106=456248} 2026-02-12T17:37:51.087 INFO:tasks.rados.rados.0.trial082.stdout:2183: writing trial08226312-30 from 638864 to 1428706 tid 1 2026-02-12T17:37:51.092 INFO:tasks.rados.rados.0.trial082.stdout:2183: writing trial08226312-30 from 1972106 to 2428354 tid 2 2026-02-12T17:37:51.093 INFO:tasks.rados.rados.0.trial082.stdout:2184: rollback oid 15 current snap is 230 2026-02-12T17:37:51.093 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 15 to 226 2026-02-12T17:37:51.093 INFO:tasks.rados.rados.0.trial082.stdout:2176: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:51.144 INFO:tasks.rados.rados.0.trial082.stdout:2180: expect (ObjNum 740 snap 225 seq_num 740) 2026-02-12T17:37:51.192 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:51.215 INFO:tasks.rados.rados.0.trial082.stdout:2178: expect (ObjNum 717 snap 213 seq_num 717) 2026-02-12T17:37:51.277 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1607647 2026-02-12T17:37:51.279 INFO:tasks.rados.rados.0.trial082.stdout:2177: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:51.279 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:51.335 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1732621 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:2181: finishing write tid 1 to trial08226312-10 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:2179: finishing copy_from racing read to trial08226312-6 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:2179: finishing copy_from to trial08226312-6 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 1569 (ObjNum 725 snap 214 seq_num 725) dirty exists 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:2176: done (8 left) 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:2177: done (7 left) 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:2178: done (6 left) 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:2179: done (5 left) 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:2180: done (4 left) 2026-02-12T17:37:51.348 INFO:tasks.rados.rados.0.trial082.stdout:2185: snap_remove snap 224 2026-02-12T17:37:52.073 INFO:tasks.rados.rados.0.trial082.stdout:2185: done (4 left) 2026-02-12T17:37:52.073 INFO:tasks.rados.rados.0.trial082.stdout:2186: write (excl) oid 33 current snap is 230 2026-02-12T17:37:52.073 INFO:tasks.rados.rados.0.trial082.stdout:2186: seq_num 753 ranges {655671=581444,2030588=625083} 2026-02-12T17:37:52.078 INFO:tasks.rados.rados.0.trial082.stdout:2186: writing trial08226312-33 from 655671 to 1237115 tid 1 2026-02-12T17:37:52.084 INFO:tasks.rados.rados.0.trial082.stdout:2186: writing trial08226312-33 from 2030588 to 2655671 tid 2 2026-02-12T17:37:52.085 INFO:tasks.rados.rados.0.trial082.stdout:2187: snap_create 2026-02-12T17:37:52.085 INFO:tasks.rados.rados.0.trial082.stdout:2182: expect (ObjNum 706 snap 212 seq_num 706) 2026-02-12T17:37:52.088 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1052630 2026-02-12T17:37:52.177 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3061291 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2181: finishing write tid 2 to trial08226312-10 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2181: finishing write tid 3 to trial08226312-10 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2181: finishing write tid 4 to trial08226312-10 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2181: oid 10 updating version 0 to 1509 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2181: oid 10 updating version 1509 to 1510 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2181: oid 10 version 1510 is already newer than 1508 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1510 (ObjNum 751 snap 230 seq_num 751) dirty exists 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2181: left oid 10 (ObjNum 751 snap 230 seq_num 751) 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2183: finishing write tid 1 to trial08226312-30 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2183: finishing write tid 2 to trial08226312-30 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2183: finishing write tid 3 to trial08226312-30 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2183: finishing write tid 4 to trial08226312-30 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2183: oid 30 updating version 0 to 1513 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2183: oid 30 version 1513 is already newer than 1511 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2183: oid 30 version 1513 is already newer than 1512 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1513 (ObjNum 752 snap 230 seq_num 752) dirty exists 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2183: left oid 30 (ObjNum 752 snap 230 seq_num 752) 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2184: finishing rollback tid 0 to trial08226312-15 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2184: finishing rollback tid 1 to trial08226312-15 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2184: finishing rollback tid 2 to trial08226312-15 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 929 (ObjNum 710 snap 213 seq_num 710) dirty exists 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2186: finishing write tid 1 to trial08226312-33 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2186: finishing write tid 2 to trial08226312-33 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2186: finishing write tid 3 to trial08226312-33 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2186: finishing write tid 4 to trial08226312-33 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2186: oid 33 updating version 0 to 1119 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2186: oid 33 version 1119 is already newer than 1118 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2186: oid 33 version 1119 is already newer than 1117 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1119 (ObjNum 753 snap 230 seq_num 753) dirty exists 2026-02-12T17:37:52.191 INFO:tasks.rados.rados.0.trial082.stdout:2186: left oid 33 (ObjNum 753 snap 230 seq_num 753) 2026-02-12T17:37:53.067 INFO:tasks.rados.rados.0.trial082.stdout:2181: done (5 left) 2026-02-12T17:37:53.067 INFO:tasks.rados.rados.0.trial082.stdout:2182: done (4 left) 2026-02-12T17:37:53.067 INFO:tasks.rados.rados.0.trial082.stdout:2183: done (3 left) 2026-02-12T17:37:53.068 INFO:tasks.rados.rados.0.trial082.stdout:2184: done (2 left) 2026-02-12T17:37:53.068 INFO:tasks.rados.rados.0.trial082.stdout:2186: done (1 left) 2026-02-12T17:37:53.068 INFO:tasks.rados.rados.0.trial082.stdout:2187: done (0 left) 2026-02-12T17:37:53.068 INFO:tasks.rados.rados.0.trial082.stdout:2188: rollback oid 33 current snap is 231 2026-02-12T17:37:53.068 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 216 2026-02-12T17:37:53.068 INFO:tasks.rados.rados.0.trial082.stdout:2189: delete oid 30 current snap is 231 2026-02-12T17:37:53.071 INFO:tasks.rados.rados.0.trial082.stdout:2189: done (1 left) 2026-02-12T17:37:53.071 INFO:tasks.rados.rados.0.trial082.stdout:2190: snap_remove snap 217 2026-02-12T17:37:53.461 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-12T17:37:53.461 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-12T17:37:53.461 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T17:37:53.462 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T17:37:53.475 INFO:tasks.ceph.mon.a:Started 2026-02-12T17:37:53.476 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:37:53.476 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient: get_monmap_and_config 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient: build_initial_monmap 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient: monmap: 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:53.544087+0000 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:53.544087+0000 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:53.540 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 1 Processor -- start 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 1 -- start start 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient: init 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient(hunting): picked mon.noname-b con 0x7f620808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient(hunting): picked mon.noname-c con 0x7f620808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient(hunting): picked mon.noname-a con 0x7f620808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620808d600 con 0x7f620808cb30 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620808b1f0 con 0x7f620808c730 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620808d1f0 con 0x7f620808ae20 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.543+0000 7f620d5d4640 10 monclient(hunting): authenticate will time out at 1153.362968s 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.544+0000 7f62077fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f620808cb30 0x7f62081a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46404/0 (socket says 10.20.193.57:46404) 2026-02-12T17:37:53.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.544+0000 7f62077fe640 1 -- 10.20.193.57:0/992908791 learned_addr learned my addr 10.20.193.57:0/992908791 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f62077fe640 1 -- 10.20.193.57:0/992908791 >> v1:10.20.193.57:6789/0 conn(0x7f620808cb30 legacy=0x7f62081a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6206ffd640 1 -- 10.20.193.57:0/992908791 >> v1:10.20.193.57:6790/0 conn(0x7f620808ae20 legacy=0x7f620808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 -- 10.20.193.57:0/992908791 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744402686 0 0) 0x7f620808d1f0 con 0x7f620808ae20 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient(hunting): my global_id is 64187 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 -- 10.20.193.57:0/992908791 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f40035e0 con 0x7f620808ae20 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 -- 10.20.193.57:0/992908791 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3170399779 0 0) 0x7f61f40035e0 con 0x7f620808ae20 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 -- 10.20.193.57:0/992908791 >> v1:10.20.193.82:6789/0 conn(0x7f620808c730 legacy=0x7f6208181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:37:53.543 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 -- 10.20.193.57:0/992908791 >> v1:10.20.193.57:6789/0 conn(0x7f620808cb30 legacy=0x7f62081a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 monclient: found mon.noname-b 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 -- 10.20.193.57:0/992908791 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6208057320 con 0x7f620808ae20 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: _finish_auth 0 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 -- 10.20.193.57:0/992908791 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f61fc003110 con 0x7f620808ae20 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: dump: 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 5 monclient: authenticate success, global_id 64187 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 -- 10.20.193.57:0/992908791 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61fc0033a0 con 0x7f620808ae20 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 1 -- 10.20.193.57:0/992908791 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f61fc003880 con 0x7f620808ae20 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:53.544 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f6205ffb640 10 monclient: dump: 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 4 set_mon_vals no callback set 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 10 monclient: shutdown 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 1 -- 10.20.193.57:0/992908791 >> v1:10.20.193.57:6790/0 conn(0x7f620808ae20 legacy=0x7f620808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 1 -- 10.20.193.57:0/992908791 shutdown_connections 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 1 -- 10.20.193.57:0/992908791 >> 10.20.193.57:0/992908791 conn(0x7f6208091620 msgr2=0x7f6208091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 1 -- 10.20.193.57:0/992908791 shutdown_connections 2026-02-12T17:37:53.545 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.546+0000 7f620d5d4640 1 -- 10.20.193.57:0/992908791 wait complete. 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient: build_initial_monmap 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient: monmap: 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 1 Processor -- start 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 1 -- start start 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient: init 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient(hunting): picked mon.noname-a con 0x7f620808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient(hunting): picked mon.noname-c con 0x7f620808c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient(hunting): picked mon.noname-b con 0x7f620808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620808d9c0 con 0x7f620808ae20 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6208088810 con 0x7f620808cb30 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62080832a0 con 0x7f620808c730 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.547+0000 7f620d5d4640 10 monclient(hunting): authenticate will time out at 1153.366995s 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.548+0000 7f6206ffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f620808ae20 0x7f6208152f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46406/0 (socket says 10.20.193.57:46406) 2026-02-12T17:37:53.546 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.548+0000 7f6206ffd640 1 -- 10.20.193.57:0/1384265075 learned_addr learned my addr 10.20.193.57:0/1384265075 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:53.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f6206ffd640 1 -- 10.20.193.57:0/1384265075 >> v1:10.20.193.57:6789/0 conn(0x7f620808ae20 legacy=0x7f6208152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:53.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f62067fc640 1 -- 10.20.193.57:0/1384265075 >> v1:10.20.193.57:6790/0 conn(0x7f620808c730 legacy=0x7f6208194260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:53.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860501002 0 0) 0x7f62080832a0 con 0x7f620808c730 2026-02-12T17:37:53.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient(hunting): _negotiate 2026-02-12T17:37:53.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:53.547 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient(hunting): my global_id is 64190 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61d40035e0 con 0x7f620808c730 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4185297246 0 0) 0x7f61d40035e0 con 0x7f620808c730 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62080832a0 con 0x7f620808c730 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f61f0005450 con 0x7f620808c730 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient(hunting): dump: 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1589554211 0 0) 0x7f62080832a0 con 0x7f620808c730 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 >> v1:10.20.193.82:6789/0 conn(0x7f620808cb30 legacy=0x7f6208195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 >> v1:10.20.193.57:6789/0 conn(0x7f620808ae20 legacy=0x7f6208152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient: _finish_hunting 0 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 monclient: found mon.c 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6208084d60 con 0x7f620808c730 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient: _finish_auth 0 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient: _check_auth_tickets 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f620d5d4640 5 monclient: authenticate success, global_id 64190 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f620d5d4640 10 monclient: _renew_subs 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f620d5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6208083e00 con 0x7f620808c730 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f620d5d4640 10 monclient: _renew_subs 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f620d5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6208086180 con 0x7f620808c730 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61f0005b50 con 0x7f620808c730 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:53.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f61f0005720 con 0x7f620808c730 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f62057fa640 4 set_mon_vals no callback set 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.550+0000 7f61e77fe640 10 monclient: dump: 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.551+0000 7f620d5d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.551+0000 7f620d5d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.551+0000 7f620d5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.551+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6208084fa0 con 0x7f620808c730 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.551+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f61f0004160 con 0x7f620808c730 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.551+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(480..480 src has 202..480) ==== 3943+0+0 (unknown 3567216229 0 0) 0x7f61f004ec10 con 0x7f620808c730 2026-02-12T17:37:53.549 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.551+0000 7f6206ffd640 10 monclient: get_auth_request con 0x7f61d403f6d0 auth_method 0 2026-02-12T17:37:53.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.553+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f61f00172c0 con 0x7f620808c730 2026-02-12T17:37:53.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.553+0000 7f61e77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:53.550 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.553+0000 7f61e77fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:53.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.699+0000 7f620d5d4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:37:53.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.699+0000 7f620d5d4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:37:53.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.699+0000 7f620d5d4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:53.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.699+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6208055340 con 0x7f620808c730 2026-02-12T17:37:53.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.699+0000 7f61e77fe640 1 -- 10.20.193.57:0/1384265075 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1596 (unknown 254746657 0 1162162075) 0x7f61f0016a70 con 0x7f620808c730 2026-02-12T17:37:53.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.699+0000 7f61e77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:37:53.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.699+0000 7f61e77fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:53.698 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":38,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":90,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:37:53.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.700+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 >> v1:10.20.193.82:6800/2441377515 conn(0x7f61d403f6d0 legacy=0x7f61d405fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:53.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.700+0000 7f620d5d4640 10 monclient: shutdown 2026-02-12T17:37:53.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.700+0000 7f620d5d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:53.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.700+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 >> v1:10.20.193.57:6790/0 conn(0x7f620808c730 legacy=0x7f6208194260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:53.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.701+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 shutdown_connections 2026-02-12T17:37:53.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.701+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 >> 10.20.193.57:0/1384265075 conn(0x7f6208091620 msgr2=0x7f62080597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:53.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.701+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 shutdown_connections 2026-02-12T17:37:53.700 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:53.701+0000 7f620d5d4640 1 -- 10.20.193.57:0/1384265075 wait complete. 2026-02-12T17:37:54.072 INFO:tasks.rados.rados.0.trial082.stdout:2190: done (1 left) 2026-02-12T17:37:54.072 INFO:tasks.rados.rados.0.trial082.stdout:2191: copy_from oid 47 from oid 6 current snap is 231 2026-02-12T17:37:54.072 INFO:tasks.rados.rados.0.trial082.stdout:2188: finishing rollback tid 0 to trial08226312-33 2026-02-12T17:37:54.072 INFO:tasks.rados.rados.0.trial082.stdout:2188: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:37:54.072 INFO:tasks.rados.rados.0.trial082.stdout:2188: finishing rollback tid 2 to trial08226312-33 2026-02-12T17:37:54.072 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1122 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2188: done (1 left) 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2192: copy_from oid 41 from oid 33 current snap is 231 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2193: read oid 13 snap 227 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2193: expect (ObjNum 679 snap 207 seq_num 679) 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2194: read oid 2 snap -1 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2194: expect (ObjNum 726 snap 214 seq_num 726) 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2195: rollback oid 15 current snap is 231 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 15 to 230 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2196: read oid 4 snap -1 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2196: expect (ObjNum 746 snap 227 seq_num 746) 2026-02-12T17:37:54.073 INFO:tasks.rados.rados.0.trial082.stdout:2197: write oid 45 current snap is 231 2026-02-12T17:37:54.074 INFO:tasks.rados.rados.0.trial082.stdout:2197: seq_num 755 ranges {689285=731942,2147552=541733} 2026-02-12T17:37:54.076 INFO:tasks.rados.rados.0.trial082.stdout:2197: writing trial08226312-45 from 689285 to 1421227 tid 1 2026-02-12T17:37:54.082 INFO:tasks.rados.rados.0.trial082.stdout:2197: writing trial08226312-45 from 2147552 to 2689285 tid 2 2026-02-12T17:37:54.082 INFO:tasks.rados.rados.0.trial082.stdout:2198: delete oid 24 current snap is 231 2026-02-12T17:37:54.082 INFO:tasks.rados.rados.0.trial082.stdout:2194: expect (ObjNum 726 snap 214 seq_num 726) 2026-02-12T17:37:54.083 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:54.101 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1320781 2026-02-12T17:37:54.109 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 310724 2026-02-12T17:37:54.123 INFO:tasks.rados.rados.0.trial082.stdout:2195: finishing rollback tid 0 to trial08226312-15 2026-02-12T17:37:54.123 INFO:tasks.rados.rados.0.trial082.stdout:2195: finishing rollback tid 1 to trial08226312-15 2026-02-12T17:37:54.123 INFO:tasks.rados.rados.0.trial082.stdout:2195: finishing rollback tid 2 to trial08226312-15 2026-02-12T17:37:54.124 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 932 (ObjNum 710 snap 213 seq_num 710) dirty exists 2026-02-12T17:37:54.124 INFO:tasks.rados.rados.0.trial082.stdout:2193: expect (ObjNum 679 snap 207 seq_num 679) 2026-02-12T17:37:54.126 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 796505 2026-02-12T17:37:54.195 INFO:tasks.rados.rados.0.trial082.stdout:2196: expect (ObjNum 746 snap 227 seq_num 746) 2026-02-12T17:37:54.196 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1353059 2026-02-12T17:37:54.208 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:54.243 INFO:tasks.rados.rados.0.trial082.stdout:2192: finishing copy_from racing read to trial08226312-41 2026-02-12T17:37:54.243 INFO:tasks.rados.rados.0.trial082.stdout:2192: finishing copy_from to trial08226312-41 2026-02-12T17:37:54.243 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1122 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2191: finishing copy_from racing read to trial08226312-47 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2191: finishing copy_from to trial08226312-47 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1569 (ObjNum 725 snap 214 seq_num 725) dirty exists 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2197: finishing write tid 1 to trial08226312-45 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2197: finishing write tid 2 to trial08226312-45 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2197: finishing write tid 3 to trial08226312-45 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2197: finishing write tid 4 to trial08226312-45 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2197: oid 45 updating version 0 to 1513 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2197: oid 45 version 1513 is already newer than 1512 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2197: oid 45 version 1513 is already newer than 1511 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1513 (ObjNum 755 snap 231 seq_num 755) dirty exists 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2197: left oid 45 (ObjNum 755 snap 231 seq_num 755) 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2191: done (7 left) 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2192: done (6 left) 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2193: done (5 left) 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2194: done (4 left) 2026-02-12T17:37:54.244 INFO:tasks.rados.rados.0.trial082.stdout:2195: done (3 left) 2026-02-12T17:37:54.245 INFO:tasks.rados.rados.0.trial082.stdout:2196: done (2 left) 2026-02-12T17:37:54.245 INFO:tasks.rados.rados.0.trial082.stdout:2197: done (1 left) 2026-02-12T17:37:54.245 INFO:tasks.rados.rados.0.trial082.stdout:2198: done (0 left) 2026-02-12T17:37:54.245 INFO:tasks.rados.rados.0.trial082.stdout:2199: write (excl) oid 48 current snap is 231 2026-02-12T17:37:54.245 INFO:tasks.rados.rados.0.trial082.stdout:2199: seq_num 757 ranges {722899=482440,1748163=723597} 2026-02-12T17:37:54.248 INFO:tasks.rados.rados.0.trial082.stdout:2199: writing trial08226312-48 from 722899 to 1205339 tid 1 2026-02-12T17:37:54.253 INFO:tasks.rados.rados.0.trial082.stdout:2199: writing trial08226312-48 from 1748163 to 2471760 tid 2 2026-02-12T17:37:54.253 INFO:tasks.rados.rados.0.trial082.stdout:2200: copy_from oid 47 from oid 18 current snap is 231 2026-02-12T17:37:54.253 INFO:tasks.rados.rados.0.trial082.stdout:2199: finishing write tid 1 to trial08226312-48 2026-02-12T17:37:54.253 INFO:tasks.rados.rados.0.trial082.stdout:2201: write oid 17 current snap is 231 2026-02-12T17:37:54.253 INFO:tasks.rados.rados.0.trial082.stdout:2201: seq_num 758 ranges {739706=557689,1806645=467255} 2026-02-12T17:37:54.257 INFO:tasks.rados.rados.0.trial082.stdout:2201: writing trial08226312-17 from 739706 to 1297395 tid 1 2026-02-12T17:37:54.261 INFO:tasks.rados.rados.0.trial082.stdout:2201: writing trial08226312-17 from 1806645 to 2273900 tid 2 2026-02-12T17:37:54.261 INFO:tasks.rados.rados.0.trial082.stdout:2202: write (excl) oid 11 current snap is 231 2026-02-12T17:37:54.261 INFO:tasks.rados.rados.0.trial082.stdout:2202: seq_num 759 ranges {756513=632938,1865127=727266} 2026-02-12T17:37:54.266 INFO:tasks.rados.rados.0.trial082.stdout:2202: writing trial08226312-11 from 756513 to 1389451 tid 1 2026-02-12T17:37:54.271 INFO:tasks.rados.rados.0.trial082.stdout:2202: writing trial08226312-11 from 1865127 to 2592393 tid 2 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2203: delete oid 13 current snap is 231 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2199: finishing write tid 2 to trial08226312-48 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2199: finishing write tid 3 to trial08226312-48 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2199: finishing write tid 4 to trial08226312-48 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2199: oid 48 updating version 0 to 826 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2199: oid 48 updating version 826 to 827 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2199: oid 48 version 827 is already newer than 825 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 827 (ObjNum 757 snap 231 seq_num 757) dirty exists 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2199: left oid 48 (ObjNum 757 snap 231 seq_num 757) 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2200: finishing copy_from to trial08226312-47 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2200: got expected ENOENT (src dne) 2026-02-12T17:37:54.272 INFO:tasks.rados.rados.0.trial082.stdout:2200: finishing copy_from racing read to trial08226312-47 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:2201: finishing write tid 1 to trial08226312-17 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:2201: finishing write tid 2 to trial08226312-17 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:2201: finishing write tid 3 to trial08226312-17 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:2201: finishing write tid 4 to trial08226312-17 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:2201: oid 17 updating version 0 to 1624 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:2201: oid 17 updating version 1624 to 1625 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:2201: oid 17 version 1625 is already newer than 1623 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 1625 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:2201: left oid 17 (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:37:54.273 INFO:tasks.rados.rados.0.trial082.stdout:2202: finishing write tid 1 to trial08226312-11 2026-02-12T17:37:54.274 INFO:tasks.rados.rados.0.trial082.stdout:2199: done (4 left) 2026-02-12T17:37:54.274 INFO:tasks.rados.rados.0.trial082.stdout:2200: done (3 left) 2026-02-12T17:37:54.274 INFO:tasks.rados.rados.0.trial082.stdout:2201: done (2 left) 2026-02-12T17:37:54.274 INFO:tasks.rados.rados.0.trial082.stdout:2203: done (1 left) 2026-02-12T17:37:54.274 INFO:tasks.rados.rados.0.trial082.stdout:2204: write (excl) oid 46 current snap is 231 2026-02-12T17:37:54.275 INFO:tasks.rados.rados.0.trial082.stdout:2204: seq_num 761 ranges {790127=499789,1698444=730935} 2026-02-12T17:37:54.278 INFO:tasks.rados.rados.0.trial082.stdout:2204: writing trial08226312-46 from 790127 to 1289916 tid 1 2026-02-12T17:37:54.283 INFO:tasks.rados.rados.0.trial082.stdout:2204: writing trial08226312-46 from 1698444 to 2429379 tid 2 2026-02-12T17:37:54.283 INFO:tasks.rados.rados.0.trial082.stdout:2205: rollback oid 25 current snap is 231 2026-02-12T17:37:54.283 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 25 to 223 2026-02-12T17:37:54.283 INFO:tasks.rados.rados.0.trial082.stdout:2202: finishing write tid 2 to trial08226312-11 2026-02-12T17:37:54.283 INFO:tasks.rados.rados.0.trial082.stdout:2202: finishing write tid 3 to trial08226312-11 2026-02-12T17:37:54.283 INFO:tasks.rados.rados.0.trial082.stdout:2202: finishing write tid 4 to trial08226312-11 2026-02-12T17:37:54.283 INFO:tasks.rados.rados.0.trial082.stdout:2202: oid 11 updating version 0 to 1262 2026-02-12T17:37:54.284 INFO:tasks.rados.rados.0.trial082.stdout:2202: oid 11 version 1262 is already newer than 1261 2026-02-12T17:37:54.284 INFO:tasks.rados.rados.0.trial082.stdout:2202: oid 11 updating version 1262 to 1263 2026-02-12T17:37:54.284 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1263 (ObjNum 759 snap 231 seq_num 759) dirty exists 2026-02-12T17:37:54.284 INFO:tasks.rados.rados.0.trial082.stdout:2202: left oid 11 (ObjNum 759 snap 231 seq_num 759) 2026-02-12T17:37:54.284 INFO:tasks.rados.rados.0.trial082.stdout:2204: finishing write tid 1 to trial08226312-46 2026-02-12T17:37:54.284 INFO:tasks.rados.rados.0.trial082.stdout:2202: done (2 left) 2026-02-12T17:37:54.284 INFO:tasks.rados.rados.0.trial082.stdout:2206: write (excl) oid 26 current snap is 231 2026-02-12T17:37:54.284 INFO:tasks.rados.rados.0.trial082.stdout:2206: seq_num 762 ranges {406934=575038,1640573=474593,2642791=164143} 2026-02-12T17:37:54.286 INFO:tasks.rados.rados.0.trial082.stdout:2206: writing trial08226312-26 from 406934 to 981972 tid 1 2026-02-12T17:37:54.290 INFO:tasks.rados.rados.0.trial082.stdout:2206: writing trial08226312-26 from 1640573 to 2115166 tid 2 2026-02-12T17:37:54.293 INFO:tasks.rados.rados.0.trial082.stdout:2206: writing trial08226312-26 from 2642791 to 2806934 tid 3 2026-02-12T17:37:54.293 INFO:tasks.rados.rados.0.trial082.stdout:2207: snap_create 2026-02-12T17:37:54.293 INFO:tasks.rados.rados.0.trial082.stdout:2205: finishing rollback tid 0 to trial08226312-25 2026-02-12T17:37:54.293 INFO:tasks.rados.rados.0.trial082.stdout:2204: finishing write tid 2 to trial08226312-46 2026-02-12T17:37:54.293 INFO:tasks.rados.rados.0.trial082.stdout:2204: finishing write tid 3 to trial08226312-46 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:2205: finishing rollback tid 1 to trial08226312-25 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:2205: finishing rollback tid 2 to trial08226312-25 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 552 (ObjNum 735 snap 219 seq_num 735) dirty exists 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:2204: finishing write tid 4 to trial08226312-46 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:2204: oid 46 updating version 0 to 1265 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:2204: oid 46 updating version 1265 to 1266 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:2204: oid 46 version 1266 is already newer than 1264 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1266 (ObjNum 761 snap 231 seq_num 761) dirty exists 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:2204: left oid 46 (ObjNum 761 snap 231 seq_num 761) 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:2206: finishing write tid 1 to trial08226312-26 2026-02-12T17:37:54.294 INFO:tasks.rados.rados.0.trial082.stdout:2206: finishing write tid 2 to trial08226312-26 2026-02-12T17:37:54.295 INFO:tasks.rados.rados.0.trial082.stdout:2206: finishing write tid 3 to trial08226312-26 2026-02-12T17:37:54.295 INFO:tasks.rados.rados.0.trial082.stdout:2206: finishing write tid 4 to trial08226312-26 2026-02-12T17:37:54.295 INFO:tasks.rados.rados.0.trial082.stdout:2206: finishing write tid 5 to trial08226312-26 2026-02-12T17:37:54.295 INFO:tasks.rados.rados.0.trial082.stdout:2206: oid 26 updating version 0 to 1517 2026-02-12T17:37:54.296 INFO:tasks.rados.rados.0.trial082.stdout:2206: oid 26 version 1517 is already newer than 1515 2026-02-12T17:37:54.296 INFO:tasks.rados.rados.0.trial082.stdout:2206: oid 26 version 1517 is already newer than 1514 2026-02-12T17:37:54.296 INFO:tasks.rados.rados.0.trial082.stdout:2206: oid 26 version 1517 is already newer than 1516 2026-02-12T17:37:54.296 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1517 (ObjNum 762 snap 231 seq_num 762) dirty exists 2026-02-12T17:37:54.296 INFO:tasks.rados.rados.0.trial082.stdout:2206: left oid 26 (ObjNum 762 snap 231 seq_num 762) 2026-02-12T17:37:55.081 INFO:tasks.rados.rados.0.trial082.stdout:2204: done (3 left) 2026-02-12T17:37:55.081 INFO:tasks.rados.rados.0.trial082.stdout:2205: done (2 left) 2026-02-12T17:37:55.081 INFO:tasks.rados.rados.0.trial082.stdout:2206: done (1 left) 2026-02-12T17:37:55.081 INFO:tasks.rados.rados.0.trial082.stdout:2207: done (0 left) 2026-02-12T17:37:55.081 INFO:tasks.rados.rados.0.trial082.stdout:2208: copy_from oid 34 from oid 24 current snap is 232 2026-02-12T17:37:55.081 INFO:tasks.rados.rados.0.trial082.stdout:2209: read oid 23 snap -1 2026-02-12T17:37:55.081 INFO:tasks.rados.rados.0.trial082.stdout:2209: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:37:55.081 INFO:tasks.rados.rados.0.trial082.stdout:2210: read oid 19 snap 230 2026-02-12T17:37:55.081 INFO:tasks.rados.rados.0.trial082.stdout:2210: expect (ObjNum 723 snap 213 seq_num 723) 2026-02-12T17:37:55.082 INFO:tasks.rados.rados.0.trial082.stdout:2211: snap_create 2026-02-12T17:37:55.085 INFO:tasks.rados.rados.0.trial082.stdout:2209: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:37:55.093 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 793789 2026-02-12T17:37:55.111 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 676053 2026-02-12T17:37:55.146 INFO:tasks.rados.rados.0.trial082.stdout:2210: expect (ObjNum 723 snap 213 seq_num 723) 2026-02-12T17:37:55.148 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1593522 2026-02-12T17:37:55.156 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:55.172 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:55.188 INFO:tasks.rados.rados.0.trial082.stdout:2208: finishing copy_from to trial08226312-34 2026-02-12T17:37:55.188 INFO:tasks.rados.rados.0.trial082.stdout:2208: got expected ENOENT (src dne) 2026-02-12T17:37:55.188 INFO:tasks.rados.rados.0.trial082.stdout:2208: finishing copy_from racing read to trial08226312-34 2026-02-12T17:37:56.084 INFO:tasks.rados.rados.0.trial082.stdout:2208: done (3 left) 2026-02-12T17:37:56.084 INFO:tasks.rados.rados.0.trial082.stdout:2209: done (2 left) 2026-02-12T17:37:56.084 INFO:tasks.rados.rados.0.trial082.stdout:2210: done (1 left) 2026-02-12T17:37:56.084 INFO:tasks.rados.rados.0.trial082.stdout:2211: done (0 left) 2026-02-12T17:37:56.084 INFO:tasks.rados.rados.0.trial082.stdout:2212: read oid 9 snap -1 2026-02-12T17:37:56.085 INFO:tasks.rados.rados.0.trial082.stdout:2212: expect (ObjNum 706 snap 212 seq_num 706) 2026-02-12T17:37:56.085 INFO:tasks.rados.rados.0.trial082.stdout:2213: delete oid 34 current snap is 233 2026-02-12T17:37:56.088 INFO:tasks.rados.rados.0.trial082.stdout:2213: done (1 left) 2026-02-12T17:37:56.088 INFO:tasks.rados.rados.0.trial082.stdout:2214: copy_from oid 26 from oid 21 current snap is 233 2026-02-12T17:37:56.088 INFO:tasks.rados.rados.0.trial082.stdout:2215: delete oid 29 current snap is 233 2026-02-12T17:37:56.088 INFO:tasks.rados.rados.0.trial082.stdout:2212: expect (ObjNum 706 snap 212 seq_num 706) 2026-02-12T17:37:56.162 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:56.202 INFO:tasks.rados.rados.0.trial082.stdout:2214: finishing copy_from racing read to trial08226312-26 2026-02-12T17:37:56.202 INFO:tasks.rados.rados.0.trial082.stdout:2214: finishing copy_from to trial08226312-26 2026-02-12T17:37:56.202 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1501 (ObjNum 732 snap 217 seq_num 732) dirty exists 2026-02-12T17:37:56.202 INFO:tasks.rados.rados.0.trial082.stdout:2212: done (2 left) 2026-02-12T17:37:56.202 INFO:tasks.rados.rados.0.trial082.stdout:2214: done (1 left) 2026-02-12T17:37:56.202 INFO:tasks.rados.rados.0.trial082.stdout:2215: done (0 left) 2026-02-12T17:37:56.202 INFO:tasks.rados.rados.0.trial082.stdout:2216: delete oid 23 current snap is 233 2026-02-12T17:37:56.203 INFO:tasks.rados.rados.0.trial082.stdout:2216: done (0 left) 2026-02-12T17:37:56.203 INFO:tasks.rados.rados.0.trial082.stdout:2217: read oid 43 snap 223 2026-02-12T17:37:56.204 INFO:tasks.rados.rados.0.trial082.stdout:2217: expect (ObjNum 711 snap 213 seq_num 711) 2026-02-12T17:37:56.204 INFO:tasks.rados.rados.0.trial082.stdout:2218: copy_from oid 20 from oid 1 current snap is 233 2026-02-12T17:37:56.204 INFO:tasks.rados.rados.0.trial082.stdout:2219: write oid 4 current snap is 233 2026-02-12T17:37:56.204 INFO:tasks.rados.rados.0.trial082.stdout:2219: seq_num 766 ranges {474162=476034,1358148=481931,2352483=465303} 2026-02-12T17:37:56.207 INFO:tasks.rados.rados.0.trial082.stdout:2219: writing trial08226312-4 from 474162 to 950196 tid 1 2026-02-12T17:37:56.210 INFO:tasks.rados.rados.0.trial082.stdout:2219: writing trial08226312-4 from 1358148 to 1840079 tid 2 2026-02-12T17:37:56.214 INFO:tasks.rados.rados.0.trial082.stdout:2219: writing trial08226312-4 from 2352483 to 2817786 tid 3 2026-02-12T17:37:56.215 INFO:tasks.rados.rados.0.trial082.stdout:2220: read oid 11 snap 216 2026-02-12T17:37:56.215 INFO:tasks.rados.rados.0.trial082.stdout:2220: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:37:56.215 INFO:tasks.rados.rados.0.trial082.stdout:2221: write (excl) oid 34 current snap is 233 2026-02-12T17:37:56.215 INFO:tasks.rados.rados.0.trial082.stdout:2221: seq_num 767 ranges {490969=551283,1816630=625589} 2026-02-12T17:37:56.219 INFO:tasks.rados.rados.0.trial082.stdout:2221: writing trial08226312-34 from 490969 to 1042252 tid 1 2026-02-12T17:37:56.224 INFO:tasks.rados.rados.0.trial082.stdout:2221: writing trial08226312-34 from 1816630 to 2442219 tid 2 2026-02-12T17:37:56.225 INFO:tasks.rados.rados.0.trial082.stdout:2222: snap_remove snap 230 2026-02-12T17:37:56.707 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:37:56.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.777+0000 7f3dd5007640 10 monclient: get_monmap_and_config 2026-02-12T17:37:56.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.777+0000 7f3dd5007640 10 monclient: build_initial_monmap 2026-02-12T17:37:56.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.777+0000 7f3dd5007640 10 monclient: monmap: 2026-02-12T17:37:56.775 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:56.775 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:56.775 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:56.778681+0000 2026-02-12T17:37:56.775 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:56.778681+0000 2026-02-12T17:37:56.775 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:56.776 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:56.776 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:56.776 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:56.776 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:56.776 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 1 Processor -- start 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 1 -- start start 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 10 monclient: init 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 10 monclient(hunting): picked mon.noname-b con 0x7f3dd008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 10 monclient(hunting): picked mon.noname-a con 0x7f3dd008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 10 monclient(hunting): picked mon.noname-c con 0x7f3dd008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd008d600 con 0x7f3dd008c730 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd008b1f0 con 0x7f3dd008cb30 2026-02-12T17:37:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd008d1f0 con 0x7f3dd008ae20 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dd5007640 10 monclient(hunting): authenticate will time out at 1156.597556s 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dced76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3dd008ae20 0x7f3dd008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45568/0 (socket says 10.20.193.57:45568) 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.778+0000 7f3dced76640 1 -- 10.20.193.57:0/320297393 learned_addr learned my addr 10.20.193.57:0/320297393 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.780+0000 7f3dce575640 1 -- 10.20.193.57:0/320297393 >> v1:10.20.193.57:6789/0 conn(0x7f3dd008c730 legacy=0x7f3dd0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.780+0000 7f3dced76640 1 -- 10.20.193.57:0/320297393 >> v1:10.20.193.57:6790/0 conn(0x7f3dd008ae20 legacy=0x7f3dd008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.780+0000 7f3dcdd74640 1 -- 10.20.193.57:0/320297393 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75590138 0 0) 0x7f3dd008d1f0 con 0x7f3dd008ae20 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.780+0000 7f3dcdd74640 10 monclient(hunting): _negotiate 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.780+0000 7f3dcdd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.780+0000 7f3dcdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.780+0000 7f3dcdd74640 10 monclient(hunting): my global_id is 64193 2026-02-12T17:37:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.780+0000 7f3dcdd74640 1 -- 10.20.193.57:0/320297393 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dbc0035e0 con 0x7f3dd008ae20 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 1 -- 10.20.193.57:0/320297393 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3905479942 0 0) 0x7f3dbc0035e0 con 0x7f3dd008ae20 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 1 -- 10.20.193.57:0/320297393 >> v1:10.20.193.82:6789/0 conn(0x7f3dd008cb30 legacy=0x7f3dd01a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 1 -- 10.20.193.57:0/320297393 >> v1:10.20.193.57:6789/0 conn(0x7f3dd008c730 legacy=0x7f3dd0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: _finish_hunting 0 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 1 monclient: found mon.noname-b 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 1 -- 10.20.193.57:0/320297393 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd0057320 con 0x7f3dd008ae20 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: _finish_auth 0 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: _check_auth_tickets 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 1 -- 10.20.193.57:0/320297393 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3dc4003140 con 0x7f3dd008ae20 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: dump: 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 5 monclient: authenticate success, global_id 64193 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 1 -- 10.20.193.57:0/320297393 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3dc4003390 con 0x7f3dd008ae20 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 1 -- 10.20.193.57:0/320297393 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3dc4004b10 con 0x7f3dd008ae20 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 4 set_mon_vals no callback set 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dcdd74640 10 monclient: dump: 2026-02-12T17:37:56.785 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 10 monclient: shutdown 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 1 -- 10.20.193.57:0/320297393 >> v1:10.20.193.57:6790/0 conn(0x7f3dd008ae20 legacy=0x7f3dd008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 1 -- 10.20.193.57:0/320297393 shutdown_connections 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 1 -- 10.20.193.57:0/320297393 >> 10.20.193.57:0/320297393 conn(0x7f3dd0091620 msgr2=0x7f3dd0091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 1 -- 10.20.193.57:0/320297393 shutdown_connections 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.781+0000 7f3dd5007640 1 -- 10.20.193.57:0/320297393 wait complete. 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient: build_initial_monmap 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient: monmap: 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:56.787 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 1 Processor -- start 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 1 -- start start 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient: init 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient(hunting): picked mon.noname-b con 0x7f3dd008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient(hunting): picked mon.noname-a con 0x7f3dd008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient(hunting): picked mon.noname-c con 0x7f3dd008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd008d9c0 con 0x7f3dd008c730 2026-02-12T17:37:56.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd00832c0 con 0x7f3dd008ae20 2026-02-12T17:37:56.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dd0084cf0 con 0x7f3dd008cb30 2026-02-12T17:37:56.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:56.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dd5007640 10 monclient(hunting): authenticate will time out at 1156.601716s 2026-02-12T17:37:56.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dce575640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f3dd008c730 0x7f3dd0193fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46424/0 (socket says 10.20.193.57:46424) 2026-02-12T17:37:56.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.782+0000 7f3dce575640 1 -- 10.20.193.57:0/2635867195 learned_addr learned my addr 10.20.193.57:0/2635867195 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.784+0000 7f3dcf577640 1 -- 10.20.193.57:0/2635867195 >> v1:10.20.193.57:6790/0 conn(0x7f3dd008cb30 legacy=0x7f3dd01956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.784+0000 7f3dce575640 1 -- 10.20.193.57:0/2635867195 >> v1:10.20.193.57:6789/0 conn(0x7f3dd008c730 legacy=0x7f3dd0193fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516398938 0 0) 0x7f3dd0084cf0 con 0x7f3dd008cb30 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): my global_id is 64196 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9c0035e0 con 0x7f3dd008cb30 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221576382 0 0) 0x7f3dd008d9c0 con 0x7f3dd008c730 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): my global_id is 74097 2026-02-12T17:37:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dd0084cf0 con 0x7f3dd008c730 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dced76640 1 -- 10.20.193.57:0/2635867195 >> v1:10.20.193.82:6789/0 conn(0x7f3dd008ae20 legacy=0x7f3dd01532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3927244755 0 0) 0x7f3dd0084cf0 con 0x7f3dd008c730 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3dd008d9c0 con 0x7f3dd008c730 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dce575640 1 --1- 10.20.193.57:0/2635867195 >> v1:10.20.193.57:6789/0 conn(0x7f3dd008c730 0x7f3dd0193fa0 :-1 s=OPENED pgs=354 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f3db8003340 mon_map magic: 0 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1536593009 0 0) 0x7f3d9c0035e0 con 0x7f3dd008cb30 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3dd0084cf0 con 0x7f3dd008cb30 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3dc0005350 con 0x7f3dd008cb30 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): dump: 2026-02-12T17:37:56.795 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3db8003340 con 0x7f3dd008c730 2026-02-12T17:37:56.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient(hunting): dump: 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:56.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 668851704 0 0) 0x7f3dd0084cf0 con 0x7f3dd008cb30 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 >> v1:10.20.193.82:6789/0 conn(0x7f3dd008ae20 legacy=0x7f3dd01532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 >> v1:10.20.193.57:6789/0 conn(0x7f3dd008c730 legacy=0x7f3dd0193fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 monclient: found mon.c 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd0085020 con 0x7f3dd008cb30 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient: _finish_auth 0 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 5 monclient: authenticate success, global_id 64196 2026-02-12T17:37:56.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 10 monclient: _renew_subs 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1115532625 0 0) 0x7f3dd008d9c0 con 0x7f3dd008c730 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd0085f70 con 0x7f3dd008cb30 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 10 monclient: _renew_subs 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3dd01539d0 con 0x7f3dd008cb30 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3dc0003a30 con 0x7f3dd008cb30 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3dc00055e0 con 0x7f3dd008cb30 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:56.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 10 monclient: dump: 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:56.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dcd573640 4 set_mon_vals no callback set 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dd00854d0 con 0x7f3dd008cb30 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.785+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3dc0003d50 con 0x7f3dd008cb30 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.786+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(483..483 src has 202..483) ==== 3915+0+0 (unknown 462862596 0 0) 0x7f3dc004fad0 con 0x7f3dd008cb30 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.786+0000 7f3dced76640 10 monclient: get_auth_request con 0x7f3d9c03fad0 auth_method 0 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.788+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3dc00182b0 con 0x7f3dd008cb30 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.788+0000 7f3daf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:56.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.788+0000 7f3daf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:56.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.938+0000 7f3dd5007640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:37:56.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.938+0000 7f3dd5007640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:37:56.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.938+0000 7f3dd5007640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:56.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.938+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3dd0055340 con 0x7f3dd008cb30 2026-02-12T17:37:56.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.938+0000 7f3daf7fe640 1 -- 10.20.193.57:0/2635867195 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2088986728) 0x7f3dc0017a60 con 0x7f3dd008cb30 2026-02-12T17:37:56.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.938+0000 7f3daf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:37:56.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.938+0000 7f3daf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:56.937 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:37:56.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.939+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 >> v1:10.20.193.82:6800/2441377515 conn(0x7f3d9c03fad0 legacy=0x7f3d9c05ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:56.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.939+0000 7f3dd5007640 10 monclient: shutdown 2026-02-12T17:37:56.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.939+0000 7f3dd5007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:56.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.939+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 >> v1:10.20.193.57:6790/0 conn(0x7f3dd008cb30 legacy=0x7f3dd01956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:56.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.939+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 shutdown_connections 2026-02-12T17:37:56.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.939+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 >> 10.20.193.57:0/2635867195 conn(0x7f3dd0091620 msgr2=0x7f3dd0089310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:56.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.939+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 shutdown_connections 2026-02-12T17:37:56.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:56.939+0000 7f3dd5007640 1 -- 10.20.193.57:0/2635867195 wait complete. 2026-02-12T17:37:56.944 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:37:56.944 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:37:56.945 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:37:57.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient: get_monmap_and_config 2026-02-12T17:37:57.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient: build_initial_monmap 2026-02-12T17:37:57.011 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient: monmap: 2026-02-12T17:37:57.011 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:57.011 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:57.013862+0000 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:57.013862+0000 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 1 Processor -- start 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 1 -- start start 2026-02-12T17:37:57.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient: init 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient(hunting): picked mon.noname-a con 0x7fbb0008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient(hunting): picked mon.noname-c con 0x7fbb0008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient(hunting): picked mon.noname-b con 0x7fbb00182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0008a820 con 0x7fbb0008c250 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb00089450 con 0x7fbb0008c620 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb00089730 con 0x7fbb00182cc0 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb0670c640 10 monclient(hunting): authenticate will time out at 1156.832799s 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbafffff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbb0008c250 0x7fbb0008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46436/0 (socket says 10.20.193.57:46436) 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbb04c82640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fbb00182cc0 0x7fbb001a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45584/0 (socket says 10.20.193.57:45584) 2026-02-12T17:37:57.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.013+0000 7fbafffff640 1 -- 10.20.193.57:0/3375584015 learned_addr learned my addr 10.20.193.57:0/3375584015 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:57.021 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb04c82640 1 -- 10.20.193.57:0/3375584015 >> v1:10.20.193.57:6790/0 conn(0x7fbb00182cc0 legacy=0x7fbb001a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafffff640 1 -- 10.20.193.57:0/3375584015 >> v1:10.20.193.57:6789/0 conn(0x7fbb0008c250 legacy=0x7fbb0008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbaff7fe640 1 -- 10.20.193.57:0/3375584015 >> v1:10.20.193.82:6789/0 conn(0x7fbb0008c620 legacy=0x7fbb0008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2852044903 0 0) 0x7fbaec002c20 con 0x7fbb0008c250 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient(hunting): my global_id is 74100 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae40035e0 con 0x7fbb0008c250 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388737121 0 0) 0x7fbb00089730 con 0x7fbb00182cc0 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient(hunting): my global_id is 64199 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaec002c20 con 0x7fbb00182cc0 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4071169466 0 0) 0x7fbae40035e0 con 0x7fbb0008c250 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 >> v1:10.20.193.57:6790/0 conn(0x7fbb00182cc0 legacy=0x7fbb001a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 >> v1:10.20.193.82:6789/0 conn(0x7fbb0008c620 legacy=0x7fbb0008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: _finish_hunting 0 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 monclient: found mon.noname-a 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb00089a10 con 0x7fbb0008c250 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: _finish_auth 0 2026-02-12T17:37:57.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: _check_auth_tickets 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaec0032e0 con 0x7fbb0008c250 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: dump: 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.024 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 5 monclient: authenticate success, global_id 74100 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbaec004960 con 0x7fbb0008c250 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 1 -- 10.20.193.57:0/3375584015 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaec004cf0 con 0x7fbb0008c250 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbafeffd640 10 monclient: dump: 2026-02-12T17:37:57.025 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 4 set_mon_vals no callback set 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 10 monclient: shutdown 2026-02-12T17:37:57.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 1 -- 10.20.193.57:0/3375584015 >> v1:10.20.193.57:6789/0 conn(0x7fbb0008c250 legacy=0x7fbb0008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 1 -- 10.20.193.57:0/3375584015 shutdown_connections 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 1 -- 10.20.193.57:0/3375584015 >> 10.20.193.57:0/3375584015 conn(0x7fbb000916b0 msgr2=0x7fbb00091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 1 -- 10.20.193.57:0/3375584015 shutdown_connections 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.016+0000 7fbb0670c640 1 -- 10.20.193.57:0/3375584015 wait complete. 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient: build_initial_monmap 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient: monmap: 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:57.027 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 1 Processor -- start 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 1 -- start start 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient: init 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient(hunting): picked mon.noname-b con 0x7fbb0008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient(hunting): picked mon.noname-c con 0x7fbb0008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:57.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient(hunting): picked mon.noname-a con 0x7fbb00182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0005d9e0 con 0x7fbb00182cc0 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0013def0 con 0x7fbb0008c250 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb00138a60 con 0x7fbb0008c620 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb0670c640 10 monclient(hunting): authenticate will time out at 1156.836862s 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb04c82640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fbb00182cc0 0x7fbb00193490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46450/0 (socket says 10.20.193.57:46450) 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbb04c82640 1 -- 10.20.193.57:0/4211734315 learned_addr learned my addr 10.20.193.57:0/4211734315 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.017+0000 7fbaff7fe640 1 --1- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6790/0 conn(0x7fbb0008c620 0x7fbb00136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45600/0 (socket says 10.20.193.57:45600) 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbaff7fe640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6790/0 conn(0x7fbb0008c620 legacy=0x7fbb00136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbb04c82640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6789/0 conn(0x7fbb00182cc0 legacy=0x7fbb00193490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942849492 0 0) 0x7fbb0005d9e0 con 0x7fbb00182cc0 2026-02-12T17:37:57.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): my global_id is 74103 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad00035e0 con 0x7fbb00182cc0 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2488975307 0 0) 0x7fbb00138a60 con 0x7fbb0008c620 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): my global_id is 64202 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb0005d9e0 con 0x7fbb0008c620 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafffff640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.82:6789/0 conn(0x7fbb0008c250 legacy=0x7fbb00136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3483956129 0 0) 0x7fbad00035e0 con 0x7fbb00182cc0 2026-02-12T17:37:57.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb00138a60 con 0x7fbb00182cc0 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaf4004440 con 0x7fbb00182cc0 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): dump: 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.031 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 679940666 0 0) 0x7fbb0005d9e0 con 0x7fbb0008c620 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbad00035e0 con 0x7fbb0008c620 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaf0003340 con 0x7fbb0008c620 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): dump: 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.032 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324695705 0 0) 0x7fbb0013def0 con 0x7fbb0008c250 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient(hunting): my global_id is 4846 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb0005d9e0 con 0x7fbb0008c250 2026-02-12T17:37:57.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3605360498 0 0) 0x7fbb00138a60 con 0x7fbb00182cc0 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6790/0 conn(0x7fbb0008c620 legacy=0x7fbb00136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.82:6789/0 conn(0x7fbb0008c250 legacy=0x7fbb00136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient: _finish_hunting 0 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 monclient: found mon.a 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb00138d40 con 0x7fbb00182cc0 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient: _finish_auth 0 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient: _check_auth_tickets 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbb0670c640 5 monclient: authenticate success, global_id 74103 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbb0670c640 10 monclient: _renew_subs 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbb0670c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:57.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb00137600 con 0x7fbb00182cc0 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbb0670c640 10 monclient: _renew_subs 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbb0670c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb0013e900 con 0x7fbb00182cc0 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbaf4004620 con 0x7fbb00182cc0 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaf4005e10 con 0x7fbb00182cc0 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafcff9640 10 monclient: dump: 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.035 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.020+0000 7fbafe7fc640 4 set_mon_vals no callback set 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.021+0000 7fbb0670c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.021+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbb0005d440 con 0x7fbb0005d070 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.021+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fbaf4005fb0 con 0x7fbb00182cc0 2026-02-12T17:37:57.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.021+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(483..483 src has 202..483) ==== 3915+0+0 (unknown 462862596 0 0) 0x7fbaf404fcb0 con 0x7fbb00182cc0 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.021+0000 7fbaff7fe640 10 monclient: get_auth_request con 0x7fbad003fd10 auth_method 0 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafffff640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6789/0 conn(0x7fbb0005d070 legacy=0x7fbb000582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225262341 0 0) 0x7fbb0005d440 con 0x7fbb0005d070 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 10 monclient(hunting): my global_id is 74106 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb00138a60 con 0x7fbb0005d070 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3020898095 0 0) 0x7fbb00138a60 con 0x7fbb0005d070 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb0005d440 con 0x7fbb0005d070 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaec002f00 con 0x7fbb0005d070 2026-02-12T17:37:57.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 10 monclient: dump: 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1879852315 0 0) 0x7fbb0005d440 con 0x7fbb0005d070 2026-02-12T17:37:57.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb00090810 con 0x7fbb0005d070 2026-02-12T17:37:57.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fbaec003410 con 0x7fbb0005d070 2026-02-12T17:37:57.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:57.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:57.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6789/0 conn(0x7fbb0005d070 legacy=0x7fbb000582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.023+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6789/0 conn(0x7fbb0005d070 legacy=0x7fbb000582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:57.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.027+0000 7fbb0670c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:37:57.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.027+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbb000888a0 con 0x7fbb000589d0 2026-02-12T17:37:57.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafffff640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6789/0 conn(0x7fbb000589d0 legacy=0x7fbb00195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934570570 0 0) 0x7fbb000888a0 con 0x7fbb000589d0 2026-02-12T17:37:57.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 10 monclient(hunting): my global_id is 74109 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb0005d440 con 0x7fbb000589d0 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3227962348 0 0) 0x7fbb0005d440 con 0x7fbb000589d0 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb000888a0 con 0x7fbb000589d0 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fbaec0053c0 con 0x7fbb000589d0 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 10 monclient: dump: 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.042 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3795257316 0 0) 0x7fbb000888a0 con 0x7fbb000589d0 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbb0008f580 con 0x7fbb000589d0 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4336 (unknown 0 0 878494512) 0x7fbaec007620 con 0x7fbb000589d0 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6789/0 conn(0x7fbb000589d0 legacy=0x7fbb00195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.029+0000 7fbafcff9640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6789/0 conn(0x7fbb000589d0 legacy=0x7fbb00195bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 40, 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 3492, 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.044 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:57.045 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:57.046 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:37:57.047 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:57.048 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.049 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:37:57.050 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.051 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:37:57.052 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:37:57.053 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.054 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.054 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.054 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:37:57.054 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.82:6800/2441377515 conn(0x7fbad003fd10 legacy=0x7fbad00601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb0670c640 10 monclient: shutdown 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb0670c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 >> v1:10.20.193.57:6789/0 conn(0x7fbb00182cc0 legacy=0x7fbb00193490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb04c82640 1 -- 10.20.193.57:0/4211734315 reap_dead start 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb04c82640 1 -- 10.20.193.57:0/4211734315 reap_dead start 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 shutdown_connections 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 >> 10.20.193.57:0/4211734315 conn(0x7fbb000916b0 msgr2=0x7fbb0008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 shutdown_connections 2026-02-12T17:37:57.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.030+0000 7fbb0670c640 1 -- 10.20.193.57:0/4211734315 wait complete. 2026-02-12T17:37:57.056 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:37:57.056 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:37:57.056 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:37:57.088 INFO:tasks.rados.rados.0.trial082.stdout:2222: done (5 left) 2026-02-12T17:37:57.088 INFO:tasks.rados.rados.0.trial082.stdout:2223: read oid 5 snap -1 2026-02-12T17:37:57.088 INFO:tasks.rados.rados.0.trial082.stdout:2223: expect (ObjNum 681 snap 207 seq_num 681) 2026-02-12T17:37:57.088 INFO:tasks.rados.rados.0.trial082.stdout:2224: snap_create 2026-02-12T17:37:57.088 INFO:tasks.rados.rados.0.trial082.stdout:2217: expect (ObjNum 711 snap 213 seq_num 711) 2026-02-12T17:37:57.120 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:57.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.126+0000 7ffafff0c640 10 monclient: get_monmap_and_config 2026-02-12T17:37:57.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.126+0000 7ffafff0c640 10 monclient: build_initial_monmap 2026-02-12T17:37:57.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.126+0000 7ffafff0c640 10 monclient: monmap: 2026-02-12T17:37:57.123 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:57.123 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.124 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:57.127171+0000 2026-02-12T17:37:57.124 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:57.127171+0000 2026-02-12T17:37:57.124 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:57.124 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.124 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:57.124 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:57.124 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:57.124 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.126+0000 7ffafff0c640 1 Processor -- start 2026-02-12T17:37:57.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.126+0000 7ffafff0c640 1 -- start start 2026-02-12T17:37:57.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.126+0000 7ffafff0c640 10 monclient: init 2026-02-12T17:37:57.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:57.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:37:57.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 10 monclient(hunting): picked mon.noname-a con 0x7ffaf808c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:57.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 10 monclient(hunting): picked mon.noname-c con 0x7ffaf808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:57.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 10 monclient(hunting): picked mon.noname-b con 0x7ffaf8182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:57.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf808a820 con 0x7ffaf808c250 2026-02-12T17:37:57.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf8089450 con 0x7ffaf808c620 2026-02-12T17:37:57.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf8089730 con 0x7ffaf8182cc0 2026-02-12T17:37:57.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:57.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafff0c640 10 monclient(hunting): authenticate will time out at 1156.946097s 2026-02-12T17:37:57.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafdc81640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c250 0x7ffaf808a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46472/0 (socket says 10.20.193.57:46472) 2026-02-12T17:37:57.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafdc81640 1 -- 10.20.193.57:0/3767885159 learned_addr learned my addr 10.20.193.57:0/3767885159 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:57.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.127+0000 7ffafe482640 1 --1- 10.20.193.57:0/3767885159 >> v1:10.20.193.57:6790/0 conn(0x7ffaf8182cc0 0x7ffaf81a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45608/0 (socket says 10.20.193.57:45608) 2026-02-12T17:37:57.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafdc81640 1 -- 10.20.193.57:0/3767885159 >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c250 legacy=0x7ffaf808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafe482640 1 -- 10.20.193.57:0/3767885159 >> v1:10.20.193.57:6790/0 conn(0x7ffaf8182cc0 legacy=0x7ffaf81a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafd480640 1 -- 10.20.193.57:0/3767885159 >> v1:10.20.193.82:6789/0 conn(0x7ffaf808c620 legacy=0x7ffaf808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001345562 0 0) 0x7ffae8002c20 con 0x7ffaf808c250 2026-02-12T17:37:57.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.135 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient(hunting): my global_id is 74112 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffae00035e0 con 0x7ffaf808c250 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572362814 0 0) 0x7ffaf8089730 con 0x7ffaf8182cc0 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient(hunting): my global_id is 64205 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffae8002c20 con 0x7ffaf8182cc0 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 344712877 0 0) 0x7ffae00035e0 con 0x7ffaf808c250 2026-02-12T17:37:57.136 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 >> v1:10.20.193.57:6790/0 conn(0x7ffaf8182cc0 legacy=0x7ffaf81a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 >> v1:10.20.193.82:6789/0 conn(0x7ffaf808c620 legacy=0x7ffaf808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: _finish_hunting 0 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 monclient: found mon.noname-a 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf8089a10 con 0x7ffaf808c250 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: _finish_auth 0 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: _check_auth_tickets 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafff0c640 5 monclient: authenticate success, global_id 74112 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffae80032e0 con 0x7ffaf808c250 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafff0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:57.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: dump: 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.138 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafff0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffae8003520 con 0x7ffaf808c250 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 1 -- 10.20.193.57:0/3767885159 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffae8004b40 con 0x7ffaf808c250 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafcc7f640 10 monclient: dump: 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.139 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafff0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.129+0000 7ffafff0c640 4 set_mon_vals no callback set 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient: shutdown 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 -- 10.20.193.57:0/3767885159 >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c250 legacy=0x7ffaf808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 -- 10.20.193.57:0/3767885159 shutdown_connections 2026-02-12T17:37:57.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 -- 10.20.193.57:0/3767885159 >> 10.20.193.57:0/3767885159 conn(0x7ffaf80916b0 msgr2=0x7ffaf8091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 -- 10.20.193.57:0/3767885159 shutdown_connections 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 -- 10.20.193.57:0/3767885159 wait complete. 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient: build_initial_monmap 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient: monmap: 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:57.141 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 Processor -- start 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 -- start start 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient: init 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient(hunting): picked mon.noname-c con 0x7ffaf808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient(hunting): picked mon.noname-a con 0x7ffaf808c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient(hunting): picked mon.noname-b con 0x7ffaf8182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf813bac0 con 0x7ffaf808c620 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf80888a0 con 0x7ffaf8182cc0 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf813a0f0 con 0x7ffaf808c250 2026-02-12T17:37:57.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.130+0000 7ffafff0c640 10 monclient(hunting): authenticate will time out at 1156.949975s 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.131+0000 7ffafd480640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c620 0x7ffaf81383b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46480/0 (socket says 10.20.193.57:46480) 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.131+0000 7ffafd480640 1 -- 10.20.193.57:0/2632813165 learned_addr learned my addr 10.20.193.57:0/2632813165 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafdc81640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6790/0 conn(0x7ffaf808c250 legacy=0x7ffaf8137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafd480640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c620 legacy=0x7ffaf81383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafd480640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c620 legacy=0x7ffaf81383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafd480640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c620 legacy=0x7ffaf81383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafd480640 1 --1- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c620 0x7ffaf81383b0 :-1 s=OPENED pgs=361 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378304023 0 0) 0x7ffaf813a0f0 con 0x7ffaf808c250 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafd480640 1 --1- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c620 0x7ffaf81383b0 :-1 s=OPENED pgs=361 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): my global_id is 64208 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffac80035e0 con 0x7ffaf808c250 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.57:6789/0 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafe482640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.82:6789/0 conn(0x7ffaf8182cc0 legacy=0x7ffaf81952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980806412 0 0) 0x7ffaf80888a0 con 0x7ffaf8182cc0 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): my global_id is 4852 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaf813a0f0 con 0x7ffaf8182cc0 2026-02-12T17:37:57.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3471004056 0 0) 0x7ffac80035e0 con 0x7ffaf808c250 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffaf80888a0 con 0x7ffaf808c250 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffae80031f0 con 0x7ffaf808c250 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): dump: 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.145 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3896765896 0 0) 0x7ffaf80888a0 con 0x7ffaf808c250 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.82:6789/0 conn(0x7ffaf8182cc0 legacy=0x7ffaf81952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6789/0 conn(0x7ffaf808c620 legacy=0x7ffaf81383b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient: _finish_hunting 0 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 monclient: found mon.c 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf813b500 con 0x7ffaf808c250 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient: _finish_auth 0 2026-02-12T17:37:57.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient: _check_auth_tickets 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafff0c640 5 monclient: authenticate success, global_id 64208 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafff0c640 10 monclient: _renew_subs 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafff0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf8138ac0 con 0x7ffaf808c250 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafff0c640 10 monclient: _renew_subs 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafff0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ffaf813eab0 con 0x7ffaf808c250 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffae8004f90 con 0x7ffaf808c250 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffae8002ee0 con 0x7ffaf808c250 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae7fff640 4 set_mon_vals no callback set 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.133+0000 7ffae67fc640 10 monclient: dump: 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.148 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.134+0000 7ffafff0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.134+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffaf818eec0 con 0x7ffaf818eaf0 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.134+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ffae8011e40 con 0x7ffaf808c250 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.134+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(484..484 src has 202..484) ==== 3959+0+0 (unknown 1663615957 0 0) 0x7ffae804ecc0 con 0x7ffaf808c250 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.134+0000 7ffafe482640 10 monclient: get_auth_request con 0x7ffac803f710 auth_method 0 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffafd480640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6790/0 conn(0x7ffaf818eaf0 legacy=0x7ffaf805b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639280186 0 0) 0x7ffaf818eec0 con 0x7ffaf818eaf0 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 10 monclient(hunting): my global_id is 64211 2026-02-12T17:37:57.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaf80888a0 con 0x7ffaf818eaf0 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3651506408 0 0) 0x7ffaf80888a0 con 0x7ffaf818eaf0 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffaf818eec0 con 0x7ffaf818eaf0 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffaec003330 con 0x7ffaf818eaf0 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 10 monclient: dump: 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.150 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.151 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.151 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3237109016 0 0) 0x7ffaf818eec0 con 0x7ffaf818eaf0 2026-02-12T17:37:57.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.136+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffaf8090810 con 0x7ffaf818eaf0 2026-02-12T17:37:57.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.137+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ffaec005880 con 0x7ffaf818eaf0 2026-02-12T17:37:57.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.137+0000 7ffae67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:57.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.137+0000 7ffae67fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:57.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.137+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6790/0 conn(0x7ffaf818eaf0 legacy=0x7ffaf805b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.137+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6790/0 conn(0x7ffaf818eaf0 legacy=0x7ffaf805b7c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:57.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.140+0000 7ffafff0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:37:57.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.140+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffaf808a820 con 0x7ffaf805bed0 2026-02-12T17:37:57.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffafd480640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6790/0 conn(0x7ffaf805bed0 legacy=0x7ffaf8197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802254910 0 0) 0x7ffaf813bac0 con 0x7ffaf805bed0 2026-02-12T17:37:57.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 10 monclient(hunting): my global_id is 64214 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaf818eec0 con 0x7ffaf805bed0 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 842324583 0 0) 0x7ffaf818eec0 con 0x7ffaf805bed0 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffaf813bac0 con 0x7ffaf805bed0 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ffaec003ca0 con 0x7ffaf805bed0 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 10 monclient: dump: 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.154 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2570339206 0 0) 0x7ffaf813bac0 con 0x7ffaf805bed0 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.142+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffaf8055340 con 0x7ffaf805bed0 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 2557355950) 0x7ffaec004100 con 0x7ffaf805bed0 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffae67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffae67fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6790/0 conn(0x7ffaf805bed0 legacy=0x7ffaf8197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffae67fc640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6790/0 conn(0x7ffaf805bed0 legacy=0x7ffaf8197a00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:57.155 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 40, 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 110612, 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:57.156 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:57.157 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:57.158 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:37:57.159 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:57.160 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.161 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:37:57.162 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:57.163 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:57.164 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:37:57.165 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:37:57.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.82:6800/2441377515 conn(0x7ffac803f710 legacy=0x7ffac805fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafff0c640 10 monclient: shutdown 2026-02-12T17:37:57.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafff0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:57.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 >> v1:10.20.193.57:6790/0 conn(0x7ffaf808c250 legacy=0x7ffaf8137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafe482640 1 -- 10.20.193.57:0/2632813165 reap_dead start 2026-02-12T17:37:57.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafe482640 1 -- 10.20.193.57:0/2632813165 reap_dead start 2026-02-12T17:37:57.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 shutdown_connections 2026-02-12T17:37:57.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 >> 10.20.193.57:0/2632813165 conn(0x7ffaf80916b0 msgr2=0x7ffaf808a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:57.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 shutdown_connections 2026-02-12T17:37:57.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.143+0000 7ffafff0c640 1 -- 10.20.193.57:0/2632813165 wait complete. 2026-02-12T17:37:57.167 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:37:57.167 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:37:57.168 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:37:57.201 INFO:tasks.rados.rados.0.trial082.stdout:2218: finishing copy_from racing read to trial08226312-20 2026-02-12T17:37:57.201 INFO:tasks.rados.rados.0.trial082.stdout:2219: finishing write tid 1 to trial08226312-4 2026-02-12T17:37:57.201 INFO:tasks.rados.rados.0.trial082.stdout:2218: finishing copy_from to trial08226312-20 2026-02-12T17:37:57.201 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 939 (ObjNum 703 snap 212 seq_num 703) dirty exists 2026-02-12T17:37:57.201 INFO:tasks.rados.rados.0.trial082.stdout:2219: finishing write tid 2 to trial08226312-4 2026-02-12T17:37:57.201 INFO:tasks.rados.rados.0.trial082.stdout:2219: finishing write tid 3 to trial08226312-4 2026-02-12T17:37:57.201 INFO:tasks.rados.rados.0.trial082.stdout:2219: finishing write tid 4 to trial08226312-4 2026-02-12T17:37:57.201 INFO:tasks.rados.rados.0.trial082.stdout:2219: finishing write tid 5 to trial08226312-4 2026-02-12T17:37:57.201 INFO:tasks.rados.rados.0.trial082.stdout:2219: oid 4 updating version 0 to 1632 2026-02-12T17:37:57.202 INFO:tasks.rados.rados.0.trial082.stdout:2219: oid 4 version 1632 is already newer than 1630 2026-02-12T17:37:57.202 INFO:tasks.rados.rados.0.trial082.stdout:2219: oid 4 version 1632 is already newer than 1631 2026-02-12T17:37:57.202 INFO:tasks.rados.rados.0.trial082.stdout:2219: oid 4 version 1632 is already newer than 1627 2026-02-12T17:37:57.202 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 1632 (ObjNum 766 snap 233 seq_num 766) dirty exists 2026-02-12T17:37:57.202 INFO:tasks.rados.rados.0.trial082.stdout:2219: left oid 4 (ObjNum 766 snap 233 seq_num 766) 2026-02-12T17:37:57.202 INFO:tasks.rados.rados.0.trial082.stdout:2220: expect (ObjNum 270 snap 79 seq_num 270) 2026-02-12T17:37:57.208 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1069635 2026-02-12T17:37:57.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.236+0000 7f828a65b640 10 monclient: get_monmap_and_config 2026-02-12T17:37:57.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.236+0000 7f828a65b640 10 monclient: build_initial_monmap 2026-02-12T17:37:57.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.236+0000 7f828a65b640 10 monclient: monmap: 2026-02-12T17:37:57.234 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:57.234 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.234 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:57.237816+0000 2026-02-12T17:37:57.234 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:57.237816+0000 2026-02-12T17:37:57.234 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:57.234 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.235 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:57.235 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:57.235 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:57.235 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 1 Processor -- start 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 1 -- start start 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 10 monclient: init 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 10 monclient(hunting): picked mon.noname-c con 0x7f828408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 10 monclient(hunting): picked mon.noname-a con 0x7f828408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 10 monclient(hunting): picked mon.noname-b con 0x7f8284182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828408a820 con 0x7f828408c620 2026-02-12T17:37:57.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8284089450 con 0x7f828408c250 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8284089730 con 0x7f8284182cc0 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f828a65b640 10 monclient(hunting): authenticate will time out at 1157.056677s 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f82837fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f828408c620 0x7f828408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46484/0 (socket says 10.20.193.57:46484) 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f8288bd1640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f8284182cc0 0x7f82841a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45636/0 (socket says 10.20.193.57:45636) 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.237+0000 7f82837fe640 1 -- 10.20.193.57:0/3179476079 learned_addr learned my addr 10.20.193.57:0/3179476079 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.239+0000 7f8288bd1640 1 -- 10.20.193.57:0/3179476079 >> v1:10.20.193.57:6790/0 conn(0x7f8284182cc0 legacy=0x7f82841a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.239+0000 7f82837fe640 1 -- 10.20.193.57:0/3179476079 >> v1:10.20.193.57:6789/0 conn(0x7f828408c620 legacy=0x7f828408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033956789 0 0) 0x7f8284089730 con 0x7f8284182cc0 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient(hunting): my global_id is 64217 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82680035e0 con 0x7f8284182cc0 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2421080367 0 0) 0x7f8274002b50 con 0x7f828408c620 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient(hunting): my global_id is 74118 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8284089730 con 0x7f828408c620 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2828519204 0 0) 0x7f82680035e0 con 0x7f8284182cc0 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 >> v1:10.20.193.82:6789/0 conn(0x7f828408c250 legacy=0x7f828408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8283fff640 1 -- 10.20.193.57:0/3179476079 >> v1:10.20.193.82:6789/0 conn(0x7f828408c250 legacy=0x7f828408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 >> v1:10.20.193.57:6789/0 conn(0x7f828408c620 legacy=0x7f828408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 monclient: found mon.noname-b 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8284089a10 con 0x7f8284182cc0 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: _finish_auth 0 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 5 monclient: authenticate success, global_id 64217 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8278004230 con 0x7f8284182cc0 2026-02-12T17:37:57.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: dump: 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.244 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8278004470 con 0x7f8284182cc0 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 1 -- 10.20.193.57:0/3179476079 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8278005b30 con 0x7f8284182cc0 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 4 set_mon_vals no callback set 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f8282ffd640 10 monclient: dump: 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.245 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 10 monclient: shutdown 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 1 -- 10.20.193.57:0/3179476079 >> v1:10.20.193.57:6790/0 conn(0x7f8284182cc0 legacy=0x7f82841a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 1 -- 10.20.193.57:0/3179476079 shutdown_connections 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 1 -- 10.20.193.57:0/3179476079 >> 10.20.193.57:0/3179476079 conn(0x7f82840916b0 msgr2=0x7f8284091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 1 -- 10.20.193.57:0/3179476079 shutdown_connections 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 1 -- 10.20.193.57:0/3179476079 wait complete. 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 10 monclient: build_initial_monmap 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.240+0000 7f828a65b640 10 monclient: monmap: 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:57.247 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 1 Processor -- start 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 1 -- start start 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 10 monclient: init 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 10 monclient(hunting): picked mon.noname-c con 0x7f828408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 10 monclient(hunting): picked mon.noname-a con 0x7f828408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 10 monclient(hunting): picked mon.noname-b con 0x7f8284182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828405e280 con 0x7f828408c620 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8284137fc0 con 0x7f8284182cc0 2026-02-12T17:37:57.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82841382a0 con 0x7f828408c250 2026-02-12T17:37:57.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:57.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f828a65b640 10 monclient(hunting): authenticate will time out at 1157.060562s 2026-02-12T17:37:57.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f8283fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 0x7f8284193aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45638/0 (socket says 10.20.193.57:45638) 2026-02-12T17:37:57.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.241+0000 7f8283fff640 1 -- 10.20.193.57:0/1755310091 learned_addr learned my addr 10.20.193.57:0/1755310091 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:57.250 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:57.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.243+0000 7f8283fff640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 legacy=0x7f8284193aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.243+0000 7f82837fe640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.57:6789/0 conn(0x7f828408c620 legacy=0x7f828413ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.243+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161873560 0 0) 0x7f82841382a0 con 0x7f828408c250 2026-02-12T17:37:57.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.243+0000 7f8280ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.243+0000 7f8280ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.243+0000 7f8280ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.243+0000 7f8280ff9640 10 monclient(hunting): my global_id is 64220 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.243+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82540035e0 con 0x7f828408c250 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.243+0000 7f8288bd1640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.82:6789/0 conn(0x7f8284182cc0 legacy=0x7f8284194de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1991373790 0 0) 0x7f82540035e0 con 0x7f828408c250 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82841382a0 con 0x7f828408c250 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f82700032a0 con 0x7f828408c250 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient(hunting): dump: 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.256 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 689758283 0 0) 0x7f8284137fc0 con 0x7f8284182cc0 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient(hunting): my global_id is 4858 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82540035e0 con 0x7f8284182cc0 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1645261845 0 0) 0x7f82841382a0 con 0x7f828408c250 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.82:6789/0 conn(0x7f8284182cc0 legacy=0x7f8284194de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.57:6789/0 conn(0x7f828408c620 legacy=0x7f828413ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 monclient: found mon.c 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8284138580 con 0x7f828408c250 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient: _finish_auth 0 2026-02-12T17:37:57.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f828a65b640 5 monclient: authenticate success, global_id 64220 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f828a65b640 10 monclient: _renew_subs 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f828a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8284137060 con 0x7f828408c250 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f828a65b640 10 monclient: _renew_subs 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f828a65b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f828413e680 con 0x7f828408c250 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8270003980 con 0x7f828408c250 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8270003ca0 con 0x7f828408c250 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 10 monclient: dump: 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f82827fc640 4 set_mon_vals no callback set 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f828a65b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8284090810 con 0x7f828418c330 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.244+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f8270003f30 con 0x7f828408c250 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.245+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(484..484 src has 202..484) ==== 3959+0+0 (unknown 1663615957 0 0) 0x7f827004eb70 con 0x7f828408c250 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.245+0000 7f8288bd1640 10 monclient: get_auth_request con 0x7f825403f880 auth_method 0 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f82837fe640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.82:6789/0 conn(0x7f828418c330 legacy=0x7f828418c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000981230 0 0) 0x7f8284090810 con 0x7f828418c330 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 10 monclient(hunting): my global_id is 4861 2026-02-12T17:37:57.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82841382a0 con 0x7f828418c330 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 61023765 0 0) 0x7f82841382a0 con 0x7f828418c330 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8284090810 con 0x7f828418c330 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8274002e10 con 0x7f828418c330 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 10 monclient: dump: 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.262 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 127314210 0 0) 0x7f8284090810 con 0x7f828418c330 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f828408f5b0 con 0x7f828418c330 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f82740048a0 con 0x7f828418c330 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.82:6789/0 conn(0x7f828418c330 legacy=0x7f828418c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.247+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.82:6789/0 conn(0x7f828418c330 legacy=0x7f828418c700 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.251+0000 7f828a65b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.251+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f82841387c0 con 0x7f828418ce10 2026-02-12T17:37:57.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f82837fe640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.82:6789/0 conn(0x7f828418ce10 legacy=0x7f8284197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424991253 0 0) 0x7f82841387c0 con 0x7f828418ce10 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 10 monclient(hunting): my global_id is 4864 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8284090810 con 0x7f828418ce10 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2982614292 0 0) 0x7f8284090810 con 0x7f828418ce10 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82841387c0 con 0x7f828418ce10 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8274004e30 con 0x7f828418ce10 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.253+0000 7f8280ff9640 10 monclient: dump: 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.264 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1632279954 0 0) 0x7f82841387c0 con 0x7f828418ce10 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8284055340 con 0x7f828418ce10 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 342140832) 0x7f82740070b0 con 0x7f828418ce10 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f8280ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f8280ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:57.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.82:6789/0 conn(0x7f828418ce10 legacy=0x7f8284197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f8280ff9640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.82:6789/0 conn(0x7f828418ce10 legacy=0x7f8284197510 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:57.266 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:37:57.266 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:37:57.266 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:37:57.266 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:37:57.266 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 40, 2026-02-12T17:37:57.266 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 598750, 2026-02-12T17:37:57.266 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:37:57.266 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:57.267 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:57.268 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:57.269 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:57.270 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:57.271 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:57.272 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:57.273 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:37:57.274 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:57.275 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:37:57.276 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:37:57.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.82:6800/2441377515 conn(0x7f825403f880 legacy=0x7f825405fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f828a65b640 10 monclient: shutdown 2026-02-12T17:37:57.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f828a65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:57.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 legacy=0x7f8284193aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f8288bd1640 1 -- 10.20.193.57:0/1755310091 reap_dead start 2026-02-12T17:37:57.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 shutdown_connections 2026-02-12T17:37:57.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 >> 10.20.193.57:0/1755310091 conn(0x7f82840916b0 msgr2=0x7f828408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:57.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 shutdown_connections 2026-02-12T17:37:57.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.254+0000 7f828a65b640 1 -- 10.20.193.57:0/1755310091 wait complete. 2026-02-12T17:37:57.278 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:37:57.278 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:37:57.278 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:37:57.330 INFO:tasks.rados.rados.0.trial082.stdout:2221: finishing write tid 1 to trial08226312-34 2026-02-12T17:37:57.331 INFO:tasks.rados.rados.0.trial082.stdout:2221: finishing write tid 2 to trial08226312-34 2026-02-12T17:37:57.331 INFO:tasks.rados.rados.0.trial082.stdout:2221: finishing write tid 3 to trial08226312-34 2026-02-12T17:37:57.331 INFO:tasks.rados.rados.0.trial082.stdout:2221: finishing write tid 4 to trial08226312-34 2026-02-12T17:37:57.331 INFO:tasks.rados.rados.0.trial082.stdout:2221: oid 34 updating version 0 to 1508 2026-02-12T17:37:57.331 INFO:tasks.rados.rados.0.trial082.stdout:2221: oid 34 updating version 1508 to 1510 2026-02-12T17:37:57.331 INFO:tasks.rados.rados.0.trial082.stdout:2221: oid 34 version 1510 is already newer than 1509 2026-02-12T17:37:57.331 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1510 (ObjNum 767 snap 233 seq_num 767) dirty exists 2026-02-12T17:37:57.331 INFO:tasks.rados.rados.0.trial082.stdout:2221: left oid 34 (ObjNum 767 snap 233 seq_num 767) 2026-02-12T17:37:57.331 INFO:tasks.rados.rados.0.trial082.stdout:2223: expect (ObjNum 681 snap 207 seq_num 681) 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient: get_monmap_and_config 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient: build_initial_monmap 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient: monmap: 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:57.346930+0000 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:57.346930+0000 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:57.343 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 1 Processor -- start 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 1 -- start start 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient: init 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient(hunting): picked mon.noname-b con 0x7f220008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient(hunting): picked mon.noname-c con 0x7f220008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient(hunting): picked mon.noname-a con 0x7f220008cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220008d600 con 0x7f220008cb30 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220008b1f0 con 0x7f220008c730 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220008d1f0 con 0x7f220008ae20 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f2205bc2640 10 monclient(hunting): authenticate will time out at 1157.165790s 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f21ff7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f220008ae20 0x7f220008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45652/0 (socket says 10.20.193.57:45652) 2026-02-12T17:37:57.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.346+0000 7f21ff7fe640 1 -- 10.20.193.57:0/93840860 learned_addr learned my addr 10.20.193.57:0/93840860 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:57.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.348+0000 7f21ff7fe640 1 -- 10.20.193.57:0/93840860 >> v1:10.20.193.57:6790/0 conn(0x7f220008ae20 legacy=0x7f220008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fffff640 1 -- 10.20.193.57:0/93840860 >> v1:10.20.193.57:6789/0 conn(0x7f220008cb30 legacy=0x7f22001a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990370829 0 0) 0x7f220008d1f0 con 0x7f220008ae20 2026-02-12T17:37:57.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient(hunting): my global_id is 64223 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21feffd640 1 -- 10.20.193.57:0/93840860 >> v1:10.20.193.82:6789/0 conn(0x7f220008c730 legacy=0x7f2200181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21e40035e0 con 0x7f220008ae20 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994071375 0 0) 0x7f220008d600 con 0x7f220008cb30 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient(hunting): my global_id is 74121 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f220008d1f0 con 0x7f220008cb30 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2827265116 0 0) 0x7f21e40035e0 con 0x7f220008ae20 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 >> v1:10.20.193.82:6789/0 conn(0x7f220008c730 legacy=0x7f2200181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 >> v1:10.20.193.57:6789/0 conn(0x7f220008cb30 legacy=0x7f22001a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 monclient: found mon.noname-b 2026-02-12T17:37:57.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2200057320 con 0x7f220008ae20 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: _finish_auth 0 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f21ec0030c0 con 0x7f220008ae20 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: dump: 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.350 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 5 monclient: authenticate success, global_id 64223 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21ec003350 con 0x7f220008ae20 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 1 -- 10.20.193.57:0/93840860 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f21ec004960 con 0x7f220008ae20 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f21fe7fc640 10 monclient: dump: 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.351 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 4 set_mon_vals no callback set 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 10 monclient: shutdown 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 1 -- 10.20.193.57:0/93840860 >> v1:10.20.193.57:6790/0 conn(0x7f220008ae20 legacy=0x7f220008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 1 -- 10.20.193.57:0/93840860 shutdown_connections 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 1 -- 10.20.193.57:0/93840860 >> 10.20.193.57:0/93840860 conn(0x7f2200091620 msgr2=0x7f2200091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 1 -- 10.20.193.57:0/93840860 shutdown_connections 2026-02-12T17:37:57.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.349+0000 7f2205bc2640 1 -- 10.20.193.57:0/93840860 wait complete. 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient: build_initial_monmap 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient: monmap: 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 1 Processor -- start 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 1 -- start start 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient: init 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:57.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient(hunting): picked mon.noname-a con 0x7f220008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient(hunting): picked mon.noname-b con 0x7f220008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient(hunting): picked mon.noname-c con 0x7f220008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220008d9c0 con 0x7f220008ae20 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220008a530 con 0x7f220008c730 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f220011ef00 con 0x7f220008cb30 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f2205bc2640 10 monclient(hunting): authenticate will time out at 1157.169813s 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f21ff7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f220008ae20 0x7f2200088d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46522/0 (socket says 10.20.193.57:46522) 2026-02-12T17:37:57.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.350+0000 7f21ff7fe640 1 -- 10.20.193.57:0/1549897091 learned_addr learned my addr 10.20.193.57:0/1549897091 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.352+0000 7f21ff7fe640 1 -- 10.20.193.57:0/1549897091 >> v1:10.20.193.57:6789/0 conn(0x7f220008ae20 legacy=0x7f2200088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.352+0000 7f21fffff640 1 -- 10.20.193.57:0/1549897091 >> v1:10.20.193.57:6790/0 conn(0x7f220008cb30 legacy=0x7f22001a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862606528 0 0) 0x7f220008d9c0 con 0x7f220008ae20 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): my global_id is 74124 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d00035e0 con 0x7f220008ae20 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642483935 0 0) 0x7f220011ef00 con 0x7f220008cb30 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): my global_id is 64226 2026-02-12T17:37:57.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f220008d9c0 con 0x7f220008cb30 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21feffd640 1 -- 10.20.193.57:0/1549897091 >> v1:10.20.193.82:6789/0 conn(0x7f220008c730 legacy=0x7f2200089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1685839116 0 0) 0x7f220008d9c0 con 0x7f220008cb30 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f220011ef00 con 0x7f220008cb30 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f21f4004470 con 0x7f220008cb30 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): dump: 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.359 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 552016245 0 0) 0x7f21d00035e0 con 0x7f220008ae20 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f220008d9c0 con 0x7f220008ae20 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f21ec002ee0 con 0x7f220008ae20 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): dump: 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.360 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307758181 0 0) 0x7f220008a530 con 0x7f220008c730 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient(hunting): my global_id is 4870 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d00035e0 con 0x7f220008c730 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2905677290 0 0) 0x7f220011ef00 con 0x7f220008cb30 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 >> v1:10.20.193.82:6789/0 conn(0x7f220008c730 legacy=0x7f2200089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 >> v1:10.20.193.57:6789/0 conn(0x7f220008ae20 legacy=0x7f2200088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient: _finish_hunting 0 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 monclient: found mon.c 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:57.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220005ae70 con 0x7f220008cb30 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient: _finish_auth 0 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient: _check_auth_tickets 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 5 monclient: authenticate success, global_id 64226 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 10 monclient: _renew_subs 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f220005ca30 con 0x7f220008cb30 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 10 monclient: _renew_subs 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f220011e2f0 con 0x7f220008cb30 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21f4004a60 con 0x7f220008cb30 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f21f4004d80 con 0x7f220008cb30 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:57.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21dbfff640 10 monclient: dump: 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f21fdffb640 4 set_mon_vals no callback set 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.363 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.353+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22000008d0 con 0x7f220008cb30 2026-02-12T17:37:57.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.354+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f21f4004f20 con 0x7f220008cb30 2026-02-12T17:37:57.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.354+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(484..484 src has 202..484) ==== 3959+0+0 (unknown 1663615957 0 0) 0x7f21f404fbf0 con 0x7f220008cb30 2026-02-12T17:37:57.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.354+0000 7f21ff7fe640 10 monclient: get_auth_request con 0x7f21d003fcc0 auth_method 0 2026-02-12T17:37:57.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.356+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f21f40183a0 con 0x7f220008cb30 2026-02-12T17:37:57.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.356+0000 7f21dbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:57.364 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.356+0000 7f21dbfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:57.387 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2954849 2026-02-12T17:37:57.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.498+0000 7f2205bc2640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:37:57.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.498+0000 7f2205bc2640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:37:57.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.498+0000 7f2205bc2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:57.496 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.498+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f22000887d0 con 0x7f220008cb30 2026-02-12T17:37:57.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.500+0000 7f21dbfff640 1 -- 10.20.193.57:0/1549897091 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f22000887d0 con 0x7f220008cb30 2026-02-12T17:37:57.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.500+0000 7f21dbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:37:57.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.500+0000 7f21dbfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:57.497 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.495+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.497 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.495+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=2,health=13,kv=11,logm=60} crc {auth=773953751,config=1618278320,health=4214671160,kv=1466688342,logm=651417975}) 2026-02-12T17:37:57.497 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.495+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=11,logm=61} crc {auth=810606485,config=1618278320,health=2056113331,kv=1466688342,logm=3433612889}) 2026-02-12T17:37:57.498 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.495+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.498 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.495+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=2,health=13,kv=11,logm=60} crc {auth=773953751,config=1618278320,health=4214671160,kv=1466688342,logm=651417975}) 2026-02-12T17:37:57.498 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.495+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=15,config=2,health=13,kv=10,logm=60} crc {auth=2313583214,config=1618278320,health=4214671160,kv=480090932,logm=904321778}) 2026-02-12T17:37:57.498 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.498 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2915950107}) 2026-02-12T17:37:57.498 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1536351457}) 2026-02-12T17:37:57.498 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.498 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2915950107}) 2026-02-12T17:37:57.498 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1862863297}) 2026-02-12T17:37:57.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.501+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 >> v1:10.20.193.82:6800/2441377515 conn(0x7f21d003fcc0 legacy=0x7f21d0060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.501+0000 7f2205bc2640 10 monclient: shutdown 2026-02-12T17:37:57.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.501+0000 7f2205bc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:57.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.501+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 >> v1:10.20.193.57:6790/0 conn(0x7f220008cb30 legacy=0x7f22001a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:57.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.501+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 shutdown_connections 2026-02-12T17:37:57.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.501+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 >> 10.20.193.57:0/1549897091 conn(0x7f2200091620 msgr2=0x7f2200125ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:57.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.501+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 shutdown_connections 2026-02-12T17:37:57.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:57.501+0000 7f2205bc2640 1 -- 10.20.193.57:0/1549897091 wait complete. 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1350037143}) 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1174224725}) 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1350037143}) 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.496+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=258815202}) 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.497+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.497+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3510115171}) 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.497+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2951231035}) 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.497+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.497+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3510115171}) 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.497+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4207774379}) 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=906023214}) 2026-02-12T17:37:57.500 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2959561568}) 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=906023214}) 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4126727345}) 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2414912162}) 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2341264743}) 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2414912162}) 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.498+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=297202554}) 2026-02-12T17:37:57.501 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=523406083}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1303535378}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=523406083}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3406068945}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1070429404}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1649926880}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1070429404}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.499+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1908125846}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=304706986}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=567430738}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=304706986}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2509789911}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3903485591}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1686930718}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3903485591}) 2026-02-12T17:37:57.502 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.500+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1304537514}) 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.501+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.501+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1223721705}) 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.501+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2049388714}) 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.501+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.501+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1223721705}) 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.501+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=670903976}) 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1245568237}) 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1825424569}) 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1245568237}) 2026-02-12T17:37:57.503 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4017338948}) 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1673740319}) 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1342920557}) 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1673740319}) 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.502+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2023060128}) 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3098499047}) 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2917670944}) 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3098499047}) 2026-02-12T17:37:57.504 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=800830251}) 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3589145121}) 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4077858613}) 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3589145121}) 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.503+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=241999319}) 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=766467571}) 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1193012720}) 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=766467571}) 2026-02-12T17:37:57.505 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3323780866}) 2026-02-12T17:37:57.506 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:37:57.506 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.506 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=170187022}) 2026-02-12T17:37:57.506 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982511186}) 2026-02-12T17:37:57.506 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.506 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=170187022}) 2026-02-12T17:37:57.506 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.504+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2242296016}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1765785895}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027993990}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1765785895}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2708170817}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3265176871}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325710489}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3265176871}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.505+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3023203111}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.506+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.506+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1949937266}) 2026-02-12T17:37:57.507 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.506+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1355505083}) 2026-02-12T17:37:57.508 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.506+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.508 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.506+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1949937266}) 2026-02-12T17:37:57.508 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.506+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3638902997}) 2026-02-12T17:37:57.508 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.508 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3624327244}) 2026-02-12T17:37:57.508 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1249835922}) 2026-02-12T17:37:57.508 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.508 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3624327244}) 2026-02-12T17:37:57.508 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3848275262}) 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=3} crc {logm=1744665317,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=2250092014,mon_config_key=325234814,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1467394822,osd_snap=70769101}) 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=54,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1} crc {logm=595597273,mdsmap=2204869053,mgr=2467168608,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=4160256537,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1467394822,osd_snap=3823785925}) 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=3} crc {logm=1744665317,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=2250092014,mon_config_key=325234814,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1467394822,osd_snap=70769101}) 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.507+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=53,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=3} crc {logm=1256123877,mdsmap=2204869053,mgr=4185179830,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=4160256537,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1467394822,osd_snap=70769101}) 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=75,osdmap=25} crc {osd_snap=3250709511,osdmap=1008438934}) 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=74,osdmap=26} crc {osd_snap=732031867,osdmap=3846296343}) 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=75,osdmap=25} crc {osd_snap=3250709511,osdmap=1008438934}) 2026-02-12T17:37:57.509 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=77,osdmap=23} crc {osd_snap=2656983357,osdmap=773723124}) 2026-02-12T17:37:57.510 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.510 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=303491043}) 2026-02-12T17:37:57.510 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2381973527}) 2026-02-12T17:37:57.510 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.510 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=303491043}) 2026-02-12T17:37:57.510 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.508+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1791904933}) 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.509+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.509+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1255218164}) 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.509+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2988572133}) 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.509+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.509+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1255218164}) 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.509+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=790668052}) 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.510+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.510+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2206158146}) 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.510+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=816724218}) 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.510+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.510+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2206158146}) 2026-02-12T17:37:57.511 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.510+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3556815}) 2026-02-12T17:37:57.512 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.511+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.512 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.511+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=94} crc {osdmap=4221402714}) 2026-02-12T17:37:57.512 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.511+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=92} crc {osdmap=2242251183}) 2026-02-12T17:37:57.512 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.511+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:37:57.512 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.511+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=94} crc {osdmap=4221402714}) 2026-02-12T17:37:57.512 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:37:57.511+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=95} crc {osdmap=2984406679}) 2026-02-12T17:37:58.070 INFO:tasks.rados.rados.0.trial082.stdout:2217: done (6 left) 2026-02-12T17:37:58.070 INFO:tasks.rados.rados.0.trial082.stdout:2218: done (5 left) 2026-02-12T17:37:58.070 INFO:tasks.rados.rados.0.trial082.stdout:2219: done (4 left) 2026-02-12T17:37:58.070 INFO:tasks.rados.rados.0.trial082.stdout:2220: done (3 left) 2026-02-12T17:37:58.070 INFO:tasks.rados.rados.0.trial082.stdout:2221: done (2 left) 2026-02-12T17:37:58.070 INFO:tasks.rados.rados.0.trial082.stdout:2223: done (1 left) 2026-02-12T17:37:58.070 INFO:tasks.rados.rados.0.trial082.stdout:2224: done (0 left) 2026-02-12T17:37:58.070 INFO:tasks.rados.rados.0.trial082.stdout:2225: read oid 26 snap -1 2026-02-12T17:37:58.071 INFO:tasks.rados.rados.0.trial082.stdout:2225: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:37:58.071 INFO:tasks.rados.rados.0.trial082.stdout:2226: read oid 9 snap -1 2026-02-12T17:37:58.071 INFO:tasks.rados.rados.0.trial082.stdout:2226: expect (ObjNum 706 snap 212 seq_num 706) 2026-02-12T17:37:58.071 INFO:tasks.rados.rados.0.trial082.stdout:2227: read oid 15 snap -1 2026-02-12T17:37:58.071 INFO:tasks.rados.rados.0.trial082.stdout:2227: expect (ObjNum 710 snap 213 seq_num 710) 2026-02-12T17:37:58.071 INFO:tasks.rados.rados.0.trial082.stdout:2228: read oid 7 snap -1 2026-02-12T17:37:58.071 INFO:tasks.rados.rados.0.trial082.stdout:2228: expect deleted 2026-02-12T17:37:58.071 INFO:tasks.rados.rados.0.trial082.stdout:2229: write (excl) oid 34 current snap is 234 2026-02-12T17:37:58.071 INFO:tasks.rados.rados.0.trial082.stdout:2229: seq_num 768 ranges {507776=742885,1991465=485600} 2026-02-12T17:37:58.074 INFO:tasks.rados.rados.0.trial082.stdout:2229: writing trial08226312-34 from 507776 to 1250661 tid 1 2026-02-12T17:37:58.079 INFO:tasks.rados.rados.0.trial082.stdout:2229: writing trial08226312-34 from 1991465 to 2477065 tid 2 2026-02-12T17:37:58.079 INFO:tasks.rados.rados.0.trial082.stdout:2230: write oid 25 current snap is 234 2026-02-12T17:37:58.079 INFO:tasks.rados.rados.0.trial082.stdout:2230: seq_num 769 ranges {524583=418134,1649947=629258,2834752=89831} 2026-02-12T17:37:58.082 INFO:tasks.rados.rados.0.trial082.stdout:2230: writing trial08226312-25 from 524583 to 942717 tid 1 2026-02-12T17:37:58.087 INFO:tasks.rados.rados.0.trial082.stdout:2230: writing trial08226312-25 from 1649947 to 2279205 tid 2 2026-02-12T17:37:58.090 INFO:tasks.rados.rados.0.trial082.stdout:2230: writing trial08226312-25 from 2834752 to 2924583 tid 3 2026-02-12T17:37:58.090 INFO:tasks.rados.rados.0.trial082.stdout:2231: read oid 41 snap -1 2026-02-12T17:37:58.090 INFO:tasks.rados.rados.0.trial082.stdout:2231: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:58.090 INFO:tasks.rados.rados.0.trial082.stdout:2232: write oid 13 current snap is 234 2026-02-12T17:37:58.090 INFO:tasks.rados.rados.0.trial082.stdout:2232: seq_num 770 ranges {541390=493383,1592076=489269,2862175=79215} 2026-02-12T17:37:58.093 INFO:tasks.rados.rados.0.trial082.stdout:2232: writing trial08226312-13 from 541390 to 1034773 tid 1 2026-02-12T17:37:58.097 INFO:tasks.rados.rados.0.trial082.stdout:2232: writing trial08226312-13 from 1592076 to 2081345 tid 2 2026-02-12T17:37:58.100 INFO:tasks.rados.rados.0.trial082.stdout:2232: writing trial08226312-13 from 2862175 to 2941390 tid 3 2026-02-12T17:37:58.100 INFO:tasks.rados.rados.0.trial082.stdout:2233: write oid 44 current snap is 234 2026-02-12T17:37:58.101 INFO:tasks.rados.rados.0.trial082.stdout:2233: seq_num 771 ranges {558197=568632,1650558=632927,2773245=184952} 2026-02-12T17:37:58.104 INFO:tasks.rados.rados.0.trial082.stdout:2233: writing trial08226312-44 from 558197 to 1126829 tid 1 2026-02-12T17:37:58.109 INFO:tasks.rados.rados.0.trial082.stdout:2233: writing trial08226312-44 from 1650558 to 2283485 tid 2 2026-02-12T17:37:58.112 INFO:tasks.rados.rados.0.trial082.stdout:2233: writing trial08226312-44 from 2773245 to 2958197 tid 3 2026-02-12T17:37:58.112 INFO:tasks.rados.rados.0.trial082.stdout:2234: snap_create 2026-02-12T17:37:58.112 INFO:tasks.rados.rados.0.trial082.stdout:2226: expect (ObjNum 706 snap 212 seq_num 706) 2026-02-12T17:37:58.112 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:58.185 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 749146 2026-02-12T17:37:58.218 INFO:tasks.rados.rados.0.trial082.stdout:2227: expect (ObjNum 710 snap 213 seq_num 710) 2026-02-12T17:37:58.231 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3406523 2026-02-12T17:37:58.259 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:58.288 INFO:tasks.rados.rados.0.trial082.stdout:2229: finishing write tid 1 to trial08226312-34 2026-02-12T17:37:58.288 INFO:tasks.rados.rados.0.trial082.stdout:2229: finishing write tid 2 to trial08226312-34 2026-02-12T17:37:58.288 INFO:tasks.rados.rados.0.trial082.stdout:2229: finishing write tid 3 to trial08226312-34 2026-02-12T17:37:58.288 INFO:tasks.rados.rados.0.trial082.stdout:2229: finishing write tid 4 to trial08226312-34 2026-02-12T17:37:58.288 INFO:tasks.rados.rados.0.trial082.stdout:2229: oid 34 updating version 0 to 1512 2026-02-12T17:37:58.288 INFO:tasks.rados.rados.0.trial082.stdout:2229: oid 34 updating version 1512 to 1513 2026-02-12T17:37:58.288 INFO:tasks.rados.rados.0.trial082.stdout:2229: oid 34 version 1513 is already newer than 1511 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1513 (ObjNum 768 snap 234 seq_num 768) dirty exists 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2229: left oid 34 (ObjNum 768 snap 234 seq_num 768) 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2230: finishing write tid 1 to trial08226312-25 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2230: finishing write tid 2 to trial08226312-25 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2230: finishing write tid 3 to trial08226312-25 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2230: finishing write tid 4 to trial08226312-25 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2230: finishing write tid 5 to trial08226312-25 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2230: oid 25 updating version 0 to 553 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2230: oid 25 updating version 553 to 554 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2230: oid 25 updating version 554 to 555 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:2230: oid 25 updating version 555 to 556 2026-02-12T17:37:58.289 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 556 (ObjNum 769 snap 234 seq_num 769) dirty exists 2026-02-12T17:37:58.290 INFO:tasks.rados.rados.0.trial082.stdout:2230: left oid 25 (ObjNum 769 snap 234 seq_num 769) 2026-02-12T17:37:58.290 INFO:tasks.rados.rados.0.trial082.stdout:2232: finishing write tid 1 to trial08226312-13 2026-02-12T17:37:58.290 INFO:tasks.rados.rados.0.trial082.stdout:2231: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:37:58.294 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2464094 2026-02-12T17:37:58.305 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:58.354 INFO:tasks.rados.rados.0.trial082.stdout:2232: finishing write tid 2 to trial08226312-13 2026-02-12T17:37:58.355 INFO:tasks.rados.rados.0.trial082.stdout:2232: finishing write tid 3 to trial08226312-13 2026-02-12T17:37:58.355 INFO:tasks.rados.rados.0.trial082.stdout:2232: finishing write tid 4 to trial08226312-13 2026-02-12T17:37:58.355 INFO:tasks.rados.rados.0.trial082.stdout:2232: finishing write tid 5 to trial08226312-13 2026-02-12T17:37:58.355 INFO:tasks.rados.rados.0.trial082.stdout:2232: oid 13 updating version 0 to 558 2026-02-12T17:37:58.355 INFO:tasks.rados.rados.0.trial082.stdout:2232: oid 13 version 558 is already newer than 557 2026-02-12T17:37:58.355 INFO:tasks.rados.rados.0.trial082.stdout:2232: oid 13 updating version 558 to 559 2026-02-12T17:37:58.355 INFO:tasks.rados.rados.0.trial082.stdout:2232: oid 13 updating version 559 to 560 2026-02-12T17:37:58.355 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 560 (ObjNum 770 snap 234 seq_num 770) dirty exists 2026-02-12T17:37:58.355 INFO:tasks.rados.rados.0.trial082.stdout:2232: left oid 13 (ObjNum 770 snap 234 seq_num 770) 2026-02-12T17:37:58.507 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:37:58.507 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:37:58.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.577+0000 7f5186436640 10 monclient: get_monmap_and_config 2026-02-12T17:37:58.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.577+0000 7f5186436640 10 monclient: build_initial_monmap 2026-02-12T17:37:58.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.577+0000 7f5186436640 10 monclient: monmap: 2026-02-12T17:37:58.575 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:58.575 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.575 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:58.578718+0000 2026-02-12T17:37:58.575 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:58.578718+0000 2026-02-12T17:37:58.575 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:58.576 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.576 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:58.576 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:58.576 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:58.576 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 1 Processor -- start 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 1 -- start start 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 10 monclient: init 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 10 monclient(hunting): picked mon.noname-a con 0x7f518008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 10 monclient(hunting): picked mon.noname-c con 0x7f518008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 10 monclient(hunting): picked mon.noname-b con 0x7f518008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518008d600 con 0x7f518008ae20 2026-02-12T17:37:58.581 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518008b1f0 con 0x7f518008c730 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518008d1f0 con 0x7f518008cb30 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f5186436640 10 monclient(hunting): authenticate will time out at 1158.397636s 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f517ffff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f518008ae20 0x7f518008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46528/0 (socket says 10.20.193.57:46528) 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.578+0000 7f517ffff640 1 -- 10.20.193.57:0/2660186053 learned_addr learned my addr 10.20.193.57:0/2660186053 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.580+0000 7f51849ac640 1 -- 10.20.193.57:0/2660186053 >> v1:10.20.193.57:6790/0 conn(0x7f518008cb30 legacy=0x7f51801a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.580+0000 7f517ffff640 1 -- 10.20.193.57:0/2660186053 >> v1:10.20.193.57:6789/0 conn(0x7f518008ae20 legacy=0x7f518008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.580+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723612927 0 0) 0x7f518008d1f0 con 0x7f518008cb30 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.580+0000 7f517effd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.580+0000 7f517effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.580+0000 7f517effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.580+0000 7f517effd640 10 monclient(hunting): my global_id is 64229 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51640035e0 con 0x7f518008cb30 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311306296 0 0) 0x7f518008d600 con 0x7f518008ae20 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient(hunting): my global_id is 74127 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517f7fe640 1 -- 10.20.193.57:0/2660186053 >> v1:10.20.193.82:6789/0 conn(0x7f518008c730 legacy=0x7f5180181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f518008d1f0 con 0x7f518008ae20 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3063150956 0 0) 0x7f51640035e0 con 0x7f518008cb30 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 >> v1:10.20.193.82:6789/0 conn(0x7f518008c730 legacy=0x7f5180181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 >> v1:10.20.193.57:6789/0 conn(0x7f518008ae20 legacy=0x7f518008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: _finish_hunting 0 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 monclient: found mon.noname-b 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5180057320 con 0x7f518008cb30 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: _finish_auth 0 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: _check_auth_tickets 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5174004270 con 0x7f518008cb30 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:37:58.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: dump: 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 5 monclient: authenticate success, global_id 64229 2026-02-12T17:37:58.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51740044c0 con 0x7f518008cb30 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 1 -- 10.20.193.57:0/2660186053 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5174004960 con 0x7f518008cb30 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f517effd640 10 monclient: dump: 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.586 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 4 set_mon_vals no callback set 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 10 monclient: shutdown 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 1 -- 10.20.193.57:0/2660186053 >> v1:10.20.193.57:6790/0 conn(0x7f518008cb30 legacy=0x7f51801a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 1 -- 10.20.193.57:0/2660186053 shutdown_connections 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 1 -- 10.20.193.57:0/2660186053 >> 10.20.193.57:0/2660186053 conn(0x7f5180091620 msgr2=0x7f5180091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 1 -- 10.20.193.57:0/2660186053 shutdown_connections 2026-02-12T17:37:58.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.581+0000 7f5186436640 1 -- 10.20.193.57:0/2660186053 wait complete. 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient: build_initial_monmap 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient: monmap: 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:58.588 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 1 Processor -- start 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 1 -- start start 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient: init 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient(hunting): picked mon.noname-b con 0x7f518008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient(hunting): picked mon.noname-c con 0x7f518008c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient(hunting): picked mon.noname-a con 0x7f518008cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518008d9c0 con 0x7f518008cb30 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5180088810 con 0x7f518008ae20 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518013d4b0 con 0x7f518008c730 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:58.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f5186436640 10 monclient(hunting): authenticate will time out at 1158.401791s 2026-02-12T17:37:58.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f517f7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f518008c730 0x7f5180192240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45678/0 (socket says 10.20.193.57:45678) 2026-02-12T17:37:58.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f51849ac640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f518008cb30 0x7f5180193960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46534/0 (socket says 10.20.193.57:46534) 2026-02-12T17:37:58.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.582+0000 7f517f7fe640 1 -- 10.20.193.57:0/869779998 learned_addr learned my addr 10.20.193.57:0/869779998 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:58.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.584+0000 7f517f7fe640 1 -- 10.20.193.57:0/869779998 >> v1:10.20.193.57:6790/0 conn(0x7f518008c730 legacy=0x7f5180192240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.584+0000 7f51849ac640 1 -- 10.20.193.57:0/869779998 >> v1:10.20.193.57:6789/0 conn(0x7f518008cb30 legacy=0x7f5180193960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796097550 0 0) 0x7f518013d4b0 con 0x7f518008c730 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): my global_id is 64232 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517ffff640 1 -- 10.20.193.57:0/869779998 >> v1:10.20.193.82:6789/0 conn(0x7f518008ae20 legacy=0x7f5180150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51500035e0 con 0x7f518008c730 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959162967 0 0) 0x7f518008d9c0 con 0x7f518008cb30 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): my global_id is 74130 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f518013d4b0 con 0x7f518008cb30 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3371276720 0 0) 0x7f518013d4b0 con 0x7f518008cb30 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f518008d9c0 con 0x7f518008cb30 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5174004630 con 0x7f518008cb30 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): dump: 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.595 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224971631 0 0) 0x7f5180088810 con 0x7f518008ae20 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): my global_id is 4876 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f518013d4b0 con 0x7f518008ae20 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1155461191 0 0) 0x7f51500035e0 con 0x7f518008c730 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5180088810 con 0x7f518008c730 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f51700033e0 con 0x7f518008c730 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient(hunting): dump: 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.597 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 100853951 0 0) 0x7f518008d9c0 con 0x7f518008cb30 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 >> v1:10.20.193.57:6790/0 conn(0x7f518008c730 legacy=0x7f5180192240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 >> v1:10.20.193.82:6789/0 conn(0x7f518008ae20 legacy=0x7f5180150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient: _finish_hunting 0 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 monclient: found mon.a 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:58.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518013ef70 con 0x7f518008cb30 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient: _finish_auth 0 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient: _check_auth_tickets 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f5186436640 5 monclient: authenticate success, global_id 74130 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f5186436640 10 monclient: _renew_subs 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f5186436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f518013f250 con 0x7f518008cb30 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f5186436640 10 monclient: _renew_subs 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f5186436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f518013e010 con 0x7f518008cb30 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5174003c00 con 0x7f518008cb30 2026-02-12T17:37:58.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f51740050f0 con 0x7f518008cb30 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517cff9640 10 monclient: dump: 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.600 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.585+0000 7f517e7fc640 4 set_mon_vals no callback set 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.586+0000 7f5186436640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.586+0000 7f5186436640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.586+0000 7f5186436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.586+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51800008d0 con 0x7f518008cb30 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.586+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5174005350 con 0x7f518008cb30 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.586+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(485..485 src has 202..485) ==== 3931+0+0 (unknown 2228139156 0 0) 0x7f517404fcf0 con 0x7f518008cb30 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.586+0000 7f517ffff640 10 monclient: get_auth_request con 0x7f515003fd10 auth_method 0 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.588+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f5174003e70 con 0x7f518008cb30 2026-02-12T17:37:58.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.588+0000 7f517cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:58.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.588+0000 7f517cff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:58.636 INFO:tasks.rados.rados.0.trial082.stdout:2225: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:37:58.636 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:37:58.695 INFO:tasks.rados.rados.0.trial082.stdout:2233: finishing write tid 1 to trial08226312-44 2026-02-12T17:37:58.695 INFO:tasks.rados.rados.0.trial082.stdout:2233: finishing write tid 2 to trial08226312-44 2026-02-12T17:37:58.695 INFO:tasks.rados.rados.0.trial082.stdout:2233: finishing write tid 3 to trial08226312-44 2026-02-12T17:37:58.695 INFO:tasks.rados.rados.0.trial082.stdout:2233: finishing write tid 4 to trial08226312-44 2026-02-12T17:37:58.696 INFO:tasks.rados.rados.0.trial082.stdout:2233: finishing write tid 5 to trial08226312-44 2026-02-12T17:37:58.696 INFO:tasks.rados.rados.0.trial082.stdout:2233: oid 44 updating version 0 to 1520 2026-02-12T17:37:58.696 INFO:tasks.rados.rados.0.trial082.stdout:2233: oid 44 version 1520 is already newer than 1519 2026-02-12T17:37:58.696 INFO:tasks.rados.rados.0.trial082.stdout:2233: oid 44 updating version 1520 to 1522 2026-02-12T17:37:58.696 INFO:tasks.rados.rados.0.trial082.stdout:2233: oid 44 version 1522 is already newer than 1521 2026-02-12T17:37:58.696 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 1522 (ObjNum 771 snap 234 seq_num 771) dirty exists 2026-02-12T17:37:58.696 INFO:tasks.rados.rados.0.trial082.stdout:2233: left oid 44 (ObjNum 771 snap 234 seq_num 771) 2026-02-12T17:37:58.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.731+0000 7f5186436640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:37:58.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.731+0000 7f5186436640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:37:58.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.731+0000 7f5186436640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:58.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.731+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f518008f520 con 0x7f518008cb30 2026-02-12T17:37:58.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.731+0000 7f517cff9640 1 -- 10.20.193.57:0/869779998 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2580802518) 0x7f517403ae60 con 0x7f518008cb30 2026-02-12T17:37:58.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.731+0000 7f517cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:37:58.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.731+0000 7f517cff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:58.730 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:37:58.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.732+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 >> v1:10.20.193.82:6800/2441377515 conn(0x7f515003fd10 legacy=0x7f51500601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.732+0000 7f5186436640 10 monclient: shutdown 2026-02-12T17:37:58.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.732+0000 7f5186436640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:58.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.732+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 >> v1:10.20.193.57:6789/0 conn(0x7f518008cb30 legacy=0x7f5180193960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.732+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 shutdown_connections 2026-02-12T17:37:58.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.732+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 >> 10.20.193.57:0/869779998 conn(0x7f5180091620 msgr2=0x7f51800597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:58.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.732+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 shutdown_connections 2026-02-12T17:37:58.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.732+0000 7f5186436640 1 -- 10.20.193.57:0/869779998 wait complete. 2026-02-12T17:37:58.737 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:37:58.738 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:37:58.738 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:37:58.738 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:37:58.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.806+0000 7f6c2425b640 10 monclient: get_monmap_and_config 2026-02-12T17:37:58.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.806+0000 7f6c2425b640 10 monclient: build_initial_monmap 2026-02-12T17:37:58.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.806+0000 7f6c2425b640 10 monclient: monmap: 2026-02-12T17:37:58.804 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:58.804 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.804 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:58.807743+0000 2026-02-12T17:37:58.804 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:58.807743+0000 2026-02-12T17:37:58.804 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:58.804 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.805 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:58.805 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:58.805 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:58.805 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 1 Processor -- start 2026-02-12T17:37:58.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 1 -- start start 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 10 monclient: init 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 10 monclient(hunting): picked mon.noname-b con 0x7f6c1c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 10 monclient(hunting): picked mon.noname-a con 0x7f6c1c08cd30 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 10 monclient(hunting): picked mon.noname-c con 0x7f6c1c183390 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c089c60 con 0x7f6c1c08cd30 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c085410 con 0x7f6c1c183390 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c089a10 con 0x7f6c1c08c250 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c2425b640 10 monclient(hunting): authenticate will time out at 1158.626829s 2026-02-12T17:37:58.807 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c217cf640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f6c1c08cd30 0x7f6c1c181c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46550/0 (socket says 10.20.193.57:46550) 2026-02-12T17:37:58.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c21fd0640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f6c1c08c250 0x7f6c1c08c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45684/0 (socket says 10.20.193.57:45684) 2026-02-12T17:37:58.808 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.807+0000 7f6c217cf640 1 -- 10.20.193.57:0/3668816740 learned_addr learned my addr 10.20.193.57:0/3668816740 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:58.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c217cf640 1 -- 10.20.193.57:0/3668816740 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c08cd30 legacy=0x7f6c1c181c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c21fd0640 1 -- 10.20.193.57:0/3668816740 >> v1:10.20.193.57:6790/0 conn(0x7f6c1c08c250 legacy=0x7f6c1c08c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3670101666 0 0) 0x7f6c1c089a10 con 0x7f6c1c08c250 2026-02-12T17:37:58.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.816 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient(hunting): my global_id is 64235 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c040035e0 con 0x7f6c1c08c250 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176618977 0 0) 0x7f6c1c089c60 con 0x7f6c1c08cd30 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient(hunting): my global_id is 74133 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c1c089a10 con 0x7f6c1c08cd30 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2151638512 0 0) 0x7f6c040035e0 con 0x7f6c1c08c250 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 >> v1:10.20.193.82:6789/0 conn(0x7f6c1c183390 legacy=0x7f6c1c1a3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c08cd30 legacy=0x7f6c1c181c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: _finish_hunting 0 2026-02-12T17:37:58.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 monclient: found mon.noname-b 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c08d430 con 0x7f6c1c08c250 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: _finish_auth 0 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: _check_auth_tickets 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6c0c0030d0 con 0x7f6c1c08c250 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: dump: 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.818 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 5 monclient: authenticate success, global_id 64235 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c0c0033d0 con 0x7f6c1c08c250 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:58.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 1 -- 10.20.193.57:0/3668816740 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6c0c004a50 con 0x7f6c1c08c250 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c20fce640 10 monclient: dump: 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.820 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 4 set_mon_vals no callback set 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 10 monclient: shutdown 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 1 -- 10.20.193.57:0/3668816740 >> v1:10.20.193.57:6790/0 conn(0x7f6c1c08c250 legacy=0x7f6c1c08c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 1 -- 10.20.193.57:0/3668816740 shutdown_connections 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 1 -- 10.20.193.57:0/3668816740 >> 10.20.193.57:0/3668816740 conn(0x7f6c1c0916b0 msgr2=0x7f6c1c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 1 -- 10.20.193.57:0/3668816740 shutdown_connections 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.810+0000 7f6c2425b640 1 -- 10.20.193.57:0/3668816740 wait complete. 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient: build_initial_monmap 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient: monmap: 2026-02-12T17:37:58.821 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 1 Processor -- start 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 1 -- start start 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient: init 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:58.822 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient(hunting): picked mon.noname-a con 0x7f6c1c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient(hunting): picked mon.noname-b con 0x7f6c1c08cd30 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient(hunting): picked mon.noname-c con 0x7f6c1c183390 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c0888a0 con 0x7f6c1c08c250 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c07cc80 con 0x7f6c1c08cd30 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c07cf60 con 0x7f6c1c183390 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c2425b640 10 monclient(hunting): authenticate will time out at 1158.630644s 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c21fd0640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f6c1c08c250 0x7f6c1c0849b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46552/0 (socket says 10.20.193.57:46552) 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.811+0000 7f6c21fd0640 1 -- 10.20.193.57:0/3415729316 learned_addr learned my addr 10.20.193.57:0/3415729316 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:58.823 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c21fd0640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c08c250 legacy=0x7f6c1c0849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c227d1640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6790/0 conn(0x7f6c1c183390 legacy=0x7f6c1c1317d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c217cf640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.82:6789/0 conn(0x7f6c1c08cd30 legacy=0x7f6c1c181c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1131242262 0 0) 0x7f6c1c0888a0 con 0x7f6c1c08c250 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 10 monclient(hunting): my global_id is 74136 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bec0035e0 con 0x7f6c1c08c250 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525087724 0 0) 0x7f6c1c07cf60 con 0x7f6c1c183390 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 10 monclient(hunting): my global_id is 64238 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.813+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c1c0888a0 con 0x7f6c1c183390 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075940168 0 0) 0x7f6c1c07cc80 con 0x7f6c1c08cd30 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): my global_id is 4879 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c1c07cf60 con 0x7f6c1c08cd30 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3172344291 0 0) 0x7f6bec0035e0 con 0x7f6c1c08c250 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c1c07cc80 con 0x7f6c1c08c250 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6c0c004a50 con 0x7f6c1c08c250 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:58.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): dump: 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:58.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3351467058 0 0) 0x7f6c1c0888a0 con 0x7f6c1c183390 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bec0035e0 con 0x7f6c1c183390 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6c18005320 con 0x7f6c1c183390 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): dump: 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.827 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2113250892 0 0) 0x7f6c1c07cf60 con 0x7f6c1c08cd30 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c1c0888a0 con 0x7f6c1c08cd30 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6c100033e0 con 0x7f6c1c08cd30 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient(hunting): dump: 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.828 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4236386931 0 0) 0x7f6c1c07cc80 con 0x7f6c1c08c250 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6790/0 conn(0x7f6c1c183390 legacy=0x7f6c1c1317d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.82:6789/0 conn(0x7f6c1c08cd30 legacy=0x7f6c1c181c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 monclient: found mon.a 2026-02-12T17:37:58.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c07bd20 con 0x7f6c1c08c250 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient: _finish_auth 0 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c2425b640 5 monclient: authenticate success, global_id 74136 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c2425b640 10 monclient: _renew_subs 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c2425b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c05d3f0 con 0x7f6c1c08c250 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c2425b640 10 monclient: _renew_subs 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c2425b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:58.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c1c085260 con 0x7f6c1c08c250 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c0c005030 con 0x7f6c1c08c250 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6c0c002d50 con 0x7f6c1c08c250 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 10 monclient: dump: 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.831 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0bfff640 4 set_mon_vals no callback set 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c2425b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6c1c05cee0 con 0x7f6c1c05cb10 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.814+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f6c0c011e60 con 0x7f6c1c08c250 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.815+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(485..485 src has 202..485) ==== 3931+0+0 (unknown 2228139156 0 0) 0x7f6c0c04eda0 con 0x7f6c1c08c250 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.815+0000 7f6c227d1640 10 monclient: get_auth_request con 0x7f6bec03ff10 auth_method 0 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.816+0000 7f6c217cf640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c05cb10 legacy=0x7f6c1c123b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489333395 0 0) 0x7f6c1c05cee0 con 0x7f6c1c05cb10 2026-02-12T17:37:58.832 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 10 monclient(hunting): my global_id is 74139 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c1c07cc80 con 0x7f6c1c05cb10 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1577065094 0 0) 0x7f6c1c07cc80 con 0x7f6c1c05cb10 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c1c05cee0 con 0x7f6c1c05cb10 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6c10003540 con 0x7f6c1c05cb10 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 10 monclient: dump: 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.833 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4044863045 0 0) 0x7f6c1c05cee0 con 0x7f6c1c05cb10 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c1c088bb0 con 0x7f6c1c05cb10 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f6c10005040 con 0x7f6c1c05cb10 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:58.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:58.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c05cb10 legacy=0x7f6c1c123b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.817+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c05cb10 legacy=0x7f6c1c123b70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:58.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.820+0000 7f6c2425b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:37:58.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.820+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6c1c090810 con 0x7f6c1c124280 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.822+0000 7f6c217cf640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c124280 legacy=0x7f6c1c133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353947805 0 0) 0x7f6c1c090810 con 0x7f6c1c124280 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 10 monclient(hunting): my global_id is 74142 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c1c05cee0 con 0x7f6c1c124280 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 945555921 0 0) 0x7f6c1c05cee0 con 0x7f6c1c124280 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c1c090810 con 0x7f6c1c124280 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6c10006ea0 con 0x7f6c1c124280 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 10 monclient: dump: 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1759404791 0 0) 0x7f6c1c090810 con 0x7f6c1c124280 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c1c0893c0 con 0x7f6c1c124280 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4336 (unknown 0 0 755513110) 0x7f6c100069b0 con 0x7f6c1c124280 2026-02-12T17:37:58.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:37:58.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:58.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c124280 legacy=0x7f6c1c133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c0a7fc640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c124280 legacy=0x7f6c1c133f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:58.839 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:37:58.839 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:37:58.839 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:37:58.839 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:37:58.839 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 40, 2026-02-12T17:37:58.839 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 5286, 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 4, 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:58.840 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:58.841 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.842 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:37:58.843 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:58.844 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.845 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:58.846 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:58.847 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.848 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:37:58.849 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:37:58.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.82:6800/2441377515 conn(0x7f6bec03ff10 legacy=0x7f6bec0603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c2425b640 10 monclient: shutdown 2026-02-12T17:37:58.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c2425b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:58.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 >> v1:10.20.193.57:6789/0 conn(0x7f6c1c08c250 legacy=0x7f6c1c0849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c227d1640 1 -- 10.20.193.57:0/3415729316 reap_dead start 2026-02-12T17:37:58.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c227d1640 1 -- 10.20.193.57:0/3415729316 reap_dead start 2026-02-12T17:37:58.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 shutdown_connections 2026-02-12T17:37:58.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 >> 10.20.193.57:0/3415729316 conn(0x7f6c1c0916b0 msgr2=0x7f6c1c0572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:58.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 shutdown_connections 2026-02-12T17:37:58.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.823+0000 7f6c2425b640 1 -- 10.20.193.57:0/3415729316 wait complete. 2026-02-12T17:37:58.851 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:37:58.851 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:37:58.852 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:37:58.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.920+0000 7f0e76812640 10 monclient: get_monmap_and_config 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.920+0000 7f0e76812640 10 monclient: build_initial_monmap 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.920+0000 7f0e76812640 10 monclient: monmap: 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:58.921488+0000 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:58.921488+0000 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:58.918 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:58.919 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:58.919 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 1 Processor -- start 2026-02-12T17:37:58.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 1 -- start start 2026-02-12T17:37:58.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 10 monclient: init 2026-02-12T17:37:58.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:58.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:37:58.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 10 monclient(hunting): picked mon.noname-c con 0x7f0e7008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:58.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 10 monclient(hunting): picked mon.noname-a con 0x7f0e7008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:58.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 10 monclient(hunting): picked mon.noname-b con 0x7f0e70182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:58.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e7008a820 con 0x7f0e7008c620 2026-02-12T17:37:58.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e70089450 con 0x7f0e7008c250 2026-02-12T17:37:58.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e70089730 con 0x7f0e70182cc0 2026-02-12T17:37:58.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:58.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e76812640 10 monclient(hunting): authenticate will time out at 1158.740372s 2026-02-12T17:37:58.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e6f7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f0e7008c620 0x7f0e7008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46578/0 (socket says 10.20.193.57:46578) 2026-02-12T17:37:58.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.921+0000 7f0e6f7fe640 1 -- 10.20.193.57:0/3975265290 learned_addr learned my addr 10.20.193.57:0/3975265290 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:58.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6f7fe640 1 -- 10.20.193.57:0/3975265290 >> v1:10.20.193.57:6789/0 conn(0x7f0e7008c620 legacy=0x7f0e7008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e74d88640 1 -- 10.20.193.57:0/3975265290 >> v1:10.20.193.57:6790/0 conn(0x7f0e70182cc0 legacy=0x7f0e701a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6ffff640 1 -- 10.20.193.57:0/3975265290 >> v1:10.20.193.82:6789/0 conn(0x7f0e7008c250 legacy=0x7f0e7008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1252429961 0 0) 0x7f0e60002c20 con 0x7f0e7008c620 2026-02-12T17:37:58.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): my global_id is 74145 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e540035e0 con 0x7f0e7008c620 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802632037 0 0) 0x7f0e70089730 con 0x7f0e70182cc0 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): my global_id is 64241 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e60002c20 con 0x7f0e70182cc0 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870560880 0 0) 0x7f0e70089450 con 0x7f0e7008c250 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient(hunting): my global_id is 4882 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e70089730 con 0x7f0e7008c250 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3204533835 0 0) 0x7f0e540035e0 con 0x7f0e7008c620 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 >> v1:10.20.193.57:6790/0 conn(0x7f0e70182cc0 legacy=0x7f0e701a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 >> v1:10.20.193.82:6789/0 conn(0x7f0e7008c250 legacy=0x7f0e7008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient: _finish_hunting 0 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 monclient: found mon.noname-a 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e70089a10 con 0x7f0e7008c620 2026-02-12T17:37:58.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient: _finish_auth 0 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient: _check_auth_tickets 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e600032e0 con 0x7f0e7008c620 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e6effd640 10 monclient: dump: 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.932 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e76812640 5 monclient: authenticate success, global_id 74145 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.923+0000 7f0e76812640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e60003530 con 0x7f0e7008c620 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e6effd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e6effd640 1 -- 10.20.193.57:0/3975265290 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e60004b40 con 0x7f0e7008c620 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e6effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:58.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e6effd640 10 monclient: dump: 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 4 set_mon_vals no callback set 2026-02-12T17:37:58.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 10 monclient: shutdown 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 1 -- 10.20.193.57:0/3975265290 >> v1:10.20.193.57:6789/0 conn(0x7f0e7008c620 legacy=0x7f0e7008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 1 -- 10.20.193.57:0/3975265290 shutdown_connections 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 1 -- 10.20.193.57:0/3975265290 >> 10.20.193.57:0/3975265290 conn(0x7f0e700916b0 msgr2=0x7f0e70091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 1 -- 10.20.193.57:0/3975265290 shutdown_connections 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 1 -- 10.20.193.57:0/3975265290 wait complete. 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 10 monclient: build_initial_monmap 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.924+0000 7f0e76812640 10 monclient: monmap: 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:58.935 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 1 Processor -- start 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 1 -- start start 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 10 monclient: init 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 10 monclient(hunting): picked mon.noname-a con 0x7f0e7008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:58.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 10 monclient(hunting): picked mon.noname-c con 0x7f0e7008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 10 monclient(hunting): picked mon.noname-b con 0x7f0e70182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e70088910 con 0x7f0e7008c250 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e70182ad0 con 0x7f0e70182cc0 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e7005c1f0 con 0x7f0e7008c620 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e76812640 10 monclient(hunting): authenticate will time out at 1158.744303s 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e6f7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0e7008c620 0x7f0e70181cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45708/0 (socket says 10.20.193.57:45708) 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e6ffff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f0e7008c250 0x7f0e70084c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46580/0 (socket says 10.20.193.57:46580) 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.925+0000 7f0e6f7fe640 1 -- 10.20.193.57:0/416436453 learned_addr learned my addr 10.20.193.57:0/416436453 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6f7fe640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6790/0 conn(0x7f0e7008c620 legacy=0x7f0e70181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6ffff640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6789/0 conn(0x7f0e7008c250 legacy=0x7f0e70084c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496749701 0 0) 0x7f0e7005c1f0 con 0x7f0e7008c620 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): my global_id is 64244 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e400035e0 con 0x7f0e7008c620 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647026431 0 0) 0x7f0e70089730 con 0x7f0e7008c250 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): my global_id is 74148 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e7005c1f0 con 0x7f0e7008c250 2026-02-12T17:37:58.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e74d88640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.82:6789/0 conn(0x7f0e70182cc0 legacy=0x7f0e701823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2985822826 0 0) 0x7f0e400035e0 con 0x7f0e7008c620 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e70089730 con 0x7f0e7008c620 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e600048a0 con 0x7f0e7008c620 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): dump: 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.939 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2029445331 0 0) 0x7f0e7005c1f0 con 0x7f0e7008c250 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e400035e0 con 0x7f0e7008c250 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e5c003360 con 0x7f0e7008c250 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): dump: 2026-02-12T17:37:58.940 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248783635 0 0) 0x7f0e70182ad0 con 0x7f0e70182cc0 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient(hunting): my global_id is 4885 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e7005c1f0 con 0x7f0e70182cc0 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1861403390 0 0) 0x7f0e70089730 con 0x7f0e7008c620 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.82:6789/0 conn(0x7f0e70182cc0 legacy=0x7f0e701823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6789/0 conn(0x7f0e7008c250 legacy=0x7f0e70084c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient: _finish_hunting 0 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 monclient: found mon.c 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7005dcb0 con 0x7f0e7008c620 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient: _finish_auth 0 2026-02-12T17:37:58.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient: _check_auth_tickets 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e76812640 5 monclient: authenticate success, global_id 64244 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e76812640 10 monclient: _renew_subs 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e76812640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7005df90 con 0x7f0e7008c620 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e76812640 10 monclient: _renew_subs 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e76812640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e7005cd50 con 0x7f0e7008c620 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e60003500 con 0x7f0e7008c620 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e600052d0 con 0x7f0e7008c620 2026-02-12T17:37:58.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6cff9640 10 monclient: dump: 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.927+0000 7f0e6e7fc640 4 set_mon_vals no callback set 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.928+0000 7f0e76812640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.928+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0e70090810 con 0x7f0e7018d340 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.928+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0e60011f40 con 0x7f0e7008c620 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.928+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(485..485 src has 202..485) ==== 3931+0+0 (unknown 2228139156 0 0) 0x7f0e6004eb20 con 0x7f0e7008c620 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.928+0000 7f0e74d88640 10 monclient: get_auth_request con 0x7f0e4003fd10 auth_method 0 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6ffff640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6790/0 conn(0x7f0e7018d340 legacy=0x7f0e7018d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2569349187 0 0) 0x7f0e70090810 con 0x7f0e7018d340 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 10 monclient(hunting): my global_id is 64247 2026-02-12T17:37:58.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e70089730 con 0x7f0e7018d340 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2224214563 0 0) 0x7f0e70089730 con 0x7f0e7018d340 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e70090810 con 0x7f0e7018d340 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e5c003a70 con 0x7f0e7018d340 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 10 monclient: dump: 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.946 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.930+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1730727364 0 0) 0x7f0e70090810 con 0x7f0e7018d340 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.931+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e7008f580 con 0x7f0e7018d340 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.931+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0e5c005880 con 0x7f0e7018d340 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.931+0000 7f0e6cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.931+0000 7f0e6cff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.931+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6790/0 conn(0x7f0e7018d340 legacy=0x7f0e7018d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.931+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6790/0 conn(0x7f0e7018d340 legacy=0x7f0e7018d710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:58.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.934+0000 7f0e76812640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:37:58.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.934+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0e70055340 con 0x7f0e7018de20 2026-02-12T17:37:58.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6ffff640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6790/0 conn(0x7f0e7018de20 legacy=0x7f0e70195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:58.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1807975121 0 0) 0x7f0e70055340 con 0x7f0e7018de20 2026-02-12T17:37:58.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:58.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:58.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:58.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 10 monclient(hunting): my global_id is 64250 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e70090810 con 0x7f0e7018de20 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 713447753 0 0) 0x7f0e70090810 con 0x7f0e7018de20 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e70055340 con 0x7f0e7018de20 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e5c004310 con 0x7f0e7018de20 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.936+0000 7f0e6cff9640 10 monclient: dump: 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:58.950 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 342724435 0 0) 0x7f0e70055340 con 0x7f0e7018de20 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0e7018e1f0 con 0x7f0e7018de20 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 4081243602) 0x7f0e5c005b80 con 0x7f0e7018de20 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e6cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e6cff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6790/0 conn(0x7f0e7018de20 legacy=0x7f0e70195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e6cff9640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6790/0 conn(0x7f0e7018de20 legacy=0x7f0e70195570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 40, 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 112406, 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 4, 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:58.952 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:58.953 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:58.954 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:37:58.955 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:58.956 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:37:58.957 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.958 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.959 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.960 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:37:58.961 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:37:58.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.82:6800/2441377515 conn(0x7f0e4003fd10 legacy=0x7f0e400601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e76812640 10 monclient: shutdown 2026-02-12T17:37:58.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e76812640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:58.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 >> v1:10.20.193.57:6790/0 conn(0x7f0e7008c620 legacy=0x7f0e70181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:58.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e74d88640 1 -- 10.20.193.57:0/416436453 reap_dead start 2026-02-12T17:37:58.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e74d88640 1 -- 10.20.193.57:0/416436453 reap_dead start 2026-02-12T17:37:58.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 shutdown_connections 2026-02-12T17:37:58.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 >> 10.20.193.57:0/416436453 conn(0x7f0e700916b0 msgr2=0x7f0e7008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:58.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 shutdown_connections 2026-02-12T17:37:58.963 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:58.937+0000 7f0e76812640 1 -- 10.20.193.57:0/416436453 wait complete. 2026-02-12T17:37:58.963 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:37:58.963 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:37:58.963 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:37:59.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.031+0000 7f41d810c640 10 monclient: get_monmap_and_config 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.031+0000 7f41d810c640 10 monclient: build_initial_monmap 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.031+0000 7f41d810c640 10 monclient: monmap: 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:59.032596+0000 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:59.032596+0000 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:59.029 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 1 Processor -- start 2026-02-12T17:37:59.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 1 -- start start 2026-02-12T17:37:59.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 10 monclient: init 2026-02-12T17:37:59.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:59.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 10 monclient(hunting): picked mon.noname-a con 0x7f41d008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 10 monclient(hunting): picked mon.noname-c con 0x7f41d008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 10 monclient(hunting): picked mon.noname-b con 0x7f41d0182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d008a820 con 0x7f41d008c250 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d0089450 con 0x7f41d008c620 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d0089730 con 0x7f41d0182cc0 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d810c640 10 monclient(hunting): authenticate will time out at 1158.851506s 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d5e81640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f41d008c250 0x7f41d008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46588/0 (socket says 10.20.193.57:46588) 2026-02-12T17:37:59.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.032+0000 7f41d5e81640 1 -- 10.20.193.57:0/1788531396 learned_addr learned my addr 10.20.193.57:0/1788531396 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:59.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d6682640 1 -- 10.20.193.57:0/1788531396 >> v1:10.20.193.57:6790/0 conn(0x7f41d0182cc0 legacy=0x7f41d01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d5e81640 1 -- 10.20.193.57:0/1788531396 >> v1:10.20.193.57:6789/0 conn(0x7f41d008c250 legacy=0x7f41d008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d5680640 1 -- 10.20.193.57:0/1788531396 >> v1:10.20.193.82:6789/0 conn(0x7f41d008c620 legacy=0x7f41d008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1883389139 0 0) 0x7f41d0089730 con 0x7f41d0182cc0 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 10 monclient(hunting): my global_id is 64253 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41b80035e0 con 0x7f41d0182cc0 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3734819266 0 0) 0x7f41c0002c20 con 0x7f41d008c250 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 10 monclient(hunting): my global_id is 74151 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.034+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d0089730 con 0x7f41d008c250 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 856387167 0 0) 0x7f41d0089450 con 0x7f41d008c620 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient(hunting): my global_id is 4888 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c0002c20 con 0x7f41d008c620 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3459320704 0 0) 0x7f41d0089730 con 0x7f41d008c250 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 >> v1:10.20.193.57:6790/0 conn(0x7f41d0182cc0 legacy=0x7f41d01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 >> v1:10.20.193.82:6789/0 conn(0x7f41d008c620 legacy=0x7f41d008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: _finish_hunting 0 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 monclient: found mon.noname-a 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:37:59.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d0089a10 con 0x7f41d008c250 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: _finish_auth 0 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: _check_auth_tickets 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f41c00032e0 con 0x7f41d008c250 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 5 monclient: authenticate success, global_id 74151 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: dump: 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.037 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41c00034b0 con 0x7f41d008c250 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 1 -- 10.20.193.57:0/1788531396 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f41c0004b10 con 0x7f41d008c250 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d4e7f640 10 monclient: dump: 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.038 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 4 set_mon_vals no callback set 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 10 monclient: shutdown 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 1 -- 10.20.193.57:0/1788531396 >> v1:10.20.193.57:6789/0 conn(0x7f41d008c250 legacy=0x7f41d008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 1 -- 10.20.193.57:0/1788531396 shutdown_connections 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 1 -- 10.20.193.57:0/1788531396 >> 10.20.193.57:0/1788531396 conn(0x7f41d00916b0 msgr2=0x7f41d0091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 1 -- 10.20.193.57:0/1788531396 shutdown_connections 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.035+0000 7f41d810c640 1 -- 10.20.193.57:0/1788531396 wait complete. 2026-02-12T17:37:59.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient: build_initial_monmap 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient: monmap: 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 1 Processor -- start 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 1 -- start start 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient: init 2026-02-12T17:37:59.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient(hunting): picked mon.noname-c con 0x7f41d008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient(hunting): picked mon.noname-b con 0x7f41d008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient(hunting): picked mon.noname-a con 0x7f41d0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d00869b0 con 0x7f41d0182cc0 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d013eae0 con 0x7f41d008c620 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d013e170 con 0x7f41d008c250 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d810c640 10 monclient(hunting): authenticate will time out at 1158.855567s 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d5e81640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f41d008c250 0x7f41d0085720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45736/0 (socket says 10.20.193.57:45736) 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d5e81640 1 -- 10.20.193.57:0/947631511 learned_addr learned my addr 10.20.193.57:0/947631511 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:59.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.036+0000 7f41d6682640 1 --1- 10.20.193.57:0/947631511 >> v1:10.20.193.57:6789/0 conn(0x7f41d0182cc0 0x7f41d0195340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46598/0 (socket says 10.20.193.57:46598) 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41d6682640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.57:6789/0 conn(0x7f41d0182cc0 legacy=0x7f41d0195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41d5e81640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.57:6790/0 conn(0x7f41d008c250 legacy=0x7f41d0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41d5680640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.82:6789/0 conn(0x7f41d008c620 legacy=0x7f41d0085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017904208 0 0) 0x7f41d00869b0 con 0x7f41d0182cc0 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): my global_id is 74154 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a00035e0 con 0x7f41d0182cc0 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 317556660 0 0) 0x7f41d013e170 con 0x7f41d008c250 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): my global_id is 64256 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d00869b0 con 0x7f41d008c250 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517321254 0 0) 0x7f41d013eae0 con 0x7f41d008c620 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 10 monclient(hunting): my global_id is 4891 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.038+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d013e170 con 0x7f41d008c620 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3893351922 0 0) 0x7f41a00035e0 con 0x7f41d0182cc0 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41d013eae0 con 0x7f41d0182cc0 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f41cc004470 con 0x7f41d0182cc0 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): dump: 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.048 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1600700175 0 0) 0x7f41d00869b0 con 0x7f41d008c250 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41a00035e0 con 0x7f41d008c250 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f41c00031f0 con 0x7f41d008c250 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): dump: 2026-02-12T17:37:59.049 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4023816754 0 0) 0x7f41d013e170 con 0x7f41d008c620 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41d00869b0 con 0x7f41d008c620 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f41c4003380 con 0x7f41d008c620 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:37:59.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient(hunting): dump: 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2667778494 0 0) 0x7f41d013eae0 con 0x7f41d0182cc0 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.57:6790/0 conn(0x7f41d008c250 legacy=0x7f41d0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.82:6789/0 conn(0x7f41d008c620 legacy=0x7f41d0085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 monclient: found mon.a 2026-02-12T17:37:59.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d013b1c0 con 0x7f41d0182cc0 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient: _finish_auth 0 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41d810c640 5 monclient: authenticate success, global_id 74154 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41d810c640 10 monclient: _renew_subs 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41d810c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41d005de80 con 0x7f41d0182cc0 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41d810c640 10 monclient: _renew_subs 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41d810c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f41d0086540 con 0x7f41d0182cc0 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41cc004610 con 0x7f41d0182cc0 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:59.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f41cc004c10 con 0x7f41d0182cc0 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41bffff640 4 set_mon_vals no callback set 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 10 monclient: dump: 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41d810c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:59.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41d0090810 con 0x7f41d005d140 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.039+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f41cc004ea0 con 0x7f41d0182cc0 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.040+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(485..485 src has 202..485) ==== 3931+0+0 (unknown 2228139156 0 0) 0x7f41cc04fc70 con 0x7f41d0182cc0 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.040+0000 7f41d5680640 10 monclient: get_auth_request con 0x7f41a003ffd0 auth_method 0 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41d5e81640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.82:6789/0 conn(0x7f41d005d140 legacy=0x7f41d00582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789592096 0 0) 0x7f41d0090810 con 0x7f41d005d140 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 10 monclient(hunting): my global_id is 4894 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d013eae0 con 0x7f41d005d140 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2171392876 0 0) 0x7f41d013eae0 con 0x7f41d005d140 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41d0090810 con 0x7f41d005d140 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f41c0005050 con 0x7f41d005d140 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:37:59.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 10 monclient: dump: 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 785059120 0 0) 0x7f41d0090810 con 0x7f41d005d140 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41d005d510 con 0x7f41d005d140 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f41c0005350 con 0x7f41d005d140 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:59.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.82:6789/0 conn(0x7f41d005d140 legacy=0x7f41d00582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.042+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.82:6789/0 conn(0x7f41d005d140 legacy=0x7f41d00582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.046+0000 7f41d810c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.046+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41d0055340 con 0x7f41d00589d0 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.048+0000 7f41d5e81640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.82:6789/0 conn(0x7f41d00589d0 legacy=0x7f41d0197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3464965789 0 0) 0x7f41d0055340 con 0x7f41d00589d0 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 10 monclient(hunting): my global_id is 4897 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d0090810 con 0x7f41d00589d0 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4040610415 0 0) 0x7f41d0090810 con 0x7f41d00589d0 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41d0055340 con 0x7f41d00589d0 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f41c00059d0 con 0x7f41d00589d0 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:59.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 10 monclient: dump: 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1175906371 0 0) 0x7f41d0055340 con 0x7f41d00589d0 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41d013ae20 con 0x7f41d00589d0 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 532780349) 0x7f41c0007e80 con 0x7f41d00589d0 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:37:59.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:59.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.82:6789/0 conn(0x7f41d00589d0 legacy=0x7f41d0197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41be7fc640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.82:6789/0 conn(0x7f41d00589d0 legacy=0x7f41d0197a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:37:59.058 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:37:59.058 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:37:59.058 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:37:59.058 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:37:59.058 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 40, 2026-02-12T17:37:59.058 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 600545, 2026-02-12T17:37:59.058 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 4, 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:59.059 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:59.060 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:37:59.061 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:37:59.062 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:59.063 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:59.064 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:59.065 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:59.066 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:37:59.067 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:37:59.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.82:6800/2441377515 conn(0x7f41a003ffd0 legacy=0x7f41a0060480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d810c640 10 monclient: shutdown 2026-02-12T17:37:59.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d810c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:59.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 >> v1:10.20.193.57:6789/0 conn(0x7f41d0182cc0 legacy=0x7f41d0195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d6682640 1 -- 10.20.193.57:0/947631511 reap_dead start 2026-02-12T17:37:59.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d6682640 1 -- 10.20.193.57:0/947631511 reap_dead start 2026-02-12T17:37:59.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 shutdown_connections 2026-02-12T17:37:59.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 >> 10.20.193.57:0/947631511 conn(0x7f41d00916b0 msgr2=0x7f41d008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:59.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 shutdown_connections 2026-02-12T17:37:59.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.049+0000 7f41d810c640 1 -- 10.20.193.57:0/947631511 wait complete. 2026-02-12T17:37:59.069 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:37:59.069 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-12T17:37:59.070 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T17:37:59.070 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-12T17:37:59.070 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-12T17:37:59.070 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T17:37:59.070 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:37:59.078 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T17:37:59.078 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:37:59.079 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:37:59.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient: get_monmap_and_config 2026-02-12T17:37:59.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient: build_initial_monmap 2026-02-12T17:37:59.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient: monmap: 2026-02-12T17:37:59.183 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:59.183 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.183 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:37:59.186900+0000 2026-02-12T17:37:59.184 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:37:59.186900+0000 2026-02-12T17:37:59.184 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:59.184 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.184 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:59.184 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:37:59.184 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:37:59.184 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 1 Processor -- start 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 1 -- start start 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient: init 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient(hunting): picked mon.noname-a con 0x7f1a2c08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient(hunting): picked mon.noname-c con 0x7f1a2c08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient(hunting): picked mon.noname-b con 0x7f1a2c08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c08d600 con 0x7f1a2c08ae20 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c08b1f0 con 0x7f1a2c08c730 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c08d1f0 con 0x7f1a2c08cb30 2026-02-12T17:37:59.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:59.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a3254c640 10 monclient(hunting): authenticate will time out at 1159.005767s 2026-02-12T17:37:59.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a30ac2640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f1a2c08cb30 legacy=0x7f1a2c1a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:37:59.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a2bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1a2c08ae20 0x7f1a2c08c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46620/0 (socket says 10.20.193.57:46620) 2026-02-12T17:37:59.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.186+0000 7f1a2bfff640 1 -- 10.20.193.57:0/4224333743 learned_addr learned my addr 10.20.193.57:0/4224333743 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:59.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.188+0000 7f1a2bfff640 1 -- 10.20.193.57:0/4224333743 >> v1:10.20.193.57:6789/0 conn(0x7f1a2c08ae20 legacy=0x7f1a2c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2b7fe640 1 -- 10.20.193.57:0/4224333743 >> v1:10.20.193.82:6789/0 conn(0x7f1a2c08c730 legacy=0x7f1a2c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 1 -- 10.20.193.57:0/4224333743 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393834113 0 0) 0x7f1a2c08b1f0 con 0x7f1a2c08c730 2026-02-12T17:37:59.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient(hunting): my global_id is 4900 2026-02-12T17:37:59.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 1 -- 10.20.193.57:0/4224333743 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a100035e0 con 0x7f1a2c08c730 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 1 -- 10.20.193.57:0/4224333743 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2066729897 0 0) 0x7f1a100035e0 con 0x7f1a2c08c730 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 1 -- 10.20.193.57:0/4224333743 >> v1:10.20.193.57:6790/0 conn(0x7f1a2c08cb30 legacy=0x7f1a2c1a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 1 -- 10.20.193.57:0/4224333743 >> v1:10.20.193.57:6789/0 conn(0x7f1a2c08ae20 legacy=0x7f1a2c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient: _finish_hunting 0 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 1 monclient: found mon.noname-c 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 1 -- 10.20.193.57:0/4224333743 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c057320 con 0x7f1a2c08c730 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient: _finish_auth 0 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient: _check_auth_tickets 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:59.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 1 -- 10.20.193.57:0/4224333743 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1a1c003120 con 0x7f1a2c08c730 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a2affd640 10 monclient: dump: 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.195 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a3254c640 5 monclient: authenticate success, global_id 4900 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.189+0000 7f1a3254c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a2affd640 1 -- 10.20.193.57:0/4224333743 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a1c0033b0 con 0x7f1a2c08c730 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a2affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a2affd640 1 -- 10.20.193.57:0/4224333743 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1a1c003550 con 0x7f1a2c08c730 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a2affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a2affd640 10 monclient: dump: 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.196 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 10 monclient: get_monmap_and_config success 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 4 set_mon_vals no callback set 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 10 monclient: shutdown 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:59.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 1 -- 10.20.193.57:0/4224333743 >> v1:10.20.193.82:6789/0 conn(0x7f1a2c08c730 legacy=0x7f1a2c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 1 -- 10.20.193.57:0/4224333743 shutdown_connections 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 1 -- 10.20.193.57:0/4224333743 >> 10.20.193.57:0/4224333743 conn(0x7f1a2c091620 msgr2=0x7f1a2c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 1 -- 10.20.193.57:0/4224333743 shutdown_connections 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 1 -- 10.20.193.57:0/4224333743 wait complete. 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 10 monclient: build_initial_monmap 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 10 monclient: monmap: 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:37:59.198 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 1 Processor -- start 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 1 -- start start 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.190+0000 7f1a3254c640 10 monclient: init 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 10 monclient: _reopen_session rank -1 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 10 monclient(hunting): picked mon.noname-b con 0x7f1a2c08ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 10 monclient(hunting): picked mon.noname-a con 0x7f1a2c08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 10 monclient(hunting): picked mon.noname-c con 0x7f1a2c08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:37:59.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c08d9c0 con 0x7f1a2c08c730 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c11c150 con 0x7f1a2c08ae20 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c05b120 con 0x7f1a2c08cb30 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 10 monclient(hunting): _renew_subs 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a3254c640 10 monclient(hunting): authenticate will time out at 1159.010160s 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a30ac2640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f1a2c08cb30 legacy=0x7f1a2c1a2c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a2b7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1a2c08c730 0x7f1a2c119380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46624/0 (socket says 10.20.193.57:46624) 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.191+0000 7f1a2b7fe640 1 -- 10.20.193.57:0/1968049369 learned_addr learned my addr 10.20.193.57:0/1968049369 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a2b7fe640 1 -- 10.20.193.57:0/1968049369 >> v1:10.20.193.57:6789/0 conn(0x7f1a2c08c730 legacy=0x7f1a2c119380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a2bfff640 1 -- 10.20.193.57:0/1968049369 >> v1:10.20.193.82:6789/0 conn(0x7f1a2c08ae20 legacy=0x7f1a2c118c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617762532 0 0) 0x7f1a2c11c150 con 0x7f1a2c08ae20 2026-02-12T17:37:59.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 10 monclient(hunting): my global_id is 4903 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19fc0035e0 con 0x7f1a2c08ae20 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 454324590 0 0) 0x7f19fc0035e0 con 0x7f1a2c08ae20 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a2c11c150 con 0x7f1a2c08ae20 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1a18003250 con 0x7f1a2c08ae20 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 10 monclient(hunting): dump: 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.201 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.193+0000 7f1a28ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1814729810 0 0) 0x7f1a2c11c150 con 0x7f1a2c08ae20 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 >> v1:10.20.193.57:6790/0 conn(0x7f1a2c08cb30 legacy=0x7f1a2c1a2c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 >> v1:10.20.193.57:6789/0 conn(0x7f1a2c08c730 legacy=0x7f1a2c119380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 1 monclient: found mon.b 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c088810 con 0x7f1a2c08ae20 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 10 monclient: _finish_auth 0 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 5 monclient: authenticate success, global_id 4903 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 10 monclient: _renew_subs 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c11c9f0 con 0x7f1a2c08ae20 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 10 monclient: _renew_subs 2026-02-12T17:37:59.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1a2c11a690 con 0x7f1a2c08ae20 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a18004b50 con 0x7f1a2c08ae20 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1a18004eb0 con 0x7f1a2c08ae20 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a2a7fc640 4 set_mon_vals no callback set 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a28ff9640 10 monclient: dump: 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.204 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.194+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2c0008d0 con 0x7f1a2c08ae20 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.195+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1a18005140 con 0x7f1a2c08ae20 2026-02-12T17:37:59.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.195+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(485..485 src has 202..485) ==== 3931+0+0 (unknown 2228139156 0 0) 0x7f1a1804eb00 con 0x7f1a2c08ae20 2026-02-12T17:37:59.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.195+0000 7f1a2b7fe640 10 monclient: get_auth_request con 0x7f19fc03f4e0 auth_method 0 2026-02-12T17:37:59.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.197+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f1a18017220 con 0x7f1a2c08ae20 2026-02-12T17:37:59.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.197+0000 7f1a28ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:37:59.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.197+0000 7f1a28ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:37:59.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.348+0000 7f1a3254c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:37:59.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.348+0000 7f1a3254c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:37:59.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.348+0000 7f1a3254c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:37:59.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.348+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1a2c08f520 con 0x7f1a2c08ae20 2026-02-12T17:37:59.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.349+0000 7f1a28ff9640 1 -- 10.20.193.57:0/1968049369 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2580802518) 0x7f1a1804b8f0 con 0x7f1a2c08ae20 2026-02-12T17:37:59.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.349+0000 7f1a28ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:37:59.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.349+0000 7f1a28ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:37:59.347 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:37:59.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.350+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 >> v1:10.20.193.82:6800/2441377515 conn(0x7f19fc03f4e0 legacy=0x7f19fc05f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.350+0000 7f1a3254c640 10 monclient: shutdown 2026-02-12T17:37:59.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.350+0000 7f1a3254c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:37:59.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.350+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 >> v1:10.20.193.82:6789/0 conn(0x7f1a2c08ae20 legacy=0x7f1a2c118c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:37:59.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.350+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 shutdown_connections 2026-02-12T17:37:59.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.350+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 >> 10.20.193.57:0/1968049369 conn(0x7f1a2c091620 msgr2=0x7f1a2c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:37:59.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.350+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 shutdown_connections 2026-02-12T17:37:59.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:37:59.350+0000 7f1a3254c640 1 -- 10.20.193.57:0/1968049369 wait complete. 2026-02-12T17:38:02.355 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:38:02.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.425+0000 7feb9961b640 10 monclient: get_monmap_and_config 2026-02-12T17:38:02.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.425+0000 7feb9961b640 10 monclient: build_initial_monmap 2026-02-12T17:38:02.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.425+0000 7feb9961b640 10 monclient: monmap: 2026-02-12T17:38:02.423 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:38:02.423 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:02.423 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:38:02.426540+0000 2026-02-12T17:38:02.423 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:38:02.426540+0000 2026-02-12T17:38:02.423 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:38:02.423 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:02.424 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:38:02.424 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:38:02.424 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:38:02.424 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:02.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 1 Processor -- start 2026-02-12T17:38:02.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 1 -- start start 2026-02-12T17:38:02.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 10 monclient: init 2026-02-12T17:38:02.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 10 monclient: _reopen_session rank -1 2026-02-12T17:38:02.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 10 monclient(hunting): picked mon.noname-c con 0x7feb9408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 10 monclient(hunting): picked mon.noname-a con 0x7feb9408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 10 monclient(hunting): picked mon.noname-b con 0x7feb9408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9408d600 con 0x7feb9408c730 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9408b1f0 con 0x7feb9408ae20 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9408d1f0 con 0x7feb9408cb30 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb9961b640 10 monclient(hunting): authenticate will time out at 1162.245486s 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb937fe640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7feb9408cb30 legacy=0x7feb941a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb927fc640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7feb9408c730 0x7feb94181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46636/0 (socket says 10.20.193.57:46636) 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb927fc640 1 -- 10.20.193.57:0/3982337444 learned_addr learned my addr 10.20.193.57:0/3982337444 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:38:02.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb927fc640 1 -- 10.20.193.57:0/3982337444 >> v1:10.20.193.57:6789/0 conn(0x7feb9408c730 legacy=0x7feb94181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb927fc640 1 -- 10.20.193.57:0/3982337444 >> v1:10.20.193.57:6789/0 conn(0x7feb9408c730 legacy=0x7feb94181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.426+0000 7feb927fc640 1 --1- 10.20.193.57:0/3982337444 >> v1:10.20.193.57:6789/0 conn(0x7feb9408c730 0x7feb94181be0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=2 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.428+0000 7feb92ffd640 1 -- 10.20.193.57:0/3982337444 >> v1:10.20.193.82:6789/0 conn(0x7feb9408ae20 legacy=0x7feb9408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.428+0000 7feb91ffb640 1 -- 10.20.193.57:0/3982337444 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1157859777 0 0) 0x7feb9408b1f0 con 0x7feb9408ae20 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.428+0000 7feb91ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.428+0000 7feb91ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.428+0000 7feb91ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.428+0000 7feb91ffb640 10 monclient(hunting): my global_id is 4906 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.428+0000 7feb91ffb640 1 -- 10.20.193.57:0/3982337444 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb800035e0 con 0x7feb9408ae20 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 1 -- 10.20.193.57:0/3982337444 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3580013530 0 0) 0x7feb800035e0 con 0x7feb9408ae20 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 1 -- 10.20.193.57:0/3982337444 >> v1:10.20.193.57:6790/0 conn(0x7feb9408cb30 legacy=0x7feb941a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:38:02.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 1 -- 10.20.193.57:0/3982337444 >> v1:10.20.193.57:6789/0 conn(0x7feb9408c730 legacy=0x7feb94181be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 1 monclient: found mon.noname-c 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 1 -- 10.20.193.57:0/3982337444 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb94057320 con 0x7feb9408ae20 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: _finish_auth 0 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 1 -- 10.20.193.57:0/3982337444 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feb88003120 con 0x7feb9408ae20 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 5 monclient: authenticate success, global_id 4906 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:02.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: dump: 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:38:02.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 1 -- 10.20.193.57:0/3982337444 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb880033b0 con 0x7feb9408ae20 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 1 -- 10.20.193.57:0/3982337444 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feb88003550 con 0x7feb9408ae20 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 10 monclient: get_monmap_and_config success 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 4 set_mon_vals no callback set 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb91ffb640 10 monclient: dump: 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:02.434 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 10 monclient: shutdown 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 1 -- 10.20.193.57:0/3982337444 >> v1:10.20.193.82:6789/0 conn(0x7feb9408ae20 legacy=0x7feb9408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 1 -- 10.20.193.57:0/3982337444 shutdown_connections 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 1 -- 10.20.193.57:0/3982337444 >> 10.20.193.57:0/3982337444 conn(0x7feb94091620 msgr2=0x7feb94091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 1 -- 10.20.193.57:0/3982337444 shutdown_connections 2026-02-12T17:38:02.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.429+0000 7feb9961b640 1 -- 10.20.193.57:0/3982337444 wait complete. 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 10 monclient: build_initial_monmap 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 10 monclient: monmap: 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:38:02.436 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 1 Processor -- start 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 1 -- start start 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 10 monclient: init 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 10 monclient: _reopen_session rank -1 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 10 monclient(hunting): picked mon.noname-b con 0x7feb9408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 10 monclient(hunting): picked mon.noname-a con 0x7feb9408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.430+0000 7feb9961b640 10 monclient(hunting): picked mon.noname-c con 0x7feb9408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.431+0000 7feb9961b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9408d9c0 con 0x7feb9408c730 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.431+0000 7feb9961b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9405af20 con 0x7feb9408ae20 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.431+0000 7feb9961b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9411a880 con 0x7feb9408cb30 2026-02-12T17:38:02.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.431+0000 7feb9961b640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:02.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.431+0000 7feb9961b640 10 monclient(hunting): authenticate will time out at 1162.250019s 2026-02-12T17:38:02.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.431+0000 7feb937fe640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7feb9408cb30 legacy=0x7feb941a2c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:02.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.431+0000 7feb927fc640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7feb9408c730 0x7feb94119890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46642/0 (socket says 10.20.193.57:46642) 2026-02-12T17:38:02.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.431+0000 7feb927fc640 1 -- 10.20.193.57:0/3093544273 learned_addr learned my addr 10.20.193.57:0/3093544273 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:38:02.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.433+0000 7feb927fc640 1 -- 10.20.193.57:0/3093544273 >> v1:10.20.193.57:6789/0 conn(0x7feb9408c730 legacy=0x7feb94119890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:02.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.433+0000 7feb92ffd640 1 -- 10.20.193.57:0/3093544273 >> v1:10.20.193.82:6789/0 conn(0x7feb9408ae20 legacy=0x7feb94119180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:02.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.433+0000 7feb92ffd640 1 --1- 10.20.193.57:0/3093544273 >> v1:10.20.193.82:6789/0 conn(0x7feb9408ae20 0x7feb94119180 :-1 s=OPENED pgs=486 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7feb9405af20 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:38:02.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:02.632+0000 7feb937fe640 1 -- 10.20.193.57:0/3093544273 >> v1:10.20.193.57:6790/0 conn(0x7feb9408cb30 legacy=0x7feb941a2c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:03.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.033+0000 7feb937fe640 1 -- 10.20.193.57:0/3093544273 >> v1:10.20.193.57:6790/0 conn(0x7feb9408cb30 legacy=0x7feb941a2c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:03.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001348043 0 0) 0x7feb9405af20 con 0x7feb9408ae20 2026-02-12T17:38:03.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient(hunting): _negotiate 2026-02-12T17:38:03.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:03.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:03.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient(hunting): my global_id is 4909 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb600035e0 con 0x7feb9408ae20 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2712906460 0 0) 0x7feb600035e0 con 0x7feb9408ae20 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb9405af20 con 0x7feb9408ae20 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feb88002b20 con 0x7feb9408ae20 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient(hunting): dump: 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:03.057 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 825812609 0 0) 0x7feb9405af20 con 0x7feb9408ae20 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 >> v1:10.20.193.57:6790/0 conn(0x7feb9408cb30 legacy=0x7feb941a2c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 >> v1:10.20.193.57:6789/0 conn(0x7feb9408c730 legacy=0x7feb94119890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient: _finish_hunting 0 2026-02-12T17:38:03.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 monclient: found mon.b 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb94088810 con 0x7feb9408ae20 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient: _finish_auth 0 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient: _check_auth_tickets 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb9961b640 5 monclient: authenticate success, global_id 4909 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb9961b640 10 monclient: _renew_subs 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb9961b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb9411cbe0 con 0x7feb9408ae20 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb9961b640 10 monclient: _renew_subs 2026-02-12T17:38:03.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb9961b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feb9411c3f0 con 0x7feb9408ae20 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb88003c50 con 0x7feb9408ae20 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feb88003fb0 con 0x7feb9408ae20 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb737fe640 10 monclient: dump: 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:03.060 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.057+0000 7feb917fa640 4 set_mon_vals no callback set 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.058+0000 7feb9961b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.058+0000 7feb9961b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.058+0000 7feb9961b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.058+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb940008d0 con 0x7feb9408ae20 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.058+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7feb88004240 con 0x7feb9408ae20 2026-02-12T17:38:03.061 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.058+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(485..485 src has 202..485) ==== 3931+0+0 (unknown 2228139156 0 0) 0x7feb8804ecc0 con 0x7feb9408ae20 2026-02-12T17:38:03.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.058+0000 7feb927fc640 10 monclient: get_auth_request con 0x7feb6003f590 auth_method 0 2026-02-12T17:38:03.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.061+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7feb880173e0 con 0x7feb9408ae20 2026-02-12T17:38:03.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.061+0000 7feb737fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:03.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.061+0000 7feb737fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:38:03.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.205+0000 7feb9961b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:38:03.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.205+0000 7feb9961b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:38:03.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.205+0000 7feb9961b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:38:03.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.205+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feb9408f500 con 0x7feb9408ae20 2026-02-12T17:38:03.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.205+0000 7feb737fe640 1 -- 10.20.193.57:0/3093544273 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 1453234779) 0x7feb88016b90 con 0x7feb9408ae20 2026-02-12T17:38:03.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.205+0000 7feb737fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:38:03.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.205+0000 7feb737fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:38:03.203 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":40,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":8,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:38:03.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.206+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 >> v1:10.20.193.82:6800/2441377515 conn(0x7feb6003f590 legacy=0x7feb6005fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:03.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.206+0000 7feb9961b640 10 monclient: shutdown 2026-02-12T17:38:03.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.206+0000 7feb9961b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:38:03.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.206+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 >> v1:10.20.193.82:6789/0 conn(0x7feb9408ae20 legacy=0x7feb94119180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:03.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.206+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 shutdown_connections 2026-02-12T17:38:03.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.206+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 >> 10.20.193.57:0/3093544273 conn(0x7feb94091620 msgr2=0x7feb940597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:38:03.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.206+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 shutdown_connections 2026-02-12T17:38:03.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:03.206+0000 7feb9961b640 1 -- 10.20.193.57:0/3093544273 wait complete. 2026-02-12T17:38:06.212 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:38:06.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.281+0000 7f28d261b640 10 monclient: get_monmap_and_config 2026-02-12T17:38:06.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.281+0000 7f28d261b640 10 monclient: build_initial_monmap 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.281+0000 7f28d261b640 10 monclient: monmap: 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:38:06.282691+0000 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:38:06.282691+0000 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:38:06.281 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 1 Processor -- start 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 1 -- start start 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 10 monclient: init 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 10 monclient: _reopen_session rank -1 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 10 monclient(hunting): picked mon.noname-a con 0x7f28cc08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 10 monclient(hunting): picked mon.noname-c con 0x7f28cc08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 10 monclient(hunting): picked mon.noname-b con 0x7f28cc08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc08d600 con 0x7f28cc08ae20 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc08b1f0 con 0x7f28cc08c730 2026-02-12T17:38:06.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc08d1f0 con 0x7f28cc08cb30 2026-02-12T17:38:06.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:06.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d261b640 10 monclient(hunting): authenticate will time out at 1166.101570s 2026-02-12T17:38:06.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28d0b91640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28cc1a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:06.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28cbfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f28cc08ae20 0x7f28cc08c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:48280/0 (socket says 10.20.193.57:48280) 2026-02-12T17:38:06.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.282+0000 7f28cbfff640 1 -- 10.20.193.57:0/142679701 learned_addr learned my addr 10.20.193.57:0/142679701 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:38:06.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.284+0000 7f28cbfff640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6789/0 conn(0x7f28cc08ae20 legacy=0x7f28cc08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:06.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.285+0000 7f28cb7fe640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.82:6789/0 conn(0x7f28cc08c730 legacy=0x7f28cc181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:06.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.483+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28cc1a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:06.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:06.884+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28cc1a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:07.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:07.685+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28cc1a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:09.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 10 monclient(hunting): tick 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 1 monclient(hunting): continuing hunt 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28cc1a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.82:6789/0 conn(0x7f28cc08c730 legacy=0x7f28cc181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6789/0 conn(0x7f28cc08ae20 legacy=0x7f28cc08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f28cc08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f28cc08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f28cc08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:09.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc057320 con 0x7f28cc08ae20 2026-02-12T17:38:09.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc08d1f0 con 0x7f28cc08c730 2026-02-12T17:38:09.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28a8066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:09.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a806a0a0 con 0x7f28cc08cb30 2026-02-12T17:38:09.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.283+0000 7f28c9ffb640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:09.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.284+0000 7f28cb7fe640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6789/0 conn(0x7f28cc08ae20 legacy=0x7f28a8045080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:09.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.285+0000 7f28cbfff640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.82:6789/0 conn(0x7f28cc08c730 legacy=0x7f28a80238a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:09.482 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.485+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28a8066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:09.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:09.886+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28a8066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:10.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:10.687+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28a8066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:12.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 10 monclient(hunting): tick 2026-02-12T17:38:12.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:38:12.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 1 monclient(hunting): continuing hunt 2026-02-12T17:38:12.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:38:12.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28a8066880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:38:12.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.82:6789/0 conn(0x7f28cc08c730 legacy=0x7f28a80238a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:12.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6789/0 conn(0x7f28cc08ae20 legacy=0x7f28a8045080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:12.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:38:12.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f28a806a3e0 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:12.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f28cc08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:12.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f28cc08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:12.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a806b3c0 con 0x7f28cc08ae20 2026-02-12T17:38:12.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a806a0a0 con 0x7f28a806a3e0 2026-02-12T17:38:12.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 1 -- 10.20.193.57:0/142679701 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a80450e0 con 0x7f28cc08cb30 2026-02-12T17:38:12.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28c9ffb640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:12.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.283+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28a8066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:12.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.285+0000 7f28cb7fe640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6789/0 conn(0x7f28cc08ae20 legacy=0x7f28a80457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:12.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.285+0000 7f28cbfff640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.82:6789/0 conn(0x7f28a806a3e0 legacy=0x7f28a806a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:12.481 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.484+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28a8066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:12.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:12.885+0000 7f28d0b91640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28a8066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 -- 10.20.193.57:0/142679701 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688005597 0 0) 0x7f28a806b3c0 con 0x7f28cc08ae20 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient(hunting): my global_id is 74157 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 -- 10.20.193.57:0/142679701 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b00035e0 con 0x7f28cc08ae20 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 -- 10.20.193.57:0/142679701 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2940402793 0 0) 0x7f28b00035e0 con 0x7f28cc08ae20 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28a8066880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.82:6789/0 conn(0x7f28a806a3e0 legacy=0x7f28a806a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: _finish_hunting 0 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 monclient: found mon.noname-a 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 -- 10.20.193.57:0/142679701 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a8045270 con 0x7f28cc08ae20 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: _finish_auth 0 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: _check_auth_tickets 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 -- 10.20.193.57:0/142679701 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f28bc003070 con 0x7f28cc08ae20 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: dump: 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.100 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28d261b640 5 monclient: authenticate success, global_id 74157 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28d261b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 -- 10.20.193.57:0/142679701 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28bc0032f0 con 0x7f28cc08ae20 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 1 -- 10.20.193.57:0/142679701 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f28bc0036d0 con 0x7f28cc08ae20 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28caffd640 10 monclient: dump: 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28d261b640 10 monclient: get_monmap_and_config success 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.102+0000 7f28d261b640 4 set_mon_vals no callback set 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.103+0000 7f28d261b640 10 monclient: shutdown 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.103+0000 7f28d261b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.103+0000 7f28d261b640 1 -- 10.20.193.57:0/142679701 >> v1:10.20.193.57:6789/0 conn(0x7f28cc08ae20 legacy=0x7f28a80457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.103+0000 7f28d261b640 1 -- 10.20.193.57:0/142679701 shutdown_connections 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.103+0000 7f28d261b640 1 -- 10.20.193.57:0/142679701 >> 10.20.193.57:0/142679701 conn(0x7f28cc091620 msgr2=0x7f28cc091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.103+0000 7f28d261b640 1 -- 10.20.193.57:0/142679701 shutdown_connections 2026-02-12T17:38:13.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.103+0000 7f28d261b640 1 -- 10.20.193.57:0/142679701 wait complete. 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.103+0000 7f28d261b640 10 monclient: build_initial_monmap 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.103+0000 7f28d261b640 10 monclient: monmap: 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 1 Processor -- start 2026-02-12T17:38:13.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 1 -- start start 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 10 monclient: init 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 10 monclient: _reopen_session rank -1 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 10 monclient(hunting): picked mon.noname-a con 0x7f28a806a3e0 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 10 monclient(hunting): picked mon.noname-b con 0x7f28cc08ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 10 monclient(hunting): picked mon.noname-c con 0x7f28cc08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc08d9c0 con 0x7f28a806a3e0 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc13f800 con 0x7f28cc08ae20 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28cc05d360 con 0x7f28cc08cb30 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d261b640 10 monclient(hunting): authenticate will time out at 1172.923501s 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28d0b91640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28cc239ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28cbfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f28a806a3e0 0x7f28cc1d7bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36338/0 (socket says 10.20.193.57:36338) 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.104+0000 7f28cbfff640 1 -- 10.20.193.57:0/4152342957 learned_addr learned my addr 10.20.193.57:0/4152342957 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28cbfff640 1 -- 10.20.193.57:0/4152342957 >> v1:10.20.193.57:6789/0 conn(0x7f28a806a3e0 legacy=0x7f28cc1d7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546201093 0 0) 0x7f28cc08d9c0 con 0x7f28a806a3e0 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 10 monclient(hunting): my global_id is 74160 2026-02-12T17:38:13.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f289c0035e0 con 0x7f28a806a3e0 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2705091370 0 0) 0x7f289c0035e0 con 0x7f28a806a3e0 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28cc08d9c0 con 0x7f28a806a3e0 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f28b8003180 con 0x7f28a806a3e0 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 10 monclient(hunting): dump: 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.106+0000 7f28c8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2432914953 0 0) 0x7f28cc08d9c0 con 0x7f28a806a3e0 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 >> v1:10.20.193.57:6790/0 conn(0x7f28cc08cb30 legacy=0x7f28cc239ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 >> v1:10.20.193.82:6789/0 conn(0x7f28cc08ae20 legacy=0x7f28cc1d82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 1 monclient: found mon.a 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28cc088810 con 0x7f28a806a3e0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 10 monclient: _finish_auth 0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 5 monclient: authenticate success, global_id 74160 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 10 monclient: _renew_subs 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28cc13d4a0 con 0x7f28a806a3e0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 10 monclient: _renew_subs 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f28cc13e1a0 con 0x7f28a806a3e0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28b80034d0 con 0x7f28a806a3e0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f28b8004d00 con 0x7f28a806a3e0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 10 monclient: dump: 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28ca7fc640 4 set_mon_vals no callback set 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f28b8004ea0 con 0x7f28a806a3e0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28cc0008d0 con 0x7f28a806a3e0 2026-02-12T17:38:13.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.107+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(486..486 src has 202..486) ==== 3931+0+0 (unknown 2922470996 0 0) 0x7f28b804ea80 con 0x7f28a806a3e0 2026-02-12T17:38:13.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.108+0000 7f28cb7fe640 10 monclient: get_auth_request con 0x7f289c03f5f0 auth_method 0 2026-02-12T17:38:13.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.110+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f28b8005760 con 0x7f28a806a3e0 2026-02-12T17:38:13.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.110+0000 7f28c8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:13.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.110+0000 7f28c8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:38:13.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.254+0000 7f28d261b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:38:13.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.254+0000 7f28d261b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:38:13.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.254+0000 7f28d261b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.254+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f28cc08f520 con 0x7f28a806a3e0 2026-02-12T17:38:13.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.254+0000 7f28c8ff9640 1 -- 10.20.193.57:0/4152342957 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 3163791953) 0x7f28b8016950 con 0x7f28a806a3e0 2026-02-12T17:38:13.251 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.254+0000 7f28c8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:38:13.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.254+0000 7f28c8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:38:13.252 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":44,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:38:13.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.256+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 >> v1:10.20.193.82:6800/2441377515 conn(0x7f289c03f5f0 legacy=0x7f289c05faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.256+0000 7f28d261b640 10 monclient: shutdown 2026-02-12T17:38:13.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.256+0000 7f28d261b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:38:13.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.256+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 >> v1:10.20.193.57:6789/0 conn(0x7f28a806a3e0 legacy=0x7f28cc1d7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.256+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 shutdown_connections 2026-02-12T17:38:13.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.256+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 >> 10.20.193.57:0/4152342957 conn(0x7f28cc091620 msgr2=0x7f28cc087fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:38:13.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.256+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 shutdown_connections 2026-02-12T17:38:13.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.256+0000 7f28d261b640 1 -- 10.20.193.57:0/4152342957 wait complete. 2026-02-12T17:38:13.261 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:38:13.261 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-12T17:38:13.261 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.329+0000 7f046850c640 10 monclient: get_monmap_and_config 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.329+0000 7f046850c640 10 monclient: build_initial_monmap 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.329+0000 7f046850c640 10 monclient: monmap: 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:38:13.330312+0000 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:38:13.330312+0000 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:38:13.326 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.329+0000 7f046850c640 1 Processor -- start 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.329+0000 7f046850c640 1 -- start start 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.329+0000 7f046850c640 10 monclient: init 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 10 monclient: _reopen_session rank -1 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 10 monclient(hunting): picked mon.noname-a con 0x7f046008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 10 monclient(hunting): picked mon.noname-c con 0x7f046008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 10 monclient(hunting): picked mon.noname-b con 0x7f0460182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046008a820 con 0x7f046008c250 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0460089450 con 0x7f046008c620 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0460089730 con 0x7f0460182cc0 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f046850c640 10 monclient(hunting): authenticate will time out at 1173.149246s 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f0466a82640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f0460182cc0 legacy=0x7f04601a30a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f0466281640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f046008c250 0x7f046008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36352/0 (socket says 10.20.193.57:36352) 2026-02-12T17:38:13.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.330+0000 7f0466281640 1 -- 10.20.193.57:0/3599886232 learned_addr learned my addr 10.20.193.57:0/3599886232 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:38:13.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f0466281640 1 -- 10.20.193.57:0/3599886232 >> v1:10.20.193.57:6789/0 conn(0x7f046008c250 legacy=0x7f046008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 -- 10.20.193.57:0/3599886232 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1971584067 0 0) 0x7f0450002c20 con 0x7f046008c250 2026-02-12T17:38:13.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient(hunting): my global_id is 74163 2026-02-12T17:38:13.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f0465a80640 1 -- 10.20.193.57:0/3599886232 >> v1:10.20.193.82:6789/0 conn(0x7f046008c620 legacy=0x7f046008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 -- 10.20.193.57:0/3599886232 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04480035e0 con 0x7f046008c250 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 -- 10.20.193.57:0/3599886232 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 706964103 0 0) 0x7f04480035e0 con 0x7f046008c250 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 -- 10.20.193.57:0/3599886232 >> v1:10.20.193.57:6790/0 conn(0x7f0460182cc0 legacy=0x7f04601a30a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 -- 10.20.193.57:0/3599886232 >> v1:10.20.193.82:6789/0 conn(0x7f046008c620 legacy=0x7f046008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: _finish_hunting 0 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 monclient: found mon.noname-a 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 -- 10.20.193.57:0/3599886232 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0460089a10 con 0x7f046008c250 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: _finish_auth 0 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: _check_auth_tickets 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 -- 10.20.193.57:0/3599886232 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0450003260 con 0x7f046008c250 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: dump: 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046850c640 5 monclient: authenticate success, global_id 74163 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046850c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:38:13.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 -- 10.20.193.57:0/3599886232 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0450004960 con 0x7f046008c250 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 1 -- 10.20.193.57:0/3599886232 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0450004cb0 con 0x7f046008c250 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046850c640 10 monclient: get_monmap_and_config success 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046850c640 4 set_mon_vals no callback set 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.332+0000 7f046527f640 10 monclient: dump: 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.333+0000 7f046850c640 10 monclient: shutdown 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.333+0000 7f046850c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.333+0000 7f046850c640 1 -- 10.20.193.57:0/3599886232 >> v1:10.20.193.57:6789/0 conn(0x7f046008c250 legacy=0x7f046008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.333+0000 7f046850c640 1 -- 10.20.193.57:0/3599886232 shutdown_connections 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.333+0000 7f046850c640 1 -- 10.20.193.57:0/3599886232 >> 10.20.193.57:0/3599886232 conn(0x7f04600916b0 msgr2=0x7f0460091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.333+0000 7f046850c640 1 -- 10.20.193.57:0/3599886232 shutdown_connections 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.333+0000 7f046850c640 1 -- 10.20.193.57:0/3599886232 wait complete. 2026-02-12T17:38:13.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.333+0000 7f046850c640 10 monclient: build_initial_monmap 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.333+0000 7f046850c640 10 monclient: monmap: 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 1 Processor -- start 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 1 -- start start 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 10 monclient: init 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 10 monclient: _reopen_session rank -1 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 10 monclient(hunting): picked mon.noname-a con 0x7f046008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 10 monclient(hunting): picked mon.noname-b con 0x7f046008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 10 monclient(hunting): picked mon.noname-c con 0x7f0460182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046005c490 con 0x7f046008c250 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046005df60 con 0x7f046008c620 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046005caa0 con 0x7f0460182cc0 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f046850c640 10 monclient(hunting): authenticate will time out at 1173.153438s 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f0466a82640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f0460182cc0 legacy=0x7f0460193500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f0466281640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f046008c250 0x7f046005a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36364/0 (socket says 10.20.193.57:36364) 2026-02-12T17:38:13.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.334+0000 7f0466281640 1 -- 10.20.193.57:0/227931725 learned_addr learned my addr 10.20.193.57:0/227931725 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:38:13.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0466281640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.57:6789/0 conn(0x7f046008c250 legacy=0x7f046005a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947770467 0 0) 0x7f046005c490 con 0x7f046008c250 2026-02-12T17:38:13.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 10 monclient(hunting): my global_id is 74166 2026-02-12T17:38:13.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04300035e0 con 0x7f046008c250 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2533113088 0 0) 0x7f04300035e0 con 0x7f046008c250 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f046005c490 con 0x7f046008c250 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0450004ad0 con 0x7f046008c250 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 10 monclient(hunting): dump: 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0446ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.336+0000 7f0465a80640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.82:6789/0 conn(0x7f046008c620 legacy=0x7f046005aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1835783129 0 0) 0x7f046005c490 con 0x7f046008c250 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.57:6790/0 conn(0x7f0460182cc0 legacy=0x7f0460193500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:38:13.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.82:6789/0 conn(0x7f046008c620 legacy=0x7f046005aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 1 monclient: found mon.a 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046005b600 con 0x7f046008c250 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 10 monclient: _finish_auth 0 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f046850c640 5 monclient: authenticate success, global_id 74166 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f046850c640 10 monclient: _renew_subs 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f046850c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f046005c660 con 0x7f046008c250 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f046850c640 10 monclient: _renew_subs 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f046850c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f04600888a0 con 0x7f046008c250 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0450002f00 con 0x7f046008c250 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0450005190 con 0x7f046008c250 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 10 monclient: dump: 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0464a7e640 4 set_mon_vals no callback set 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f046850c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0460085180 con 0x7f0460084db0 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0450011e00 con 0x7f046008c250 2026-02-12T17:38:13.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.337+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(486..486 src has 202..486) ==== 3931+0+0 (unknown 2922470996 0 0) 0x7f045004ec70 con 0x7f046008c250 2026-02-12T17:38:13.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.338+0000 7f0466a82640 10 monclient: get_auth_request con 0x7f043003f680 auth_method 0 2026-02-12T17:38:13.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.339+0000 7f0465a80640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.57:6789/0 conn(0x7f0460084db0 legacy=0x7f046018d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.339+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3527290900 0 0) 0x7f0460085180 con 0x7f0460084db0 2026-02-12T17:38:13.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.339+0000 7f0446ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.339+0000 7f0446ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.339+0000 7f0446ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.339+0000 7f0446ffd640 10 monclient(hunting): my global_id is 74169 2026-02-12T17:38:13.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.339+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f046005c490 con 0x7f0460084db0 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2786047448 0 0) 0x7f046005c490 con 0x7f0460084db0 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0460085180 con 0x7f0460084db0 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f04540031a0 con 0x7f0460084db0 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 10 monclient: dump: 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3027201802 0 0) 0x7f0460085180 con 0x7f0460084db0 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0460090810 con 0x7f0460084db0 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0454005880 con 0x7f0460084db0 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.57:6789/0 conn(0x7f0460084db0 legacy=0x7f046018d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.340+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.57:6789/0 conn(0x7f0460084db0 legacy=0x7f046018d340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:38:13.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.343+0000 7f046850c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:38:13.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.343+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f046008a820 con 0x7f046018da50 2026-02-12T17:38:13.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.345+0000 7f0465a80640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.57:6789/0 conn(0x7f046018da50 legacy=0x7f0460195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690532208 0 0) 0x7f046005df60 con 0x7f046018da50 2026-02-12T17:38:13.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 10 monclient(hunting): my global_id is 74172 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0460085180 con 0x7f046018da50 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2520060083 0 0) 0x7f0460085180 con 0x7f046018da50 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f046005df60 con 0x7f046018da50 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0454003bb0 con 0x7f046018da50 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 10 monclient: dump: 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 364673529 0 0) 0x7f046005df60 con 0x7f046018da50 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f046013e650 con 0x7f046018da50 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4493 (unknown 0 0 3627911658) 0x7f0454005ac0 con 0x7f046018da50 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.57:6789/0 conn(0x7f046018da50 legacy=0x7f0460195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0446ffd640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.57:6789/0 conn(0x7f046018da50 legacy=0x7f0460195c30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:38:13.343 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 44, 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 19809, 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:38:13.344 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:38:13.345 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:38:13.346 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.82:6800/2441377515 conn(0x7f043003f680 legacy=0x7f043005fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f046850c640 10 monclient: shutdown 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f046850c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:38:13.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 >> v1:10.20.193.57:6789/0 conn(0x7f046008c250 legacy=0x7f046005a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0466a82640 1 -- 10.20.193.57:0/227931725 reap_dead start 2026-02-12T17:38:13.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f0466a82640 1 -- 10.20.193.57:0/227931725 reap_dead start 2026-02-12T17:38:13.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 shutdown_connections 2026-02-12T17:38:13.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 >> 10.20.193.57:0/227931725 conn(0x7f04600916b0 msgr2=0x7f046008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:38:13.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 shutdown_connections 2026-02-12T17:38:13.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.346+0000 7f046850c640 1 -- 10.20.193.57:0/227931725 wait complete. 2026-02-12T17:38:13.348 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:38:13.348 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:38:13.348 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient: get_monmap_and_config 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient: build_initial_monmap 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient: monmap: 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:38:13.417083+0000 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:38:13.417083+0000 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:38:13.413 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 1 Processor -- start 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 1 -- start start 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient: init 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient(hunting): picked mon.noname-c con 0x7efc2408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient(hunting): picked mon.noname-a con 0x7efc2408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient(hunting): picked mon.noname-b con 0x7efc24182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2408a820 con 0x7efc2408c620 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc24089450 con 0x7efc2408c250 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc24089730 con 0x7efc24182cc0 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc29e5b640 10 monclient(hunting): authenticate will time out at 1173.235950s 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.416+0000 7efc23fff640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7efc24182cc0 legacy=0x7efc241a30a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.417+0000 7efc237fe640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7efc2408c250 0x7efc2408a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:51782/0 (socket says 10.20.193.57:51782) 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.417+0000 7efc237fe640 1 -- 10.20.193.57:0/2624849421 learned_addr learned my addr 10.20.193.57:0/2624849421 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:38:13.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.417+0000 7efc22ffd640 1 --1- 10.20.193.57:0/2624849421 >> v1:10.20.193.57:6789/0 conn(0x7efc2408c620 0x7efc2408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36402/0 (socket says 10.20.193.57:36402) 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc22ffd640 1 -- 10.20.193.57:0/2624849421 >> v1:10.20.193.57:6789/0 conn(0x7efc2408c620 legacy=0x7efc2408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc237fe640 1 -- 10.20.193.57:0/2624849421 >> v1:10.20.193.82:6789/0 conn(0x7efc2408c250 legacy=0x7efc2408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035859279 0 0) 0x7efc24089450 con 0x7efc2408c250 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient(hunting): my global_id is 4918 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc080035e0 con 0x7efc2408c250 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993011157 0 0) 0x7efc14002c20 con 0x7efc2408c620 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient(hunting): my global_id is 74175 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc24089450 con 0x7efc2408c620 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1227889126 0 0) 0x7efc080035e0 con 0x7efc2408c250 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 >> v1:10.20.193.57:6790/0 conn(0x7efc24182cc0 legacy=0x7efc241a30a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 >> v1:10.20.193.57:6789/0 conn(0x7efc2408c620 legacy=0x7efc2408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: _finish_hunting 0 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 monclient: found mon.noname-c 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc24089a10 con 0x7efc2408c250 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: _finish_auth 0 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: _check_auth_tickets 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc100030d0 con 0x7efc2408c250 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: dump: 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc29e5b640 5 monclient: authenticate success, global_id 4918 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc29e5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc100033d0 con 0x7efc2408c250 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 1 -- 10.20.193.57:0/2624849421 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc10004b10 con 0x7efc2408c250 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc227fc640 10 monclient: dump: 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.417 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc29e5b640 10 monclient: get_monmap_and_config success 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.419+0000 7efc29e5b640 4 set_mon_vals no callback set 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 10 monclient: shutdown 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 1 -- 10.20.193.57:0/2624849421 >> v1:10.20.193.82:6789/0 conn(0x7efc2408c250 legacy=0x7efc2408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 1 -- 10.20.193.57:0/2624849421 shutdown_connections 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 1 -- 10.20.193.57:0/2624849421 >> 10.20.193.57:0/2624849421 conn(0x7efc240916b0 msgr2=0x7efc24091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 1 -- 10.20.193.57:0/2624849421 shutdown_connections 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 1 -- 10.20.193.57:0/2624849421 wait complete. 2026-02-12T17:38:13.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 10 monclient: build_initial_monmap 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 10 monclient: monmap: 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 1 Processor -- start 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 1 -- start start 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 10 monclient: init 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.420+0000 7efc29e5b640 10 monclient(hunting): picked mon.noname-c con 0x7efc2408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc29e5b640 10 monclient(hunting): picked mon.noname-b con 0x7efc2408c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc29e5b640 10 monclient(hunting): picked mon.noname-a con 0x7efc24182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc29e5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc24182ad0 con 0x7efc24182cc0 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc29e5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc24085d50 con 0x7efc2408c620 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc29e5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2413ddd0 con 0x7efc2408c250 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc29e5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc237fe640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7efc2408c250 legacy=0x7efc24086d10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc29e5b640 10 monclient(hunting): authenticate will time out at 1173.240030s 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc23fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7efc24182cc0 0x7efc241823c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:36412/0 (socket says 10.20.193.57:36412) 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.421+0000 7efc23fff640 1 -- 10.20.193.57:0/2531698895 learned_addr learned my addr 10.20.193.57:0/2531698895 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:38:13.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc23fff640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.57:6789/0 conn(0x7efc24182cc0 legacy=0x7efc241823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273280032 0 0) 0x7efc24182ad0 con 0x7efc24182cc0 2026-02-12T17:38:13.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): my global_id is 74178 2026-02-12T17:38:13.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc22ffd640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.82:6789/0 conn(0x7efc2408c620 legacy=0x7efc24181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbf40035e0 con 0x7efc24182cc0 2026-02-12T17:38:13.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392223898 0 0) 0x7efc24085d50 con 0x7efc2408c620 2026-02-12T17:38:13.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): my global_id is 4921 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc24182ad0 con 0x7efc2408c620 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2996944430 0 0) 0x7efbf40035e0 con 0x7efc24182cc0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc24085d50 con 0x7efc24182cc0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc18005550 con 0x7efc24182cc0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): dump: 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3349645855 0 0) 0x7efc24085d50 con 0x7efc24182cc0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.57:6790/0 conn(0x7efc2408c250 legacy=0x7efc24086d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.82:6789/0 conn(0x7efc2408c620 legacy=0x7efc24181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient: _finish_hunting 0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 monclient: found mon.a 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2413b130 con 0x7efc24182cc0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient: _finish_auth 0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient: _check_auth_tickets 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc29e5b640 5 monclient: authenticate success, global_id 74178 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc29e5b640 10 monclient: _renew_subs 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc29e5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efc2413e900 con 0x7efc24182cc0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc29e5b640 10 monclient: _renew_subs 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc29e5b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efc240875b0 con 0x7efc24182cc0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc180057e0 con 0x7efc24182cc0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc18005b00 con 0x7efc24182cc0 2026-02-12T17:38:13.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efbfffff640 10 monclient: dump: 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.423+0000 7efc21ffb640 4 set_mon_vals no callback set 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.424+0000 7efc29e5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.424+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efc24090810 con 0x7efc240582c0 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.424+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7efc18005d90 con 0x7efc24182cc0 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.424+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(486..486 src has 202..486) ==== 3931+0+0 (unknown 2922470996 0 0) 0x7efc1804fc30 con 0x7efc24182cc0 2026-02-12T17:38:13.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.424+0000 7efc22ffd640 10 monclient: get_auth_request con 0x7efbf403f760 auth_method 0 2026-02-12T17:38:13.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.426+0000 7efc237fe640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.82:6789/0 conn(0x7efc240582c0 legacy=0x7efc24058690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.426+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4181885597 0 0) 0x7efc24090810 con 0x7efc240582c0 2026-02-12T17:38:13.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.426+0000 7efbfffff640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.426+0000 7efbfffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.426+0000 7efbfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.426+0000 7efbfffff640 10 monclient(hunting): my global_id is 4924 2026-02-12T17:38:13.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.426+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc24085d50 con 0x7efc240582c0 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2450709910 0 0) 0x7efc24085d50 con 0x7efc240582c0 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc24090810 con 0x7efc240582c0 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc10002d50 con 0x7efc240582c0 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 10 monclient: dump: 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1895154421 0 0) 0x7efc24090810 con 0x7efc240582c0 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc2408f5b0 con 0x7efc240582c0 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7efc10004b90 con 0x7efc240582c0 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.82:6789/0 conn(0x7efc240582c0 legacy=0x7efc24058690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.427+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.82:6789/0 conn(0x7efc240582c0 legacy=0x7efc24058690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:38:13.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.430+0000 7efc29e5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:38:13.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.430+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efc240591a0 con 0x7efc24058da0 2026-02-12T17:38:13.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efc237fe640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.82:6789/0 conn(0x7efc24058da0 legacy=0x7efc241974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647714640 0 0) 0x7efc240591a0 con 0x7efc24058da0 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 10 monclient(hunting): _negotiate 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 10 monclient(hunting): my global_id is 4927 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc24090810 con 0x7efc24058da0 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1282001474 0 0) 0x7efc24090810 con 0x7efc24058da0 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc240591a0 con 0x7efc24058da0 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7efc100053e0 con 0x7efc24058da0 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 10 monclient: dump: 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:38:13.430 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3089291609 0 0) 0x7efc240591a0 con 0x7efc24058da0 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efc2413adb0 con 0x7efc24058da0 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 929618117) 0x7efc10007aa0 con 0x7efc24058da0 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.82:6789/0 conn(0x7efc24058da0 legacy=0x7efc241974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.433+0000 7efbfffff640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.82:6789/0 conn(0x7efc24058da0 legacy=0x7efc241974f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 44, 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 614930, 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:38:13.431 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:38:13.432 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:38:13.433 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.434 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.82:6800/2441377515 conn(0x7efbf403f760 legacy=0x7efbf405fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc29e5b640 10 monclient: shutdown 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc29e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 >> v1:10.20.193.57:6789/0 conn(0x7efc24182cc0 legacy=0x7efc241823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc23fff640 1 -- 10.20.193.57:0/2531698895 reap_dead start 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc23fff640 1 -- 10.20.193.57:0/2531698895 reap_dead start 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 shutdown_connections 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 >> 10.20.193.57:0/2531698895 conn(0x7efc240916b0 msgr2=0x7efc2408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 shutdown_connections 2026-02-12T17:38:13.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:38:13.434+0000 7efc29e5b640 1 -- 10.20.193.57:0/2531698895 wait complete. 2026-02-12T17:38:13.436 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:38:13.436 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:38:14.102 INFO:tasks.rados.rados.0.trial082.stdout:2225: done (9 left) 2026-02-12T17:38:14.102 INFO:tasks.rados.rados.0.trial082.stdout:2226: done (8 left) 2026-02-12T17:38:14.102 INFO:tasks.rados.rados.0.trial082.stdout:2227: done (7 left) 2026-02-12T17:38:14.102 INFO:tasks.rados.rados.0.trial082.stdout:2228: done (6 left) 2026-02-12T17:38:14.102 INFO:tasks.rados.rados.0.trial082.stdout:2229: done (5 left) 2026-02-12T17:38:14.102 INFO:tasks.rados.rados.0.trial082.stdout:2230: done (4 left) 2026-02-12T17:38:14.102 INFO:tasks.rados.rados.0.trial082.stdout:2231: done (3 left) 2026-02-12T17:38:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2232: done (2 left) 2026-02-12T17:38:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2233: done (1 left) 2026-02-12T17:38:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2234: done (0 left) 2026-02-12T17:38:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2235: copy_from oid 26 from oid 42 current snap is 235 2026-02-12T17:38:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2236: copy_from oid 5 from oid 23 current snap is 235 2026-02-12T17:38:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2237: read oid 47 snap 229 2026-02-12T17:38:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2237: expect (ObjNum 748 snap 227 seq_num 748) 2026-02-12T17:38:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2238: write (excl) oid 8 current snap is 235 2026-02-12T17:38:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2238: seq_num 772 ranges {575004=643881,1709040=492938,2917021=57983} 2026-02-12T17:38:14.106 INFO:tasks.rados.rados.0.trial082.stdout:2238: writing trial08226312-8 from 575004 to 1218885 tid 1 2026-02-12T17:38:14.109 INFO:tasks.rados.rados.0.trial082.stdout:2238: writing trial08226312-8 from 1709040 to 2201978 tid 2 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2238: writing trial08226312-8 from 2917021 to 2975004 tid 3 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2239: read oid 12 snap -1 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2239: expect (ObjNum 690 snap 208 seq_num 690) 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2240: rollback oid 40 current snap is 235 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 40 to 227 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2235: finishing copy_from to trial08226312-26 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2235: got expected ENOENT (src dne) 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2236: finishing copy_from to trial08226312-5 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2236: got expected ENOENT (src dne) 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2235: finishing copy_from racing read to trial08226312-26 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2236: finishing copy_from racing read to trial08226312-5 2026-02-12T17:38:14.113 INFO:tasks.rados.rados.0.trial082.stdout:2237: expect (ObjNum 748 snap 227 seq_num 748) 2026-02-12T17:38:14.120 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2063841 2026-02-12T17:38:14.142 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2562699 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:2238: finishing write tid 1 to trial08226312-8 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:2235: done (5 left) 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:2236: done (4 left) 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:2237: done (3 left) 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:2241: rollback oid 9 current snap is 235 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 9 to 231 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:2238: finishing write tid 2 to trial08226312-8 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:2238: finishing write tid 3 to trial08226312-8 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:2238: finishing write tid 4 to trial08226312-8 2026-02-12T17:38:14.146 INFO:tasks.rados.rados.0.trial082.stdout:2238: finishing write tid 5 to trial08226312-8 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:2238: oid 8 updating version 0 to 1644 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:2238: oid 8 updating version 1644 to 1645 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:2238: oid 8 updating version 1645 to 1647 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:2238: oid 8 version 1647 is already newer than 1646 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1647 (ObjNum 772 snap 235 seq_num 772) dirty exists 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:2238: left oid 8 (ObjNum 772 snap 235 seq_num 772) 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:2240: finishing rollback tid 0 to trial08226312-40 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:2240: finishing rollback tid 1 to trial08226312-40 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:2240: finishing rollback tid 2 to trial08226312-40 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1313 (ObjNum 750 snap 227 seq_num 750) dirty exists 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:2239: expect (ObjNum 690 snap 208 seq_num 690) 2026-02-12T17:38:14.147 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:14.171 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:14.197 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:14.224 INFO:tasks.rados.rados.0.trial082.stdout:2241: finishing rollback tid 0 to trial08226312-9 2026-02-12T17:38:14.224 INFO:tasks.rados.rados.0.trial082.stdout:2241: finishing rollback tid 1 to trial08226312-9 2026-02-12T17:38:14.224 INFO:tasks.rados.rados.0.trial082.stdout:2241: finishing rollback tid 2 to trial08226312-9 2026-02-12T17:38:14.225 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 1317 (ObjNum 706 snap 212 seq_num 706) dirty exists 2026-02-12T17:38:14.225 INFO:tasks.rados.rados.0.trial082.stdout:2238: done (3 left) 2026-02-12T17:38:14.225 INFO:tasks.rados.rados.0.trial082.stdout:2239: done (2 left) 2026-02-12T17:38:14.225 INFO:tasks.rados.rados.0.trial082.stdout:2240: done (1 left) 2026-02-12T17:38:14.225 INFO:tasks.rados.rados.0.trial082.stdout:2241: done (0 left) 2026-02-12T17:38:14.225 INFO:tasks.rados.rados.0.trial082.stdout:2242: copy_from oid 3 from oid 30 current snap is 235 2026-02-12T17:38:14.225 INFO:tasks.rados.rados.0.trial082.stdout:2243: read oid 14 snap -1 2026-02-12T17:38:14.225 INFO:tasks.rados.rados.0.trial082.stdout:2243: expect (ObjNum 739 snap 224 seq_num 739) 2026-02-12T17:38:14.225 INFO:tasks.rados.rados.0.trial082.stdout:2244: snap_remove snap 234 2026-02-12T17:38:15.104 INFO:tasks.rados.rados.0.trial082.stdout:2244: done (2 left) 2026-02-12T17:38:15.104 INFO:tasks.rados.rados.0.trial082.stdout:2245: rollback oid 22 current snap is 235 2026-02-12T17:38:15.104 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 233 2026-02-12T17:38:15.104 INFO:tasks.rados.rados.0.trial082.stdout:2242: finishing copy_from to trial08226312-3 2026-02-12T17:38:15.104 INFO:tasks.rados.rados.0.trial082.stdout:2242: got expected ENOENT (src dne) 2026-02-12T17:38:15.104 INFO:tasks.rados.rados.0.trial082.stdout:2242: finishing copy_from racing read to trial08226312-3 2026-02-12T17:38:15.104 INFO:tasks.rados.rados.0.trial082.stdout:2243: expect (ObjNum 739 snap 224 seq_num 739) 2026-02-12T17:38:15.114 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 119238 2026-02-12T17:38:15.133 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 693967 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2245: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2245: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2245: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 1517 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2242: done (2 left) 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2243: done (1 left) 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2245: done (0 left) 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2246: read oid 3 snap -1 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2246: expect (ObjNum 747 snap 227 seq_num 747) 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2247: write oid 8 current snap is 235 2026-02-12T17:38:15.145 INFO:tasks.rados.rados.0.trial082.stdout:2247: seq_num 773 ranges {591811=719130,1767522=636596,2828091=163720} 2026-02-12T17:38:15.150 INFO:tasks.rados.rados.0.trial082.stdout:2247: writing trial08226312-8 from 591811 to 1310941 tid 1 2026-02-12T17:38:15.154 INFO:tasks.rados.rados.0.trial082.stdout:2247: writing trial08226312-8 from 1767522 to 2404118 tid 2 2026-02-12T17:38:15.156 INFO:tasks.rados.rados.0.trial082.stdout:2247: writing trial08226312-8 from 2828091 to 2991811 tid 3 2026-02-12T17:38:15.156 INFO:tasks.rados.rados.0.trial082.stdout:2248: write oid 34 current snap is 235 2026-02-12T17:38:15.156 INFO:tasks.rados.rados.0.trial082.stdout:2248: seq_num 774 ranges {608618=794379,2109651=780254} 2026-02-12T17:38:15.161 INFO:tasks.rados.rados.0.trial082.stdout:2248: writing trial08226312-34 from 608618 to 1402997 tid 1 2026-02-12T17:38:15.167 INFO:tasks.rados.rados.0.trial082.stdout:2248: writing trial08226312-34 from 2109651 to 2889905 tid 2 2026-02-12T17:38:15.167 INFO:tasks.rados.rados.0.trial082.stdout:2249: snap_remove snap 226 2026-02-12T17:38:16.108 INFO:tasks.rados.rados.0.trial082.stdout:2249: done (3 left) 2026-02-12T17:38:16.108 INFO:tasks.rados.rados.0.trial082.stdout:2250: read oid 41 snap 231 2026-02-12T17:38:16.108 INFO:tasks.rados.rados.0.trial082.stdout:2250: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:38:16.108 INFO:tasks.rados.rados.0.trial082.stdout:2251: delete oid 7 current snap is 235 2026-02-12T17:38:16.109 INFO:tasks.rados.rados.0.trial082.stdout:2246: expect (ObjNum 747 snap 227 seq_num 747) 2026-02-12T17:38:16.141 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:16.172 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:16.205 INFO:tasks.rados.rados.0.trial082.stdout:2247: finishing write tid 1 to trial08226312-8 2026-02-12T17:38:16.206 INFO:tasks.rados.rados.0.trial082.stdout:2247: finishing write tid 2 to trial08226312-8 2026-02-12T17:38:16.206 INFO:tasks.rados.rados.0.trial082.stdout:2247: finishing write tid 3 to trial08226312-8 2026-02-12T17:38:16.206 INFO:tasks.rados.rados.0.trial082.stdout:2246: done (4 left) 2026-02-12T17:38:16.206 INFO:tasks.rados.rados.0.trial082.stdout:2251: done (3 left) 2026-02-12T17:38:16.206 INFO:tasks.rados.rados.0.trial082.stdout:2252: rollback oid 35 current snap is 235 2026-02-12T17:38:16.206 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 35 to 229 2026-02-12T17:38:16.206 INFO:tasks.rados.rados.0.trial082.stdout:2247: finishing write tid 4 to trial08226312-8 2026-02-12T17:38:16.206 INFO:tasks.rados.rados.0.trial082.stdout:2247: finishing write tid 5 to trial08226312-8 2026-02-12T17:38:16.206 INFO:tasks.rados.rados.0.trial082.stdout:2247: oid 8 updating version 0 to 1648 2026-02-12T17:38:16.207 INFO:tasks.rados.rados.0.trial082.stdout:2247: oid 8 updating version 1648 to 1652 2026-02-12T17:38:16.207 INFO:tasks.rados.rados.0.trial082.stdout:2247: oid 8 updating version 1652 to 1653 2026-02-12T17:38:16.207 INFO:tasks.rados.rados.0.trial082.stdout:2247: oid 8 version 1653 is already newer than 1651 2026-02-12T17:38:16.207 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1653 (ObjNum 773 snap 235 seq_num 773) dirty exists 2026-02-12T17:38:16.207 INFO:tasks.rados.rados.0.trial082.stdout:2247: left oid 8 (ObjNum 773 snap 235 seq_num 773) 2026-02-12T17:38:16.207 INFO:tasks.rados.rados.0.trial082.stdout:2248: finishing write tid 1 to trial08226312-34 2026-02-12T17:38:16.207 INFO:tasks.rados.rados.0.trial082.stdout:2248: finishing write tid 2 to trial08226312-34 2026-02-12T17:38:16.207 INFO:tasks.rados.rados.0.trial082.stdout:2248: finishing write tid 3 to trial08226312-34 2026-02-12T17:38:16.207 INFO:tasks.rados.rados.0.trial082.stdout:2248: finishing write tid 4 to trial08226312-34 2026-02-12T17:38:16.208 INFO:tasks.rados.rados.0.trial082.stdout:2248: oid 34 updating version 0 to 1515 2026-02-12T17:38:16.208 INFO:tasks.rados.rados.0.trial082.stdout:2248: oid 34 version 1515 is already newer than 1514 2026-02-12T17:38:16.208 INFO:tasks.rados.rados.0.trial082.stdout:2248: oid 34 updating version 1515 to 1516 2026-02-12T17:38:16.208 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1516 (ObjNum 774 snap 235 seq_num 774) dirty exists 2026-02-12T17:38:16.208 INFO:tasks.rados.rados.0.trial082.stdout:2248: left oid 34 (ObjNum 774 snap 235 seq_num 774) 2026-02-12T17:38:16.208 INFO:tasks.rados.rados.0.trial082.stdout:2250: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:38:16.209 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 884837 2026-02-12T17:38:16.234 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2912345 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:2252: finishing rollback tid 0 to trial08226312-35 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:2247: done (3 left) 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:2248: done (2 left) 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:2250: done (1 left) 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:2253: rollback oid 16 current snap is 235 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 232 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:2252: finishing rollback tid 1 to trial08226312-35 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:2252: finishing rollback tid 2 to trial08226312-35 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1525 (ObjNum 716 snap 213 seq_num 716) dirty exists 2026-02-12T17:38:16.262 INFO:tasks.rados.rados.0.trial082.stdout:2252: done (1 left) 2026-02-12T17:38:16.263 INFO:tasks.rados.rados.0.trial082.stdout:2254: read oid 28 snap -1 2026-02-12T17:38:16.263 INFO:tasks.rados.rados.0.trial082.stdout:2254: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:38:16.263 INFO:tasks.rados.rados.0.trial082.stdout:2255: read oid 5 snap -1 2026-02-12T17:38:16.263 INFO:tasks.rados.rados.0.trial082.stdout:2255: expect (ObjNum 681 snap 207 seq_num 681) 2026-02-12T17:38:16.263 INFO:tasks.rados.rados.0.trial082.stdout:2256: snap_create 2026-02-12T17:38:16.266 INFO:tasks.rados.rados.0.trial082.stdout:2253: finishing rollback tid 0 to trial08226312-16 2026-02-12T17:38:16.267 INFO:tasks.rados.rados.0.trial082.stdout:2253: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:38:16.267 INFO:tasks.rados.rados.0.trial082.stdout:2253: finishing rollback tid 2 to trial08226312-16 2026-02-12T17:38:16.267 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1330 (ObjNum 666 snap 205 seq_num 666) dirty exists 2026-02-12T17:38:16.269 INFO:tasks.rados.rados.0.trial082.stdout:2255: expect (ObjNum 681 snap 207 seq_num 681) 2026-02-12T17:38:16.271 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1470840 2026-02-12T17:38:16.326 INFO:tasks.rados.rados.0.trial082.stdout:2254: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:38:16.326 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 224122 2026-02-12T17:38:16.374 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:17.112 INFO:tasks.rados.rados.0.trial082.stdout:2253: done (3 left) 2026-02-12T17:38:17.112 INFO:tasks.rados.rados.0.trial082.stdout:2254: done (2 left) 2026-02-12T17:38:17.112 INFO:tasks.rados.rados.0.trial082.stdout:2255: done (1 left) 2026-02-12T17:38:17.113 INFO:tasks.rados.rados.0.trial082.stdout:2256: done (0 left) 2026-02-12T17:38:17.113 INFO:tasks.rados.rados.0.trial082.stdout:2257: read oid 22 snap -1 2026-02-12T17:38:17.113 INFO:tasks.rados.rados.0.trial082.stdout:2257: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:38:17.113 INFO:tasks.rados.rados.0.trial082.stdout:2258: delete oid 23 current snap is 236 2026-02-12T17:38:17.115 INFO:tasks.rados.rados.0.trial082.stdout:2258: done (1 left) 2026-02-12T17:38:17.115 INFO:tasks.rados.rados.0.trial082.stdout:2259: read oid 1 snap -1 2026-02-12T17:38:17.115 INFO:tasks.rados.rados.0.trial082.stdout:2259: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:38:17.116 INFO:tasks.rados.rados.0.trial082.stdout:2260: read oid 2 snap -1 2026-02-12T17:38:17.116 INFO:tasks.rados.rados.0.trial082.stdout:2260: expect (ObjNum 726 snap 214 seq_num 726) 2026-02-12T17:38:17.116 INFO:tasks.rados.rados.0.trial082.stdout:2261: snap_create 2026-02-12T17:38:17.117 INFO:tasks.rados.rados.0.trial082.stdout:2260: expect (ObjNum 726 snap 214 seq_num 726) 2026-02-12T17:38:17.146 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:17.162 INFO:tasks.rados.rados.0.trial082.stdout:2259: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:38:17.162 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:17.264 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2743853 2026-02-12T17:38:17.306 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2511301 2026-02-12T17:38:17.332 INFO:tasks.rados.rados.0.trial082.stdout:2257: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:38:17.373 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3226775 2026-02-12T17:38:17.380 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:18.069 INFO:tasks.rados.rados.0.trial082.stdout:2257: done (3 left) 2026-02-12T17:38:18.069 INFO:tasks.rados.rados.0.trial082.stdout:2259: done (2 left) 2026-02-12T17:38:18.069 INFO:tasks.rados.rados.0.trial082.stdout:2260: done (1 left) 2026-02-12T17:38:18.069 INFO:tasks.rados.rados.0.trial082.stdout:2261: done (0 left) 2026-02-12T17:38:18.069 INFO:tasks.rados.rados.0.trial082.stdout:2262: snap_create 2026-02-12T17:38:19.069 INFO:tasks.rados.rados.0.trial082.stdout:2262: done (0 left) 2026-02-12T17:38:19.069 INFO:tasks.rados.rados.0.trial082.stdout:2263: rollback oid 21 current snap is 238 2026-02-12T17:38:19.069 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 233 2026-02-12T17:38:19.069 INFO:tasks.rados.rados.0.trial082.stdout:2264: delete oid 6 current snap is 238 2026-02-12T17:38:19.071 INFO:tasks.rados.rados.0.trial082.stdout:2264: done (1 left) 2026-02-12T17:38:19.071 INFO:tasks.rados.rados.0.trial082.stdout:2265: read oid 1 snap -1 2026-02-12T17:38:19.071 INFO:tasks.rados.rados.0.trial082.stdout:2265: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:38:19.071 INFO:tasks.rados.rados.0.trial082.stdout:2266: rollback oid 34 current snap is 238 2026-02-12T17:38:19.071 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 235 2026-02-12T17:38:19.071 INFO:tasks.rados.rados.0.trial082.stdout:2267: read oid 17 snap -1 2026-02-12T17:38:19.071 INFO:tasks.rados.rados.0.trial082.stdout:2267: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:38:19.071 INFO:tasks.rados.rados.0.trial082.stdout:2268: read oid 5 snap -1 2026-02-12T17:38:19.071 INFO:tasks.rados.rados.0.trial082.stdout:2268: expect (ObjNum 681 snap 207 seq_num 681) 2026-02-12T17:38:19.072 INFO:tasks.rados.rados.0.trial082.stdout:2269: copy_from oid 40 from oid 26 current snap is 238 2026-02-12T17:38:19.072 INFO:tasks.rados.rados.0.trial082.stdout:2270: snap_create 2026-02-12T17:38:19.072 INFO:tasks.rados.rados.0.trial082.stdout:2263: finishing rollback tid 0 to trial08226312-21 2026-02-12T17:38:19.072 INFO:tasks.rados.rados.0.trial082.stdout:2265: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:38:19.241 INFO:tasks.rados.rados.0.trial082.stdout:2263: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:38:19.242 INFO:tasks.rados.rados.0.trial082.stdout:2263: finishing rollback tid 2 to trial08226312-21 2026-02-12T17:38:19.242 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1520 (ObjNum 732 snap 217 seq_num 732) dirty exists 2026-02-12T17:38:19.242 INFO:tasks.rados.rados.0.trial082.stdout:2266: finishing rollback tid 0 to trial08226312-34 2026-02-12T17:38:19.242 INFO:tasks.rados.rados.0.trial082.stdout:2266: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:38:19.242 INFO:tasks.rados.rados.0.trial082.stdout:2266: finishing rollback tid 2 to trial08226312-34 2026-02-12T17:38:19.242 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1519 (ObjNum 774 snap 235 seq_num 774) dirty exists 2026-02-12T17:38:19.242 INFO:tasks.rados.rados.0.trial082.stdout:2267: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:38:19.252 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1382058 2026-02-12T17:38:19.270 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:19.327 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2706585 2026-02-12T17:38:19.330 INFO:tasks.rados.rados.0.trial082.stdout:2269: finishing copy_from racing read to trial08226312-40 2026-02-12T17:38:19.331 INFO:tasks.rados.rados.0.trial082.stdout:2268: expect (ObjNum 681 snap 207 seq_num 681) 2026-02-12T17:38:19.331 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 506969 2026-02-12T17:38:19.377 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:19.402 INFO:tasks.rados.rados.0.trial082.stdout:2269: finishing copy_from to trial08226312-40 2026-02-12T17:38:19.402 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1501 (ObjNum 732 snap 217 seq_num 732) dirty exists 2026-02-12T17:38:20.071 INFO:tasks.rados.rados.0.trial082.stdout:2263: done (6 left) 2026-02-12T17:38:20.072 INFO:tasks.rados.rados.0.trial082.stdout:2265: done (5 left) 2026-02-12T17:38:20.072 INFO:tasks.rados.rados.0.trial082.stdout:2266: done (4 left) 2026-02-12T17:38:20.072 INFO:tasks.rados.rados.0.trial082.stdout:2267: done (3 left) 2026-02-12T17:38:20.072 INFO:tasks.rados.rados.0.trial082.stdout:2268: done (2 left) 2026-02-12T17:38:20.072 INFO:tasks.rados.rados.0.trial082.stdout:2269: done (1 left) 2026-02-12T17:38:20.072 INFO:tasks.rados.rados.0.trial082.stdout:2270: done (0 left) 2026-02-12T17:38:20.072 INFO:tasks.rados.rados.0.trial082.stdout:2271: delete oid 6 current snap is 239 2026-02-12T17:38:20.073 INFO:tasks.rados.rados.0.trial082.stdout:2271: done (0 left) 2026-02-12T17:38:20.073 INFO:tasks.rados.rados.0.trial082.stdout:2272: rollback oid 38 current snap is 239 2026-02-12T17:38:20.074 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 235 2026-02-12T17:38:20.074 INFO:tasks.rados.rados.0.trial082.stdout:2273: snap_remove snap 229 2026-02-12T17:38:21.073 INFO:tasks.rados.rados.0.trial082.stdout:2273: done (1 left) 2026-02-12T17:38:21.073 INFO:tasks.rados.rados.0.trial082.stdout:2274: read oid 8 snap -1 2026-02-12T17:38:21.073 INFO:tasks.rados.rados.0.trial082.stdout:2274: expect (ObjNum 773 snap 235 seq_num 773) 2026-02-12T17:38:21.073 INFO:tasks.rados.rados.0.trial082.stdout:2275: read oid 9 snap 231 2026-02-12T17:38:21.073 INFO:tasks.rados.rados.0.trial082.stdout:2275: expect (ObjNum 706 snap 212 seq_num 706) 2026-02-12T17:38:21.074 INFO:tasks.rados.rados.0.trial082.stdout:2276: read oid 39 snap -1 2026-02-12T17:38:21.074 INFO:tasks.rados.rados.0.trial082.stdout:2276: expect (ObjNum 740 snap 225 seq_num 740) 2026-02-12T17:38:21.074 INFO:tasks.rados.rados.0.trial082.stdout:2277: snap_create 2026-02-12T17:38:21.074 INFO:tasks.rados.rados.0.trial082.stdout:2272: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:38:21.074 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 850 (ObjNum 81 snap 0 seq_num 27016840) dirty dne 2026-02-12T17:38:21.074 INFO:tasks.rados.rados.0.trial082.stdout:2276: expect (ObjNum 740 snap 225 seq_num 740) 2026-02-12T17:38:21.104 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1724355 2026-02-12T17:38:21.135 INFO:tasks.rados.rados.0.trial082.stdout:2274: expect (ObjNum 773 snap 235 seq_num 773) 2026-02-12T17:38:21.135 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:21.268 INFO:tasks.rados.rados.0.trial082.stdout:2275: expect (ObjNum 706 snap 212 seq_num 706) 2026-02-12T17:38:21.268 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:22.075 INFO:tasks.rados.rados.0.trial082.stdout:2272: done (4 left) 2026-02-12T17:38:22.075 INFO:tasks.rados.rados.0.trial082.stdout:2274: done (3 left) 2026-02-12T17:38:22.075 INFO:tasks.rados.rados.0.trial082.stdout:2275: done (2 left) 2026-02-12T17:38:22.076 INFO:tasks.rados.rados.0.trial082.stdout:2276: done (1 left) 2026-02-12T17:38:22.076 INFO:tasks.rados.rados.0.trial082.stdout:2277: done (0 left) 2026-02-12T17:38:22.076 INFO:tasks.rados.rados.0.trial082.stdout:2278: delete oid 12 current snap is 240 2026-02-12T17:38:22.076 INFO:tasks.rados.rados.0.trial082.stdout:2278: done (0 left) 2026-02-12T17:38:22.076 INFO:tasks.rados.rados.0.trial082.stdout:2279: snap_create 2026-02-12T17:38:23.070 INFO:tasks.rados.rados.0.trial082.stdout:2279: done (0 left) 2026-02-12T17:38:23.070 INFO:tasks.rados.rados.0.trial082.stdout:2280: read oid 39 snap 232 2026-02-12T17:38:23.070 INFO:tasks.rados.rados.0.trial082.stdout:2280: expect (ObjNum 740 snap 225 seq_num 740) 2026-02-12T17:38:23.070 INFO:tasks.rados.rados.0.trial082.stdout:2281: copy_from oid 16 from oid 47 current snap is 241 2026-02-12T17:38:23.070 INFO:tasks.rados.rados.0.trial082.stdout:2282: snap_create 2026-02-12T17:38:23.072 INFO:tasks.rados.rados.0.trial082.stdout:2280: expect (ObjNum 740 snap 225 seq_num 740) 2026-02-12T17:38:23.072 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:23.143 INFO:tasks.rados.rados.0.trial082.stdout:2281: finishing copy_from racing read to trial08226312-16 2026-02-12T17:38:23.143 INFO:tasks.rados.rados.0.trial082.stdout:2281: finishing copy_from to trial08226312-16 2026-02-12T17:38:23.143 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1569 (ObjNum 725 snap 214 seq_num 725) dirty exists 2026-02-12T17:38:24.072 INFO:tasks.rados.rados.0.trial082.stdout:2280: done (2 left) 2026-02-12T17:38:24.072 INFO:tasks.rados.rados.0.trial082.stdout:2281: done (1 left) 2026-02-12T17:38:24.072 INFO:tasks.rados.rados.0.trial082.stdout:2282: done (0 left) 2026-02-12T17:38:24.073 INFO:tasks.rados.rados.0.trial082.stdout:2283: copy_from oid 23 from oid 31 current snap is 242 2026-02-12T17:38:24.073 INFO:tasks.rados.rados.0.trial082.stdout:2284: copy_from oid 47 from oid 17 current snap is 242 2026-02-12T17:38:24.073 INFO:tasks.rados.rados.0.trial082.stdout:2285: snap_remove snap 235 2026-02-12T17:38:25.076 INFO:tasks.rados.rados.0.trial082.stdout:2285: done (2 left) 2026-02-12T17:38:25.077 INFO:tasks.rados.rados.0.trial082.stdout:2286: snap_remove snap 241 2026-02-12T17:38:26.548 INFO:tasks.rados.rados.0.trial082.stdout:2286: done (2 left) 2026-02-12T17:38:26.548 INFO:tasks.rados.rados.0.trial082.stdout:2287: write oid 30 current snap is 242 2026-02-12T17:38:26.548 INFO:tasks.rados.rados.0.trial082.stdout:2287: seq_num 780 ranges {709460=562226,2060543=791261} 2026-02-12T17:38:26.553 INFO:tasks.rados.rados.0.trial082.stdout:2287: writing trial08226312-30 from 709460 to 1271686 tid 1 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:2287: writing trial08226312-30 from 2060543 to 2851804 tid 2 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:2288: rollback oid 12 current snap is 242 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 233 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:2283: finishing copy_from to trial08226312-23 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:2283: got expected ENOENT (src dne) 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:2283: finishing copy_from racing read to trial08226312-23 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:2284: finishing copy_from racing read to trial08226312-47 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:2284: finishing copy_from to trial08226312-47 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1625 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:2287: finishing write tid 1 to trial08226312-30 2026-02-12T17:38:26.560 INFO:tasks.rados.rados.0.trial082.stdout:2283: done (3 left) 2026-02-12T17:38:26.561 INFO:tasks.rados.rados.0.trial082.stdout:2284: done (2 left) 2026-02-12T17:38:26.561 INFO:tasks.rados.rados.0.trial082.stdout:2289: rollback oid 7 current snap is 242 2026-02-12T17:38:26.561 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 7 to 216 2026-02-12T17:38:26.561 INFO:tasks.rados.rados.0.trial082.stdout:2290: write (excl) oid 42 current snap is 242 2026-02-12T17:38:26.561 INFO:tasks.rados.rados.0.trial082.stdout:2290: seq_num 781 ranges {726267=637475,2119025=651272} 2026-02-12T17:38:26.565 INFO:tasks.rados.rados.0.trial082.stdout:2290: writing trial08226312-42 from 726267 to 1363742 tid 1 2026-02-12T17:38:26.571 INFO:tasks.rados.rados.0.trial082.stdout:2290: writing trial08226312-42 from 2119025 to 2770297 tid 2 2026-02-12T17:38:26.571 INFO:tasks.rados.rados.0.trial082.stdout:2291: snap_create 2026-02-12T17:38:26.571 INFO:tasks.rados.rados.0.trial082.stdout:2289: finishing rollback tid 1 to trial08226312-7 2026-02-12T17:38:26.571 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 0 (ObjNum 33 snap 0 seq_num 27653616) dirty dne 2026-02-12T17:38:26.571 INFO:tasks.rados.rados.0.trial082.stdout:2288: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:38:26.571 INFO:tasks.rados.rados.0.trial082.stdout:2287: finishing write tid 2 to trial08226312-30 2026-02-12T17:38:26.571 INFO:tasks.rados.rados.0.trial082.stdout:2287: finishing write tid 3 to trial08226312-30 2026-02-12T17:38:26.571 INFO:tasks.rados.rados.0.trial082.stdout:2288: finishing rollback tid 2 to trial08226312-12 2026-02-12T17:38:26.572 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1125 (ObjNum 690 snap 208 seq_num 690) dirty exists 2026-02-12T17:38:26.572 INFO:tasks.rados.rados.0.trial082.stdout:2287: finishing write tid 4 to trial08226312-30 2026-02-12T17:38:26.572 INFO:tasks.rados.rados.0.trial082.stdout:2287: oid 30 updating version 0 to 1521 2026-02-12T17:38:26.572 INFO:tasks.rados.rados.0.trial082.stdout:2287: oid 30 updating version 1521 to 1522 2026-02-12T17:38:26.572 INFO:tasks.rados.rados.0.trial082.stdout:2287: oid 30 updating version 1522 to 1523 2026-02-12T17:38:26.572 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1523 (ObjNum 780 snap 242 seq_num 780) dirty exists 2026-02-12T17:38:26.572 INFO:tasks.rados.rados.0.trial082.stdout:2287: left oid 30 (ObjNum 780 snap 242 seq_num 780) 2026-02-12T17:38:26.572 INFO:tasks.rados.rados.0.trial082.stdout:2290: finishing write tid 1 to trial08226312-42 2026-02-12T17:38:26.573 INFO:tasks.rados.rados.0.trial082.stdout:2290: finishing write tid 2 to trial08226312-42 2026-02-12T17:38:26.573 INFO:tasks.rados.rados.0.trial082.stdout:2290: finishing write tid 3 to trial08226312-42 2026-02-12T17:38:26.573 INFO:tasks.rados.rados.0.trial082.stdout:2290: finishing write tid 4 to trial08226312-42 2026-02-12T17:38:26.574 INFO:tasks.rados.rados.0.trial082.stdout:2290: oid 42 updating version 0 to 1572 2026-02-12T17:38:26.574 INFO:tasks.rados.rados.0.trial082.stdout:2290: oid 42 version 1572 is already newer than 1571 2026-02-12T17:38:26.574 INFO:tasks.rados.rados.0.trial082.stdout:2290: oid 42 version 1572 is already newer than 1570 2026-02-12T17:38:26.574 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 1572 (ObjNum 781 snap 242 seq_num 781) dirty exists 2026-02-12T17:38:26.574 INFO:tasks.rados.rados.0.trial082.stdout:2290: left oid 42 (ObjNum 781 snap 242 seq_num 781) 2026-02-12T17:38:27.550 INFO:tasks.rados.rados.0.trial082.stdout:2287: done (4 left) 2026-02-12T17:38:27.550 INFO:tasks.rados.rados.0.trial082.stdout:2288: done (3 left) 2026-02-12T17:38:27.550 INFO:tasks.rados.rados.0.trial082.stdout:2289: done (2 left) 2026-02-12T17:38:27.550 INFO:tasks.rados.rados.0.trial082.stdout:2290: done (1 left) 2026-02-12T17:38:27.550 INFO:tasks.rados.rados.0.trial082.stdout:2291: done (0 left) 2026-02-12T17:38:27.550 INFO:tasks.rados.rados.0.trial082.stdout:2292: snap_remove snap 238 2026-02-12T17:38:28.070 INFO:tasks.rados.rados.0.trial082.stdout:2292: done (0 left) 2026-02-12T17:38:28.070 INFO:tasks.rados.rados.0.trial082.stdout:2293: read oid 17 snap -1 2026-02-12T17:38:28.070 INFO:tasks.rados.rados.0.trial082.stdout:2293: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:38:28.070 INFO:tasks.rados.rados.0.trial082.stdout:2294: rollback oid 29 current snap is 243 2026-02-12T17:38:28.071 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 29 to 233 2026-02-12T17:38:28.071 INFO:tasks.rados.rados.0.trial082.stdout:2295: write oid 23 current snap is 243 2026-02-12T17:38:28.071 INFO:tasks.rados.rados.0.trial082.stdout:2295: seq_num 782 ranges {743074=712724,2061154=794930} 2026-02-12T17:38:28.075 INFO:tasks.rados.rados.0.trial082.stdout:2295: writing trial08226312-23 from 743074 to 1455798 tid 1 2026-02-12T17:38:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2295: writing trial08226312-23 from 2061154 to 2856084 tid 2 2026-02-12T17:38:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2296: delete oid 20 current snap is 243 2026-02-12T17:38:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2294: finishing rollback tid 1 to trial08226312-29 2026-02-12T17:38:28.081 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 1570 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:38:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2293: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:38:28.081 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 321366 2026-02-12T17:38:28.113 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:28.146 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2295: finishing write tid 1 to trial08226312-23 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2295: finishing write tid 2 to trial08226312-23 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2295: finishing write tid 3 to trial08226312-23 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2295: finishing write tid 4 to trial08226312-23 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2295: oid 23 updating version 0 to 1528 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2295: oid 23 version 1528 is already newer than 1526 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2295: oid 23 version 1528 is already newer than 1527 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 1528 (ObjNum 782 snap 243 seq_num 782) dirty exists 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2295: left oid 23 (ObjNum 782 snap 243 seq_num 782) 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2293: done (3 left) 2026-02-12T17:38:28.181 INFO:tasks.rados.rados.0.trial082.stdout:2294: done (2 left) 2026-02-12T17:38:28.182 INFO:tasks.rados.rados.0.trial082.stdout:2295: done (1 left) 2026-02-12T17:38:28.182 INFO:tasks.rados.rados.0.trial082.stdout:2296: done (0 left) 2026-02-12T17:38:28.182 INFO:tasks.rados.rados.0.trial082.stdout:2297: delete oid 37 current snap is 243 2026-02-12T17:38:28.182 INFO:tasks.rados.rados.0.trial082.stdout:2297: done (0 left) 2026-02-12T17:38:28.182 INFO:tasks.rados.rados.0.trial082.stdout:2298: delete oid 33 current snap is 243 2026-02-12T17:38:28.183 INFO:tasks.rados.rados.0.trial082.stdout:2298: done (0 left) 2026-02-12T17:38:28.183 INFO:tasks.rados.rados.0.trial082.stdout:2299: write (excl) oid 27 current snap is 243 2026-02-12T17:38:28.183 INFO:tasks.rados.rados.0.trial082.stdout:2299: seq_num 786 ranges {410302=730073,1895082=402268,2951884=258418} 2026-02-12T17:38:28.187 INFO:tasks.rados.rados.0.trial082.stdout:2299: writing trial08226312-27 from 410302 to 1140375 tid 1 2026-02-12T17:38:28.192 INFO:tasks.rados.rados.0.trial082.stdout:2299: writing trial08226312-27 from 1895082 to 2297350 tid 2 2026-02-12T17:38:28.195 INFO:tasks.rados.rados.0.trial082.stdout:2299: writing trial08226312-27 from 2951884 to 3210302 tid 3 2026-02-12T17:38:28.195 INFO:tasks.rados.rados.0.trial082.stdout:2300: read oid 29 snap -1 2026-02-12T17:38:28.196 INFO:tasks.rados.rados.0.trial082.stdout:2300: expect deleted 2026-02-12T17:38:28.196 INFO:tasks.rados.rados.0.trial082.stdout:2301: snap_remove snap 242 2026-02-12T17:38:29.074 INFO:tasks.rados.rados.0.trial082.stdout:2301: done (2 left) 2026-02-12T17:38:29.074 INFO:tasks.rados.rados.0.trial082.stdout:2302: write oid 17 current snap is 243 2026-02-12T17:38:29.074 INFO:tasks.rados.rados.0.trial082.stdout:2302: seq_num 787 ranges {427109=405322,1553564=545926,2579307=647802} 2026-02-12T17:38:29.077 INFO:tasks.rados.rados.0.trial082.stdout:2302: writing trial08226312-17 from 427109 to 832431 tid 1 2026-02-12T17:38:29.082 INFO:tasks.rados.rados.0.trial082.stdout:2302: writing trial08226312-17 from 1553564 to 2099490 tid 2 2026-02-12T17:38:29.086 INFO:tasks.rados.rados.0.trial082.stdout:2302: writing trial08226312-17 from 2579307 to 3227109 tid 3 2026-02-12T17:38:29.086 INFO:tasks.rados.rados.0.trial082.stdout:2303: snap_remove snap 223 2026-02-12T17:38:30.077 INFO:tasks.rados.rados.0.trial082.stdout:2303: done (3 left) 2026-02-12T17:38:30.077 INFO:tasks.rados.rados.0.trial082.stdout:2304: delete oid 50 current snap is 243 2026-02-12T17:38:30.077 INFO:tasks.rados.rados.0.trial082.stdout:2299: finishing write tid 1 to trial08226312-27 2026-02-12T17:38:30.077 INFO:tasks.rados.rados.0.trial082.stdout:2299: finishing write tid 2 to trial08226312-27 2026-02-12T17:38:30.077 INFO:tasks.rados.rados.0.trial082.stdout:2299: finishing write tid 3 to trial08226312-27 2026-02-12T17:38:30.077 INFO:tasks.rados.rados.0.trial082.stdout:2299: finishing write tid 4 to trial08226312-27 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2299: finishing write tid 5 to trial08226312-27 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2299: oid 27 updating version 0 to 1087 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2299: oid 27 version 1087 is already newer than 1085 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2299: oid 27 updating version 1087 to 1088 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2299: oid 27 version 1088 is already newer than 1086 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1088 (ObjNum 786 snap 243 seq_num 786) dirty exists 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2299: left oid 27 (ObjNum 786 snap 243 seq_num 786) 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2302: finishing write tid 1 to trial08226312-17 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2302: finishing write tid 2 to trial08226312-17 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2302: finishing write tid 3 to trial08226312-17 2026-02-12T17:38:30.078 INFO:tasks.rados.rados.0.trial082.stdout:2302: finishing write tid 4 to trial08226312-17 2026-02-12T17:38:30.079 INFO:tasks.rados.rados.0.trial082.stdout:2302: finishing write tid 5 to trial08226312-17 2026-02-12T17:38:30.079 INFO:tasks.rados.rados.0.trial082.stdout:2302: oid 17 updating version 0 to 1690 2026-02-12T17:38:30.079 INFO:tasks.rados.rados.0.trial082.stdout:2302: oid 17 version 1690 is already newer than 1688 2026-02-12T17:38:30.079 INFO:tasks.rados.rados.0.trial082.stdout:2302: oid 17 version 1690 is already newer than 1689 2026-02-12T17:38:30.079 INFO:tasks.rados.rados.0.trial082.stdout:2302: oid 17 version 1690 is already newer than 1685 2026-02-12T17:38:30.079 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 1690 (ObjNum 787 snap 243 seq_num 787) dirty exists 2026-02-12T17:38:30.079 INFO:tasks.rados.rados.0.trial082.stdout:2302: left oid 17 (ObjNum 787 snap 243 seq_num 787) 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:2299: done (3 left) 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:2300: done (2 left) 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:2302: done (1 left) 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:2304: done (0 left) 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:2305: rollback oid 30 current snap is 243 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 233 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:2306: read oid 3 snap -1 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:2306: expect (ObjNum 747 snap 227 seq_num 747) 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:2307: rollback oid 24 current snap is 243 2026-02-12T17:38:30.082 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 216 2026-02-12T17:38:30.083 INFO:tasks.rados.rados.0.trial082.stdout:2308: rollback oid 15 current snap is 243 2026-02-12T17:38:30.083 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 15 to 216 2026-02-12T17:38:30.083 INFO:tasks.rados.rados.0.trial082.stdout:2309: rollback oid 5 current snap is 243 2026-02-12T17:38:30.083 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 5 to 225 2026-02-12T17:38:30.083 INFO:tasks.rados.rados.0.trial082.stdout:2310: rollback oid 45 current snap is 243 2026-02-12T17:38:30.083 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 225 2026-02-12T17:38:30.083 INFO:tasks.rados.rados.0.trial082.stdout:2311: write oid 2 current snap is 243 2026-02-12T17:38:30.083 INFO:tasks.rados.rados.0.trial082.stdout:2311: seq_num 789 ranges {460723=555820,1670528=549595,2634153=626570} 2026-02-12T17:38:30.084 INFO:tasks.rados.rados.0.trial082.stdout:2311: writing trial08226312-2 from 460723 to 1016543 tid 1 2026-02-12T17:38:30.089 INFO:tasks.rados.rados.0.trial082.stdout:2311: writing trial08226312-2 from 1670528 to 2220123 tid 2 2026-02-12T17:38:30.093 INFO:tasks.rados.rados.0.trial082.stdout:2311: writing trial08226312-2 from 2634153 to 3260723 tid 3 2026-02-12T17:38:30.093 INFO:tasks.rados.rados.0.trial082.stdout:2312: write oid 27 current snap is 243 2026-02-12T17:38:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2305: finishing rollback tid 0 to trial08226312-30 2026-02-12T17:38:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2305: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:38:30.094 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1525 (ObjNum 193 snap 0 seq_num 26904512) dirty dne 2026-02-12T17:38:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2307: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:38:30.094 INFO:tasks.rados.rados.0.trial082.stdout:2312: seq_num 790 ranges {477530=631069,1612657=409606,2545223=517596} 2026-02-12T17:38:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2312: writing trial08226312-27 from 477530 to 1108599 tid 1 2026-02-12T17:38:30.100 INFO:tasks.rados.rados.0.trial082.stdout:2312: writing trial08226312-27 from 1612657 to 2022263 tid 2 2026-02-12T17:38:30.104 INFO:tasks.rados.rados.0.trial082.stdout:2312: writing trial08226312-27 from 2545223 to 3062819 tid 3 2026-02-12T17:38:30.105 INFO:tasks.rados.rados.0.trial082.stdout:2305: done (7 left) 2026-02-12T17:38:30.105 INFO:tasks.rados.rados.0.trial082.stdout:2313: read oid 20 snap -1 2026-02-12T17:38:30.105 INFO:tasks.rados.rados.0.trial082.stdout:2313: expect deleted 2026-02-12T17:38:30.105 INFO:tasks.rados.rados.0.trial082.stdout:2314: write oid 46 current snap is 243 2026-02-12T17:38:30.105 INFO:tasks.rados.rados.0.trial082.stdout:2314: seq_num 791 ranges {494337=422671,1387492=553264,2688999=445221} 2026-02-12T17:38:30.107 INFO:tasks.rados.rados.0.trial082.stdout:2314: writing trial08226312-46 from 494337 to 917008 tid 1 2026-02-12T17:38:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2314: writing trial08226312-46 from 1387492 to 1940756 tid 2 2026-02-12T17:38:30.116 INFO:tasks.rados.rados.0.trial082.stdout:2314: writing trial08226312-46 from 2688999 to 3134220 tid 3 2026-02-12T17:38:30.116 INFO:tasks.rados.rados.0.trial082.stdout:2315: read oid 37 snap -1 2026-02-12T17:38:30.116 INFO:tasks.rados.rados.0.trial082.stdout:2315: expect deleted 2026-02-12T17:38:30.116 INFO:tasks.rados.rados.0.trial082.stdout:2316: snap_remove snap 237 2026-02-12T17:38:31.077 INFO:tasks.rados.rados.0.trial082.stdout:2316: done (10 left) 2026-02-12T17:38:31.077 INFO:tasks.rados.rados.0.trial082.stdout:2317: snap_create 2026-02-12T17:38:31.078 INFO:tasks.rados.rados.0.trial082.stdout:2307: finishing rollback tid 2 to trial08226312-24 2026-02-12T17:38:31.078 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1700 (ObjNum 645 snap 197 seq_num 645) dirty exists 2026-02-12T17:38:31.078 INFO:tasks.rados.rados.0.trial082.stdout:2310: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:38:31.078 INFO:tasks.rados.rados.0.trial082.stdout:2310: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:38:31.078 INFO:tasks.rados.rados.0.trial082.stdout:2310: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:38:31.078 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1531 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:38:31.078 INFO:tasks.rados.rados.0.trial082.stdout:2311: finishing write tid 1 to trial08226312-2 2026-02-12T17:38:31.078 INFO:tasks.rados.rados.0.trial082.stdout:2311: finishing write tid 2 to trial08226312-2 2026-02-12T17:38:31.078 INFO:tasks.rados.rados.0.trial082.stdout:2306: expect (ObjNum 747 snap 227 seq_num 747) 2026-02-12T17:38:31.106 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:31.138 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:31.170 INFO:tasks.rados.rados.0.trial082.stdout:2308: finishing rollback tid 0 to trial08226312-15 2026-02-12T17:38:31.170 INFO:tasks.rados.rados.0.trial082.stdout:2308: finishing rollback tid 1 to trial08226312-15 2026-02-12T17:38:31.170 INFO:tasks.rados.rados.0.trial082.stdout:2308: finishing rollback tid 2 to trial08226312-15 2026-02-12T17:38:31.170 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 935 (ObjNum 710 snap 213 seq_num 710) dirty exists 2026-02-12T17:38:31.170 INFO:tasks.rados.rados.0.trial082.stdout:2309: finishing rollback tid 0 to trial08226312-5 2026-02-12T17:38:31.170 INFO:tasks.rados.rados.0.trial082.stdout:2309: finishing rollback tid 1 to trial08226312-5 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2309: finishing rollback tid 2 to trial08226312-5 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 938 (ObjNum 681 snap 207 seq_num 681) dirty exists 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2311: finishing write tid 3 to trial08226312-2 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2311: finishing write tid 4 to trial08226312-2 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2311: finishing write tid 5 to trial08226312-2 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2311: oid 2 updating version 0 to 941 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2311: oid 2 version 941 is already newer than 940 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2311: oid 2 updating version 941 to 943 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2311: oid 2 version 943 is already newer than 942 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 943 (ObjNum 789 snap 243 seq_num 789) dirty exists 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2311: left oid 2 (ObjNum 789 snap 243 seq_num 789) 2026-02-12T17:38:31.171 INFO:tasks.rados.rados.0.trial082.stdout:2312: finishing write tid 1 to trial08226312-27 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2312: finishing write tid 2 to trial08226312-27 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2312: finishing write tid 3 to trial08226312-27 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2312: finishing write tid 4 to trial08226312-27 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2312: finishing write tid 5 to trial08226312-27 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2312: oid 27 updating version 0 to 1090 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2312: oid 27 updating version 1090 to 1092 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2312: oid 27 version 1092 is already newer than 1089 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2312: oid 27 version 1092 is already newer than 1091 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1092 (ObjNum 790 snap 243 seq_num 790) dirty exists 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2312: left oid 27 (ObjNum 790 snap 243 seq_num 790) 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2314: finishing write tid 1 to trial08226312-46 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2314: finishing write tid 2 to trial08226312-46 2026-02-12T17:38:31.172 INFO:tasks.rados.rados.0.trial082.stdout:2314: finishing write tid 3 to trial08226312-46 2026-02-12T17:38:31.173 INFO:tasks.rados.rados.0.trial082.stdout:2314: finishing write tid 4 to trial08226312-46 2026-02-12T17:38:31.173 INFO:tasks.rados.rados.0.trial082.stdout:2314: finishing write tid 5 to trial08226312-46 2026-02-12T17:38:31.173 INFO:tasks.rados.rados.0.trial082.stdout:2314: oid 46 updating version 0 to 1268 2026-02-12T17:38:31.173 INFO:tasks.rados.rados.0.trial082.stdout:2314: oid 46 updating version 1268 to 1269 2026-02-12T17:38:31.173 INFO:tasks.rados.rados.0.trial082.stdout:2314: oid 46 version 1269 is already newer than 1267 2026-02-12T17:38:31.173 INFO:tasks.rados.rados.0.trial082.stdout:2314: oid 46 updating version 1269 to 1270 2026-02-12T17:38:31.173 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1270 (ObjNum 791 snap 243 seq_num 791) dirty exists 2026-02-12T17:38:31.173 INFO:tasks.rados.rados.0.trial082.stdout:2314: left oid 46 (ObjNum 791 snap 243 seq_num 791) 2026-02-12T17:38:32.379 INFO:tasks.rados.rados.0.trial082.stdout:2306: done (10 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2307: done (9 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2308: done (8 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2309: done (7 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2310: done (6 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2311: done (5 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2312: done (4 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2313: done (3 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2314: done (2 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2315: done (1 left) 2026-02-12T17:38:32.380 INFO:tasks.rados.rados.0.trial082.stdout:2317: done (0 left) 2026-02-12T17:38:32.381 INFO:tasks.rados.rados.0.trial082.stdout:2318: delete oid 48 current snap is 244 2026-02-12T17:38:32.382 INFO:tasks.rados.rados.0.trial082.stdout:2318: done (0 left) 2026-02-12T17:38:32.382 INFO:tasks.rados.rados.0.trial082.stdout:2319: read oid 31 snap 232 2026-02-12T17:38:32.382 INFO:tasks.rados.rados.0.trial082.stdout:2319: expect deleted 2026-02-12T17:38:32.382 INFO:tasks.rados.rados.0.trial082.stdout:2320: copy_from oid 26 from oid 12 current snap is 244 2026-02-12T17:38:32.382 INFO:tasks.rados.rados.0.trial082.stdout:2321: snap_remove snap 233 2026-02-12T17:38:33.071 INFO:tasks.rados.rados.0.trial082.stdout:2321: done (2 left) 2026-02-12T17:38:33.071 INFO:tasks.rados.rados.0.trial082.stdout:2322: copy_from oid 42 from oid 40 current snap is 244 2026-02-12T17:38:33.072 INFO:tasks.rados.rados.0.trial082.stdout:2320: finishing copy_from racing read to trial08226312-26 2026-02-12T17:38:33.072 INFO:tasks.rados.rados.0.trial082.stdout:2320: finishing copy_from to trial08226312-26 2026-02-12T17:38:33.072 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1125 (ObjNum 690 snap 208 seq_num 690) dirty exists 2026-02-12T17:38:33.072 INFO:tasks.rados.rados.0.trial082.stdout:2319: done (2 left) 2026-02-12T17:38:33.072 INFO:tasks.rados.rados.0.trial082.stdout:2320: done (1 left) 2026-02-12T17:38:33.072 INFO:tasks.rados.rados.0.trial082.stdout:2323: snap_remove snap 236 2026-02-12T17:38:34.072 INFO:tasks.rados.rados.0.trial082.stdout:2323: done (1 left) 2026-02-12T17:38:34.072 INFO:tasks.rados.rados.0.trial082.stdout:2324: snap_remove snap 225 2026-02-12T17:38:35.074 INFO:tasks.rados.rados.0.trial082.stdout:2324: done (1 left) 2026-02-12T17:38:35.074 INFO:tasks.rados.rados.0.trial082.stdout:2325: snap_create 2026-02-12T17:38:35.075 INFO:tasks.rados.rados.0.trial082.stdout:2322: finishing copy_from racing read to trial08226312-42 2026-02-12T17:38:35.075 INFO:tasks.rados.rados.0.trial082.stdout:2322: finishing copy_from to trial08226312-42 2026-02-12T17:38:35.075 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 1501 (ObjNum 732 snap 217 seq_num 732) dirty exists 2026-02-12T17:38:36.073 INFO:tasks.rados.rados.0.trial082.stdout:2322: done (1 left) 2026-02-12T17:38:36.073 INFO:tasks.rados.rados.0.trial082.stdout:2325: done (0 left) 2026-02-12T17:38:36.074 INFO:tasks.rados.rados.0.trial082.stdout:2326: delete oid 2 current snap is 245 2026-02-12T17:38:36.076 INFO:tasks.rados.rados.0.trial082.stdout:2326: done (0 left) 2026-02-12T17:38:36.076 INFO:tasks.rados.rados.0.trial082.stdout:2327: write oid 12 current snap is 245 2026-02-12T17:38:36.076 INFO:tasks.rados.rados.0.trial082.stdout:2327: seq_num 794 ranges {544758=648418,1846585=416944,2771268=573490} 2026-02-12T17:38:36.080 INFO:tasks.rados.rados.0.trial082.stdout:2327: writing trial08226312-12 from 544758 to 1193176 tid 1 2026-02-12T17:38:36.084 INFO:tasks.rados.rados.0.trial082.stdout:2327: writing trial08226312-12 from 1846585 to 2263529 tid 2 2026-02-12T17:38:36.088 INFO:tasks.rados.rados.0.trial082.stdout:2327: writing trial08226312-12 from 2771268 to 3344758 tid 3 2026-02-12T17:38:36.088 INFO:tasks.rados.rados.0.trial082.stdout:2328: write oid 3 current snap is 245 2026-02-12T17:38:36.088 INFO:tasks.rados.rados.0.trial082.stdout:2328: seq_num 795 ranges {561565=723667,1905067=560602,3082338=279227} 2026-02-12T17:38:36.093 INFO:tasks.rados.rados.0.trial082.stdout:2328: writing trial08226312-3 from 561565 to 1285232 tid 1 2026-02-12T17:38:36.097 INFO:tasks.rados.rados.0.trial082.stdout:2328: writing trial08226312-3 from 1905067 to 2465669 tid 2 2026-02-12T17:38:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2328: writing trial08226312-3 from 3082338 to 3361565 tid 3 2026-02-12T17:38:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2329: copy_from oid 4 from oid 40 current snap is 245 2026-02-12T17:38:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2327: finishing write tid 1 to trial08226312-12 2026-02-12T17:38:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2327: finishing write tid 2 to trial08226312-12 2026-02-12T17:38:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2327: finishing write tid 3 to trial08226312-12 2026-02-12T17:38:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2327: finishing write tid 4 to trial08226312-12 2026-02-12T17:38:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2327: finishing write tid 5 to trial08226312-12 2026-02-12T17:38:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2327: oid 12 updating version 0 to 1130 2026-02-12T17:38:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2327: oid 12 version 1130 is already newer than 1129 2026-02-12T17:38:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2327: oid 12 updating version 1130 to 1131 2026-02-12T17:38:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2327: oid 12 version 1131 is already newer than 1128 2026-02-12T17:38:36.102 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1131 (ObjNum 794 snap 245 seq_num 794) dirty exists 2026-02-12T17:38:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2327: left oid 12 (ObjNum 794 snap 245 seq_num 794) 2026-02-12T17:38:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2328: finishing write tid 1 to trial08226312-3 2026-02-12T17:38:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2328: finishing write tid 2 to trial08226312-3 2026-02-12T17:38:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2327: done (2 left) 2026-02-12T17:38:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2330: snap_create 2026-02-12T17:38:36.103 INFO:tasks.rados.rados.0.trial082.stdout:2328: finishing write tid 3 to trial08226312-3 2026-02-12T17:38:36.103 INFO:tasks.rados.rados.0.trial082.stdout:2328: finishing write tid 4 to trial08226312-3 2026-02-12T17:38:36.103 INFO:tasks.rados.rados.0.trial082.stdout:2328: finishing write tid 5 to trial08226312-3 2026-02-12T17:38:36.103 INFO:tasks.rados.rados.0.trial082.stdout:2328: oid 3 updating version 0 to 942 2026-02-12T17:38:36.103 INFO:tasks.rados.rados.0.trial082.stdout:2328: oid 3 version 942 is already newer than 941 2026-02-12T17:38:36.103 INFO:tasks.rados.rados.0.trial082.stdout:2328: oid 3 version 942 is already newer than 939 2026-02-12T17:38:36.103 INFO:tasks.rados.rados.0.trial082.stdout:2328: oid 3 version 942 is already newer than 940 2026-02-12T17:38:36.103 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 942 (ObjNum 795 snap 245 seq_num 795) dirty exists 2026-02-12T17:38:36.104 INFO:tasks.rados.rados.0.trial082.stdout:2328: left oid 3 (ObjNum 795 snap 245 seq_num 795) 2026-02-12T17:38:36.105 INFO:tasks.rados.rados.0.trial082.stdout:2329: finishing copy_from racing read to trial08226312-4 2026-02-12T17:38:36.106 INFO:tasks.rados.rados.0.trial082.stdout:2329: finishing copy_from to trial08226312-4 2026-02-12T17:38:36.106 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 1501 (ObjNum 732 snap 217 seq_num 732) dirty exists 2026-02-12T17:38:37.079 INFO:tasks.rados.rados.0.trial082.stdout:2328: done (2 left) 2026-02-12T17:38:37.079 INFO:tasks.rados.rados.0.trial082.stdout:2329: done (1 left) 2026-02-12T17:38:37.079 INFO:tasks.rados.rados.0.trial082.stdout:2330: done (0 left) 2026-02-12T17:38:37.080 INFO:tasks.rados.rados.0.trial082.stdout:2331: snap_create 2026-02-12T17:38:38.071 INFO:tasks.rados.rados.0.trial082.stdout:2331: done (0 left) 2026-02-12T17:38:38.072 INFO:tasks.rados.rados.0.trial082.stdout:2332: rollback oid 32 current snap is 247 2026-02-12T17:38:38.072 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 240 2026-02-12T17:38:38.072 INFO:tasks.rados.rados.0.trial082.stdout:2333: snap_create 2026-02-12T17:38:38.072 INFO:tasks.rados.rados.0.trial082.stdout:2332: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:38:38.072 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 0 (ObjNum 433 snap 0 seq_num 27583906) dirty dne 2026-02-12T17:38:39.072 INFO:tasks.rados.rados.0.trial082.stdout:2332: done (1 left) 2026-02-12T17:38:39.073 INFO:tasks.rados.rados.0.trial082.stdout:2333: done (0 left) 2026-02-12T17:38:39.073 INFO:tasks.rados.rados.0.trial082.stdout:2334: read oid 47 snap -1 2026-02-12T17:38:39.073 INFO:tasks.rados.rados.0.trial082.stdout:2334: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:38:39.073 INFO:tasks.rados.rados.0.trial082.stdout:2335: write (excl) oid 27 current snap is 248 2026-02-12T17:38:39.073 INFO:tasks.rados.rados.0.trial082.stdout:2335: seq_num 796 ranges {578372=798916,1963549=420613,2826114=417934} 2026-02-12T17:38:39.077 INFO:tasks.rados.rados.0.trial082.stdout:2335: writing trial08226312-27 from 578372 to 1377288 tid 1 2026-02-12T17:38:39.081 INFO:tasks.rados.rados.0.trial082.stdout:2335: writing trial08226312-27 from 1963549 to 2384162 tid 2 2026-02-12T17:38:39.085 INFO:tasks.rados.rados.0.trial082.stdout:2335: writing trial08226312-27 from 2826114 to 3244048 tid 3 2026-02-12T17:38:39.086 INFO:tasks.rados.rados.0.trial082.stdout:2336: rollback oid 37 current snap is 248 2026-02-12T17:38:39.086 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 37 to 231 2026-02-12T17:38:39.086 INFO:tasks.rados.rados.0.trial082.stdout:2334: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:38:39.181 INFO:tasks.rados.rados.0.trial082.stdout:2335: finishing write tid 1 to trial08226312-27 2026-02-12T17:38:39.181 INFO:tasks.rados.rados.0.trial082.stdout:2335: finishing write tid 2 to trial08226312-27 2026-02-12T17:38:39.181 INFO:tasks.rados.rados.0.trial082.stdout:2334: done (2 left) 2026-02-12T17:38:39.181 INFO:tasks.rados.rados.0.trial082.stdout:2337: write (excl) oid 16 current snap is 248 2026-02-12T17:38:39.181 INFO:tasks.rados.rados.0.trial082.stdout:2335: finishing write tid 3 to trial08226312-27 2026-02-12T17:38:39.181 INFO:tasks.rados.rados.0.trial082.stdout:2335: finishing write tid 4 to trial08226312-27 2026-02-12T17:38:39.182 INFO:tasks.rados.rados.0.trial082.stdout:2337: seq_num 797 ranges {595179=474165,1622031=564271,2737184=629206} 2026-02-12T17:38:39.184 INFO:tasks.rados.rados.0.trial082.stdout:2337: writing trial08226312-16 from 595179 to 1069344 tid 1 2026-02-12T17:38:39.189 INFO:tasks.rados.rados.0.trial082.stdout:2337: writing trial08226312-16 from 1622031 to 2186302 tid 2 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:2337: writing trial08226312-16 from 2737184 to 3366390 tid 3 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:2338: read oid 44 snap -1 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:2338: expect (ObjNum 771 snap 234 seq_num 771) 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:2339: copy_from oid 22 from oid 14 current snap is 248 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:2335: finishing write tid 5 to trial08226312-27 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:2335: oid 27 updating version 0 to 1096 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:2335: oid 27 version 1096 is already newer than 1093 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:2335: oid 27 version 1096 is already newer than 1094 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:2335: oid 27 version 1096 is already newer than 1095 2026-02-12T17:38:39.194 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1096 (ObjNum 796 snap 248 seq_num 796) dirty exists 2026-02-12T17:38:39.195 INFO:tasks.rados.rados.0.trial082.stdout:2335: left oid 27 (ObjNum 796 snap 248 seq_num 796) 2026-02-12T17:38:39.195 INFO:tasks.rados.rados.0.trial082.stdout:2336: finishing rollback tid 1 to trial08226312-37 2026-02-12T17:38:39.195 INFO:tasks.rados.rados.0.trial082.stdout:2336: finishing rollback tid 2 to trial08226312-37 2026-02-12T17:38:39.195 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1133 (ObjNum 736 snap 224 seq_num 736) dirty exists 2026-02-12T17:38:39.195 INFO:tasks.rados.rados.0.trial082.stdout:2337: finishing write tid 1 to trial08226312-16 2026-02-12T17:38:39.195 INFO:tasks.rados.rados.0.trial082.stdout:2337: finishing write tid 2 to trial08226312-16 2026-02-12T17:38:39.195 INFO:tasks.rados.rados.0.trial082.stdout:2335: done (4 left) 2026-02-12T17:38:39.195 INFO:tasks.rados.rados.0.trial082.stdout:2336: done (3 left) 2026-02-12T17:38:39.195 INFO:tasks.rados.rados.0.trial082.stdout:2340: delete oid 28 current snap is 248 2026-02-12T17:38:39.196 INFO:tasks.rados.rados.0.trial082.stdout:2337: finishing write tid 3 to trial08226312-16 2026-02-12T17:38:39.196 INFO:tasks.rados.rados.0.trial082.stdout:2337: finishing write tid 4 to trial08226312-16 2026-02-12T17:38:39.196 INFO:tasks.rados.rados.0.trial082.stdout:2337: finishing write tid 5 to trial08226312-16 2026-02-12T17:38:39.196 INFO:tasks.rados.rados.0.trial082.stdout:2337: oid 16 updating version 0 to 1576 2026-02-12T17:38:39.197 INFO:tasks.rados.rados.0.trial082.stdout:2337: oid 16 version 1576 is already newer than 1575 2026-02-12T17:38:39.197 INFO:tasks.rados.rados.0.trial082.stdout:2337: oid 16 version 1576 is already newer than 1573 2026-02-12T17:38:39.197 INFO:tasks.rados.rados.0.trial082.stdout:2337: oid 16 version 1576 is already newer than 1574 2026-02-12T17:38:39.197 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1576 (ObjNum 797 snap 248 seq_num 797) dirty exists 2026-02-12T17:38:39.197 INFO:tasks.rados.rados.0.trial082.stdout:2337: left oid 16 (ObjNum 797 snap 248 seq_num 797) 2026-02-12T17:38:39.197 INFO:tasks.rados.rados.0.trial082.stdout:2337: done (3 left) 2026-02-12T17:38:39.197 INFO:tasks.rados.rados.0.trial082.stdout:2340: done (2 left) 2026-02-12T17:38:39.197 INFO:tasks.rados.rados.0.trial082.stdout:2341: snap_create 2026-02-12T17:38:39.198 INFO:tasks.rados.rados.0.trial082.stdout:2338: expect (ObjNum 771 snap 234 seq_num 771) 2026-02-12T17:38:39.230 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:39.306 INFO:tasks.rados.rados.0.trial082.stdout:2339: finishing copy_from racing read to trial08226312-22 2026-02-12T17:38:39.306 INFO:tasks.rados.rados.0.trial082.stdout:2339: finishing copy_from to trial08226312-22 2026-02-12T17:38:39.307 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 920 (ObjNum 739 snap 224 seq_num 739) dirty exists 2026-02-12T17:38:40.088 INFO:tasks.rados.rados.0.trial082.stdout:2338: done (2 left) 2026-02-12T17:38:40.089 INFO:tasks.rados.rados.0.trial082.stdout:2339: done (1 left) 2026-02-12T17:38:40.089 INFO:tasks.rados.rados.0.trial082.stdout:2341: done (0 left) 2026-02-12T17:38:40.089 INFO:tasks.rados.rados.0.trial082.stdout:2342: rollback oid 22 current snap is 249 2026-02-12T17:38:40.089 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 232 2026-02-12T17:38:40.089 INFO:tasks.rados.rados.0.trial082.stdout:2343: delete oid 37 current snap is 249 2026-02-12T17:38:40.091 INFO:tasks.rados.rados.0.trial082.stdout:2343: done (1 left) 2026-02-12T17:38:40.091 INFO:tasks.rados.rados.0.trial082.stdout:2344: rollback oid 8 current snap is 249 2026-02-12T17:38:40.092 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 232 2026-02-12T17:38:40.092 INFO:tasks.rados.rados.0.trial082.stdout:2345: write (excl) oid 43 current snap is 249 2026-02-12T17:38:40.092 INFO:tasks.rados.rados.0.trial082.stdout:2345: seq_num 800 ranges {645600=416265,1797477=711598,3219453=226147} 2026-02-12T17:38:40.095 INFO:tasks.rados.rados.0.trial082.stdout:2345: writing trial08226312-43 from 645600 to 1061865 tid 1 2026-02-12T17:38:40.101 INFO:tasks.rados.rados.0.trial082.stdout:2345: writing trial08226312-43 from 1797477 to 2509075 tid 2 2026-02-12T17:38:40.104 INFO:tasks.rados.rados.0.trial082.stdout:2345: writing trial08226312-43 from 3219453 to 3445600 tid 3 2026-02-12T17:38:40.105 INFO:tasks.rados.rados.0.trial082.stdout:2346: snap_remove snap 240 2026-02-12T17:38:41.091 INFO:tasks.rados.rados.0.trial082.stdout:2346: done (3 left) 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:2347: read oid 10 snap -1 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:2347: expect (ObjNum 751 snap 230 seq_num 751) 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:2348: rollback oid 49 current snap is 249 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 227 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:2342: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:2342: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:2342: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 1528 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:2344: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:2344: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:38:41.092 INFO:tasks.rados.rados.0.trial082.stdout:2344: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:38:41.093 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1736 (ObjNum 713 snap 213 seq_num 713) dirty exists 2026-02-12T17:38:41.093 INFO:tasks.rados.rados.0.trial082.stdout:2345: finishing write tid 1 to trial08226312-43 2026-02-12T17:38:41.093 INFO:tasks.rados.rados.0.trial082.stdout:2345: finishing write tid 2 to trial08226312-43 2026-02-12T17:38:41.093 INFO:tasks.rados.rados.0.trial082.stdout:2345: finishing write tid 3 to trial08226312-43 2026-02-12T17:38:41.093 INFO:tasks.rados.rados.0.trial082.stdout:2342: done (4 left) 2026-02-12T17:38:41.093 INFO:tasks.rados.rados.0.trial082.stdout:2344: done (3 left) 2026-02-12T17:38:41.093 INFO:tasks.rados.rados.0.trial082.stdout:2349: read oid 18 snap -1 2026-02-12T17:38:41.093 INFO:tasks.rados.rados.0.trial082.stdout:2349: expect deleted 2026-02-12T17:38:41.093 INFO:tasks.rados.rados.0.trial082.stdout:2350: snap_remove snap 248 2026-02-12T17:38:42.093 INFO:tasks.rados.rados.0.trial082.stdout:2350: done (4 left) 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:2351: copy_from oid 46 from oid 9 current snap is 249 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:2345: finishing write tid 4 to trial08226312-43 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:2345: finishing write tid 5 to trial08226312-43 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:2345: oid 43 updating version 0 to 1531 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:2345: oid 43 updating version 1531 to 1532 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:2345: oid 43 version 1532 is already newer than 1529 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:2345: oid 43 version 1532 is already newer than 1530 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 1532 (ObjNum 800 snap 249 seq_num 800) dirty exists 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:2345: left oid 43 (ObjNum 800 snap 249 seq_num 800) 2026-02-12T17:38:42.094 INFO:tasks.rados.rados.0.trial082.stdout:2348: finishing rollback tid 0 to trial08226312-49 2026-02-12T17:38:42.095 INFO:tasks.rados.rados.0.trial082.stdout:2348: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:38:42.095 INFO:tasks.rados.rados.0.trial082.stdout:2348: finishing rollback tid 2 to trial08226312-49 2026-02-12T17:38:42.095 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 1522 (ObjNum 654 snap 202 seq_num 654) dirty exists 2026-02-12T17:38:42.095 INFO:tasks.rados.rados.0.trial082.stdout:2347: expect (ObjNum 751 snap 230 seq_num 751) 2026-02-12T17:38:42.124 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:42.161 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:42.197 INFO:tasks.rados.rados.0.trial082.stdout:2351: finishing copy_from racing read to trial08226312-46 2026-02-12T17:38:42.197 INFO:tasks.rados.rados.0.trial082.stdout:2351: finishing copy_from to trial08226312-46 2026-02-12T17:38:42.197 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1317 (ObjNum 706 snap 212 seq_num 706) dirty exists 2026-02-12T17:38:42.198 INFO:tasks.rados.rados.0.trial082.stdout:2345: done (4 left) 2026-02-12T17:38:42.198 INFO:tasks.rados.rados.0.trial082.stdout:2347: done (3 left) 2026-02-12T17:38:42.198 INFO:tasks.rados.rados.0.trial082.stdout:2348: done (2 left) 2026-02-12T17:38:42.198 INFO:tasks.rados.rados.0.trial082.stdout:2349: done (1 left) 2026-02-12T17:38:42.198 INFO:tasks.rados.rados.0.trial082.stdout:2351: done (0 left) 2026-02-12T17:38:42.198 INFO:tasks.rados.rados.0.trial082.stdout:2352: write (excl) oid 8 current snap is 249 2026-02-12T17:38:42.198 INFO:tasks.rados.rados.0.trial082.stdout:2352: seq_num 801 ranges {662407=491514,1855959=571609,2846876=615531} 2026-02-12T17:38:42.202 INFO:tasks.rados.rados.0.trial082.stdout:2352: writing trial08226312-8 from 662407 to 1153921 tid 1 2026-02-12T17:38:42.206 INFO:tasks.rados.rados.0.trial082.stdout:2352: writing trial08226312-8 from 1855959 to 2427568 tid 2 2026-02-12T17:38:42.210 INFO:tasks.rados.rados.0.trial082.stdout:2352: writing trial08226312-8 from 2846876 to 3462407 tid 3 2026-02-12T17:38:42.211 INFO:tasks.rados.rados.0.trial082.stdout:2353: rollback oid 28 current snap is 249 2026-02-12T17:38:42.211 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 245 2026-02-12T17:38:42.211 INFO:tasks.rados.rados.0.trial082.stdout:2352: finishing write tid 1 to trial08226312-8 2026-02-12T17:38:42.211 INFO:tasks.rados.rados.0.trial082.stdout:2352: finishing write tid 2 to trial08226312-8 2026-02-12T17:38:42.211 INFO:tasks.rados.rados.0.trial082.stdout:2354: write oid 31 current snap is 249 2026-02-12T17:38:42.211 INFO:tasks.rados.rados.0.trial082.stdout:2354: seq_num 802 ranges {679214=566763,1798088=715267,3157946=321268} 2026-02-12T17:38:42.215 INFO:tasks.rados.rados.0.trial082.stdout:2354: writing trial08226312-31 from 679214 to 1245977 tid 1 2026-02-12T17:38:42.219 INFO:tasks.rados.rados.0.trial082.stdout:2354: writing trial08226312-31 from 1798088 to 2513355 tid 2 2026-02-12T17:38:42.223 INFO:tasks.rados.rados.0.trial082.stdout:2354: writing trial08226312-31 from 3157946 to 3479214 tid 3 2026-02-12T17:38:42.223 INFO:tasks.rados.rados.0.trial082.stdout:2355: snap_remove snap 243 2026-02-12T17:38:43.075 INFO:tasks.rados.rados.0.trial082.stdout:2355: done (3 left) 2026-02-12T17:38:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2356: rollback oid 40 current snap is 249 2026-02-12T17:38:43.076 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 40 to 228 2026-02-12T17:38:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2353: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:38:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2353: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:38:43.076 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1579 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:38:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2352: finishing write tid 3 to trial08226312-8 2026-02-12T17:38:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2352: finishing write tid 4 to trial08226312-8 2026-02-12T17:38:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2352: finishing write tid 5 to trial08226312-8 2026-02-12T17:38:43.076 INFO:tasks.rados.rados.0.trial082.stdout:2352: oid 8 updating version 0 to 1749 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2352: oid 8 updating version 1749 to 1751 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2352: oid 8 version 1751 is already newer than 1750 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2352: oid 8 updating version 1751 to 1752 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1752 (ObjNum 801 snap 249 seq_num 801) dirty exists 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2352: left oid 8 (ObjNum 801 snap 249 seq_num 801) 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2354: finishing write tid 1 to trial08226312-31 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2352: done (3 left) 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2353: done (2 left) 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2357: rollback oid 46 current snap is 249 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 46 to 227 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2354: finishing write tid 2 to trial08226312-31 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2354: finishing write tid 3 to trial08226312-31 2026-02-12T17:38:43.077 INFO:tasks.rados.rados.0.trial082.stdout:2354: finishing write tid 4 to trial08226312-31 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:2354: finishing write tid 5 to trial08226312-31 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:2354: oid 31 updating version 0 to 1097 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:2354: oid 31 updating version 1097 to 1099 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:2354: oid 31 version 1099 is already newer than 1098 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:2354: oid 31 updating version 1099 to 1100 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 1100 (ObjNum 802 snap 249 seq_num 802) dirty exists 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:2354: left oid 31 (ObjNum 802 snap 249 seq_num 802) 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:2354: done (2 left) 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:2358: write (excl) oid 34 current snap is 249 2026-02-12T17:38:43.078 INFO:tasks.rados.rados.0.trial082.stdout:2358: seq_num 803 ranges {696021=642012,1856570=575278,3185369=310652} 2026-02-12T17:38:43.079 INFO:tasks.rados.rados.0.trial082.stdout:2358: writing trial08226312-34 from 696021 to 1338033 tid 1 2026-02-12T17:38:43.083 INFO:tasks.rados.rados.0.trial082.stdout:2358: writing trial08226312-34 from 1856570 to 2431848 tid 2 2026-02-12T17:38:43.088 INFO:tasks.rados.rados.0.trial082.stdout:2358: writing trial08226312-34 from 3185369 to 3496021 tid 3 2026-02-12T17:38:43.088 INFO:tasks.rados.rados.0.trial082.stdout:2359: snap_create 2026-02-12T17:38:43.088 INFO:tasks.rados.rados.0.trial082.stdout:2356: finishing rollback tid 0 to trial08226312-40 2026-02-12T17:38:43.088 INFO:tasks.rados.rados.0.trial082.stdout:2356: finishing rollback tid 1 to trial08226312-40 2026-02-12T17:38:43.088 INFO:tasks.rados.rados.0.trial082.stdout:2356: finishing rollback tid 2 to trial08226312-40 2026-02-12T17:38:43.088 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1582 (ObjNum 750 snap 227 seq_num 750) dirty exists 2026-02-12T17:38:43.088 INFO:tasks.rados.rados.0.trial082.stdout:2357: finishing rollback tid 0 to trial08226312-46 2026-02-12T17:38:43.088 INFO:tasks.rados.rados.0.trial082.stdout:2357: finishing rollback tid 1 to trial08226312-46 2026-02-12T17:38:43.088 INFO:tasks.rados.rados.0.trial082.stdout:2357: finishing rollback tid 2 to trial08226312-46 2026-02-12T17:38:43.089 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1320 (ObjNum 728 snap 214 seq_num 728) dirty exists 2026-02-12T17:38:43.089 INFO:tasks.rados.rados.0.trial082.stdout:2358: finishing write tid 1 to trial08226312-34 2026-02-12T17:38:43.089 INFO:tasks.rados.rados.0.trial082.stdout:2358: finishing write tid 2 to trial08226312-34 2026-02-12T17:38:43.089 INFO:tasks.rados.rados.0.trial082.stdout:2358: finishing write tid 3 to trial08226312-34 2026-02-12T17:38:43.090 INFO:tasks.rados.rados.0.trial082.stdout:2358: finishing write tid 4 to trial08226312-34 2026-02-12T17:38:43.090 INFO:tasks.rados.rados.0.trial082.stdout:2358: finishing write tid 5 to trial08226312-34 2026-02-12T17:38:43.090 INFO:tasks.rados.rados.0.trial082.stdout:2358: oid 34 updating version 0 to 1525 2026-02-12T17:38:43.090 INFO:tasks.rados.rados.0.trial082.stdout:2358: oid 34 updating version 1525 to 1526 2026-02-12T17:38:43.090 INFO:tasks.rados.rados.0.trial082.stdout:2358: oid 34 version 1526 is already newer than 1524 2026-02-12T17:38:43.090 INFO:tasks.rados.rados.0.trial082.stdout:2358: oid 34 version 1526 is already newer than 1523 2026-02-12T17:38:43.090 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1526 (ObjNum 803 snap 249 seq_num 803) dirty exists 2026-02-12T17:38:43.090 INFO:tasks.rados.rados.0.trial082.stdout:2358: left oid 34 (ObjNum 803 snap 249 seq_num 803) 2026-02-12T17:38:44.074 INFO:tasks.rados.rados.0.trial082.stdout:2356: done (3 left) 2026-02-12T17:38:44.074 INFO:tasks.rados.rados.0.trial082.stdout:2357: done (2 left) 2026-02-12T17:38:44.074 INFO:tasks.rados.rados.0.trial082.stdout:2358: done (1 left) 2026-02-12T17:38:44.074 INFO:tasks.rados.rados.0.trial082.stdout:2359: done (0 left) 2026-02-12T17:38:44.074 INFO:tasks.rados.rados.0.trial082.stdout:2360: snap_remove snap 231 2026-02-12T17:38:45.075 INFO:tasks.rados.rados.0.trial082.stdout:2360: done (0 left) 2026-02-12T17:38:45.075 INFO:tasks.rados.rados.0.trial082.stdout:2361: write oid 32 current snap is 250 2026-02-12T17:38:45.075 INFO:tasks.rados.rados.0.trial082.stdout:2361: seq_num 804 ranges {712828=717261,1915052=718936,3212792=300036} 2026-02-12T17:38:45.080 INFO:tasks.rados.rados.0.trial082.stdout:2361: writing trial08226312-32 from 712828 to 1430089 tid 1 2026-02-12T17:38:45.085 INFO:tasks.rados.rados.0.trial082.stdout:2361: writing trial08226312-32 from 1915052 to 2633988 tid 2 2026-02-12T17:38:45.088 INFO:tasks.rados.rados.0.trial082.stdout:2361: writing trial08226312-32 from 3212792 to 3512828 tid 3 2026-02-12T17:38:45.089 INFO:tasks.rados.rados.0.trial082.stdout:2362: read oid 50 snap -1 2026-02-12T17:38:45.089 INFO:tasks.rados.rados.0.trial082.stdout:2362: expect deleted 2026-02-12T17:38:45.089 INFO:tasks.rados.rados.0.trial082.stdout:2363: snap_create 2026-02-12T17:38:45.089 INFO:tasks.rados.rados.0.trial082.stdout:2361: finishing write tid 1 to trial08226312-32 2026-02-12T17:38:45.089 INFO:tasks.rados.rados.0.trial082.stdout:2361: finishing write tid 2 to trial08226312-32 2026-02-12T17:38:45.090 INFO:tasks.rados.rados.0.trial082.stdout:2361: finishing write tid 3 to trial08226312-32 2026-02-12T17:38:45.090 INFO:tasks.rados.rados.0.trial082.stdout:2361: finishing write tid 4 to trial08226312-32 2026-02-12T17:38:45.090 INFO:tasks.rados.rados.0.trial082.stdout:2361: finishing write tid 5 to trial08226312-32 2026-02-12T17:38:45.090 INFO:tasks.rados.rados.0.trial082.stdout:2361: oid 32 updating version 0 to 854 2026-02-12T17:38:45.090 INFO:tasks.rados.rados.0.trial082.stdout:2361: oid 32 version 854 is already newer than 851 2026-02-12T17:38:45.090 INFO:tasks.rados.rados.0.trial082.stdout:2361: oid 32 version 854 is already newer than 853 2026-02-12T17:38:45.091 INFO:tasks.rados.rados.0.trial082.stdout:2361: oid 32 version 854 is already newer than 852 2026-02-12T17:38:45.091 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 854 (ObjNum 804 snap 250 seq_num 804) dirty exists 2026-02-12T17:38:45.091 INFO:tasks.rados.rados.0.trial082.stdout:2361: left oid 32 (ObjNum 804 snap 250 seq_num 804) 2026-02-12T17:38:46.079 INFO:tasks.rados.rados.0.trial082.stdout:2361: done (2 left) 2026-02-12T17:38:46.079 INFO:tasks.rados.rados.0.trial082.stdout:2362: done (1 left) 2026-02-12T17:38:46.079 INFO:tasks.rados.rados.0.trial082.stdout:2363: done (0 left) 2026-02-12T17:38:46.080 INFO:tasks.rados.rados.0.trial082.stdout:2364: rollback oid 10 current snap is 251 2026-02-12T17:38:46.080 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 10 to 216 2026-02-12T17:38:46.080 INFO:tasks.rados.rados.0.trial082.stdout:2365: delete oid 49 current snap is 251 2026-02-12T17:38:46.082 INFO:tasks.rados.rados.0.trial082.stdout:2364: finishing rollback tid 0 to trial08226312-10 2026-02-12T17:38:46.082 INFO:tasks.rados.rados.0.trial082.stdout:2364: finishing rollback tid 1 to trial08226312-10 2026-02-12T17:38:46.082 INFO:tasks.rados.rados.0.trial082.stdout:2364: finishing rollback tid 2 to trial08226312-10 2026-02-12T17:38:46.082 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1535 (ObjNum 707 snap 212 seq_num 707) dirty exists 2026-02-12T17:38:46.082 INFO:tasks.rados.rados.0.trial082.stdout:2364: done (1 left) 2026-02-12T17:38:46.083 INFO:tasks.rados.rados.0.trial082.stdout:2365: done (0 left) 2026-02-12T17:38:46.083 INFO:tasks.rados.rados.0.trial082.stdout:2366: rollback oid 33 current snap is 251 2026-02-12T17:38:46.083 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 249 2026-02-12T17:38:46.083 INFO:tasks.rados.rados.0.trial082.stdout:2367: write (excl) oid 3 current snap is 251 2026-02-12T17:38:46.083 INFO:tasks.rados.rados.0.trial082.stdout:2367: seq_num 806 ranges {746442=584112,1748369=722605,2983991=562451} 2026-02-12T17:38:46.087 INFO:tasks.rados.rados.0.trial082.stdout:2367: writing trial08226312-3 from 746442 to 1330554 tid 1 2026-02-12T17:38:46.091 INFO:tasks.rados.rados.0.trial082.stdout:2367: writing trial08226312-3 from 1748369 to 2470974 tid 2 2026-02-12T17:38:46.095 INFO:tasks.rados.rados.0.trial082.stdout:2367: writing trial08226312-3 from 2983991 to 3546442 tid 3 2026-02-12T17:38:46.095 INFO:tasks.rados.rados.0.trial082.stdout:2368: write (excl) oid 5 current snap is 251 2026-02-12T17:38:46.095 INFO:tasks.rados.rados.0.trial082.stdout:2368: seq_num 807 ranges {763249=659361,2090498=582616,3295061=268188} 2026-02-12T17:38:46.100 INFO:tasks.rados.rados.0.trial082.stdout:2368: writing trial08226312-5 from 763249 to 1422610 tid 1 2026-02-12T17:38:46.105 INFO:tasks.rados.rados.0.trial082.stdout:2368: writing trial08226312-5 from 2090498 to 2673114 tid 2 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:2368: writing trial08226312-5 from 3295061 to 3563249 tid 3 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:2369: snap_create 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:2366: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1127 (ObjNum 81 snap 0 seq_num 1) dirty dne 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:2367: finishing write tid 1 to trial08226312-3 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:2367: finishing write tid 2 to trial08226312-3 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:2367: finishing write tid 3 to trial08226312-3 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:2367: finishing write tid 4 to trial08226312-3 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:2367: finishing write tid 5 to trial08226312-3 2026-02-12T17:38:46.109 INFO:tasks.rados.rados.0.trial082.stdout:2367: oid 3 updating version 0 to 948 2026-02-12T17:38:46.110 INFO:tasks.rados.rados.0.trial082.stdout:2367: oid 3 updating version 948 to 950 2026-02-12T17:38:46.110 INFO:tasks.rados.rados.0.trial082.stdout:2367: oid 3 version 950 is already newer than 949 2026-02-12T17:38:46.110 INFO:tasks.rados.rados.0.trial082.stdout:2367: oid 3 version 950 is already newer than 947 2026-02-12T17:38:46.110 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 950 (ObjNum 806 snap 251 seq_num 806) dirty exists 2026-02-12T17:38:46.110 INFO:tasks.rados.rados.0.trial082.stdout:2367: left oid 3 (ObjNum 806 snap 251 seq_num 806) 2026-02-12T17:38:46.110 INFO:tasks.rados.rados.0.trial082.stdout:2368: finishing write tid 1 to trial08226312-5 2026-02-12T17:38:46.110 INFO:tasks.rados.rados.0.trial082.stdout:2368: finishing write tid 2 to trial08226312-5 2026-02-12T17:38:46.111 INFO:tasks.rados.rados.0.trial082.stdout:2368: finishing write tid 3 to trial08226312-5 2026-02-12T17:38:46.111 INFO:tasks.rados.rados.0.trial082.stdout:2368: finishing write tid 4 to trial08226312-5 2026-02-12T17:38:46.111 INFO:tasks.rados.rados.0.trial082.stdout:2368: finishing write tid 5 to trial08226312-5 2026-02-12T17:38:46.111 INFO:tasks.rados.rados.0.trial082.stdout:2368: oid 5 updating version 0 to 953 2026-02-12T17:38:46.111 INFO:tasks.rados.rados.0.trial082.stdout:2368: oid 5 updating version 953 to 954 2026-02-12T17:38:46.111 INFO:tasks.rados.rados.0.trial082.stdout:2368: oid 5 version 954 is already newer than 952 2026-02-12T17:38:46.111 INFO:tasks.rados.rados.0.trial082.stdout:2368: oid 5 updating version 954 to 955 2026-02-12T17:38:46.111 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 955 (ObjNum 807 snap 251 seq_num 807) dirty exists 2026-02-12T17:38:46.112 INFO:tasks.rados.rados.0.trial082.stdout:2368: left oid 5 (ObjNum 807 snap 251 seq_num 807) 2026-02-12T17:38:47.363 INFO:tasks.rados.rados.0.trial082.stdout:2366: done (3 left) 2026-02-12T17:38:47.363 INFO:tasks.rados.rados.0.trial082.stdout:2367: done (2 left) 2026-02-12T17:38:47.363 INFO:tasks.rados.rados.0.trial082.stdout:2368: done (1 left) 2026-02-12T17:38:47.363 INFO:tasks.rados.rados.0.trial082.stdout:2369: done (0 left) 2026-02-12T17:38:47.363 INFO:tasks.rados.rados.0.trial082.stdout:2370: read oid 34 snap -1 2026-02-12T17:38:47.363 INFO:tasks.rados.rados.0.trial082.stdout:2370: expect (ObjNum 803 snap 249 seq_num 803) 2026-02-12T17:38:47.363 INFO:tasks.rados.rados.0.trial082.stdout:2371: snap_remove snap 227 2026-02-12T17:38:48.073 INFO:tasks.rados.rados.0.trial082.stdout:2371: done (1 left) 2026-02-12T17:38:48.074 INFO:tasks.rados.rados.0.trial082.stdout:2372: rollback oid 33 current snap is 252 2026-02-12T17:38:48.074 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 246 2026-02-12T17:38:48.074 INFO:tasks.rados.rados.0.trial082.stdout:2370: expect (ObjNum 803 snap 249 seq_num 803) 2026-02-12T17:38:48.083 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 887042 2026-02-12T17:38:48.134 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 818199 2026-02-12T17:38:48.233 INFO:tasks.rados.rados.0.trial082.stdout:2372: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:38:48.233 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1127 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:38:48.233 INFO:tasks.rados.rados.0.trial082.stdout:2370: done (1 left) 2026-02-12T17:38:48.233 INFO:tasks.rados.rados.0.trial082.stdout:2372: done (0 left) 2026-02-12T17:38:48.233 INFO:tasks.rados.rados.0.trial082.stdout:2373: write (excl) oid 23 current snap is 252 2026-02-12T17:38:48.233 INFO:tasks.rados.rados.0.trial082.stdout:2373: seq_num 808 ranges {780056=734610,2148980=726274,3322484=257572} 2026-02-12T17:38:48.238 INFO:tasks.rados.rados.0.trial082.stdout:2373: writing trial08226312-23 from 780056 to 1514666 tid 1 2026-02-12T17:38:48.244 INFO:tasks.rados.rados.0.trial082.stdout:2373: writing trial08226312-23 from 2148980 to 2875254 tid 2 2026-02-12T17:38:48.247 INFO:tasks.rados.rados.0.trial082.stdout:2373: writing trial08226312-23 from 3322484 to 3580056 tid 3 2026-02-12T17:38:48.247 INFO:tasks.rados.rados.0.trial082.stdout:2374: snap_create 2026-02-12T17:38:48.247 INFO:tasks.rados.rados.0.trial082.stdout:2373: finishing write tid 1 to trial08226312-23 2026-02-12T17:38:48.247 INFO:tasks.rados.rados.0.trial082.stdout:2373: finishing write tid 2 to trial08226312-23 2026-02-12T17:38:48.248 INFO:tasks.rados.rados.0.trial082.stdout:2373: finishing write tid 3 to trial08226312-23 2026-02-12T17:38:48.248 INFO:tasks.rados.rados.0.trial082.stdout:2373: finishing write tid 4 to trial08226312-23 2026-02-12T17:38:48.249 INFO:tasks.rados.rados.0.trial082.stdout:2373: finishing write tid 5 to trial08226312-23 2026-02-12T17:38:48.249 INFO:tasks.rados.rados.0.trial082.stdout:2373: oid 23 updating version 0 to 1533 2026-02-12T17:38:48.249 INFO:tasks.rados.rados.0.trial082.stdout:2373: oid 23 updating version 1533 to 1534 2026-02-12T17:38:48.249 INFO:tasks.rados.rados.0.trial082.stdout:2373: oid 23 updating version 1534 to 1535 2026-02-12T17:38:48.249 INFO:tasks.rados.rados.0.trial082.stdout:2373: oid 23 version 1535 is already newer than 1532 2026-02-12T17:38:48.249 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 1535 (ObjNum 808 snap 252 seq_num 808) dirty exists 2026-02-12T17:38:48.249 INFO:tasks.rados.rados.0.trial082.stdout:2373: left oid 23 (ObjNum 808 snap 252 seq_num 808) 2026-02-12T17:38:49.076 INFO:tasks.rados.rados.0.trial082.stdout:2373: done (1 left) 2026-02-12T17:38:49.076 INFO:tasks.rados.rados.0.trial082.stdout:2374: done (0 left) 2026-02-12T17:38:49.077 INFO:tasks.rados.rados.0.trial082.stdout:2375: snap_remove snap 239 2026-02-12T17:38:50.079 INFO:tasks.rados.rados.0.trial082.stdout:2375: done (0 left) 2026-02-12T17:38:50.079 INFO:tasks.rados.rados.0.trial082.stdout:2376: read oid 36 snap -1 2026-02-12T17:38:50.079 INFO:tasks.rados.rados.0.trial082.stdout:2376: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:38:50.079 INFO:tasks.rados.rados.0.trial082.stdout:2377: rollback oid 27 current snap is 253 2026-02-12T17:38:50.079 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 247 2026-02-12T17:38:50.079 INFO:tasks.rados.rados.0.trial082.stdout:2378: write oid 38 current snap is 253 2026-02-12T17:38:50.080 INFO:tasks.rados.rados.0.trial082.stdout:2378: seq_num 809 ranges {796863=409859,1807462=586285,3066260=530603} 2026-02-12T17:38:50.084 INFO:tasks.rados.rados.0.trial082.stdout:2378: writing trial08226312-38 from 796863 to 1206722 tid 1 2026-02-12T17:38:50.088 INFO:tasks.rados.rados.0.trial082.stdout:2378: writing trial08226312-38 from 1807462 to 2393747 tid 2 2026-02-12T17:38:50.093 INFO:tasks.rados.rados.0.trial082.stdout:2378: writing trial08226312-38 from 3066260 to 3596863 tid 3 2026-02-12T17:38:50.093 INFO:tasks.rados.rados.0.trial082.stdout:2379: delete oid 43 current snap is 253 2026-02-12T17:38:50.093 INFO:tasks.rados.rados.0.trial082.stdout:2376: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:38:50.157 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1134240 2026-02-12T17:38:50.197 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:50.252 INFO:tasks.rados.rados.0.trial082.stdout:2377: finishing rollback tid 0 to trial08226312-27 2026-02-12T17:38:50.252 INFO:tasks.rados.rados.0.trial082.stdout:2377: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:38:50.252 INFO:tasks.rados.rados.0.trial082.stdout:2377: finishing rollback tid 2 to trial08226312-27 2026-02-12T17:38:50.252 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1103 (ObjNum 790 snap 243 seq_num 790) dirty exists 2026-02-12T17:38:50.252 INFO:tasks.rados.rados.0.trial082.stdout:2378: finishing write tid 1 to trial08226312-38 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2378: finishing write tid 2 to trial08226312-38 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2376: done (3 left) 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2377: done (2 left) 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2379: done (1 left) 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2380: delete oid 9 current snap is 253 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2378: finishing write tid 3 to trial08226312-38 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2378: finishing write tid 4 to trial08226312-38 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2378: finishing write tid 5 to trial08226312-38 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2378: oid 38 updating version 0 to 856 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2378: oid 38 version 856 is already newer than 855 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2378: oid 38 updating version 856 to 857 2026-02-12T17:38:50.253 INFO:tasks.rados.rados.0.trial082.stdout:2378: oid 38 updating version 857 to 858 2026-02-12T17:38:50.254 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 858 (ObjNum 809 snap 253 seq_num 809) dirty exists 2026-02-12T17:38:50.254 INFO:tasks.rados.rados.0.trial082.stdout:2378: left oid 38 (ObjNum 809 snap 253 seq_num 809) 2026-02-12T17:38:50.254 INFO:tasks.rados.rados.0.trial082.stdout:2378: done (1 left) 2026-02-12T17:38:50.254 INFO:tasks.rados.rados.0.trial082.stdout:2380: done (0 left) 2026-02-12T17:38:50.254 INFO:tasks.rados.rados.0.trial082.stdout:2381: snap_remove snap 216 2026-02-12T17:38:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2381: done (0 left) 2026-02-12T17:38:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2382: read oid 34 snap 245 2026-02-12T17:38:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2382: expect (ObjNum 774 snap 235 seq_num 774) 2026-02-12T17:38:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2383: read oid 30 snap 228 2026-02-12T17:38:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2383: expect (ObjNum 745 snap 227 seq_num 745) 2026-02-12T17:38:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2384: copy_from oid 11 from oid 12 current snap is 253 2026-02-12T17:38:51.080 INFO:tasks.rados.rados.0.trial082.stdout:2385: delete oid 50 current snap is 253 2026-02-12T17:38:51.084 INFO:tasks.rados.rados.0.trial082.stdout:2385: done (3 left) 2026-02-12T17:38:51.084 INFO:tasks.rados.rados.0.trial082.stdout:2386: write oid 26 current snap is 253 2026-02-12T17:38:51.084 INFO:tasks.rados.rados.0.trial082.stdout:2386: seq_num 813 ranges {464091=710855,1925037=477270,2943246=474970} 2026-02-12T17:38:51.088 INFO:tasks.rados.rados.0.trial082.stdout:2386: writing trial08226312-26 from 464091 to 1174946 tid 1 2026-02-12T17:38:51.093 INFO:tasks.rados.rados.0.trial082.stdout:2386: writing trial08226312-26 from 1925037 to 2402307 tid 2 2026-02-12T17:38:51.097 INFO:tasks.rados.rados.0.trial082.stdout:2386: writing trial08226312-26 from 2943246 to 3418216 tid 3 2026-02-12T17:38:51.097 INFO:tasks.rados.rados.0.trial082.stdout:2387: delete oid 42 current snap is 253 2026-02-12T17:38:51.097 INFO:tasks.rados.rados.0.trial082.stdout:2383: expect (ObjNum 745 snap 227 seq_num 745) 2026-02-12T17:38:51.123 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:51.141 INFO:tasks.rados.rados.0.trial082.stdout:2382: expect (ObjNum 774 snap 235 seq_num 774) 2026-02-12T17:38:51.188 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 667387 2026-02-12T17:38:51.244 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2835671 2026-02-12T17:38:51.253 INFO:tasks.rados.rados.0.trial082.stdout:2386: finishing write tid 1 to trial08226312-26 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:2384: finishing copy_from racing read to trial08226312-11 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:2386: finishing write tid 2 to trial08226312-26 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:2384: finishing copy_from to trial08226312-11 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1131 (ObjNum 794 snap 245 seq_num 794) dirty exists 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:2386: finishing write tid 3 to trial08226312-26 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:2382: done (4 left) 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:2383: done (3 left) 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:2384: done (2 left) 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:2387: done (1 left) 2026-02-12T17:38:51.254 INFO:tasks.rados.rados.0.trial082.stdout:2388: read oid 33 snap 232 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2388: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2389: copy_from oid 19 from oid 6 current snap is 253 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2386: finishing write tid 4 to trial08226312-26 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2386: finishing write tid 5 to trial08226312-26 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2386: oid 26 updating version 0 to 1537 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2386: oid 26 updating version 1537 to 1539 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2386: oid 26 version 1539 is already newer than 1536 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2386: oid 26 version 1539 is already newer than 1538 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1539 (ObjNum 813 snap 253 seq_num 813) dirty exists 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2386: left oid 26 (ObjNum 813 snap 253 seq_num 813) 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2386: done (2 left) 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2390: write oid 11 current snap is 253 2026-02-12T17:38:51.255 INFO:tasks.rados.rados.0.trial082.stdout:2390: seq_num 815 ranges {497705=577706,1642001=480939,2598092=497514} 2026-02-12T17:38:51.257 INFO:tasks.rados.rados.0.trial082.stdout:2390: writing trial08226312-11 from 497705 to 1075411 tid 1 2026-02-12T17:38:51.260 INFO:tasks.rados.rados.0.trial082.stdout:2390: writing trial08226312-11 from 1642001 to 2122940 tid 2 2026-02-12T17:38:51.264 INFO:tasks.rados.rados.0.trial082.stdout:2390: writing trial08226312-11 from 2598092 to 3095606 tid 3 2026-02-12T17:38:51.264 INFO:tasks.rados.rados.0.trial082.stdout:2391: write oid 39 current snap is 253 2026-02-12T17:38:51.265 INFO:tasks.rados.rados.0.trial082.stdout:2391: seq_num 816 ranges {514512=652955,1700483=740950,3025515=688997} 2026-02-12T17:38:51.268 INFO:tasks.rados.rados.0.trial082.stdout:2391: writing trial08226312-39 from 514512 to 1167467 tid 1 2026-02-12T17:38:51.273 INFO:tasks.rados.rados.0.trial082.stdout:2391: writing trial08226312-39 from 1700483 to 2441433 tid 2 2026-02-12T17:38:51.278 INFO:tasks.rados.rados.0.trial082.stdout:2391: writing trial08226312-39 from 3025515 to 3714512 tid 3 2026-02-12T17:38:51.278 INFO:tasks.rados.rados.0.trial082.stdout:2392: snap_remove snap 228 2026-02-12T17:38:52.084 INFO:tasks.rados.rados.0.trial082.stdout:2392: done (4 left) 2026-02-12T17:38:52.084 INFO:tasks.rados.rados.0.trial082.stdout:2393: delete oid 25 current snap is 253 2026-02-12T17:38:52.084 INFO:tasks.rados.rados.0.trial082.stdout:2389: finishing copy_from to trial08226312-19 2026-02-12T17:38:52.084 INFO:tasks.rados.rados.0.trial082.stdout:2389: got expected ENOENT (src dne) 2026-02-12T17:38:52.084 INFO:tasks.rados.rados.0.trial082.stdout:2389: finishing copy_from racing read to trial08226312-19 2026-02-12T17:38:52.084 INFO:tasks.rados.rados.0.trial082.stdout:2388: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:38:52.107 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:52.150 INFO:tasks.rados.rados.0.trial082.stdout:2390: finishing write tid 1 to trial08226312-11 2026-02-12T17:38:52.150 INFO:tasks.rados.rados.0.trial082.stdout:2390: finishing write tid 2 to trial08226312-11 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2390: finishing write tid 3 to trial08226312-11 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2390: finishing write tid 4 to trial08226312-11 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2388: done (4 left) 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2389: done (3 left) 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2393: done (2 left) 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2394: read oid 42 snap -1 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2394: expect deleted 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2395: read oid 1 snap 232 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2395: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2396: snap_create 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2390: finishing write tid 5 to trial08226312-11 2026-02-12T17:38:52.151 INFO:tasks.rados.rados.0.trial082.stdout:2390: oid 11 updating version 0 to 1323 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2390: oid 11 version 1323 is already newer than 1322 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2390: oid 11 version 1323 is already newer than 1321 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2390: oid 11 updating version 1323 to 1324 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1324 (ObjNum 815 snap 253 seq_num 815) dirty exists 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2390: left oid 11 (ObjNum 815 snap 253 seq_num 815) 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2391: finishing write tid 1 to trial08226312-39 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2391: finishing write tid 2 to trial08226312-39 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2391: finishing write tid 3 to trial08226312-39 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2391: finishing write tid 4 to trial08226312-39 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2391: finishing write tid 5 to trial08226312-39 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2391: oid 39 updating version 0 to 945 2026-02-12T17:38:52.152 INFO:tasks.rados.rados.0.trial082.stdout:2391: oid 39 updating version 945 to 946 2026-02-12T17:38:52.153 INFO:tasks.rados.rados.0.trial082.stdout:2391: oid 39 updating version 946 to 948 2026-02-12T17:38:52.153 INFO:tasks.rados.rados.0.trial082.stdout:2391: oid 39 version 948 is already newer than 947 2026-02-12T17:38:52.153 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 948 (ObjNum 816 snap 253 seq_num 816) dirty exists 2026-02-12T17:38:52.153 INFO:tasks.rados.rados.0.trial082.stdout:2391: left oid 39 (ObjNum 816 snap 253 seq_num 816) 2026-02-12T17:38:52.153 INFO:tasks.rados.rados.0.trial082.stdout:2395: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:38:52.196 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3098927 2026-02-12T17:38:53.074 INFO:tasks.rados.rados.0.trial082.stdout:2390: done (4 left) 2026-02-12T17:38:53.075 INFO:tasks.rados.rados.0.trial082.stdout:2391: done (3 left) 2026-02-12T17:38:53.075 INFO:tasks.rados.rados.0.trial082.stdout:2394: done (2 left) 2026-02-12T17:38:53.075 INFO:tasks.rados.rados.0.trial082.stdout:2395: done (1 left) 2026-02-12T17:38:53.075 INFO:tasks.rados.rados.0.trial082.stdout:2396: done (0 left) 2026-02-12T17:38:53.075 INFO:tasks.rados.rados.0.trial082.stdout:2397: rollback oid 17 current snap is 254 2026-02-12T17:38:53.075 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 232 2026-02-12T17:38:53.075 INFO:tasks.rados.rados.0.trial082.stdout:2398: delete oid 45 current snap is 254 2026-02-12T17:38:53.081 INFO:tasks.rados.rados.0.trial082.stdout:2398: done (1 left) 2026-02-12T17:38:53.081 INFO:tasks.rados.rados.0.trial082.stdout:2399: copy_from oid 22 from oid 12 current snap is 254 2026-02-12T17:38:53.081 INFO:tasks.rados.rados.0.trial082.stdout:2400: read oid 23 snap -1 2026-02-12T17:38:53.081 INFO:tasks.rados.rados.0.trial082.stdout:2400: expect (ObjNum 808 snap 252 seq_num 808) 2026-02-12T17:38:53.081 INFO:tasks.rados.rados.0.trial082.stdout:2401: snap_create 2026-02-12T17:38:53.082 INFO:tasks.rados.rados.0.trial082.stdout:2397: finishing rollback tid 0 to trial08226312-17 2026-02-12T17:38:53.082 INFO:tasks.rados.rados.0.trial082.stdout:2397: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:38:53.082 INFO:tasks.rados.rados.0.trial082.stdout:2397: finishing rollback tid 2 to trial08226312-17 2026-02-12T17:38:53.082 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 1814 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:38:53.085 INFO:tasks.rados.rados.0.trial082.stdout:2400: expect (ObjNum 808 snap 252 seq_num 808) 2026-02-12T17:38:53.091 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1553252 2026-02-12T17:38:53.190 INFO:tasks.rados.rados.0.trial082.stdout:2399: finishing copy_from racing read to trial08226312-22 2026-02-12T17:38:53.191 INFO:tasks.rados.rados.0.trial082.stdout:2399: finishing copy_from to trial08226312-22 2026-02-12T17:38:53.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 1131 (ObjNum 794 snap 245 seq_num 794) dirty exists 2026-02-12T17:38:54.076 INFO:tasks.rados.rados.0.trial082.stdout:2397: done (3 left) 2026-02-12T17:38:54.076 INFO:tasks.rados.rados.0.trial082.stdout:2399: done (2 left) 2026-02-12T17:38:54.076 INFO:tasks.rados.rados.0.trial082.stdout:2400: done (1 left) 2026-02-12T17:38:54.076 INFO:tasks.rados.rados.0.trial082.stdout:2401: done (0 left) 2026-02-12T17:38:54.076 INFO:tasks.rados.rados.0.trial082.stdout:2402: copy_from oid 5 from oid 41 current snap is 255 2026-02-12T17:38:54.077 INFO:tasks.rados.rados.0.trial082.stdout:2403: delete oid 30 current snap is 255 2026-02-12T17:38:54.077 INFO:tasks.rados.rados.0.trial082.stdout:2403: done (1 left) 2026-02-12T17:38:54.077 INFO:tasks.rados.rados.0.trial082.stdout:2404: write oid 36 current snap is 255 2026-02-12T17:38:54.077 INFO:tasks.rados.rados.0.trial082.stdout:2404: seq_num 820 ranges {581740=553951,1818058=748288,3018854=470227} 2026-02-12T17:38:54.081 INFO:tasks.rados.rados.0.trial082.stdout:2404: writing trial08226312-36 from 581740 to 1135691 tid 1 2026-02-12T17:38:54.086 INFO:tasks.rados.rados.0.trial082.stdout:2404: writing trial08226312-36 from 1818058 to 2566346 tid 2 2026-02-12T17:38:54.090 INFO:tasks.rados.rados.0.trial082.stdout:2404: writing trial08226312-36 from 3018854 to 3489081 tid 3 2026-02-12T17:38:54.090 INFO:tasks.rados.rados.0.trial082.stdout:2405: write (excl) oid 14 current snap is 255 2026-02-12T17:38:54.090 INFO:tasks.rados.rados.0.trial082.stdout:2402: finishing copy_from racing read to trial08226312-5 2026-02-12T17:38:54.091 INFO:tasks.rados.rados.0.trial082.stdout:2402: finishing copy_from to trial08226312-5 2026-02-12T17:38:54.091 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 1122 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:38:54.091 INFO:tasks.rados.rados.0.trial082.stdout:2404: finishing write tid 1 to trial08226312-36 2026-02-12T17:38:54.091 INFO:tasks.rados.rados.0.trial082.stdout:2404: finishing write tid 2 to trial08226312-36 2026-02-12T17:38:54.091 INFO:tasks.rados.rados.0.trial082.stdout:2405: seq_num 821 ranges {598547=629200,1876540=491946,3046277=681499} 2026-02-12T17:38:54.095 INFO:tasks.rados.rados.0.trial082.stdout:2405: writing trial08226312-14 from 598547 to 1227747 tid 1 2026-02-12T17:38:54.099 INFO:tasks.rados.rados.0.trial082.stdout:2405: writing trial08226312-14 from 1876540 to 2368486 tid 2 2026-02-12T17:38:54.104 INFO:tasks.rados.rados.0.trial082.stdout:2405: writing trial08226312-14 from 3046277 to 3727776 tid 3 2026-02-12T17:38:54.104 INFO:tasks.rados.rados.0.trial082.stdout:2402: done (2 left) 2026-02-12T17:38:54.104 INFO:tasks.rados.rados.0.trial082.stdout:2406: read oid 1 snap -1 2026-02-12T17:38:54.105 INFO:tasks.rados.rados.0.trial082.stdout:2406: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:38:54.105 INFO:tasks.rados.rados.0.trial082.stdout:2407: snap_remove snap 246 2026-02-12T17:38:55.086 INFO:tasks.rados.rados.0.trial082.stdout:2407: done (3 left) 2026-02-12T17:38:55.086 INFO:tasks.rados.rados.0.trial082.stdout:2408: rollback oid 29 current snap is 255 2026-02-12T17:38:55.086 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 29 to 252 2026-02-12T17:38:55.086 INFO:tasks.rados.rados.0.trial082.stdout:2404: finishing write tid 3 to trial08226312-36 2026-02-12T17:38:55.086 INFO:tasks.rados.rados.0.trial082.stdout:2409: delete oid 32 current snap is 255 2026-02-12T17:38:55.086 INFO:tasks.rados.rados.0.trial082.stdout:2404: finishing write tid 4 to trial08226312-36 2026-02-12T17:38:55.086 INFO:tasks.rados.rados.0.trial082.stdout:2404: finishing write tid 5 to trial08226312-36 2026-02-12T17:38:55.086 INFO:tasks.rados.rados.0.trial082.stdout:2404: oid 36 updating version 0 to 1543 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2404: oid 36 version 1543 is already newer than 1541 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2404: oid 36 version 1543 is already newer than 1542 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2404: oid 36 updating version 1543 to 1544 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 1544 (ObjNum 820 snap 255 seq_num 820) dirty exists 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2404: left oid 36 (ObjNum 820 snap 255 seq_num 820) 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: finishing write tid 1 to trial08226312-14 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: finishing write tid 2 to trial08226312-14 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: finishing write tid 3 to trial08226312-14 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: finishing write tid 4 to trial08226312-14 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: finishing write tid 5 to trial08226312-14 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: oid 14 updating version 0 to 1123 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: oid 14 updating version 1123 to 1126 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: oid 14 version 1126 is already newer than 1124 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: oid 14 version 1126 is already newer than 1125 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 1126 (ObjNum 821 snap 255 seq_num 821) dirty exists 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2405: left oid 14 (ObjNum 821 snap 255 seq_num 821) 2026-02-12T17:38:55.087 INFO:tasks.rados.rados.0.trial082.stdout:2406: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:38:55.187 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3132869 2026-02-12T17:38:55.255 INFO:tasks.rados.rados.0.trial082.stdout:2408: finishing rollback tid 1 to trial08226312-29 2026-02-12T17:38:55.256 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 1570 (ObjNum 129 snap 0 seq_num 27729168) dirty dne 2026-02-12T17:38:55.256 INFO:tasks.rados.rados.0.trial082.stdout:2404: done (4 left) 2026-02-12T17:38:55.256 INFO:tasks.rados.rados.0.trial082.stdout:2405: done (3 left) 2026-02-12T17:38:55.256 INFO:tasks.rados.rados.0.trial082.stdout:2406: done (2 left) 2026-02-12T17:38:55.256 INFO:tasks.rados.rados.0.trial082.stdout:2408: done (1 left) 2026-02-12T17:38:55.256 INFO:tasks.rados.rados.0.trial082.stdout:2409: done (0 left) 2026-02-12T17:38:55.256 INFO:tasks.rados.rados.0.trial082.stdout:2410: write (excl) oid 49 current snap is 255 2026-02-12T17:38:55.256 INFO:tasks.rados.rados.0.trial082.stdout:2410: seq_num 823 ranges {632161=496051,1593504=495615,2701123=420396,3611645=220516} 2026-02-12T17:38:55.260 INFO:tasks.rados.rados.0.trial082.stdout:2410: writing trial08226312-49 from 632161 to 1128212 tid 1 2026-02-12T17:38:55.263 INFO:tasks.rados.rados.0.trial082.stdout:2410: writing trial08226312-49 from 1593504 to 2089119 tid 2 2026-02-12T17:38:55.267 INFO:tasks.rados.rados.0.trial082.stdout:2410: writing trial08226312-49 from 2701123 to 3121519 tid 3 2026-02-12T17:38:55.270 INFO:tasks.rados.rados.0.trial082.stdout:2410: writing trial08226312-49 from 3611645 to 3832161 tid 4 2026-02-12T17:38:55.270 INFO:tasks.rados.rados.0.trial082.stdout:2411: rollback oid 30 current snap is 255 2026-02-12T17:38:55.270 INFO:tasks.rados.rados.0.trial082.stdout:2410: finishing write tid 1 to trial08226312-49 2026-02-12T17:38:55.270 INFO:tasks.rados.rados.0.trial082.stdout:2410: finishing write tid 2 to trial08226312-49 2026-02-12T17:38:55.270 INFO:tasks.rados.rados.0.trial082.stdout:2410: finishing write tid 3 to trial08226312-49 2026-02-12T17:38:55.270 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 254 2026-02-12T17:38:55.271 INFO:tasks.rados.rados.0.trial082.stdout:2412: write oid 31 current snap is 255 2026-02-12T17:38:55.271 INFO:tasks.rados.rados.0.trial082.stdout:2412: seq_num 824 ranges {648968=571300,1651986=639273,2728546=631668} 2026-02-12T17:38:55.274 INFO:tasks.rados.rados.0.trial082.stdout:2412: writing trial08226312-31 from 648968 to 1220268 tid 1 2026-02-12T17:38:55.278 INFO:tasks.rados.rados.0.trial082.stdout:2412: writing trial08226312-31 from 1651986 to 2291259 tid 2 2026-02-12T17:38:55.283 INFO:tasks.rados.rados.0.trial082.stdout:2412: writing trial08226312-31 from 2728546 to 3360214 tid 3 2026-02-12T17:38:55.283 INFO:tasks.rados.rados.0.trial082.stdout:2413: write (excl) oid 15 current snap is 255 2026-02-12T17:38:55.283 INFO:tasks.rados.rados.0.trial082.stdout:2411: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:38:55.283 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:38:55.283 INFO:tasks.rados.rados.0.trial082.stdout:2410: finishing write tid 4 to trial08226312-49 2026-02-12T17:38:55.283 INFO:tasks.rados.rados.0.trial082.stdout:2410: finishing write tid 5 to trial08226312-49 2026-02-12T17:38:55.283 INFO:tasks.rados.rados.0.trial082.stdout:2410: finishing write tid 6 to trial08226312-49 2026-02-12T17:38:55.283 INFO:tasks.rados.rados.0.trial082.stdout:2410: oid 49 updating version 0 to 1530 2026-02-12T17:38:55.284 INFO:tasks.rados.rados.0.trial082.stdout:2410: oid 49 version 1530 is already newer than 1528 2026-02-12T17:38:55.284 INFO:tasks.rados.rados.0.trial082.stdout:2410: oid 49 updating version 1530 to 1531 2026-02-12T17:38:55.284 INFO:tasks.rados.rados.0.trial082.stdout:2410: oid 49 updating version 1531 to 1532 2026-02-12T17:38:55.284 INFO:tasks.rados.rados.0.trial082.stdout:2410: oid 49 version 1532 is already newer than 1529 2026-02-12T17:38:55.284 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 1532 (ObjNum 823 snap 255 seq_num 823) dirty exists 2026-02-12T17:38:55.284 INFO:tasks.rados.rados.0.trial082.stdout:2410: left oid 49 (ObjNum 823 snap 255 seq_num 823) 2026-02-12T17:38:55.284 INFO:tasks.rados.rados.0.trial082.stdout:2412: finishing write tid 1 to trial08226312-31 2026-02-12T17:38:55.284 INFO:tasks.rados.rados.0.trial082.stdout:2413: seq_num 825 ranges {665775=646549,2110468=499284,3155969=442940} 2026-02-12T17:38:55.287 INFO:tasks.rados.rados.0.trial082.stdout:2413: writing trial08226312-15 from 665775 to 1312324 tid 1 2026-02-12T17:38:55.292 INFO:tasks.rados.rados.0.trial082.stdout:2413: writing trial08226312-15 from 2110468 to 2609752 tid 2 2026-02-12T17:38:55.297 INFO:tasks.rados.rados.0.trial082.stdout:2413: writing trial08226312-15 from 3155969 to 3598909 tid 3 2026-02-12T17:38:55.297 INFO:tasks.rados.rados.0.trial082.stdout:2410: done (3 left) 2026-02-12T17:38:55.297 INFO:tasks.rados.rados.0.trial082.stdout:2411: done (2 left) 2026-02-12T17:38:55.297 INFO:tasks.rados.rados.0.trial082.stdout:2414: copy_from oid 48 from oid 43 current snap is 255 2026-02-12T17:38:55.297 INFO:tasks.rados.rados.0.trial082.stdout:2412: finishing write tid 2 to trial08226312-31 2026-02-12T17:38:55.297 INFO:tasks.rados.rados.0.trial082.stdout:2412: finishing write tid 3 to trial08226312-31 2026-02-12T17:38:55.297 INFO:tasks.rados.rados.0.trial082.stdout:2412: finishing write tid 4 to trial08226312-31 2026-02-12T17:38:55.297 INFO:tasks.rados.rados.0.trial082.stdout:2412: finishing write tid 5 to trial08226312-31 2026-02-12T17:38:55.297 INFO:tasks.rados.rados.0.trial082.stdout:2412: oid 31 updating version 0 to 1107 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2412: oid 31 version 1107 is already newer than 1106 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2412: oid 31 version 1107 is already newer than 1104 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2412: oid 31 version 1107 is already newer than 1105 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 1107 (ObjNum 824 snap 255 seq_num 824) dirty exists 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2412: left oid 31 (ObjNum 824 snap 255 seq_num 824) 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2413: finishing write tid 1 to trial08226312-15 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2413: finishing write tid 2 to trial08226312-15 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2412: done (2 left) 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2415: read oid 40 snap 232 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2415: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2416: read oid 31 snap -1 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2416: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-12T17:38:55.298 INFO:tasks.rados.rados.0.trial082.stdout:2417: write (excl) oid 30 current snap is 255 2026-02-12T17:38:55.299 INFO:tasks.rados.rados.0.trial082.stdout:2417: seq_num 826 ranges {682582=721798,2168950=642942,3583392=299190} 2026-02-12T17:38:55.301 INFO:tasks.rados.rados.0.trial082.stdout:2417: writing trial08226312-30 from 682582 to 1404380 tid 1 2026-02-12T17:38:55.306 INFO:tasks.rados.rados.0.trial082.stdout:2417: writing trial08226312-30 from 2168950 to 2811892 tid 2 2026-02-12T17:38:55.311 INFO:tasks.rados.rados.0.trial082.stdout:2417: writing trial08226312-30 from 3583392 to 3882582 tid 3 2026-02-12T17:38:55.311 INFO:tasks.rados.rados.0.trial082.stdout:2418: read oid 4 snap 252 2026-02-12T17:38:55.311 INFO:tasks.rados.rados.0.trial082.stdout:2418: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:38:55.311 INFO:tasks.rados.rados.0.trial082.stdout:2419: snap_remove snap 245 2026-02-12T17:38:56.090 INFO:tasks.rados.rados.0.trial082.stdout:2419: done (6 left) 2026-02-12T17:38:56.090 INFO:tasks.rados.rados.0.trial082.stdout:2420: read oid 20 snap -1 2026-02-12T17:38:56.090 INFO:tasks.rados.rados.0.trial082.stdout:2420: expect deleted 2026-02-12T17:38:56.090 INFO:tasks.rados.rados.0.trial082.stdout:2421: copy_from oid 18 from oid 10 current snap is 255 2026-02-12T17:38:56.090 INFO:tasks.rados.rados.0.trial082.stdout:2414: finishing copy_from to trial08226312-48 2026-02-12T17:38:56.090 INFO:tasks.rados.rados.0.trial082.stdout:2414: got expected ENOENT (src dne) 2026-02-12T17:38:56.090 INFO:tasks.rados.rados.0.trial082.stdout:2414: finishing copy_from racing read to trial08226312-48 2026-02-12T17:38:56.090 INFO:tasks.rados.rados.0.trial082.stdout:2416: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-12T17:38:56.157 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:56.196 INFO:tasks.rados.rados.0.trial082.stdout:2415: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:38:56.197 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:56.250 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:56.358 INFO:tasks.rados.rados.0.trial082.stdout:2417: finishing write tid 1 to trial08226312-30 2026-02-12T17:38:56.359 INFO:tasks.rados.rados.0.trial082.stdout:2414: done (7 left) 2026-02-12T17:38:56.359 INFO:tasks.rados.rados.0.trial082.stdout:2415: done (6 left) 2026-02-12T17:38:56.359 INFO:tasks.rados.rados.0.trial082.stdout:2416: done (5 left) 2026-02-12T17:38:56.359 INFO:tasks.rados.rados.0.trial082.stdout:2422: snap_create 2026-02-12T17:38:56.359 INFO:tasks.rados.rados.0.trial082.stdout:2413: finishing write tid 3 to trial08226312-15 2026-02-12T17:38:56.359 INFO:tasks.rados.rados.0.trial082.stdout:2413: finishing write tid 4 to trial08226312-15 2026-02-12T17:38:56.359 INFO:tasks.rados.rados.0.trial082.stdout:2413: finishing write tid 5 to trial08226312-15 2026-02-12T17:38:56.359 INFO:tasks.rados.rados.0.trial082.stdout:2413: oid 15 updating version 0 to 1129 2026-02-12T17:38:56.359 INFO:tasks.rados.rados.0.trial082.stdout:2413: oid 15 version 1129 is already newer than 1128 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2413: oid 15 updating version 1129 to 1130 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2413: oid 15 version 1130 is already newer than 1127 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 1130 (ObjNum 825 snap 255 seq_num 825) dirty exists 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2413: left oid 15 (ObjNum 825 snap 255 seq_num 825) 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2417: finishing write tid 2 to trial08226312-30 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2417: finishing write tid 3 to trial08226312-30 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2417: finishing write tid 4 to trial08226312-30 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2417: finishing write tid 5 to trial08226312-30 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2417: oid 30 updating version 0 to 1538 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2417: oid 30 updating version 1538 to 1539 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2417: oid 30 updating version 1539 to 1540 2026-02-12T17:38:56.360 INFO:tasks.rados.rados.0.trial082.stdout:2417: oid 30 version 1540 is already newer than 1537 2026-02-12T17:38:56.361 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1540 (ObjNum 826 snap 255 seq_num 826) dirty exists 2026-02-12T17:38:56.361 INFO:tasks.rados.rados.0.trial082.stdout:2417: left oid 30 (ObjNum 826 snap 255 seq_num 826) 2026-02-12T17:38:56.361 INFO:tasks.rados.rados.0.trial082.stdout:2418: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:38:56.383 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:56.407 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:56.432 INFO:tasks.rados.rados.0.trial082.stdout:2421: finishing copy_from racing read to trial08226312-18 2026-02-12T17:38:56.432 INFO:tasks.rados.rados.0.trial082.stdout:2421: finishing copy_from to trial08226312-18 2026-02-12T17:38:56.432 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 1535 (ObjNum 707 snap 212 seq_num 707) dirty exists 2026-02-12T17:38:57.102 INFO:tasks.rados.rados.0.trial082.stdout:2413: done (5 left) 2026-02-12T17:38:57.102 INFO:tasks.rados.rados.0.trial082.stdout:2417: done (4 left) 2026-02-12T17:38:57.103 INFO:tasks.rados.rados.0.trial082.stdout:2418: done (3 left) 2026-02-12T17:38:57.103 INFO:tasks.rados.rados.0.trial082.stdout:2420: done (2 left) 2026-02-12T17:38:57.103 INFO:tasks.rados.rados.0.trial082.stdout:2421: done (1 left) 2026-02-12T17:38:57.103 INFO:tasks.rados.rados.0.trial082.stdout:2422: done (0 left) 2026-02-12T17:38:57.103 INFO:tasks.rados.rados.0.trial082.stdout:2423: copy_from oid 5 from oid 31 current snap is 256 2026-02-12T17:38:57.103 INFO:tasks.rados.rados.0.trial082.stdout:2424: read oid 30 snap -1 2026-02-12T17:38:57.103 INFO:tasks.rados.rados.0.trial082.stdout:2424: expect (ObjNum 826 snap 255 seq_num 826) 2026-02-12T17:38:57.103 INFO:tasks.rados.rados.0.trial082.stdout:2425: delete oid 42 current snap is 256 2026-02-12T17:38:57.104 INFO:tasks.rados.rados.0.trial082.stdout:2425: done (2 left) 2026-02-12T17:38:57.104 INFO:tasks.rados.rados.0.trial082.stdout:2426: delete oid 46 current snap is 256 2026-02-12T17:38:57.105 INFO:tasks.rados.rados.0.trial082.stdout:2426: done (2 left) 2026-02-12T17:38:57.105 INFO:tasks.rados.rados.0.trial082.stdout:2427: write (excl) oid 50 current snap is 256 2026-02-12T17:38:57.105 INFO:tasks.rados.rados.0.trial082.stdout:2427: seq_num 829 ranges {733003=663898,1944396=506622,2865661=604381} 2026-02-12T17:38:57.111 INFO:tasks.rados.rados.0.trial082.stdout:2427: writing trial08226312-50 from 733003 to 1396901 tid 1 2026-02-12T17:38:57.115 INFO:tasks.rados.rados.0.trial082.stdout:2427: writing trial08226312-50 from 1944396 to 2451018 tid 2 2026-02-12T17:38:57.119 INFO:tasks.rados.rados.0.trial082.stdout:2427: writing trial08226312-50 from 2865661 to 3470042 tid 3 2026-02-12T17:38:57.119 INFO:tasks.rados.rados.0.trial082.stdout:2428: snap_create 2026-02-12T17:38:57.120 INFO:tasks.rados.rados.0.trial082.stdout:2424: expect (ObjNum 826 snap 255 seq_num 826) 2026-02-12T17:38:57.120 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:38:57.156 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3006035 2026-02-12T17:38:57.169 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 809001 2026-02-12T17:38:57.190 INFO:tasks.rados.rados.0.trial082.stdout:2423: finishing copy_from racing read to trial08226312-5 2026-02-12T17:38:57.190 INFO:tasks.rados.rados.0.trial082.stdout:2423: finishing copy_from to trial08226312-5 2026-02-12T17:38:57.190 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 1107 (ObjNum 824 snap 255 seq_num 824) dirty exists 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: finishing write tid 1 to trial08226312-50 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: finishing write tid 2 to trial08226312-50 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: finishing write tid 3 to trial08226312-50 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: finishing write tid 4 to trial08226312-50 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: finishing write tid 5 to trial08226312-50 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: oid 50 updating version 0 to 1574 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: oid 50 updating version 1574 to 1576 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: oid 50 version 1576 is already newer than 1575 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: oid 50 version 1576 is already newer than 1573 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 1576 (ObjNum 829 snap 256 seq_num 829) dirty exists 2026-02-12T17:38:57.191 INFO:tasks.rados.rados.0.trial082.stdout:2427: left oid 50 (ObjNum 829 snap 256 seq_num 829) 2026-02-12T17:38:58.076 INFO:tasks.rados.rados.0.trial082.stdout:2423: done (3 left) 2026-02-12T17:38:58.076 INFO:tasks.rados.rados.0.trial082.stdout:2424: done (2 left) 2026-02-12T17:38:58.076 INFO:tasks.rados.rados.0.trial082.stdout:2427: done (1 left) 2026-02-12T17:38:58.076 INFO:tasks.rados.rados.0.trial082.stdout:2428: done (0 left) 2026-02-12T17:38:58.077 INFO:tasks.rados.rados.0.trial082.stdout:2429: write oid 25 current snap is 257 2026-02-12T17:38:58.077 INFO:tasks.rados.rados.0.trial082.stdout:2429: seq_num 830 ranges {749810=739147,2002878=650280,3293084=415653} 2026-02-12T17:38:58.081 INFO:tasks.rados.rados.0.trial082.stdout:2429: writing trial08226312-25 from 749810 to 1488957 tid 1 2026-02-12T17:38:58.086 INFO:tasks.rados.rados.0.trial082.stdout:2429: writing trial08226312-25 from 2002878 to 2653158 tid 2 2026-02-12T17:38:58.090 INFO:tasks.rados.rados.0.trial082.stdout:2429: writing trial08226312-25 from 3293084 to 3708737 tid 3 2026-02-12T17:38:58.090 INFO:tasks.rados.rados.0.trial082.stdout:2430: write oid 29 current snap is 257 2026-02-12T17:38:58.090 INFO:tasks.rados.rados.0.trial082.stdout:2430: seq_num 831 ranges {766617=414396,1945007=510291,3204154=626925} 2026-02-12T17:38:58.094 INFO:tasks.rados.rados.0.trial082.stdout:2430: writing trial08226312-29 from 766617 to 1181013 tid 1 2026-02-12T17:38:58.099 INFO:tasks.rados.rados.0.trial082.stdout:2430: writing trial08226312-29 from 1945007 to 2455298 tid 2 2026-02-12T17:38:58.105 INFO:tasks.rados.rados.0.trial082.stdout:2430: writing trial08226312-29 from 3204154 to 3831079 tid 3 2026-02-12T17:38:58.105 INFO:tasks.rados.rados.0.trial082.stdout:2431: rollback oid 6 current snap is 257 2026-02-12T17:38:58.105 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 6 to 256 2026-02-12T17:38:58.105 INFO:tasks.rados.rados.0.trial082.stdout:2429: finishing write tid 1 to trial08226312-25 2026-02-12T17:38:58.105 INFO:tasks.rados.rados.0.trial082.stdout:2432: copy_from oid 18 from oid 3 current snap is 257 2026-02-12T17:38:58.105 INFO:tasks.rados.rados.0.trial082.stdout:2430: finishing write tid 1 to trial08226312-29 2026-02-12T17:38:58.105 INFO:tasks.rados.rados.0.trial082.stdout:2429: finishing write tid 2 to trial08226312-25 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2429: finishing write tid 3 to trial08226312-25 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2429: finishing write tid 4 to trial08226312-25 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2429: finishing write tid 5 to trial08226312-25 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2429: oid 25 updating version 0 to 562 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2429: oid 25 updating version 562 to 563 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2429: oid 25 updating version 563 to 564 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2429: oid 25 updating version 564 to 565 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 565 (ObjNum 830 snap 257 seq_num 830) dirty exists 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2429: left oid 25 (ObjNum 830 snap 257 seq_num 830) 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2430: finishing write tid 2 to trial08226312-29 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2429: done (3 left) 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2433: read oid 44 snap -1 2026-02-12T17:38:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2433: expect (ObjNum 771 snap 234 seq_num 771) 2026-02-12T17:38:58.107 INFO:tasks.rados.rados.0.trial082.stdout:2434: delete oid 33 current snap is 257 2026-02-12T17:38:58.107 INFO:tasks.rados.rados.0.trial082.stdout:2434: done (4 left) 2026-02-12T17:38:58.107 INFO:tasks.rados.rados.0.trial082.stdout:2435: rollback oid 22 current snap is 257 2026-02-12T17:38:58.107 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 232 2026-02-12T17:38:58.108 INFO:tasks.rados.rados.0.trial082.stdout:2436: snap_create 2026-02-12T17:38:58.108 INFO:tasks.rados.rados.0.trial082.stdout:2433: expect (ObjNum 771 snap 234 seq_num 771) 2026-02-12T17:38:58.218 INFO:tasks.rados.rados.0.trial082.stdout:2435: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:38:58.218 INFO:tasks.rados.rados.0.trial082.stdout:2435: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:38:58.218 INFO:tasks.rados.rados.0.trial082.stdout:2435: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:38:58.218 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 1543 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:38:58.218 INFO:tasks.rados.rados.0.trial082.stdout:2432: finishing copy_from racing read to trial08226312-18 2026-02-12T17:38:58.218 INFO:tasks.rados.rados.0.trial082.stdout:2430: finishing write tid 3 to trial08226312-29 2026-02-12T17:38:58.218 INFO:tasks.rados.rados.0.trial082.stdout:2430: finishing write tid 4 to trial08226312-29 2026-02-12T17:38:58.218 INFO:tasks.rados.rados.0.trial082.stdout:2430: finishing write tid 5 to trial08226312-29 2026-02-12T17:38:58.218 INFO:tasks.rados.rados.0.trial082.stdout:2430: oid 29 updating version 0 to 1578 2026-02-12T17:38:58.219 INFO:tasks.rados.rados.0.trial082.stdout:2430: oid 29 updating version 1578 to 1580 2026-02-12T17:38:58.219 INFO:tasks.rados.rados.0.trial082.stdout:2430: oid 29 version 1580 is already newer than 1577 2026-02-12T17:38:58.219 INFO:tasks.rados.rados.0.trial082.stdout:2430: oid 29 version 1580 is already newer than 1579 2026-02-12T17:38:58.219 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 1580 (ObjNum 831 snap 257 seq_num 831) dirty exists 2026-02-12T17:38:58.219 INFO:tasks.rados.rados.0.trial082.stdout:2430: left oid 29 (ObjNum 831 snap 257 seq_num 831) 2026-02-12T17:38:58.219 INFO:tasks.rados.rados.0.trial082.stdout:2431: finishing rollback tid 1 to trial08226312-6 2026-02-12T17:38:58.219 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 1571 (ObjNum 49 snap 0 seq_num 26969616) dirty dne 2026-02-12T17:38:58.219 INFO:tasks.rados.rados.0.trial082.stdout:2432: finishing copy_from to trial08226312-18 2026-02-12T17:38:58.219 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 950 (ObjNum 806 snap 251 seq_num 806) dirty exists 2026-02-12T17:38:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2430: done (5 left) 2026-02-12T17:38:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2431: done (4 left) 2026-02-12T17:38:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2432: done (3 left) 2026-02-12T17:38:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2433: done (2 left) 2026-02-12T17:38:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2435: done (1 left) 2026-02-12T17:38:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2436: done (0 left) 2026-02-12T17:38:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2437: read oid 49 snap -1 2026-02-12T17:38:59.107 INFO:tasks.rados.rados.0.trial082.stdout:2437: expect (ObjNum 823 snap 255 seq_num 823) 2026-02-12T17:38:59.107 INFO:tasks.rados.rados.0.trial082.stdout:2438: read oid 46 snap -1 2026-02-12T17:38:59.107 INFO:tasks.rados.rados.0.trial082.stdout:2438: expect deleted 2026-02-12T17:38:59.107 INFO:tasks.rados.rados.0.trial082.stdout:2439: snap_remove snap 257 2026-02-12T17:39:00.106 INFO:tasks.rados.rados.0.trial082.stdout:2439: done (2 left) 2026-02-12T17:39:00.106 INFO:tasks.rados.rados.0.trial082.stdout:2440: snap_create 2026-02-12T17:39:00.106 INFO:tasks.rados.rados.0.trial082.stdout:2437: expect (ObjNum 823 snap 255 seq_num 823) 2026-02-12T17:39:00.140 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2266077 2026-02-12T17:39:00.154 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:01.108 INFO:tasks.rados.rados.0.trial082.stdout:2437: done (2 left) 2026-02-12T17:39:01.108 INFO:tasks.rados.rados.0.trial082.stdout:2438: done (1 left) 2026-02-12T17:39:01.108 INFO:tasks.rados.rados.0.trial082.stdout:2440: done (0 left) 2026-02-12T17:39:01.108 INFO:tasks.rados.rados.0.trial082.stdout:2441: rollback oid 49 current snap is 259 2026-02-12T17:39:01.108 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 252 2026-02-12T17:39:01.108 INFO:tasks.rados.rados.0.trial082.stdout:2442: copy_from oid 36 from oid 13 current snap is 259 2026-02-12T17:39:01.109 INFO:tasks.rados.rados.0.trial082.stdout:2443: read oid 16 snap -1 2026-02-12T17:39:01.109 INFO:tasks.rados.rados.0.trial082.stdout:2443: expect (ObjNum 797 snap 248 seq_num 797) 2026-02-12T17:39:01.109 INFO:tasks.rados.rados.0.trial082.stdout:2444: read oid 28 snap -1 2026-02-12T17:39:01.109 INFO:tasks.rados.rados.0.trial082.stdout:2444: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:39:01.109 INFO:tasks.rados.rados.0.trial082.stdout:2445: read oid 14 snap -1 2026-02-12T17:39:01.109 INFO:tasks.rados.rados.0.trial082.stdout:2445: expect (ObjNum 821 snap 255 seq_num 821) 2026-02-12T17:39:01.109 INFO:tasks.rados.rados.0.trial082.stdout:2446: snap_remove snap 254 2026-02-12T17:39:02.108 INFO:tasks.rados.rados.0.trial082.stdout:2446: done (5 left) 2026-02-12T17:39:02.108 INFO:tasks.rados.rados.0.trial082.stdout:2447: read oid 37 snap 251 2026-02-12T17:39:02.108 INFO:tasks.rados.rados.0.trial082.stdout:2447: expect deleted 2026-02-12T17:39:02.108 INFO:tasks.rados.rados.0.trial082.stdout:2448: rollback oid 27 current snap is 259 2026-02-12T17:39:02.108 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 247 2026-02-12T17:39:02.108 INFO:tasks.rados.rados.0.trial082.stdout:2441: finishing rollback tid 0 to trial08226312-49 2026-02-12T17:39:02.109 INFO:tasks.rados.rados.0.trial082.stdout:2441: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:39:02.109 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 1537 (ObjNum 49 snap 0 seq_num 26813273) dirty dne 2026-02-12T17:39:02.109 INFO:tasks.rados.rados.0.trial082.stdout:2443: expect (ObjNum 797 snap 248 seq_num 797) 2026-02-12T17:39:02.129 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2652513 2026-02-12T17:39:02.220 INFO:tasks.rados.rados.0.trial082.stdout:2442: finishing copy_from racing read to trial08226312-36 2026-02-12T17:39:02.221 INFO:tasks.rados.rados.0.trial082.stdout:2445: expect (ObjNum 821 snap 255 seq_num 821) 2026-02-12T17:39:02.224 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1420215 2026-02-12T17:39:02.330 INFO:tasks.rados.rados.0.trial082.stdout:2444: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:39:02.330 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:02.386 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1812133 2026-02-12T17:39:02.399 INFO:tasks.rados.rados.0.trial082.stdout:2442: finishing copy_from to trial08226312-36 2026-02-12T17:39:02.399 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 560 (ObjNum 770 snap 234 seq_num 770) dirty exists 2026-02-12T17:39:02.399 INFO:tasks.rados.rados.0.trial082.stdout:2441: done (6 left) 2026-02-12T17:39:02.399 INFO:tasks.rados.rados.0.trial082.stdout:2442: done (5 left) 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2443: done (4 left) 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2444: done (3 left) 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2445: done (2 left) 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2447: done (1 left) 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2449: read oid 44 snap 255 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2449: expect (ObjNum 771 snap 234 seq_num 771) 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2450: copy_from oid 12 from oid 43 current snap is 259 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2448: finishing rollback tid 0 to trial08226312-27 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2448: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2448: finishing rollback tid 2 to trial08226312-27 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1110 (ObjNum 790 snap 243 seq_num 790) dirty exists 2026-02-12T17:39:02.400 INFO:tasks.rados.rados.0.trial082.stdout:2448: done (2 left) 2026-02-12T17:39:02.401 INFO:tasks.rados.rados.0.trial082.stdout:2451: write (excl) oid 8 current snap is 259 2026-02-12T17:39:02.401 INFO:tasks.rados.rados.0.trial082.stdout:2451: seq_num 833 ranges {400231=564894,1661971=338260} 2026-02-12T17:39:02.403 INFO:tasks.rados.rados.0.trial082.stdout:2451: writing trial08226312-8 from 400231 to 965125 tid 1 2026-02-12T17:39:02.407 INFO:tasks.rados.rados.0.trial082.stdout:2451: writing trial08226312-8 from 1661971 to 2000231 tid 2 2026-02-12T17:39:02.407 INFO:tasks.rados.rados.0.trial082.stdout:2452: copy_from oid 16 from oid 10 current snap is 259 2026-02-12T17:39:02.407 INFO:tasks.rados.rados.0.trial082.stdout:2450: finishing copy_from to trial08226312-12 2026-02-12T17:39:02.407 INFO:tasks.rados.rados.0.trial082.stdout:2450: got expected ENOENT (src dne) 2026-02-12T17:39:02.407 INFO:tasks.rados.rados.0.trial082.stdout:2450: finishing copy_from racing read to trial08226312-12 2026-02-12T17:39:02.407 INFO:tasks.rados.rados.0.trial082.stdout:2450: done (3 left) 2026-02-12T17:39:02.408 INFO:tasks.rados.rados.0.trial082.stdout:2453: snap_create 2026-02-12T17:39:02.408 INFO:tasks.rados.rados.0.trial082.stdout:2449: expect (ObjNum 771 snap 234 seq_num 771) 2026-02-12T17:39:02.446 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:02.517 INFO:tasks.rados.rados.0.trial082.stdout:2451: finishing write tid 1 to trial08226312-8 2026-02-12T17:39:02.517 INFO:tasks.rados.rados.0.trial082.stdout:2451: finishing write tid 2 to trial08226312-8 2026-02-12T17:39:02.517 INFO:tasks.rados.rados.0.trial082.stdout:2451: finishing write tid 3 to trial08226312-8 2026-02-12T17:39:02.518 INFO:tasks.rados.rados.0.trial082.stdout:2451: finishing write tid 4 to trial08226312-8 2026-02-12T17:39:02.518 INFO:tasks.rados.rados.0.trial082.stdout:2451: oid 8 updating version 0 to 1825 2026-02-12T17:39:02.518 INFO:tasks.rados.rados.0.trial082.stdout:2451: oid 8 version 1825 is already newer than 1824 2026-02-12T17:39:02.518 INFO:tasks.rados.rados.0.trial082.stdout:2451: oid 8 updating version 1825 to 1826 2026-02-12T17:39:02.518 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1826 (ObjNum 833 snap 259 seq_num 833) dirty exists 2026-02-12T17:39:02.518 INFO:tasks.rados.rados.0.trial082.stdout:2451: left oid 8 (ObjNum 833 snap 259 seq_num 833) 2026-02-12T17:39:02.518 INFO:tasks.rados.rados.0.trial082.stdout:2452: finishing copy_from racing read to trial08226312-16 2026-02-12T17:39:02.518 INFO:tasks.rados.rados.0.trial082.stdout:2452: finishing copy_from to trial08226312-16 2026-02-12T17:39:02.518 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1535 (ObjNum 707 snap 212 seq_num 707) dirty exists 2026-02-12T17:39:03.077 INFO:tasks.rados.rados.0.trial082.stdout:2449: done (3 left) 2026-02-12T17:39:03.078 INFO:tasks.rados.rados.0.trial082.stdout:2451: done (2 left) 2026-02-12T17:39:03.078 INFO:tasks.rados.rados.0.trial082.stdout:2452: done (1 left) 2026-02-12T17:39:03.078 INFO:tasks.rados.rados.0.trial082.stdout:2453: done (0 left) 2026-02-12T17:39:03.078 INFO:tasks.rados.rados.0.trial082.stdout:2454: read oid 29 snap -1 2026-02-12T17:39:03.078 INFO:tasks.rados.rados.0.trial082.stdout:2454: expect (ObjNum 831 snap 257 seq_num 831) 2026-02-12T17:39:03.078 INFO:tasks.rados.rados.0.trial082.stdout:2455: delete oid 9 current snap is 260 2026-02-12T17:39:03.079 INFO:tasks.rados.rados.0.trial082.stdout:2455: done (1 left) 2026-02-12T17:39:03.079 INFO:tasks.rados.rados.0.trial082.stdout:2456: read oid 46 snap -1 2026-02-12T17:39:03.079 INFO:tasks.rados.rados.0.trial082.stdout:2456: expect deleted 2026-02-12T17:39:03.080 INFO:tasks.rados.rados.0.trial082.stdout:2457: write oid 26 current snap is 260 2026-02-12T17:39:03.080 INFO:tasks.rados.rados.0.trial082.stdout:2457: seq_num 835 ranges {433845=715392,1662582=371263} 2026-02-12T17:39:03.083 INFO:tasks.rados.rados.0.trial082.stdout:2457: writing trial08226312-26 from 433845 to 1149237 tid 1 2026-02-12T17:39:03.087 INFO:tasks.rados.rados.0.trial082.stdout:2457: writing trial08226312-26 from 1662582 to 2033845 tid 2 2026-02-12T17:39:03.087 INFO:tasks.rados.rados.0.trial082.stdout:2458: write oid 30 current snap is 260 2026-02-12T17:39:03.087 INFO:tasks.rados.rados.0.trial082.stdout:2458: seq_num 836 ranges {450652=790641,1721064=329588} 2026-02-12T17:39:03.092 INFO:tasks.rados.rados.0.trial082.stdout:2458: writing trial08226312-30 from 450652 to 1241293 tid 1 2026-02-12T17:39:03.095 INFO:tasks.rados.rados.0.trial082.stdout:2458: writing trial08226312-30 from 1721064 to 2050652 tid 2 2026-02-12T17:39:03.095 INFO:tasks.rados.rados.0.trial082.stdout:2459: snap_remove snap 253 2026-02-12T17:39:04.078 INFO:tasks.rados.rados.0.trial082.stdout:2459: done (4 left) 2026-02-12T17:39:04.078 INFO:tasks.rados.rados.0.trial082.stdout:2460: rollback oid 27 current snap is 260 2026-02-12T17:39:04.078 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 255 2026-02-12T17:39:04.078 INFO:tasks.rados.rados.0.trial082.stdout:2454: expect (ObjNum 831 snap 257 seq_num 831) 2026-02-12T17:39:04.107 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2457: finishing write tid 1 to trial08226312-26 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2457: finishing write tid 2 to trial08226312-26 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2457: finishing write tid 3 to trial08226312-26 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2454: done (4 left) 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2456: done (3 left) 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2461: snap_create 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2457: finishing write tid 4 to trial08226312-26 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2457: oid 26 updating version 0 to 1547 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2457: oid 26 version 1547 is already newer than 1546 2026-02-12T17:39:04.166 INFO:tasks.rados.rados.0.trial082.stdout:2457: oid 26 version 1547 is already newer than 1545 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1547 (ObjNum 835 snap 260 seq_num 835) dirty exists 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2457: left oid 26 (ObjNum 835 snap 260 seq_num 835) 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2458: finishing write tid 1 to trial08226312-30 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2458: finishing write tid 2 to trial08226312-30 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2458: finishing write tid 3 to trial08226312-30 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2458: finishing write tid 4 to trial08226312-30 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2458: oid 30 updating version 0 to 1546 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2458: oid 30 version 1546 is already newer than 1545 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2458: oid 30 version 1546 is already newer than 1544 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1546 (ObjNum 836 snap 260 seq_num 836) dirty exists 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2458: left oid 30 (ObjNum 836 snap 260 seq_num 836) 2026-02-12T17:39:04.167 INFO:tasks.rados.rados.0.trial082.stdout:2460: finishing rollback tid 0 to trial08226312-27 2026-02-12T17:39:04.168 INFO:tasks.rados.rados.0.trial082.stdout:2460: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:39:04.168 INFO:tasks.rados.rados.0.trial082.stdout:2460: finishing rollback tid 2 to trial08226312-27 2026-02-12T17:39:04.168 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1113 (ObjNum 790 snap 243 seq_num 790) dirty exists 2026-02-12T17:39:05.110 INFO:tasks.rados.rados.0.trial082.stdout:2457: done (3 left) 2026-02-12T17:39:05.110 INFO:tasks.rados.rados.0.trial082.stdout:2458: done (2 left) 2026-02-12T17:39:05.110 INFO:tasks.rados.rados.0.trial082.stdout:2460: done (1 left) 2026-02-12T17:39:05.110 INFO:tasks.rados.rados.0.trial082.stdout:2461: done (0 left) 2026-02-12T17:39:05.110 INFO:tasks.rados.rados.0.trial082.stdout:2462: read oid 32 snap 260 2026-02-12T17:39:05.110 INFO:tasks.rados.rados.0.trial082.stdout:2462: expect deleted 2026-02-12T17:39:05.110 INFO:tasks.rados.rados.0.trial082.stdout:2463: snap_create 2026-02-12T17:39:06.111 INFO:tasks.rados.rados.0.trial082.stdout:2462: done (1 left) 2026-02-12T17:39:06.111 INFO:tasks.rados.rados.0.trial082.stdout:2463: done (0 left) 2026-02-12T17:39:06.111 INFO:tasks.rados.rados.0.trial082.stdout:2464: read oid 50 snap -1 2026-02-12T17:39:06.112 INFO:tasks.rados.rados.0.trial082.stdout:2464: expect (ObjNum 829 snap 256 seq_num 829) 2026-02-12T17:39:06.112 INFO:tasks.rados.rados.0.trial082.stdout:2465: rollback oid 1 current snap is 262 2026-02-12T17:39:06.112 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 251 2026-02-12T17:39:06.112 INFO:tasks.rados.rados.0.trial082.stdout:2466: delete oid 12 current snap is 262 2026-02-12T17:39:06.115 INFO:tasks.rados.rados.0.trial082.stdout:2466: done (2 left) 2026-02-12T17:39:06.115 INFO:tasks.rados.rados.0.trial082.stdout:2467: write oid 48 current snap is 262 2026-02-12T17:39:06.115 INFO:tasks.rados.rados.0.trial082.stdout:2467: seq_num 838 ranges {484266=657492,1554381=529885} 2026-02-12T17:39:06.119 INFO:tasks.rados.rados.0.trial082.stdout:2467: writing trial08226312-48 from 484266 to 1141758 tid 1 2026-02-12T17:39:06.123 INFO:tasks.rados.rados.0.trial082.stdout:2467: writing trial08226312-48 from 1554381 to 2084266 tid 2 2026-02-12T17:39:06.123 INFO:tasks.rados.rados.0.trial082.stdout:2468: read oid 29 snap -1 2026-02-12T17:39:06.123 INFO:tasks.rados.rados.0.trial082.stdout:2468: expect (ObjNum 831 snap 257 seq_num 831) 2026-02-12T17:39:06.123 INFO:tasks.rados.rados.0.trial082.stdout:2469: snap_remove snap 232 2026-02-12T17:39:07.117 INFO:tasks.rados.rados.0.trial082.stdout:2469: done (4 left) 2026-02-12T17:39:07.117 INFO:tasks.rados.rados.0.trial082.stdout:2470: snap_remove snap 258 2026-02-12T17:39:08.076 INFO:tasks.rados.rados.0.trial082.stdout:2470: done (4 left) 2026-02-12T17:39:08.077 INFO:tasks.rados.rados.0.trial082.stdout:2471: snap_create 2026-02-12T17:39:08.077 INFO:tasks.rados.rados.0.trial082.stdout:2465: finishing rollback tid 0 to trial08226312-1 2026-02-12T17:39:08.077 INFO:tasks.rados.rados.0.trial082.stdout:2465: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:39:08.077 INFO:tasks.rados.rados.0.trial082.stdout:2465: finishing rollback tid 2 to trial08226312-1 2026-02-12T17:39:08.077 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 942 (ObjNum 703 snap 212 seq_num 703) dirty exists 2026-02-12T17:39:08.077 INFO:tasks.rados.rados.0.trial082.stdout:2464: expect (ObjNum 829 snap 256 seq_num 829) 2026-02-12T17:39:08.087 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3813842 2026-02-12T17:39:08.136 INFO:tasks.rados.rados.0.trial082.stdout:2467: finishing write tid 1 to trial08226312-48 2026-02-12T17:39:08.136 INFO:tasks.rados.rados.0.trial082.stdout:2468: expect (ObjNum 831 snap 257 seq_num 831) 2026-02-12T17:39:08.214 INFO:tasks.rados.rados.0.trial082.stdout:2467: finishing write tid 2 to trial08226312-48 2026-02-12T17:39:08.214 INFO:tasks.rados.rados.0.trial082.stdout:2467: finishing write tid 3 to trial08226312-48 2026-02-12T17:39:08.214 INFO:tasks.rados.rados.0.trial082.stdout:2467: finishing write tid 4 to trial08226312-48 2026-02-12T17:39:08.214 INFO:tasks.rados.rados.0.trial082.stdout:2467: oid 48 updating version 0 to 829 2026-02-12T17:39:08.214 INFO:tasks.rados.rados.0.trial082.stdout:2467: oid 48 updating version 829 to 830 2026-02-12T17:39:08.214 INFO:tasks.rados.rados.0.trial082.stdout:2467: oid 48 updating version 830 to 831 2026-02-12T17:39:08.214 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 831 (ObjNum 838 snap 262 seq_num 838) dirty exists 2026-02-12T17:39:08.215 INFO:tasks.rados.rados.0.trial082.stdout:2467: left oid 48 (ObjNum 838 snap 262 seq_num 838) 2026-02-12T17:39:09.079 INFO:tasks.rados.rados.0.trial082.stdout:2464: done (4 left) 2026-02-12T17:39:09.079 INFO:tasks.rados.rados.0.trial082.stdout:2465: done (3 left) 2026-02-12T17:39:09.079 INFO:tasks.rados.rados.0.trial082.stdout:2467: done (2 left) 2026-02-12T17:39:09.079 INFO:tasks.rados.rados.0.trial082.stdout:2468: done (1 left) 2026-02-12T17:39:09.079 INFO:tasks.rados.rados.0.trial082.stdout:2471: done (0 left) 2026-02-12T17:39:09.079 INFO:tasks.rados.rados.0.trial082.stdout:2472: copy_from oid 42 from oid 3 current snap is 263 2026-02-12T17:39:09.079 INFO:tasks.rados.rados.0.trial082.stdout:2473: write (excl) oid 24 current snap is 263 2026-02-12T17:39:09.080 INFO:tasks.rados.rados.0.trial082.stdout:2473: seq_num 839 ranges {501073=732741,1896510=204563} 2026-02-12T17:39:09.083 INFO:tasks.rados.rados.0.trial082.stdout:2473: writing trial08226312-24 from 501073 to 1233814 tid 1 2026-02-12T17:39:09.086 INFO:tasks.rados.rados.0.trial082.stdout:2473: writing trial08226312-24 from 1896510 to 2101073 tid 2 2026-02-12T17:39:09.086 INFO:tasks.rados.rados.0.trial082.stdout:2474: snap_create 2026-02-12T17:39:09.086 INFO:tasks.rados.rados.0.trial082.stdout:2473: finishing write tid 1 to trial08226312-24 2026-02-12T17:39:09.087 INFO:tasks.rados.rados.0.trial082.stdout:2472: finishing copy_from racing read to trial08226312-42 2026-02-12T17:39:09.088 INFO:tasks.rados.rados.0.trial082.stdout:2473: finishing write tid 2 to trial08226312-24 2026-02-12T17:39:09.088 INFO:tasks.rados.rados.0.trial082.stdout:2473: finishing write tid 3 to trial08226312-24 2026-02-12T17:39:09.088 INFO:tasks.rados.rados.0.trial082.stdout:2473: finishing write tid 4 to trial08226312-24 2026-02-12T17:39:09.088 INFO:tasks.rados.rados.0.trial082.stdout:2473: oid 24 updating version 0 to 1844 2026-02-12T17:39:09.088 INFO:tasks.rados.rados.0.trial082.stdout:2473: oid 24 updating version 1844 to 1845 2026-02-12T17:39:09.089 INFO:tasks.rados.rados.0.trial082.stdout:2473: oid 24 updating version 1845 to 1846 2026-02-12T17:39:09.089 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1846 (ObjNum 839 snap 263 seq_num 839) dirty exists 2026-02-12T17:39:09.089 INFO:tasks.rados.rados.0.trial082.stdout:2473: left oid 24 (ObjNum 839 snap 263 seq_num 839) 2026-02-12T17:39:09.089 INFO:tasks.rados.rados.0.trial082.stdout:2472: finishing copy_from to trial08226312-42 2026-02-12T17:39:09.089 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 950 (ObjNum 806 snap 251 seq_num 806) dirty exists 2026-02-12T17:39:10.082 INFO:tasks.rados.rados.0.trial082.stdout:2472: done (2 left) 2026-02-12T17:39:10.082 INFO:tasks.rados.rados.0.trial082.stdout:2473: done (1 left) 2026-02-12T17:39:10.082 INFO:tasks.rados.rados.0.trial082.stdout:2474: done (0 left) 2026-02-12T17:39:10.082 INFO:tasks.rados.rados.0.trial082.stdout:2475: read oid 31 snap -1 2026-02-12T17:39:10.082 INFO:tasks.rados.rados.0.trial082.stdout:2475: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-12T17:39:10.082 INFO:tasks.rados.rados.0.trial082.stdout:2476: snap_create 2026-02-12T17:39:10.086 INFO:tasks.rados.rados.0.trial082.stdout:2475: expect (ObjNum 824 snap 255 seq_num 824) 2026-02-12T17:39:10.086 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:10.137 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2284764 2026-02-12T17:39:11.082 INFO:tasks.rados.rados.0.trial082.stdout:2475: done (1 left) 2026-02-12T17:39:11.082 INFO:tasks.rados.rados.0.trial082.stdout:2476: done (0 left) 2026-02-12T17:39:11.083 INFO:tasks.rados.rados.0.trial082.stdout:2477: snap_remove snap 255 2026-02-12T17:39:12.083 INFO:tasks.rados.rados.0.trial082.stdout:2477: done (0 left) 2026-02-12T17:39:12.083 INFO:tasks.rados.rados.0.trial082.stdout:2478: write (excl) oid 21 current snap is 265 2026-02-12T17:39:12.083 INFO:tasks.rados.rados.0.trial082.stdout:2478: seq_num 840 ranges {517880=407990,1554992=562888} 2026-02-12T17:39:12.087 INFO:tasks.rados.rados.0.trial082.stdout:2478: writing trial08226312-21 from 517880 to 925870 tid 1 2026-02-12T17:39:12.091 INFO:tasks.rados.rados.0.trial082.stdout:2478: writing trial08226312-21 from 1554992 to 2117880 tid 2 2026-02-12T17:39:12.092 INFO:tasks.rados.rados.0.trial082.stdout:2479: read oid 46 snap -1 2026-02-12T17:39:12.092 INFO:tasks.rados.rados.0.trial082.stdout:2479: expect deleted 2026-02-12T17:39:12.092 INFO:tasks.rados.rados.0.trial082.stdout:2480: snap_remove snap 249 2026-02-12T17:39:13.077 INFO:tasks.rados.rados.0.trial082.stdout:2480: done (2 left) 2026-02-12T17:39:13.078 INFO:tasks.rados.rados.0.trial082.stdout:2481: snap_remove snap 261 2026-02-12T17:39:14.079 INFO:tasks.rados.rados.0.trial082.stdout:2481: done (2 left) 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:2482: delete oid 30 current snap is 265 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:2478: finishing write tid 1 to trial08226312-21 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:2478: finishing write tid 2 to trial08226312-21 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:2478: finishing write tid 3 to trial08226312-21 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:2478: finishing write tid 4 to trial08226312-21 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:2478: oid 21 updating version 0 to 1549 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:2478: oid 21 version 1549 is already newer than 1548 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:2478: oid 21 version 1549 is already newer than 1547 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1549 (ObjNum 840 snap 265 seq_num 840) dirty exists 2026-02-12T17:39:14.080 INFO:tasks.rados.rados.0.trial082.stdout:2478: left oid 21 (ObjNum 840 snap 265 seq_num 840) 2026-02-12T17:39:14.082 INFO:tasks.rados.rados.0.trial082.stdout:2478: done (2 left) 2026-02-12T17:39:14.082 INFO:tasks.rados.rados.0.trial082.stdout:2479: done (1 left) 2026-02-12T17:39:14.082 INFO:tasks.rados.rados.0.trial082.stdout:2482: done (0 left) 2026-02-12T17:39:14.082 INFO:tasks.rados.rados.0.trial082.stdout:2483: rollback oid 19 current snap is 265 2026-02-12T17:39:14.082 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 251 2026-02-12T17:39:14.082 INFO:tasks.rados.rados.0.trial082.stdout:2484: read oid 30 snap 264 2026-02-12T17:39:14.082 INFO:tasks.rados.rados.0.trial082.stdout:2484: expect (ObjNum 836 snap 260 seq_num 836) 2026-02-12T17:39:14.082 INFO:tasks.rados.rados.0.trial082.stdout:2485: write (excl) oid 34 current snap is 265 2026-02-12T17:39:14.082 INFO:tasks.rados.rados.0.trial082.stdout:2485: seq_num 842 ranges {551494=558488,1671956=479538} 2026-02-12T17:39:14.086 INFO:tasks.rados.rados.0.trial082.stdout:2485: writing trial08226312-34 from 551494 to 1109982 tid 1 2026-02-12T17:39:14.091 INFO:tasks.rados.rados.0.trial082.stdout:2485: writing trial08226312-34 from 1671956 to 2151494 tid 2 2026-02-12T17:39:14.091 INFO:tasks.rados.rados.0.trial082.stdout:2486: read oid 41 snap 263 2026-02-12T17:39:14.091 INFO:tasks.rados.rados.0.trial082.stdout:2486: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:39:14.091 INFO:tasks.rados.rados.0.trial082.stdout:2487: delete oid 23 current snap is 265 2026-02-12T17:39:14.091 INFO:tasks.rados.rados.0.trial082.stdout:2484: expect (ObjNum 836 snap 260 seq_num 836) 2026-02-12T17:39:14.123 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 271839 2026-02-12T17:39:14.140 INFO:tasks.rados.rados.0.trial082.stdout:2485: finishing write tid 1 to trial08226312-34 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:2484: done (4 left) 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:2487: done (3 left) 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:2488: read oid 18 snap -1 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:2488: expect (ObjNum 806 snap 251 seq_num 806) 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:2489: delete oid 13 current snap is 265 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:2483: finishing rollback tid 0 to trial08226312-19 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:2483: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:2483: finishing rollback tid 2 to trial08226312-19 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 1860 (ObjNum 723 snap 213 seq_num 723) dirty exists 2026-02-12T17:39:14.141 INFO:tasks.rados.rados.0.trial082.stdout:2485: finishing write tid 2 to trial08226312-34 2026-02-12T17:39:14.142 INFO:tasks.rados.rados.0.trial082.stdout:2485: finishing write tid 3 to trial08226312-34 2026-02-12T17:39:14.142 INFO:tasks.rados.rados.0.trial082.stdout:2485: finishing write tid 4 to trial08226312-34 2026-02-12T17:39:14.142 INFO:tasks.rados.rados.0.trial082.stdout:2485: oid 34 updating version 0 to 1540 2026-02-12T17:39:14.142 INFO:tasks.rados.rados.0.trial082.stdout:2485: oid 34 version 1540 is already newer than 1539 2026-02-12T17:39:14.142 INFO:tasks.rados.rados.0.trial082.stdout:2485: oid 34 version 1540 is already newer than 1538 2026-02-12T17:39:14.142 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1540 (ObjNum 842 snap 265 seq_num 842) dirty exists 2026-02-12T17:39:14.142 INFO:tasks.rados.rados.0.trial082.stdout:2485: left oid 34 (ObjNum 842 snap 265 seq_num 842) 2026-02-12T17:39:14.142 INFO:tasks.rados.rados.0.trial082.stdout:2486: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:39:14.146 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1783380 2026-02-12T17:39:14.158 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:14.191 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2162464 2026-02-12T17:39:14.201 INFO:tasks.rados.rados.0.trial082.stdout:2488: expect (ObjNum 806 snap 251 seq_num 806) 2026-02-12T17:39:14.330 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1767253 2026-02-12T17:39:14.350 INFO:tasks.rados.rados.0.trial082.stdout:2483: done (4 left) 2026-02-12T17:39:14.350 INFO:tasks.rados.rados.0.trial082.stdout:2485: done (3 left) 2026-02-12T17:39:14.351 INFO:tasks.rados.rados.0.trial082.stdout:2486: done (2 left) 2026-02-12T17:39:14.351 INFO:tasks.rados.rados.0.trial082.stdout:2488: done (1 left) 2026-02-12T17:39:14.351 INFO:tasks.rados.rados.0.trial082.stdout:2489: done (0 left) 2026-02-12T17:39:14.351 INFO:tasks.rados.rados.0.trial082.stdout:2490: read oid 10 snap -1 2026-02-12T17:39:14.351 INFO:tasks.rados.rados.0.trial082.stdout:2490: expect (ObjNum 707 snap 212 seq_num 707) 2026-02-12T17:39:14.351 INFO:tasks.rados.rados.0.trial082.stdout:2491: copy_from oid 44 from oid 5 current snap is 265 2026-02-12T17:39:14.351 INFO:tasks.rados.rados.0.trial082.stdout:2492: rollback oid 30 current snap is 265 2026-02-12T17:39:14.351 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 262 2026-02-12T17:39:14.351 INFO:tasks.rados.rados.0.trial082.stdout:2493: snap_remove snap 259 2026-02-12T17:39:15.088 INFO:tasks.rados.rados.0.trial082.stdout:2493: done (3 left) 2026-02-12T17:39:15.088 INFO:tasks.rados.rados.0.trial082.stdout:2494: copy_from oid 35 from oid 24 current snap is 265 2026-02-12T17:39:15.088 INFO:tasks.rados.rados.0.trial082.stdout:2490: expect (ObjNum 707 snap 212 seq_num 707) 2026-02-12T17:39:15.088 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:15.234 INFO:tasks.rados.rados.0.trial082.stdout:2492: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:39:15.234 INFO:tasks.rados.rados.0.trial082.stdout:2492: finishing rollback tid 2 to trial08226312-30 2026-02-12T17:39:15.234 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1552 (ObjNum 836 snap 260 seq_num 836) dirty exists 2026-02-12T17:39:15.234 INFO:tasks.rados.rados.0.trial082.stdout:2491: finishing copy_from racing read to trial08226312-44 2026-02-12T17:39:15.234 INFO:tasks.rados.rados.0.trial082.stdout:2491: finishing copy_from to trial08226312-44 2026-02-12T17:39:15.234 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 1107 (ObjNum 824 snap 255 seq_num 824) dirty exists 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:2494: finishing copy_from racing read to trial08226312-35 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:2494: finishing copy_from to trial08226312-35 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1846 (ObjNum 839 snap 263 seq_num 839) dirty exists 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:2490: done (3 left) 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:2491: done (2 left) 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:2492: done (1 left) 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:2494: done (0 left) 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:2495: rollback oid 10 current snap is 265 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 10 to 256 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:2496: copy_from oid 32 from oid 21 current snap is 265 2026-02-12T17:39:15.235 INFO:tasks.rados.rados.0.trial082.stdout:2497: snap_create 2026-02-12T17:39:15.236 INFO:tasks.rados.rados.0.trial082.stdout:2495: finishing rollback tid 0 to trial08226312-10 2026-02-12T17:39:15.236 INFO:tasks.rados.rados.0.trial082.stdout:2495: finishing rollback tid 1 to trial08226312-10 2026-02-12T17:39:15.238 INFO:tasks.rados.rados.0.trial082.stdout:2495: finishing rollback tid 2 to trial08226312-10 2026-02-12T17:39:15.238 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1555 (ObjNum 707 snap 212 seq_num 707) dirty exists 2026-02-12T17:39:15.242 INFO:tasks.rados.rados.0.trial082.stdout:2496: finishing copy_from racing read to trial08226312-32 2026-02-12T17:39:15.242 INFO:tasks.rados.rados.0.trial082.stdout:2496: finishing copy_from to trial08226312-32 2026-02-12T17:39:15.242 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 1549 (ObjNum 840 snap 265 seq_num 840) dirty exists 2026-02-12T17:39:16.091 INFO:tasks.rados.rados.0.trial082.stdout:2495: done (2 left) 2026-02-12T17:39:16.092 INFO:tasks.rados.rados.0.trial082.stdout:2496: done (1 left) 2026-02-12T17:39:16.092 INFO:tasks.rados.rados.0.trial082.stdout:2497: done (0 left) 2026-02-12T17:39:16.092 INFO:tasks.rados.rados.0.trial082.stdout:2498: read oid 11 snap 262 2026-02-12T17:39:16.092 INFO:tasks.rados.rados.0.trial082.stdout:2498: expect (ObjNum 815 snap 253 seq_num 815) 2026-02-12T17:39:16.092 INFO:tasks.rados.rados.0.trial082.stdout:2499: delete oid 31 current snap is 266 2026-02-12T17:39:16.094 INFO:tasks.rados.rados.0.trial082.stdout:2499: done (1 left) 2026-02-12T17:39:16.094 INFO:tasks.rados.rados.0.trial082.stdout:2500: snap_remove snap 247 2026-02-12T17:39:17.091 INFO:tasks.rados.rados.0.trial082.stdout:2500: done (1 left) 2026-02-12T17:39:17.092 INFO:tasks.rados.rados.0.trial082.stdout:2501: snap_create 2026-02-12T17:39:17.092 INFO:tasks.rados.rados.0.trial082.stdout:2498: expect (ObjNum 815 snap 253 seq_num 815) 2026-02-12T17:39:18.078 INFO:tasks.rados.rados.0.trial082.stdout:2498: done (1 left) 2026-02-12T17:39:18.079 INFO:tasks.rados.rados.0.trial082.stdout:2501: done (0 left) 2026-02-12T17:39:18.079 INFO:tasks.rados.rados.0.trial082.stdout:2502: copy_from oid 7 from oid 13 current snap is 267 2026-02-12T17:39:18.079 INFO:tasks.rados.rados.0.trial082.stdout:2503: snap_create 2026-02-12T17:39:18.080 INFO:tasks.rados.rados.0.trial082.stdout:2502: finishing copy_from to trial08226312-7 2026-02-12T17:39:18.080 INFO:tasks.rados.rados.0.trial082.stdout:2502: got expected ENOENT (src dne) 2026-02-12T17:39:18.080 INFO:tasks.rados.rados.0.trial082.stdout:2502: finishing copy_from racing read to trial08226312-7 2026-02-12T17:39:19.079 INFO:tasks.rados.rados.0.trial082.stdout:2502: done (1 left) 2026-02-12T17:39:19.079 INFO:tasks.rados.rados.0.trial082.stdout:2503: done (0 left) 2026-02-12T17:39:19.080 INFO:tasks.rados.rados.0.trial082.stdout:2504: delete oid 25 current snap is 268 2026-02-12T17:39:19.082 INFO:tasks.rados.rados.0.trial082.stdout:2504: done (0 left) 2026-02-12T17:39:19.082 INFO:tasks.rados.rados.0.trial082.stdout:2505: rollback oid 45 current snap is 268 2026-02-12T17:39:19.082 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 250 2026-02-12T17:39:19.082 INFO:tasks.rados.rados.0.trial082.stdout:2506: write oid 34 current snap is 268 2026-02-12T17:39:19.082 INFO:tasks.rados.rados.0.trial082.stdout:2506: seq_num 847 ranges {635529=651086,1848013=387516} 2026-02-12T17:39:19.088 INFO:tasks.rados.rados.0.trial082.stdout:2506: writing trial08226312-34 from 635529 to 1286615 tid 1 2026-02-12T17:39:19.092 INFO:tasks.rados.rados.0.trial082.stdout:2506: writing trial08226312-34 from 1848013 to 2235529 tid 2 2026-02-12T17:39:19.092 INFO:tasks.rados.rados.0.trial082.stdout:2507: write oid 46 current snap is 268 2026-02-12T17:39:19.092 INFO:tasks.rados.rados.0.trial082.stdout:2507: seq_num 848 ranges {652336=726335,1906495=345841} 2026-02-12T17:39:19.097 INFO:tasks.rados.rados.0.trial082.stdout:2507: writing trial08226312-46 from 652336 to 1378671 tid 1 2026-02-12T17:39:19.101 INFO:tasks.rados.rados.0.trial082.stdout:2507: writing trial08226312-46 from 1906495 to 2252336 tid 2 2026-02-12T17:39:19.101 INFO:tasks.rados.rados.0.trial082.stdout:2508: rollback oid 4 current snap is 268 2026-02-12T17:39:19.101 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 4 to 267 2026-02-12T17:39:19.101 INFO:tasks.rados.rados.0.trial082.stdout:2505: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2505: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1848 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2506: finishing write tid 1 to trial08226312-34 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2506: finishing write tid 2 to trial08226312-34 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2505: done (3 left) 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2509: read oid 28 snap -1 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2509: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2510: copy_from oid 18 from oid 32 current snap is 268 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2506: finishing write tid 3 to trial08226312-34 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2506: finishing write tid 4 to trial08226312-34 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2506: oid 34 updating version 0 to 1542 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2506: oid 34 version 1542 is already newer than 1541 2026-02-12T17:39:19.102 INFO:tasks.rados.rados.0.trial082.stdout:2506: oid 34 updating version 1542 to 1543 2026-02-12T17:39:19.103 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1543 (ObjNum 847 snap 268 seq_num 847) dirty exists 2026-02-12T17:39:19.103 INFO:tasks.rados.rados.0.trial082.stdout:2506: left oid 34 (ObjNum 847 snap 268 seq_num 847) 2026-02-12T17:39:19.103 INFO:tasks.rados.rados.0.trial082.stdout:2507: finishing write tid 1 to trial08226312-46 2026-02-12T17:39:19.103 INFO:tasks.rados.rados.0.trial082.stdout:2506: done (4 left) 2026-02-12T17:39:19.103 INFO:tasks.rados.rados.0.trial082.stdout:2511: copy_from oid 6 from oid 26 current snap is 268 2026-02-12T17:39:19.103 INFO:tasks.rados.rados.0.trial082.stdout:2512: write (excl) oid 5 current snap is 268 2026-02-12T17:39:19.103 INFO:tasks.rados.rados.0.trial082.stdout:2512: seq_num 849 ranges {669143=401584,1564977=426959} 2026-02-12T17:39:19.104 INFO:tasks.rados.rados.0.trial082.stdout:2512: writing trial08226312-5 from 669143 to 1070727 tid 1 2026-02-12T17:39:19.108 INFO:tasks.rados.rados.0.trial082.stdout:2512: writing trial08226312-5 from 1564977 to 1991936 tid 2 2026-02-12T17:39:19.108 INFO:tasks.rados.rados.0.trial082.stdout:2513: write (excl) oid 8 current snap is 268 2026-02-12T17:39:19.108 INFO:tasks.rados.rados.0.trial082.stdout:2513: seq_num 850 ranges {685950=476833,1623459=570617} 2026-02-12T17:39:19.112 INFO:tasks.rados.rados.0.trial082.stdout:2513: writing trial08226312-8 from 685950 to 1162783 tid 1 2026-02-12T17:39:19.116 INFO:tasks.rados.rados.0.trial082.stdout:2513: writing trial08226312-8 from 1623459 to 2194076 tid 2 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2514: copy_from oid 15 from oid 49 current snap is 268 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2507: finishing write tid 2 to trial08226312-46 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2507: finishing write tid 3 to trial08226312-46 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2507: finishing write tid 4 to trial08226312-46 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2507: oid 46 updating version 0 to 1328 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2507: oid 46 version 1328 is already newer than 1326 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2507: oid 46 version 1328 is already newer than 1327 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1328 (ObjNum 848 snap 268 seq_num 848) dirty exists 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2507: left oid 46 (ObjNum 848 snap 268 seq_num 848) 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2508: finishing rollback tid 0 to trial08226312-4 2026-02-12T17:39:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2508: finishing rollback tid 1 to trial08226312-4 2026-02-12T17:39:19.118 INFO:tasks.rados.rados.0.trial082.stdout:2507: done (7 left) 2026-02-12T17:39:19.118 INFO:tasks.rados.rados.0.trial082.stdout:2515: write oid 44 current snap is 268 2026-02-12T17:39:19.118 INFO:tasks.rados.rados.0.trial082.stdout:2515: seq_num 851 ranges {702757=552082,1681941=430628} 2026-02-12T17:39:19.121 INFO:tasks.rados.rados.0.trial082.stdout:2515: writing trial08226312-44 from 702757 to 1254839 tid 1 2026-02-12T17:39:19.124 INFO:tasks.rados.rados.0.trial082.stdout:2515: writing trial08226312-44 from 1681941 to 2112569 tid 2 2026-02-12T17:39:19.124 INFO:tasks.rados.rados.0.trial082.stdout:2516: read oid 45 snap -1 2026-02-12T17:39:19.124 INFO:tasks.rados.rados.0.trial082.stdout:2516: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:39:19.125 INFO:tasks.rados.rados.0.trial082.stdout:2517: snap_create 2026-02-12T17:39:19.125 INFO:tasks.rados.rados.0.trial082.stdout:2508: finishing rollback tid 2 to trial08226312-4 2026-02-12T17:39:19.125 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 1878 (ObjNum 732 snap 217 seq_num 732) dirty exists 2026-02-12T17:39:19.125 INFO:tasks.rados.rados.0.trial082.stdout:2509: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:39:19.146 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:19.171 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:19.196 INFO:tasks.rados.rados.0.trial082.stdout:2511: finishing copy_from racing read to trial08226312-6 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:2511: finishing copy_from to trial08226312-6 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 1547 (ObjNum 835 snap 260 seq_num 835) dirty exists 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:2512: finishing write tid 1 to trial08226312-5 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:2510: finishing copy_from racing read to trial08226312-18 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:2513: finishing write tid 1 to trial08226312-8 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:2514: finishing copy_from to trial08226312-15 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:2514: got expected ENOENT (src dne) 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:2514: finishing copy_from racing read to trial08226312-15 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:2510: finishing copy_from to trial08226312-18 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 1549 (ObjNum 840 snap 265 seq_num 840) dirty exists 2026-02-12T17:39:19.197 INFO:tasks.rados.rados.0.trial082.stdout:2513: finishing write tid 2 to trial08226312-8 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2513: finishing write tid 3 to trial08226312-8 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2513: finishing write tid 4 to trial08226312-8 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2513: oid 8 updating version 0 to 1881 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2513: oid 8 updating version 1881 to 1882 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2513: oid 8 version 1882 is already newer than 1880 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1882 (ObjNum 850 snap 268 seq_num 850) dirty exists 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2513: left oid 8 (ObjNum 850 snap 268 seq_num 850) 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2512: finishing write tid 2 to trial08226312-5 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2512: finishing write tid 3 to trial08226312-5 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2512: finishing write tid 4 to trial08226312-5 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2512: oid 5 updating version 0 to 1132 2026-02-12T17:39:19.198 INFO:tasks.rados.rados.0.trial082.stdout:2512: oid 5 version 1132 is already newer than 1131 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:2512: oid 5 updating version 1132 to 1133 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 1133 (ObjNum 849 snap 268 seq_num 849) dirty exists 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:2512: left oid 5 (ObjNum 849 snap 268 seq_num 849) 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:2515: finishing write tid 1 to trial08226312-44 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:2515: finishing write tid 2 to trial08226312-44 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:2515: finishing write tid 3 to trial08226312-44 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:2515: finishing write tid 4 to trial08226312-44 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:2515: oid 44 updating version 0 to 1851 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:2515: oid 44 version 1851 is already newer than 1850 2026-02-12T17:39:19.199 INFO:tasks.rados.rados.0.trial082.stdout:2515: oid 44 version 1851 is already newer than 1849 2026-02-12T17:39:19.200 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 1851 (ObjNum 851 snap 268 seq_num 851) dirty exists 2026-02-12T17:39:19.200 INFO:tasks.rados.rados.0.trial082.stdout:2515: left oid 44 (ObjNum 851 snap 268 seq_num 851) 2026-02-12T17:39:19.200 INFO:tasks.rados.rados.0.trial082.stdout:2516: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:39:19.289 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3167770 2026-02-12T17:39:20.100 INFO:tasks.rados.rados.0.trial082.stdout:2508: done (9 left) 2026-02-12T17:39:20.100 INFO:tasks.rados.rados.0.trial082.stdout:2509: done (8 left) 2026-02-12T17:39:20.100 INFO:tasks.rados.rados.0.trial082.stdout:2510: done (7 left) 2026-02-12T17:39:20.100 INFO:tasks.rados.rados.0.trial082.stdout:2511: done (6 left) 2026-02-12T17:39:20.100 INFO:tasks.rados.rados.0.trial082.stdout:2512: done (5 left) 2026-02-12T17:39:20.100 INFO:tasks.rados.rados.0.trial082.stdout:2513: done (4 left) 2026-02-12T17:39:20.100 INFO:tasks.rados.rados.0.trial082.stdout:2514: done (3 left) 2026-02-12T17:39:20.100 INFO:tasks.rados.rados.0.trial082.stdout:2515: done (2 left) 2026-02-12T17:39:20.101 INFO:tasks.rados.rados.0.trial082.stdout:2516: done (1 left) 2026-02-12T17:39:20.101 INFO:tasks.rados.rados.0.trial082.stdout:2517: done (0 left) 2026-02-12T17:39:20.101 INFO:tasks.rados.rados.0.trial082.stdout:2518: delete oid 27 current snap is 269 2026-02-12T17:39:20.102 INFO:tasks.rados.rados.0.trial082.stdout:2518: done (0 left) 2026-02-12T17:39:20.102 INFO:tasks.rados.rados.0.trial082.stdout:2519: delete oid 3 current snap is 269 2026-02-12T17:39:20.105 INFO:tasks.rados.rados.0.trial082.stdout:2519: done (0 left) 2026-02-12T17:39:20.105 INFO:tasks.rados.rados.0.trial082.stdout:2520: snap_create 2026-02-12T17:39:21.100 INFO:tasks.rados.rados.0.trial082.stdout:2520: done (0 left) 2026-02-12T17:39:21.101 INFO:tasks.rados.rados.0.trial082.stdout:2521: rollback oid 46 current snap is 270 2026-02-12T17:39:21.101 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 46 to 256 2026-02-12T17:39:21.101 INFO:tasks.rados.rados.0.trial082.stdout:2522: delete oid 5 current snap is 270 2026-02-12T17:39:21.103 INFO:tasks.rados.rados.0.trial082.stdout:2522: done (1 left) 2026-02-12T17:39:21.104 INFO:tasks.rados.rados.0.trial082.stdout:2523: read oid 38 snap 252 2026-02-12T17:39:21.104 INFO:tasks.rados.rados.0.trial082.stdout:2523: expect deleted 2026-02-12T17:39:21.104 INFO:tasks.rados.rados.0.trial082.stdout:2524: snap_remove snap 263 2026-02-12T17:39:22.159 INFO:tasks.rados.rados.0.trial082.stdout:2524: done (2 left) 2026-02-12T17:39:22.159 INFO:tasks.rados.rados.0.trial082.stdout:2525: delete oid 41 current snap is 270 2026-02-12T17:39:22.160 INFO:tasks.rados.rados.0.trial082.stdout:2521: finishing rollback tid 0 to trial08226312-46 2026-02-12T17:39:22.160 INFO:tasks.rados.rados.0.trial082.stdout:2521: finishing rollback tid 1 to trial08226312-46 2026-02-12T17:39:22.160 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1330 (ObjNum 97 snap 0 seq_num 27629632) dirty dne 2026-02-12T17:39:22.164 INFO:tasks.rados.rados.0.trial082.stdout:2521: done (2 left) 2026-02-12T17:39:22.164 INFO:tasks.rados.rados.0.trial082.stdout:2523: done (1 left) 2026-02-12T17:39:22.164 INFO:tasks.rados.rados.0.trial082.stdout:2525: done (0 left) 2026-02-12T17:39:22.164 INFO:tasks.rados.rados.0.trial082.stdout:2526: write (excl) oid 11 current snap is 270 2026-02-12T17:39:22.164 INFO:tasks.rados.rados.0.trial082.stdout:2526: seq_num 856 ranges {786792=644680,1857998=528794} 2026-02-12T17:39:22.170 INFO:tasks.rados.rados.0.trial082.stdout:2526: writing trial08226312-11 from 786792 to 1431472 tid 1 2026-02-12T17:39:22.173 INFO:tasks.rados.rados.0.trial082.stdout:2526: writing trial08226312-11 from 1857998 to 2386792 tid 2 2026-02-12T17:39:22.174 INFO:tasks.rados.rados.0.trial082.stdout:2527: write (excl) oid 23 current snap is 270 2026-02-12T17:39:22.174 INFO:tasks.rados.rados.0.trial082.stdout:2527: seq_num 857 ranges {403599=719929,1916480=441635} 2026-02-12T17:39:22.177 INFO:tasks.rados.rados.0.trial082.stdout:2527: writing trial08226312-23 from 403599 to 1123528 tid 1 2026-02-12T17:39:22.182 INFO:tasks.rados.rados.0.trial082.stdout:2527: writing trial08226312-23 from 1916480 to 2358115 tid 2 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:2528: rollback oid 24 current snap is 270 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 252 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:2526: finishing write tid 1 to trial08226312-11 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:2526: finishing write tid 2 to trial08226312-11 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:2526: finishing write tid 3 to trial08226312-11 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:2526: finishing write tid 4 to trial08226312-11 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:2526: oid 11 updating version 0 to 1331 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:2526: oid 11 updating version 1331 to 1333 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:2526: oid 11 version 1333 is already newer than 1332 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1333 (ObjNum 856 snap 270 seq_num 856) dirty exists 2026-02-12T17:39:22.183 INFO:tasks.rados.rados.0.trial082.stdout:2526: left oid 11 (ObjNum 856 snap 270 seq_num 856) 2026-02-12T17:39:22.184 INFO:tasks.rados.rados.0.trial082.stdout:2527: finishing write tid 1 to trial08226312-23 2026-02-12T17:39:22.184 INFO:tasks.rados.rados.0.trial082.stdout:2526: done (2 left) 2026-02-12T17:39:22.184 INFO:tasks.rados.rados.0.trial082.stdout:2529: write (excl) oid 20 current snap is 270 2026-02-12T17:39:22.184 INFO:tasks.rados.rados.0.trial082.stdout:2529: seq_num 858 ranges {420406=795178,1974962=445444} 2026-02-12T17:39:22.187 INFO:tasks.rados.rados.0.trial082.stdout:2529: writing trial08226312-20 from 420406 to 1215584 tid 1 2026-02-12T17:39:22.191 INFO:tasks.rados.rados.0.trial082.stdout:2529: writing trial08226312-20 from 1974962 to 2420406 tid 2 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2530: snap_create 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2527: finishing write tid 2 to trial08226312-23 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2527: finishing write tid 3 to trial08226312-23 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2527: finishing write tid 4 to trial08226312-23 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2527: oid 23 updating version 0 to 1854 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2527: oid 23 version 1854 is already newer than 1852 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2527: oid 23 version 1854 is already newer than 1853 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 1854 (ObjNum 857 snap 270 seq_num 857) dirty exists 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2527: left oid 23 (ObjNum 857 snap 270 seq_num 857) 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2528: finishing rollback tid 0 to trial08226312-24 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2528: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:39:22.192 INFO:tasks.rados.rados.0.trial082.stdout:2528: finishing rollback tid 2 to trial08226312-24 2026-02-12T17:39:22.193 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1892 (ObjNum 645 snap 197 seq_num 645) dirty exists 2026-02-12T17:39:22.193 INFO:tasks.rados.rados.0.trial082.stdout:2529: finishing write tid 1 to trial08226312-20 2026-02-12T17:39:22.193 INFO:tasks.rados.rados.0.trial082.stdout:2529: finishing write tid 2 to trial08226312-20 2026-02-12T17:39:22.194 INFO:tasks.rados.rados.0.trial082.stdout:2529: finishing write tid 3 to trial08226312-20 2026-02-12T17:39:22.194 INFO:tasks.rados.rados.0.trial082.stdout:2529: finishing write tid 4 to trial08226312-20 2026-02-12T17:39:22.194 INFO:tasks.rados.rados.0.trial082.stdout:2529: oid 20 updating version 0 to 1895 2026-02-12T17:39:22.194 INFO:tasks.rados.rados.0.trial082.stdout:2529: oid 20 version 1895 is already newer than 1894 2026-02-12T17:39:22.194 INFO:tasks.rados.rados.0.trial082.stdout:2529: oid 20 version 1895 is already newer than 1893 2026-02-12T17:39:22.194 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 1895 (ObjNum 858 snap 270 seq_num 858) dirty exists 2026-02-12T17:39:22.194 INFO:tasks.rados.rados.0.trial082.stdout:2529: left oid 20 (ObjNum 858 snap 270 seq_num 858) 2026-02-12T17:39:23.080 INFO:tasks.rados.rados.0.trial082.stdout:2527: done (3 left) 2026-02-12T17:39:23.080 INFO:tasks.rados.rados.0.trial082.stdout:2528: done (2 left) 2026-02-12T17:39:23.080 INFO:tasks.rados.rados.0.trial082.stdout:2529: done (1 left) 2026-02-12T17:39:23.080 INFO:tasks.rados.rados.0.trial082.stdout:2530: done (0 left) 2026-02-12T17:39:23.080 INFO:tasks.rados.rados.0.trial082.stdout:2531: snap_remove snap 256 2026-02-12T17:39:24.080 INFO:tasks.rados.rados.0.trial082.stdout:2531: done (0 left) 2026-02-12T17:39:24.081 INFO:tasks.rados.rados.0.trial082.stdout:2532: snap_create 2026-02-12T17:39:25.081 INFO:tasks.rados.rados.0.trial082.stdout:2532: done (0 left) 2026-02-12T17:39:25.082 INFO:tasks.rados.rados.0.trial082.stdout:2533: write oid 42 current snap is 272 2026-02-12T17:39:25.082 INFO:tasks.rados.rados.0.trial082.stdout:2533: seq_num 859 ranges {437213=470427,1633444=728951} 2026-02-12T17:39:25.085 INFO:tasks.rados.rados.0.trial082.stdout:2533: writing trial08226312-42 from 437213 to 907640 tid 1 2026-02-12T17:39:25.091 INFO:tasks.rados.rados.0.trial082.stdout:2533: writing trial08226312-42 from 1633444 to 2362395 tid 2 2026-02-12T17:39:25.091 INFO:tasks.rados.rados.0.trial082.stdout:2534: snap_create 2026-02-12T17:39:25.091 INFO:tasks.rados.rados.0.trial082.stdout:2533: finishing write tid 1 to trial08226312-42 2026-02-12T17:39:25.094 INFO:tasks.rados.rados.0.trial082.stdout:2533: finishing write tid 2 to trial08226312-42 2026-02-12T17:39:25.094 INFO:tasks.rados.rados.0.trial082.stdout:2533: finishing write tid 3 to trial08226312-42 2026-02-12T17:39:25.094 INFO:tasks.rados.rados.0.trial082.stdout:2533: finishing write tid 4 to trial08226312-42 2026-02-12T17:39:25.094 INFO:tasks.rados.rados.0.trial082.stdout:2533: oid 42 updating version 0 to 1587 2026-02-12T17:39:25.094 INFO:tasks.rados.rados.0.trial082.stdout:2533: oid 42 version 1587 is already newer than 1586 2026-02-12T17:39:25.094 INFO:tasks.rados.rados.0.trial082.stdout:2533: oid 42 version 1587 is already newer than 1585 2026-02-12T17:39:25.094 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 1587 (ObjNum 859 snap 272 seq_num 859) dirty exists 2026-02-12T17:39:25.094 INFO:tasks.rados.rados.0.trial082.stdout:2533: left oid 42 (ObjNum 859 snap 272 seq_num 859) 2026-02-12T17:39:26.085 INFO:tasks.rados.rados.0.trial082.stdout:2533: done (1 left) 2026-02-12T17:39:26.086 INFO:tasks.rados.rados.0.trial082.stdout:2534: done (0 left) 2026-02-12T17:39:26.086 INFO:tasks.rados.rados.0.trial082.stdout:2535: read oid 2 snap 269 2026-02-12T17:39:26.086 INFO:tasks.rados.rados.0.trial082.stdout:2535: expect deleted 2026-02-12T17:39:26.086 INFO:tasks.rados.rados.0.trial082.stdout:2536: delete oid 14 current snap is 273 2026-02-12T17:39:26.089 INFO:tasks.rados.rados.0.trial082.stdout:2535: done (1 left) 2026-02-12T17:39:26.090 INFO:tasks.rados.rados.0.trial082.stdout:2536: done (0 left) 2026-02-12T17:39:26.090 INFO:tasks.rados.rados.0.trial082.stdout:2537: rollback oid 28 current snap is 273 2026-02-12T17:39:26.090 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 244 2026-02-12T17:39:26.090 INFO:tasks.rados.rados.0.trial082.stdout:2538: copy_from oid 12 from oid 17 current snap is 273 2026-02-12T17:39:26.090 INFO:tasks.rados.rados.0.trial082.stdout:2539: snap_remove snap 269 2026-02-12T17:39:27.087 INFO:tasks.rados.rados.0.trial082.stdout:2539: done (2 left) 2026-02-12T17:39:27.087 INFO:tasks.rados.rados.0.trial082.stdout:2540: read oid 23 snap -1 2026-02-12T17:39:27.087 INFO:tasks.rados.rados.0.trial082.stdout:2540: expect (ObjNum 857 snap 270 seq_num 857) 2026-02-12T17:39:27.087 INFO:tasks.rados.rados.0.trial082.stdout:2541: snap_create 2026-02-12T17:39:27.087 INFO:tasks.rados.rados.0.trial082.stdout:2537: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:39:27.087 INFO:tasks.rados.rados.0.trial082.stdout:2537: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:39:27.087 INFO:tasks.rados.rados.0.trial082.stdout:2537: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:39:27.087 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1590 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:39:27.087 INFO:tasks.rados.rados.0.trial082.stdout:2538: finishing copy_from racing read to trial08226312-12 2026-02-12T17:39:27.088 INFO:tasks.rados.rados.0.trial082.stdout:2538: finishing copy_from to trial08226312-12 2026-02-12T17:39:27.088 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1814 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:39:27.091 INFO:tasks.rados.rados.0.trial082.stdout:2540: expect (ObjNum 857 snap 270 seq_num 857) 2026-02-12T17:39:27.094 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 812806 2026-02-12T17:39:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2537: done (3 left) 2026-02-12T17:39:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2538: done (2 left) 2026-02-12T17:39:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2540: done (1 left) 2026-02-12T17:39:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2541: done (0 left) 2026-02-12T17:39:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2542: copy_from oid 22 from oid 49 current snap is 274 2026-02-12T17:39:28.081 INFO:tasks.rados.rados.0.trial082.stdout:2543: delete oid 19 current snap is 274 2026-02-12T17:39:28.084 INFO:tasks.rados.rados.0.trial082.stdout:2543: done (1 left) 2026-02-12T17:39:28.084 INFO:tasks.rados.rados.0.trial082.stdout:2544: delete oid 41 current snap is 274 2026-02-12T17:39:28.085 INFO:tasks.rados.rados.0.trial082.stdout:2542: finishing copy_from to trial08226312-22 2026-02-12T17:39:28.085 INFO:tasks.rados.rados.0.trial082.stdout:2542: got expected ENOENT (src dne) 2026-02-12T17:39:28.085 INFO:tasks.rados.rados.0.trial082.stdout:2542: finishing copy_from racing read to trial08226312-22 2026-02-12T17:39:28.086 INFO:tasks.rados.rados.0.trial082.stdout:2542: done (1 left) 2026-02-12T17:39:28.086 INFO:tasks.rados.rados.0.trial082.stdout:2544: done (0 left) 2026-02-12T17:39:28.086 INFO:tasks.rados.rados.0.trial082.stdout:2545: read oid 22 snap 262 2026-02-12T17:39:28.086 INFO:tasks.rados.rados.0.trial082.stdout:2545: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:39:28.086 INFO:tasks.rados.rados.0.trial082.stdout:2546: write (excl) oid 26 current snap is 274 2026-02-12T17:39:28.086 INFO:tasks.rados.rados.0.trial082.stdout:2546: seq_num 863 ranges {504441=487776,1467372=736289} 2026-02-12T17:39:28.089 INFO:tasks.rados.rados.0.trial082.stdout:2546: writing trial08226312-26 from 504441 to 992217 tid 1 2026-02-12T17:39:28.094 INFO:tasks.rados.rados.0.trial082.stdout:2546: writing trial08226312-26 from 1467372 to 2203661 tid 2 2026-02-12T17:39:28.094 INFO:tasks.rados.rados.0.trial082.stdout:2547: write (excl) oid 21 current snap is 274 2026-02-12T17:39:28.094 INFO:tasks.rados.rados.0.trial082.stdout:2547: seq_num 864 ranges {521248=563025,1809501=596300} 2026-02-12T17:39:28.098 INFO:tasks.rados.rados.0.trial082.stdout:2547: writing trial08226312-21 from 521248 to 1084273 tid 1 2026-02-12T17:39:28.103 INFO:tasks.rados.rados.0.trial082.stdout:2547: writing trial08226312-21 from 1809501 to 2405801 tid 2 2026-02-12T17:39:28.103 INFO:tasks.rados.rados.0.trial082.stdout:2548: rollback oid 34 current snap is 274 2026-02-12T17:39:28.103 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 266 2026-02-12T17:39:28.103 INFO:tasks.rados.rados.0.trial082.stdout:2545: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:39:28.111 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 832543 2026-02-12T17:39:28.202 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:28.256 INFO:tasks.rados.rados.0.trial082.stdout:2546: finishing write tid 1 to trial08226312-26 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2546: finishing write tid 2 to trial08226312-26 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2546: finishing write tid 3 to trial08226312-26 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2546: finishing write tid 4 to trial08226312-26 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2546: oid 26 updating version 0 to 1857 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2546: oid 26 version 1857 is already newer than 1855 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2546: oid 26 version 1857 is already newer than 1856 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1857 (ObjNum 863 snap 274 seq_num 863) dirty exists 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2546: left oid 26 (ObjNum 863 snap 274 seq_num 863) 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2547: finishing write tid 1 to trial08226312-21 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2545: done (3 left) 2026-02-12T17:39:28.257 INFO:tasks.rados.rados.0.trial082.stdout:2546: done (2 left) 2026-02-12T17:39:28.258 INFO:tasks.rados.rados.0.trial082.stdout:2549: snap_remove snap 260 2026-02-12T17:39:29.094 INFO:tasks.rados.rados.0.trial082.stdout:2549: done (2 left) 2026-02-12T17:39:29.094 INFO:tasks.rados.rados.0.trial082.stdout:2550: write (excl) oid 43 current snap is 274 2026-02-12T17:39:29.094 INFO:tasks.rados.rados.0.trial082.stdout:2550: seq_num 865 ranges {538055=638274,1867983=670072} 2026-02-12T17:39:29.098 INFO:tasks.rados.rados.0.trial082.stdout:2550: writing trial08226312-43 from 538055 to 1176329 tid 1 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:2550: writing trial08226312-43 from 1867983 to 2538055 tid 2 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:2551: write (excl) oid 13 current snap is 274 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:2547: finishing write tid 2 to trial08226312-21 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:2547: finishing write tid 3 to trial08226312-21 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:2547: finishing write tid 4 to trial08226312-21 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:2547: oid 21 updating version 0 to 1556 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:2547: oid 21 updating version 1556 to 1557 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:2547: oid 21 updating version 1557 to 1558 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1558 (ObjNum 864 snap 274 seq_num 864) dirty exists 2026-02-12T17:39:29.104 INFO:tasks.rados.rados.0.trial082.stdout:2547: left oid 21 (ObjNum 864 snap 274 seq_num 864) 2026-02-12T17:39:29.105 INFO:tasks.rados.rados.0.trial082.stdout:2551: seq_num 866 ranges {554862=713523,1926465=599969} 2026-02-12T17:39:29.108 INFO:tasks.rados.rados.0.trial082.stdout:2551: writing trial08226312-13 from 554862 to 1268385 tid 1 2026-02-12T17:39:29.113 INFO:tasks.rados.rados.0.trial082.stdout:2551: writing trial08226312-13 from 1926465 to 2526434 tid 2 2026-02-12T17:39:29.113 INFO:tasks.rados.rados.0.trial082.stdout:2547: done (3 left) 2026-02-12T17:39:29.113 INFO:tasks.rados.rados.0.trial082.stdout:2552: copy_from oid 11 from oid 28 current snap is 274 2026-02-12T17:39:29.113 INFO:tasks.rados.rados.0.trial082.stdout:2548: finishing rollback tid 0 to trial08226312-34 2026-02-12T17:39:29.113 INFO:tasks.rados.rados.0.trial082.stdout:2548: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:2548: finishing rollback tid 2 to trial08226312-34 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1552 (ObjNum 842 snap 265 seq_num 842) dirty exists 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:2550: finishing write tid 1 to trial08226312-43 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:2550: finishing write tid 2 to trial08226312-43 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:2550: finishing write tid 3 to trial08226312-43 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:2550: finishing write tid 4 to trial08226312-43 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:2550: oid 43 updating version 0 to 1561 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:2550: oid 43 version 1561 is already newer than 1560 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:2550: oid 43 version 1561 is already newer than 1559 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 1561 (ObjNum 865 snap 274 seq_num 865) dirty exists 2026-02-12T17:39:29.114 INFO:tasks.rados.rados.0.trial082.stdout:2550: left oid 43 (ObjNum 865 snap 274 seq_num 865) 2026-02-12T17:39:29.115 INFO:tasks.rados.rados.0.trial082.stdout:2551: finishing write tid 1 to trial08226312-13 2026-02-12T17:39:29.115 INFO:tasks.rados.rados.0.trial082.stdout:2548: done (3 left) 2026-02-12T17:39:29.115 INFO:tasks.rados.rados.0.trial082.stdout:2550: done (2 left) 2026-02-12T17:39:29.115 INFO:tasks.rados.rados.0.trial082.stdout:2553: snap_create 2026-02-12T17:39:29.116 INFO:tasks.rados.rados.0.trial082.stdout:2551: finishing write tid 2 to trial08226312-13 2026-02-12T17:39:29.116 INFO:tasks.rados.rados.0.trial082.stdout:2551: finishing write tid 3 to trial08226312-13 2026-02-12T17:39:29.116 INFO:tasks.rados.rados.0.trial082.stdout:2551: finishing write tid 4 to trial08226312-13 2026-02-12T17:39:29.116 INFO:tasks.rados.rados.0.trial082.stdout:2551: oid 13 updating version 0 to 568 2026-02-12T17:39:29.116 INFO:tasks.rados.rados.0.trial082.stdout:2551: oid 13 updating version 568 to 569 2026-02-12T17:39:29.116 INFO:tasks.rados.rados.0.trial082.stdout:2551: oid 13 updating version 569 to 570 2026-02-12T17:39:29.116 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 570 (ObjNum 866 snap 274 seq_num 866) dirty exists 2026-02-12T17:39:29.116 INFO:tasks.rados.rados.0.trial082.stdout:2551: left oid 13 (ObjNum 866 snap 274 seq_num 866) 2026-02-12T17:39:29.120 INFO:tasks.rados.rados.0.trial082.stdout:2552: finishing copy_from racing read to trial08226312-11 2026-02-12T17:39:29.122 INFO:tasks.rados.rados.0.trial082.stdout:2552: finishing copy_from to trial08226312-11 2026-02-12T17:39:29.122 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1590 (ObjNum 692 snap 208 seq_num 692) dirty exists 2026-02-12T17:39:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2551: done (2 left) 2026-02-12T17:39:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2552: done (1 left) 2026-02-12T17:39:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2553: done (0 left) 2026-02-12T17:39:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2554: copy_from oid 22 from oid 46 current snap is 275 2026-02-12T17:39:30.098 INFO:tasks.rados.rados.0.trial082.stdout:2555: rollback oid 47 current snap is 275 2026-02-12T17:39:30.098 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 47 to 262 2026-02-12T17:39:30.098 INFO:tasks.rados.rados.0.trial082.stdout:2556: copy_from oid 17 from oid 43 current snap is 275 2026-02-12T17:39:30.098 INFO:tasks.rados.rados.0.trial082.stdout:2557: write (excl) oid 21 current snap is 275 2026-02-12T17:39:30.098 INFO:tasks.rados.rados.0.trial082.stdout:2557: seq_num 867 ranges {571669=505125,1701300=743627} 2026-02-12T17:39:30.101 INFO:tasks.rados.rados.0.trial082.stdout:2557: writing trial08226312-21 from 571669 to 1076794 tid 1 2026-02-12T17:39:30.106 INFO:tasks.rados.rados.0.trial082.stdout:2557: writing trial08226312-21 from 1701300 to 2444927 tid 2 2026-02-12T17:39:30.107 INFO:tasks.rados.rados.0.trial082.stdout:2558: rollback oid 50 current snap is 275 2026-02-12T17:39:30.107 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 252 2026-02-12T17:39:30.107 INFO:tasks.rados.rados.0.trial082.stdout:2554: finishing copy_from to trial08226312-22 2026-02-12T17:39:30.107 INFO:tasks.rados.rados.0.trial082.stdout:2554: got expected ENOENT (src dne) 2026-02-12T17:39:30.107 INFO:tasks.rados.rados.0.trial082.stdout:2554: finishing copy_from racing read to trial08226312-22 2026-02-12T17:39:30.107 INFO:tasks.rados.rados.0.trial082.stdout:2555: finishing rollback tid 0 to trial08226312-47 2026-02-12T17:39:30.107 INFO:tasks.rados.rados.0.trial082.stdout:2555: finishing rollback tid 1 to trial08226312-47 2026-02-12T17:39:30.107 INFO:tasks.rados.rados.0.trial082.stdout:2555: finishing rollback tid 2 to trial08226312-47 2026-02-12T17:39:30.107 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1919 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:39:30.108 INFO:tasks.rados.rados.0.trial082.stdout:2557: finishing write tid 1 to trial08226312-21 2026-02-12T17:39:30.108 INFO:tasks.rados.rados.0.trial082.stdout:2554: done (4 left) 2026-02-12T17:39:30.108 INFO:tasks.rados.rados.0.trial082.stdout:2555: done (3 left) 2026-02-12T17:39:30.108 INFO:tasks.rados.rados.0.trial082.stdout:2559: delete oid 7 current snap is 275 2026-02-12T17:39:30.108 INFO:tasks.rados.rados.0.trial082.stdout:2556: finishing copy_from racing read to trial08226312-17 2026-02-12T17:39:30.109 INFO:tasks.rados.rados.0.trial082.stdout:2556: finishing copy_from to trial08226312-17 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 1561 (ObjNum 865 snap 274 seq_num 865) dirty exists 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:2556: done (3 left) 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:2559: done (2 left) 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:2560: rollback oid 24 current snap is 275 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 270 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:2561: read oid 1 snap -1 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:2561: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:2562: delete oid 20 current snap is 275 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:2557: finishing write tid 2 to trial08226312-21 2026-02-12T17:39:30.110 INFO:tasks.rados.rados.0.trial082.stdout:2557: finishing write tid 3 to trial08226312-21 2026-02-12T17:39:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2557: finishing write tid 4 to trial08226312-21 2026-02-12T17:39:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2557: oid 21 updating version 0 to 1564 2026-02-12T17:39:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2557: oid 21 version 1564 is already newer than 1563 2026-02-12T17:39:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2557: oid 21 version 1564 is already newer than 1562 2026-02-12T17:39:30.111 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1564 (ObjNum 867 snap 275 seq_num 867) dirty exists 2026-02-12T17:39:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2557: left oid 21 (ObjNum 867 snap 275 seq_num 867) 2026-02-12T17:39:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2558: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:39:30.111 INFO:tasks.rados.rados.0.trial082.stdout:2558: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:39:30.111 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 1582 (ObjNum 257 snap 0 seq_num 27681504) dirty dne 2026-02-12T17:39:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2560: finishing rollback tid 0 to trial08226312-24 2026-02-12T17:39:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2560: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:39:30.112 INFO:tasks.rados.rados.0.trial082.stdout:2560: finishing rollback tid 2 to trial08226312-24 2026-02-12T17:39:30.112 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 1925 (ObjNum 645 snap 197 seq_num 645) dirty exists 2026-02-12T17:39:30.113 INFO:tasks.rados.rados.0.trial082.stdout:2557: done (4 left) 2026-02-12T17:39:30.113 INFO:tasks.rados.rados.0.trial082.stdout:2558: done (3 left) 2026-02-12T17:39:30.113 INFO:tasks.rados.rados.0.trial082.stdout:2560: done (2 left) 2026-02-12T17:39:30.113 INFO:tasks.rados.rados.0.trial082.stdout:2562: done (1 left) 2026-02-12T17:39:30.113 INFO:tasks.rados.rados.0.trial082.stdout:2563: write (excl) oid 8 current snap is 275 2026-02-12T17:39:30.113 INFO:tasks.rados.rados.0.trial082.stdout:2563: seq_num 870 ranges {622090=730872,1760393=607307} 2026-02-12T17:39:30.116 INFO:tasks.rados.rados.0.trial082.stdout:2563: writing trial08226312-8 from 622090 to 1352962 tid 1 2026-02-12T17:39:30.120 INFO:tasks.rados.rados.0.trial082.stdout:2563: writing trial08226312-8 from 1760393 to 2367700 tid 2 2026-02-12T17:39:30.120 INFO:tasks.rados.rados.0.trial082.stdout:2564: delete oid 48 current snap is 275 2026-02-12T17:39:30.120 INFO:tasks.rados.rados.0.trial082.stdout:2561: expect (ObjNum 703 snap 212 seq_num 703) 2026-02-12T17:39:30.142 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1825520 2026-02-12T17:39:30.224 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3682509 2026-02-12T17:39:30.290 INFO:tasks.rados.rados.0.trial082.stdout:2563: finishing write tid 1 to trial08226312-8 2026-02-12T17:39:30.290 INFO:tasks.rados.rados.0.trial082.stdout:2563: finishing write tid 2 to trial08226312-8 2026-02-12T17:39:30.290 INFO:tasks.rados.rados.0.trial082.stdout:2563: finishing write tid 3 to trial08226312-8 2026-02-12T17:39:30.290 INFO:tasks.rados.rados.0.trial082.stdout:2563: finishing write tid 4 to trial08226312-8 2026-02-12T17:39:30.290 INFO:tasks.rados.rados.0.trial082.stdout:2563: oid 8 updating version 0 to 1929 2026-02-12T17:39:30.290 INFO:tasks.rados.rados.0.trial082.stdout:2563: oid 8 updating version 1929 to 1931 2026-02-12T17:39:30.290 INFO:tasks.rados.rados.0.trial082.stdout:2563: oid 8 version 1931 is already newer than 1930 2026-02-12T17:39:30.290 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1931 (ObjNum 870 snap 275 seq_num 870) dirty exists 2026-02-12T17:39:30.291 INFO:tasks.rados.rados.0.trial082.stdout:2563: left oid 8 (ObjNum 870 snap 275 seq_num 870) 2026-02-12T17:39:30.291 INFO:tasks.rados.rados.0.trial082.stdout:2561: done (2 left) 2026-02-12T17:39:30.291 INFO:tasks.rados.rados.0.trial082.stdout:2563: done (1 left) 2026-02-12T17:39:30.291 INFO:tasks.rados.rados.0.trial082.stdout:2564: done (0 left) 2026-02-12T17:39:30.291 INFO:tasks.rados.rados.0.trial082.stdout:2565: write oid 5 current snap is 275 2026-02-12T17:39:30.291 INFO:tasks.rados.rados.0.trial082.stdout:2565: seq_num 872 ranges {655704=481370,1761004=494623} 2026-02-12T17:39:30.294 INFO:tasks.rados.rados.0.trial082.stdout:2565: writing trial08226312-5 from 655704 to 1137074 tid 1 2026-02-12T17:39:30.298 INFO:tasks.rados.rados.0.trial082.stdout:2565: writing trial08226312-5 from 1761004 to 2255627 tid 2 2026-02-12T17:39:30.299 INFO:tasks.rados.rados.0.trial082.stdout:2566: write oid 27 current snap is 275 2026-02-12T17:39:30.299 INFO:tasks.rados.rados.0.trial082.stdout:2565: finishing write tid 1 to trial08226312-5 2026-02-12T17:39:30.299 INFO:tasks.rados.rados.0.trial082.stdout:2566: seq_num 873 ranges {672511=556619,1819486=754634} 2026-02-12T17:39:30.303 INFO:tasks.rados.rados.0.trial082.stdout:2566: writing trial08226312-27 from 672511 to 1229130 tid 1 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2566: writing trial08226312-27 from 1819486 to 2574120 tid 2 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2567: read oid 36 snap -1 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2567: expect (ObjNum 770 snap 234 seq_num 770) 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2568: copy_from oid 13 from oid 4 current snap is 275 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2565: finishing write tid 2 to trial08226312-5 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2565: finishing write tid 3 to trial08226312-5 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2565: finishing write tid 4 to trial08226312-5 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2565: oid 5 updating version 0 to 1138 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2565: oid 5 version 1138 is already newer than 1137 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:2565: oid 5 updating version 1138 to 1139 2026-02-12T17:39:30.309 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 1139 (ObjNum 872 snap 275 seq_num 872) dirty exists 2026-02-12T17:39:30.310 INFO:tasks.rados.rados.0.trial082.stdout:2565: left oid 5 (ObjNum 872 snap 275 seq_num 872) 2026-02-12T17:39:30.310 INFO:tasks.rados.rados.0.trial082.stdout:2566: finishing write tid 1 to trial08226312-27 2026-02-12T17:39:30.310 INFO:tasks.rados.rados.0.trial082.stdout:2565: done (3 left) 2026-02-12T17:39:30.310 INFO:tasks.rados.rados.0.trial082.stdout:2569: copy_from oid 37 from oid 34 current snap is 275 2026-02-12T17:39:30.310 INFO:tasks.rados.rados.0.trial082.stdout:2570: snap_remove snap 267 2026-02-12T17:39:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2570: done (4 left) 2026-02-12T17:39:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2571: read oid 20 snap -1 2026-02-12T17:39:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2571: expect deleted 2026-02-12T17:39:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2572: snap_create 2026-02-12T17:39:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2566: finishing write tid 2 to trial08226312-27 2026-02-12T17:39:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2566: finishing write tid 3 to trial08226312-27 2026-02-12T17:39:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2566: finishing write tid 4 to trial08226312-27 2026-02-12T17:39:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2566: oid 27 updating version 0 to 1118 2026-02-12T17:39:31.099 INFO:tasks.rados.rados.0.trial082.stdout:2566: oid 27 version 1118 is already newer than 1117 2026-02-12T17:39:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2566: oid 27 version 1118 is already newer than 1116 2026-02-12T17:39:31.100 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1118 (ObjNum 873 snap 275 seq_num 873) dirty exists 2026-02-12T17:39:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2566: left oid 27 (ObjNum 873 snap 275 seq_num 873) 2026-02-12T17:39:31.100 INFO:tasks.rados.rados.0.trial082.stdout:2567: expect (ObjNum 770 snap 234 seq_num 770) 2026-02-12T17:39:31.104 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2138601 2026-02-12T17:39:31.116 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 781247 2026-02-12T17:39:31.144 INFO:tasks.rados.rados.0.trial082.stdout:2569: finishing copy_from racing read to trial08226312-37 2026-02-12T17:39:31.144 INFO:tasks.rados.rados.0.trial082.stdout:2569: finishing copy_from to trial08226312-37 2026-02-12T17:39:31.144 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1552 (ObjNum 842 snap 265 seq_num 842) dirty exists 2026-02-12T17:39:31.144 INFO:tasks.rados.rados.0.trial082.stdout:2568: finishing copy_from racing read to trial08226312-13 2026-02-12T17:39:31.144 INFO:tasks.rados.rados.0.trial082.stdout:2568: finishing copy_from to trial08226312-13 2026-02-12T17:39:31.144 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 1878 (ObjNum 732 snap 217 seq_num 732) dirty exists 2026-02-12T17:39:32.100 INFO:tasks.rados.rados.0.trial082.stdout:2566: done (5 left) 2026-02-12T17:39:32.100 INFO:tasks.rados.rados.0.trial082.stdout:2567: done (4 left) 2026-02-12T17:39:32.100 INFO:tasks.rados.rados.0.trial082.stdout:2568: done (3 left) 2026-02-12T17:39:32.100 INFO:tasks.rados.rados.0.trial082.stdout:2569: done (2 left) 2026-02-12T17:39:32.100 INFO:tasks.rados.rados.0.trial082.stdout:2571: done (1 left) 2026-02-12T17:39:32.100 INFO:tasks.rados.rados.0.trial082.stdout:2572: done (0 left) 2026-02-12T17:39:32.100 INFO:tasks.rados.rados.0.trial082.stdout:2573: snap_create 2026-02-12T17:39:33.081 INFO:tasks.rados.rados.0.trial082.stdout:2573: done (0 left) 2026-02-12T17:39:33.081 INFO:tasks.rados.rados.0.trial082.stdout:2574: delete oid 50 current snap is 277 2026-02-12T17:39:33.084 INFO:tasks.rados.rados.0.trial082.stdout:2574: done (0 left) 2026-02-12T17:39:33.084 INFO:tasks.rados.rados.0.trial082.stdout:2575: write oid 35 current snap is 277 2026-02-12T17:39:33.084 INFO:tasks.rados.rados.0.trial082.stdout:2575: seq_num 875 ranges {706125=423470,1652803=758303} 2026-02-12T17:39:33.088 INFO:tasks.rados.rados.0.trial082.stdout:2575: writing trial08226312-35 from 706125 to 1129595 tid 1 2026-02-12T17:39:33.093 INFO:tasks.rados.rados.0.trial082.stdout:2575: writing trial08226312-35 from 1652803 to 2411106 tid 2 2026-02-12T17:39:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2576: read oid 9 snap -1 2026-02-12T17:39:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2576: expect deleted 2026-02-12T17:39:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2577: rollback oid 22 current snap is 277 2026-02-12T17:39:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2575: finishing write tid 1 to trial08226312-35 2026-02-12T17:39:33.094 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 265 2026-02-12T17:39:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2578: copy_from oid 8 from oid 30 current snap is 277 2026-02-12T17:39:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2579: write oid 7 current snap is 277 2026-02-12T17:39:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2579: seq_num 876 ranges {722932=498719,1994932=501961} 2026-02-12T17:39:33.097 INFO:tasks.rados.rados.0.trial082.stdout:2579: writing trial08226312-7 from 722932 to 1221651 tid 1 2026-02-12T17:39:33.102 INFO:tasks.rados.rados.0.trial082.stdout:2579: writing trial08226312-7 from 1994932 to 2496893 tid 2 2026-02-12T17:39:33.102 INFO:tasks.rados.rados.0.trial082.stdout:2580: snap_remove snap 272 2026-02-12T17:39:34.105 INFO:tasks.rados.rados.0.trial082.stdout:2580: done (5 left) 2026-02-12T17:39:34.106 INFO:tasks.rados.rados.0.trial082.stdout:2581: copy_from oid 37 from oid 47 current snap is 277 2026-02-12T17:39:34.106 INFO:tasks.rados.rados.0.trial082.stdout:2575: finishing write tid 2 to trial08226312-35 2026-02-12T17:39:34.106 INFO:tasks.rados.rados.0.trial082.stdout:2575: finishing write tid 3 to trial08226312-35 2026-02-12T17:39:34.106 INFO:tasks.rados.rados.0.trial082.stdout:2575: finishing write tid 4 to trial08226312-35 2026-02-12T17:39:34.106 INFO:tasks.rados.rados.0.trial082.stdout:2575: oid 35 updating version 0 to 1859 2026-02-12T17:39:34.106 INFO:tasks.rados.rados.0.trial082.stdout:2575: oid 35 updating version 1859 to 1860 2026-02-12T17:39:34.106 INFO:tasks.rados.rados.0.trial082.stdout:2575: oid 35 version 1860 is already newer than 1858 2026-02-12T17:39:34.106 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1860 (ObjNum 875 snap 277 seq_num 875) dirty exists 2026-02-12T17:39:34.106 INFO:tasks.rados.rados.0.trial082.stdout:2575: left oid 35 (ObjNum 875 snap 277 seq_num 875) 2026-02-12T17:39:34.107 INFO:tasks.rados.rados.0.trial082.stdout:2577: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:39:34.107 INFO:tasks.rados.rados.0.trial082.stdout:2575: done (5 left) 2026-02-12T17:39:34.107 INFO:tasks.rados.rados.0.trial082.stdout:2576: done (4 left) 2026-02-12T17:39:34.107 INFO:tasks.rados.rados.0.trial082.stdout:2582: read oid 11 snap -1 2026-02-12T17:39:34.107 INFO:tasks.rados.rados.0.trial082.stdout:2582: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:39:34.107 INFO:tasks.rados.rados.0.trial082.stdout:2583: read oid 17 snap -1 2026-02-12T17:39:34.107 INFO:tasks.rados.rados.0.trial082.stdout:2583: expect (ObjNum 865 snap 274 seq_num 865) 2026-02-12T17:39:34.107 INFO:tasks.rados.rados.0.trial082.stdout:2584: write oid 48 current snap is 277 2026-02-12T17:39:34.107 INFO:tasks.rados.rados.0.trial082.stdout:2584: seq_num 877 ranges {739739=573968,2053414=686325} 2026-02-12T17:39:34.110 INFO:tasks.rados.rados.0.trial082.stdout:2584: writing trial08226312-48 from 739739 to 1313707 tid 1 2026-02-12T17:39:34.116 INFO:tasks.rados.rados.0.trial082.stdout:2584: writing trial08226312-48 from 2053414 to 2739739 tid 2 2026-02-12T17:39:34.116 INFO:tasks.rados.rados.0.trial082.stdout:2585: read oid 29 snap -1 2026-02-12T17:39:34.116 INFO:tasks.rados.rados.0.trial082.stdout:2585: expect (ObjNum 831 snap 257 seq_num 831) 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:2586: snap_create 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:2577: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:2577: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 1567 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:2578: finishing copy_from racing read to trial08226312-8 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:2578: finishing copy_from to trial08226312-8 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1552 (ObjNum 836 snap 260 seq_num 836) dirty exists 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:2579: finishing write tid 1 to trial08226312-7 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:2579: finishing write tid 2 to trial08226312-7 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:2579: finishing write tid 3 to trial08226312-7 2026-02-12T17:39:34.117 INFO:tasks.rados.rados.0.trial082.stdout:2579: finishing write tid 4 to trial08226312-7 2026-02-12T17:39:34.118 INFO:tasks.rados.rados.0.trial082.stdout:2579: oid 7 updating version 0 to 1593 2026-02-12T17:39:34.118 INFO:tasks.rados.rados.0.trial082.stdout:2579: oid 7 version 1593 is already newer than 1591 2026-02-12T17:39:34.118 INFO:tasks.rados.rados.0.trial082.stdout:2579: oid 7 version 1593 is already newer than 1592 2026-02-12T17:39:34.118 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 1593 (ObjNum 876 snap 277 seq_num 876) dirty exists 2026-02-12T17:39:34.118 INFO:tasks.rados.rados.0.trial082.stdout:2579: left oid 7 (ObjNum 876 snap 277 seq_num 876) 2026-02-12T17:39:34.118 INFO:tasks.rados.rados.0.trial082.stdout:2582: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:39:34.175 INFO:tasks.rados.rados.0.trial082.stdout:2583: expect (ObjNum 865 snap 274 seq_num 865) 2026-02-12T17:39:34.175 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:34.209 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:34.227 INFO:tasks.rados.rados.0.trial082.stdout:2584: finishing write tid 1 to trial08226312-48 2026-02-12T17:39:34.227 INFO:tasks.rados.rados.0.trial082.stdout:2584: finishing write tid 2 to trial08226312-48 2026-02-12T17:39:34.227 INFO:tasks.rados.rados.0.trial082.stdout:2584: finishing write tid 3 to trial08226312-48 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:2584: finishing write tid 4 to trial08226312-48 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:2584: oid 48 updating version 0 to 835 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:2584: oid 48 version 835 is already newer than 834 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:2584: oid 48 version 835 is already newer than 833 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 835 (ObjNum 877 snap 277 seq_num 877) dirty exists 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:2584: left oid 48 (ObjNum 877 snap 277 seq_num 877) 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:2581: finishing copy_from racing read to trial08226312-37 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:2581: finishing copy_from to trial08226312-37 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1919 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:39:34.228 INFO:tasks.rados.rados.0.trial082.stdout:2585: expect (ObjNum 831 snap 257 seq_num 831) 2026-02-12T17:39:34.272 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:35.107 INFO:tasks.rados.rados.0.trial082.stdout:2577: done (8 left) 2026-02-12T17:39:35.107 INFO:tasks.rados.rados.0.trial082.stdout:2578: done (7 left) 2026-02-12T17:39:35.107 INFO:tasks.rados.rados.0.trial082.stdout:2579: done (6 left) 2026-02-12T17:39:35.107 INFO:tasks.rados.rados.0.trial082.stdout:2581: done (5 left) 2026-02-12T17:39:35.107 INFO:tasks.rados.rados.0.trial082.stdout:2582: done (4 left) 2026-02-12T17:39:35.108 INFO:tasks.rados.rados.0.trial082.stdout:2583: done (3 left) 2026-02-12T17:39:35.108 INFO:tasks.rados.rados.0.trial082.stdout:2584: done (2 left) 2026-02-12T17:39:35.108 INFO:tasks.rados.rados.0.trial082.stdout:2585: done (1 left) 2026-02-12T17:39:35.108 INFO:tasks.rados.rados.0.trial082.stdout:2586: done (0 left) 2026-02-12T17:39:35.108 INFO:tasks.rados.rados.0.trial082.stdout:2587: rollback oid 25 current snap is 278 2026-02-12T17:39:35.108 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 25 to 277 2026-02-12T17:39:35.108 INFO:tasks.rados.rados.0.trial082.stdout:2588: snap_create 2026-02-12T17:39:35.108 INFO:tasks.rados.rados.0.trial082.stdout:2587: finishing rollback tid 1 to trial08226312-25 2026-02-12T17:39:35.109 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 567 (ObjNum 145 snap 0 seq_num 1728032128) dirty dne 2026-02-12T17:39:36.106 INFO:tasks.rados.rados.0.trial082.stdout:2587: done (1 left) 2026-02-12T17:39:36.107 INFO:tasks.rados.rados.0.trial082.stdout:2588: done (0 left) 2026-02-12T17:39:36.107 INFO:tasks.rados.rados.0.trial082.stdout:2589: write (excl) oid 41 current snap is 279 2026-02-12T17:39:36.107 INFO:tasks.rados.rados.0.trial082.stdout:2589: seq_num 878 ranges {756546=649217,2111896=505630} 2026-02-12T17:39:36.112 INFO:tasks.rados.rados.0.trial082.stdout:2589: writing trial08226312-41 from 756546 to 1405763 tid 1 2026-02-12T17:39:36.117 INFO:tasks.rados.rados.0.trial082.stdout:2589: writing trial08226312-41 from 2111896 to 2617526 tid 2 2026-02-12T17:39:36.117 INFO:tasks.rados.rados.0.trial082.stdout:2590: read oid 20 snap -1 2026-02-12T17:39:36.117 INFO:tasks.rados.rados.0.trial082.stdout:2590: expect deleted 2026-02-12T17:39:36.117 INFO:tasks.rados.rados.0.trial082.stdout:2591: snap_remove snap 278 2026-02-12T17:39:37.113 INFO:tasks.rados.rados.0.trial082.stdout:2591: done (2 left) 2026-02-12T17:39:37.113 INFO:tasks.rados.rados.0.trial082.stdout:2592: read oid 23 snap -1 2026-02-12T17:39:37.113 INFO:tasks.rados.rados.0.trial082.stdout:2592: expect (ObjNum 857 snap 270 seq_num 857) 2026-02-12T17:39:37.114 INFO:tasks.rados.rados.0.trial082.stdout:2593: snap_remove snap 277 2026-02-12T17:39:38.082 INFO:tasks.rados.rados.0.trial082.stdout:2593: done (3 left) 2026-02-12T17:39:38.082 INFO:tasks.rados.rados.0.trial082.stdout:2594: snap_create 2026-02-12T17:39:38.082 INFO:tasks.rados.rados.0.trial082.stdout:2589: finishing write tid 1 to trial08226312-41 2026-02-12T17:39:38.082 INFO:tasks.rados.rados.0.trial082.stdout:2589: finishing write tid 2 to trial08226312-41 2026-02-12T17:39:38.082 INFO:tasks.rados.rados.0.trial082.stdout:2589: finishing write tid 3 to trial08226312-41 2026-02-12T17:39:38.082 INFO:tasks.rados.rados.0.trial082.stdout:2589: finishing write tid 4 to trial08226312-41 2026-02-12T17:39:38.082 INFO:tasks.rados.rados.0.trial082.stdout:2589: oid 41 updating version 0 to 1922 2026-02-12T17:39:38.082 INFO:tasks.rados.rados.0.trial082.stdout:2589: oid 41 version 1922 is already newer than 1921 2026-02-12T17:39:38.083 INFO:tasks.rados.rados.0.trial082.stdout:2589: oid 41 version 1922 is already newer than 1920 2026-02-12T17:39:38.083 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1922 (ObjNum 878 snap 279 seq_num 878) dirty exists 2026-02-12T17:39:38.083 INFO:tasks.rados.rados.0.trial082.stdout:2589: left oid 41 (ObjNum 878 snap 279 seq_num 878) 2026-02-12T17:39:38.083 INFO:tasks.rados.rados.0.trial082.stdout:2592: expect (ObjNum 857 snap 270 seq_num 857) 2026-02-12T17:39:39.083 INFO:tasks.rados.rados.0.trial082.stdout:2589: done (3 left) 2026-02-12T17:39:39.083 INFO:tasks.rados.rados.0.trial082.stdout:2590: done (2 left) 2026-02-12T17:39:39.083 INFO:tasks.rados.rados.0.trial082.stdout:2592: done (1 left) 2026-02-12T17:39:39.083 INFO:tasks.rados.rados.0.trial082.stdout:2594: done (0 left) 2026-02-12T17:39:39.083 INFO:tasks.rados.rados.0.trial082.stdout:2595: snap_remove snap 244 2026-02-12T17:39:40.083 INFO:tasks.rados.rados.0.trial082.stdout:2595: done (0 left) 2026-02-12T17:39:40.083 INFO:tasks.rados.rados.0.trial082.stdout:2596: copy_from oid 20 from oid 47 current snap is 280 2026-02-12T17:39:40.084 INFO:tasks.rados.rados.0.trial082.stdout:2597: snap_remove snap 273 2026-02-12T17:39:41.084 INFO:tasks.rados.rados.0.trial082.stdout:2597: done (1 left) 2026-02-12T17:39:41.084 INFO:tasks.rados.rados.0.trial082.stdout:2598: write (excl) oid 2 current snap is 280 2026-02-12T17:39:41.084 INFO:tasks.rados.rados.0.trial082.stdout:2598: seq_num 879 ranges {773353=724466,2170378=602975} 2026-02-12T17:39:41.089 INFO:tasks.rados.rados.0.trial082.stdout:2598: writing trial08226312-2 from 773353 to 1497819 tid 1 2026-02-12T17:39:41.095 INFO:tasks.rados.rados.0.trial082.stdout:2598: writing trial08226312-2 from 2170378 to 2773353 tid 2 2026-02-12T17:39:41.095 INFO:tasks.rados.rados.0.trial082.stdout:2599: delete oid 15 current snap is 280 2026-02-12T17:39:41.095 INFO:tasks.rados.rados.0.trial082.stdout:2596: finishing copy_from racing read to trial08226312-20 2026-02-12T17:39:41.095 INFO:tasks.rados.rados.0.trial082.stdout:2596: finishing copy_from to trial08226312-20 2026-02-12T17:39:41.095 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 1919 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:39:41.095 INFO:tasks.rados.rados.0.trial082.stdout:2598: finishing write tid 1 to trial08226312-2 2026-02-12T17:39:41.097 INFO:tasks.rados.rados.0.trial082.stdout:2598: finishing write tid 2 to trial08226312-2 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:2598: finishing write tid 3 to trial08226312-2 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:2596: done (2 left) 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:2599: done (1 left) 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:2600: rollback oid 8 current snap is 280 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 262 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:2601: delete oid 37 current snap is 280 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:2598: finishing write tid 4 to trial08226312-2 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:2598: oid 2 updating version 0 to 950 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:2598: oid 2 version 950 is already newer than 949 2026-02-12T17:39:41.098 INFO:tasks.rados.rados.0.trial082.stdout:2598: oid 2 updating version 950 to 951 2026-02-12T17:39:41.099 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 951 (ObjNum 879 snap 280 seq_num 879) dirty exists 2026-02-12T17:39:41.099 INFO:tasks.rados.rados.0.trial082.stdout:2598: left oid 2 (ObjNum 879 snap 280 seq_num 879) 2026-02-12T17:39:41.099 INFO:tasks.rados.rados.0.trial082.stdout:2598: done (2 left) 2026-02-12T17:39:41.099 INFO:tasks.rados.rados.0.trial082.stdout:2601: done (1 left) 2026-02-12T17:39:41.099 INFO:tasks.rados.rados.0.trial082.stdout:2602: read oid 30 snap -1 2026-02-12T17:39:41.099 INFO:tasks.rados.rados.0.trial082.stdout:2602: expect (ObjNum 836 snap 260 seq_num 836) 2026-02-12T17:39:41.099 INFO:tasks.rados.rados.0.trial082.stdout:2603: read oid 43 snap -1 2026-02-12T17:39:41.099 INFO:tasks.rados.rados.0.trial082.stdout:2603: expect (ObjNum 865 snap 274 seq_num 865) 2026-02-12T17:39:41.099 INFO:tasks.rados.rados.0.trial082.stdout:2604: snap_create 2026-02-12T17:39:41.100 INFO:tasks.rados.rados.0.trial082.stdout:2600: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:39:41.100 INFO:tasks.rados.rados.0.trial082.stdout:2600: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:39:41.100 INFO:tasks.rados.rados.0.trial082.stdout:2602: expect (ObjNum 836 snap 260 seq_num 836) 2026-02-12T17:39:41.102 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 999422 2026-02-12T17:39:41.148 INFO:tasks.rados.rados.0.trial082.stdout:2600: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:39:41.148 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1986 (ObjNum 833 snap 259 seq_num 833) dirty exists 2026-02-12T17:39:41.148 INFO:tasks.rados.rados.0.trial082.stdout:2603: expect (ObjNum 865 snap 274 seq_num 865) 2026-02-12T17:39:41.159 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:42.088 INFO:tasks.rados.rados.0.trial082.stdout:2600: done (3 left) 2026-02-12T17:39:42.088 INFO:tasks.rados.rados.0.trial082.stdout:2602: done (2 left) 2026-02-12T17:39:42.088 INFO:tasks.rados.rados.0.trial082.stdout:2603: done (1 left) 2026-02-12T17:39:42.088 INFO:tasks.rados.rados.0.trial082.stdout:2604: done (0 left) 2026-02-12T17:39:42.089 INFO:tasks.rados.rados.0.trial082.stdout:2605: snap_remove snap 266 2026-02-12T17:39:43.083 INFO:tasks.rados.rados.0.trial082.stdout:2605: done (0 left) 2026-02-12T17:39:43.083 INFO:tasks.rados.rados.0.trial082.stdout:2606: copy_from oid 43 from oid 12 current snap is 281 2026-02-12T17:39:43.083 INFO:tasks.rados.rados.0.trial082.stdout:2607: delete oid 29 current snap is 281 2026-02-12T17:39:43.087 INFO:tasks.rados.rados.0.trial082.stdout:2607: done (1 left) 2026-02-12T17:39:43.087 INFO:tasks.rados.rados.0.trial082.stdout:2608: write oid 29 current snap is 281 2026-02-12T17:39:43.087 INFO:tasks.rados.rados.0.trial082.stdout:2608: seq_num 883 ranges {440581=741815,1604306=656626,2732032=108549} 2026-02-12T17:39:43.092 INFO:tasks.rados.rados.0.trial082.stdout:2608: writing trial08226312-29 from 440581 to 1182396 tid 1 2026-02-12T17:39:43.096 INFO:tasks.rados.rados.0.trial082.stdout:2608: writing trial08226312-29 from 1604306 to 2260932 tid 2 2026-02-12T17:39:43.099 INFO:tasks.rados.rados.0.trial082.stdout:2608: writing trial08226312-29 from 2732032 to 2840581 tid 3 2026-02-12T17:39:43.099 INFO:tasks.rados.rados.0.trial082.stdout:2609: delete oid 46 current snap is 281 2026-02-12T17:39:43.099 INFO:tasks.rados.rados.0.trial082.stdout:2606: finishing copy_from racing read to trial08226312-43 2026-02-12T17:39:43.099 INFO:tasks.rados.rados.0.trial082.stdout:2608: finishing write tid 1 to trial08226312-29 2026-02-12T17:39:43.099 INFO:tasks.rados.rados.0.trial082.stdout:2606: finishing copy_from to trial08226312-43 2026-02-12T17:39:43.099 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 1814 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:39:43.099 INFO:tasks.rados.rados.0.trial082.stdout:2608: finishing write tid 2 to trial08226312-29 2026-02-12T17:39:43.100 INFO:tasks.rados.rados.0.trial082.stdout:2606: done (2 left) 2026-02-12T17:39:43.100 INFO:tasks.rados.rados.0.trial082.stdout:2609: done (1 left) 2026-02-12T17:39:43.100 INFO:tasks.rados.rados.0.trial082.stdout:2610: read oid 39 snap 270 2026-02-12T17:39:43.100 INFO:tasks.rados.rados.0.trial082.stdout:2610: expect (ObjNum 816 snap 253 seq_num 816) 2026-02-12T17:39:43.101 INFO:tasks.rados.rados.0.trial082.stdout:2611: write oid 31 current snap is 281 2026-02-12T17:39:43.101 INFO:tasks.rados.rados.0.trial082.stdout:2611: seq_num 885 ranges {474195=492313,1604917=660295,2670525=203670} 2026-02-12T17:39:43.103 INFO:tasks.rados.rados.0.trial082.stdout:2611: writing trial08226312-31 from 474195 to 966508 tid 1 2026-02-12T17:39:43.108 INFO:tasks.rados.rados.0.trial082.stdout:2611: writing trial08226312-31 from 1604917 to 2265212 tid 2 2026-02-12T17:39:43.110 INFO:tasks.rados.rados.0.trial082.stdout:2611: writing trial08226312-31 from 2670525 to 2874195 tid 3 2026-02-12T17:39:43.111 INFO:tasks.rados.rados.0.trial082.stdout:2612: read oid 43 snap -1 2026-02-12T17:39:43.111 INFO:tasks.rados.rados.0.trial082.stdout:2612: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:39:43.111 INFO:tasks.rados.rados.0.trial082.stdout:2613: read oid 40 snap -1 2026-02-12T17:39:43.111 INFO:tasks.rados.rados.0.trial082.stdout:2613: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:39:43.111 INFO:tasks.rados.rados.0.trial082.stdout:2614: write oid 48 current snap is 281 2026-02-12T17:39:43.111 INFO:tasks.rados.rados.0.trial082.stdout:2614: seq_num 886 ranges {491002=567562,1663399=520306,2814301=76701} 2026-02-12T17:39:43.114 INFO:tasks.rados.rados.0.trial082.stdout:2614: writing trial08226312-48 from 491002 to 1058564 tid 1 2026-02-12T17:39:43.118 INFO:tasks.rados.rados.0.trial082.stdout:2614: writing trial08226312-48 from 1663399 to 2183705 tid 2 2026-02-12T17:39:43.121 INFO:tasks.rados.rados.0.trial082.stdout:2614: writing trial08226312-48 from 2814301 to 2891002 tid 3 2026-02-12T17:39:43.122 INFO:tasks.rados.rados.0.trial082.stdout:2615: read oid 18 snap -1 2026-02-12T17:39:43.122 INFO:tasks.rados.rados.0.trial082.stdout:2615: expect (ObjNum 840 snap 265 seq_num 840) 2026-02-12T17:39:43.122 INFO:tasks.rados.rados.0.trial082.stdout:2616: read oid 10 snap -1 2026-02-12T17:39:43.122 INFO:tasks.rados.rados.0.trial082.stdout:2616: expect (ObjNum 707 snap 212 seq_num 707) 2026-02-12T17:39:43.122 INFO:tasks.rados.rados.0.trial082.stdout:2617: snap_remove snap 276 2026-02-12T17:39:43.437 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:39:43.437 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:39:43.437 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T17:39:43.437 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T17:39:43.446 INFO:tasks.ceph.mon.c:Started 2026-02-12T17:39:43.446 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:39:43.447 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:39:43.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient: get_monmap_and_config 2026-02-12T17:39:43.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient: build_initial_monmap 2026-02-12T17:39:43.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient: monmap: 2026-02-12T17:39:43.513 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:43.513 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.513 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:43.514999+0000 2026-02-12T17:39:43.513 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:43.514999+0000 2026-02-12T17:39:43.513 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 1 Processor -- start 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 1 -- start start 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient: init 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:39:43.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient(hunting): picked mon.noname-b con 0x7fddf8088b20 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:43.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient(hunting): picked mon.noname-a con 0x7fddf808a960 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:43.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient(hunting): picked mon.noname-c con 0x7fddf8089600 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:43.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf808a0d0 con 0x7fddf808a960 2026-02-12T17:39:43.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf808ba10 con 0x7fddf8089600 2026-02-12T17:39:43.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf808b170 con 0x7fddf8088b20 2026-02-12T17:39:43.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:43.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddfd05b640 10 monclient(hunting): authenticate will time out at 1263.333937s 2026-02-12T17:39:43.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.514+0000 7fddf6d76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fddf8088b20 0x7fddf8088ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40814/0 (socket says 10.20.193.57:40814) 2026-02-12T17:39:43.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.515+0000 7fddf6d76640 1 -- 10.20.193.57:0/429366480 learned_addr learned my addr 10.20.193.57:0/429366480 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:43.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf6d76640 1 -- 10.20.193.57:0/429366480 >> v1:10.20.193.57:6790/0 conn(0x7fddf8088b20 legacy=0x7fddf8088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf6575640 1 -- 10.20.193.57:0/429366480 >> v1:10.20.193.57:6789/0 conn(0x7fddf808a960 legacy=0x7fddf81809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 -- 10.20.193.57:0/429366480 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871539504 0 0) 0x7fddf808a0d0 con 0x7fddf808a960 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient(hunting): my global_id is 74181 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 -- 10.20.193.57:0/429366480 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdde40035e0 con 0x7fddf808a960 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 -- 10.20.193.57:0/429366480 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4051803157 0 0) 0x7fdde40035e0 con 0x7fddf808a960 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 -- 10.20.193.57:0/429366480 >> v1:10.20.193.57:6790/0 conn(0x7fddf8088b20 legacy=0x7fddf8088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 -- 10.20.193.57:0/429366480 >> v1:10.20.193.82:6789/0 conn(0x7fddf8089600 legacy=0x7fddf81a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: _finish_hunting 0 2026-02-12T17:39:43.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 monclient: found mon.noname-a 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 -- 10.20.193.57:0/429366480 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf808c2b0 con 0x7fddf808a960 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: _finish_auth 0 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: _check_auth_tickets 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 -- 10.20.193.57:0/429366480 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdde00031a0 con 0x7fddf808a960 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: dump: 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.526 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddfd05b640 5 monclient: authenticate success, global_id 74181 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddfd05b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 -- 10.20.193.57:0/429366480 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdde0003460 con 0x7fddf808a960 2026-02-12T17:39:43.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 1 -- 10.20.193.57:0/429366480 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdde0003900 con 0x7fddf808a960 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddf5d74640 10 monclient: dump: 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.528 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddfd05b640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.517+0000 7fddfd05b640 4 set_mon_vals no callback set 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 10 monclient: shutdown 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 1 -- 10.20.193.57:0/429366480 >> v1:10.20.193.57:6789/0 conn(0x7fddf808a960 legacy=0x7fddf81809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 1 -- 10.20.193.57:0/429366480 shutdown_connections 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 1 -- 10.20.193.57:0/429366480 >> 10.20.193.57:0/429366480 conn(0x7fddf8091620 msgr2=0x7fddf8091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 1 -- 10.20.193.57:0/429366480 shutdown_connections 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 1 -- 10.20.193.57:0/429366480 wait complete. 2026-02-12T17:39:43.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 10 monclient: build_initial_monmap 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 10 monclient: monmap: 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 1 Processor -- start 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 1 -- start start 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 10 monclient: init 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 10 monclient(hunting): picked mon.noname-c con 0x7fddf8088b20 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 10 monclient(hunting): picked mon.noname-a con 0x7fddf8089600 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.518+0000 7fddfd05b640 10 monclient(hunting): picked mon.noname-b con 0x7fddf808a960 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.519+0000 7fddfd05b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf8058ff0 con 0x7fddf8089600 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.519+0000 7fddfd05b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf8088810 con 0x7fddf808a960 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.519+0000 7fddfd05b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf813be10 con 0x7fddf8088b20 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.519+0000 7fddfd05b640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.519+0000 7fddfd05b640 10 monclient(hunting): authenticate will time out at 1263.338037s 2026-02-12T17:39:43.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.519+0000 7fddf6575640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fddf8089600 0x7fddf8216b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51506/0 (socket says 10.20.193.57:51506) 2026-02-12T17:39:43.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.519+0000 7fddf6575640 1 -- 10.20.193.57:0/472275070 learned_addr learned my addr 10.20.193.57:0/472275070 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:43.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.519+0000 7fddf6d76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fddf8088b20 0x7fddf81d5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40822/0 (socket says 10.20.193.57:40822) 2026-02-12T17:39:43.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddf6575640 1 -- 10.20.193.57:0/472275070 >> v1:10.20.193.57:6789/0 conn(0x7fddf8089600 legacy=0x7fddf8216b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddf6d76640 1 -- 10.20.193.57:0/472275070 >> v1:10.20.193.57:6790/0 conn(0x7fddf8088b20 legacy=0x7fddf81d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 583036208 0 0) 0x7fddf8058ff0 con 0x7fddf8089600 2026-02-12T17:39:43.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient(hunting): my global_id is 74184 2026-02-12T17:39:43.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddc40035e0 con 0x7fddf8089600 2026-02-12T17:39:43.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3473861912 0 0) 0x7fddc40035e0 con 0x7fddf8089600 2026-02-12T17:39:43.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddf8058ff0 con 0x7fddf8089600 2026-02-12T17:39:43.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdde0003880 con 0x7fddf8089600 2026-02-12T17:39:43.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:43.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:43.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient(hunting): dump: 2026-02-12T17:39:43.534 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.534 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.534 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.534 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2253339362 0 0) 0x7fddf8058ff0 con 0x7fddf8089600 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 >> v1:10.20.193.57:6790/0 conn(0x7fddf8088b20 legacy=0x7fddf81d5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.535 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 >> v1:10.20.193.82:6789/0 conn(0x7fddf808a960 legacy=0x7fddf8238250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient: _finish_hunting 0 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 monclient: found mon.a 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf8140560 con 0x7fddf8089600 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient: _finish_auth 0 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient: _check_auth_tickets 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddfd05b640 5 monclient: authenticate success, global_id 74184 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddfd05b640 10 monclient: _renew_subs 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddfd05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fddf813de90 con 0x7fddf8089600 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddfd05b640 10 monclient: _renew_subs 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddfd05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fddf813e220 con 0x7fddf8089600 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdde0003f40 con 0x7fddf8089600 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fdde00042a0 con 0x7fddf8089600 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddd77fe640 10 monclient: dump: 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.537 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.521+0000 7fddf5573640 4 set_mon_vals no callback set 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.522+0000 7fddfd05b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.522+0000 7fddfd05b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.522+0000 7fddfd05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.522+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf80008d0 con 0x7fddf8089600 2026-02-12T17:39:43.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.522+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fdde0012390 con 0x7fddf8089600 2026-02-12T17:39:43.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.522+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(576..576 src has 202..576) ==== 4019+0+0 (unknown 2804230665 0 0) 0x7fdde004f070 con 0x7fddf8089600 2026-02-12T17:39:43.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.522+0000 7fddf6d76640 10 monclient: get_auth_request con 0x7fddc403f680 auth_method 0 2026-02-12T17:39:43.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.524+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fdde0004440 con 0x7fddf8089600 2026-02-12T17:39:43.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.524+0000 7fddd77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:43.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.524+0000 7fddd77fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:43.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.670+0000 7fddfd05b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:39:43.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.670+0000 7fddfd05b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:39:43.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.670+0000 7fddfd05b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.670+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fddf808f520 con 0x7fddf8089600 2026-02-12T17:39:43.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.670+0000 7fddd77fe640 1 -- 10.20.193.57:0/472275070 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2251745325) 0x7fdde0015720 con 0x7fddf8089600 2026-02-12T17:39:43.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.670+0000 7fddd77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:39:43.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.670+0000 7fddd77fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:43.668 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:39:43.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.671+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 >> v1:10.20.193.82:6800/2441377515 conn(0x7fddc403f680 legacy=0x7fddc405fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.671+0000 7fddfd05b640 10 monclient: shutdown 2026-02-12T17:39:43.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.671+0000 7fddfd05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:43.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.671+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 >> v1:10.20.193.57:6789/0 conn(0x7fddf8089600 legacy=0x7fddf8216b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.671+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 shutdown_connections 2026-02-12T17:39:43.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.671+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 >> 10.20.193.57:0/472275070 conn(0x7fddf8091620 msgr2=0x7fddf805a210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:43.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.671+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 shutdown_connections 2026-02-12T17:39:43.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.671+0000 7fddfd05b640 1 -- 10.20.193.57:0/472275070 wait complete. 2026-02-12T17:39:43.677 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:39:43.677 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:39:43.678 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:39:43.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient: get_monmap_and_config 2026-02-12T17:39:43.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient: build_initial_monmap 2026-02-12T17:39:43.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient: monmap: 2026-02-12T17:39:43.744 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:43.747060+0000 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:43.747060+0000 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 1 Processor -- start 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 1 -- start start 2026-02-12T17:39:43.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient: init 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient(hunting): picked mon.noname-b con 0x7f65b008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient(hunting): picked mon.noname-c con 0x7f65b008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient(hunting): picked mon.noname-a con 0x7f65b0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b008a820 con 0x7f65b0182cc0 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b0089450 con 0x7f65b008c620 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b0089730 con 0x7f65b008c250 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.746+0000 7f65b83c2640 10 monclient(hunting): authenticate will time out at 1263.565929s 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.747+0000 7f65b6137640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f65b008c250 0x7f65b008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40826/0 (socket says 10.20.193.57:40826) 2026-02-12T17:39:43.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.747+0000 7f65b6137640 1 -- 10.20.193.57:0/670336979 learned_addr learned my addr 10.20.193.57:0/670336979 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:43.753 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b6137640 1 -- 10.20.193.57:0/670336979 >> v1:10.20.193.57:6790/0 conn(0x7f65b008c250 legacy=0x7f65b008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b6938640 1 -- 10.20.193.57:0/670336979 >> v1:10.20.193.57:6789/0 conn(0x7f65b0182cc0 legacy=0x7f65b01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5936640 1 -- 10.20.193.57:0/670336979 >> v1:10.20.193.82:6789/0 conn(0x7f65b008c620 legacy=0x7f65b008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807249935 0 0) 0x7f65ac003d50 con 0x7f65b0182cc0 2026-02-12T17:39:43.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient(hunting): my global_id is 74187 2026-02-12T17:39:43.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65980035e0 con 0x7f65b0182cc0 2026-02-12T17:39:43.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502525798 0 0) 0x7f65b0089450 con 0x7f65b008c620 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient(hunting): my global_id is 4930 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65ac003d50 con 0x7f65b008c620 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2280146857 0 0) 0x7f65980035e0 con 0x7f65b0182cc0 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 >> v1:10.20.193.57:6790/0 conn(0x7f65b008c250 legacy=0x7f65b008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 >> v1:10.20.193.82:6789/0 conn(0x7f65b008c620 legacy=0x7f65b008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: _finish_hunting 0 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 monclient: found mon.noname-a 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:43.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b0089a10 con 0x7f65b0182cc0 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: _finish_auth 0 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: _check_auth_tickets 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f65ac004390 con 0x7f65b0182cc0 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: dump: 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.756 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b83c2640 5 monclient: authenticate success, global_id 74187 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b83c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65ac0047b0 con 0x7f65b0182cc0 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 1 -- 10.20.193.57:0/670336979 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f65ac004b00 con 0x7f65b0182cc0 2026-02-12T17:39:43.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b5135640 10 monclient: dump: 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.758 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b83c2640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.749+0000 7f65b83c2640 4 set_mon_vals no callback set 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 10 monclient: shutdown 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 1 -- 10.20.193.57:0/670336979 >> v1:10.20.193.57:6789/0 conn(0x7f65b0182cc0 legacy=0x7f65b01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 1 -- 10.20.193.57:0/670336979 shutdown_connections 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 1 -- 10.20.193.57:0/670336979 >> 10.20.193.57:0/670336979 conn(0x7f65b00916b0 msgr2=0x7f65b0091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 1 -- 10.20.193.57:0/670336979 shutdown_connections 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 1 -- 10.20.193.57:0/670336979 wait complete. 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 10 monclient: build_initial_monmap 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 10 monclient: monmap: 2026-02-12T17:39:43.759 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:43.760 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:43.760 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:43.760 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:43.760 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:43.760 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:43.760 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:43.760 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:43.760 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:43.760 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 1 Processor -- start 2026-02-12T17:39:43.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 1 -- start start 2026-02-12T17:39:43.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 10 monclient: init 2026-02-12T17:39:43.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:43.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:39:43.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 10 monclient(hunting): picked mon.noname-a con 0x7f65b008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 10 monclient(hunting): picked mon.noname-c con 0x7f65b008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 10 monclient(hunting): picked mon.noname-b con 0x7f65b0182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.750+0000 7f65b83c2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b0137660 con 0x7f65b008c250 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.751+0000 7f65b83c2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b013ed50 con 0x7f65b0182cc0 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.751+0000 7f65b83c2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b005d880 con 0x7f65b008c620 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.751+0000 7f65b83c2640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.751+0000 7f65b83c2640 10 monclient(hunting): authenticate will time out at 1263.570017s 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.751+0000 7f65b6137640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f65b008c250 0x7f65b005ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51516/0 (socket says 10.20.193.57:51516) 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.751+0000 7f65b6137640 1 -- 10.20.193.57:0/3045272940 learned_addr learned my addr 10.20.193.57:0/3045272940 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:43.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b5936640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6790/0 conn(0x7f65b008c620 legacy=0x7f65b005d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b6137640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6789/0 conn(0x7f65b008c250 legacy=0x7f65b005ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800961142 0 0) 0x7f65b0137660 con 0x7f65b008c250 2026-02-12T17:39:43.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient(hunting): my global_id is 74190 2026-02-12T17:39:43.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65800035e0 con 0x7f65b008c250 2026-02-12T17:39:43.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b6938640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.82:6789/0 conn(0x7f65b0182cc0 legacy=0x7f65b0193420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3249213461 0 0) 0x7f65800035e0 con 0x7f65b008c250 2026-02-12T17:39:43.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65b0137660 con 0x7f65b008c250 2026-02-12T17:39:43.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f65a00032f0 con 0x7f65b008c250 2026-02-12T17:39:43.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:43.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:43.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient(hunting): dump: 2026-02-12T17:39:43.764 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3172854358 0 0) 0x7f65b0137660 con 0x7f65b008c250 2026-02-12T17:39:43.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6790/0 conn(0x7f65b008c620 legacy=0x7f65b005d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.82:6789/0 conn(0x7f65b0182cc0 legacy=0x7f65b0193420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 monclient: found mon.a 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b0136a00 con 0x7f65b008c250 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient: _finish_auth 0 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b83c2640 5 monclient: authenticate success, global_id 74190 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b83c2640 10 monclient: _renew_subs 2026-02-12T17:39:43.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b83c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f65b00888a0 con 0x7f65b008c250 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b83c2640 10 monclient: _renew_subs 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b83c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f65b0138b00 con 0x7f65b008c250 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65a0004b50 con 0x7f65b008c250 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f65a0004ea0 con 0x7f65b008c250 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f6596ffd640 10 monclient: dump: 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.767 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.753+0000 7f65b4934640 4 set_mon_vals no callback set 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.754+0000 7f65b83c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.754+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f65b0090810 con 0x7f65b013e210 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.754+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f65a0005130 con 0x7f65b008c250 2026-02-12T17:39:43.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.754+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(576..576 src has 202..576) ==== 4019+0+0 (unknown 2804230665 0 0) 0x7f65a004ec60 con 0x7f65b008c250 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.754+0000 7f65b6938640 10 monclient: get_auth_request con 0x7f658003f700 auth_method 0 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f65b5936640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6789/0 conn(0x7f65b013e210 legacy=0x7f65b0058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146057984 0 0) 0x7f65b0090810 con 0x7f65b013e210 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 10 monclient(hunting): my global_id is 74193 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65b0137660 con 0x7f65b013e210 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3432397608 0 0) 0x7f65b0137660 con 0x7f65b013e210 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65b0090810 con 0x7f65b013e210 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f65a4003270 con 0x7f65b013e210 2026-02-12T17:39:43.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 10 monclient: dump: 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.770 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3890198737 0 0) 0x7f65b0090810 con 0x7f65b013e210 2026-02-12T17:39:43.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65b013e5e0 con 0x7f65b013e210 2026-02-12T17:39:43.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f65a4005880 con 0x7f65b013e210 2026-02-12T17:39:43.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:43.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:43.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6789/0 conn(0x7f65b013e210 legacy=0x7f65b0058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.756+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6789/0 conn(0x7f65b013e210 legacy=0x7f65b0058410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:43.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.760+0000 7f65b83c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:39:43.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.760+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f65b00008d0 con 0x7f65b004d1c0 2026-02-12T17:39:43.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f65b5936640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6789/0 conn(0x7f65b004d1c0 legacy=0x7f65b0195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258377741 0 0) 0x7f65b00008d0 con 0x7f65b004d1c0 2026-02-12T17:39:43.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 10 monclient(hunting): my global_id is 74196 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65b0090810 con 0x7f65b004d1c0 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 481401680 0 0) 0x7f65b0090810 con 0x7f65b004d1c0 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65b00008d0 con 0x7f65b004d1c0 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f65a4003bb0 con 0x7f65b004d1c0 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 10 monclient: dump: 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.774 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2254000622 0 0) 0x7f65b00008d0 con 0x7f65b004d1c0 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f65b0138320 con 0x7f65b004d1c0 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 2232257495) 0x7f65a4005aa0 con 0x7f65b004d1c0 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:39:43.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:43.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6789/0 conn(0x7f65b004d1c0 legacy=0x7f65b0195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.762+0000 7f6596ffd640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6789/0 conn(0x7f65b004d1c0 legacy=0x7f65b0195b50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:43.776 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:39:43.776 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:39:43.776 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:39:43.776 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:39:43.776 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 46, 2026-02-12T17:39:43.776 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 110225, 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:43.777 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:39:43.778 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.779 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:39:43.780 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:43.781 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:39:43.782 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:43.783 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.783 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.783 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.783 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:39:43.783 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:39:43.783 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:43.783 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:43.783 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:39:43.784 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:43.784 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.784 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.784 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:39:43.784 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:39:43.784 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:43.784 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:43.784 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.785 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:39:43.786 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:43.787 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:39:43.788 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:39:43.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.82:6800/2441377515 conn(0x7f658003f700 legacy=0x7f658005fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b83c2640 10 monclient: shutdown 2026-02-12T17:39:43.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b83c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:43.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 >> v1:10.20.193.57:6789/0 conn(0x7f65b008c250 legacy=0x7f65b005ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b6938640 1 -- 10.20.193.57:0/3045272940 reap_dead start 2026-02-12T17:39:43.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b6938640 1 -- 10.20.193.57:0/3045272940 reap_dead start 2026-02-12T17:39:43.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 shutdown_connections 2026-02-12T17:39:43.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 >> 10.20.193.57:0/3045272940 conn(0x7f65b00916b0 msgr2=0x7f65b018e340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:43.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 shutdown_connections 2026-02-12T17:39:43.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.763+0000 7f65b83c2640 1 -- 10.20.193.57:0/3045272940 wait complete. 2026-02-12T17:39:43.790 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:39:43.790 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:39:43.791 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:39:43.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.858+0000 7faa0930c640 10 monclient: get_monmap_and_config 2026-02-12T17:39:43.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.858+0000 7faa0930c640 10 monclient: build_initial_monmap 2026-02-12T17:39:43.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.858+0000 7faa0930c640 10 monclient: monmap: 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:43.859490+0000 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:43.859490+0000 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:43.856 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 1 Processor -- start 2026-02-12T17:39:43.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 1 -- start start 2026-02-12T17:39:43.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 10 monclient: init 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 10 monclient(hunting): picked mon.noname-a con 0x7faa0408c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 10 monclient(hunting): picked mon.noname-b con 0x7faa0408c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 10 monclient(hunting): picked mon.noname-c con 0x7faa04182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0408a820 con 0x7faa0408c250 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa04089450 con 0x7faa04182cc0 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa04089730 con 0x7faa0408c620 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa0930c640 10 monclient(hunting): authenticate will time out at 1263.678379s 2026-02-12T17:39:43.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa02ffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7faa0408c250 0x7faa0408a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51542/0 (socket says 10.20.193.57:51542) 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.859+0000 7faa02ffd640 1 -- 10.20.193.57:0/2853401796 learned_addr learned my addr 10.20.193.57:0/2853401796 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.861+0000 7faa02ffd640 1 -- 10.20.193.57:0/2853401796 >> v1:10.20.193.57:6789/0 conn(0x7faa0408c250 legacy=0x7faa0408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.861+0000 7faa027fc640 1 -- 10.20.193.57:0/2853401796 >> v1:10.20.193.57:6790/0 conn(0x7faa0408c620 legacy=0x7faa0408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.861+0000 7faa01ffb640 1 -- 10.20.193.57:0/2853401796 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810647045 0 0) 0x7faa04089730 con 0x7faa0408c620 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.861+0000 7faa01ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.861+0000 7faa01ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.861+0000 7faa01ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.861+0000 7faa01ffb640 10 monclient(hunting): my global_id is 84101 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.861+0000 7faa01ffb640 1 -- 10.20.193.57:0/2853401796 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9f00035e0 con 0x7faa0408c620 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.861+0000 7faa037fe640 1 -- 10.20.193.57:0/2853401796 >> v1:10.20.193.82:6789/0 conn(0x7faa04182cc0 legacy=0x7faa041a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 1 -- 10.20.193.57:0/2853401796 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 399815111 0 0) 0x7fa9f00035e0 con 0x7faa0408c620 2026-02-12T17:39:43.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 1 -- 10.20.193.57:0/2853401796 >> v1:10.20.193.82:6789/0 conn(0x7faa04182cc0 legacy=0x7faa041a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 1 -- 10.20.193.57:0/2853401796 >> v1:10.20.193.57:6789/0 conn(0x7faa0408c250 legacy=0x7faa0408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 1 monclient: found mon.noname-b 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 1 -- 10.20.193.57:0/2853401796 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa04089a10 con 0x7faa0408c620 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: _finish_auth 0 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 1 -- 10.20.193.57:0/2853401796 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa9ec003120 con 0x7faa0408c620 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 5 monclient: authenticate success, global_id 84101 2026-02-12T17:39:43.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: dump: 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.865 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.866 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 1 -- 10.20.193.57:0/2853401796 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9ec003420 con 0x7faa0408c620 2026-02-12T17:39:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:43.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 1 -- 10.20.193.57:0/2853401796 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa9ec003880 con 0x7faa0408c620 2026-02-12T17:39:43.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:43.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa01ffb640 10 monclient: dump: 2026-02-12T17:39:43.867 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.867 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.867 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.868 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.868 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.868 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.868 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.868 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.868 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.869 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 4 set_mon_vals no callback set 2026-02-12T17:39:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 10 monclient: shutdown 2026-02-12T17:39:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:43.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 1 -- 10.20.193.57:0/2853401796 >> v1:10.20.193.57:6790/0 conn(0x7faa0408c620 legacy=0x7faa0408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 1 -- 10.20.193.57:0/2853401796 shutdown_connections 2026-02-12T17:39:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 1 -- 10.20.193.57:0/2853401796 >> 10.20.193.57:0/2853401796 conn(0x7faa040916b0 msgr2=0x7faa04091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 1 -- 10.20.193.57:0/2853401796 shutdown_connections 2026-02-12T17:39:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.862+0000 7faa0930c640 1 -- 10.20.193.57:0/2853401796 wait complete. 2026-02-12T17:39:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient: build_initial_monmap 2026-02-12T17:39:43.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient: monmap: 2026-02-12T17:39:43.871 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:43.871 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:43.871 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:43.871 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:43.871 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:43.871 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:43.871 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:43.871 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:43.871 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 1 Processor -- start 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 1 -- start start 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient: init 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient(hunting): picked mon.noname-c con 0x7faa0408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient(hunting): picked mon.noname-a con 0x7faa0408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient(hunting): picked mon.noname-b con 0x7faa04182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa04182ad0 con 0x7faa0408c620 2026-02-12T17:39:43.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa04139700 con 0x7faa04182cc0 2026-02-12T17:39:43.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0413aaf0 con 0x7faa0408c250 2026-02-12T17:39:43.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:43.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa0930c640 10 monclient(hunting): authenticate will time out at 1263.682518s 2026-02-12T17:39:43.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa02ffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7faa0408c250 0x7faa041946d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40854/0 (socket says 10.20.193.57:40854) 2026-02-12T17:39:43.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.863+0000 7faa02ffd640 1 -- 10.20.193.57:0/754201861 learned_addr learned my addr 10.20.193.57:0/754201861 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:43.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.865+0000 7faa02ffd640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6790/0 conn(0x7faa0408c250 legacy=0x7faa041946d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.865+0000 7faa027fc640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6789/0 conn(0x7faa0408c620 legacy=0x7faa04181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.865+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126123873 0 0) 0x7faa0413aaf0 con 0x7faa0408c250 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.865+0000 7fa9e37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.865+0000 7fa9e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.865+0000 7fa9e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.865+0000 7fa9e37fe640 10 monclient(hunting): my global_id is 84104 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.865+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9d00035e0 con 0x7faa0408c250 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2919865333 0 0) 0x7fa9d00035e0 con 0x7faa0408c250 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa0413aaf0 con 0x7faa0408c250 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa9f80032f0 con 0x7faa0408c250 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:39:43.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): dump: 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:43.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7faa02ffd640 1 --1- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6790/0 conn(0x7faa0408c250 0x7faa041946d0 :-1 s=OPENED pgs=245 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7faa0413aaf0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7faa037fe640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.82:6789/0 conn(0x7faa04182cc0 legacy=0x7faa041823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535628859 0 0) 0x7faa04139700 con 0x7faa04182cc0 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): my global_id is 4939 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9d00035e0 con 0x7faa04182cc0 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3170048368 0 0) 0x7fa9d00035e0 con 0x7faa04182cc0 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa04139700 con 0x7faa04182cc0 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa9f40043b0 con 0x7faa04182cc0 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:43.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.866+0000 7fa9e37fe640 10 monclient(hunting): dump: 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 124634277 0 0) 0x7faa04139700 con 0x7faa04182cc0 2026-02-12T17:39:43.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6790/0 conn(0x7faa0408c250 legacy=0x7faa041946d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6789/0 conn(0x7faa0408c620 legacy=0x7faa04181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 10 monclient: _finish_hunting 0 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 1 monclient: found mon.b 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0413b1c0 con 0x7faa04182cc0 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 10 monclient: _finish_auth 0 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 10 monclient: _check_auth_tickets 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 332587002 0 0) 0x7faa0413aaf0 con 0x7faa0408c250 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa0930c640 5 monclient: authenticate success, global_id 4939 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa0930c640 10 monclient: _renew_subs 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa0930c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faa0413b4a0 con 0x7faa04182cc0 2026-02-12T17:39:43.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa0930c640 10 monclient: _renew_subs 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa0930c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faa04138c50 con 0x7faa04182cc0 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9f4004a60 con 0x7faa04182cc0 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa017fa640 4 set_mon_vals no callback set 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa9f4004e00 con 0x7faa04182cc0 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7fa9e37fe640 10 monclient: dump: 2026-02-12T17:39:43.885 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.886 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.886 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.886 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.886 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.886 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.886 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.886 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa0930c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.867+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faa04090810 con 0x7faa0413be80 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.868+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fa9f4004fe0 con 0x7faa04182cc0 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.868+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(576..576 src has 202..576) ==== 4019+0+0 (unknown 2804230665 0 0) 0x7fa9f404fca0 con 0x7faa04182cc0 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.868+0000 7faa027fc640 10 monclient: get_auth_request con 0x7fa9d003fad0 auth_method 0 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.869+0000 7faa02ffd640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6790/0 conn(0x7faa0413be80 legacy=0x7faa0405b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.869+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457275284 0 0) 0x7faa04090810 con 0x7faa0413be80 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.869+0000 7fa9e37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.869+0000 7fa9e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.869+0000 7fa9e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.869+0000 7fa9e37fe640 10 monclient(hunting): my global_id is 84107 2026-02-12T17:39:43.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.869+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa0413aaf0 con 0x7faa0413be80 2026-02-12T17:39:43.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4000286876 0 0) 0x7faa0413aaf0 con 0x7faa0413be80 2026-02-12T17:39:43.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa04090810 con 0x7faa0413be80 2026-02-12T17:39:43.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa9f8004f50 con 0x7faa0413be80 2026-02-12T17:39:43.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:43.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 10 monclient: dump: 2026-02-12T17:39:43.888 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1850140521 0 0) 0x7faa04090810 con 0x7faa0413be80 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa0413af40 con 0x7faa0413be80 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fa9f8005540 con 0x7faa0413be80 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:43.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6790/0 conn(0x7faa0413be80 legacy=0x7faa0405b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.870+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6790/0 conn(0x7faa0413be80 legacy=0x7faa0405b7c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.873+0000 7faa0930c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.873+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faa04091a80 con 0x7faa04194de0 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.875+0000 7faa02ffd640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6790/0 conn(0x7faa04194de0 legacy=0x7faa0405bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.875+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734752321 0 0) 0x7faa04091a80 con 0x7faa04194de0 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.875+0000 7fa9e37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.875+0000 7fa9e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.875+0000 7fa9e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.875+0000 7fa9e37fe640 10 monclient(hunting): my global_id is 84110 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.875+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa04090810 con 0x7faa04194de0 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2148157513 0 0) 0x7faa04090810 con 0x7faa04194de0 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa04091a80 con 0x7faa04194de0 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa9f8005730 con 0x7faa04194de0 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 10 monclient: dump: 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1655888947 0 0) 0x7faa04091a80 con 0x7faa04194de0 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faa0408f5b0 con 0x7faa04194de0 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4335 (unknown 0 0 3440178485) 0x7fa9f8005f70 con 0x7faa04194de0 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:39:43.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:43.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6790/0 conn(0x7faa04194de0 legacy=0x7faa0405bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7fa9e37fe640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.57:6790/0 conn(0x7faa04194de0 legacy=0x7faa0405bed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:43.892 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:39:43.892 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:39:43.892 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:39:43.892 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:39:43.892 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 46, 2026-02-12T17:39:43.892 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 368, 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:43.893 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:43.894 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:39:43.895 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:43.896 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.897 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.898 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:39:43.899 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:43.900 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:43.901 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:43.901 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:43.901 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:43.901 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:43.901 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:39:43.901 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.82:6800/2441377515 conn(0x7fa9d003fad0 legacy=0x7fa9d005ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa0930c640 10 monclient: shutdown 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa0930c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 >> v1:10.20.193.82:6789/0 conn(0x7faa04182cc0 legacy=0x7faa041823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa037fe640 1 -- 10.20.193.57:0/754201861 reap_dead start 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa037fe640 1 -- 10.20.193.57:0/754201861 reap_dead start 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 shutdown_connections 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 >> 10.20.193.57:0/754201861 conn(0x7faa040916b0 msgr2=0x7faa0408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 shutdown_connections 2026-02-12T17:39:43.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.876+0000 7faa0930c640 1 -- 10.20.193.57:0/754201861 wait complete. 2026-02-12T17:39:43.903 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:39:43.903 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:39:43.903 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:39:43.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient: get_monmap_and_config 2026-02-12T17:39:43.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient: build_initial_monmap 2026-02-12T17:39:43.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient: monmap: 2026-02-12T17:39:43.970 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:43.970 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.970 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:43.972914+0000 2026-02-12T17:39:43.970 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:43.972914+0000 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 1 Processor -- start 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 1 -- start start 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient: init 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:39:43.971 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient(hunting): picked mon.noname-b con 0x7f3e0808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:43.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient(hunting): picked mon.noname-a con 0x7f3e0808c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:43.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient(hunting): picked mon.noname-c con 0x7f3e08182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:43.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0808a820 con 0x7f3e0808c620 2026-02-12T17:39:43.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e08089450 con 0x7f3e08182cc0 2026-02-12T17:39:43.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e08089730 con 0x7f3e0808c250 2026-02-12T17:39:43.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:43.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0fb0c640 10 monclient(hunting): authenticate will time out at 1263.791836s 2026-02-12T17:39:43.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0d881640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3e0808c250 0x7f3e0808a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40872/0 (socket says 10.20.193.57:40872) 2026-02-12T17:39:43.972 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.972+0000 7f3e0d881640 1 -- 10.20.193.57:0/309315498 learned_addr learned my addr 10.20.193.57:0/309315498 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:43.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0d080640 1 -- 10.20.193.57:0/309315498 >> v1:10.20.193.57:6789/0 conn(0x7f3e0808c620 legacy=0x7f3e0808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0d881640 1 -- 10.20.193.57:0/309315498 >> v1:10.20.193.57:6790/0 conn(0x7f3e0808c250 legacy=0x7f3e0808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0e082640 1 -- 10.20.193.57:0/309315498 >> v1:10.20.193.82:6789/0 conn(0x7f3e08182cc0 legacy=0x7f3e081a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799479038 0 0) 0x7f3e08089730 con 0x7f3e0808c250 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient(hunting): my global_id is 84113 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3df00035e0 con 0x7f3e0808c250 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611429803 0 0) 0x7f3e08089450 con 0x7f3e08182cc0 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.979 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient(hunting): my global_id is 4942 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e08089730 con 0x7f3e08182cc0 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2580883448 0 0) 0x7f3df00035e0 con 0x7f3e0808c250 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 >> v1:10.20.193.82:6789/0 conn(0x7f3e08182cc0 legacy=0x7f3e081a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 >> v1:10.20.193.57:6789/0 conn(0x7f3e0808c620 legacy=0x7f3e0808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: _finish_hunting 0 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 monclient: found mon.noname-b 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e08089a10 con 0x7f3e0808c250 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: _finish_auth 0 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: _check_auth_tickets 2026-02-12T17:39:43.980 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3df8003000 con 0x7f3e0808c250 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: dump: 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.981 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 5 monclient: authenticate success, global_id 84113 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3df8003300 con 0x7f3e0808c250 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 1 -- 10.20.193.57:0/309315498 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3df8004960 con 0x7f3e0808c250 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0c87f640 10 monclient: dump: 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.982 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 4 set_mon_vals no callback set 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 10 monclient: shutdown 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:43.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/309315498 >> v1:10.20.193.57:6790/0 conn(0x7f3e0808c250 legacy=0x7f3e0808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/309315498 shutdown_connections 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/309315498 >> 10.20.193.57:0/309315498 conn(0x7f3e080916b0 msgr2=0x7f3e08091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.975+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/309315498 shutdown_connections 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/309315498 wait complete. 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient: build_initial_monmap 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient: monmap: 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:43.984 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 1 Processor -- start 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 1 -- start start 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient: init 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient(hunting): picked mon.noname-c con 0x7f3e0808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient(hunting): picked mon.noname-a con 0x7f3e0808c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient(hunting): picked mon.noname-b con 0x7f3e08182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e081389d0 con 0x7f3e0808c620 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e08182ad0 con 0x7f3e08182cc0 2026-02-12T17:39:43.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e08138130 con 0x7f3e0808c250 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0fb0c640 10 monclient(hunting): authenticate will time out at 1263.795784s 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0d881640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3e0808c250 0x7f3e0813df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40878/0 (socket says 10.20.193.57:40878) 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.976+0000 7f3e0d881640 1 -- 10.20.193.57:0/4182724011 learned_addr learned my addr 10.20.193.57:0/4182724011 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.978+0000 7f3e0d881640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.57:6790/0 conn(0x7f3e0808c250 legacy=0x7f3e0813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.978+0000 7f3e0d080640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.57:6789/0 conn(0x7f3e0808c620 legacy=0x7f3e08181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0e082640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.82:6789/0 conn(0x7f3e08182cc0 legacy=0x7f3e081823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 360558972 0 0) 0x7f3e08138130 con 0x7f3e0808c250 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): my global_id is 84116 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dd80035e0 con 0x7f3e0808c250 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215135157 0 0) 0x7f3e08182ad0 con 0x7f3e08182cc0 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): my global_id is 4945 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e08138130 con 0x7f3e08182cc0 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1644779040 0 0) 0x7f3dd80035e0 con 0x7f3e0808c250 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e08182ad0 con 0x7f3e0808c250 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3df8002a60 con 0x7f3e0808c250 2026-02-12T17:39:43.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): dump: 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4201171381 0 0) 0x7f3e08182ad0 con 0x7f3e0808c250 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.82:6789/0 conn(0x7f3e08182cc0 legacy=0x7f3e081823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.57:6789/0 conn(0x7f3e0808c620 legacy=0x7f3e08181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient: _finish_hunting 0 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 monclient: found mon.c 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e08138410 con 0x7f3e0808c250 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient: _finish_auth 0 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient: _check_auth_tickets 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:43.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0fb0c640 5 monclient: authenticate success, global_id 84116 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0fb0c640 10 monclient: _renew_subs 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0fb0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e08138750 con 0x7f3e0808c250 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0fb0c640 10 monclient: _renew_subs 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0fb0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e0813e650 con 0x7f3e0808c250 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3df8004f40 con 0x7f3e0808c250 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3df8005260 con 0x7f3e0808c250 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df67fc640 10 monclient: dump: 2026-02-12T17:39:43.990 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3df7fff640 4 set_mon_vals no callback set 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0fb0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:43.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.979+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3e08090810 con 0x7f3e0818ff90 2026-02-12T17:39:43.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.980+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3df8011ed0 con 0x7f3e0808c250 2026-02-12T17:39:43.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.980+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(576..576 src has 202..576) ==== 4019+0+0 (unknown 2804230665 0 0) 0x7f3df804ed50 con 0x7f3e0808c250 2026-02-12T17:39:43.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.980+0000 7f3e0e082640 10 monclient: get_auth_request con 0x7f3dd803f830 auth_method 0 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.982+0000 7f3e0d080640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.82:6789/0 conn(0x7f3e0818ff90 legacy=0x7f3e08086730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.982+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5038005 0 0) 0x7f3e08090810 con 0x7f3e0818ff90 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.982+0000 7f3df67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.982+0000 7f3df67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.982+0000 7f3df67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.982+0000 7f3df67fc640 10 monclient(hunting): my global_id is 4948 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.982+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e08182ad0 con 0x7f3e0818ff90 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1971113884 0 0) 0x7f3e08182ad0 con 0x7f3e0818ff90 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e08090810 con 0x7f3e0818ff90 2026-02-12T17:39:43.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3dfc0031d0 con 0x7f3e0818ff90 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 10 monclient: dump: 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.996 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1837568408 0 0) 0x7f3e08090810 con 0x7f3e0818ff90 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e0808f5b0 con 0x7f3e0818ff90 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3dfc005880 con 0x7f3e0818ff90 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.82:6789/0 conn(0x7f3e0818ff90 legacy=0x7f3e08086730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.983+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.82:6789/0 conn(0x7f3e0818ff90 legacy=0x7f3e08086730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.987+0000 7f3e0fb0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.987+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3e0818f910 con 0x7f3e0818f510 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.989+0000 7f3e0d080640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.82:6789/0 conn(0x7f3e0818f510 legacy=0x7f3e08086e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:43.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893852845 0 0) 0x7f3e081389d0 con 0x7f3e0818f510 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 10 monclient(hunting): my global_id is 4951 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e08090810 con 0x7f3e0818f510 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3177793927 0 0) 0x7f3e08090810 con 0x7f3e0818f510 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e081389d0 con 0x7f3e0818f510 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3dfc003b40 con 0x7f3e0818f510 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 10 monclient: dump: 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:43.998 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3955678335 0 0) 0x7f3e081389d0 con 0x7f3e0818f510 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3e0813e8a0 con 0x7f3e0818f510 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 1895720686) 0x7f3dfc005aa0 con 0x7f3e0818f510 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:39:43.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:44.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.82:6789/0 conn(0x7f3e0818f510 legacy=0x7f3e08086e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.990+0000 7f3df67fc640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.82:6789/0 conn(0x7f3e0818f510 legacy=0x7f3e08086e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:44.000 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:39:44.000 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:39:44.000 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:39:44.000 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:39:44.000 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 46, 2026-02-12T17:39:44.000 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 705485, 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:44.001 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:39:44.002 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:44.003 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:39:44.004 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:44.005 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:39:44.006 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:44.007 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:44.008 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:44.009 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:44.010 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:44.011 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:44.011 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:44.011 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:44.011 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:39:44.011 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.82:6800/2441377515 conn(0x7f3dd803f830 legacy=0x7f3dd805fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0fb0c640 10 monclient: shutdown 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0fb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 >> v1:10.20.193.57:6790/0 conn(0x7f3e0808c250 legacy=0x7f3e0813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0e082640 1 -- 10.20.193.57:0/4182724011 reap_dead start 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0e082640 1 -- 10.20.193.57:0/4182724011 reap_dead start 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 shutdown_connections 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 >> 10.20.193.57:0/4182724011 conn(0x7f3e080916b0 msgr2=0x7f3e0808a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 shutdown_connections 2026-02-12T17:39:44.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:43.991+0000 7f3e0fb0c640 1 -- 10.20.193.57:0/4182724011 wait complete. 2026-02-12T17:39:44.013 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:39:44.013 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:39:44.013 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:39:44.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.081+0000 7f2f6eec3640 10 monclient: get_monmap_and_config 2026-02-12T17:39:44.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.081+0000 7f2f6eec3640 10 monclient: build_initial_monmap 2026-02-12T17:39:44.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.081+0000 7f2f6eec3640 10 monclient: monmap: 2026-02-12T17:39:44.078 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:44.078 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:44.078 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:44.082494+0000 2026-02-12T17:39:44.078 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:44.082494+0000 2026-02-12T17:39:44.079 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:44.079 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:44.079 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:44.079 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:44.079 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:44.079 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:44.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 1 Processor -- start 2026-02-12T17:39:44.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 1 -- start start 2026-02-12T17:39:44.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 10 monclient: init 2026-02-12T17:39:44.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:44.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:39:44.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 10 monclient(hunting): picked mon.noname-c con 0x7f2f68054330 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:44.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 10 monclient(hunting): picked mon.noname-a con 0x7f2f68054700 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:44.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 10 monclient(hunting): picked mon.noname-b con 0x7f2f68184d30 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:44.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6805d8f0 con 0x7f2f68054700 2026-02-12T17:39:44.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6805e590 con 0x7f2f68054330 2026-02-12T17:39:44.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6808d390 con 0x7f2f68184d30 2026-02-12T17:39:44.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:44.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f6eec3640 10 monclient(hunting): authenticate will time out at 1263.901423s 2026-02-12T17:39:44.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f5ffff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f2f68054700 0x7f2f68054b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51574/0 (socket says 10.20.193.57:51574) 2026-02-12T17:39:44.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.082+0000 7f2f5ffff640 1 -- 10.20.193.57:0/3526167062 learned_addr learned my addr 10.20.193.57:0/3526167062 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:44.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.084+0000 7f2f6d439640 1 -- 10.20.193.57:0/3526167062 >> v1:10.20.193.57:6790/0 conn(0x7f2f68184d30 legacy=0x7f2f681a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:44.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.084+0000 7f2f5ffff640 1 -- 10.20.193.57:0/3526167062 >> v1:10.20.193.57:6789/0 conn(0x7f2f68054700 legacy=0x7f2f68054b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:44.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.084+0000 7f2f6cc38640 1 -- 10.20.193.57:0/3526167062 >> v1:10.20.193.82:6789/0 conn(0x7f2f68054330 legacy=0x7f2f6808dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:44.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.084+0000 7f2f5f7fe640 1 -- 10.20.193.57:0/3526167062 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217463823 0 0) 0x7f2f6808d390 con 0x7f2f68184d30 2026-02-12T17:39:44.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.084+0000 7f2f5f7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:39:44.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.084+0000 7f2f5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:44.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.084+0000 7f2f5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:44.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.084+0000 7f2f5f7fe640 10 monclient(hunting): my global_id is 84119 2026-02-12T17:39:44.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.084+0000 7f2f5f7fe640 1 -- 10.20.193.57:0/3526167062 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f540035e0 con 0x7f2f68184d30 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 1 -- 10.20.193.57:0/3526167062 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 828026227 0 0) 0x7f2f540035e0 con 0x7f2f68184d30 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 1 -- 10.20.193.57:0/3526167062 >> v1:10.20.193.82:6789/0 conn(0x7f2f68054330 legacy=0x7f2f6808dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 1 -- 10.20.193.57:0/3526167062 >> v1:10.20.193.57:6789/0 conn(0x7f2f68054700 legacy=0x7f2f68054b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 1 monclient: found mon.noname-b 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 1 -- 10.20.193.57:0/3526167062 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6808fd30 con 0x7f2f68184d30 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: _finish_auth 0 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 1 -- 10.20.193.57:0/3526167062 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2f64004200 con 0x7f2f68184d30 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 5 monclient: authenticate success, global_id 84119 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:44.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: dump: 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 1 -- 10.20.193.57:0/3526167062 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f64004500 con 0x7f2f68184d30 2026-02-12T17:39:44.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 4 set_mon_vals no callback set 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 1 -- 10.20.193.57:0/3526167062 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2f64004960 con 0x7f2f68184d30 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f5f7fe640 10 monclient: dump: 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:44.087 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 10 monclient: shutdown 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 1 -- 10.20.193.57:0/3526167062 >> v1:10.20.193.57:6790/0 conn(0x7f2f68184d30 legacy=0x7f2f681a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 1 -- 10.20.193.57:0/3526167062 shutdown_connections 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 1 -- 10.20.193.57:0/3526167062 >> 10.20.193.57:0/3526167062 conn(0x7f2f680930d0 msgr2=0x7f2f6808f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 1 -- 10.20.193.57:0/3526167062 shutdown_connections 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 1 -- 10.20.193.57:0/3526167062 wait complete. 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 10 monclient: build_initial_monmap 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 10 monclient: monmap: 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:44.088 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.085+0000 7f2f6eec3640 1 Processor -- start 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 1 -- start start 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 10 monclient: init 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 10 monclient(hunting): picked mon.noname-c con 0x7f2f68054330 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 10 monclient(hunting): picked mon.noname-b con 0x7f2f68054700 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 10 monclient(hunting): picked mon.noname-a con 0x7f2f68184d30 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f68184b40 con 0x7f2f68184d30 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f68056d70 con 0x7f2f68054700 2026-02-12T17:39:44.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f68089ae0 con 0x7f2f68054330 2026-02-12T17:39:44.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:44.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6eec3640 10 monclient(hunting): authenticate will time out at 1263.905277s 2026-02-12T17:39:44.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6cc38640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f2f68054330 0x7f2f68143360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40906/0 (socket says 10.20.193.57:40906) 2026-02-12T17:39:44.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6cc38640 1 -- 10.20.193.57:0/1994496582 learned_addr learned my addr 10.20.193.57:0/1994496582 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:44.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.086+0000 7f2f6d439640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f2f68184d30 0x7f2f68184430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51578/0 (socket says 10.20.193.57:51578) 2026-02-12T17:39:44.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f6d439640 1 -- 10.20.193.57:0/1994496582 >> v1:10.20.193.57:6789/0 conn(0x7f2f68184d30 legacy=0x7f2f68184430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:44.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f6cc38640 1 -- 10.20.193.57:0/1994496582 >> v1:10.20.193.57:6790/0 conn(0x7f2f68054330 legacy=0x7f2f68143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:44.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2728405946 0 0) 0x7f2f68089ae0 con 0x7f2f68054330 2026-02-12T17:39:44.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5ffff640 1 -- 10.20.193.57:0/1994496582 >> v1:10.20.193.82:6789/0 conn(0x7f2f68054700 legacy=0x7f2f68183d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): my global_id is 84122 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f380035e0 con 0x7f2f68054330 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3045364343 0 0) 0x7f2f380035e0 con 0x7f2f68054330 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f68089ae0 con 0x7f2f68054330 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2f580033c0 con 0x7f2f68054330 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): dump: 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:44.093 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502502707 0 0) 0x7f2f68056d70 con 0x7f2f68054700 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 10 monclient(hunting): my global_id is 4957 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.088+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f380035e0 con 0x7f2f68054700 2026-02-12T17:39:44.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3105830300 0 0) 0x7f2f68089ae0 con 0x7f2f68054330 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 >> v1:10.20.193.82:6789/0 conn(0x7f2f68054700 legacy=0x7f2f68183d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 >> v1:10.20.193.57:6789/0 conn(0x7f2f68184d30 legacy=0x7f2f68184430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 10 monclient: _finish_hunting 0 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 1 monclient: found mon.c 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6807e920 con 0x7f2f68054330 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 10 monclient: _finish_auth 0 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 10 monclient: _check_auth_tickets 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 5 monclient: authenticate success, global_id 84122 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 10 monclient: _renew_subs 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f68080c80 con 0x7f2f68054330 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 10 monclient: _renew_subs 2026-02-12T17:39:44.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f680861a0 con 0x7f2f68054330 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f580039f0 con 0x7f2f68054330 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2f58003d10 con 0x7f2f68054330 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 10 monclient: dump: 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:44.096 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5effd640 4 set_mon_vals no callback set 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f680008d0 con 0x7f2f68054330 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f2f58003f60 con 0x7f2f68054330 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.089+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(576..576 src has 202..576) ==== 4019+0+0 (unknown 2804230665 0 0) 0x7f2f5804ed80 con 0x7f2f68054330 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.090+0000 7f2f5ffff640 10 monclient: get_auth_request con 0x7f2f3803f7e0 auth_method 0 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.092+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f2f58004480 con 0x7f2f68054330 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.092+0000 7f2f5d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:44.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.092+0000 7f2f5d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:44.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.237+0000 7f2f6eec3640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:39:44.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.237+0000 7f2f6eec3640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:39:44.234 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.237+0000 7f2f6eec3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:44.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.237+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f2f680907f0 con 0x7f2f68054330 2026-02-12T17:39:44.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.238+0000 7f2f5d7fa640 1 -- 10.20.193.57:0/1994496582 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f2f58016bf0 con 0x7f2f68054330 2026-02-12T17:39:44.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.238+0000 7f2f5d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:39:44.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.238+0000 7f2f5d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:44.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.239+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 >> v1:10.20.193.82:6800/2441377515 conn(0x7f2f3803f7e0 legacy=0x7f2f3805fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.239+0000 7f2f6eec3640 10 monclient: shutdown 2026-02-12T17:39:44.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.239+0000 7f2f6eec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:44.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.239+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 >> v1:10.20.193.57:6790/0 conn(0x7f2f68054330 legacy=0x7f2f68143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:44.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.240+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 shutdown_connections 2026-02-12T17:39:44.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.240+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 >> 10.20.193.57:0/1994496582 conn(0x7f2f680930d0 msgr2=0x7f2f681a5110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:44.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.240+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 shutdown_connections 2026-02-12T17:39:44.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:44.240+0000 7f2f6eec3640 1 -- 10.20.193.57:0/1994496582 wait complete. 2026-02-12T17:39:44.239 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.235+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.239 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.235+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=2,health=13,kv=10,logm=59} crc {auth=4146589295,config=1618278320,health=78763509,kv=547955641,logm=4064022124}) 2026-02-12T17:39:44.239 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.235+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=13,kv=11,logm=60} crc {auth=1692247138,config=1618278320,health=3224279698,kv=1466688342,logm=1562167844}) 2026-02-12T17:39:44.239 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.235+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.240 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.235+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=2,health=13,kv=10,logm=59} crc {auth=4146589295,config=1618278320,health=78763509,kv=547955641,logm=4064022124}) 2026-02-12T17:39:44.240 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.235+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=13,kv=10,logm=61} crc {auth=1919943852,config=1618278320,health=2795790017,kv=372569586,logm=246834780}) 2026-02-12T17:39:44.240 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.237+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.240 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.237+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3165892208}) 2026-02-12T17:39:44.240 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.237+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=432054094}) 2026-02-12T17:39:44.240 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.237+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.240 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.237+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3165892208}) 2026-02-12T17:39:44.240 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.237+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3249050109}) 2026-02-12T17:39:44.241 INFO:tasks.rados.rados.0.trial082.stdout:2617: done (8 left) 2026-02-12T17:39:44.241 INFO:tasks.rados.rados.0.trial082.stdout:2618: delete oid 2 current snap is 281 2026-02-12T17:39:44.241 INFO:tasks.rados.rados.0.trial082.stdout:2608: finishing write tid 3 to trial08226312-29 2026-02-12T17:39:44.241 INFO:tasks.rados.rados.0.trial082.stdout:2608: finishing write tid 4 to trial08226312-29 2026-02-12T17:39:44.242 INFO:tasks.rados.rados.0.trial082.stdout:2608: finishing write tid 5 to trial08226312-29 2026-02-12T17:39:44.242 INFO:tasks.rados.rados.0.trial082.stdout:2608: oid 29 updating version 0 to 1587 2026-02-12T17:39:44.242 INFO:tasks.rados.rados.0.trial082.stdout:2608: oid 29 version 1587 is already newer than 1585 2026-02-12T17:39:44.242 INFO:tasks.rados.rados.0.trial082.stdout:2608: oid 29 version 1587 is already newer than 1584 2026-02-12T17:39:44.242 INFO:tasks.rados.rados.0.trial082.stdout:2608: oid 29 version 1587 is already newer than 1586 2026-02-12T17:39:44.242 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 1587 (ObjNum 883 snap 281 seq_num 883) dirty exists 2026-02-12T17:39:44.242 INFO:tasks.rados.rados.0.trial082.stdout:2608: left oid 29 (ObjNum 883 snap 281 seq_num 883) 2026-02-12T17:39:44.242 INFO:tasks.rados.rados.0.trial082.stdout:2610: expect (ObjNum 816 snap 253 seq_num 816) 2026-02-12T17:39:44.246 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:39:44.272 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:44.349 INFO:tasks.rados.rados.0.trial082.stdout:2611: finishing write tid 1 to trial08226312-31 2026-02-12T17:39:44.349 INFO:tasks.rados.rados.0.trial082.stdout:2611: finishing write tid 2 to trial08226312-31 2026-02-12T17:39:44.349 INFO:tasks.rados.rados.0.trial082.stdout:2611: finishing write tid 3 to trial08226312-31 2026-02-12T17:39:44.349 INFO:tasks.rados.rados.0.trial082.stdout:2611: finishing write tid 4 to trial08226312-31 2026-02-12T17:39:44.349 INFO:tasks.rados.rados.0.trial082.stdout:2611: finishing write tid 5 to trial08226312-31 2026-02-12T17:39:44.349 INFO:tasks.rados.rados.0.trial082.stdout:2611: oid 31 updating version 0 to 1121 2026-02-12T17:39:44.349 INFO:tasks.rados.rados.0.trial082.stdout:2611: oid 31 version 1121 is already newer than 1120 2026-02-12T17:39:44.350 INFO:tasks.rados.rados.0.trial082.stdout:2611: oid 31 version 1121 is already newer than 1119 2026-02-12T17:39:44.350 INFO:tasks.rados.rados.0.trial082.stdout:2611: oid 31 updating version 1121 to 1122 2026-02-12T17:39:44.350 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 1122 (ObjNum 885 snap 281 seq_num 885) dirty exists 2026-02-12T17:39:44.350 INFO:tasks.rados.rados.0.trial082.stdout:2611: left oid 31 (ObjNum 885 snap 281 seq_num 885) 2026-02-12T17:39:44.350 INFO:tasks.rados.rados.0.trial082.stdout:2612: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:39:44.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3697605480}) 2026-02-12T17:39:44.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664955650}) 2026-02-12T17:39:44.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3697605480}) 2026-02-12T17:39:44.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2976871058}) 2026-02-12T17:39:44.417 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 891523 2026-02-12T17:39:44.441 INFO:tasks.rados.rados.0.trial082.stdout:2613: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:39:44.441 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:44.537 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2384001 2026-02-12T17:39:44.558 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.556+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.559 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.556+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1588095841}) 2026-02-12T17:39:44.559 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.556+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4180527417}) 2026-02-12T17:39:44.559 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.556+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.559 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.556+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1588095841}) 2026-02-12T17:39:44.559 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.556+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2939694697}) 2026-02-12T17:39:44.593 INFO:tasks.rados.rados.0.trial082.stdout:2614: finishing write tid 1 to trial08226312-48 2026-02-12T17:39:44.593 INFO:tasks.rados.rados.0.trial082.stdout:2614: finishing write tid 2 to trial08226312-48 2026-02-12T17:39:44.593 INFO:tasks.rados.rados.0.trial082.stdout:2608: done (8 left) 2026-02-12T17:39:44.593 INFO:tasks.rados.rados.0.trial082.stdout:2610: done (7 left) 2026-02-12T17:39:44.593 INFO:tasks.rados.rados.0.trial082.stdout:2611: done (6 left) 2026-02-12T17:39:44.593 INFO:tasks.rados.rados.0.trial082.stdout:2612: done (5 left) 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2613: done (4 left) 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2618: done (3 left) 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2619: snap_create 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2614: finishing write tid 3 to trial08226312-48 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2614: finishing write tid 4 to trial08226312-48 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2614: finishing write tid 5 to trial08226312-48 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2614: oid 48 updating version 0 to 837 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2614: oid 48 updating version 837 to 839 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2614: oid 48 version 839 is already newer than 836 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:2614: oid 48 version 839 is already newer than 838 2026-02-12T17:39:44.594 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 839 (ObjNum 886 snap 281 seq_num 886) dirty exists 2026-02-12T17:39:44.595 INFO:tasks.rados.rados.0.trial082.stdout:2614: left oid 48 (ObjNum 886 snap 281 seq_num 886) 2026-02-12T17:39:44.595 INFO:tasks.rados.rados.0.trial082.stdout:2615: expect (ObjNum 840 snap 265 seq_num 840) 2026-02-12T17:39:44.633 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1787091 2026-02-12T17:39:44.635 INFO:tasks.rados.rados.0.trial082.stdout:2616: expect (ObjNum 707 snap 212 seq_num 707) 2026-02-12T17:39:44.635 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:39:44.671 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.668+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.671 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.668+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1231182846}) 2026-02-12T17:39:44.671 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.668+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1091366679}) 2026-02-12T17:39:44.671 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.668+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.671 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.668+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1231182846}) 2026-02-12T17:39:44.672 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.668+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=999982660}) 2026-02-12T17:39:44.672 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.672 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=813659479}) 2026-02-12T17:39:44.672 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027376678}) 2026-02-12T17:39:44.672 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.672 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=813659479}) 2026-02-12T17:39:44.672 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1862181900}) 2026-02-12T17:39:44.677 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.677 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2679088012}) 2026-02-12T17:39:44.677 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562197538}) 2026-02-12T17:39:44.677 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.677 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2679088012}) 2026-02-12T17:39:44.677 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.669+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3884008177}) 2026-02-12T17:39:44.677 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.670+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.677 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.670+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=416118413}) 2026-02-12T17:39:44.677 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.670+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1344713616}) 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.670+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.670+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=416118413}) 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.670+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4137866784}) 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2779779293}) 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2346393691}) 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2779779293}) 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2838531626}) 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4170621307}) 2026-02-12T17:39:44.678 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512337171}) 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4170621307}) 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1461942050}) 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3476058519}) 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4015223393}) 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3476058519}) 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.672+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1796374986}) 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.673+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.673+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3650871283}) 2026-02-12T17:39:44.679 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.673+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=967567943}) 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.673+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.673+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3650871283}) 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.673+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1626380273}) 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.673+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.673+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=738205341}) 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.673+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4288576047}) 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.674+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.674+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=738205341}) 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.674+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2271995160}) 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.674+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.674+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1627648537}) 2026-02-12T17:39:44.680 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.674+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1307980460}) 2026-02-12T17:39:44.681 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.674+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.681 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.674+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1627648537}) 2026-02-12T17:39:44.681 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.674+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2880765663}) 2026-02-12T17:39:44.681 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.681 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=23989590}) 2026-02-12T17:39:44.681 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1356039311}) 2026-02-12T17:39:44.681 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.681 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=23989590}) 2026-02-12T17:39:44.681 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3431880438}) 2026-02-12T17:39:44.689 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.689 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2426423193}) 2026-02-12T17:39:44.689 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=268573368}) 2026-02-12T17:39:44.689 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2426423193}) 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.675+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2524224566}) 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.676+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.676+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3104881279}) 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.676+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1974671672}) 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.676+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.676+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3104881279}) 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.676+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=292889264}) 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1833297432}) 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4144890518}) 2026-02-12T17:39:44.690 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1833297432}) 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3499883328}) 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1761216687}) 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=353795371}) 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1761216687}) 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.677+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2698178330}) 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.678+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.678+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1886096927}) 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.678+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2089205267}) 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.678+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.691 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.678+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1886096927}) 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.678+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4287274536}) 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3973386373}) 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856457712}) 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3973386373}) 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3541708709}) 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1484577556}) 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=99432464}) 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1484577556}) 2026-02-12T17:39:44.692 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.679+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2888974965}) 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=882539471}) 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3450127841}) 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=882539471}) 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2707215090}) 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1720774022}) 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2472541951}) 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1720774022}) 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.680+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1309212079}) 2026-02-12T17:39:44.693 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.681+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.681+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=426470692}) 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.681+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3488983932}) 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.681+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.681+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=426470692}) 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.681+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1447927792}) 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=92,mdsmap=3,mgr=5} crc {logm=952326467,mdsmap=2204869053,mgr=2437184467}) 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=88,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1} crc {logm=2523449919,mdsmap=2204869053,mgr=1659003414,mgr_command_descs=714296370,mgr_metadata=283970154}) 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=92,mdsmap=3,mgr=5} crc {logm=952326467,mdsmap=2204869053,mgr=2437184467}) 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=558121083,mdsmap=2204869053,mgr=4223574758,mgr_command_descs=714296370}) 2026-02-12T17:39:44.694 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr=1,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=65} crc {mgr=1747058506,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3473024434,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2184513372,osd_snap=3642854804}) 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=62} crc {mgr=2586702516,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=1976008356,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2184513372,osd_snap=3176513858}) 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr=1,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=65} crc {mgr=1747058506,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3473024434,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2184513372,osd_snap=3642854804}) 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.682+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=63} crc {mgr=575665002,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=1427956034,mon_config_key=325234814,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2184513372,osd_snap=732985689}) 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=33,osdmap=67} crc {osd_snap=3462934809,osdmap=1397114632}) 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=30,osdmap=70} crc {osd_snap=3141334424,osdmap=2825196010}) 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=33,osdmap=67} crc {osd_snap=3462934809,osdmap=1397114632}) 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=33,osdmap=67} crc {osd_snap=1489387582,osdmap=3470539619}) 2026-02-12T17:39:44.695 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1053871171}) 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1192932899}) 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1053871171}) 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.683+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=898149965}) 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.684+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.684+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=652505953}) 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.684+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2543460125}) 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.684+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.684+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=652505953}) 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.684+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2933350372}) 2026-02-12T17:39:44.696 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.684+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.684+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2525827815}) 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.684+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1437718560}) 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.685+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.685+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2525827815}) 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.685+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2821401232}) 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.685+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.685+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3415361761}) 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.685+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=893533660}) 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.685+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.685+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3415361761}) 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.685+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=991200210}) 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.686+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.697 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.686+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=94} crc {osdmap=2284453954}) 2026-02-12T17:39:44.698 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.686+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=91} crc {osdmap=3924785598}) 2026-02-12T17:39:44.698 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.686+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:39:44.698 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.686+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=94} crc {osdmap=2284453954}) 2026-02-12T17:39:44.698 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:39:44.686+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=92} crc {osdmap=1016511271}) 2026-02-12T17:39:44.750 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2026120 2026-02-12T17:39:45.243 INFO:tasks.rados.rados.0.trial082.stdout:2614: done (3 left) 2026-02-12T17:39:45.243 INFO:tasks.rados.rados.0.trial082.stdout:2615: done (2 left) 2026-02-12T17:39:45.243 INFO:tasks.rados.rados.0.trial082.stdout:2616: done (1 left) 2026-02-12T17:39:45.243 INFO:tasks.rados.rados.0.trial082.stdout:2619: done (0 left) 2026-02-12T17:39:45.244 INFO:tasks.rados.rados.0.trial082.stdout:2620: write (excl) oid 2 current snap is 282 2026-02-12T17:39:45.244 INFO:tasks.rados.rados.0.trial082.stdout:2620: seq_num 888 ranges {524616=718060,1664010=523975,2752794=171822} 2026-02-12T17:39:45.247 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:39:45.247 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:39:45.248 INFO:tasks.rados.rados.0.trial082.stdout:2620: writing trial08226312-2 from 524616 to 1242676 tid 1 2026-02-12T17:39:45.251 INFO:tasks.rados.rados.0.trial082.stdout:2620: writing trial08226312-2 from 1664010 to 2187985 tid 2 2026-02-12T17:39:45.254 INFO:tasks.rados.rados.0.trial082.stdout:2620: writing trial08226312-2 from 2752794 to 2924616 tid 3 2026-02-12T17:39:45.254 INFO:tasks.rados.rados.0.trial082.stdout:2621: delete oid 17 current snap is 282 2026-02-12T17:39:45.254 INFO:tasks.rados.rados.0.trial082.stdout:2620: finishing write tid 1 to trial08226312-2 2026-02-12T17:39:45.254 INFO:tasks.rados.rados.0.trial082.stdout:2620: finishing write tid 2 to trial08226312-2 2026-02-12T17:39:45.255 INFO:tasks.rados.rados.0.trial082.stdout:2620: finishing write tid 3 to trial08226312-2 2026-02-12T17:39:45.255 INFO:tasks.rados.rados.0.trial082.stdout:2620: finishing write tid 4 to trial08226312-2 2026-02-12T17:39:45.255 INFO:tasks.rados.rados.0.trial082.stdout:2620: finishing write tid 5 to trial08226312-2 2026-02-12T17:39:45.255 INFO:tasks.rados.rados.0.trial082.stdout:2620: oid 2 updating version 0 to 956 2026-02-12T17:39:45.255 INFO:tasks.rados.rados.0.trial082.stdout:2620: oid 2 version 956 is already newer than 953 2026-02-12T17:39:45.256 INFO:tasks.rados.rados.0.trial082.stdout:2620: oid 2 version 956 is already newer than 955 2026-02-12T17:39:45.256 INFO:tasks.rados.rados.0.trial082.stdout:2620: oid 2 version 956 is already newer than 954 2026-02-12T17:39:45.256 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 956 (ObjNum 888 snap 282 seq_num 888) dirty exists 2026-02-12T17:39:45.256 INFO:tasks.rados.rados.0.trial082.stdout:2620: left oid 2 (ObjNum 888 snap 282 seq_num 888) 2026-02-12T17:39:45.256 INFO:tasks.rados.rados.0.trial082.stdout:2620: done (1 left) 2026-02-12T17:39:45.256 INFO:tasks.rados.rados.0.trial082.stdout:2621: done (0 left) 2026-02-12T17:39:45.256 INFO:tasks.rados.rados.0.trial082.stdout:2622: snap_remove snap 270 2026-02-12T17:39:45.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.314+0000 7ff35a8cc640 10 monclient: get_monmap_and_config 2026-02-12T17:39:45.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.314+0000 7ff35a8cc640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.311 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.314+0000 7ff35a8cc640 10 monclient: monmap: 2026-02-12T17:39:45.311 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.312 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.312 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:45.315430+0000 2026-02-12T17:39:45.312 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:45.315430+0000 2026-02-12T17:39:45.312 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.312 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.312 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.312 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:45.312 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:45.312 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 1 Processor -- start 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 1 -- start start 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 10 monclient: init 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff35408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff35408cc80 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff3541852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35408d600 con 0x7ff3541852d0 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff354089770 con 0x7ff35408cc80 2026-02-12T17:39:45.314 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35408b1f0 con 0x7ff35408ae20 2026-02-12T17:39:45.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff35a8cc640 10 monclient(hunting): authenticate will time out at 1265.134550s 2026-02-12T17:39:45.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff353fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ff35408ae20 0x7ff35408c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40908/0 (socket says 10.20.193.57:40908) 2026-02-12T17:39:45.315 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.315+0000 7ff353fff640 1 -- 10.20.193.57:0/1850291020 learned_addr learned my addr 10.20.193.57:0/1850291020 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.322 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff358e42640 1 -- 10.20.193.57:0/1850291020 >> v1:10.20.193.57:6789/0 conn(0x7ff3541852d0 legacy=0x7ff3541a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff353fff640 1 -- 10.20.193.57:0/1850291020 >> v1:10.20.193.57:6790/0 conn(0x7ff35408ae20 legacy=0x7ff35408c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2843279221 0 0) 0x7ff35408d600 con 0x7ff3541852d0 2026-02-12T17:39:45.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 10 monclient(hunting): my global_id is 74199 2026-02-12T17:39:45.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3380035e0 con 0x7ff3541852d0 2026-02-12T17:39:45.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569388697 0 0) 0x7ff35408b1f0 con 0x7ff35408ae20 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 10 monclient(hunting): my global_id is 84125 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff3537fe640 1 -- 10.20.193.57:0/1850291020 >> v1:10.20.193.82:6789/0 conn(0x7ff35408cc80 legacy=0x7ff354183bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.317+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff35408d600 con 0x7ff35408ae20 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1114275822 0 0) 0x7ff3380035e0 con 0x7ff3541852d0 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 >> v1:10.20.193.57:6790/0 conn(0x7ff35408ae20 legacy=0x7ff35408c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 >> v1:10.20.193.82:6789/0 conn(0x7ff35408cc80 legacy=0x7ff354183bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.324 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 1 monclient: found mon.noname-a 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35408c020 con 0x7ff3541852d0 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff348004280 con 0x7ff3541852d0 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 5 monclient: authenticate success, global_id 74199 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.325 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: dump: 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.326 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff348004450 con 0x7ff3541852d0 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 1 -- 10.20.193.57:0/1850291020 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff348004630 con 0x7ff3541852d0 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 4 set_mon_vals no callback set 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff352ffd640 10 monclient: dump: 2026-02-12T17:39:45.327 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 10 monclient: shutdown 2026-02-12T17:39:45.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 1 -- 10.20.193.57:0/1850291020 >> v1:10.20.193.57:6789/0 conn(0x7ff3541852d0 legacy=0x7ff3541a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 1 -- 10.20.193.57:0/1850291020 shutdown_connections 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 1 -- 10.20.193.57:0/1850291020 >> 10.20.193.57:0/1850291020 conn(0x7ff354091620 msgr2=0x7ff354091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 1 -- 10.20.193.57:0/1850291020 shutdown_connections 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 1 -- 10.20.193.57:0/1850291020 wait complete. 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.318+0000 7ff35a8cc640 10 monclient: monmap: 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:45.329 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 1 Processor -- start 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 1 -- start start 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 10 monclient: init 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff35408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff35408cc80 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff3541852d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff354086f60 con 0x7ff35408ae20 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff354083560 con 0x7ff3541852d0 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3540805b0 con 0x7ff35408cc80 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff35a8cc640 10 monclient(hunting): authenticate will time out at 1265.138473s 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff353fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff35408ae20 0x7ff35407f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51596/0 (socket says 10.20.193.57:51596) 2026-02-12T17:39:45.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.319+0000 7ff353fff640 1 -- 10.20.193.57:0/69663116 learned_addr learned my addr 10.20.193.57:0/69663116 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff353fff640 1 -- 10.20.193.57:0/69663116 >> v1:10.20.193.57:6789/0 conn(0x7ff35408ae20 legacy=0x7ff35407f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff3537fe640 1 -- 10.20.193.57:0/69663116 >> v1:10.20.193.57:6790/0 conn(0x7ff35408cc80 legacy=0x7ff35407fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719458375 0 0) 0x7ff354086f60 con 0x7ff35408ae20 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): my global_id is 74202 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3240035e0 con 0x7ff35408ae20 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179088383 0 0) 0x7ff3540805b0 con 0x7ff35408cc80 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): my global_id is 84128 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff354086f60 con 0x7ff35408cc80 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 144220299 0 0) 0x7ff3240035e0 con 0x7ff35408ae20 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3540805b0 con 0x7ff35408ae20 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff340003350 con 0x7ff35408ae20 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): dump: 2026-02-12T17:39:45.333 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff350ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:45.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.321+0000 7ff358e42640 1 -- 10.20.193.57:0/69663116 >> v1:10.20.193.82:6789/0 conn(0x7ff3541852d0 legacy=0x7ff3541849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4072307710 0 0) 0x7ff3540805b0 con 0x7ff35408ae20 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 >> v1:10.20.193.57:6790/0 conn(0x7ff35408cc80 legacy=0x7ff35407fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 >> v1:10.20.193.82:6789/0 conn(0x7ff3541852d0 legacy=0x7ff3541849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 1 monclient: found mon.a 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35405e480 con 0x7ff35408ae20 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 5 monclient: authenticate success, global_id 74202 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 10 monclient: _renew_subs 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff354088810 con 0x7ff35408ae20 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 10 monclient: _renew_subs 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff3540826f0 con 0x7ff35408ae20 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff340004b50 con 0x7ff35408ae20 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff340004ea0 con 0x7ff35408ae20 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 10 monclient: dump: 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.337 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff3527fc640 4 set_mon_vals no callback set 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff354081200 con 0x7ff35408ae20 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff3400050f0 con 0x7ff35408ae20 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.322+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(578..578 src has 202..578) ==== 3947+0+0 (unknown 2274444407 0 0) 0x7ff34004ebb0 con 0x7ff35408ae20 2026-02-12T17:39:45.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.323+0000 7ff3537fe640 10 monclient: get_auth_request con 0x7ff32403f740 auth_method 0 2026-02-12T17:39:45.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.325+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff3400172c0 con 0x7ff35408ae20 2026-02-12T17:39:45.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.325+0000 7ff350ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.325+0000 7ff350ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:45.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.468+0000 7ff35a8cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:39:45.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.468+0000 7ff35a8cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:39:45.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.468+0000 7ff35a8cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.468+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff354055340 con 0x7ff35408ae20 2026-02-12T17:39:45.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.469+0000 7ff350ff9640 1 -- 10.20.193.57:0/69663116 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 1425343799) 0x7ff340016a70 con 0x7ff35408ae20 2026-02-12T17:39:45.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.469+0000 7ff350ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:39:45.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.469+0000 7ff350ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:45.467 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:39:45.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.470+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff32403f740 legacy=0x7ff32405fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.470+0000 7ff35a8cc640 10 monclient: shutdown 2026-02-12T17:39:45.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.470+0000 7ff35a8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:45.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.470+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 >> v1:10.20.193.57:6789/0 conn(0x7ff35408ae20 legacy=0x7ff35407f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.470+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 shutdown_connections 2026-02-12T17:39:45.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.470+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 >> 10.20.193.57:0/69663116 conn(0x7ff354091620 msgr2=0x7ff3541a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:45.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.470+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 shutdown_connections 2026-02-12T17:39:45.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.470+0000 7ff35a8cc640 1 -- 10.20.193.57:0/69663116 wait complete. 2026-02-12T17:39:45.474 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:39:45.474 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:39:45.474 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:39:45.475 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:39:45.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.543+0000 7f52f02cc640 10 monclient: get_monmap_and_config 2026-02-12T17:39:45.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.543+0000 7f52f02cc640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.541 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.543+0000 7f52f02cc640 10 monclient: monmap: 2026-02-12T17:39:45.541 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.541 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.541 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:45.544617+0000 2026-02-12T17:39:45.541 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:45.544617+0000 2026-02-12T17:39:45.541 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.542 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.542 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.542 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:45.542 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:45.542 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 1 Processor -- start 2026-02-12T17:39:45.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 1 -- start start 2026-02-12T17:39:45.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 10 monclient: init 2026-02-12T17:39:45.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:39:45.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 10 monclient(hunting): picked mon.noname-c con 0x7f52e808c480 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 10 monclient(hunting): picked mon.noname-b con 0x7f52e808c850 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.552 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 10 monclient(hunting): picked mon.noname-a con 0x7f52e8184e60 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e805d510 con 0x7f52e8184e60 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e808d670 con 0x7f52e808c480 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e805cec0 con 0x7f52e808c850 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52f02cc640 10 monclient(hunting): authenticate will time out at 1265.363559s 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52ed840640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f52e808c850 0x7f52e808ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40914/0 (socket says 10.20.193.57:40914) 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.544+0000 7f52ed840640 1 -- 10.20.193.57:0/201430310 learned_addr learned my addr 10.20.193.57:0/201430310 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.546+0000 7f52ed840640 1 -- 10.20.193.57:0/201430310 >> v1:10.20.193.57:6790/0 conn(0x7f52e808c850 legacy=0x7f52e808ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.546+0000 7f52ee842640 1 -- 10.20.193.57:0/201430310 >> v1:10.20.193.57:6789/0 conn(0x7f52e8184e60 legacy=0x7f52e81a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.546+0000 7f52ed03f640 1 -- 10.20.193.57:0/201430310 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775105254 0 0) 0x7f52e805cec0 con 0x7f52e808c850 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.546+0000 7f52ed03f640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.553 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.546+0000 7f52ed03f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.546+0000 7f52ed03f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.546+0000 7f52ed03f640 10 monclient(hunting): my global_id is 84131 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.546+0000 7f52ed03f640 1 -- 10.20.193.57:0/201430310 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52d00035e0 con 0x7f52e808c850 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.546+0000 7f52ee041640 1 -- 10.20.193.57:0/201430310 >> v1:10.20.193.82:6789/0 conn(0x7f52e808c480 legacy=0x7f52e805db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 1 -- 10.20.193.57:0/201430310 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 893122216 0 0) 0x7f52d00035e0 con 0x7f52e808c850 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 1 -- 10.20.193.57:0/201430310 >> v1:10.20.193.82:6789/0 conn(0x7f52e808c480 legacy=0x7f52e805db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 1 -- 10.20.193.57:0/201430310 >> v1:10.20.193.57:6789/0 conn(0x7f52e8184e60 legacy=0x7f52e81a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 1 monclient: found mon.noname-b 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.554 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 1 -- 10.20.193.57:0/201430310 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e805d1a0 con 0x7f52e808c850 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 1 -- 10.20.193.57:0/201430310 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52dc0030d0 con 0x7f52e808c850 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: dump: 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.555 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 5 monclient: authenticate success, global_id 84131 2026-02-12T17:39:45.556 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 1 -- 10.20.193.57:0/201430310 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52dc0033d0 con 0x7f52e808c850 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 1 -- 10.20.193.57:0/201430310 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52dc004b10 con 0x7f52e808c850 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52ed03f640 10 monclient: dump: 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.557 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 4 set_mon_vals no callback set 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 10 monclient: shutdown 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 1 -- 10.20.193.57:0/201430310 >> v1:10.20.193.57:6790/0 conn(0x7f52e808c850 legacy=0x7f52e808ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 1 -- 10.20.193.57:0/201430310 shutdown_connections 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 1 -- 10.20.193.57:0/201430310 >> 10.20.193.57:0/201430310 conn(0x7f52e8054cd0 msgr2=0x7f52e8091a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 1 -- 10.20.193.57:0/201430310 shutdown_connections 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.547+0000 7f52f02cc640 1 -- 10.20.193.57:0/201430310 wait complete. 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient: monmap: 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.559 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 1 Processor -- start 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 1 -- start start 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient: init 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient(hunting): picked mon.noname-a con 0x7f52e808c480 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient(hunting): picked mon.noname-b con 0x7f52e808c850 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient(hunting): picked mon.noname-c con 0x7f52e8184e60 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e808b790 con 0x7f52e808c480 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e8080370 con 0x7f52e808c850 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e8082360 con 0x7f52e8184e60 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52f02cc640 10 monclient(hunting): authenticate will time out at 1265.367498s 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52ee041640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f52e808c480 0x7f52e8084db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51602/0 (socket says 10.20.193.57:51602) 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.548+0000 7f52ee041640 1 -- 10.20.193.57:0/3421313881 learned_addr learned my addr 10.20.193.57:0/3421313881 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ee041640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6789/0 conn(0x7f52e808c480 legacy=0x7f52e8084db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ee842640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6790/0 conn(0x7f52e8184e60 legacy=0x7f52e8184560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122416712 0 0) 0x7f52e8082360 con 0x7f52e8184e60 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 10 monclient(hunting): my global_id is 84134 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52b80035e0 con 0x7f52e8184e60 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444281992 0 0) 0x7f52e808b790 con 0x7f52e808c480 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 10 monclient(hunting): my global_id is 74205 2026-02-12T17:39:45.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e8082360 con 0x7f52e808c480 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.550+0000 7f52ed840640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.82:6789/0 conn(0x7f52e808c850 legacy=0x7f52e8183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2920093657 0 0) 0x7f52b80035e0 con 0x7f52e8184e60 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52e808b790 con 0x7f52e8184e60 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52e4004420 con 0x7f52e8184e60 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): dump: 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.563 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1081837238 0 0) 0x7f52e8082360 con 0x7f52e808c480 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52b80035e0 con 0x7f52e808c480 2026-02-12T17:39:45.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52d80033e0 con 0x7f52e808c480 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): dump: 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.565 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780909557 0 0) 0x7f52e8080370 con 0x7f52e808c850 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient(hunting): my global_id is 4969 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e8082360 con 0x7f52e808c850 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 551566210 0 0) 0x7f52e808b790 con 0x7f52e8184e60 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.82:6789/0 conn(0x7f52e808c850 legacy=0x7f52e8183e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6789/0 conn(0x7f52e808c480 legacy=0x7f52e8084db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 monclient: found mon.c 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e80820a0 con 0x7f52e8184e60 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52f02cc640 5 monclient: authenticate success, global_id 84134 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52f02cc640 10 monclient: _renew_subs 2026-02-12T17:39:45.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52f02cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f52e8184cd0 con 0x7f52e8184e60 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52f02cc640 10 monclient: _renew_subs 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52f02cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f52e8082640 con 0x7f52e8184e60 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52e4004600 con 0x7f52e8184e60 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52e4004c10 con 0x7f52e8184e60 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:45.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 10 monclient: dump: 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ec83e640 4 set_mon_vals no callback set 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52f02cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f52e8090c10 con 0x7f52e807a360 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f52e4004db0 con 0x7f52e8184e60 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.551+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(578..578 src has 202..578) ==== 3947+0+0 (unknown 2274444407 0 0) 0x7f52e404fbf0 con 0x7f52e8184e60 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.552+0000 7f52ed840640 10 monclient: get_auth_request con 0x7f52b803fd10 auth_method 0 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.553+0000 7f52ee041640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6789/0 conn(0x7f52e807a360 legacy=0x7f52e807a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.553+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 140944486 0 0) 0x7f52e8090c10 con 0x7f52e807a360 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.553+0000 7f52ceffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.553+0000 7f52ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.553+0000 7f52ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.553+0000 7f52ceffd640 10 monclient(hunting): my global_id is 74208 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.553+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e808b790 con 0x7f52e807a360 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1824400190 0 0) 0x7f52e808b790 con 0x7f52e807a360 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52e8090c10 con 0x7f52e807a360 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52d8003b00 con 0x7f52e807a360 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 10 monclient: dump: 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.571 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3463880123 0 0) 0x7f52e8090c10 con 0x7f52e807a360 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52e81a6960 con 0x7f52e807a360 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f52d8003fc0 con 0x7f52e807a360 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:45.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6789/0 conn(0x7f52e807a360 legacy=0x7f52e807a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.554+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6789/0 conn(0x7f52e807a360 legacy=0x7f52e807a730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.557+0000 7f52f02cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.557+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f52e808f980 con 0x7f52e807ae40 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ee041640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6789/0 conn(0x7f52e807ae40 legacy=0x7f52e8187250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1356079410 0 0) 0x7f52e808f980 con 0x7f52e807ae40 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 10 monclient(hunting): my global_id is 74211 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e8090c10 con 0x7f52e807ae40 2026-02-12T17:39:45.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2095843764 0 0) 0x7f52e8090c10 con 0x7f52e807ae40 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52e808f980 con 0x7f52e807ae40 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52d8004560 con 0x7f52e807ae40 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 10 monclient: dump: 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.576 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1515981936 0 0) 0x7f52e808f980 con 0x7f52e807ae40 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f52e8062cf0 con 0x7f52e807ae40 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 122464892) 0x7f52d8007a30 con 0x7f52e807ae40 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6789/0 conn(0x7f52e807ae40 legacy=0x7f52e8187250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.577 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ceffd640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6789/0 conn(0x7f52e807ae40 legacy=0x7f52e8187250 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 46, 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 112023, 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:39:45.578 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:45.579 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:45.580 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:39:45.581 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:45.582 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.583 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:39:45.584 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:45.585 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.586 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.587 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:45.588 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.589 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.589 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.589 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:39:45.589 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:39:45.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.82:6800/2441377515 conn(0x7f52b803fd10 legacy=0x7f52b80601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52f02cc640 10 monclient: shutdown 2026-02-12T17:39:45.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52f02cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:45.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 >> v1:10.20.193.57:6790/0 conn(0x7f52e8184e60 legacy=0x7f52e8184560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ee842640 1 -- 10.20.193.57:0/3421313881 reap_dead start 2026-02-12T17:39:45.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52ee842640 1 -- 10.20.193.57:0/3421313881 reap_dead start 2026-02-12T17:39:45.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 shutdown_connections 2026-02-12T17:39:45.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 >> 10.20.193.57:0/3421313881 conn(0x7f52e8054cd0 msgr2=0x7f52e8086360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:45.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 shutdown_connections 2026-02-12T17:39:45.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.560+0000 7f52f02cc640 1 -- 10.20.193.57:0/3421313881 wait complete. 2026-02-12T17:39:45.591 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:39:45.591 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:39:45.591 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:39:45.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.659+0000 7f63b2caf640 10 monclient: get_monmap_and_config 2026-02-12T17:39:45.657 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.659+0000 7f63b2caf640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.659+0000 7f63b2caf640 10 monclient: monmap: 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:45.660290+0000 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:45.660290+0000 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.659+0000 7f63b2caf640 1 Processor -- start 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.659+0000 7f63b2caf640 1 -- start start 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.659+0000 7f63b2caf640 10 monclient: init 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:39:45.658 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 10 monclient(hunting): picked mon.noname-c con 0x7f63ac08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 10 monclient(hunting): picked mon.noname-a con 0x7f63ac08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 10 monclient(hunting): picked mon.noname-b con 0x7f63ac182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac08a820 con 0x7f63ac08c620 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac089450 con 0x7f63ac08c250 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac089730 con 0x7f63ac182cc0 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b2caf640 10 monclient(hunting): authenticate will time out at 1265.479184s 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63a3fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f63ac08c620 0x7f63ac08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51636/0 (socket says 10.20.193.57:51636) 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63b1225640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f63ac182cc0 0x7f63ac1a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40926/0 (socket says 10.20.193.57:40926) 2026-02-12T17:39:45.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.660+0000 7f63a3fff640 1 -- 10.20.193.57:0/4154551244 learned_addr learned my addr 10.20.193.57:0/4154551244 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a3fff640 1 -- 10.20.193.57:0/4154551244 >> v1:10.20.193.57:6789/0 conn(0x7f63ac08c620 legacy=0x7f63ac08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63b1225640 1 -- 10.20.193.57:0/4154551244 >> v1:10.20.193.57:6790/0 conn(0x7f63ac182cc0 legacy=0x7f63ac1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291083183 0 0) 0x7f6394002c20 con 0x7f63ac08c620 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient(hunting): my global_id is 74214 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63980035e0 con 0x7f63ac08c620 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654694752 0 0) 0x7f63ac089730 con 0x7f63ac182cc0 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient(hunting): my global_id is 84137 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6394002c20 con 0x7f63ac182cc0 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63b0a24640 1 -- 10.20.193.57:0/4154551244 >> v1:10.20.193.82:6789/0 conn(0x7f63ac08c250 legacy=0x7f63ac08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2460280380 0 0) 0x7f63980035e0 con 0x7f63ac08c620 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 >> v1:10.20.193.57:6790/0 conn(0x7f63ac182cc0 legacy=0x7f63ac1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 >> v1:10.20.193.82:6789/0 conn(0x7f63ac08c250 legacy=0x7f63ac08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 monclient: found mon.noname-a 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac089a10 con 0x7f63ac08c620 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6394003260 con 0x7f63ac08c620 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63b2caf640 5 monclient: authenticate success, global_id 74214 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: dump: 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63b2caf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6394004960 con 0x7f63ac08c620 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 1 -- 10.20.193.57:0/4154551244 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6394004cb0 con 0x7f63ac08c620 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63b2caf640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63b2caf640 4 set_mon_vals no callback set 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.662+0000 7f63a37fe640 10 monclient: dump: 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient: shutdown 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:45.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 -- 10.20.193.57:0/4154551244 >> v1:10.20.193.57:6789/0 conn(0x7f63ac08c620 legacy=0x7f63ac08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 -- 10.20.193.57:0/4154551244 shutdown_connections 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 -- 10.20.193.57:0/4154551244 >> 10.20.193.57:0/4154551244 conn(0x7f63ac0916b0 msgr2=0x7f63ac091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 -- 10.20.193.57:0/4154551244 shutdown_connections 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 -- 10.20.193.57:0/4154551244 wait complete. 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient: monmap: 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 Processor -- start 2026-02-12T17:39:45.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 -- start start 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient: init 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient(hunting): picked mon.noname-c con 0x7f63ac08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient(hunting): picked mon.noname-b con 0x7f63ac08c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient(hunting): picked mon.noname-a con 0x7f63ac182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac0888a0 con 0x7f63ac182cc0 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac138730 con 0x7f63ac08c620 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac138a10 con 0x7f63ac08c250 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.663+0000 7f63b2caf640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.664+0000 7f63b2caf640 10 monclient(hunting): authenticate will time out at 1265.483002s 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.664+0000 7f63b0a24640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f63ac08c250 0x7f63ac05c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40932/0 (socket says 10.20.193.57:40932) 2026-02-12T17:39:45.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.664+0000 7f63b0a24640 1 -- 10.20.193.57:0/544502058 learned_addr learned my addr 10.20.193.57:0/544502058 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63b1225640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6789/0 conn(0x7f63ac182cc0 legacy=0x7f63ac195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63b0a24640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6790/0 conn(0x7f63ac08c250 legacy=0x7f63ac05c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615022616 0 0) 0x7f63ac138a10 con 0x7f63ac08c250 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): my global_id is 84140 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f637c0035e0 con 0x7f63ac08c250 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2499450207 0 0) 0x7f63ac0888a0 con 0x7f63ac182cc0 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): my global_id is 74217 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63ac138a10 con 0x7f63ac182cc0 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 224924268 0 0) 0x7f637c0035e0 con 0x7f63ac08c250 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63ac0888a0 con 0x7f63ac08c250 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 483003910 0 0) 0x7f63ac138a10 con 0x7f63ac182cc0 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f637c0035e0 con 0x7f63ac182cc0 2026-02-12T17:39:45.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f639c0033e0 con 0x7f63ac08c250 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): dump: 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:45.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f63a8004440 con 0x7f63ac182cc0 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient(hunting): dump: 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 507846175 0 0) 0x7f637c0035e0 con 0x7f63ac182cc0 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a3fff640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.82:6789/0 conn(0x7f63ac08c620 legacy=0x7f63ac05d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6790/0 conn(0x7f63ac08c250 legacy=0x7f63ac05c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.82:6789/0 conn(0x7f63ac08c620 legacy=0x7f63ac05d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 monclient: found mon.a 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac05d7c0 con 0x7f63ac182cc0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63b2caf640 5 monclient: authenticate success, global_id 74217 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63b2caf640 10 monclient: _renew_subs 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63b2caf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63ac136ff0 con 0x7f63ac182cc0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63b2caf640 10 monclient: _renew_subs 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63b2caf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f63ac136b10 con 0x7f63ac182cc0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63a80045e0 con 0x7f63ac182cc0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f63a8005de0 con 0x7f63ac182cc0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a17fa640 10 monclient: dump: 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.666+0000 7f63a2ffd640 4 set_mon_vals no callback set 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.667+0000 7f63b2caf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.667+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f63ac090810 con 0x7f63ac13e6e0 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.667+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f63a8005f80 con 0x7f63ac182cc0 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.667+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(578..578 src has 202..578) ==== 3947+0+0 (unknown 2274444407 0 0) 0x7f63a804fc00 con 0x7f63ac182cc0 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.667+0000 7f63a3fff640 10 monclient: get_auth_request con 0x7f637c03fa60 auth_method 0 2026-02-12T17:39:45.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63b0a24640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6790/0 conn(0x7f63ac13e6e0 legacy=0x7f63ac086730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507764091 0 0) 0x7f63ac090810 con 0x7f63ac13e6e0 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 10 monclient(hunting): my global_id is 84143 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f637c0035e0 con 0x7f63ac13e6e0 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2157825496 0 0) 0x7f637c0035e0 con 0x7f63ac13e6e0 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63ac090810 con 0x7f63ac13e6e0 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f639c003dc0 con 0x7f63ac13e6e0 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 10 monclient: dump: 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.676 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4081795526 0 0) 0x7f63ac090810 con 0x7f63ac13e6e0 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.669+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63ac08f5b0 con 0x7f63ac13e6e0 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.670+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f639c004380 con 0x7f63ac13e6e0 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.670+0000 7f63a17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.670+0000 7f63a17fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.670+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6790/0 conn(0x7f63ac13e6e0 legacy=0x7f63ac086730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.670+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6790/0 conn(0x7f63ac13e6e0 legacy=0x7f63ac086730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.673+0000 7f63b2caf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:39:45.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.673+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f63ac0851b0 con 0x7f63ac084db0 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63b0a24640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6790/0 conn(0x7f63ac084db0 legacy=0x7f63ac086e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917981709 0 0) 0x7f63ac089450 con 0x7f63ac084db0 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 10 monclient(hunting): my global_id is 84146 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63ac090810 con 0x7f63ac084db0 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3565801637 0 0) 0x7f63ac090810 con 0x7f63ac084db0 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63ac089450 con 0x7f63ac084db0 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f639c004590 con 0x7f63ac084db0 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 10 monclient: dump: 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.679 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3274071753 0 0) 0x7f63ac089450 con 0x7f63ac084db0 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.675+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f63ac087550 con 0x7f63ac084db0 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4336 (unknown 0 0 1208680163) 0x7f639c005fc0 con 0x7f63ac084db0 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63a17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63a17fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6790/0 conn(0x7f63ac084db0 legacy=0x7f63ac086e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63a17fa640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6790/0 conn(0x7f63ac084db0 legacy=0x7f63ac086e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:45.680 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 46, 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 2167, 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:39:45.681 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:45.682 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:39:45.683 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:45.684 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:39:45.685 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:39:45.686 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:45.687 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:45.688 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:39:45.689 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:39:45.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.82:6800/2441377515 conn(0x7f637c03fa60 legacy=0x7f637c05ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b2caf640 10 monclient: shutdown 2026-02-12T17:39:45.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b2caf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:45.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 >> v1:10.20.193.57:6789/0 conn(0x7f63ac182cc0 legacy=0x7f63ac195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b1225640 1 -- 10.20.193.57:0/544502058 reap_dead start 2026-02-12T17:39:45.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b1225640 1 -- 10.20.193.57:0/544502058 reap_dead start 2026-02-12T17:39:45.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 shutdown_connections 2026-02-12T17:39:45.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 >> 10.20.193.57:0/544502058 conn(0x7f63ac0916b0 msgr2=0x7f63ac08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:45.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 shutdown_connections 2026-02-12T17:39:45.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.676+0000 7f63b2caf640 1 -- 10.20.193.57:0/544502058 wait complete. 2026-02-12T17:39:45.691 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:39:45.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:39:45.691 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:39:45.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient: get_monmap_and_config 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient: monmap: 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:45.760890+0000 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:45.760890+0000 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 1 Processor -- start 2026-02-12T17:39:45.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 1 -- start start 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient: init 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient(hunting): picked mon.noname-c con 0x7f9e0c08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient(hunting): picked mon.noname-a con 0x7f9e0c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient(hunting): picked mon.noname-b con 0x7f9e0c182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0c08a820 con 0x7f9e0c08c620 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0c089450 con 0x7f9e0c08c250 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0c089730 con 0x7f9e0c182cc0 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e1405b640 10 monclient(hunting): authenticate will time out at 1265.579766s 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e115cf640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f9e0c08c620 0x7f9e0c08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51656/0 (socket says 10.20.193.57:51656) 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e125d1640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f9e0c182cc0 0x7f9e0c1a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40972/0 (socket says 10.20.193.57:40972) 2026-02-12T17:39:45.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.760+0000 7f9e115cf640 1 -- 10.20.193.57:0/1023367337 learned_addr learned my addr 10.20.193.57:0/1023367337 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.762+0000 7f9e115cf640 1 -- 10.20.193.57:0/1023367337 >> v1:10.20.193.57:6789/0 conn(0x7f9e0c08c620 legacy=0x7f9e0c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e125d1640 1 -- 10.20.193.57:0/1023367337 >> v1:10.20.193.57:6790/0 conn(0x7f9e0c182cc0 legacy=0x7f9e0c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e11dd0640 1 -- 10.20.193.57:0/1023367337 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c08c250 legacy=0x7f9e0c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1305350279 0 0) 0x7f9e00002c20 con 0x7f9e0c08c620 2026-02-12T17:39:45.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): my global_id is 74220 2026-02-12T17:39:45.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9df40035e0 con 0x7f9e0c08c620 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228165081 0 0) 0x7f9e0c089730 con 0x7f9e0c182cc0 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): my global_id is 84149 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e00002c20 con 0x7f9e0c182cc0 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459716277 0 0) 0x7f9e0c089450 con 0x7f9e0c08c250 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient(hunting): my global_id is 4975 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e0c089730 con 0x7f9e0c08c250 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1331640666 0 0) 0x7f9df40035e0 con 0x7f9e0c08c620 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 >> v1:10.20.193.57:6790/0 conn(0x7f9e0c182cc0 legacy=0x7f9e0c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c08c250 legacy=0x7f9e0c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 monclient: found mon.noname-a 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c089a10 con 0x7f9e0c08c620 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9e00003260 con 0x7f9e0c08c620 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: dump: 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.765 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 5 monclient: authenticate success, global_id 74220 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e00004960 con 0x7f9e0c08c620 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 1 -- 10.20.193.57:0/1023367337 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9e00004cb0 con 0x7f9e0c08c620 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e10dce640 10 monclient: dump: 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.766 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 4 set_mon_vals no callback set 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 10 monclient: shutdown 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 1 -- 10.20.193.57:0/1023367337 >> v1:10.20.193.57:6789/0 conn(0x7f9e0c08c620 legacy=0x7f9e0c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 1 -- 10.20.193.57:0/1023367337 shutdown_connections 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 1 -- 10.20.193.57:0/1023367337 >> 10.20.193.57:0/1023367337 conn(0x7f9e0c0916b0 msgr2=0x7f9e0c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 1 -- 10.20.193.57:0/1023367337 shutdown_connections 2026-02-12T17:39:45.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.763+0000 7f9e1405b640 1 -- 10.20.193.57:0/1023367337 wait complete. 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient: monmap: 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 1 Processor -- start 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 1 -- start start 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient: init 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient(hunting): picked mon.noname-c con 0x7f9e0c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient(hunting): picked mon.noname-b con 0x7f9e0c08c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient(hunting): picked mon.noname-a con 0x7f9e0c182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0c138c70 con 0x7f9e0c182cc0 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0c13edc0 con 0x7f9e0c08c620 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0c0888a0 con 0x7f9e0c08c250 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e1405b640 10 monclient(hunting): authenticate will time out at 1265.583582s 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e11dd0640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f9e0c08c250 0x7f9e0c136780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:40978/0 (socket says 10.20.193.57:40978) 2026-02-12T17:39:45.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.764+0000 7f9e11dd0640 1 -- 10.20.193.57:0/1379012703 learned_addr learned my addr 10.20.193.57:0/1379012703 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9e125d1640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.57:6789/0 conn(0x7f9e0c182cc0 legacy=0x7f9e0c193420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9e11dd0640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.57:6790/0 conn(0x7f9e0c08c250 legacy=0x7f9e0c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223939933 0 0) 0x7f9e0c138c70 con 0x7f9e0c182cc0 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 10 monclient(hunting): my global_id is 74223 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ddc0035e0 con 0x7f9e0c182cc0 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367907923 0 0) 0x7f9e0c0888a0 con 0x7f9e0c08c250 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 10 monclient(hunting): my global_id is 84152 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e0c138c70 con 0x7f9e0c08c250 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.766+0000 7f9e115cf640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c08c620 legacy=0x7f9e0c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2973370660 0 0) 0x7f9ddc0035e0 con 0x7f9e0c182cc0 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e0c0888a0 con 0x7f9e0c182cc0 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9e08004440 con 0x7f9e0c182cc0 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): dump: 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.774 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785099191 0 0) 0x7f9e0c13edc0 con 0x7f9e0c08c620 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): my global_id is 4978 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ddc0035e0 con 0x7f9e0c08c620 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2115546854 0 0) 0x7f9e0c138c70 con 0x7f9e0c08c250 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e0c13edc0 con 0x7f9e0c08c250 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9dfc0033b0 con 0x7f9e0c08c250 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:45.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient(hunting): dump: 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3826953761 0 0) 0x7f9e0c0888a0 con 0x7f9e0c182cc0 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.57:6790/0 conn(0x7f9e0c08c250 legacy=0x7f9e0c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c08c620 legacy=0x7f9e0c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 monclient: found mon.a 2026-02-12T17:39:45.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0c05dc20 con 0x7f9e0c182cc0 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9e1405b640 5 monclient: authenticate success, global_id 74223 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9e1405b640 10 monclient: _renew_subs 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9e1405b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0c1375a0 con 0x7f9e0c182cc0 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9e1405b640 10 monclient: _renew_subs 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9e1405b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9e0c138f30 con 0x7f9e0c182cc0 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e08005c30 con 0x7f9e0c182cc0 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9e08005f50 con 0x7f9e0c182cc0 2026-02-12T17:39:45.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 10 monclient: dump: 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfbfff640 4 set_mon_vals no callback set 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9e1405b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9e0c18e8d0 con 0x7f9e0c05d180 2026-02-12T17:39:45.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.767+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f9e08012bc0 con 0x7f9e0c182cc0 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.768+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(578..578 src has 202..578) ==== 3947+0+0 (unknown 2274444407 0 0) 0x7f9e0804fc80 con 0x7f9e0c182cc0 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.768+0000 7f9e115cf640 10 monclient: get_auth_request con 0x7f9ddc03fd60 auth_method 0 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9e11dd0640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c05d180 legacy=0x7f9e0c0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4037382478 0 0) 0x7f9e0c13edc0 con 0x7f9e0c05d180 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 10 monclient(hunting): my global_id is 4981 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e0c0888a0 con 0x7f9e0c05d180 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 171785041 0 0) 0x7f9e0c0888a0 con 0x7f9e0c05d180 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e0c13edc0 con 0x7f9e0c05d180 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9dfc003ab0 con 0x7f9e0c05d180 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 10 monclient: dump: 2026-02-12T17:39:45.779 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2459236957 0 0) 0x7f9e0c13edc0 con 0x7f9e0c05d180 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.770+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e0c138ad0 con 0x7f9e0c05d180 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.771+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9dfc005880 con 0x7f9e0c05d180 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.771+0000 7f9dfa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.771+0000 7f9dfa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.771+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c05d180 legacy=0x7f9e0c0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.771+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c05d180 legacy=0x7f9e0c0582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:45.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.774+0000 7f9e1405b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:39:45.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.774+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9e0c090810 con 0x7f9e0c0589d0 2026-02-12T17:39:45.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.776+0000 7f9e11dd0640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c0589d0 legacy=0x7f9e0c195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107926634 0 0) 0x7f9e0c090810 con 0x7f9e0c0589d0 2026-02-12T17:39:45.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 10 monclient(hunting): my global_id is 4984 2026-02-12T17:39:45.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e0c13edc0 con 0x7f9e0c0589d0 2026-02-12T17:39:45.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2782189798 0 0) 0x7f9e0c13edc0 con 0x7f9e0c0589d0 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e0c090810 con 0x7f9e0c0589d0 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9dfc0042f0 con 0x7f9e0c0589d0 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 10 monclient: dump: 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2440762 0 0) 0x7f9e0c090810 con 0x7f9e0c0589d0 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9e0c05d550 con 0x7f9e0c0589d0 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 3940369388) 0x7f9dfc005bd0 con 0x7f9e0c0589d0 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c0589d0 legacy=0x7f9e0c195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9dfa7fc640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.82:6789/0 conn(0x7f9e0c0589d0 legacy=0x7f9e0c195b50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:39:45.784 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 46, 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 707272, 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:45.785 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:45.786 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:39:45.787 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:39:45.788 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.789 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.790 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.791 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:39:45.792 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:39:45.793 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:39:45.794 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:39:45.794 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:39:45.794 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:39:45.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.82:6800/2441377515 conn(0x7f9ddc03fd60 legacy=0x7f9ddc060210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9e1405b640 10 monclient: shutdown 2026-02-12T17:39:45.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9e1405b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:45.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 >> v1:10.20.193.57:6789/0 conn(0x7f9e0c182cc0 legacy=0x7f9e0c193420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9e125d1640 1 -- 10.20.193.57:0/1379012703 reap_dead start 2026-02-12T17:39:45.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 shutdown_connections 2026-02-12T17:39:45.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 >> 10.20.193.57:0/1379012703 conn(0x7f9e0c0916b0 msgr2=0x7f9e0c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:45.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 shutdown_connections 2026-02-12T17:39:45.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.777+0000 7f9e1405b640 1 -- 10.20.193.57:0/1379012703 wait complete. 2026-02-12T17:39:45.795 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:39:45.795 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-12T17:39:45.795 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T17:39:45.795 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-12T17:39:45.796 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-12T17:39:45.796 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T17:39:45.796 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:39:45.803 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T17:39:45.803 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:39:45.804 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:39:45.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.912+0000 7fa0f72cc640 10 monclient: get_monmap_and_config 2026-02-12T17:39:45.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.912+0000 7fa0f72cc640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.912+0000 7fa0f72cc640 10 monclient: monmap: 2026-02-12T17:39:45.910 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.910 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.910 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:45.913373+0000 2026-02-12T17:39:45.910 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:45.913373+0000 2026-02-12T17:39:45.910 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.910 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.910 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.910 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:45.910 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:45.911 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.912+0000 7fa0f72cc640 1 Processor -- start 2026-02-12T17:39:45.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.912+0000 7fa0f72cc640 1 -- start start 2026-02-12T17:39:45.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.912+0000 7fa0f72cc640 10 monclient: init 2026-02-12T17:39:45.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 10 monclient(hunting): picked mon.noname-c con 0x7fa0f008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa0f008cc80 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa0f01852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f008d600 con 0x7fa0f01852d0 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f0089770 con 0x7fa0f008ae20 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f008b1f0 con 0x7fa0f008cc80 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f4840640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fa0f008cc80 legacy=0x7fa0f0183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f72cc640 10 monclient(hunting): authenticate will time out at 1265.732333s 2026-02-12T17:39:45.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f5842640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fa0f01852d0 0x7fa0f01a56b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51672/0 (socket says 10.20.193.57:51672) 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.913+0000 7fa0f5842640 1 -- 10.20.193.57:0/2473975357 learned_addr learned my addr 10.20.193.57:0/2473975357 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0f5842640 1 -- 10.20.193.57:0/2473975357 >> v1:10.20.193.57:6789/0 conn(0x7fa0f01852d0 legacy=0x7fa0f01a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0f5041640 1 -- 10.20.193.57:0/2473975357 >> v1:10.20.193.82:6789/0 conn(0x7fa0f008ae20 legacy=0x7fa0f008c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 1 -- 10.20.193.57:0/2473975357 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719346676 0 0) 0x7fa0f008d600 con 0x7fa0f01852d0 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient(hunting): my global_id is 74226 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 1 -- 10.20.193.57:0/2473975357 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0d80035e0 con 0x7fa0f01852d0 2026-02-12T17:39:45.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 1 -- 10.20.193.57:0/2473975357 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 421574091 0 0) 0x7fa0d80035e0 con 0x7fa0f01852d0 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 1 -- 10.20.193.57:0/2473975357 >> v1:10.20.193.57:6790/0 conn(0x7fa0f008cc80 legacy=0x7fa0f0183bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 1 -- 10.20.193.57:0/2473975357 >> v1:10.20.193.82:6789/0 conn(0x7fa0f008ae20 legacy=0x7fa0f008c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 1 monclient: found mon.noname-a 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 1 -- 10.20.193.57:0/2473975357 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f008c020 con 0x7fa0f01852d0 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 1 -- 10.20.193.57:0/2473975357 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa0ec004230 con 0x7fa0f01852d0 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0dffff640 10 monclient: dump: 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.924 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0f72cc640 5 monclient: authenticate success, global_id 74226 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.915+0000 7fa0f72cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0dffff640 1 -- 10.20.193.57:0/2473975357 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0ec0044f0 con 0x7fa0f01852d0 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0dffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0dffff640 1 -- 10.20.193.57:0/2473975357 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa0ec005bf0 con 0x7fa0f01852d0 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0dffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0dffff640 10 monclient: dump: 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.926 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 4 set_mon_vals no callback set 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 10 monclient: shutdown 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2473975357 >> v1:10.20.193.57:6789/0 conn(0x7fa0f01852d0 legacy=0x7fa0f01a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2473975357 shutdown_connections 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2473975357 >> 10.20.193.57:0/2473975357 conn(0x7fa0f0091620 msgr2=0x7fa0f0091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2473975357 shutdown_connections 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2473975357 wait complete. 2026-02-12T17:39:45.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 10 monclient: build_initial_monmap 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.916+0000 7fa0f72cc640 10 monclient: monmap: 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:45.928 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 1 Processor -- start 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 1 -- start start 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 10 monclient: init 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa0f008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 10 monclient(hunting): picked mon.noname-c con 0x7fa0f008cc80 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa0f01852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f005e280 con 0x7fa0f01852d0 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f00832e0 con 0x7fa0f008ae20 2026-02-12T17:39:45.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f0088810 con 0x7fa0f008cc80 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f72cc640 10 monclient(hunting): authenticate will time out at 1265.736499s 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f4840640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fa0f008cc80 legacy=0x7fa0f01839a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f5842640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fa0f01852d0 0x7fa0f0132ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51678/0 (socket says 10.20.193.57:51678) 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.917+0000 7fa0f5842640 1 -- 10.20.193.57:0/2811358099 learned_addr learned my addr 10.20.193.57:0/2811358099 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0f5842640 1 -- 10.20.193.57:0/2811358099 >> v1:10.20.193.57:6789/0 conn(0x7fa0f01852d0 legacy=0x7fa0f0132ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921623624 0 0) 0x7fa0f005e280 con 0x7fa0f01852d0 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): my global_id is 74229 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0c00035e0 con 0x7fa0f01852d0 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0f5041640 1 -- 10.20.193.57:0/2811358099 >> v1:10.20.193.82:6789/0 conn(0x7fa0f008ae20 legacy=0x7fa0f0131ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 397972768 0 0) 0x7fa0f00832e0 con 0x7fa0f008ae20 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): _negotiate 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): my global_id is 4990 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0f005e280 con 0x7fa0f008ae20 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 947566296 0 0) 0x7fa0c00035e0 con 0x7fa0f01852d0 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0f00832e0 con 0x7fa0f01852d0 2026-02-12T17:39:45.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa0ec004230 con 0x7fa0f01852d0 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): dump: 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.932 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.919+0000 7fa0ddffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 643795699 0 0) 0x7fa0f00832e0 con 0x7fa0f01852d0 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f5041640 1 --1- 10.20.193.57:0/2811358099 >> v1:10.20.193.82:6789/0 conn(0x7fa0f008ae20 0x7fa0f0131ac0 :-1 s=OPENED pgs=539 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fa0f005e280 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 >> v1:10.20.193.57:6790/0 conn(0x7fa0f008cc80 legacy=0x7fa0f01839a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 >> v1:10.20.193.82:6789/0 conn(0x7fa0f008ae20 legacy=0x7fa0f0131ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 10 monclient: _finish_hunting 0 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 1 monclient: found mon.a 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:45.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f01850c0 con 0x7fa0f01852d0 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 10 monclient: _finish_auth 0 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 10 monclient: _check_auth_tickets 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3320983415 0 0) 0x7fa0f005e280 con 0x7fa0f008ae20 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 5 monclient: authenticate success, global_id 74229 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 10 monclient: _renew_subs 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f0080f80 con 0x7fa0f01852d0 2026-02-12T17:39:45.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 10 monclient: _renew_subs 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa0f00830b0 con 0x7fa0f01852d0 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0ec0061d0 con 0x7fa0f01852d0 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa0ec0064f0 con 0x7fa0f01852d0 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 10 monclient: dump: 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:45.935 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0df7fe640 4 set_mon_vals no callback set 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:45.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f00826b0 con 0x7fa0f01852d0 2026-02-12T17:39:45.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.920+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fa0ec013160 con 0x7fa0f01852d0 2026-02-12T17:39:45.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.921+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(578..578 src has 202..578) ==== 3947+0+0 (unknown 2274444407 0 0) 0x7fa0ec04fd70 con 0x7fa0f01852d0 2026-02-12T17:39:45.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.921+0000 7fa0f5041640 10 monclient: get_auth_request con 0x7fa0c003f6f0 auth_method 0 2026-02-12T17:39:45.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.923+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fa0ec017f20 con 0x7fa0f01852d0 2026-02-12T17:39:45.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.923+0000 7fa0ddffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:45.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:45.923+0000 7fa0ddffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:46.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.070+0000 7fa0f72cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:39:46.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.070+0000 7fa0f72cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:39:46.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.070+0000 7fa0f72cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:39:46.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.070+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa0f007a6d0 con 0x7fa0f01852d0 2026-02-12T17:39:46.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.070+0000 7fa0ddffb640 1 -- 10.20.193.57:0/2811358099 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 643646696) 0x7fa0ec017d40 con 0x7fa0f01852d0 2026-02-12T17:39:46.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.070+0000 7fa0ddffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:39:46.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.070+0000 7fa0ddffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:46.068 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:39:46.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.071+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 >> v1:10.20.193.82:6800/2441377515 conn(0x7fa0c003f6f0 legacy=0x7fa0c005fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:46.069 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.071+0000 7fa0f72cc640 10 monclient: shutdown 2026-02-12T17:39:46.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.071+0000 7fa0f72cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:46.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.071+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 >> v1:10.20.193.57:6789/0 conn(0x7fa0f01852d0 legacy=0x7fa0f0132ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:46.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.071+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 shutdown_connections 2026-02-12T17:39:46.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.071+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 >> 10.20.193.57:0/2811358099 conn(0x7fa0f0091620 msgr2=0x7fa0f01a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:46.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.071+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 shutdown_connections 2026-02-12T17:39:46.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:46.071+0000 7fa0f72cc640 1 -- 10.20.193.57:0/2811358099 wait complete. 2026-02-12T17:39:49.077 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:39:49.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.143+0000 7f627005b640 10 monclient: get_monmap_and_config 2026-02-12T17:39:49.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.143+0000 7f627005b640 10 monclient: build_initial_monmap 2026-02-12T17:39:49.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.143+0000 7f627005b640 10 monclient: monmap: 2026-02-12T17:39:49.142 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:49.142 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:49.144771+0000 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:49.144771+0000 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 1 Processor -- start 2026-02-12T17:39:49.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 1 -- start start 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 10 monclient: init 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 10 monclient(hunting): picked mon.noname-a con 0x7f626808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 10 monclient(hunting): picked mon.noname-c con 0x7f626808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 10 monclient(hunting): picked mon.noname-b con 0x7f626808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626808d600 con 0x7f626808ae20 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626808b1f0 con 0x7f626808c730 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626808d1f0 con 0x7f626808cb30 2026-02-12T17:39:49.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:49.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f627005b640 10 monclient(hunting): authenticate will time out at 1268.963645s 2026-02-12T17:39:49.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f626e5d1640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f626808cb30 legacy=0x7f62681a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:49.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f626ddd0640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f626808ae20 0x7f626808c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51690/0 (socket says 10.20.193.57:51690) 2026-02-12T17:39:49.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.144+0000 7f626ddd0640 1 -- 10.20.193.57:0/796963122 learned_addr learned my addr 10.20.193.57:0/796963122 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:49.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.146+0000 7f626ddd0640 1 -- 10.20.193.57:0/796963122 >> v1:10.20.193.57:6789/0 conn(0x7f626808ae20 legacy=0x7f626808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:49.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626d5cf640 1 -- 10.20.193.57:0/796963122 >> v1:10.20.193.82:6789/0 conn(0x7f626808c730 legacy=0x7f6268181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 -- 10.20.193.57:0/796963122 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850291760 0 0) 0x7f626808b1f0 con 0x7f626808c730 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient(hunting): _negotiate 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient(hunting): my global_id is 4993 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 -- 10.20.193.57:0/796963122 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62500035e0 con 0x7f626808c730 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 -- 10.20.193.57:0/796963122 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 359604580 0 0) 0x7f62500035e0 con 0x7f626808c730 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 -- 10.20.193.57:0/796963122 >> v1:10.20.193.57:6790/0 conn(0x7f626808cb30 legacy=0x7f62681a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 -- 10.20.193.57:0/796963122 >> v1:10.20.193.57:6789/0 conn(0x7f626808ae20 legacy=0x7f626808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:49.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: _finish_hunting 0 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 monclient: found mon.noname-c 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 -- 10.20.193.57:0/796963122 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6268057320 con 0x7f626808c730 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: _finish_auth 0 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: _check_auth_tickets 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 -- 10.20.193.57:0/796963122 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f625c0031a0 con 0x7f626808c730 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:49.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: dump: 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:49.152 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f627005b640 5 monclient: authenticate success, global_id 4993 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f627005b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 -- 10.20.193.57:0/796963122 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f625c0033f0 con 0x7f626808c730 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 1 -- 10.20.193.57:0/796963122 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f625c003880 con 0x7f626808c730 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f627005b640 10 monclient: get_monmap_and_config success 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f627005b640 4 set_mon_vals no callback set 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:39:49.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.147+0000 7f626cdce640 10 monclient: dump: 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:49.154 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 10 monclient: shutdown 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 1 -- 10.20.193.57:0/796963122 >> v1:10.20.193.82:6789/0 conn(0x7f626808c730 legacy=0x7f6268181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 1 -- 10.20.193.57:0/796963122 shutdown_connections 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 1 -- 10.20.193.57:0/796963122 >> 10.20.193.57:0/796963122 conn(0x7f6268091620 msgr2=0x7f6268091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 1 -- 10.20.193.57:0/796963122 shutdown_connections 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 1 -- 10.20.193.57:0/796963122 wait complete. 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 10 monclient: build_initial_monmap 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 10 monclient: monmap: 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:49.155 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 1 Processor -- start 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 1 -- start start 2026-02-12T17:39:49.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.148+0000 7f627005b640 10 monclient: init 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 10 monclient(hunting): picked mon.noname-b con 0x7f626808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 10 monclient(hunting): picked mon.noname-c con 0x7f626808c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 10 monclient(hunting): picked mon.noname-a con 0x7f626808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626808d9c0 con 0x7f626808cb30 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6268088810 con 0x7f626808ae20 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626805b000 con 0x7f626808c730 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f627005b640 10 monclient(hunting): authenticate will time out at 1268.968147s 2026-02-12T17:39:49.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f626d5cf640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f626808c730 legacy=0x7f6268089460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:49.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f626e5d1640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f626808cb30 0x7f62681a2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51696/0 (socket says 10.20.193.57:51696) 2026-02-12T17:39:49.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.149+0000 7f626e5d1640 1 -- 10.20.193.57:0/3861912108 learned_addr learned my addr 10.20.193.57:0/3861912108 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:49.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.151+0000 7f626e5d1640 1 -- 10.20.193.57:0/3861912108 >> v1:10.20.193.57:6789/0 conn(0x7f626808cb30 legacy=0x7f62681a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:49.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.151+0000 7f626ddd0640 1 -- 10.20.193.57:0/3861912108 >> v1:10.20.193.82:6789/0 conn(0x7f626808ae20 legacy=0x7f6268088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:49.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.151+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:39:49.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842363332 0 0) 0x7f6268088810 con 0x7f626808ae20 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient(hunting): _negotiate 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient(hunting): my global_id is 4996 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62380035e0 con 0x7f626808ae20 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2017928782 0 0) 0x7f62380035e0 con 0x7f626808ae20 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6268088810 con 0x7f626808ae20 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6258003120 con 0x7f626808ae20 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:39:49.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient(hunting): dump: 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:49.163 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4108345398 0 0) 0x7f6268088810 con 0x7f626808ae20 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 >> v1:10.20.193.57:6790/0 conn(0x7f626808c730 legacy=0x7f6268089460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 >> v1:10.20.193.57:6789/0 conn(0x7f626808cb30 legacy=0x7f62681a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient: _finish_hunting 0 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 monclient: found mon.b 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626808a570 con 0x7f626808ae20 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient: _finish_auth 0 2026-02-12T17:39:49.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 10 monclient: _check_auth_tickets 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f62567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f627005b640 5 monclient: authenticate success, global_id 4996 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f627005b640 10 monclient: _renew_subs 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f627005b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.153+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f626811e4a0 con 0x7f626808ae20 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f627005b640 10 monclient: _renew_subs 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f627005b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6268123420 con 0x7f626808ae20 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6258003300 con 0x7f626808ae20 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f62567fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:39:49.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6258004d00 con 0x7f626808ae20 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f62567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f62567fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f62567fc640 10 monclient: dump: 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:49.166 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f6257fff640 4 set_mon_vals no callback set 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f627005b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f627005b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f627005b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.154+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62680008d0 con 0x7f626808ae20 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.155+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f6258004f90 con 0x7f626808ae20 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.155+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(578..578 src has 202..578) ==== 3947+0+0 (unknown 2274444407 0 0) 0x7f625804ea40 con 0x7f626808ae20 2026-02-12T17:39:49.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.155+0000 7f626d5cf640 10 monclient: get_auth_request con 0x7f623803f680 auth_method 0 2026-02-12T17:39:49.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.157+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f62580171b0 con 0x7f626808ae20 2026-02-12T17:39:49.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.157+0000 7f62567fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:39:49.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.157+0000 7f62567fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:39:49.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.301+0000 7f627005b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:39:49.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.301+0000 7f627005b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:39:49.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.301+0000 7f627005b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:39:49.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.301+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f626808f520 con 0x7f626808ae20 2026-02-12T17:39:49.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.301+0000 7f62567fc640 1 -- 10.20.193.57:0/3861912108 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 298723916) 0x7f625804b820 con 0x7f626808ae20 2026-02-12T17:39:49.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.301+0000 7f62567fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:39:49.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.301+0000 7f62567fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:39:49.299 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":46,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:39:49.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.302+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 >> v1:10.20.193.82:6800/2441377515 conn(0x7f623803f680 legacy=0x7f623805fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:49.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.302+0000 7f627005b640 10 monclient: shutdown 2026-02-12T17:39:49.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.302+0000 7f627005b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:39:49.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.302+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 >> v1:10.20.193.82:6789/0 conn(0x7f626808ae20 legacy=0x7f6268088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:49.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.302+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 shutdown_connections 2026-02-12T17:39:49.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.302+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 >> 10.20.193.57:0/3861912108 conn(0x7f6268091620 msgr2=0x7f62680597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:39:49.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.302+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 shutdown_connections 2026-02-12T17:39:49.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:49.302+0000 7f627005b640 1 -- 10.20.193.57:0/3861912108 wait complete. 2026-02-12T17:39:52.307 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:39:52.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.377+0000 7f967808c640 10 monclient: get_monmap_and_config 2026-02-12T17:39:52.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.377+0000 7f967808c640 10 monclient: build_initial_monmap 2026-02-12T17:39:52.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.377+0000 7f967808c640 10 monclient: monmap: 2026-02-12T17:39:52.375 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:39:52.375 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:39:52.375 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:39:52.378528+0000 2026-02-12T17:39:52.375 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:39:52.378528+0000 2026-02-12T17:39:52.375 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:39:52.375 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:39:52.375 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:39:52.375 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:39:52.376 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:39:52.376 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:39:52.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 1 Processor -- start 2026-02-12T17:39:52.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 1 -- start start 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 10 monclient: init 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 10 monclient: _reopen_session rank -1 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 10 monclient(hunting): picked mon.noname-c con 0x7f967008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 10 monclient(hunting): picked mon.noname-b con 0x7f967008cc80 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 10 monclient(hunting): picked mon.noname-a con 0x7f96701852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f967008d600 con 0x7f96701852d0 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9670089770 con 0x7f967008ae20 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f967008b1f0 con 0x7f967008cc80 2026-02-12T17:39:52.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:52.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f967808c640 10 monclient(hunting): authenticate will time out at 1272.197467s 2026-02-12T17:39:52.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f9675600640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9670183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:52.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f9676602640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 0x7f96701a56b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:51708/0 (socket says 10.20.193.57:51708) 2026-02-12T17:39:52.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.378+0000 7f9676602640 1 -- 10.20.193.57:0/624916685 learned_addr learned my addr 10.20.193.57:0/624916685 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:39:52.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.380+0000 7f9676602640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 legacy=0x7f96701a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:52.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.380+0000 7f9675e01640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.82:6789/0 conn(0x7f967008ae20 legacy=0x7f967008c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:52.576 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.580+0000 7f9675600640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9670183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:52.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:52.981+0000 7f9675600640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9670183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:53.779 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:53.782+0000 7f9675600640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9670183bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:55.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 10 monclient(hunting): tick 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 1 monclient(hunting): continuing hunt 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9670183bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.82:6789/0 conn(0x7f967008ae20 legacy=0x7f967008c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 legacy=0x7f96701a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f967008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f96701852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:55.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f967008cc80 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:55.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f967008c020 con 0x7f96701852d0 2026-02-12T17:39:55.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f967008b1f0 con 0x7f967008ae20 2026-02-12T17:39:55.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965406a080 con 0x7f967008cc80 2026-02-12T17:39:55.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f965f7fe640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:55.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.378+0000 7f9676602640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:55.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.380+0000 7f9675600640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 legacy=0x7f9654045060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:55.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.381+0000 7f9675e01640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.82:6789/0 conn(0x7f967008ae20 legacy=0x7f9654023890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:55.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.579+0000 7f9676602640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:55.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:55.980+0000 7f9676602640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:56.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:56.781+0000 7f9676602640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:58.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 10 monclient(hunting): tick 2026-02-12T17:39:58.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 1 monclient(hunting): continuing hunt 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.82:6789/0 conn(0x7f967008ae20 legacy=0x7f9654023890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 legacy=0x7f9654045060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f967008cc80 addr v1:10.20.193.57:6790/0 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f967008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f96701852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965406b2e0 con 0x7f96701852d0 2026-02-12T17:39:58.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965406a080 con 0x7f967008ae20 2026-02-12T17:39:58.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f9675e01640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:58.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 1 -- 10.20.193.57:0/624916685 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965406a470 con 0x7f967008cc80 2026-02-12T17:39:58.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.378+0000 7f965f7fe640 10 monclient(hunting): _renew_subs 2026-02-12T17:39:58.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.381+0000 7f9676602640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 legacy=0x7f9654044fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:58.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.381+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:39:58.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.381+0000 7f9675600640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.82:6789/0 conn(0x7f967008ae20 legacy=0x7f9654023850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:39:58.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.579+0000 7f9675e01640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:58.976 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:58.980+0000 7f9675e01640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:39:59.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:39:59.781+0000 7f9675e01640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:40:00.252 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878490492 0 0) 0x7f965406b2e0 con 0x7f96701852d0 2026-02-12T17:40:00.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient(hunting): my global_id is 74232 2026-02-12T17:40:00.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96580035e0 con 0x7f96701852d0 2026-02-12T17:40:00.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3468946832 0 0) 0x7f96580035e0 con 0x7f96701852d0 2026-02-12T17:40:00.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9654066860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:40:00.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.82:6789/0 conn(0x7f967008ae20 legacy=0x7f9654023850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: _finish_hunting 0 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 monclient: found mon.noname-a 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965406a6c0 con 0x7f96701852d0 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: _finish_auth 0 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: _check_auth_tickets 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f966c004160 con 0x7f96701852d0 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f967808c640 5 monclient: authenticate success, global_id 74232 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f967808c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: dump: 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.255 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f967808c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f966c004460 con 0x7f96701852d0 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 1 -- 10.20.193.57:0/624916685 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f966c005a40 con 0x7f96701852d0 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f967808c640 10 monclient: get_monmap_and_config success 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f967808c640 4 set_mon_vals no callback set 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.252+0000 7f9674dff640 10 monclient: dump: 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.256 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 10 monclient: shutdown 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 1 -- 10.20.193.57:0/624916685 >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 legacy=0x7f9654044fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 1 -- 10.20.193.57:0/624916685 shutdown_connections 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 1 -- 10.20.193.57:0/624916685 >> 10.20.193.57:0/624916685 conn(0x7f9670091620 msgr2=0x7f9670091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 1 -- 10.20.193.57:0/624916685 shutdown_connections 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 1 -- 10.20.193.57:0/624916685 wait complete. 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 10 monclient: build_initial_monmap 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 10 monclient: monmap: 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:40:00.258 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 1 Processor -- start 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 1 -- start start 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.253+0000 7f967808c640 10 monclient: init 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 10 monclient: _reopen_session rank -1 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 10 monclient(hunting): picked mon.noname-b con 0x7f967008ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 10 monclient(hunting): picked mon.noname-c con 0x7f967008cc80 addr v1:10.20.193.57:6790/0 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 10 monclient(hunting): picked mon.noname-a con 0x7f96701852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:40:00.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f9675600640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9670173fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:40:00.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9670088810 con 0x7f96701852d0 2026-02-12T17:40:00.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9670085830 con 0x7f967008ae20 2026-02-12T17:40:00.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f965e7fc640 1 -- DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:40:00.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9670082af0 con 0x7f967008cc80 2026-02-12T17:40:00.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 10 monclient(hunting): _renew_subs 2026-02-12T17:40:00.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f967808c640 10 monclient(hunting): authenticate will time out at 1280.073183s 2026-02-12T17:40:00.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f9676602640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 0x7f96701756f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:45850/0 (socket says 10.20.193.57:45850) 2026-02-12T17:40:00.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.254+0000 7f9676602640 1 -- 10.20.193.57:0/1151056772 learned_addr learned my addr 10.20.193.57:0/1151056772 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:40:00.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f9676602640 1 -- 10.20.193.57:0/1151056772 >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 legacy=0x7f96701756f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309955475 0 0) 0x7f9670088810 con 0x7f96701852d0 2026-02-12T17:40:00.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): my global_id is 74235 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f9675e01640 1 -- 10.20.193.57:0/1151056772 >> v1:10.20.193.82:6789/0 conn(0x7f967008ae20 legacy=0x7f9670152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96400035e0 con 0x7f96701852d0 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 798055760 0 0) 0x7f96400035e0 con 0x7f96701852d0 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9670088810 con 0x7f96701852d0 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f966c004610 con 0x7f96701852d0 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): dump: 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.265 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467954213 0 0) 0x7f967008b1f0 con 0x7f967008ae20 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.266 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient(hunting): my global_id is 4999 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96400035e0 con 0x7f967008ae20 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3609518999 0 0) 0x7f9670088810 con 0x7f96701852d0 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 >> v1:10.20.193.57:6790/0 conn(0x7f967008cc80 legacy=0x7f9670173fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 >> v1:10.20.193.82:6789/0 conn(0x7f967008ae20 legacy=0x7f9670152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 monclient: found mon.a 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9670084ea0 con 0x7f96701852d0 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:40:00.267 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f965e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f967808c640 5 monclient: authenticate success, global_id 74235 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f967808c640 10 monclient: _renew_subs 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f967808c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.256+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9670088160 con 0x7f96701852d0 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f967808c640 10 monclient: _renew_subs 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f967808c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f96700820c0 con 0x7f96701852d0 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f966c004130 con 0x7f96701852d0 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f965e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:40:00.268 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f966c003fb0 con 0x7f96701852d0 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f965e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f965e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f965ffff640 4 set_mon_vals no callback set 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f965e7fc640 10 monclient: dump: 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.269 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f966c012d50 con 0x7f96701852d0 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f967808c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f967808c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f967808c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9670088ae0 con 0x7f96701852d0 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(578..578 src has 202..578) ==== 3947+0+0 (unknown 2274444407 0 0) 0x7f966c04f9e0 con 0x7f96701852d0 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.257+0000 7f9675e01640 10 monclient: get_auth_request con 0x7f964003f760 auth_method 0 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.260+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f966c018260 con 0x7f96701852d0 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.260+0000 7f965e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:40:00.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.260+0000 7f965e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:40:00.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.404+0000 7f967808c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:40:00.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.404+0000 7f967808c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:40:00.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.404+0000 7f967808c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.404+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9670084ea0 con 0x7f96701852d0 2026-02-12T17:40:00.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.404+0000 7f965e7fc640 1 -- 10.20.193.57:0/1151056772 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 953697405) 0x7f9670084ea0 con 0x7f96701852d0 2026-02-12T17:40:00.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.404+0000 7f965e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:40:00.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.404+0000 7f965e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:40:00.402 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":50,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:40:00.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.405+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 >> v1:10.20.193.82:6800/2441377515 conn(0x7f964003f760 legacy=0x7f964005fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.405+0000 7f967808c640 10 monclient: shutdown 2026-02-12T17:40:00.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.405+0000 7f967808c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:40:00.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.405+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 >> v1:10.20.193.57:6789/0 conn(0x7f96701852d0 legacy=0x7f96701756f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.405+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 shutdown_connections 2026-02-12T17:40:00.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.405+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 >> 10.20.193.57:0/1151056772 conn(0x7f9670091620 msgr2=0x7f967007b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:40:00.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.405+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 shutdown_connections 2026-02-12T17:40:00.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.405+0000 7f967808c640 1 -- 10.20.193.57:0/1151056772 wait complete. 2026-02-12T17:40:00.411 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:40:00.411 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-12T17:40:00.411 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:40:00.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.479+0000 7fac75e47640 10 monclient: get_monmap_and_config 2026-02-12T17:40:00.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.479+0000 7fac75e47640 10 monclient: build_initial_monmap 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.479+0000 7fac75e47640 10 monclient: monmap: 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:40:00.480611+0000 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:40:00.480611+0000 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:40:00.477 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 1 Processor -- start 2026-02-12T17:40:00.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 1 -- start start 2026-02-12T17:40:00.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 10 monclient: init 2026-02-12T17:40:00.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 10 monclient: _reopen_session rank -1 2026-02-12T17:40:00.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:40:00.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 10 monclient(hunting): picked mon.noname-c con 0x7fac7008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:40:00.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 10 monclient(hunting): picked mon.noname-b con 0x7fac7008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:40:00.483 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 10 monclient(hunting): picked mon.noname-a con 0x7fac70182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac7008a820 con 0x7fac70182cc0 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac70089450 con 0x7fac7008c250 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac70089730 con 0x7fac7008c620 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 10 monclient(hunting): _renew_subs 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac75e47640 10 monclient(hunting): authenticate will time out at 1280.299483s 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac6effd640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fac7008c620 legacy=0x7fac7008caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac6ffff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fac70182cc0 0x7fac701a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:45854/0 (socket says 10.20.193.57:45854) 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac6ffff640 1 -- 10.20.193.57:0/276760706 learned_addr learned my addr 10.20.193.57:0/276760706 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.480+0000 7fac6f7fe640 1 --1- 10.20.193.57:0/276760706 >> v1:10.20.193.82:6789/0 conn(0x7fac7008c250 0x7fac7008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:43476/0 (socket says 10.20.193.57:43476) 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.482+0000 7fac6ffff640 1 -- 10.20.193.57:0/276760706 >> v1:10.20.193.57:6789/0 conn(0x7fac70182cc0 legacy=0x7fac701a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.482+0000 7fac6f7fe640 1 -- 10.20.193.57:0/276760706 >> v1:10.20.193.82:6789/0 conn(0x7fac7008c250 legacy=0x7fac7008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.484 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.482+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773650948 0 0) 0x7fac64003d00 con 0x7fac70182cc0 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.482+0000 7fac6e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.482+0000 7fac6e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.482+0000 7fac6e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.482+0000 7fac6e7fc640 10 monclient(hunting): my global_id is 74238 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.482+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac540035e0 con 0x7fac70182cc0 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3663250136 0 0) 0x7fac70089450 con 0x7fac7008c250 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient(hunting): my global_id is 5002 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac64003d00 con 0x7fac7008c250 2026-02-12T17:40:00.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 225982590 0 0) 0x7fac540035e0 con 0x7fac70182cc0 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 >> v1:10.20.193.57:6790/0 conn(0x7fac7008c620 legacy=0x7fac7008caa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 >> v1:10.20.193.82:6789/0 conn(0x7fac7008c250 legacy=0x7fac7008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 monclient: found mon.noname-a 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac70089a10 con 0x7fac70182cc0 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac640043c0 con 0x7fac70182cc0 2026-02-12T17:40:00.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: dump: 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.487 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 5 monclient: authenticate success, global_id 74238 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac64005a40 con 0x7fac70182cc0 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 10 monclient: get_monmap_and_config success 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 4 set_mon_vals no callback set 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 1 -- 10.20.193.57:0/276760706 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac64005e50 con 0x7fac70182cc0 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac6e7fc640 10 monclient: dump: 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.488 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 10 monclient: shutdown 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 1 -- 10.20.193.57:0/276760706 >> v1:10.20.193.57:6789/0 conn(0x7fac70182cc0 legacy=0x7fac701a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 1 -- 10.20.193.57:0/276760706 shutdown_connections 2026-02-12T17:40:00.489 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 1 -- 10.20.193.57:0/276760706 >> 10.20.193.57:0/276760706 conn(0x7fac700916b0 msgr2=0x7fac70091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 1 -- 10.20.193.57:0/276760706 shutdown_connections 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.483+0000 7fac75e47640 1 -- 10.20.193.57:0/276760706 wait complete. 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient: build_initial_monmap 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient: monmap: 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:40:00.490 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 1 Processor -- start 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 1 -- start start 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient: init 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient: _reopen_session rank -1 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient(hunting): picked mon.noname-a con 0x7fac7008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient(hunting): picked mon.noname-c con 0x7fac7008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient(hunting): picked mon.noname-b con 0x7fac70182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac70138180 con 0x7fac7008c250 2026-02-12T17:40:00.491 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac70139200 con 0x7fac70182cc0 2026-02-12T17:40:00.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac70182ad0 con 0x7fac7008c620 2026-02-12T17:40:00.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac6effd640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fac7008c620 legacy=0x7fac70181cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:40:00.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient(hunting): _renew_subs 2026-02-12T17:40:00.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac75e47640 10 monclient(hunting): authenticate will time out at 1280.303693s 2026-02-12T17:40:00.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac6f7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fac7008c250 0x7fac7013df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:45862/0 (socket says 10.20.193.57:45862) 2026-02-12T17:40:00.492 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.484+0000 7fac6f7fe640 1 -- 10.20.193.57:0/1347775707 learned_addr learned my addr 10.20.193.57:0/1347775707 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:40:00.497 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.486+0000 7fac6f7fe640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.57:6789/0 conn(0x7fac7008c250 legacy=0x7fac7013df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.486+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1691353881 0 0) 0x7fac64003d00 con 0x7fac7008c250 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.486+0000 7fac4bfff640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.486+0000 7fac4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.486+0000 7fac4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.486+0000 7fac4bfff640 10 monclient(hunting): my global_id is 74241 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.486+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac400035e0 con 0x7fac7008c250 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac6ffff640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.82:6789/0 conn(0x7fac70182cc0 legacy=0x7fac701823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1555536891 0 0) 0x7fac400035e0 con 0x7fac7008c250 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac64003d00 con 0x7fac7008c250 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac5c0033e0 con 0x7fac7008c250 2026-02-12T17:40:00.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient(hunting): dump: 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.499 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227023354 0 0) 0x7fac70139200 con 0x7fac70182cc0 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient(hunting): my global_id is 5005 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac400035e0 con 0x7fac70182cc0 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 452117808 0 0) 0x7fac64003d00 con 0x7fac7008c250 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.57:6790/0 conn(0x7fac7008c620 legacy=0x7fac70181cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.82:6789/0 conn(0x7fac70182cc0 legacy=0x7fac701823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient: _finish_hunting 0 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 monclient: found mon.a 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac700888a0 con 0x7fac7008c250 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient: _finish_auth 0 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient: _check_auth_tickets 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac75e47640 5 monclient: authenticate success, global_id 74241 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac75e47640 10 monclient: _renew_subs 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac75e47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fac701386a0 con 0x7fac7008c250 2026-02-12T17:40:00.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac75e47640 10 monclient: _renew_subs 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac75e47640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fac70139440 con 0x7fac7008c250 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac5c004b50 con 0x7fac7008c250 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac5c004eb0 con 0x7fac7008c250 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 10 monclient: dump: 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.502 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac6dffb640 4 set_mon_vals no callback set 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac75e47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fac7018f740 con 0x7fac7018f370 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.487+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fac5c005140 con 0x7fac7008c250 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.488+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(578..578 src has 202..578) ==== 3947+0+0 (unknown 2274444407 0 0) 0x7fac5c04ebe0 con 0x7fac7008c250 2026-02-12T17:40:00.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.488+0000 7fac6ffff640 10 monclient: get_auth_request con 0x7fac4003f760 auth_method 0 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac6effd640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.57:6789/0 conn(0x7fac7018f370 legacy=0x7fac70086730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677422290 0 0) 0x7fac7018f740 con 0x7fac7018f370 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 10 monclient(hunting): my global_id is 74244 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac64003d00 con 0x7fac7018f370 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1871928463 0 0) 0x7fac64003d00 con 0x7fac7018f370 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac7018f740 con 0x7fac7018f370 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac600042f0 con 0x7fac7018f370 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 10 monclient: dump: 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 341330675 0 0) 0x7fac7018f740 con 0x7fac7018f370 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac70090810 con 0x7fac7018f370 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fac600066e0 con 0x7fac7018f370 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.57:6789/0 conn(0x7fac7018f370 legacy=0x7fac70086730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.490+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.57:6789/0 conn(0x7fac7018f370 legacy=0x7fac70086730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.493+0000 7fac75e47640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.493+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fac70138180 con 0x7fac70086e40 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac6effd640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.57:6789/0 conn(0x7fac70086e40 legacy=0x7fac70197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899928923 0 0) 0x7fac70138180 con 0x7fac70086e40 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 10 monclient(hunting): my global_id is 74247 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac7018f740 con 0x7fac70086e40 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1081913039 0 0) 0x7fac7018f740 con 0x7fac70086e40 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac70138180 con 0x7fac70086e40 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fac60005c80 con 0x7fac70086e40 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 10 monclient: dump: 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.507 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2327164748 0 0) 0x7fac70138180 con 0x7fac70086e40 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fac7008f580 con 0x7fac70086e40 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4661 (unknown 0 0 3116872243) 0x7fac600061b0 con 0x7fac70086e40 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:40:00.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.57:6789/0 conn(0x7fac70086e40 legacy=0x7fac70197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac4bfff640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.57:6789/0 conn(0x7fac70086e40 legacy=0x7fac70197d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:40:00.509 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:40:00.509 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:40:00.509 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:40:00.509 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:40:00.509 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 50, 2026-02-12T17:40:00.509 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 126959, 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:40:00.510 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:40:00.511 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.512 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:40:00.513 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:40:00.514 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.515 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:40:00.516 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:40:00.517 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.518 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.519 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:40:00.520 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:40:00.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.82:6800/2441377515 conn(0x7fac4003f760 legacy=0x7fac4005fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac75e47640 10 monclient: shutdown 2026-02-12T17:40:00.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac75e47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:40:00.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 >> v1:10.20.193.57:6789/0 conn(0x7fac7008c250 legacy=0x7fac7013df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac6ffff640 1 -- 10.20.193.57:0/1347775707 reap_dead start 2026-02-12T17:40:00.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac6ffff640 1 -- 10.20.193.57:0/1347775707 reap_dead start 2026-02-12T17:40:00.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 shutdown_connections 2026-02-12T17:40:00.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 >> 10.20.193.57:0/1347775707 conn(0x7fac700916b0 msgr2=0x7fac7008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:40:00.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 shutdown_connections 2026-02-12T17:40:00.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.496+0000 7fac75e47640 1 -- 10.20.193.57:0/1347775707 wait complete. 2026-02-12T17:40:00.522 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:40:00.522 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:40:00.523 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:40:00.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.590+0000 7f9c8c3f6640 10 monclient: get_monmap_and_config 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.590+0000 7f9c8c3f6640 10 monclient: build_initial_monmap 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.590+0000 7f9c8c3f6640 10 monclient: monmap: 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:40:00.591698+0000 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:40:00.591698+0000 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:40:00.588 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:40:00.589 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 1 Processor -- start 2026-02-12T17:40:00.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 1 -- start start 2026-02-12T17:40:00.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 10 monclient: init 2026-02-12T17:40:00.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 10 monclient: _reopen_session rank -1 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 10 monclient(hunting): picked mon.noname-b con 0x7f9c8408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 10 monclient(hunting): picked mon.noname-a con 0x7f9c8408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 10 monclient(hunting): picked mon.noname-c con 0x7f9c84182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8a16b640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f9c8408c250 legacy=0x7f9c8408a110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c8408a820 con 0x7f9c8408c620 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c84089450 con 0x7f9c84182cc0 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c84089730 con 0x7f9c8408c250 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 10 monclient(hunting): _renew_subs 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8c3f6640 10 monclient(hunting): authenticate will time out at 1280.410631s 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8996a640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f9c8408c620 0x7f9c8408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:45890/0 (socket says 10.20.193.57:45890) 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.591+0000 7f9c8996a640 1 -- 10.20.193.57:0/1829575948 learned_addr learned my addr 10.20.193.57:0/1829575948 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:40:00.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.593+0000 7f9c8996a640 1 -- 10.20.193.57:0/1829575948 >> v1:10.20.193.57:6789/0 conn(0x7f9c8408c620 legacy=0x7f9c8408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.593+0000 7f9c8a96c640 1 -- 10.20.193.57:0/1829575948 >> v1:10.20.193.82:6789/0 conn(0x7f9c84182cc0 legacy=0x7f9c841a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.593+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264034582 0 0) 0x7f9c78002c20 con 0x7f9c8408c620 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient(hunting): my global_id is 74250 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c6c0035e0 con 0x7f9c8408c620 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965871978 0 0) 0x7f9c84089450 con 0x7f9c84182cc0 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient(hunting): my global_id is 5008 2026-02-12T17:40:00.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c78002c20 con 0x7f9c84182cc0 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 167886257 0 0) 0x7f9c6c0035e0 con 0x7f9c8408c620 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 >> v1:10.20.193.57:6790/0 conn(0x7f9c8408c250 legacy=0x7f9c8408a110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 >> v1:10.20.193.82:6789/0 conn(0x7f9c84182cc0 legacy=0x7f9c841a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: _finish_hunting 0 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 monclient: found mon.noname-a 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c84089a10 con 0x7f9c8408c620 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: _finish_auth 0 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: _check_auth_tickets 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9c78003260 con 0x7f9c8408c620 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: dump: 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 5 monclient: authenticate success, global_id 74250 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:40:00.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c78004960 con 0x7f9c8408c620 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: handle_config config(0 keys) 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 10 monclient: get_monmap_and_config success 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 4 set_mon_vals no callback set 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 1 -- 10.20.193.57:0/1829575948 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9c78004d30 con 0x7f9c8408c620 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c89169640 10 monclient: dump: 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.598 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 10 monclient: shutdown 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/1829575948 >> v1:10.20.193.57:6789/0 conn(0x7f9c8408c620 legacy=0x7f9c8408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/1829575948 shutdown_connections 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/1829575948 >> 10.20.193.57:0/1829575948 conn(0x7f9c840916b0 msgr2=0x7f9c84091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/1829575948 shutdown_connections 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.594+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/1829575948 wait complete. 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient: build_initial_monmap 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient: monmap: 2026-02-12T17:40:00.599 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 1 Processor -- start 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 1 -- start start 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient: init 2026-02-12T17:40:00.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient: _reopen_session rank -1 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient(hunting): picked mon.noname-b con 0x7f9c8408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient(hunting): picked mon.noname-c con 0x7f9c8408c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient(hunting): picked mon.noname-a con 0x7f9c84182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c84139a90 con 0x7f9c84182cc0 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c84137c40 con 0x7f9c8408c250 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c84138a70 con 0x7f9c8408c620 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient(hunting): _renew_subs 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8c3f6640 10 monclient(hunting): authenticate will time out at 1280.414516s 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8996a640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f9c8408c620 legacy=0x7f9c84136e90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8a96c640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f9c84182cc0 0x7f9c84193240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:45898/0 (socket says 10.20.193.57:45898) 2026-02-12T17:40:00.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.595+0000 7f9c8a96c640 1 -- 10.20.193.57:0/815154957 learned_addr learned my addr 10.20.193.57:0/815154957 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:40:00.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.597+0000 7f9c8a96c640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.57:6789/0 conn(0x7f9c84182cc0 legacy=0x7f9c84193240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.597+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370621629 0 0) 0x7f9c84139a90 con 0x7f9c84182cc0 2026-02-12T17:40:00.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.597+0000 7f9c6affd640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.597+0000 7f9c6affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.597+0000 7f9c6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.597+0000 7f9c6affd640 10 monclient(hunting): my global_id is 74253 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.597+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c540035e0 con 0x7f9c84182cc0 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 251460371 0 0) 0x7f9c540035e0 con 0x7f9c84182cc0 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c84139a90 con 0x7f9c84182cc0 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8a16b640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.82:6789/0 conn(0x7f9c8408c250 legacy=0x7f9c84136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9c80004530 con 0x7f9c84182cc0 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient(hunting): dump: 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.607 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1374708856 0 0) 0x7f9c84139a90 con 0x7f9c84182cc0 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.57:6790/0 conn(0x7f9c8408c620 legacy=0x7f9c84136e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.82:6789/0 conn(0x7f9c8408c250 legacy=0x7f9c84136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient: _finish_hunting 0 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 monclient: found mon.a 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:40:00.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c841394d0 con 0x7f9c84182cc0 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient: _finish_auth 0 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient: _check_auth_tickets 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8c3f6640 5 monclient: authenticate success, global_id 74253 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8c3f6640 10 monclient: _renew_subs 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8c3f6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c84138070 con 0x7f9c84182cc0 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8c3f6640 10 monclient: _renew_subs 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8c3f6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c8413ea50 con 0x7f9c84182cc0 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c80004a60 con 0x7f9c84182cc0 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:40:00.609 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9c80004db0 con 0x7f9c84182cc0 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 10 monclient: dump: 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.610 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c88968640 4 set_mon_vals no callback set 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8c3f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9c84090810 con 0x7f9c8405d070 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.598+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f9c80005040 con 0x7f9c84182cc0 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.599+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(578..578 src has 202..578) ==== 3947+0+0 (unknown 2274444407 0 0) 0x7f9c8004fe60 con 0x7f9c84182cc0 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.599+0000 7f9c8996a640 10 monclient: get_auth_request con 0x7f9c5403f680 auth_method 0 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c8a16b640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.82:6789/0 conn(0x7f9c8405d070 legacy=0x7f9c840582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864993552 0 0) 0x7f9c84090810 con 0x7f9c8405d070 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 10 monclient(hunting): my global_id is 5014 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c84139a90 con 0x7f9c8405d070 2026-02-12T17:40:00.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 739195119 0 0) 0x7f9c84139a90 con 0x7f9c8405d070 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c84090810 con 0x7f9c8405d070 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9c74004260 con 0x7f9c8405d070 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 10 monclient: dump: 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.612 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2728657887 0 0) 0x7f9c84090810 con 0x7f9c8405d070 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.601+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c841392b0 con 0x7f9c8405d070 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.602+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f9c74005890 con 0x7f9c8405d070 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.602+0000 7f9c6affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.602+0000 7f9c6affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.602+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.82:6789/0 conn(0x7f9c8405d070 legacy=0x7f9c840582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.602+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.82:6789/0 conn(0x7f9c8405d070 legacy=0x7f9c840582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.605+0000 7f9c8c3f6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.605+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9c8408f580 con 0x7f9c840589d0 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.607+0000 7f9c8a16b640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.82:6789/0 conn(0x7f9c840589d0 legacy=0x7f9c84195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:40:00.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.607+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185555305 0 0) 0x7f9c8408f580 con 0x7f9c840589d0 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.607+0000 7f9c6affd640 10 monclient(hunting): _negotiate 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.607+0000 7f9c6affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.607+0000 7f9c6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.607+0000 7f9c6affd640 10 monclient(hunting): my global_id is 5017 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.607+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c84090810 con 0x7f9c840589d0 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1992618385 0 0) 0x7f9c84090810 con 0x7f9c840589d0 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c8408f580 con 0x7f9c840589d0 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9c74004920 con 0x7f9c840589d0 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 10 monclient: dump: 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:40:00.614 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3577281342 0 0) 0x7f9c8408f580 con 0x7f9c840589d0 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9c84055340 con 0x7f9c840589d0 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4496 (unknown 0 0 3345973643) 0x7f9c74005ad0 con 0x7f9c840589d0 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:40:00.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.82:6789/0 conn(0x7f9c840589d0 legacy=0x7f9c84195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c6affd640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.82:6789/0 conn(0x7f9c840589d0 legacy=0x7f9c84195970 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:40:00.616 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:40:00.616 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:40:00.616 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:40:00.616 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:40:00.616 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 50, 2026-02-12T17:40:00.616 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 722104, 2026-02-12T17:40:00.616 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:40:00.617 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:40:00.618 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:40:00.619 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:40:00.620 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:40:00.621 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.622 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:40:00.623 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:40:00.624 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:40:00.625 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:40:00.626 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:40:00.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.82:6800/2441377515 conn(0x7f9c5403f680 legacy=0x7f9c5405fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8c3f6640 10 monclient: shutdown 2026-02-12T17:40:00.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8c3f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:40:00.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 >> v1:10.20.193.57:6789/0 conn(0x7f9c84182cc0 legacy=0x7f9c84193240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:40:00.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8a96c640 1 -- 10.20.193.57:0/815154957 reap_dead start 2026-02-12T17:40:00.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8a96c640 1 -- 10.20.193.57:0/815154957 reap_dead start 2026-02-12T17:40:00.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 shutdown_connections 2026-02-12T17:40:00.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 >> 10.20.193.57:0/815154957 conn(0x7f9c840916b0 msgr2=0x7f9c8408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:40:00.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 shutdown_connections 2026-02-12T17:40:00.628 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:40:00.608+0000 7f9c8c3f6640 1 -- 10.20.193.57:0/815154957 wait complete. 2026-02-12T17:40:00.628 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:40:00.628 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:40:01.258 INFO:tasks.rados.rados.0.trial082.stdout:2622: done (0 left) 2026-02-12T17:40:01.258 INFO:tasks.rados.rados.0.trial082.stdout:2623: snap_remove snap 279 2026-02-12T17:40:02.264 INFO:tasks.rados.rados.0.trial082.stdout:2623: done (0 left) 2026-02-12T17:40:02.264 INFO:tasks.rados.rados.0.trial082.stdout:2624: copy_from oid 9 from oid 19 current snap is 282 2026-02-12T17:40:02.265 INFO:tasks.rados.rados.0.trial082.stdout:2625: snap_create 2026-02-12T17:40:02.265 INFO:tasks.rados.rados.0.trial082.stdout:2624: finishing copy_from to trial08226312-9 2026-02-12T17:40:02.265 INFO:tasks.rados.rados.0.trial082.stdout:2624: got expected ENOENT (src dne) 2026-02-12T17:40:02.265 INFO:tasks.rados.rados.0.trial082.stdout:2624: finishing copy_from racing read to trial08226312-9 2026-02-12T17:40:03.083 INFO:tasks.rados.rados.0.trial082.stdout:2624: done (1 left) 2026-02-12T17:40:03.084 INFO:tasks.rados.rados.0.trial082.stdout:2625: done (0 left) 2026-02-12T17:40:03.084 INFO:tasks.rados.rados.0.trial082.stdout:2626: write oid 37 current snap is 283 2026-02-12T17:40:03.084 INFO:tasks.rados.rados.0.trial082.stdout:2626: seq_num 890 ranges {558230=584911,1897327=527644,2923993=34237} 2026-02-12T17:40:03.088 INFO:tasks.rados.rados.0.trial082.stdout:2626: writing trial08226312-37 from 558230 to 1143141 tid 1 2026-02-12T17:40:03.093 INFO:tasks.rados.rados.0.trial082.stdout:2626: writing trial08226312-37 from 1897327 to 2424971 tid 2 2026-02-12T17:40:03.096 INFO:tasks.rados.rados.0.trial082.stdout:2626: writing trial08226312-37 from 2923993 to 2958230 tid 3 2026-02-12T17:40:03.096 INFO:tasks.rados.rados.0.trial082.stdout:2627: rollback oid 3 current snap is 283 2026-02-12T17:40:03.096 INFO:tasks.rados.rados.0.trial082.stdout:2626: finishing write tid 1 to trial08226312-37 2026-02-12T17:40:03.096 INFO:tasks.rados.rados.0.trial082.stdout:2626: finishing write tid 2 to trial08226312-37 2026-02-12T17:40:03.096 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 252 2026-02-12T17:40:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2628: rollback oid 20 current snap is 283 2026-02-12T17:40:03.097 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 20 to 264 2026-02-12T17:40:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2629: write oid 26 current snap is 283 2026-02-12T17:40:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2629: seq_num 891 ranges {575037=660160,1955809=671302} 2026-02-12T17:40:03.100 INFO:tasks.rados.rados.0.trial082.stdout:2629: writing trial08226312-26 from 575037 to 1235197 tid 1 2026-02-12T17:40:03.106 INFO:tasks.rados.rados.0.trial082.stdout:2629: writing trial08226312-26 from 1955809 to 2627111 tid 2 2026-02-12T17:40:03.106 INFO:tasks.rados.rados.0.trial082.stdout:2626: finishing write tid 3 to trial08226312-37 2026-02-12T17:40:03.106 INFO:tasks.rados.rados.0.trial082.stdout:2630: read oid 6 snap -1 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2630: expect (ObjNum 835 snap 260 seq_num 835) 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2631: write (excl) oid 50 current snap is 283 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2626: finishing write tid 4 to trial08226312-37 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2626: finishing write tid 5 to trial08226312-37 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2626: oid 37 updating version 0 to 1927 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2626: oid 37 version 1927 is already newer than 1926 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2626: oid 37 version 1927 is already newer than 1924 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2626: oid 37 version 1927 is already newer than 1925 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1927 (ObjNum 890 snap 283 seq_num 890) dirty exists 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2626: left oid 37 (ObjNum 890 snap 283 seq_num 890) 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2627: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:40:03.107 INFO:tasks.rados.rados.0.trial082.stdout:2627: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:40:03.108 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1142 (ObjNum 806 snap 251 seq_num 806) dirty exists 2026-02-12T17:40:03.108 INFO:tasks.rados.rados.0.trial082.stdout:2628: finishing rollback tid 0 to trial08226312-20 2026-02-12T17:40:03.108 INFO:tasks.rados.rados.0.trial082.stdout:2628: finishing rollback tid 1 to trial08226312-20 2026-02-12T17:40:03.108 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 2021 (ObjNum 129 snap 0 seq_num 27703736) dirty dne 2026-02-12T17:40:03.108 INFO:tasks.rados.rados.0.trial082.stdout:2629: finishing write tid 1 to trial08226312-26 2026-02-12T17:40:03.108 INFO:tasks.rados.rados.0.trial082.stdout:2631: seq_num 892 ranges {591844=735409,1897938=531313,2862486=129358} 2026-02-12T17:40:03.110 INFO:tasks.rados.rados.0.trial082.stdout:2631: writing trial08226312-50 from 591844 to 1327253 tid 1 2026-02-12T17:40:03.114 INFO:tasks.rados.rados.0.trial082.stdout:2631: writing trial08226312-50 from 1897938 to 2429251 tid 2 2026-02-12T17:40:03.117 INFO:tasks.rados.rados.0.trial082.stdout:2631: writing trial08226312-50 from 2862486 to 2991844 tid 3 2026-02-12T17:40:03.117 INFO:tasks.rados.rados.0.trial082.stdout:2626: done (5 left) 2026-02-12T17:40:03.117 INFO:tasks.rados.rados.0.trial082.stdout:2627: done (4 left) 2026-02-12T17:40:03.117 INFO:tasks.rados.rados.0.trial082.stdout:2628: done (3 left) 2026-02-12T17:40:03.117 INFO:tasks.rados.rados.0.trial082.stdout:2632: read oid 33 snap -1 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2632: expect deleted 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2633: copy_from oid 11 from oid 17 current snap is 283 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2629: finishing write tid 2 to trial08226312-26 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2629: finishing write tid 3 to trial08226312-26 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2629: finishing write tid 4 to trial08226312-26 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2629: oid 26 updating version 0 to 1863 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2629: oid 26 version 1863 is already newer than 1862 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2629: oid 26 version 1863 is already newer than 1861 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1863 (ObjNum 891 snap 283 seq_num 891) dirty exists 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2629: left oid 26 (ObjNum 891 snap 283 seq_num 891) 2026-02-12T17:40:03.118 INFO:tasks.rados.rados.0.trial082.stdout:2630: expect (ObjNum 835 snap 260 seq_num 835) 2026-02-12T17:40:03.158 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:03.182 INFO:tasks.rados.rados.0.trial082.stdout:2631: finishing write tid 1 to trial08226312-50 2026-02-12T17:40:03.182 INFO:tasks.rados.rados.0.trial082.stdout:2629: done (4 left) 2026-02-12T17:40:03.182 INFO:tasks.rados.rados.0.trial082.stdout:2630: done (3 left) 2026-02-12T17:40:03.182 INFO:tasks.rados.rados.0.trial082.stdout:2634: read oid 14 snap -1 2026-02-12T17:40:03.182 INFO:tasks.rados.rados.0.trial082.stdout:2634: expect deleted 2026-02-12T17:40:03.182 INFO:tasks.rados.rados.0.trial082.stdout:2635: read oid 40 snap -1 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2635: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2636: read oid 8 snap 250 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2636: expect (ObjNum 801 snap 249 seq_num 801) 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2637: read oid 9 snap -1 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2637: expect deleted 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2638: rollback oid 34 current snap is 283 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 275 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2631: finishing write tid 2 to trial08226312-50 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2633: finishing copy_from to trial08226312-11 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2633: got expected ENOENT (src dne) 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2633: finishing copy_from racing read to trial08226312-11 2026-02-12T17:40:03.183 INFO:tasks.rados.rados.0.trial082.stdout:2631: finishing write tid 3 to trial08226312-50 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2631: finishing write tid 4 to trial08226312-50 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2631: finishing write tid 5 to trial08226312-50 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2631: oid 50 updating version 0 to 1590 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2631: oid 50 version 1590 is already newer than 1588 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2631: oid 50 updating version 1590 to 1591 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2631: oid 50 version 1591 is already newer than 1589 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 1591 (ObjNum 892 snap 283 seq_num 892) dirty exists 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2631: left oid 50 (ObjNum 892 snap 283 seq_num 892) 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2631: done (7 left) 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2632: done (6 left) 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2633: done (5 left) 2026-02-12T17:40:03.184 INFO:tasks.rados.rados.0.trial082.stdout:2639: read oid 42 snap -1 2026-02-12T17:40:03.185 INFO:tasks.rados.rados.0.trial082.stdout:2639: expect (ObjNum 859 snap 272 seq_num 859) 2026-02-12T17:40:03.185 INFO:tasks.rados.rados.0.trial082.stdout:2640: snap_create 2026-02-12T17:40:03.185 INFO:tasks.rados.rados.0.trial082.stdout:2635: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:40:03.234 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:03.300 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1381566 2026-02-12T17:40:03.337 INFO:tasks.rados.rados.0.trial082.stdout:2638: finishing rollback tid 0 to trial08226312-34 2026-02-12T17:40:03.337 INFO:tasks.rados.rados.0.trial082.stdout:2636: expect (ObjNum 801 snap 249 seq_num 801) 2026-02-12T17:40:03.380 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 364082 2026-02-12T17:40:03.464 INFO:tasks.rados.rados.0.trial082.stdout:2638: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:40:03.464 INFO:tasks.rados.rados.0.trial082.stdout:2638: finishing rollback tid 2 to trial08226312-34 2026-02-12T17:40:03.464 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1555 (ObjNum 842 snap 265 seq_num 842) dirty exists 2026-02-12T17:40:03.464 INFO:tasks.rados.rados.0.trial082.stdout:2639: expect (ObjNum 859 snap 272 seq_num 859) 2026-02-12T17:40:03.497 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:03.537 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:04.089 INFO:tasks.rados.rados.0.trial082.stdout:2634: done (6 left) 2026-02-12T17:40:04.090 INFO:tasks.rados.rados.0.trial082.stdout:2635: done (5 left) 2026-02-12T17:40:04.090 INFO:tasks.rados.rados.0.trial082.stdout:2636: done (4 left) 2026-02-12T17:40:04.090 INFO:tasks.rados.rados.0.trial082.stdout:2637: done (3 left) 2026-02-12T17:40:04.090 INFO:tasks.rados.rados.0.trial082.stdout:2638: done (2 left) 2026-02-12T17:40:04.090 INFO:tasks.rados.rados.0.trial082.stdout:2639: done (1 left) 2026-02-12T17:40:04.090 INFO:tasks.rados.rados.0.trial082.stdout:2640: done (0 left) 2026-02-12T17:40:04.090 INFO:tasks.rados.rados.0.trial082.stdout:2641: snap_remove snap 251 2026-02-12T17:40:05.088 INFO:tasks.rados.rados.0.trial082.stdout:2641: done (0 left) 2026-02-12T17:40:05.089 INFO:tasks.rados.rados.0.trial082.stdout:2642: delete oid 10 current snap is 284 2026-02-12T17:40:05.093 INFO:tasks.rados.rados.0.trial082.stdout:2642: done (0 left) 2026-02-12T17:40:05.093 INFO:tasks.rados.rados.0.trial082.stdout:2643: copy_from oid 13 from oid 39 current snap is 284 2026-02-12T17:40:05.093 INFO:tasks.rados.rados.0.trial082.stdout:2644: read oid 47 snap -1 2026-02-12T17:40:05.093 INFO:tasks.rados.rados.0.trial082.stdout:2644: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:40:05.093 INFO:tasks.rados.rados.0.trial082.stdout:2645: write (excl) oid 14 current snap is 284 2026-02-12T17:40:05.093 INFO:tasks.rados.rados.0.trial082.stdout:2645: seq_num 894 ranges {625458=485907,1614902=534982,2917332=108126} 2026-02-12T17:40:05.097 INFO:tasks.rados.rados.0.trial082.stdout:2645: writing trial08226312-14 from 625458 to 1111365 tid 1 2026-02-12T17:40:05.101 INFO:tasks.rados.rados.0.trial082.stdout:2645: writing trial08226312-14 from 1614902 to 2149884 tid 2 2026-02-12T17:40:05.104 INFO:tasks.rados.rados.0.trial082.stdout:2645: writing trial08226312-14 from 2917332 to 3025458 tid 3 2026-02-12T17:40:05.105 INFO:tasks.rados.rados.0.trial082.stdout:2646: write (excl) oid 42 current snap is 284 2026-02-12T17:40:05.105 INFO:tasks.rados.rados.0.trial082.stdout:2646: seq_num 895 ranges {642265=561156,1673384=678640,2828402=213863} 2026-02-12T17:40:05.109 INFO:tasks.rados.rados.0.trial082.stdout:2646: writing trial08226312-42 from 642265 to 1203421 tid 1 2026-02-12T17:40:05.113 INFO:tasks.rados.rados.0.trial082.stdout:2646: writing trial08226312-42 from 1673384 to 2352024 tid 2 2026-02-12T17:40:05.116 INFO:tasks.rados.rados.0.trial082.stdout:2646: writing trial08226312-42 from 2828402 to 3042265 tid 3 2026-02-12T17:40:05.116 INFO:tasks.rados.rados.0.trial082.stdout:2647: write (excl) oid 16 current snap is 284 2026-02-12T17:40:05.116 INFO:tasks.rados.rados.0.trial082.stdout:2647: seq_num 896 ranges {659072=636405,1731866=422298,2855825=203247} 2026-02-12T17:40:05.120 INFO:tasks.rados.rados.0.trial082.stdout:2647: writing trial08226312-16 from 659072 to 1295477 tid 1 2026-02-12T17:40:05.124 INFO:tasks.rados.rados.0.trial082.stdout:2647: writing trial08226312-16 from 1731866 to 2154164 tid 2 2026-02-12T17:40:05.127 INFO:tasks.rados.rados.0.trial082.stdout:2647: writing trial08226312-16 from 2855825 to 3059072 tid 3 2026-02-12T17:40:05.127 INFO:tasks.rados.rados.0.trial082.stdout:2648: read oid 22 snap -1 2026-02-12T17:40:05.128 INFO:tasks.rados.rados.0.trial082.stdout:2648: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:40:05.128 INFO:tasks.rados.rados.0.trial082.stdout:2649: rollback oid 5 current snap is 284 2026-02-12T17:40:05.128 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 5 to 282 2026-02-12T17:40:05.128 INFO:tasks.rados.rados.0.trial082.stdout:2644: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:40:05.132 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 608568 2026-02-12T17:40:05.223 INFO:tasks.rados.rados.0.trial082.stdout:2645: finishing write tid 1 to trial08226312-14 2026-02-12T17:40:05.223 INFO:tasks.rados.rados.0.trial082.stdout:2644: done (6 left) 2026-02-12T17:40:05.223 INFO:tasks.rados.rados.0.trial082.stdout:2650: snap_remove snap 268 2026-02-12T17:40:06.091 INFO:tasks.rados.rados.0.trial082.stdout:2650: done (6 left) 2026-02-12T17:40:06.092 INFO:tasks.rados.rados.0.trial082.stdout:2651: snap_create 2026-02-12T17:40:06.092 INFO:tasks.rados.rados.0.trial082.stdout:2643: finishing copy_from racing read to trial08226312-13 2026-02-12T17:40:06.092 INFO:tasks.rados.rados.0.trial082.stdout:2643: finishing copy_from to trial08226312-13 2026-02-12T17:40:06.092 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 948 (ObjNum 816 snap 253 seq_num 816) dirty exists 2026-02-12T17:40:06.092 INFO:tasks.rados.rados.0.trial082.stdout:2645: finishing write tid 2 to trial08226312-14 2026-02-12T17:40:06.092 INFO:tasks.rados.rados.0.trial082.stdout:2645: finishing write tid 3 to trial08226312-14 2026-02-12T17:40:06.092 INFO:tasks.rados.rados.0.trial082.stdout:2645: finishing write tid 4 to trial08226312-14 2026-02-12T17:40:06.092 INFO:tasks.rados.rados.0.trial082.stdout:2645: finishing write tid 5 to trial08226312-14 2026-02-12T17:40:06.092 INFO:tasks.rados.rados.0.trial082.stdout:2645: oid 14 updating version 0 to 1143 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2645: oid 14 updating version 1143 to 1145 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2645: oid 14 version 1145 is already newer than 1144 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2645: oid 14 updating version 1145 to 1146 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 1146 (ObjNum 894 snap 284 seq_num 894) dirty exists 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2645: left oid 14 (ObjNum 894 snap 284 seq_num 894) 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2646: finishing write tid 1 to trial08226312-42 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2646: finishing write tid 2 to trial08226312-42 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2646: finishing write tid 3 to trial08226312-42 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2646: finishing write tid 4 to trial08226312-42 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2646: finishing write tid 5 to trial08226312-42 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2646: oid 42 updating version 0 to 1597 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2646: oid 42 version 1597 is already newer than 1594 2026-02-12T17:40:06.093 INFO:tasks.rados.rados.0.trial082.stdout:2646: oid 42 version 1597 is already newer than 1595 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2646: oid 42 version 1597 is already newer than 1596 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 1597 (ObjNum 895 snap 284 seq_num 895) dirty exists 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2646: left oid 42 (ObjNum 895 snap 284 seq_num 895) 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2647: finishing write tid 1 to trial08226312-16 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2647: finishing write tid 2 to trial08226312-16 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2647: finishing write tid 3 to trial08226312-16 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2647: finishing write tid 4 to trial08226312-16 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2647: finishing write tid 5 to trial08226312-16 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2647: oid 16 updating version 0 to 1599 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2647: oid 16 version 1599 is already newer than 1598 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2647: oid 16 updating version 1599 to 1600 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:2647: oid 16 updating version 1600 to 1601 2026-02-12T17:40:06.094 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1601 (ObjNum 896 snap 284 seq_num 896) dirty exists 2026-02-12T17:40:06.095 INFO:tasks.rados.rados.0.trial082.stdout:2647: left oid 16 (ObjNum 896 snap 284 seq_num 896) 2026-02-12T17:40:06.095 INFO:tasks.rados.rados.0.trial082.stdout:2649: finishing rollback tid 0 to trial08226312-5 2026-02-12T17:40:06.095 INFO:tasks.rados.rados.0.trial082.stdout:2649: finishing rollback tid 1 to trial08226312-5 2026-02-12T17:40:06.095 INFO:tasks.rados.rados.0.trial082.stdout:2649: finishing rollback tid 2 to trial08226312-5 2026-02-12T17:40:06.095 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 1149 (ObjNum 872 snap 275 seq_num 872) dirty exists 2026-02-12T17:40:06.095 INFO:tasks.rados.rados.0.trial082.stdout:2648: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:40:06.131 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2836857 2026-02-12T17:40:06.189 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:07.396 INFO:tasks.rados.rados.0.trial082.stdout:2643: done (6 left) 2026-02-12T17:40:07.396 INFO:tasks.rados.rados.0.trial082.stdout:2645: done (5 left) 2026-02-12T17:40:07.396 INFO:tasks.rados.rados.0.trial082.stdout:2646: done (4 left) 2026-02-12T17:40:07.396 INFO:tasks.rados.rados.0.trial082.stdout:2647: done (3 left) 2026-02-12T17:40:07.396 INFO:tasks.rados.rados.0.trial082.stdout:2648: done (2 left) 2026-02-12T17:40:07.396 INFO:tasks.rados.rados.0.trial082.stdout:2649: done (1 left) 2026-02-12T17:40:07.396 INFO:tasks.rados.rados.0.trial082.stdout:2651: done (0 left) 2026-02-12T17:40:07.397 INFO:tasks.rados.rados.0.trial082.stdout:2652: copy_from oid 50 from oid 9 current snap is 285 2026-02-12T17:40:07.397 INFO:tasks.rados.rados.0.trial082.stdout:2653: read oid 14 snap -1 2026-02-12T17:40:07.397 INFO:tasks.rados.rados.0.trial082.stdout:2653: expect (ObjNum 894 snap 284 seq_num 894) 2026-02-12T17:40:07.397 INFO:tasks.rados.rados.0.trial082.stdout:2654: snap_create 2026-02-12T17:40:07.397 INFO:tasks.rados.rados.0.trial082.stdout:2652: finishing copy_from to trial08226312-50 2026-02-12T17:40:07.397 INFO:tasks.rados.rados.0.trial082.stdout:2652: got expected ENOENT (src dne) 2026-02-12T17:40:07.397 INFO:tasks.rados.rados.0.trial082.stdout:2652: finishing copy_from racing read to trial08226312-50 2026-02-12T17:40:07.398 INFO:tasks.rados.rados.0.trial082.stdout:2653: expect (ObjNum 894 snap 284 seq_num 894) 2026-02-12T17:40:07.442 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2946920 2026-02-12T17:40:08.096 INFO:tasks.rados.rados.0.trial082.stdout:2652: done (2 left) 2026-02-12T17:40:08.096 INFO:tasks.rados.rados.0.trial082.stdout:2653: done (1 left) 2026-02-12T17:40:08.096 INFO:tasks.rados.rados.0.trial082.stdout:2654: done (0 left) 2026-02-12T17:40:08.096 INFO:tasks.rados.rados.0.trial082.stdout:2655: read oid 49 snap -1 2026-02-12T17:40:08.096 INFO:tasks.rados.rados.0.trial082.stdout:2655: expect deleted 2026-02-12T17:40:08.096 INFO:tasks.rados.rados.0.trial082.stdout:2656: write oid 14 current snap is 286 2026-02-12T17:40:08.096 INFO:tasks.rados.rados.0.trial082.stdout:2656: seq_num 897 ranges {675879=711654,2073995=682309} 2026-02-12T17:40:08.100 INFO:tasks.rados.rados.0.trial082.stdout:2656: writing trial08226312-14 from 675879 to 1387533 tid 1 2026-02-12T17:40:08.106 INFO:tasks.rados.rados.0.trial082.stdout:2656: writing trial08226312-14 from 2073995 to 2756304 tid 2 2026-02-12T17:40:08.106 INFO:tasks.rados.rados.0.trial082.stdout:2657: rollback oid 39 current snap is 286 2026-02-12T17:40:08.106 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 39 to 283 2026-02-12T17:40:08.106 INFO:tasks.rados.rados.0.trial082.stdout:2656: finishing write tid 1 to trial08226312-14 2026-02-12T17:40:08.106 INFO:tasks.rados.rados.0.trial082.stdout:2655: done (2 left) 2026-02-12T17:40:08.107 INFO:tasks.rados.rados.0.trial082.stdout:2658: write oid 18 current snap is 286 2026-02-12T17:40:08.107 INFO:tasks.rados.rados.0.trial082.stdout:2658: seq_num 898 ranges {692686=503256,1848830=425967,2910671=182015} 2026-02-12T17:40:08.110 INFO:tasks.rados.rados.0.trial082.stdout:2658: writing trial08226312-18 from 692686 to 1195942 tid 1 2026-02-12T17:40:08.114 INFO:tasks.rados.rados.0.trial082.stdout:2658: writing trial08226312-18 from 1848830 to 2274797 tid 2 2026-02-12T17:40:08.117 INFO:tasks.rados.rados.0.trial082.stdout:2658: writing trial08226312-18 from 2910671 to 3092686 tid 3 2026-02-12T17:40:08.117 INFO:tasks.rados.rados.0.trial082.stdout:2659: delete oid 19 current snap is 286 2026-02-12T17:40:08.118 INFO:tasks.rados.rados.0.trial082.stdout:2656: finishing write tid 2 to trial08226312-14 2026-02-12T17:40:08.118 INFO:tasks.rados.rados.0.trial082.stdout:2656: finishing write tid 3 to trial08226312-14 2026-02-12T17:40:08.118 INFO:tasks.rados.rados.0.trial082.stdout:2656: finishing write tid 4 to trial08226312-14 2026-02-12T17:40:08.118 INFO:tasks.rados.rados.0.trial082.stdout:2656: oid 14 updating version 0 to 1150 2026-02-12T17:40:08.118 INFO:tasks.rados.rados.0.trial082.stdout:2656: oid 14 updating version 1150 to 1152 2026-02-12T17:40:08.118 INFO:tasks.rados.rados.0.trial082.stdout:2656: oid 14 version 1152 is already newer than 1151 2026-02-12T17:40:08.118 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 1152 (ObjNum 897 snap 286 seq_num 897) dirty exists 2026-02-12T17:40:08.118 INFO:tasks.rados.rados.0.trial082.stdout:2656: left oid 14 (ObjNum 897 snap 286 seq_num 897) 2026-02-12T17:40:08.118 INFO:tasks.rados.rados.0.trial082.stdout:2657: finishing rollback tid 0 to trial08226312-39 2026-02-12T17:40:08.119 INFO:tasks.rados.rados.0.trial082.stdout:2657: finishing rollback tid 1 to trial08226312-39 2026-02-12T17:40:08.119 INFO:tasks.rados.rados.0.trial082.stdout:2657: finishing rollback tid 2 to trial08226312-39 2026-02-12T17:40:08.119 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 959 (ObjNum 816 snap 253 seq_num 816) dirty exists 2026-02-12T17:40:08.119 INFO:tasks.rados.rados.0.trial082.stdout:2658: finishing write tid 1 to trial08226312-18 2026-02-12T17:40:08.119 INFO:tasks.rados.rados.0.trial082.stdout:2658: finishing write tid 2 to trial08226312-18 2026-02-12T17:40:08.120 INFO:tasks.rados.rados.0.trial082.stdout:2658: finishing write tid 3 to trial08226312-18 2026-02-12T17:40:08.120 INFO:tasks.rados.rados.0.trial082.stdout:2658: finishing write tid 4 to trial08226312-18 2026-02-12T17:40:08.120 INFO:tasks.rados.rados.0.trial082.stdout:2658: finishing write tid 5 to trial08226312-18 2026-02-12T17:40:08.120 INFO:tasks.rados.rados.0.trial082.stdout:2658: oid 18 updating version 0 to 1557 2026-02-12T17:40:08.120 INFO:tasks.rados.rados.0.trial082.stdout:2658: oid 18 updating version 1557 to 1559 2026-02-12T17:40:08.120 INFO:tasks.rados.rados.0.trial082.stdout:2658: oid 18 version 1559 is already newer than 1556 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:2658: oid 18 version 1559 is already newer than 1558 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 1559 (ObjNum 898 snap 286 seq_num 898) dirty exists 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:2658: left oid 18 (ObjNum 898 snap 286 seq_num 898) 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:2656: done (3 left) 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:2657: done (2 left) 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:2658: done (1 left) 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:2659: done (0 left) 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:2660: rollback oid 50 current snap is 286 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 275 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:2661: write (excl) oid 17 current snap is 286 2026-02-12T17:40:08.121 INFO:tasks.rados.rados.0.trial082.stdout:2661: seq_num 900 ranges {726300=653754,1965794=429636,2965517=160783} 2026-02-12T17:40:08.124 INFO:tasks.rados.rados.0.trial082.stdout:2661: writing trial08226312-17 from 726300 to 1380054 tid 1 2026-02-12T17:40:08.128 INFO:tasks.rados.rados.0.trial082.stdout:2661: writing trial08226312-17 from 1965794 to 2395430 tid 2 2026-02-12T17:40:08.131 INFO:tasks.rados.rados.0.trial082.stdout:2661: writing trial08226312-17 from 2965517 to 3126300 tid 3 2026-02-12T17:40:08.131 INFO:tasks.rados.rados.0.trial082.stdout:2662: delete oid 5 current snap is 286 2026-02-12T17:40:08.131 INFO:tasks.rados.rados.0.trial082.stdout:2660: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:40:08.131 INFO:tasks.rados.rados.0.trial082.stdout:2660: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:40:08.131 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 1593 (ObjNum 129 snap 0 seq_num 27723863) dirty dne 2026-02-12T17:40:08.132 INFO:tasks.rados.rados.0.trial082.stdout:2661: finishing write tid 1 to trial08226312-17 2026-02-12T17:40:08.132 INFO:tasks.rados.rados.0.trial082.stdout:2661: finishing write tid 2 to trial08226312-17 2026-02-12T17:40:08.133 INFO:tasks.rados.rados.0.trial082.stdout:2660: done (2 left) 2026-02-12T17:40:08.133 INFO:tasks.rados.rados.0.trial082.stdout:2662: done (1 left) 2026-02-12T17:40:08.133 INFO:tasks.rados.rados.0.trial082.stdout:2663: delete oid 50 current snap is 286 2026-02-12T17:40:08.133 INFO:tasks.rados.rados.0.trial082.stdout:2661: finishing write tid 3 to trial08226312-17 2026-02-12T17:40:08.133 INFO:tasks.rados.rados.0.trial082.stdout:2661: finishing write tid 4 to trial08226312-17 2026-02-12T17:40:08.133 INFO:tasks.rados.rados.0.trial082.stdout:2661: finishing write tid 5 to trial08226312-17 2026-02-12T17:40:08.133 INFO:tasks.rados.rados.0.trial082.stdout:2661: oid 17 updating version 0 to 2048 2026-02-12T17:40:08.133 INFO:tasks.rados.rados.0.trial082.stdout:2661: oid 17 version 2048 is already newer than 2047 2026-02-12T17:40:08.133 INFO:tasks.rados.rados.0.trial082.stdout:2661: oid 17 version 2048 is already newer than 2045 2026-02-12T17:40:08.134 INFO:tasks.rados.rados.0.trial082.stdout:2661: oid 17 version 2048 is already newer than 2046 2026-02-12T17:40:08.134 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2048 (ObjNum 900 snap 286 seq_num 900) dirty exists 2026-02-12T17:40:08.134 INFO:tasks.rados.rados.0.trial082.stdout:2661: left oid 17 (ObjNum 900 snap 286 seq_num 900) 2026-02-12T17:40:08.134 INFO:tasks.rados.rados.0.trial082.stdout:2661: done (1 left) 2026-02-12T17:40:08.135 INFO:tasks.rados.rados.0.trial082.stdout:2663: done (0 left) 2026-02-12T17:40:08.135 INFO:tasks.rados.rados.0.trial082.stdout:2664: copy_from oid 20 from oid 42 current snap is 286 2026-02-12T17:40:08.135 INFO:tasks.rados.rados.0.trial082.stdout:2665: copy_from oid 34 from oid 48 current snap is 286 2026-02-12T17:40:08.135 INFO:tasks.rados.rados.0.trial082.stdout:2666: write oid 37 current snap is 286 2026-02-12T17:40:08.135 INFO:tasks.rados.rados.0.trial082.stdout:2666: seq_num 903 ranges {776721=479501,2024887=693316} 2026-02-12T17:40:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2666: writing trial08226312-37 from 776721 to 1256222 tid 1 2026-02-12T17:40:08.144 INFO:tasks.rados.rados.0.trial082.stdout:2666: writing trial08226312-37 from 2024887 to 2718203 tid 2 2026-02-12T17:40:08.144 INFO:tasks.rados.rados.0.trial082.stdout:2667: copy_from oid 3 from oid 31 current snap is 286 2026-02-12T17:40:08.144 INFO:tasks.rados.rados.0.trial082.stdout:2665: finishing copy_from racing read to trial08226312-34 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2665: finishing copy_from to trial08226312-34 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 839 (ObjNum 886 snap 281 seq_num 886) dirty exists 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2666: finishing write tid 1 to trial08226312-37 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2664: finishing copy_from racing read to trial08226312-20 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2664: finishing copy_from to trial08226312-20 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 1597 (ObjNum 895 snap 284 seq_num 895) dirty exists 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2664: done (3 left) 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2665: done (2 left) 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2668: read oid 47 snap 281 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2668: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2669: copy_from oid 50 from oid 35 current snap is 286 2026-02-12T17:40:08.145 INFO:tasks.rados.rados.0.trial082.stdout:2670: read oid 25 snap -1 2026-02-12T17:40:08.146 INFO:tasks.rados.rados.0.trial082.stdout:2670: expect deleted 2026-02-12T17:40:08.146 INFO:tasks.rados.rados.0.trial082.stdout:2671: snap_remove snap 265 2026-02-12T17:40:09.100 INFO:tasks.rados.rados.0.trial082.stdout:2671: done (5 left) 2026-02-12T17:40:09.100 INFO:tasks.rados.rados.0.trial082.stdout:2672: snap_remove snap 250 2026-02-12T17:40:10.101 INFO:tasks.rados.rados.0.trial082.stdout:2672: done (5 left) 2026-02-12T17:40:10.102 INFO:tasks.rados.rados.0.trial082.stdout:2673: read oid 23 snap -1 2026-02-12T17:40:10.102 INFO:tasks.rados.rados.0.trial082.stdout:2673: expect (ObjNum 857 snap 270 seq_num 857) 2026-02-12T17:40:10.102 INFO:tasks.rados.rados.0.trial082.stdout:2674: write oid 17 current snap is 286 2026-02-12T17:40:10.102 INFO:tasks.rados.rados.0.trial082.stdout:2674: seq_num 904 ranges {793528=554750,2083369=436974,2958856=234672} 2026-02-12T17:40:10.107 INFO:tasks.rados.rados.0.trial082.stdout:2674: writing trial08226312-17 from 793528 to 1348278 tid 1 2026-02-12T17:40:10.111 INFO:tasks.rados.rados.0.trial082.stdout:2674: writing trial08226312-17 from 2083369 to 2520343 tid 2 2026-02-12T17:40:10.114 INFO:tasks.rados.rados.0.trial082.stdout:2674: writing trial08226312-17 from 2958856 to 3193528 tid 3 2026-02-12T17:40:10.114 INFO:tasks.rados.rados.0.trial082.stdout:2675: delete oid 14 current snap is 286 2026-02-12T17:40:10.114 INFO:tasks.rados.rados.0.trial082.stdout:2668: expect (ObjNum 758 snap 231 seq_num 758) 2026-02-12T17:40:10.182 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 726088 2026-02-12T17:40:10.208 INFO:tasks.rados.rados.0.trial082.stdout:2666: finishing write tid 2 to trial08226312-37 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2666: finishing write tid 3 to trial08226312-37 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2666: finishing write tid 4 to trial08226312-37 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2666: oid 37 updating version 0 to 1930 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2666: oid 37 version 1930 is already newer than 1928 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2666: oid 37 version 1930 is already newer than 1929 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1930 (ObjNum 903 snap 286 seq_num 903) dirty exists 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2666: left oid 37 (ObjNum 903 snap 286 seq_num 903) 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2667: finishing copy_from racing read to trial08226312-3 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2667: finishing copy_from to trial08226312-3 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1122 (ObjNum 885 snap 281 seq_num 885) dirty exists 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2669: finishing copy_from racing read to trial08226312-50 2026-02-12T17:40:10.209 INFO:tasks.rados.rados.0.trial082.stdout:2669: finishing copy_from to trial08226312-50 2026-02-12T17:40:10.210 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 1860 (ObjNum 875 snap 277 seq_num 875) dirty exists 2026-02-12T17:40:10.210 INFO:tasks.rados.rados.0.trial082.stdout:2673: expect (ObjNum 857 snap 270 seq_num 857) 2026-02-12T17:40:10.215 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2397781 2026-02-12T17:40:10.234 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2674: finishing write tid 1 to trial08226312-17 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2674: finishing write tid 2 to trial08226312-17 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2666: done (7 left) 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2667: done (6 left) 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2668: done (5 left) 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2669: done (4 left) 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2670: done (3 left) 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2673: done (2 left) 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2675: done (1 left) 2026-02-12T17:40:10.252 INFO:tasks.rados.rados.0.trial082.stdout:2676: read oid 45 snap -1 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2676: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2677: read oid 26 snap -1 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2677: expect (ObjNum 891 snap 283 seq_num 891) 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2678: delete oid 20 current snap is 286 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2674: finishing write tid 3 to trial08226312-17 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2674: finishing write tid 4 to trial08226312-17 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2674: finishing write tid 5 to trial08226312-17 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2674: oid 17 updating version 0 to 2070 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2674: oid 17 updating version 2070 to 2075 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2674: oid 17 updating version 2075 to 2076 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:2674: oid 17 updating version 2076 to 2077 2026-02-12T17:40:10.253 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2077 (ObjNum 904 snap 286 seq_num 904) dirty exists 2026-02-12T17:40:10.254 INFO:tasks.rados.rados.0.trial082.stdout:2674: left oid 17 (ObjNum 904 snap 286 seq_num 904) 2026-02-12T17:40:10.254 INFO:tasks.rados.rados.0.trial082.stdout:2676: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:40:10.260 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 958864 2026-02-12T17:40:10.405 INFO:tasks.rados.rados.0.trial082.stdout:2677: expect (ObjNum 891 snap 283 seq_num 891) 2026-02-12T17:40:10.420 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1824182 2026-02-12T17:40:10.470 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:10.506 INFO:tasks.rados.rados.0.trial082.stdout:2674: done (3 left) 2026-02-12T17:40:10.506 INFO:tasks.rados.rados.0.trial082.stdout:2676: done (2 left) 2026-02-12T17:40:10.506 INFO:tasks.rados.rados.0.trial082.stdout:2677: done (1 left) 2026-02-12T17:40:10.506 INFO:tasks.rados.rados.0.trial082.stdout:2678: done (0 left) 2026-02-12T17:40:10.506 INFO:tasks.rados.rados.0.trial082.stdout:2679: snap_create 2026-02-12T17:40:11.107 INFO:tasks.rados.rados.0.trial082.stdout:2679: done (0 left) 2026-02-12T17:40:11.107 INFO:tasks.rados.rados.0.trial082.stdout:2680: write (excl) oid 28 current snap is 287 2026-02-12T17:40:11.107 INFO:tasks.rados.rados.0.trial082.stdout:2680: seq_num 907 ranges {443949=496850,1458815=584301,2641125=602824} 2026-02-12T17:40:11.110 INFO:tasks.rados.rados.0.trial082.stdout:2680: writing trial08226312-28 from 443949 to 940799 tid 1 2026-02-12T17:40:11.114 INFO:tasks.rados.rados.0.trial082.stdout:2680: writing trial08226312-28 from 1458815 to 2043116 tid 2 2026-02-12T17:40:11.119 INFO:tasks.rados.rados.0.trial082.stdout:2680: writing trial08226312-28 from 2641125 to 3243949 tid 3 2026-02-12T17:40:11.119 INFO:tasks.rados.rados.0.trial082.stdout:2681: copy_from oid 25 from oid 26 current snap is 287 2026-02-12T17:40:11.120 INFO:tasks.rados.rados.0.trial082.stdout:2680: finishing write tid 1 to trial08226312-28 2026-02-12T17:40:11.120 INFO:tasks.rados.rados.0.trial082.stdout:2680: finishing write tid 2 to trial08226312-28 2026-02-12T17:40:11.120 INFO:tasks.rados.rados.0.trial082.stdout:2682: read oid 33 snap -1 2026-02-12T17:40:11.120 INFO:tasks.rados.rados.0.trial082.stdout:2682: expect deleted 2026-02-12T17:40:11.120 INFO:tasks.rados.rados.0.trial082.stdout:2683: write (excl) oid 36 current snap is 287 2026-02-12T17:40:11.120 INFO:tasks.rados.rados.0.trial082.stdout:2683: seq_num 908 ranges {460756=572099,1517297=444312,2668548=472870} 2026-02-12T17:40:11.123 INFO:tasks.rados.rados.0.trial082.stdout:2683: writing trial08226312-36 from 460756 to 1032855 tid 1 2026-02-12T17:40:11.126 INFO:tasks.rados.rados.0.trial082.stdout:2683: writing trial08226312-36 from 1517297 to 1961609 tid 2 2026-02-12T17:40:11.131 INFO:tasks.rados.rados.0.trial082.stdout:2683: writing trial08226312-36 from 2668548 to 3141418 tid 3 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2684: copy_from oid 29 from oid 43 current snap is 287 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2680: finishing write tid 3 to trial08226312-28 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2680: finishing write tid 4 to trial08226312-28 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2680: finishing write tid 5 to trial08226312-28 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2680: oid 28 updating version 0 to 1605 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2680: oid 28 version 1605 is already newer than 1603 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2680: oid 28 version 1605 is already newer than 1602 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2680: oid 28 version 1605 is already newer than 1604 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1605 (ObjNum 907 snap 287 seq_num 907) dirty exists 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2680: left oid 28 (ObjNum 907 snap 287 seq_num 907) 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2683: finishing write tid 1 to trial08226312-36 2026-02-12T17:40:11.132 INFO:tasks.rados.rados.0.trial082.stdout:2681: finishing copy_from racing read to trial08226312-25 2026-02-12T17:40:11.133 INFO:tasks.rados.rados.0.trial082.stdout:2681: finishing copy_from to trial08226312-25 2026-02-12T17:40:11.133 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 1863 (ObjNum 891 snap 283 seq_num 891) dirty exists 2026-02-12T17:40:11.133 INFO:tasks.rados.rados.0.trial082.stdout:2683: finishing write tid 2 to trial08226312-36 2026-02-12T17:40:11.133 INFO:tasks.rados.rados.0.trial082.stdout:2680: done (4 left) 2026-02-12T17:40:11.133 INFO:tasks.rados.rados.0.trial082.stdout:2681: done (3 left) 2026-02-12T17:40:11.133 INFO:tasks.rados.rados.0.trial082.stdout:2682: done (2 left) 2026-02-12T17:40:11.133 INFO:tasks.rados.rados.0.trial082.stdout:2685: copy_from oid 25 from oid 7 current snap is 287 2026-02-12T17:40:11.133 INFO:tasks.rados.rados.0.trial082.stdout:2686: snap_create 2026-02-12T17:40:11.134 INFO:tasks.rados.rados.0.trial082.stdout:2683: finishing write tid 3 to trial08226312-36 2026-02-12T17:40:11.134 INFO:tasks.rados.rados.0.trial082.stdout:2683: finishing write tid 4 to trial08226312-36 2026-02-12T17:40:11.134 INFO:tasks.rados.rados.0.trial082.stdout:2683: finishing write tid 5 to trial08226312-36 2026-02-12T17:40:11.134 INFO:tasks.rados.rados.0.trial082.stdout:2683: oid 36 updating version 0 to 1866 2026-02-12T17:40:11.134 INFO:tasks.rados.rados.0.trial082.stdout:2683: oid 36 version 1866 is already newer than 1864 2026-02-12T17:40:11.134 INFO:tasks.rados.rados.0.trial082.stdout:2683: oid 36 version 1866 is already newer than 1865 2026-02-12T17:40:11.134 INFO:tasks.rados.rados.0.trial082.stdout:2683: oid 36 updating version 1866 to 1867 2026-02-12T17:40:11.135 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 1867 (ObjNum 908 snap 287 seq_num 908) dirty exists 2026-02-12T17:40:11.135 INFO:tasks.rados.rados.0.trial082.stdout:2683: left oid 36 (ObjNum 908 snap 287 seq_num 908) 2026-02-12T17:40:11.135 INFO:tasks.rados.rados.0.trial082.stdout:2685: finishing copy_from racing read to trial08226312-25 2026-02-12T17:40:11.135 INFO:tasks.rados.rados.0.trial082.stdout:2685: finishing copy_from to trial08226312-25 2026-02-12T17:40:11.136 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 1593 (ObjNum 876 snap 277 seq_num 876) dirty exists 2026-02-12T17:40:11.137 INFO:tasks.rados.rados.0.trial082.stdout:2684: finishing copy_from racing read to trial08226312-29 2026-02-12T17:40:11.138 INFO:tasks.rados.rados.0.trial082.stdout:2684: finishing copy_from to trial08226312-29 2026-02-12T17:40:11.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 1814 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:40:12.111 INFO:tasks.rados.rados.0.trial082.stdout:2683: done (3 left) 2026-02-12T17:40:12.111 INFO:tasks.rados.rados.0.trial082.stdout:2684: done (2 left) 2026-02-12T17:40:12.111 INFO:tasks.rados.rados.0.trial082.stdout:2685: done (1 left) 2026-02-12T17:40:12.111 INFO:tasks.rados.rados.0.trial082.stdout:2686: done (0 left) 2026-02-12T17:40:12.111 INFO:tasks.rados.rados.0.trial082.stdout:2687: snap_remove snap 271 2026-02-12T17:40:13.086 INFO:tasks.rados.rados.0.trial082.stdout:2687: done (0 left) 2026-02-12T17:40:13.087 INFO:tasks.rados.rados.0.trial082.stdout:2688: write (excl) oid 3 current snap is 288 2026-02-12T17:40:13.087 INFO:tasks.rados.rados.0.trial082.stdout:2688: seq_num 909 ranges {477563=647348,1859426=587970,2979618=297945} 2026-02-12T17:40:13.091 INFO:tasks.rados.rados.0.trial082.stdout:2688: writing trial08226312-3 from 477563 to 1124911 tid 1 2026-02-12T17:40:13.096 INFO:tasks.rados.rados.0.trial082.stdout:2688: writing trial08226312-3 from 1859426 to 2447396 tid 2 2026-02-12T17:40:13.100 INFO:tasks.rados.rados.0.trial082.stdout:2688: writing trial08226312-3 from 2979618 to 3277563 tid 3 2026-02-12T17:40:13.100 INFO:tasks.rados.rados.0.trial082.stdout:2689: read oid 4 snap 282 2026-02-12T17:40:13.100 INFO:tasks.rados.rados.0.trial082.stdout:2689: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:40:13.100 INFO:tasks.rados.rados.0.trial082.stdout:2690: snap_remove snap 264 2026-02-12T17:40:14.090 INFO:tasks.rados.rados.0.trial082.stdout:2690: done (2 left) 2026-02-12T17:40:14.090 INFO:tasks.rados.rados.0.trial082.stdout:2691: write oid 30 current snap is 288 2026-02-12T17:40:14.091 INFO:tasks.rados.rados.0.trial082.stdout:2691: seq_num 910 ranges {494370=722597,1917908=447981,3007041=287329} 2026-02-12T17:40:14.095 INFO:tasks.rados.rados.0.trial082.stdout:2691: writing trial08226312-30 from 494370 to 1216967 tid 1 2026-02-12T17:40:14.100 INFO:tasks.rados.rados.0.trial082.stdout:2691: writing trial08226312-30 from 1917908 to 2365889 tid 2 2026-02-12T17:40:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2691: writing trial08226312-30 from 3007041 to 3294370 tid 3 2026-02-12T17:40:14.103 INFO:tasks.rados.rados.0.trial082.stdout:2692: delete oid 14 current snap is 288 2026-02-12T17:40:14.104 INFO:tasks.rados.rados.0.trial082.stdout:2688: finishing write tid 1 to trial08226312-3 2026-02-12T17:40:14.104 INFO:tasks.rados.rados.0.trial082.stdout:2688: finishing write tid 2 to trial08226312-3 2026-02-12T17:40:14.104 INFO:tasks.rados.rados.0.trial082.stdout:2689: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:40:14.110 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1442306 2026-02-12T17:40:14.139 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1984858 2026-02-12T17:40:14.149 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1049246 2026-02-12T17:40:14.162 INFO:tasks.rados.rados.0.trial082.stdout:2688: finishing write tid 3 to trial08226312-3 2026-02-12T17:40:14.162 INFO:tasks.rados.rados.0.trial082.stdout:2688: finishing write tid 4 to trial08226312-3 2026-02-12T17:40:14.162 INFO:tasks.rados.rados.0.trial082.stdout:2689: done (3 left) 2026-02-12T17:40:14.162 INFO:tasks.rados.rados.0.trial082.stdout:2692: done (2 left) 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:2693: write oid 20 current snap is 288 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:2688: finishing write tid 5 to trial08226312-3 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:2688: oid 3 updating version 0 to 1169 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:2688: oid 3 version 1169 is already newer than 1168 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:2688: oid 3 updating version 1169 to 1170 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:2688: oid 3 version 1170 is already newer than 1167 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1170 (ObjNum 909 snap 288 seq_num 909) dirty exists 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:2688: left oid 3 (ObjNum 909 snap 288 seq_num 909) 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:2691: finishing write tid 1 to trial08226312-30 2026-02-12T17:40:14.163 INFO:tasks.rados.rados.0.trial082.stdout:2691: finishing write tid 2 to trial08226312-30 2026-02-12T17:40:14.164 INFO:tasks.rados.rados.0.trial082.stdout:2693: seq_num 912 ranges {527984=473095,1634872=451650,2661887=634311} 2026-02-12T17:40:14.166 INFO:tasks.rados.rados.0.trial082.stdout:2693: writing trial08226312-20 from 527984 to 1001079 tid 1 2026-02-12T17:40:14.170 INFO:tasks.rados.rados.0.trial082.stdout:2693: writing trial08226312-20 from 1634872 to 2086522 tid 2 2026-02-12T17:40:14.175 INFO:tasks.rados.rados.0.trial082.stdout:2693: writing trial08226312-20 from 2661887 to 3296198 tid 3 2026-02-12T17:40:14.175 INFO:tasks.rados.rados.0.trial082.stdout:2688: done (2 left) 2026-02-12T17:40:14.175 INFO:tasks.rados.rados.0.trial082.stdout:2694: copy_from oid 42 from oid 25 current snap is 288 2026-02-12T17:40:14.175 INFO:tasks.rados.rados.0.trial082.stdout:2691: finishing write tid 3 to trial08226312-30 2026-02-12T17:40:14.175 INFO:tasks.rados.rados.0.trial082.stdout:2691: finishing write tid 4 to trial08226312-30 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:2691: finishing write tid 5 to trial08226312-30 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:2691: oid 30 updating version 0 to 1816 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:2691: oid 30 updating version 1816 to 1819 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:2691: oid 30 version 1819 is already newer than 1817 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:2691: oid 30 version 1819 is already newer than 1818 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1819 (ObjNum 910 snap 288 seq_num 910) dirty exists 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:2691: left oid 30 (ObjNum 910 snap 288 seq_num 910) 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:2693: finishing write tid 1 to trial08226312-20 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:2693: finishing write tid 2 to trial08226312-20 2026-02-12T17:40:14.176 INFO:tasks.rados.rados.0.trial082.stdout:2691: done (2 left) 2026-02-12T17:40:14.177 INFO:tasks.rados.rados.0.trial082.stdout:2695: rollback oid 49 current snap is 288 2026-02-12T17:40:14.177 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 283 2026-02-12T17:40:14.177 INFO:tasks.rados.rados.0.trial082.stdout:2696: delete oid 8 current snap is 288 2026-02-12T17:40:14.177 INFO:tasks.rados.rados.0.trial082.stdout:2695: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:40:14.177 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:40:14.178 INFO:tasks.rados.rados.0.trial082.stdout:2693: finishing write tid 3 to trial08226312-20 2026-02-12T17:40:14.178 INFO:tasks.rados.rados.0.trial082.stdout:2693: finishing write tid 4 to trial08226312-20 2026-02-12T17:40:14.178 INFO:tasks.rados.rados.0.trial082.stdout:2693: finishing write tid 5 to trial08226312-20 2026-02-12T17:40:14.178 INFO:tasks.rados.rados.0.trial082.stdout:2693: oid 20 updating version 0 to 2106 2026-02-12T17:40:14.178 INFO:tasks.rados.rados.0.trial082.stdout:2693: oid 20 version 2106 is already newer than 2103 2026-02-12T17:40:14.178 INFO:tasks.rados.rados.0.trial082.stdout:2693: oid 20 version 2106 is already newer than 2104 2026-02-12T17:40:14.178 INFO:tasks.rados.rados.0.trial082.stdout:2693: oid 20 version 2106 is already newer than 2105 2026-02-12T17:40:14.179 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 2106 (ObjNum 912 snap 288 seq_num 912) dirty exists 2026-02-12T17:40:14.179 INFO:tasks.rados.rados.0.trial082.stdout:2693: left oid 20 (ObjNum 912 snap 288 seq_num 912) 2026-02-12T17:40:14.179 INFO:tasks.rados.rados.0.trial082.stdout:2693: done (3 left) 2026-02-12T17:40:14.179 INFO:tasks.rados.rados.0.trial082.stdout:2695: done (2 left) 2026-02-12T17:40:14.179 INFO:tasks.rados.rados.0.trial082.stdout:2696: done (1 left) 2026-02-12T17:40:14.179 INFO:tasks.rados.rados.0.trial082.stdout:2697: snap_remove snap 282 2026-02-12T17:40:15.113 INFO:tasks.rados.rados.0.trial082.stdout:2697: done (1 left) 2026-02-12T17:40:15.113 INFO:tasks.rados.rados.0.trial082.stdout:2698: delete oid 24 current snap is 288 2026-02-12T17:40:15.113 INFO:tasks.rados.rados.0.trial082.stdout:2694: finishing copy_from racing read to trial08226312-42 2026-02-12T17:40:15.114 INFO:tasks.rados.rados.0.trial082.stdout:2694: finishing copy_from to trial08226312-42 2026-02-12T17:40:15.114 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 1593 (ObjNum 876 snap 277 seq_num 876) dirty exists 2026-02-12T17:40:15.117 INFO:tasks.rados.rados.0.trial082.stdout:2694: done (1 left) 2026-02-12T17:40:15.117 INFO:tasks.rados.rados.0.trial082.stdout:2698: done (0 left) 2026-02-12T17:40:15.117 INFO:tasks.rados.rados.0.trial082.stdout:2699: read oid 27 snap -1 2026-02-12T17:40:15.118 INFO:tasks.rados.rados.0.trial082.stdout:2699: expect (ObjNum 873 snap 275 seq_num 873) 2026-02-12T17:40:15.118 INFO:tasks.rados.rados.0.trial082.stdout:2700: write oid 32 current snap is 288 2026-02-12T17:40:15.118 INFO:tasks.rados.rados.0.trial082.stdout:2700: seq_num 915 ranges {578405=415195,1410318=598977,2744156=584480} 2026-02-12T17:40:15.120 INFO:tasks.rados.rados.0.trial082.stdout:2700: writing trial08226312-32 from 578405 to 993600 tid 1 2026-02-12T17:40:15.124 INFO:tasks.rados.rados.0.trial082.stdout:2700: writing trial08226312-32 from 1410318 to 2009295 tid 2 2026-02-12T17:40:15.129 INFO:tasks.rados.rados.0.trial082.stdout:2700: writing trial08226312-32 from 2744156 to 3328636 tid 3 2026-02-12T17:40:15.129 INFO:tasks.rados.rados.0.trial082.stdout:2701: write (excl) oid 23 current snap is 288 2026-02-12T17:40:15.129 INFO:tasks.rados.rados.0.trial082.stdout:2701: seq_num 916 ranges {595212=490444,1868800=458988,2887932=507280} 2026-02-12T17:40:15.133 INFO:tasks.rados.rados.0.trial082.stdout:2701: writing trial08226312-23 from 595212 to 1085656 tid 1 2026-02-12T17:40:15.138 INFO:tasks.rados.rados.0.trial082.stdout:2701: writing trial08226312-23 from 1868800 to 2327788 tid 2 2026-02-12T17:40:15.142 INFO:tasks.rados.rados.0.trial082.stdout:2701: writing trial08226312-23 from 2887932 to 3395212 tid 3 2026-02-12T17:40:15.142 INFO:tasks.rados.rados.0.trial082.stdout:2702: delete oid 5 current snap is 288 2026-02-12T17:40:15.143 INFO:tasks.rados.rados.0.trial082.stdout:2699: expect (ObjNum 873 snap 275 seq_num 873) 2026-02-12T17:40:15.149 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1822397 2026-02-12T17:40:15.157 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1455860 2026-02-12T17:40:15.187 INFO:tasks.rados.rados.0.trial082.stdout:2700: finishing write tid 1 to trial08226312-32 2026-02-12T17:40:15.187 INFO:tasks.rados.rados.0.trial082.stdout:2700: finishing write tid 2 to trial08226312-32 2026-02-12T17:40:15.187 INFO:tasks.rados.rados.0.trial082.stdout:2700: finishing write tid 3 to trial08226312-32 2026-02-12T17:40:15.187 INFO:tasks.rados.rados.0.trial082.stdout:2700: finishing write tid 4 to trial08226312-32 2026-02-12T17:40:15.187 INFO:tasks.rados.rados.0.trial082.stdout:2700: finishing write tid 5 to trial08226312-32 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2700: oid 32 updating version 0 to 1550 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2700: oid 32 updating version 1550 to 1551 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2700: oid 32 updating version 1551 to 1552 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2700: oid 32 updating version 1552 to 1553 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 1553 (ObjNum 915 snap 288 seq_num 915) dirty exists 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2700: left oid 32 (ObjNum 915 snap 288 seq_num 915) 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2701: finishing write tid 1 to trial08226312-23 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2701: finishing write tid 2 to trial08226312-23 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2701: finishing write tid 3 to trial08226312-23 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2701: finishing write tid 4 to trial08226312-23 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2701: finishing write tid 5 to trial08226312-23 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2701: oid 23 updating version 0 to 1868 2026-02-12T17:40:15.188 INFO:tasks.rados.rados.0.trial082.stdout:2701: oid 23 updating version 1868 to 1869 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2701: oid 23 updating version 1869 to 1870 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2701: oid 23 updating version 1870 to 1871 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 1871 (ObjNum 916 snap 288 seq_num 916) dirty exists 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2701: left oid 23 (ObjNum 916 snap 288 seq_num 916) 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2699: done (3 left) 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2700: done (2 left) 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2701: done (1 left) 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2702: done (0 left) 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2703: rollback oid 5 current snap is 288 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 5 to 283 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2704: write (excl) oid 17 current snap is 288 2026-02-12T17:40:15.189 INFO:tasks.rados.rados.0.trial082.stdout:2704: seq_num 918 ranges {628826=640942,1869411=462657,2826425=534649} 2026-02-12T17:40:15.192 INFO:tasks.rados.rados.0.trial082.stdout:2704: writing trial08226312-17 from 628826 to 1269768 tid 1 2026-02-12T17:40:15.196 INFO:tasks.rados.rados.0.trial082.stdout:2704: writing trial08226312-17 from 1869411 to 2332068 tid 2 2026-02-12T17:40:15.200 INFO:tasks.rados.rados.0.trial082.stdout:2704: writing trial08226312-17 from 2826425 to 3361074 tid 3 2026-02-12T17:40:15.200 INFO:tasks.rados.rados.0.trial082.stdout:2705: write oid 47 current snap is 288 2026-02-12T17:40:15.200 INFO:tasks.rados.rados.0.trial082.stdout:2705: seq_num 919 ranges {645633=716191,1927893=606315,3137495=308138} 2026-02-12T17:40:15.205 INFO:tasks.rados.rados.0.trial082.stdout:2705: writing trial08226312-47 from 645633 to 1361824 tid 1 2026-02-12T17:40:15.209 INFO:tasks.rados.rados.0.trial082.stdout:2705: writing trial08226312-47 from 1927893 to 2534208 tid 2 2026-02-12T17:40:15.213 INFO:tasks.rados.rados.0.trial082.stdout:2705: writing trial08226312-47 from 3137495 to 3445633 tid 3 2026-02-12T17:40:15.213 INFO:tasks.rados.rados.0.trial082.stdout:2706: snap_create 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2703: finishing rollback tid 1 to trial08226312-5 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2703: finishing rollback tid 2 to trial08226312-5 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 1184 (ObjNum 872 snap 275 seq_num 872) dirty exists 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2704: finishing write tid 1 to trial08226312-17 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2704: finishing write tid 2 to trial08226312-17 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2704: finishing write tid 3 to trial08226312-17 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2704: finishing write tid 4 to trial08226312-17 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2704: finishing write tid 5 to trial08226312-17 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2704: oid 17 updating version 0 to 2116 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2704: oid 17 updating version 2116 to 2117 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2704: oid 17 updating version 2117 to 2118 2026-02-12T17:40:15.214 INFO:tasks.rados.rados.0.trial082.stdout:2704: oid 17 updating version 2118 to 2119 2026-02-12T17:40:15.215 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2119 (ObjNum 918 snap 288 seq_num 918) dirty exists 2026-02-12T17:40:15.215 INFO:tasks.rados.rados.0.trial082.stdout:2704: left oid 17 (ObjNum 918 snap 288 seq_num 918) 2026-02-12T17:40:15.215 INFO:tasks.rados.rados.0.trial082.stdout:2705: finishing write tid 1 to trial08226312-47 2026-02-12T17:40:15.215 INFO:tasks.rados.rados.0.trial082.stdout:2705: finishing write tid 2 to trial08226312-47 2026-02-12T17:40:15.216 INFO:tasks.rados.rados.0.trial082.stdout:2705: finishing write tid 3 to trial08226312-47 2026-02-12T17:40:15.216 INFO:tasks.rados.rados.0.trial082.stdout:2705: finishing write tid 4 to trial08226312-47 2026-02-12T17:40:15.216 INFO:tasks.rados.rados.0.trial082.stdout:2705: finishing write tid 5 to trial08226312-47 2026-02-12T17:40:15.216 INFO:tasks.rados.rados.0.trial082.stdout:2705: oid 47 updating version 0 to 2122 2026-02-12T17:40:15.216 INFO:tasks.rados.rados.0.trial082.stdout:2705: oid 47 updating version 2122 to 2123 2026-02-12T17:40:15.216 INFO:tasks.rados.rados.0.trial082.stdout:2705: oid 47 version 2123 is already newer than 2121 2026-02-12T17:40:15.216 INFO:tasks.rados.rados.0.trial082.stdout:2705: oid 47 updating version 2123 to 2124 2026-02-12T17:40:15.216 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 2124 (ObjNum 919 snap 288 seq_num 919) dirty exists 2026-02-12T17:40:15.216 INFO:tasks.rados.rados.0.trial082.stdout:2705: left oid 47 (ObjNum 919 snap 288 seq_num 919) 2026-02-12T17:40:16.118 INFO:tasks.rados.rados.0.trial082.stdout:2703: done (3 left) 2026-02-12T17:40:16.118 INFO:tasks.rados.rados.0.trial082.stdout:2704: done (2 left) 2026-02-12T17:40:16.118 INFO:tasks.rados.rados.0.trial082.stdout:2705: done (1 left) 2026-02-12T17:40:16.118 INFO:tasks.rados.rados.0.trial082.stdout:2706: done (0 left) 2026-02-12T17:40:16.118 INFO:tasks.rados.rados.0.trial082.stdout:2707: snap_remove snap 288 2026-02-12T17:40:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2707: done (0 left) 2026-02-12T17:40:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2708: rollback oid 33 current snap is 289 2026-02-12T17:40:17.119 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 262 2026-02-12T17:40:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2709: read oid 22 snap -1 2026-02-12T17:40:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2709: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:40:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2710: write oid 44 current snap is 289 2026-02-12T17:40:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2710: seq_num 920 ranges {662440=507793,1702728=749973,2881271=557193} 2026-02-12T17:40:17.123 INFO:tasks.rados.rados.0.trial082.stdout:2710: writing trial08226312-44 from 662440 to 1170233 tid 1 2026-02-12T17:40:17.128 INFO:tasks.rados.rados.0.trial082.stdout:2710: writing trial08226312-44 from 1702728 to 2452701 tid 2 2026-02-12T17:40:17.132 INFO:tasks.rados.rados.0.trial082.stdout:2710: writing trial08226312-44 from 2881271 to 3438464 tid 3 2026-02-12T17:40:17.133 INFO:tasks.rados.rados.0.trial082.stdout:2711: delete oid 49 current snap is 289 2026-02-12T17:40:17.133 INFO:tasks.rados.rados.0.trial082.stdout:2708: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:40:17.133 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:40:17.133 INFO:tasks.rados.rados.0.trial082.stdout:2709: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:40:17.185 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 203259 2026-02-12T17:40:17.249 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1189470 2026-02-12T17:40:17.290 INFO:tasks.rados.rados.0.trial082.stdout:2710: finishing write tid 1 to trial08226312-44 2026-02-12T17:40:17.290 INFO:tasks.rados.rados.0.trial082.stdout:2710: finishing write tid 2 to trial08226312-44 2026-02-12T17:40:17.290 INFO:tasks.rados.rados.0.trial082.stdout:2708: done (3 left) 2026-02-12T17:40:17.290 INFO:tasks.rados.rados.0.trial082.stdout:2709: done (2 left) 2026-02-12T17:40:17.290 INFO:tasks.rados.rados.0.trial082.stdout:2711: done (1 left) 2026-02-12T17:40:17.290 INFO:tasks.rados.rados.0.trial082.stdout:2712: read oid 45 snap -1 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2712: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2713: snap_create 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2710: finishing write tid 3 to trial08226312-44 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2710: finishing write tid 4 to trial08226312-44 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2710: finishing write tid 5 to trial08226312-44 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2710: oid 44 updating version 0 to 1874 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2710: oid 44 version 1874 is already newer than 1872 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2710: oid 44 updating version 1874 to 1875 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2710: oid 44 version 1875 is already newer than 1873 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 1875 (ObjNum 920 snap 289 seq_num 920) dirty exists 2026-02-12T17:40:17.291 INFO:tasks.rados.rados.0.trial082.stdout:2710: left oid 44 (ObjNum 920 snap 289 seq_num 920) 2026-02-12T17:40:17.293 INFO:tasks.rados.rados.0.trial082.stdout:2712: expect (ObjNum 693 snap 208 seq_num 693) 2026-02-12T17:40:17.409 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 958255 2026-02-12T17:40:18.088 INFO:tasks.rados.rados.0.trial082.stdout:2710: done (2 left) 2026-02-12T17:40:18.088 INFO:tasks.rados.rados.0.trial082.stdout:2712: done (1 left) 2026-02-12T17:40:18.089 INFO:tasks.rados.rados.0.trial082.stdout:2713: done (0 left) 2026-02-12T17:40:18.089 INFO:tasks.rados.rados.0.trial082.stdout:2714: write oid 2 current snap is 290 2026-02-12T17:40:18.089 INFO:tasks.rados.rados.0.trial082.stdout:2714: seq_num 922 ranges {696054=658291,2103339=753642} 2026-02-12T17:40:18.093 INFO:tasks.rados.rados.0.trial082.stdout:2714: writing trial08226312-2 from 696054 to 1354345 tid 1 2026-02-12T17:40:18.100 INFO:tasks.rados.rados.0.trial082.stdout:2714: writing trial08226312-2 from 2103339 to 2856981 tid 2 2026-02-12T17:40:18.100 INFO:tasks.rados.rados.0.trial082.stdout:2715: read oid 23 snap 262 2026-02-12T17:40:18.100 INFO:tasks.rados.rados.0.trial082.stdout:2715: expect (ObjNum 808 snap 252 seq_num 808) 2026-02-12T17:40:18.100 INFO:tasks.rados.rados.0.trial082.stdout:2716: rollback oid 32 current snap is 290 2026-02-12T17:40:18.100 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 281 2026-02-12T17:40:18.100 INFO:tasks.rados.rados.0.trial082.stdout:2714: finishing write tid 1 to trial08226312-2 2026-02-12T17:40:18.100 INFO:tasks.rados.rados.0.trial082.stdout:2717: snap_remove snap 289 2026-02-12T17:40:19.089 INFO:tasks.rados.rados.0.trial082.stdout:2717: done (3 left) 2026-02-12T17:40:19.089 INFO:tasks.rados.rados.0.trial082.stdout:2718: write oid 24 current snap is 290 2026-02-12T17:40:19.089 INFO:tasks.rados.rados.0.trial082.stdout:2716: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:40:19.090 INFO:tasks.rados.rados.0.trial082.stdout:2718: seq_num 923 ranges {712861=733540,2161821=613653,3247187=265674} 2026-02-12T17:40:19.095 INFO:tasks.rados.rados.0.trial082.stdout:2718: writing trial08226312-24 from 712861 to 1446401 tid 1 2026-02-12T17:40:19.100 INFO:tasks.rados.rados.0.trial082.stdout:2718: writing trial08226312-24 from 2161821 to 2775474 tid 2 2026-02-12T17:40:19.103 INFO:tasks.rados.rados.0.trial082.stdout:2718: writing trial08226312-24 from 3247187 to 3512861 tid 3 2026-02-12T17:40:19.103 INFO:tasks.rados.rados.0.trial082.stdout:2719: write (excl) oid 12 current snap is 290 2026-02-12T17:40:19.103 INFO:tasks.rados.rados.0.trial082.stdout:2719: seq_num 924 ranges {729668=408789,1820303=757311,3274610=255058} 2026-02-12T17:40:19.107 INFO:tasks.rados.rados.0.trial082.stdout:2719: writing trial08226312-12 from 729668 to 1138457 tid 1 2026-02-12T17:40:19.112 INFO:tasks.rados.rados.0.trial082.stdout:2719: writing trial08226312-12 from 1820303 to 2577614 tid 2 2026-02-12T17:40:19.116 INFO:tasks.rados.rados.0.trial082.stdout:2719: writing trial08226312-12 from 3274610 to 3529668 tid 3 2026-02-12T17:40:19.116 INFO:tasks.rados.rados.0.trial082.stdout:2720: copy_from oid 1 from oid 33 current snap is 290 2026-02-12T17:40:19.116 INFO:tasks.rados.rados.0.trial082.stdout:2714: finishing write tid 2 to trial08226312-2 2026-02-12T17:40:19.116 INFO:tasks.rados.rados.0.trial082.stdout:2716: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:40:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2716: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:40:19.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 1556 (ObjNum 840 snap 265 seq_num 840) dirty exists 2026-02-12T17:40:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2716: done (5 left) 2026-02-12T17:40:19.117 INFO:tasks.rados.rados.0.trial082.stdout:2721: snap_remove snap 281 2026-02-12T17:40:20.090 INFO:tasks.rados.rados.0.trial082.stdout:2721: done (5 left) 2026-02-12T17:40:20.090 INFO:tasks.rados.rados.0.trial082.stdout:2722: write (excl) oid 32 current snap is 290 2026-02-12T17:40:20.090 INFO:tasks.rados.rados.0.trial082.stdout:2722: seq_num 925 ranges {746475=484038,1762432=617322,2785680=529906} 2026-02-12T17:40:20.095 INFO:tasks.rados.rados.0.trial082.stdout:2722: writing trial08226312-32 from 746475 to 1230513 tid 1 2026-02-12T17:40:20.100 INFO:tasks.rados.rados.0.trial082.stdout:2722: writing trial08226312-32 from 1762432 to 2379754 tid 2 2026-02-12T17:40:20.104 INFO:tasks.rados.rados.0.trial082.stdout:2722: writing trial08226312-32 from 2785680 to 3315586 tid 3 2026-02-12T17:40:20.105 INFO:tasks.rados.rados.0.trial082.stdout:2723: write oid 43 current snap is 290 2026-02-12T17:40:20.105 INFO:tasks.rados.rados.0.trial082.stdout:2723: seq_num 926 ranges {763282=559287,1820914=760980,3213103=350179} 2026-02-12T17:40:20.109 INFO:tasks.rados.rados.0.trial082.stdout:2723: writing trial08226312-43 from 763282 to 1322569 tid 1 2026-02-12T17:40:20.114 INFO:tasks.rados.rados.0.trial082.stdout:2723: writing trial08226312-43 from 1820914 to 2581894 tid 2 2026-02-12T17:40:20.119 INFO:tasks.rados.rados.0.trial082.stdout:2723: writing trial08226312-43 from 3213103 to 3563282 tid 3 2026-02-12T17:40:20.119 INFO:tasks.rados.rados.0.trial082.stdout:2724: read oid 50 snap 274 2026-02-12T17:40:20.119 INFO:tasks.rados.rados.0.trial082.stdout:2724: expect (ObjNum 829 snap 256 seq_num 829) 2026-02-12T17:40:20.119 INFO:tasks.rados.rados.0.trial082.stdout:2725: read oid 9 snap -1 2026-02-12T17:40:20.119 INFO:tasks.rados.rados.0.trial082.stdout:2725: expect deleted 2026-02-12T17:40:20.120 INFO:tasks.rados.rados.0.trial082.stdout:2726: copy_from oid 38 from oid 44 current snap is 290 2026-02-12T17:40:20.120 INFO:tasks.rados.rados.0.trial082.stdout:2714: finishing write tid 3 to trial08226312-2 2026-02-12T17:40:20.120 INFO:tasks.rados.rados.0.trial082.stdout:2714: finishing write tid 4 to trial08226312-2 2026-02-12T17:40:20.120 INFO:tasks.rados.rados.0.trial082.stdout:2714: oid 2 updating version 0 to 961 2026-02-12T17:40:20.120 INFO:tasks.rados.rados.0.trial082.stdout:2714: oid 2 version 961 is already newer than 960 2026-02-12T17:40:20.120 INFO:tasks.rados.rados.0.trial082.stdout:2714: oid 2 updating version 961 to 962 2026-02-12T17:40:20.120 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 962 (ObjNum 922 snap 290 seq_num 922) dirty exists 2026-02-12T17:40:20.120 INFO:tasks.rados.rados.0.trial082.stdout:2714: left oid 2 (ObjNum 922 snap 290 seq_num 922) 2026-02-12T17:40:20.120 INFO:tasks.rados.rados.0.trial082.stdout:2715: expect (ObjNum 808 snap 252 seq_num 808) 2026-02-12T17:40:20.126 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1059815 2026-02-12T17:40:20.223 INFO:tasks.rados.rados.0.trial082.stdout:2718: finishing write tid 1 to trial08226312-24 2026-02-12T17:40:20.223 INFO:tasks.rados.rados.0.trial082.stdout:2718: finishing write tid 2 to trial08226312-24 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2718: finishing write tid 3 to trial08226312-24 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2718: finishing write tid 4 to trial08226312-24 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2718: finishing write tid 5 to trial08226312-24 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2718: oid 24 updating version 0 to 2128 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2718: oid 24 version 2128 is already newer than 2125 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2718: oid 24 version 2128 is already newer than 2127 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2718: oid 24 version 2128 is already newer than 2126 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 2128 (ObjNum 923 snap 290 seq_num 923) dirty exists 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2718: left oid 24 (ObjNum 923 snap 290 seq_num 923) 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2719: finishing write tid 1 to trial08226312-12 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2719: finishing write tid 2 to trial08226312-12 2026-02-12T17:40:20.224 INFO:tasks.rados.rados.0.trial082.stdout:2714: done (9 left) 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2715: done (8 left) 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2718: done (7 left) 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2727: copy_from oid 35 from oid 28 current snap is 290 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2720: finishing copy_from to trial08226312-1 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2720: got expected ENOENT (src dne) 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2719: finishing write tid 3 to trial08226312-12 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2720: finishing copy_from racing read to trial08226312-1 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2719: finishing write tid 4 to trial08226312-12 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2719: finishing write tid 5 to trial08226312-12 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2719: oid 12 updating version 0 to 1932 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2719: oid 12 updating version 1932 to 1933 2026-02-12T17:40:20.225 INFO:tasks.rados.rados.0.trial082.stdout:2719: oid 12 updating version 1933 to 1934 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2719: oid 12 version 1934 is already newer than 1931 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1934 (ObjNum 924 snap 290 seq_num 924) dirty exists 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2719: left oid 12 (ObjNum 924 snap 290 seq_num 924) 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2722: finishing write tid 1 to trial08226312-32 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2722: finishing write tid 2 to trial08226312-32 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2722: finishing write tid 3 to trial08226312-32 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2722: finishing write tid 4 to trial08226312-32 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2722: finishing write tid 5 to trial08226312-32 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2722: oid 32 updating version 0 to 1557 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2722: oid 32 updating version 1557 to 1559 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2722: oid 32 version 1559 is already newer than 1558 2026-02-12T17:40:20.226 INFO:tasks.rados.rados.0.trial082.stdout:2722: oid 32 updating version 1559 to 1560 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 1560 (ObjNum 925 snap 290 seq_num 925) dirty exists 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2722: left oid 32 (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: finishing write tid 1 to trial08226312-43 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: finishing write tid 2 to trial08226312-43 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: finishing write tid 3 to trial08226312-43 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: finishing write tid 4 to trial08226312-43 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: finishing write tid 5 to trial08226312-43 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: oid 43 updating version 0 to 1820 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: oid 43 updating version 1820 to 1823 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: oid 43 version 1823 is already newer than 1821 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: oid 43 version 1823 is already newer than 1822 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 1823 (ObjNum 926 snap 290 seq_num 926) dirty exists 2026-02-12T17:40:20.227 INFO:tasks.rados.rados.0.trial082.stdout:2723: left oid 43 (ObjNum 926 snap 290 seq_num 926) 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:2726: finishing copy_from racing read to trial08226312-38 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:2719: done (7 left) 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:2720: done (6 left) 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:2722: done (5 left) 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:2723: done (4 left) 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:2725: done (3 left) 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:2728: rollback oid 41 current snap is 290 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 286 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:2726: finishing copy_from to trial08226312-38 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 1875 (ObjNum 920 snap 289 seq_num 920) dirty exists 2026-02-12T17:40:20.228 INFO:tasks.rados.rados.0.trial082.stdout:2724: expect (ObjNum 829 snap 256 seq_num 829) 2026-02-12T17:40:20.258 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:20.287 INFO:tasks.rados.rados.0.trial082.stdout:2728: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:40:20.287 INFO:tasks.rados.rados.0.trial082.stdout:2728: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:2728: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1937 (ObjNum 878 snap 279 seq_num 878) dirty exists 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:2727: finishing copy_from racing read to trial08226312-35 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:2727: finishing copy_from to trial08226312-35 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1605 (ObjNum 907 snap 287 seq_num 907) dirty exists 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:2724: done (3 left) 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:2726: done (2 left) 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:2727: done (1 left) 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:2728: done (0 left) 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:2729: copy_from oid 38 from oid 7 current snap is 290 2026-02-12T17:40:20.288 INFO:tasks.rados.rados.0.trial082.stdout:2730: read oid 5 snap 283 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:2730: expect (ObjNum 872 snap 275 seq_num 872) 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:2731: copy_from oid 39 from oid 47 current snap is 290 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:2732: copy_from oid 11 from oid 21 current snap is 290 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:2733: read oid 2 snap -1 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:2733: expect (ObjNum 922 snap 290 seq_num 922) 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:2734: copy_from oid 33 from oid 10 current snap is 290 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:2735: copy_from oid 45 from oid 3 current snap is 290 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:2736: rollback oid 16 current snap is 290 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 262 2026-02-12T17:40:20.289 INFO:tasks.rados.rados.0.trial082.stdout:2737: delete oid 31 current snap is 290 2026-02-12T17:40:20.290 INFO:tasks.rados.rados.0.trial082.stdout:2737: done (8 left) 2026-02-12T17:40:20.290 INFO:tasks.rados.rados.0.trial082.stdout:2738: rollback oid 13 current snap is 290 2026-02-12T17:40:20.290 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 287 2026-02-12T17:40:20.290 INFO:tasks.rados.rados.0.trial082.stdout:2739: delete oid 19 current snap is 290 2026-02-12T17:40:20.291 INFO:tasks.rados.rados.0.trial082.stdout:2736: finishing rollback tid 0 to trial08226312-16 2026-02-12T17:40:20.291 INFO:tasks.rados.rados.0.trial082.stdout:2738: finishing rollback tid 0 to trial08226312-13 2026-02-12T17:40:20.291 INFO:tasks.rados.rados.0.trial082.stdout:2733: expect (ObjNum 922 snap 290 seq_num 922) 2026-02-12T17:40:20.344 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2881818 2026-02-12T17:40:20.370 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2883822 2026-02-12T17:40:20.379 INFO:tasks.rados.rados.0.trial082.stdout:2738: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:40:20.379 INFO:tasks.rados.rados.0.trial082.stdout:2736: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:40:20.379 INFO:tasks.rados.rados.0.trial082.stdout:2736: finishing rollback tid 2 to trial08226312-16 2026-02-12T17:40:20.379 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1614 (ObjNum 707 snap 212 seq_num 707) dirty exists 2026-02-12T17:40:20.379 INFO:tasks.rados.rados.0.trial082.stdout:2738: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:40:20.379 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 1881 (ObjNum 816 snap 253 seq_num 816) dirty exists 2026-02-12T17:40:20.379 INFO:tasks.rados.rados.0.trial082.stdout:2730: expect (ObjNum 872 snap 275 seq_num 872) 2026-02-12T17:40:20.386 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2011171 2026-02-12T17:40:20.391 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:20.413 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1653930 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2734: finishing copy_from to trial08226312-33 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2734: got expected ENOENT (src dne) 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2734: finishing copy_from racing read to trial08226312-33 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2732: finishing copy_from racing read to trial08226312-11 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2730: done (9 left) 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2733: done (8 left) 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2734: done (7 left) 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2736: done (6 left) 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2738: done (5 left) 2026-02-12T17:40:20.425 INFO:tasks.rados.rados.0.trial082.stdout:2739: done (4 left) 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:2740: delete oid 25 current snap is 290 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:2729: finishing copy_from racing read to trial08226312-38 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:2731: finishing copy_from racing read to trial08226312-39 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:2729: finishing copy_from to trial08226312-38 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 1593 (ObjNum 876 snap 277 seq_num 876) dirty exists 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:2731: finishing copy_from to trial08226312-39 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 2124 (ObjNum 919 snap 288 seq_num 919) dirty exists 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:2732: finishing copy_from to trial08226312-11 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1564 (ObjNum 867 snap 275 seq_num 867) dirty exists 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:2735: finishing copy_from racing read to trial08226312-45 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:2735: finishing copy_from to trial08226312-45 2026-02-12T17:40:20.426 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1170 (ObjNum 909 snap 288 seq_num 909) dirty exists 2026-02-12T17:40:20.427 INFO:tasks.rados.rados.0.trial082.stdout:2729: done (4 left) 2026-02-12T17:40:20.427 INFO:tasks.rados.rados.0.trial082.stdout:2731: done (3 left) 2026-02-12T17:40:20.427 INFO:tasks.rados.rados.0.trial082.stdout:2732: done (2 left) 2026-02-12T17:40:20.428 INFO:tasks.rados.rados.0.trial082.stdout:2735: done (1 left) 2026-02-12T17:40:20.428 INFO:tasks.rados.rados.0.trial082.stdout:2740: done (0 left) 2026-02-12T17:40:20.428 INFO:tasks.rados.rados.0.trial082.stdout:2741: copy_from oid 38 from oid 48 current snap is 290 2026-02-12T17:40:20.428 INFO:tasks.rados.rados.0.trial082.stdout:2742: snap_remove snap 286 2026-02-12T17:40:21.126 INFO:tasks.rados.rados.0.trial082.stdout:2742: done (1 left) 2026-02-12T17:40:21.126 INFO:tasks.rados.rados.0.trial082.stdout:2743: snap_create 2026-02-12T17:40:21.126 INFO:tasks.rados.rados.0.trial082.stdout:2741: finishing copy_from racing read to trial08226312-38 2026-02-12T17:40:21.126 INFO:tasks.rados.rados.0.trial082.stdout:2741: finishing copy_from to trial08226312-38 2026-02-12T17:40:21.126 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 839 (ObjNum 886 snap 281 seq_num 886) dirty exists 2026-02-12T17:40:22.127 INFO:tasks.rados.rados.0.trial082.stdout:2741: done (1 left) 2026-02-12T17:40:22.127 INFO:tasks.rados.rados.0.trial082.stdout:2743: done (0 left) 2026-02-12T17:40:22.127 INFO:tasks.rados.rados.0.trial082.stdout:2744: write (excl) oid 35 current snap is 291 2026-02-12T17:40:22.127 INFO:tasks.rados.rados.0.trial082.stdout:2744: seq_num 930 ranges {430510=576636,1654842=768318,2922795=502619} 2026-02-12T17:40:22.131 INFO:tasks.rados.rados.0.trial082.stdout:2744: writing trial08226312-35 from 430510 to 1007146 tid 1 2026-02-12T17:40:22.136 INFO:tasks.rados.rados.0.trial082.stdout:2744: writing trial08226312-35 from 1654842 to 2423160 tid 2 2026-02-12T17:40:22.141 INFO:tasks.rados.rados.0.trial082.stdout:2744: writing trial08226312-35 from 2922795 to 3425414 tid 3 2026-02-12T17:40:22.141 INFO:tasks.rados.rados.0.trial082.stdout:2745: snap_create 2026-02-12T17:40:22.141 INFO:tasks.rados.rados.0.trial082.stdout:2744: finishing write tid 1 to trial08226312-35 2026-02-12T17:40:22.141 INFO:tasks.rados.rados.0.trial082.stdout:2744: finishing write tid 2 to trial08226312-35 2026-02-12T17:40:22.143 INFO:tasks.rados.rados.0.trial082.stdout:2744: finishing write tid 3 to trial08226312-35 2026-02-12T17:40:22.143 INFO:tasks.rados.rados.0.trial082.stdout:2744: finishing write tid 4 to trial08226312-35 2026-02-12T17:40:22.143 INFO:tasks.rados.rados.0.trial082.stdout:2744: finishing write tid 5 to trial08226312-35 2026-02-12T17:40:22.143 INFO:tasks.rados.rados.0.trial082.stdout:2744: oid 35 updating version 0 to 1876 2026-02-12T17:40:22.143 INFO:tasks.rados.rados.0.trial082.stdout:2744: oid 35 updating version 1876 to 1877 2026-02-12T17:40:22.143 INFO:tasks.rados.rados.0.trial082.stdout:2744: oid 35 updating version 1877 to 1879 2026-02-12T17:40:22.144 INFO:tasks.rados.rados.0.trial082.stdout:2744: oid 35 version 1879 is already newer than 1878 2026-02-12T17:40:22.144 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1879 (ObjNum 930 snap 291 seq_num 930) dirty exists 2026-02-12T17:40:22.144 INFO:tasks.rados.rados.0.trial082.stdout:2744: left oid 35 (ObjNum 930 snap 291 seq_num 930) 2026-02-12T17:40:23.089 INFO:tasks.rados.rados.0.trial082.stdout:2744: done (1 left) 2026-02-12T17:40:23.089 INFO:tasks.rados.rados.0.trial082.stdout:2745: done (0 left) 2026-02-12T17:40:23.089 INFO:tasks.rados.rados.0.trial082.stdout:2746: write oid 46 current snap is 292 2026-02-12T17:40:23.089 INFO:tasks.rados.rados.0.trial082.stdout:2746: seq_num 931 ranges {447317=651885,1713324=628329,3066571=580746} 2026-02-12T17:40:23.094 INFO:tasks.rados.rados.0.trial082.stdout:2746: writing trial08226312-46 from 447317 to 1099202 tid 1 2026-02-12T17:40:23.099 INFO:tasks.rados.rados.0.trial082.stdout:2746: writing trial08226312-46 from 1713324 to 2341653 tid 2 2026-02-12T17:40:23.105 INFO:tasks.rados.rados.0.trial082.stdout:2746: writing trial08226312-46 from 3066571 to 3647317 tid 3 2026-02-12T17:40:23.105 INFO:tasks.rados.rados.0.trial082.stdout:2747: rollback oid 44 current snap is 292 2026-02-12T17:40:23.105 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 287 2026-02-12T17:40:23.105 INFO:tasks.rados.rados.0.trial082.stdout:2746: finishing write tid 1 to trial08226312-46 2026-02-12T17:40:23.105 INFO:tasks.rados.rados.0.trial082.stdout:2746: finishing write tid 2 to trial08226312-46 2026-02-12T17:40:23.106 INFO:tasks.rados.rados.0.trial082.stdout:2748: read oid 24 snap -1 2026-02-12T17:40:23.106 INFO:tasks.rados.rados.0.trial082.stdout:2748: expect (ObjNum 923 snap 290 seq_num 923) 2026-02-12T17:40:23.106 INFO:tasks.rados.rados.0.trial082.stdout:2749: delete oid 17 current snap is 292 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:2746: finishing write tid 3 to trial08226312-46 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:2746: finishing write tid 4 to trial08226312-46 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:2746: finishing write tid 5 to trial08226312-46 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:2746: oid 46 updating version 0 to 1591 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:2746: oid 46 updating version 1591 to 1594 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:2746: oid 46 version 1594 is already newer than 1593 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:2746: oid 46 version 1594 is already newer than 1592 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1594 (ObjNum 931 snap 292 seq_num 931) dirty exists 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:2746: left oid 46 (ObjNum 931 snap 292 seq_num 931) 2026-02-12T17:40:23.108 INFO:tasks.rados.rados.0.trial082.stdout:2747: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:40:23.109 INFO:tasks.rados.rados.0.trial082.stdout:2747: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:40:23.109 INFO:tasks.rados.rados.0.trial082.stdout:2747: finishing rollback tid 2 to trial08226312-44 2026-02-12T17:40:23.109 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 1882 (ObjNum 851 snap 268 seq_num 851) dirty exists 2026-02-12T17:40:23.109 INFO:tasks.rados.rados.0.trial082.stdout:2748: expect (ObjNum 923 snap 290 seq_num 923) 2026-02-12T17:40:23.136 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:23.160 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 300817 2026-02-12T17:40:23.184 INFO:tasks.rados.rados.0.trial082.stdout:2746: done (3 left) 2026-02-12T17:40:23.184 INFO:tasks.rados.rados.0.trial082.stdout:2747: done (2 left) 2026-02-12T17:40:23.184 INFO:tasks.rados.rados.0.trial082.stdout:2748: done (1 left) 2026-02-12T17:40:23.184 INFO:tasks.rados.rados.0.trial082.stdout:2749: done (0 left) 2026-02-12T17:40:23.184 INFO:tasks.rados.rados.0.trial082.stdout:2750: delete oid 49 current snap is 292 2026-02-12T17:40:23.185 INFO:tasks.rados.rados.0.trial082.stdout:2750: done (0 left) 2026-02-12T17:40:23.185 INFO:tasks.rados.rados.0.trial082.stdout:2751: write oid 1 current snap is 292 2026-02-12T17:40:23.185 INFO:tasks.rados.rados.0.trial082.stdout:2751: seq_num 934 ranges {497738=477632,1772417=775656,3316134=381604} 2026-02-12T17:40:23.189 INFO:tasks.rados.rados.0.trial082.stdout:2751: writing trial08226312-1 from 497738 to 975370 tid 1 2026-02-12T17:40:23.195 INFO:tasks.rados.rados.0.trial082.stdout:2751: writing trial08226312-1 from 1772417 to 2548073 tid 2 2026-02-12T17:40:23.199 INFO:tasks.rados.rados.0.trial082.stdout:2751: writing trial08226312-1 from 3316134 to 3697738 tid 3 2026-02-12T17:40:23.199 INFO:tasks.rados.rados.0.trial082.stdout:2752: snap_remove snap 274 2026-02-12T17:40:24.135 INFO:tasks.rados.rados.0.trial082.stdout:2752: done (1 left) 2026-02-12T17:40:24.135 INFO:tasks.rados.rados.0.trial082.stdout:2753: copy_from oid 11 from oid 13 current snap is 292 2026-02-12T17:40:24.135 INFO:tasks.rados.rados.0.trial082.stdout:2751: finishing write tid 1 to trial08226312-1 2026-02-12T17:40:24.135 INFO:tasks.rados.rados.0.trial082.stdout:2751: finishing write tid 2 to trial08226312-1 2026-02-12T17:40:24.135 INFO:tasks.rados.rados.0.trial082.stdout:2751: finishing write tid 3 to trial08226312-1 2026-02-12T17:40:24.135 INFO:tasks.rados.rados.0.trial082.stdout:2751: finishing write tid 4 to trial08226312-1 2026-02-12T17:40:24.136 INFO:tasks.rados.rados.0.trial082.stdout:2751: finishing write tid 5 to trial08226312-1 2026-02-12T17:40:24.136 INFO:tasks.rados.rados.0.trial082.stdout:2751: oid 1 updating version 0 to 943 2026-02-12T17:40:24.136 INFO:tasks.rados.rados.0.trial082.stdout:2751: oid 1 updating version 943 to 944 2026-02-12T17:40:24.136 INFO:tasks.rados.rados.0.trial082.stdout:2751: oid 1 updating version 944 to 946 2026-02-12T17:40:24.136 INFO:tasks.rados.rados.0.trial082.stdout:2751: oid 1 version 946 is already newer than 945 2026-02-12T17:40:24.136 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 946 (ObjNum 934 snap 292 seq_num 934) dirty exists 2026-02-12T17:40:24.136 INFO:tasks.rados.rados.0.trial082.stdout:2751: left oid 1 (ObjNum 934 snap 292 seq_num 934) 2026-02-12T17:40:24.136 INFO:tasks.rados.rados.0.trial082.stdout:2751: done (1 left) 2026-02-12T17:40:24.136 INFO:tasks.rados.rados.0.trial082.stdout:2754: delete oid 4 current snap is 292 2026-02-12T17:40:24.139 INFO:tasks.rados.rados.0.trial082.stdout:2754: done (1 left) 2026-02-12T17:40:24.139 INFO:tasks.rados.rados.0.trial082.stdout:2755: copy_from oid 8 from oid 35 current snap is 292 2026-02-12T17:40:24.139 INFO:tasks.rados.rados.0.trial082.stdout:2756: copy_from oid 48 from oid 7 current snap is 292 2026-02-12T17:40:24.139 INFO:tasks.rados.rados.0.trial082.stdout:2757: read oid 24 snap -1 2026-02-12T17:40:24.139 INFO:tasks.rados.rados.0.trial082.stdout:2757: expect (ObjNum 923 snap 290 seq_num 923) 2026-02-12T17:40:24.139 INFO:tasks.rados.rados.0.trial082.stdout:2758: snap_remove snap 252 2026-02-12T17:40:25.136 INFO:tasks.rados.rados.0.trial082.stdout:2758: done (4 left) 2026-02-12T17:40:25.136 INFO:tasks.rados.rados.0.trial082.stdout:2759: write (excl) oid 25 current snap is 292 2026-02-12T17:40:25.136 INFO:tasks.rados.rados.0.trial082.stdout:2759: seq_num 936 ranges {531352=744483,2005734=779325,3487333=244019} 2026-02-12T17:40:25.141 INFO:tasks.rados.rados.0.trial082.stdout:2759: writing trial08226312-25 from 531352 to 1275835 tid 1 2026-02-12T17:40:25.147 INFO:tasks.rados.rados.0.trial082.stdout:2759: writing trial08226312-25 from 2005734 to 2785059 tid 2 2026-02-12T17:40:25.151 INFO:tasks.rados.rados.0.trial082.stdout:2759: writing trial08226312-25 from 3487333 to 3731352 tid 3 2026-02-12T17:40:25.151 INFO:tasks.rados.rados.0.trial082.stdout:2760: read oid 47 snap 290 2026-02-12T17:40:25.151 INFO:tasks.rados.rados.0.trial082.stdout:2760: expect (ObjNum 919 snap 288 seq_num 919) 2026-02-12T17:40:25.151 INFO:tasks.rados.rados.0.trial082.stdout:2761: snap_remove snap 262 2026-02-12T17:40:26.140 INFO:tasks.rados.rados.0.trial082.stdout:2761: done (6 left) 2026-02-12T17:40:26.140 INFO:tasks.rados.rados.0.trial082.stdout:2762: snap_remove snap 285 2026-02-12T17:40:27.142 INFO:tasks.rados.rados.0.trial082.stdout:2762: done (6 left) 2026-02-12T17:40:27.142 INFO:tasks.rados.rados.0.trial082.stdout:2763: rollback oid 45 current snap is 292 2026-02-12T17:40:27.142 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 283 2026-02-12T17:40:27.142 INFO:tasks.rados.rados.0.trial082.stdout:2757: expect (ObjNum 923 snap 290 seq_num 923) 2026-02-12T17:40:27.213 INFO:tasks.rados.rados.0.trial082.stdout:2753: finishing copy_from racing read to trial08226312-11 2026-02-12T17:40:27.213 INFO:tasks.rados.rados.0.trial082.stdout:2753: finishing copy_from to trial08226312-11 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1881 (ObjNum 816 snap 253 seq_num 816) dirty exists 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:2756: finishing copy_from racing read to trial08226312-48 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:2755: finishing copy_from racing read to trial08226312-8 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:2755: finishing copy_from to trial08226312-8 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1879 (ObjNum 930 snap 291 seq_num 930) dirty exists 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:2756: finishing copy_from to trial08226312-48 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1593 (ObjNum 876 snap 277 seq_num 876) dirty exists 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:2759: finishing write tid 1 to trial08226312-25 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:2759: finishing write tid 2 to trial08226312-25 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:2753: done (6 left) 2026-02-12T17:40:27.214 INFO:tasks.rados.rados.0.trial082.stdout:2755: done (5 left) 2026-02-12T17:40:27.215 INFO:tasks.rados.rados.0.trial082.stdout:2756: done (4 left) 2026-02-12T17:40:27.215 INFO:tasks.rados.rados.0.trial082.stdout:2757: done (3 left) 2026-02-12T17:40:27.215 INFO:tasks.rados.rados.0.trial082.stdout:2764: read oid 8 snap -1 2026-02-12T17:40:27.215 INFO:tasks.rados.rados.0.trial082.stdout:2764: expect (ObjNum 930 snap 291 seq_num 930) 2026-02-12T17:40:27.215 INFO:tasks.rados.rados.0.trial082.stdout:2765: write oid 20 current snap is 292 2026-02-12T17:40:27.215 INFO:tasks.rados.rados.0.trial082.stdout:2765: seq_num 937 ranges {548159=419732,1664216=522983,2714756=614229} 2026-02-12T17:40:27.217 INFO:tasks.rados.rados.0.trial082.stdout:2765: writing trial08226312-20 from 548159 to 967891 tid 1 2026-02-12T17:40:27.221 INFO:tasks.rados.rados.0.trial082.stdout:2765: writing trial08226312-20 from 1664216 to 2187199 tid 2 2026-02-12T17:40:27.226 INFO:tasks.rados.rados.0.trial082.stdout:2765: writing trial08226312-20 from 2714756 to 3328985 tid 3 2026-02-12T17:40:27.226 INFO:tasks.rados.rados.0.trial082.stdout:2766: snap_create 2026-02-12T17:40:27.226 INFO:tasks.rados.rados.0.trial082.stdout:2759: finishing write tid 3 to trial08226312-25 2026-02-12T17:40:27.226 INFO:tasks.rados.rados.0.trial082.stdout:2759: finishing write tid 4 to trial08226312-25 2026-02-12T17:40:27.226 INFO:tasks.rados.rados.0.trial082.stdout:2759: finishing write tid 5 to trial08226312-25 2026-02-12T17:40:27.226 INFO:tasks.rados.rados.0.trial082.stdout:2759: oid 25 updating version 0 to 1884 2026-02-12T17:40:27.227 INFO:tasks.rados.rados.0.trial082.stdout:2759: oid 25 updating version 1884 to 1885 2026-02-12T17:40:27.227 INFO:tasks.rados.rados.0.trial082.stdout:2759: oid 25 updating version 1885 to 1886 2026-02-12T17:40:27.227 INFO:tasks.rados.rados.0.trial082.stdout:2759: oid 25 version 1886 is already newer than 1883 2026-02-12T17:40:27.227 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 1886 (ObjNum 936 snap 292 seq_num 936) dirty exists 2026-02-12T17:40:27.227 INFO:tasks.rados.rados.0.trial082.stdout:2759: left oid 25 (ObjNum 936 snap 292 seq_num 936) 2026-02-12T17:40:27.227 INFO:tasks.rados.rados.0.trial082.stdout:2760: expect (ObjNum 919 snap 288 seq_num 919) 2026-02-12T17:40:27.271 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 516427 2026-02-12T17:40:27.311 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:27.355 INFO:tasks.rados.rados.0.trial082.stdout:2763: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:40:27.355 INFO:tasks.rados.rados.0.trial082.stdout:2763: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:40:27.355 INFO:tasks.rados.rados.0.trial082.stdout:2763: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:40:27.356 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1885 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:40:27.356 INFO:tasks.rados.rados.0.trial082.stdout:2764: expect (ObjNum 930 snap 291 seq_num 930) 2026-02-12T17:40:27.461 INFO:tasks.rados.rados.0.trial082.stdout:2765: finishing write tid 1 to trial08226312-20 2026-02-12T17:40:27.461 INFO:tasks.rados.rados.0.trial082.stdout:2765: finishing write tid 2 to trial08226312-20 2026-02-12T17:40:27.461 INFO:tasks.rados.rados.0.trial082.stdout:2765: finishing write tid 3 to trial08226312-20 2026-02-12T17:40:27.462 INFO:tasks.rados.rados.0.trial082.stdout:2765: finishing write tid 4 to trial08226312-20 2026-02-12T17:40:27.462 INFO:tasks.rados.rados.0.trial082.stdout:2765: finishing write tid 5 to trial08226312-20 2026-02-12T17:40:27.462 INFO:tasks.rados.rados.0.trial082.stdout:2765: oid 20 updating version 0 to 2197 2026-02-12T17:40:27.462 INFO:tasks.rados.rados.0.trial082.stdout:2765: oid 20 updating version 2197 to 2199 2026-02-12T17:40:27.462 INFO:tasks.rados.rados.0.trial082.stdout:2765: oid 20 version 2199 is already newer than 2198 2026-02-12T17:40:27.462 INFO:tasks.rados.rados.0.trial082.stdout:2765: oid 20 version 2199 is already newer than 2196 2026-02-12T17:40:27.462 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 2199 (ObjNum 937 snap 292 seq_num 937) dirty exists 2026-02-12T17:40:27.462 INFO:tasks.rados.rados.0.trial082.stdout:2765: left oid 20 (ObjNum 937 snap 292 seq_num 937) 2026-02-12T17:40:28.091 INFO:tasks.rados.rados.0.trial082.stdout:2759: done (5 left) 2026-02-12T17:40:28.092 INFO:tasks.rados.rados.0.trial082.stdout:2760: done (4 left) 2026-02-12T17:40:28.092 INFO:tasks.rados.rados.0.trial082.stdout:2763: done (3 left) 2026-02-12T17:40:28.092 INFO:tasks.rados.rados.0.trial082.stdout:2764: done (2 left) 2026-02-12T17:40:28.092 INFO:tasks.rados.rados.0.trial082.stdout:2765: done (1 left) 2026-02-12T17:40:28.092 INFO:tasks.rados.rados.0.trial082.stdout:2766: done (0 left) 2026-02-12T17:40:28.092 INFO:tasks.rados.rados.0.trial082.stdout:2767: copy_from oid 42 from oid 49 current snap is 293 2026-02-12T17:40:28.092 INFO:tasks.rados.rados.0.trial082.stdout:2768: delete oid 26 current snap is 293 2026-02-12T17:40:28.093 INFO:tasks.rados.rados.0.trial082.stdout:2767: finishing copy_from to trial08226312-42 2026-02-12T17:40:28.093 INFO:tasks.rados.rados.0.trial082.stdout:2767: got expected ENOENT (src dne) 2026-02-12T17:40:28.093 INFO:tasks.rados.rados.0.trial082.stdout:2767: finishing copy_from racing read to trial08226312-42 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2767: done (1 left) 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2768: done (0 left) 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2769: read oid 25 snap 292 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2769: expect (ObjNum 936 snap 292 seq_num 936) 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2770: read oid 4 snap 280 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2770: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2771: read oid 47 snap 290 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2771: expect (ObjNum 919 snap 288 seq_num 919) 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2772: read oid 38 snap -1 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2772: expect (ObjNum 886 snap 281 seq_num 886) 2026-02-12T17:40:28.095 INFO:tasks.rados.rados.0.trial082.stdout:2773: read oid 34 snap -1 2026-02-12T17:40:28.096 INFO:tasks.rados.rados.0.trial082.stdout:2773: expect (ObjNum 886 snap 281 seq_num 886) 2026-02-12T17:40:28.096 INFO:tasks.rados.rados.0.trial082.stdout:2774: snap_remove snap 287 2026-02-12T17:40:29.093 INFO:tasks.rados.rados.0.trial082.stdout:2774: done (5 left) 2026-02-12T17:40:29.094 INFO:tasks.rados.rados.0.trial082.stdout:2775: read oid 42 snap 292 2026-02-12T17:40:29.094 INFO:tasks.rados.rados.0.trial082.stdout:2775: expect (ObjNum 876 snap 277 seq_num 876) 2026-02-12T17:40:29.094 INFO:tasks.rados.rados.0.trial082.stdout:2776: snap_create 2026-02-12T17:40:29.094 INFO:tasks.rados.rados.0.trial082.stdout:2770: expect (ObjNum 732 snap 217 seq_num 732) 2026-02-12T17:40:29.094 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:29.152 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1141961 2026-02-12T17:40:29.164 INFO:tasks.rados.rados.0.trial082.stdout:2773: expect (ObjNum 886 snap 281 seq_num 886) 2026-02-12T17:40:29.207 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2317368 2026-02-12T17:40:29.230 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2590242 2026-02-12T17:40:29.236 INFO:tasks.rados.rados.0.trial082.stdout:2772: expect (ObjNum 886 snap 281 seq_num 886) 2026-02-12T17:40:29.236 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:29.311 INFO:tasks.rados.rados.0.trial082.stdout:2769: expect (ObjNum 936 snap 292 seq_num 936) 2026-02-12T17:40:29.311 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:29.370 INFO:tasks.rados.rados.0.trial082.stdout:2771: expect (ObjNum 919 snap 288 seq_num 919) 2026-02-12T17:40:29.370 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:29.414 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 323711 2026-02-12T17:40:29.463 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1372094 2026-02-12T17:40:29.496 INFO:tasks.rados.rados.0.trial082.stdout:2775: expect (ObjNum 876 snap 277 seq_num 876) 2026-02-12T17:40:29.528 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:30.096 INFO:tasks.rados.rados.0.trial082.stdout:2769: done (6 left) 2026-02-12T17:40:30.096 INFO:tasks.rados.rados.0.trial082.stdout:2770: done (5 left) 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2771: done (4 left) 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2772: done (3 left) 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2773: done (2 left) 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2775: done (1 left) 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2776: done (0 left) 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2777: read oid 38 snap -1 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2777: expect (ObjNum 886 snap 281 seq_num 886) 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2778: rollback oid 28 current snap is 294 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 293 2026-02-12T17:40:30.097 INFO:tasks.rados.rados.0.trial082.stdout:2779: delete oid 2 current snap is 294 2026-02-12T17:40:30.098 INFO:tasks.rados.rados.0.trial082.stdout:2777: expect (ObjNum 886 snap 281 seq_num 886) 2026-02-12T17:40:30.167 INFO:tasks.rados.rados.0.trial082.stdout:2778: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:40:30.167 INFO:tasks.rados.rados.0.trial082.stdout:2778: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:40:30.168 INFO:tasks.rados.rados.0.trial082.stdout:2778: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:40:30.168 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1652 (ObjNum 907 snap 287 seq_num 907) dirty exists 2026-02-12T17:40:30.168 INFO:tasks.rados.rados.0.trial082.stdout:2777: done (2 left) 2026-02-12T17:40:30.168 INFO:tasks.rados.rados.0.trial082.stdout:2778: done (1 left) 2026-02-12T17:40:30.168 INFO:tasks.rados.rados.0.trial082.stdout:2779: done (0 left) 2026-02-12T17:40:30.168 INFO:tasks.rados.rados.0.trial082.stdout:2780: write (excl) oid 3 current snap is 294 2026-02-12T17:40:30.168 INFO:tasks.rados.rados.0.trial082.stdout:2780: seq_num 940 ranges {598580=645479,1723309=786663,3080672=448045} 2026-02-12T17:40:30.173 INFO:tasks.rados.rados.0.trial082.stdout:2780: writing trial08226312-3 from 598580 to 1244059 tid 1 2026-02-12T17:40:30.177 INFO:tasks.rados.rados.0.trial082.stdout:2780: writing trial08226312-3 from 1723309 to 2509972 tid 2 2026-02-12T17:40:30.182 INFO:tasks.rados.rados.0.trial082.stdout:2780: writing trial08226312-3 from 3080672 to 3528717 tid 3 2026-02-12T17:40:30.182 INFO:tasks.rados.rados.0.trial082.stdout:2781: rollback oid 7 current snap is 294 2026-02-12T17:40:30.182 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 7 to 283 2026-02-12T17:40:30.182 INFO:tasks.rados.rados.0.trial082.stdout:2780: finishing write tid 1 to trial08226312-3 2026-02-12T17:40:30.183 INFO:tasks.rados.rados.0.trial082.stdout:2780: finishing write tid 2 to trial08226312-3 2026-02-12T17:40:30.183 INFO:tasks.rados.rados.0.trial082.stdout:2782: write oid 12 current snap is 294 2026-02-12T17:40:30.183 INFO:tasks.rados.rados.0.trial082.stdout:2782: seq_num 941 ranges {615387=720728,1781791=530321,3108095=707292} 2026-02-12T17:40:30.187 INFO:tasks.rados.rados.0.trial082.stdout:2782: writing trial08226312-12 from 615387 to 1336115 tid 1 2026-02-12T17:40:30.191 INFO:tasks.rados.rados.0.trial082.stdout:2782: writing trial08226312-12 from 1781791 to 2312112 tid 2 2026-02-12T17:40:30.197 INFO:tasks.rados.rados.0.trial082.stdout:2782: writing trial08226312-12 from 3108095 to 3815387 tid 3 2026-02-12T17:40:30.197 INFO:tasks.rados.rados.0.trial082.stdout:2783: copy_from oid 30 from oid 20 current snap is 294 2026-02-12T17:40:30.197 INFO:tasks.rados.rados.0.trial082.stdout:2780: finishing write tid 3 to trial08226312-3 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2781: finishing rollback tid 0 to trial08226312-7 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2780: finishing write tid 4 to trial08226312-3 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2781: finishing rollback tid 1 to trial08226312-7 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2780: finishing write tid 5 to trial08226312-3 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2780: oid 3 updating version 0 to 1218 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2780: oid 3 version 1218 is already newer than 1216 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2780: oid 3 version 1218 is already newer than 1217 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2780: oid 3 updating version 1218 to 1219 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1219 (ObjNum 940 snap 294 seq_num 940) dirty exists 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2780: left oid 3 (ObjNum 940 snap 294 seq_num 940) 2026-02-12T17:40:30.198 INFO:tasks.rados.rados.0.trial082.stdout:2781: finishing rollback tid 2 to trial08226312-7 2026-02-12T17:40:30.199 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 1656 (ObjNum 876 snap 277 seq_num 876) dirty exists 2026-02-12T17:40:30.199 INFO:tasks.rados.rados.0.trial082.stdout:2782: finishing write tid 1 to trial08226312-12 2026-02-12T17:40:30.199 INFO:tasks.rados.rados.0.trial082.stdout:2780: done (3 left) 2026-02-12T17:40:30.199 INFO:tasks.rados.rados.0.trial082.stdout:2781: done (2 left) 2026-02-12T17:40:30.199 INFO:tasks.rados.rados.0.trial082.stdout:2784: write oid 38 current snap is 294 2026-02-12T17:40:30.199 INFO:tasks.rados.rados.0.trial082.stdout:2784: seq_num 942 ranges {632194=795977,2123920=790332,3419165=413029} 2026-02-12T17:40:30.202 INFO:tasks.rados.rados.0.trial082.stdout:2784: writing trial08226312-38 from 632194 to 1428171 tid 1 2026-02-12T17:40:30.208 INFO:tasks.rados.rados.0.trial082.stdout:2784: writing trial08226312-38 from 2123920 to 2914252 tid 2 2026-02-12T17:40:30.211 INFO:tasks.rados.rados.0.trial082.stdout:2784: writing trial08226312-38 from 3419165 to 3832194 tid 3 2026-02-12T17:40:30.211 INFO:tasks.rados.rados.0.trial082.stdout:2785: write oid 48 current snap is 294 2026-02-12T17:40:30.212 INFO:tasks.rados.rados.0.trial082.stdout:2785: seq_num 943 ranges {649001=587579,1898755=533990,3162941=686060} 2026-02-12T17:40:30.216 INFO:tasks.rados.rados.0.trial082.stdout:2785: writing trial08226312-48 from 649001 to 1236580 tid 1 2026-02-12T17:40:30.220 INFO:tasks.rados.rados.0.trial082.stdout:2785: writing trial08226312-48 from 1898755 to 2432745 tid 2 2026-02-12T17:40:30.226 INFO:tasks.rados.rados.0.trial082.stdout:2785: writing trial08226312-48 from 3162941 to 3849001 tid 3 2026-02-12T17:40:30.227 INFO:tasks.rados.rados.0.trial082.stdout:2786: read oid 32 snap -1 2026-02-12T17:40:30.227 INFO:tasks.rados.rados.0.trial082.stdout:2786: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:40:30.227 INFO:tasks.rados.rados.0.trial082.stdout:2787: read oid 25 snap -1 2026-02-12T17:40:30.227 INFO:tasks.rados.rados.0.trial082.stdout:2787: expect (ObjNum 936 snap 292 seq_num 936) 2026-02-12T17:40:30.227 INFO:tasks.rados.rados.0.trial082.stdout:2788: write oid 11 current snap is 294 2026-02-12T17:40:30.227 INFO:tasks.rados.rados.0.trial082.stdout:2782: finishing write tid 2 to trial08226312-12 2026-02-12T17:40:30.227 INFO:tasks.rados.rados.0.trial082.stdout:2788: seq_num 944 ranges {665808=662828,1957237=677648,3074011=609486} 2026-02-12T17:40:30.231 INFO:tasks.rados.rados.0.trial082.stdout:2788: writing trial08226312-11 from 665808 to 1328636 tid 1 2026-02-12T17:40:30.236 INFO:tasks.rados.rados.0.trial082.stdout:2788: writing trial08226312-11 from 1957237 to 2634885 tid 2 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:2788: writing trial08226312-11 from 3074011 to 3683497 tid 3 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:2789: rollback oid 13 current snap is 294 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 284 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:2782: finishing write tid 3 to trial08226312-12 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:2782: finishing write tid 4 to trial08226312-12 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:2782: finishing write tid 5 to trial08226312-12 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:2782: oid 12 updating version 0 to 1940 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:2782: oid 12 updating version 1940 to 1941 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:2782: oid 12 version 1941 is already newer than 1939 2026-02-12T17:40:30.241 INFO:tasks.rados.rados.0.trial082.stdout:2782: oid 12 version 1941 is already newer than 1938 2026-02-12T17:40:30.242 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1941 (ObjNum 941 snap 294 seq_num 941) dirty exists 2026-02-12T17:40:30.242 INFO:tasks.rados.rados.0.trial082.stdout:2782: left oid 12 (ObjNum 941 snap 294 seq_num 941) 2026-02-12T17:40:30.242 INFO:tasks.rados.rados.0.trial082.stdout:2784: finishing write tid 1 to trial08226312-38 2026-02-12T17:40:30.242 INFO:tasks.rados.rados.0.trial082.stdout:2782: done (7 left) 2026-02-12T17:40:30.242 INFO:tasks.rados.rados.0.trial082.stdout:2790: write oid 34 current snap is 294 2026-02-12T17:40:30.242 INFO:tasks.rados.rados.0.trial082.stdout:2790: seq_num 945 ranges {682615=738077,2015719=537659,3217787=420758} 2026-02-12T17:40:30.245 INFO:tasks.rados.rados.0.trial082.stdout:2790: writing trial08226312-34 from 682615 to 1420692 tid 1 2026-02-12T17:40:30.250 INFO:tasks.rados.rados.0.trial082.stdout:2790: writing trial08226312-34 from 2015719 to 2553378 tid 2 2026-02-12T17:40:30.255 INFO:tasks.rados.rados.0.trial082.stdout:2790: writing trial08226312-34 from 3217787 to 3638545 tid 3 2026-02-12T17:40:30.255 INFO:tasks.rados.rados.0.trial082.stdout:2791: delete oid 39 current snap is 294 2026-02-12T17:40:30.255 INFO:tasks.rados.rados.0.trial082.stdout:2783: finishing copy_from racing read to trial08226312-30 2026-02-12T17:40:30.255 INFO:tasks.rados.rados.0.trial082.stdout:2783: finishing copy_from to trial08226312-30 2026-02-12T17:40:30.255 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2199 (ObjNum 937 snap 292 seq_num 937) dirty exists 2026-02-12T17:40:30.255 INFO:tasks.rados.rados.0.trial082.stdout:2784: finishing write tid 2 to trial08226312-38 2026-02-12T17:40:30.255 INFO:tasks.rados.rados.0.trial082.stdout:2784: finishing write tid 3 to trial08226312-38 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2784: finishing write tid 4 to trial08226312-38 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2784: finishing write tid 5 to trial08226312-38 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2784: oid 38 updating version 0 to 1879 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2784: oid 38 version 1879 is already newer than 1876 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2784: oid 38 version 1879 is already newer than 1877 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2784: oid 38 version 1879 is already newer than 1878 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 1879 (ObjNum 942 snap 294 seq_num 942) dirty exists 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2784: left oid 38 (ObjNum 942 snap 294 seq_num 942) 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2785: finishing write tid 1 to trial08226312-48 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2785: finishing write tid 2 to trial08226312-48 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2785: finishing write tid 3 to trial08226312-48 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2785: finishing write tid 4 to trial08226312-48 2026-02-12T17:40:30.256 INFO:tasks.rados.rados.0.trial082.stdout:2785: finishing write tid 5 to trial08226312-48 2026-02-12T17:40:30.257 INFO:tasks.rados.rados.0.trial082.stdout:2785: oid 48 updating version 0 to 1597 2026-02-12T17:40:30.257 INFO:tasks.rados.rados.0.trial082.stdout:2785: oid 48 version 1597 is already newer than 1594 2026-02-12T17:40:30.257 INFO:tasks.rados.rados.0.trial082.stdout:2785: oid 48 version 1597 is already newer than 1596 2026-02-12T17:40:30.257 INFO:tasks.rados.rados.0.trial082.stdout:2785: oid 48 version 1597 is already newer than 1595 2026-02-12T17:40:30.257 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1597 (ObjNum 943 snap 294 seq_num 943) dirty exists 2026-02-12T17:40:30.257 INFO:tasks.rados.rados.0.trial082.stdout:2785: left oid 48 (ObjNum 943 snap 294 seq_num 943) 2026-02-12T17:40:30.257 INFO:tasks.rados.rados.0.trial082.stdout:2787: expect (ObjNum 936 snap 292 seq_num 936) 2026-02-12T17:40:30.274 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:30.302 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 588850 2026-02-12T17:40:30.324 INFO:tasks.rados.rados.0.trial082.stdout:2786: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:40:30.405 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:30.446 INFO:tasks.rados.rados.0.trial082.stdout:2788: finishing write tid 1 to trial08226312-11 2026-02-12T17:40:30.447 INFO:tasks.rados.rados.0.trial082.stdout:2788: finishing write tid 2 to trial08226312-11 2026-02-12T17:40:30.447 INFO:tasks.rados.rados.0.trial082.stdout:2788: finishing write tid 3 to trial08226312-11 2026-02-12T17:40:30.447 INFO:tasks.rados.rados.0.trial082.stdout:2788: finishing write tid 4 to trial08226312-11 2026-02-12T17:40:30.447 INFO:tasks.rados.rados.0.trial082.stdout:2788: finishing write tid 5 to trial08226312-11 2026-02-12T17:40:30.447 INFO:tasks.rados.rados.0.trial082.stdout:2788: oid 11 updating version 0 to 1883 2026-02-12T17:40:30.447 INFO:tasks.rados.rados.0.trial082.stdout:2788: oid 11 updating version 1883 to 1884 2026-02-12T17:40:30.447 INFO:tasks.rados.rados.0.trial082.stdout:2788: oid 11 version 1884 is already newer than 1882 2026-02-12T17:40:30.447 INFO:tasks.rados.rados.0.trial082.stdout:2788: oid 11 updating version 1884 to 1885 2026-02-12T17:40:30.447 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1885 (ObjNum 944 snap 294 seq_num 944) dirty exists 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2788: left oid 11 (ObjNum 944 snap 294 seq_num 944) 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2789: finishing rollback tid 0 to trial08226312-13 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2789: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2789: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 1889 (ObjNum 816 snap 253 seq_num 816) dirty exists 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2790: finishing write tid 1 to trial08226312-34 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2790: finishing write tid 2 to trial08226312-34 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2783: done (8 left) 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2784: done (7 left) 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2785: done (6 left) 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2786: done (5 left) 2026-02-12T17:40:30.448 INFO:tasks.rados.rados.0.trial082.stdout:2787: done (4 left) 2026-02-12T17:40:30.449 INFO:tasks.rados.rados.0.trial082.stdout:2788: done (3 left) 2026-02-12T17:40:30.449 INFO:tasks.rados.rados.0.trial082.stdout:2789: done (2 left) 2026-02-12T17:40:30.449 INFO:tasks.rados.rados.0.trial082.stdout:2791: done (1 left) 2026-02-12T17:40:30.449 INFO:tasks.rados.rados.0.trial082.stdout:2792: write (excl) oid 26 current snap is 294 2026-02-12T17:40:30.449 INFO:tasks.rados.rados.0.trial082.stdout:2792: seq_num 947 ranges {716229=488575,1616330=541328,2756280=559655} 2026-02-12T17:40:30.451 INFO:tasks.rados.rados.0.trial082.stdout:2792: writing trial08226312-26 from 716229 to 1204804 tid 1 2026-02-12T17:40:30.454 INFO:tasks.rados.rados.0.trial082.stdout:2792: writing trial08226312-26 from 1616330 to 2157658 tid 2 2026-02-12T17:40:30.459 INFO:tasks.rados.rados.0.trial082.stdout:2792: writing trial08226312-26 from 2756280 to 3315935 tid 3 2026-02-12T17:40:30.459 INFO:tasks.rados.rados.0.trial082.stdout:2793: write (excl) oid 30 current snap is 294 2026-02-12T17:40:30.459 INFO:tasks.rados.rados.0.trial082.stdout:2790: finishing write tid 3 to trial08226312-34 2026-02-12T17:40:30.459 INFO:tasks.rados.rados.0.trial082.stdout:2790: finishing write tid 4 to trial08226312-34 2026-02-12T17:40:30.459 INFO:tasks.rados.rados.0.trial082.stdout:2790: finishing write tid 5 to trial08226312-34 2026-02-12T17:40:30.460 INFO:tasks.rados.rados.0.trial082.stdout:2790: oid 34 updating version 0 to 1562 2026-02-12T17:40:30.460 INFO:tasks.rados.rados.0.trial082.stdout:2790: oid 34 updating version 1562 to 1563 2026-02-12T17:40:30.460 INFO:tasks.rados.rados.0.trial082.stdout:2790: oid 34 version 1563 is already newer than 1560 2026-02-12T17:40:30.460 INFO:tasks.rados.rados.0.trial082.stdout:2790: oid 34 version 1563 is already newer than 1561 2026-02-12T17:40:30.460 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1563 (ObjNum 945 snap 294 seq_num 945) dirty exists 2026-02-12T17:40:30.460 INFO:tasks.rados.rados.0.trial082.stdout:2790: left oid 34 (ObjNum 945 snap 294 seq_num 945) 2026-02-12T17:40:30.460 INFO:tasks.rados.rados.0.trial082.stdout:2792: finishing write tid 1 to trial08226312-26 2026-02-12T17:40:30.460 INFO:tasks.rados.rados.0.trial082.stdout:2792: finishing write tid 2 to trial08226312-26 2026-02-12T17:40:30.460 INFO:tasks.rados.rados.0.trial082.stdout:2793: seq_num 948 ranges {733036=563824,2074812=684986,3183703=749333} 2026-02-12T17:40:30.463 INFO:tasks.rados.rados.0.trial082.stdout:2793: writing trial08226312-30 from 733036 to 1296860 tid 1 2026-02-12T17:40:30.469 INFO:tasks.rados.rados.0.trial082.stdout:2793: writing trial08226312-30 from 2074812 to 2759798 tid 2 2026-02-12T17:40:30.475 INFO:tasks.rados.rados.0.trial082.stdout:2793: writing trial08226312-30 from 3183703 to 3933036 tid 3 2026-02-12T17:40:30.475 INFO:tasks.rados.rados.0.trial082.stdout:2790: done (2 left) 2026-02-12T17:40:30.475 INFO:tasks.rados.rados.0.trial082.stdout:2794: copy_from oid 29 from oid 22 current snap is 294 2026-02-12T17:40:30.475 INFO:tasks.rados.rados.0.trial082.stdout:2792: finishing write tid 3 to trial08226312-26 2026-02-12T17:40:30.475 INFO:tasks.rados.rados.0.trial082.stdout:2792: finishing write tid 4 to trial08226312-26 2026-02-12T17:40:30.475 INFO:tasks.rados.rados.0.trial082.stdout:2792: finishing write tid 5 to trial08226312-26 2026-02-12T17:40:30.475 INFO:tasks.rados.rados.0.trial082.stdout:2792: oid 26 updating version 0 to 1888 2026-02-12T17:40:30.475 INFO:tasks.rados.rados.0.trial082.stdout:2792: oid 26 version 1888 is already newer than 1887 2026-02-12T17:40:30.475 INFO:tasks.rados.rados.0.trial082.stdout:2792: oid 26 updating version 1888 to 1889 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:2792: oid 26 updating version 1889 to 1890 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1890 (ObjNum 947 snap 294 seq_num 947) dirty exists 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:2792: left oid 26 (ObjNum 947 snap 294 seq_num 947) 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:2793: finishing write tid 1 to trial08226312-30 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:2792: done (2 left) 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:2795: copy_from oid 24 from oid 10 current snap is 294 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:2793: finishing write tid 2 to trial08226312-30 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:2796: read oid 42 snap -1 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:2796: expect (ObjNum 876 snap 277 seq_num 876) 2026-02-12T17:40:30.476 INFO:tasks.rados.rados.0.trial082.stdout:2797: copy_from oid 20 from oid 38 current snap is 294 2026-02-12T17:40:30.477 INFO:tasks.rados.rados.0.trial082.stdout:2798: read oid 3 snap -1 2026-02-12T17:40:30.477 INFO:tasks.rados.rados.0.trial082.stdout:2798: expect (ObjNum 940 snap 294 seq_num 940) 2026-02-12T17:40:30.477 INFO:tasks.rados.rados.0.trial082.stdout:2799: write (excl) oid 39 current snap is 294 2026-02-12T17:40:30.477 INFO:tasks.rados.rados.0.trial082.stdout:2799: seq_num 949 ranges {749843=639073,2133294=544997,3211126=582199} 2026-02-12T17:40:30.479 INFO:tasks.rados.rados.0.trial082.stdout:2799: writing trial08226312-39 from 749843 to 1388916 tid 1 2026-02-12T17:40:30.483 INFO:tasks.rados.rados.0.trial082.stdout:2799: writing trial08226312-39 from 2133294 to 2678291 tid 2 2026-02-12T17:40:30.488 INFO:tasks.rados.rados.0.trial082.stdout:2799: writing trial08226312-39 from 3211126 to 3793325 tid 3 2026-02-12T17:40:30.488 INFO:tasks.rados.rados.0.trial082.stdout:2800: snap_create 2026-02-12T17:40:30.488 INFO:tasks.rados.rados.0.trial082.stdout:2795: finishing copy_from to trial08226312-24 2026-02-12T17:40:30.488 INFO:tasks.rados.rados.0.trial082.stdout:2795: got expected ENOENT (src dne) 2026-02-12T17:40:30.489 INFO:tasks.rados.rados.0.trial082.stdout:2795: finishing copy_from racing read to trial08226312-24 2026-02-12T17:40:30.489 INFO:tasks.rados.rados.0.trial082.stdout:2796: expect (ObjNum 876 snap 277 seq_num 876) 2026-02-12T17:40:30.489 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:30.532 INFO:tasks.rados.rados.0.trial082.stdout:2793: finishing write tid 3 to trial08226312-30 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:2793: finishing write tid 4 to trial08226312-30 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:2793: finishing write tid 5 to trial08226312-30 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:2793: oid 30 updating version 0 to 2201 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:2793: oid 30 updating version 2201 to 2203 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:2793: oid 30 version 2203 is already newer than 2200 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:2793: oid 30 version 2203 is already newer than 2202 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2203 (ObjNum 948 snap 294 seq_num 948) dirty exists 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:2793: left oid 30 (ObjNum 948 snap 294 seq_num 948) 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:2799: finishing write tid 1 to trial08226312-39 2026-02-12T17:40:30.533 INFO:tasks.rados.rados.0.trial082.stdout:2797: finishing copy_from racing read to trial08226312-20 2026-02-12T17:40:30.534 INFO:tasks.rados.rados.0.trial082.stdout:2798: expect (ObjNum 940 snap 294 seq_num 940) 2026-02-12T17:40:30.534 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 14909 2026-02-12T17:40:30.580 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:30.672 INFO:tasks.rados.rados.0.trial082.stdout:2797: finishing copy_from to trial08226312-20 2026-02-12T17:40:30.672 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 1879 (ObjNum 942 snap 294 seq_num 942) dirty exists 2026-02-12T17:40:30.672 INFO:tasks.rados.rados.0.trial082.stdout:2794: finishing copy_from racing read to trial08226312-29 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:2794: finishing copy_from to trial08226312-29 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 1567 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:2799: finishing write tid 2 to trial08226312-39 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:2799: finishing write tid 3 to trial08226312-39 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:2799: finishing write tid 4 to trial08226312-39 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:2799: finishing write tid 5 to trial08226312-39 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:2799: oid 39 updating version 0 to 2128 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:2799: oid 39 updating version 2128 to 2129 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:2799: oid 39 updating version 2129 to 2130 2026-02-12T17:40:30.673 INFO:tasks.rados.rados.0.trial082.stdout:2799: oid 39 version 2130 is already newer than 2127 2026-02-12T17:40:30.674 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 2130 (ObjNum 949 snap 294 seq_num 949) dirty exists 2026-02-12T17:40:30.674 INFO:tasks.rados.rados.0.trial082.stdout:2799: left oid 39 (ObjNum 949 snap 294 seq_num 949) 2026-02-12T17:40:31.149 INFO:tasks.rados.rados.0.trial082.stdout:2793: done (7 left) 2026-02-12T17:40:31.149 INFO:tasks.rados.rados.0.trial082.stdout:2794: done (6 left) 2026-02-12T17:40:31.149 INFO:tasks.rados.rados.0.trial082.stdout:2795: done (5 left) 2026-02-12T17:40:31.150 INFO:tasks.rados.rados.0.trial082.stdout:2796: done (4 left) 2026-02-12T17:40:31.150 INFO:tasks.rados.rados.0.trial082.stdout:2797: done (3 left) 2026-02-12T17:40:31.150 INFO:tasks.rados.rados.0.trial082.stdout:2798: done (2 left) 2026-02-12T17:40:31.150 INFO:tasks.rados.rados.0.trial082.stdout:2799: done (1 left) 2026-02-12T17:40:31.150 INFO:tasks.rados.rados.0.trial082.stdout:2800: done (0 left) 2026-02-12T17:40:31.150 INFO:tasks.rados.rados.0.trial082.stdout:2801: snap_remove snap 290 2026-02-12T17:40:32.154 INFO:tasks.rados.rados.0.trial082.stdout:2801: done (0 left) 2026-02-12T17:40:32.154 INFO:tasks.rados.rados.0.trial082.stdout:2802: copy_from oid 25 from oid 30 current snap is 295 2026-02-12T17:40:32.154 INFO:tasks.rados.rados.0.trial082.stdout:2803: write (excl) oid 46 current snap is 295 2026-02-12T17:40:32.154 INFO:tasks.rados.rados.0.trial082.stdout:2803: seq_num 950 ranges {766650=714322,2075423=688655,3522196=444454} 2026-02-12T17:40:32.160 INFO:tasks.rados.rados.0.trial082.stdout:2803: writing trial08226312-46 from 766650 to 1480972 tid 1 2026-02-12T17:40:32.164 INFO:tasks.rados.rados.0.trial082.stdout:2803: writing trial08226312-46 from 2075423 to 2764078 tid 2 2026-02-12T17:40:32.169 INFO:tasks.rados.rados.0.trial082.stdout:2803: writing trial08226312-46 from 3522196 to 3966650 tid 3 2026-02-12T17:40:32.170 INFO:tasks.rados.rados.0.trial082.stdout:2804: snap_create 2026-02-12T17:40:32.170 INFO:tasks.rados.rados.0.trial082.stdout:2803: finishing write tid 1 to trial08226312-46 2026-02-12T17:40:32.170 INFO:tasks.rados.rados.0.trial082.stdout:2802: finishing copy_from racing read to trial08226312-25 2026-02-12T17:40:32.170 INFO:tasks.rados.rados.0.trial082.stdout:2803: finishing write tid 2 to trial08226312-46 2026-02-12T17:40:32.170 INFO:tasks.rados.rados.0.trial082.stdout:2802: finishing copy_from to trial08226312-25 2026-02-12T17:40:32.170 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 2203 (ObjNum 948 snap 294 seq_num 948) dirty exists 2026-02-12T17:40:32.171 INFO:tasks.rados.rados.0.trial082.stdout:2803: finishing write tid 3 to trial08226312-46 2026-02-12T17:40:32.171 INFO:tasks.rados.rados.0.trial082.stdout:2803: finishing write tid 4 to trial08226312-46 2026-02-12T17:40:32.171 INFO:tasks.rados.rados.0.trial082.stdout:2803: finishing write tid 5 to trial08226312-46 2026-02-12T17:40:32.172 INFO:tasks.rados.rados.0.trial082.stdout:2803: oid 46 updating version 0 to 1889 2026-02-12T17:40:32.172 INFO:tasks.rados.rados.0.trial082.stdout:2803: oid 46 version 1889 is already newer than 1886 2026-02-12T17:40:32.172 INFO:tasks.rados.rados.0.trial082.stdout:2803: oid 46 version 1889 is already newer than 1887 2026-02-12T17:40:32.172 INFO:tasks.rados.rados.0.trial082.stdout:2803: oid 46 version 1889 is already newer than 1888 2026-02-12T17:40:32.172 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1889 (ObjNum 950 snap 295 seq_num 950) dirty exists 2026-02-12T17:40:32.172 INFO:tasks.rados.rados.0.trial082.stdout:2803: left oid 46 (ObjNum 950 snap 295 seq_num 950) 2026-02-12T17:40:33.093 INFO:tasks.rados.rados.0.trial082.stdout:2802: done (2 left) 2026-02-12T17:40:33.093 INFO:tasks.rados.rados.0.trial082.stdout:2803: done (1 left) 2026-02-12T17:40:33.093 INFO:tasks.rados.rados.0.trial082.stdout:2804: done (0 left) 2026-02-12T17:40:33.093 INFO:tasks.rados.rados.0.trial082.stdout:2805: rollback oid 43 current snap is 296 2026-02-12T17:40:33.093 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 43 to 283 2026-02-12T17:40:33.093 INFO:tasks.rados.rados.0.trial082.stdout:2806: read oid 13 snap -1 2026-02-12T17:40:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2806: expect (ObjNum 816 snap 253 seq_num 816) 2026-02-12T17:40:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2807: read oid 38 snap 283 2026-02-12T17:40:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2807: expect (ObjNum 809 snap 253 seq_num 809) 2026-02-12T17:40:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2808: write (excl) oid 15 current snap is 296 2026-02-12T17:40:33.094 INFO:tasks.rados.rados.0.trial082.stdout:2808: seq_num 951 ranges {783457=505924,1850258=548666,2865972=721096} 2026-02-12T17:40:33.097 INFO:tasks.rados.rados.0.trial082.stdout:2808: writing trial08226312-15 from 783457 to 1289381 tid 1 2026-02-12T17:40:33.101 INFO:tasks.rados.rados.0.trial082.stdout:2808: writing trial08226312-15 from 1850258 to 2398924 tid 2 2026-02-12T17:40:33.106 INFO:tasks.rados.rados.0.trial082.stdout:2808: writing trial08226312-15 from 2865972 to 3587068 tid 3 2026-02-12T17:40:33.106 INFO:tasks.rados.rados.0.trial082.stdout:2809: write (excl) oid 41 current snap is 296 2026-02-12T17:40:33.106 INFO:tasks.rados.rados.0.trial082.stdout:2809: seq_num 952 ranges {400264=581173,1508740=491524} 2026-02-12T17:40:33.110 INFO:tasks.rados.rados.0.trial082.stdout:2809: writing trial08226312-41 from 400264 to 981437 tid 1 2026-02-12T17:40:33.114 INFO:tasks.rados.rados.0.trial082.stdout:2809: writing trial08226312-41 from 1508740 to 2000264 tid 2 2026-02-12T17:40:33.114 INFO:tasks.rados.rados.0.trial082.stdout:2810: snap_remove snap 275 2026-02-12T17:40:34.096 INFO:tasks.rados.rados.0.trial082.stdout:2810: done (5 left) 2026-02-12T17:40:34.096 INFO:tasks.rados.rados.0.trial082.stdout:2811: snap_create 2026-02-12T17:40:34.096 INFO:tasks.rados.rados.0.trial082.stdout:2805: finishing rollback tid 0 to trial08226312-43 2026-02-12T17:40:34.096 INFO:tasks.rados.rados.0.trial082.stdout:2805: finishing rollback tid 1 to trial08226312-43 2026-02-12T17:40:34.096 INFO:tasks.rados.rados.0.trial082.stdout:2805: finishing rollback tid 2 to trial08226312-43 2026-02-12T17:40:34.096 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2206 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:40:34.097 INFO:tasks.rados.rados.0.trial082.stdout:2807: expect (ObjNum 809 snap 253 seq_num 809) 2026-02-12T17:40:34.144 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 104140 2026-02-12T17:40:34.170 INFO:tasks.rados.rados.0.trial082.stdout:2808: finishing write tid 1 to trial08226312-15 2026-02-12T17:40:34.170 INFO:tasks.rados.rados.0.trial082.stdout:2806: expect (ObjNum 816 snap 253 seq_num 816) 2026-02-12T17:40:34.170 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:34.211 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 535277 2026-02-12T17:40:34.242 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:34.280 INFO:tasks.rados.rados.0.trial082.stdout:2808: finishing write tid 2 to trial08226312-15 2026-02-12T17:40:34.280 INFO:tasks.rados.rados.0.trial082.stdout:2808: finishing write tid 3 to trial08226312-15 2026-02-12T17:40:34.280 INFO:tasks.rados.rados.0.trial082.stdout:2808: finishing write tid 4 to trial08226312-15 2026-02-12T17:40:34.280 INFO:tasks.rados.rados.0.trial082.stdout:2808: finishing write tid 5 to trial08226312-15 2026-02-12T17:40:34.280 INFO:tasks.rados.rados.0.trial082.stdout:2808: oid 15 updating version 0 to 1222 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:2808: oid 15 updating version 1222 to 1225 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:2808: oid 15 version 1225 is already newer than 1224 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:2808: oid 15 version 1225 is already newer than 1223 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 1225 (ObjNum 951 snap 296 seq_num 951) dirty exists 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:2808: left oid 15 (ObjNum 951 snap 296 seq_num 951) 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:2809: finishing write tid 1 to trial08226312-41 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:2809: finishing write tid 2 to trial08226312-41 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:2809: finishing write tid 3 to trial08226312-41 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:2809: finishing write tid 4 to trial08226312-41 2026-02-12T17:40:34.281 INFO:tasks.rados.rados.0.trial082.stdout:2809: oid 41 updating version 0 to 1944 2026-02-12T17:40:34.282 INFO:tasks.rados.rados.0.trial082.stdout:2809: oid 41 version 1944 is already newer than 1942 2026-02-12T17:40:34.282 INFO:tasks.rados.rados.0.trial082.stdout:2809: oid 41 version 1944 is already newer than 1943 2026-02-12T17:40:34.282 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1944 (ObjNum 952 snap 296 seq_num 952) dirty exists 2026-02-12T17:40:34.282 INFO:tasks.rados.rados.0.trial082.stdout:2809: left oid 41 (ObjNum 952 snap 296 seq_num 952) 2026-02-12T17:40:35.098 INFO:tasks.rados.rados.0.trial082.stdout:2805: done (5 left) 2026-02-12T17:40:35.098 INFO:tasks.rados.rados.0.trial082.stdout:2806: done (4 left) 2026-02-12T17:40:35.098 INFO:tasks.rados.rados.0.trial082.stdout:2807: done (3 left) 2026-02-12T17:40:35.098 INFO:tasks.rados.rados.0.trial082.stdout:2808: done (2 left) 2026-02-12T17:40:35.099 INFO:tasks.rados.rados.0.trial082.stdout:2809: done (1 left) 2026-02-12T17:40:35.099 INFO:tasks.rados.rados.0.trial082.stdout:2811: done (0 left) 2026-02-12T17:40:35.099 INFO:tasks.rados.rados.0.trial082.stdout:2812: write oid 46 current snap is 297 2026-02-12T17:40:35.099 INFO:tasks.rados.rados.0.trial082.stdout:2812: seq_num 953 ranges {417071=656422,1567222=449849} 2026-02-12T17:40:35.102 INFO:tasks.rados.rados.0.trial082.stdout:2812: writing trial08226312-46 from 417071 to 1073493 tid 1 2026-02-12T17:40:35.105 INFO:tasks.rados.rados.0.trial082.stdout:2812: writing trial08226312-46 from 1567222 to 2017071 tid 2 2026-02-12T17:40:35.106 INFO:tasks.rados.rados.0.trial082.stdout:2813: snap_remove snap 280 2026-02-12T17:40:36.100 INFO:tasks.rados.rados.0.trial082.stdout:2813: done (1 left) 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2814: read oid 11 snap -1 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2814: expect (ObjNum 944 snap 294 seq_num 944) 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2815: rollback oid 48 current snap is 297 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 291 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2812: finishing write tid 1 to trial08226312-46 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2812: finishing write tid 2 to trial08226312-46 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2812: finishing write tid 3 to trial08226312-46 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2812: finishing write tid 4 to trial08226312-46 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2812: oid 46 updating version 0 to 1891 2026-02-12T17:40:36.101 INFO:tasks.rados.rados.0.trial082.stdout:2812: oid 46 updating version 1891 to 1892 2026-02-12T17:40:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2812: oid 46 version 1892 is already newer than 1890 2026-02-12T17:40:36.102 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1892 (ObjNum 953 snap 297 seq_num 953) dirty exists 2026-02-12T17:40:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2812: left oid 46 (ObjNum 953 snap 297 seq_num 953) 2026-02-12T17:40:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2812: done (2 left) 2026-02-12T17:40:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2816: read oid 17 snap -1 2026-02-12T17:40:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2816: expect deleted 2026-02-12T17:40:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2817: write oid 7 current snap is 297 2026-02-12T17:40:36.102 INFO:tasks.rados.rados.0.trial082.stdout:2817: seq_num 954 ranges {433878=731671,1909351=124527} 2026-02-12T17:40:36.105 INFO:tasks.rados.rados.0.trial082.stdout:2817: writing trial08226312-7 from 433878 to 1165549 tid 1 2026-02-12T17:40:36.108 INFO:tasks.rados.rados.0.trial082.stdout:2817: writing trial08226312-7 from 1909351 to 2033878 tid 2 2026-02-12T17:40:36.108 INFO:tasks.rados.rados.0.trial082.stdout:2818: snap_remove snap 295 2026-02-12T17:40:37.103 INFO:tasks.rados.rados.0.trial082.stdout:2818: done (4 left) 2026-02-12T17:40:37.103 INFO:tasks.rados.rados.0.trial082.stdout:2819: write (excl) oid 43 current snap is 297 2026-02-12T17:40:37.103 INFO:tasks.rados.rados.0.trial082.stdout:2819: seq_num 955 ranges {450685=406920,1567833=482852} 2026-02-12T17:40:37.106 INFO:tasks.rados.rados.0.trial082.stdout:2819: writing trial08226312-43 from 450685 to 857605 tid 1 2026-02-12T17:40:37.112 INFO:tasks.rados.rados.0.trial082.stdout:2819: writing trial08226312-43 from 1567833 to 2050685 tid 2 2026-02-12T17:40:37.112 INFO:tasks.rados.rados.0.trial082.stdout:2820: read oid 3 snap 296 2026-02-12T17:40:37.112 INFO:tasks.rados.rados.0.trial082.stdout:2820: expect (ObjNum 940 snap 294 seq_num 940) 2026-02-12T17:40:37.112 INFO:tasks.rados.rados.0.trial082.stdout:2821: read oid 28 snap -1 2026-02-12T17:40:37.112 INFO:tasks.rados.rados.0.trial082.stdout:2821: expect (ObjNum 907 snap 287 seq_num 907) 2026-02-12T17:40:37.112 INFO:tasks.rados.rados.0.trial082.stdout:2822: read oid 18 snap 296 2026-02-12T17:40:37.112 INFO:tasks.rados.rados.0.trial082.stdout:2822: expect (ObjNum 898 snap 286 seq_num 898) 2026-02-12T17:40:37.112 INFO:tasks.rados.rados.0.trial082.stdout:2823: copy_from oid 50 from oid 13 current snap is 297 2026-02-12T17:40:37.113 INFO:tasks.rados.rados.0.trial082.stdout:2815: finishing rollback tid 0 to trial08226312-48 2026-02-12T17:40:37.113 INFO:tasks.rados.rados.0.trial082.stdout:2815: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:40:37.113 INFO:tasks.rados.rados.0.trial082.stdout:2815: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:40:37.113 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1600 (ObjNum 886 snap 281 seq_num 886) dirty exists 2026-02-12T17:40:37.113 INFO:tasks.rados.rados.0.trial082.stdout:2814: expect (ObjNum 944 snap 294 seq_num 944) 2026-02-12T17:40:37.175 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2951188 2026-02-12T17:40:37.191 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:37.240 INFO:tasks.rados.rados.0.trial082.stdout:2817: finishing write tid 1 to trial08226312-7 2026-02-12T17:40:37.240 INFO:tasks.rados.rados.0.trial082.stdout:2817: finishing write tid 2 to trial08226312-7 2026-02-12T17:40:37.240 INFO:tasks.rados.rados.0.trial082.stdout:2814: done (8 left) 2026-02-12T17:40:37.240 INFO:tasks.rados.rados.0.trial082.stdout:2815: done (7 left) 2026-02-12T17:40:37.240 INFO:tasks.rados.rados.0.trial082.stdout:2816: done (6 left) 2026-02-12T17:40:37.240 INFO:tasks.rados.rados.0.trial082.stdout:2824: copy_from oid 17 from oid 46 current snap is 297 2026-02-12T17:40:37.240 INFO:tasks.rados.rados.0.trial082.stdout:2817: finishing write tid 3 to trial08226312-7 2026-02-12T17:40:37.240 INFO:tasks.rados.rados.0.trial082.stdout:2817: finishing write tid 4 to trial08226312-7 2026-02-12T17:40:37.240 INFO:tasks.rados.rados.0.trial082.stdout:2817: oid 7 updating version 0 to 1676 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:2817: oid 7 updating version 1676 to 1677 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:2817: oid 7 updating version 1677 to 1678 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 1678 (ObjNum 954 snap 297 seq_num 954) dirty exists 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:2817: left oid 7 (ObjNum 954 snap 297 seq_num 954) 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:2819: finishing write tid 1 to trial08226312-43 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:2819: finishing write tid 2 to trial08226312-43 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:2819: finishing write tid 3 to trial08226312-43 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:2819: finishing write tid 4 to trial08226312-43 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:2819: oid 43 updating version 0 to 2209 2026-02-12T17:40:37.241 INFO:tasks.rados.rados.0.trial082.stdout:2819: oid 43 version 2209 is already newer than 2207 2026-02-12T17:40:37.242 INFO:tasks.rados.rados.0.trial082.stdout:2819: oid 43 version 2209 is already newer than 2208 2026-02-12T17:40:37.242 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2209 (ObjNum 955 snap 297 seq_num 955) dirty exists 2026-02-12T17:40:37.242 INFO:tasks.rados.rados.0.trial082.stdout:2819: left oid 43 (ObjNum 955 snap 297 seq_num 955) 2026-02-12T17:40:37.242 INFO:tasks.rados.rados.0.trial082.stdout:2820: expect (ObjNum 940 snap 294 seq_num 940) 2026-02-12T17:40:37.273 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3442387 2026-02-12T17:40:37.284 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1405992 2026-02-12T17:40:37.357 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3537503 2026-02-12T17:40:37.361 INFO:tasks.rados.rados.0.trial082.stdout:2822: expect (ObjNum 898 snap 286 seq_num 898) 2026-02-12T17:40:37.382 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2731270 2026-02-12T17:40:37.388 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:37.449 INFO:tasks.rados.rados.0.trial082.stdout:2821: expect (ObjNum 907 snap 287 seq_num 907) 2026-02-12T17:40:37.533 INFO:tasks.rados.rados.0.trial082.stdout:2823: finishing copy_from racing read to trial08226312-50 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:2823: finishing copy_from to trial08226312-50 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 1889 (ObjNum 816 snap 253 seq_num 816) dirty exists 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:2824: finishing copy_from racing read to trial08226312-17 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:2824: finishing copy_from to trial08226312-17 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 1892 (ObjNum 953 snap 297 seq_num 953) dirty exists 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:2817: done (6 left) 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:2819: done (5 left) 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:2820: done (4 left) 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:2821: done (3 left) 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:2822: done (2 left) 2026-02-12T17:40:37.534 INFO:tasks.rados.rados.0.trial082.stdout:2823: done (1 left) 2026-02-12T17:40:37.535 INFO:tasks.rados.rados.0.trial082.stdout:2824: done (0 left) 2026-02-12T17:40:37.535 INFO:tasks.rados.rados.0.trial082.stdout:2825: snap_create 2026-02-12T17:40:38.107 INFO:tasks.rados.rados.0.trial082.stdout:2825: done (0 left) 2026-02-12T17:40:38.107 INFO:tasks.rados.rados.0.trial082.stdout:2826: copy_from oid 47 from oid 15 current snap is 298 2026-02-12T17:40:38.107 INFO:tasks.rados.rados.0.trial082.stdout:2827: read oid 13 snap -1 2026-02-12T17:40:38.107 INFO:tasks.rados.rados.0.trial082.stdout:2827: expect (ObjNum 816 snap 253 seq_num 816) 2026-02-12T17:40:38.107 INFO:tasks.rados.rados.0.trial082.stdout:2828: read oid 10 snap -1 2026-02-12T17:40:38.108 INFO:tasks.rados.rados.0.trial082.stdout:2828: expect deleted 2026-02-12T17:40:38.108 INFO:tasks.rados.rados.0.trial082.stdout:2829: snap_remove snap 291 2026-02-12T17:40:39.109 INFO:tasks.rados.rados.0.trial082.stdout:2829: done (3 left) 2026-02-12T17:40:39.109 INFO:tasks.rados.rados.0.trial082.stdout:2830: write (excl) oid 9 current snap is 298 2026-02-12T17:40:39.110 INFO:tasks.rados.rados.0.trial082.stdout:2830: seq_num 956 ranges {467492=482169,1626315=441177} 2026-02-12T17:40:39.113 INFO:tasks.rados.rados.0.trial082.stdout:2830: writing trial08226312-9 from 467492 to 949661 tid 1 2026-02-12T17:40:39.117 INFO:tasks.rados.rados.0.trial082.stdout:2830: writing trial08226312-9 from 1626315 to 2067492 tid 2 2026-02-12T17:40:39.117 INFO:tasks.rados.rados.0.trial082.stdout:2831: rollback oid 48 current snap is 298 2026-02-12T17:40:39.117 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 296 2026-02-12T17:40:39.118 INFO:tasks.rados.rados.0.trial082.stdout:2827: expect (ObjNum 816 snap 253 seq_num 816) 2026-02-12T17:40:39.176 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2972249 2026-02-12T17:40:39.228 INFO:tasks.rados.rados.0.trial082.stdout:2826: finishing copy_from racing read to trial08226312-47 2026-02-12T17:40:39.228 INFO:tasks.rados.rados.0.trial082.stdout:2827: done (4 left) 2026-02-12T17:40:39.228 INFO:tasks.rados.rados.0.trial082.stdout:2828: done (3 left) 2026-02-12T17:40:39.228 INFO:tasks.rados.rados.0.trial082.stdout:2832: rollback oid 30 current snap is 298 2026-02-12T17:40:39.228 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 297 2026-02-12T17:40:39.228 INFO:tasks.rados.rados.0.trial082.stdout:2826: finishing copy_from to trial08226312-47 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1225 (ObjNum 951 snap 296 seq_num 951) dirty exists 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:2830: finishing write tid 1 to trial08226312-9 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:2830: finishing write tid 2 to trial08226312-9 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:2830: finishing write tid 3 to trial08226312-9 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:2831: finishing rollback tid 0 to trial08226312-48 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:2830: finishing write tid 4 to trial08226312-9 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:2830: oid 9 updating version 0 to 1687 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:2830: oid 9 version 1687 is already newer than 1685 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:2830: oid 9 version 1687 is already newer than 1686 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 1687 (ObjNum 956 snap 298 seq_num 956) dirty exists 2026-02-12T17:40:39.229 INFO:tasks.rados.rados.0.trial082.stdout:2830: left oid 9 (ObjNum 956 snap 298 seq_num 956) 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2831: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2831: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1603 (ObjNum 943 snap 294 seq_num 943) dirty exists 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2826: done (3 left) 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2830: done (2 left) 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2831: done (1 left) 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2833: copy_from oid 39 from oid 27 current snap is 298 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2834: delete oid 26 current snap is 298 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2834: done (2 left) 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2835: write (excl) oid 29 current snap is 298 2026-02-12T17:40:39.230 INFO:tasks.rados.rados.0.trial082.stdout:2835: seq_num 958 ranges {501106=749020,1743279=357827} 2026-02-12T17:40:39.232 INFO:tasks.rados.rados.0.trial082.stdout:2835: writing trial08226312-29 from 501106 to 1250126 tid 1 2026-02-12T17:40:39.235 INFO:tasks.rados.rados.0.trial082.stdout:2835: writing trial08226312-29 from 1743279 to 2101106 tid 2 2026-02-12T17:40:39.235 INFO:tasks.rados.rados.0.trial082.stdout:2836: snap_create 2026-02-12T17:40:39.236 INFO:tasks.rados.rados.0.trial082.stdout:2832: finishing rollback tid 0 to trial08226312-30 2026-02-12T17:40:39.236 INFO:tasks.rados.rados.0.trial082.stdout:2832: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:40:39.236 INFO:tasks.rados.rados.0.trial082.stdout:2832: finishing rollback tid 2 to trial08226312-30 2026-02-12T17:40:39.236 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2212 (ObjNum 948 snap 294 seq_num 948) dirty exists 2026-02-12T17:40:39.236 INFO:tasks.rados.rados.0.trial082.stdout:2833: finishing copy_from racing read to trial08226312-39 2026-02-12T17:40:39.236 INFO:tasks.rados.rados.0.trial082.stdout:2833: finishing copy_from to trial08226312-39 2026-02-12T17:40:39.236 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 1118 (ObjNum 873 snap 275 seq_num 873) dirty exists 2026-02-12T17:40:39.236 INFO:tasks.rados.rados.0.trial082.stdout:2835: finishing write tid 1 to trial08226312-29 2026-02-12T17:40:39.237 INFO:tasks.rados.rados.0.trial082.stdout:2835: finishing write tid 2 to trial08226312-29 2026-02-12T17:40:39.237 INFO:tasks.rados.rados.0.trial082.stdout:2835: finishing write tid 3 to trial08226312-29 2026-02-12T17:40:39.237 INFO:tasks.rados.rados.0.trial082.stdout:2835: finishing write tid 4 to trial08226312-29 2026-02-12T17:40:39.237 INFO:tasks.rados.rados.0.trial082.stdout:2835: oid 29 updating version 0 to 1892 2026-02-12T17:40:39.237 INFO:tasks.rados.rados.0.trial082.stdout:2835: oid 29 version 1892 is already newer than 1891 2026-02-12T17:40:39.237 INFO:tasks.rados.rados.0.trial082.stdout:2835: oid 29 version 1892 is already newer than 1890 2026-02-12T17:40:39.238 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 1892 (ObjNum 958 snap 298 seq_num 958) dirty exists 2026-02-12T17:40:39.238 INFO:tasks.rados.rados.0.trial082.stdout:2835: left oid 29 (ObjNum 958 snap 298 seq_num 958) 2026-02-12T17:40:40.114 INFO:tasks.rados.rados.0.trial082.stdout:2832: done (3 left) 2026-02-12T17:40:40.115 INFO:tasks.rados.rados.0.trial082.stdout:2833: done (2 left) 2026-02-12T17:40:40.115 INFO:tasks.rados.rados.0.trial082.stdout:2835: done (1 left) 2026-02-12T17:40:40.115 INFO:tasks.rados.rados.0.trial082.stdout:2836: done (0 left) 2026-02-12T17:40:40.115 INFO:tasks.rados.rados.0.trial082.stdout:2837: snap_remove snap 297 2026-02-12T17:40:41.117 INFO:tasks.rados.rados.0.trial082.stdout:2837: done (0 left) 2026-02-12T17:40:41.117 INFO:tasks.rados.rados.0.trial082.stdout:2838: copy_from oid 45 from oid 35 current snap is 299 2026-02-12T17:40:41.117 INFO:tasks.rados.rados.0.trial082.stdout:2839: delete oid 10 current snap is 299 2026-02-12T17:40:41.120 INFO:tasks.rados.rados.0.trial082.stdout:2839: done (1 left) 2026-02-12T17:40:41.120 INFO:tasks.rados.rados.0.trial082.stdout:2840: copy_from oid 1 from oid 24 current snap is 299 2026-02-12T17:40:41.120 INFO:tasks.rados.rados.0.trial082.stdout:2841: delete oid 16 current snap is 299 2026-02-12T17:40:41.121 INFO:tasks.rados.rados.0.trial082.stdout:2841: done (2 left) 2026-02-12T17:40:41.121 INFO:tasks.rados.rados.0.trial082.stdout:2842: rollback oid 33 current snap is 299 2026-02-12T17:40:41.122 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 293 2026-02-12T17:40:41.122 INFO:tasks.rados.rados.0.trial082.stdout:2843: snap_remove snap 284 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2843: done (3 left) 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2844: rollback oid 49 current snap is 299 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 283 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2842: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 0 (ObjNum 177 snap 0 seq_num 26891216) dirty dne 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2838: finishing copy_from racing read to trial08226312-45 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2838: finishing copy_from to trial08226312-45 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1879 (ObjNum 930 snap 291 seq_num 930) dirty exists 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2840: finishing copy_from racing read to trial08226312-1 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2840: finishing copy_from to trial08226312-1 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2128 (ObjNum 923 snap 290 seq_num 923) dirty exists 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2838: done (3 left) 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2840: done (2 left) 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2842: done (1 left) 2026-02-12T17:40:42.121 INFO:tasks.rados.rados.0.trial082.stdout:2845: delete oid 31 current snap is 299 2026-02-12T17:40:42.122 INFO:tasks.rados.rados.0.trial082.stdout:2844: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:40:42.122 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 0 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:40:42.123 INFO:tasks.rados.rados.0.trial082.stdout:2844: done (1 left) 2026-02-12T17:40:42.123 INFO:tasks.rados.rados.0.trial082.stdout:2845: done (0 left) 2026-02-12T17:40:42.123 INFO:tasks.rados.rados.0.trial082.stdout:2846: delete oid 49 current snap is 299 2026-02-12T17:40:42.125 INFO:tasks.rados.rados.0.trial082.stdout:2846: done (0 left) 2026-02-12T17:40:42.125 INFO:tasks.rados.rados.0.trial082.stdout:2847: copy_from oid 10 from oid 23 current snap is 299 2026-02-12T17:40:42.125 INFO:tasks.rados.rados.0.trial082.stdout:2848: rollback oid 40 current snap is 299 2026-02-12T17:40:42.125 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 40 to 293 2026-02-12T17:40:42.125 INFO:tasks.rados.rados.0.trial082.stdout:2849: write (excl) oid 37 current snap is 299 2026-02-12T17:40:42.125 INFO:tasks.rados.rados.0.trial082.stdout:2849: seq_num 963 ranges {585141=725265,1919336=265805} 2026-02-12T17:40:42.131 INFO:tasks.rados.rados.0.trial082.stdout:2849: writing trial08226312-37 from 585141 to 1310406 tid 1 2026-02-12T17:40:42.134 INFO:tasks.rados.rados.0.trial082.stdout:2849: writing trial08226312-37 from 1919336 to 2185141 tid 2 2026-02-12T17:40:42.134 INFO:tasks.rados.rados.0.trial082.stdout:2850: read oid 36 snap 283 2026-02-12T17:40:42.134 INFO:tasks.rados.rados.0.trial082.stdout:2850: expect (ObjNum 770 snap 234 seq_num 770) 2026-02-12T17:40:42.135 INFO:tasks.rados.rados.0.trial082.stdout:2851: delete oid 18 current snap is 299 2026-02-12T17:40:42.135 INFO:tasks.rados.rados.0.trial082.stdout:2848: finishing rollback tid 0 to trial08226312-40 2026-02-12T17:40:42.135 INFO:tasks.rados.rados.0.trial082.stdout:2848: finishing rollback tid 1 to trial08226312-40 2026-02-12T17:40:42.135 INFO:tasks.rados.rados.0.trial082.stdout:2848: finishing rollback tid 2 to trial08226312-40 2026-02-12T17:40:42.135 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1701 (ObjNum 750 snap 227 seq_num 750) dirty exists 2026-02-12T17:40:42.135 INFO:tasks.rados.rados.0.trial082.stdout:2849: finishing write tid 1 to trial08226312-37 2026-02-12T17:40:42.135 INFO:tasks.rados.rados.0.trial082.stdout:2847: finishing copy_from racing read to trial08226312-10 2026-02-12T17:40:42.137 INFO:tasks.rados.rados.0.trial082.stdout:2848: done (4 left) 2026-02-12T17:40:42.137 INFO:tasks.rados.rados.0.trial082.stdout:2851: done (3 left) 2026-02-12T17:40:42.137 INFO:tasks.rados.rados.0.trial082.stdout:2852: snap_create 2026-02-12T17:40:42.137 INFO:tasks.rados.rados.0.trial082.stdout:2849: finishing write tid 2 to trial08226312-37 2026-02-12T17:40:42.137 INFO:tasks.rados.rados.0.trial082.stdout:2849: finishing write tid 3 to trial08226312-37 2026-02-12T17:40:42.137 INFO:tasks.rados.rados.0.trial082.stdout:2849: finishing write tid 4 to trial08226312-37 2026-02-12T17:40:42.137 INFO:tasks.rados.rados.0.trial082.stdout:2849: oid 37 updating version 0 to 1945 2026-02-12T17:40:42.137 INFO:tasks.rados.rados.0.trial082.stdout:2849: oid 37 updating version 1945 to 1946 2026-02-12T17:40:42.138 INFO:tasks.rados.rados.0.trial082.stdout:2849: oid 37 updating version 1946 to 1947 2026-02-12T17:40:42.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1947 (ObjNum 963 snap 299 seq_num 963) dirty exists 2026-02-12T17:40:42.138 INFO:tasks.rados.rados.0.trial082.stdout:2849: left oid 37 (ObjNum 963 snap 299 seq_num 963) 2026-02-12T17:40:42.138 INFO:tasks.rados.rados.0.trial082.stdout:2847: finishing copy_from to trial08226312-10 2026-02-12T17:40:42.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1871 (ObjNum 916 snap 288 seq_num 916) dirty exists 2026-02-12T17:40:42.139 INFO:tasks.rados.rados.0.trial082.stdout:2850: expect (ObjNum 770 snap 234 seq_num 770) 2026-02-12T17:40:42.158 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:42.180 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:43.094 INFO:tasks.rados.rados.0.trial082.stdout:2847: done (3 left) 2026-02-12T17:40:43.094 INFO:tasks.rados.rados.0.trial082.stdout:2849: done (2 left) 2026-02-12T17:40:43.094 INFO:tasks.rados.rados.0.trial082.stdout:2850: done (1 left) 2026-02-12T17:40:43.094 INFO:tasks.rados.rados.0.trial082.stdout:2852: done (0 left) 2026-02-12T17:40:43.095 INFO:tasks.rados.rados.0.trial082.stdout:2853: snap_create 2026-02-12T17:40:44.372 INFO:tasks.rados.rados.0.trial082.stdout:2853: done (0 left) 2026-02-12T17:40:44.373 INFO:tasks.rados.rados.0.trial082.stdout:2854: write oid 28 current snap is 301 2026-02-12T17:40:44.373 INFO:tasks.rados.rados.0.trial082.stdout:2854: seq_num 965 ranges {618755=475763,1636300=457996} 2026-02-12T17:40:44.377 INFO:tasks.rados.rados.0.trial082.stdout:2854: writing trial08226312-28 from 618755 to 1094518 tid 1 2026-02-12T17:40:44.381 INFO:tasks.rados.rados.0.trial082.stdout:2854: writing trial08226312-28 from 1636300 to 2094296 tid 2 2026-02-12T17:40:44.381 INFO:tasks.rados.rados.0.trial082.stdout:2855: delete oid 26 current snap is 301 2026-02-12T17:40:44.382 INFO:tasks.rados.rados.0.trial082.stdout:2854: finishing write tid 1 to trial08226312-28 2026-02-12T17:40:44.383 INFO:tasks.rados.rados.0.trial082.stdout:2855: done (1 left) 2026-02-12T17:40:44.383 INFO:tasks.rados.rados.0.trial082.stdout:2856: copy_from oid 2 from oid 43 current snap is 301 2026-02-12T17:40:44.383 INFO:tasks.rados.rados.0.trial082.stdout:2857: read oid 10 snap -1 2026-02-12T17:40:44.383 INFO:tasks.rados.rados.0.trial082.stdout:2857: expect (ObjNum 916 snap 288 seq_num 916) 2026-02-12T17:40:44.384 INFO:tasks.rados.rados.0.trial082.stdout:2858: snap_remove snap 293 2026-02-12T17:40:45.717 INFO:tasks.rados.rados.0.trial082.stdout:2858: done (3 left) 2026-02-12T17:40:45.717 INFO:tasks.rados.rados.0.trial082.stdout:2859: rollback oid 17 current snap is 301 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 292 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:2854: finishing write tid 2 to trial08226312-28 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:2854: finishing write tid 3 to trial08226312-28 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:2854: finishing write tid 4 to trial08226312-28 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:2854: oid 28 updating version 0 to 1705 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:2854: oid 28 version 1705 is already newer than 1703 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:2854: oid 28 version 1705 is already newer than 1704 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1705 (ObjNum 965 snap 301 seq_num 965) dirty exists 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:2854: left oid 28 (ObjNum 965 snap 301 seq_num 965) 2026-02-12T17:40:45.718 INFO:tasks.rados.rados.0.trial082.stdout:2857: expect (ObjNum 916 snap 288 seq_num 916) 2026-02-12T17:40:45.722 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 950947 2026-02-12T17:40:45.767 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2923413 2026-02-12T17:40:45.798 INFO:tasks.rados.rados.0.trial082.stdout:2856: finishing copy_from racing read to trial08226312-2 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:2856: finishing copy_from to trial08226312-2 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 2209 (ObjNum 955 snap 297 seq_num 955) dirty exists 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:2859: finishing rollback tid 0 to trial08226312-17 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:2859: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2267 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:2854: done (3 left) 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:2856: done (2 left) 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:2857: done (1 left) 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:2859: done (0 left) 2026-02-12T17:40:45.799 INFO:tasks.rados.rados.0.trial082.stdout:2860: read oid 7 snap 298 2026-02-12T17:40:45.800 INFO:tasks.rados.rados.0.trial082.stdout:2860: expect (ObjNum 954 snap 297 seq_num 954) 2026-02-12T17:40:45.800 INFO:tasks.rados.rados.0.trial082.stdout:2861: write (excl) oid 26 current snap is 301 2026-02-12T17:40:45.800 INFO:tasks.rados.rados.0.trial082.stdout:2861: seq_num 967 ranges {652369=742614,2153264=99105} 2026-02-12T17:40:45.803 INFO:tasks.rados.rados.0.trial082.stdout:2861: writing trial08226312-26 from 652369 to 1394983 tid 1 2026-02-12T17:40:45.806 INFO:tasks.rados.rados.0.trial082.stdout:2861: writing trial08226312-26 from 2153264 to 2252369 tid 2 2026-02-12T17:40:45.806 INFO:tasks.rados.rados.0.trial082.stdout:2862: write (excl) oid 3 current snap is 301 2026-02-12T17:40:45.807 INFO:tasks.rados.rados.0.trial082.stdout:2862: seq_num 968 ranges {669176=417863,1811746=457430} 2026-02-12T17:40:45.810 INFO:tasks.rados.rados.0.trial082.stdout:2862: writing trial08226312-3 from 669176 to 1087039 tid 1 2026-02-12T17:40:45.815 INFO:tasks.rados.rados.0.trial082.stdout:2862: writing trial08226312-3 from 1811746 to 2269176 tid 2 2026-02-12T17:40:45.815 INFO:tasks.rados.rados.0.trial082.stdout:2863: read oid 30 snap 294 2026-02-12T17:40:45.815 INFO:tasks.rados.rados.0.trial082.stdout:2863: expect (ObjNum 948 snap 294 seq_num 948) 2026-02-12T17:40:45.815 INFO:tasks.rados.rados.0.trial082.stdout:2864: write (excl) oid 49 current snap is 301 2026-02-12T17:40:45.815 INFO:tasks.rados.rados.0.trial082.stdout:2864: seq_num 969 ranges {685983=493112,1870228=415755} 2026-02-12T17:40:45.819 INFO:tasks.rados.rados.0.trial082.stdout:2864: writing trial08226312-49 from 685983 to 1179095 tid 1 2026-02-12T17:40:45.823 INFO:tasks.rados.rados.0.trial082.stdout:2864: writing trial08226312-49 from 1870228 to 2285983 tid 2 2026-02-12T17:40:45.823 INFO:tasks.rados.rados.0.trial082.stdout:2865: write oid 37 current snap is 301 2026-02-12T17:40:45.823 INFO:tasks.rados.rados.0.trial082.stdout:2865: seq_num 970 ranges {702790=568361,1812357=490433} 2026-02-12T17:40:45.828 INFO:tasks.rados.rados.0.trial082.stdout:2865: writing trial08226312-37 from 702790 to 1271151 tid 1 2026-02-12T17:40:45.832 INFO:tasks.rados.rados.0.trial082.stdout:2865: writing trial08226312-37 from 1812357 to 2302790 tid 2 2026-02-12T17:40:45.832 INFO:tasks.rados.rados.0.trial082.stdout:2866: read oid 34 snap -1 2026-02-12T17:40:45.832 INFO:tasks.rados.rados.0.trial082.stdout:2866: expect (ObjNum 945 snap 294 seq_num 945) 2026-02-12T17:40:45.832 INFO:tasks.rados.rados.0.trial082.stdout:2867: delete oid 45 current snap is 301 2026-02-12T17:40:45.832 INFO:tasks.rados.rados.0.trial082.stdout:2860: expect (ObjNum 954 snap 297 seq_num 954) 2026-02-12T17:40:45.834 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 708289 2026-02-12T17:40:45.884 INFO:tasks.rados.rados.0.trial082.stdout:2861: finishing write tid 1 to trial08226312-26 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2861: finishing write tid 2 to trial08226312-26 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2861: finishing write tid 3 to trial08226312-26 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2860: done (7 left) 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2867: done (6 left) 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2868: copy_from oid 42 from oid 13 current snap is 301 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2861: finishing write tid 4 to trial08226312-26 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2861: oid 26 updating version 0 to 1892 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2861: oid 26 updating version 1892 to 1893 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2861: oid 26 updating version 1893 to 1894 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1894 (ObjNum 967 snap 301 seq_num 967) dirty exists 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2861: left oid 26 (ObjNum 967 snap 301 seq_num 967) 2026-02-12T17:40:45.885 INFO:tasks.rados.rados.0.trial082.stdout:2862: finishing write tid 1 to trial08226312-3 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:2862: finishing write tid 2 to trial08226312-3 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:2862: finishing write tid 3 to trial08226312-3 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:2862: finishing write tid 4 to trial08226312-3 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:2862: oid 3 updating version 0 to 1245 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:2862: oid 3 version 1245 is already newer than 1244 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:2862: oid 3 version 1245 is already newer than 1243 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1245 (ObjNum 968 snap 301 seq_num 968) dirty exists 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:2862: left oid 3 (ObjNum 968 snap 301 seq_num 968) 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:2863: expect (ObjNum 948 snap 294 seq_num 948) 2026-02-12T17:40:45.886 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:45.999 INFO:tasks.rados.rados.0.trial082.stdout:2864: finishing write tid 1 to trial08226312-49 2026-02-12T17:40:45.999 INFO:tasks.rados.rados.0.trial082.stdout:2861: done (6 left) 2026-02-12T17:40:45.999 INFO:tasks.rados.rados.0.trial082.stdout:2862: done (5 left) 2026-02-12T17:40:45.999 INFO:tasks.rados.rados.0.trial082.stdout:2863: done (4 left) 2026-02-12T17:40:45.999 INFO:tasks.rados.rados.0.trial082.stdout:2869: rollback oid 28 current snap is 301 2026-02-12T17:40:45.999 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 292 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2864: finishing write tid 2 to trial08226312-49 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2864: finishing write tid 3 to trial08226312-49 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2864: finishing write tid 4 to trial08226312-49 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2864: oid 49 updating version 0 to 1566 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2864: oid 49 version 1566 is already newer than 1565 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2864: oid 49 updating version 1566 to 1567 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 1567 (ObjNum 969 snap 301 seq_num 969) dirty exists 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2864: left oid 49 (ObjNum 969 snap 301 seq_num 969) 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2865: finishing write tid 1 to trial08226312-37 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2865: finishing write tid 2 to trial08226312-37 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2865: finishing write tid 3 to trial08226312-37 2026-02-12T17:40:46.000 INFO:tasks.rados.rados.0.trial082.stdout:2865: finishing write tid 4 to trial08226312-37 2026-02-12T17:40:46.001 INFO:tasks.rados.rados.0.trial082.stdout:2865: oid 37 updating version 0 to 1948 2026-02-12T17:40:46.001 INFO:tasks.rados.rados.0.trial082.stdout:2865: oid 37 updating version 1948 to 1949 2026-02-12T17:40:46.001 INFO:tasks.rados.rados.0.trial082.stdout:2865: oid 37 updating version 1949 to 1950 2026-02-12T17:40:46.001 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1950 (ObjNum 970 snap 301 seq_num 970) dirty exists 2026-02-12T17:40:46.001 INFO:tasks.rados.rados.0.trial082.stdout:2865: left oid 37 (ObjNum 970 snap 301 seq_num 970) 2026-02-12T17:40:46.001 INFO:tasks.rados.rados.0.trial082.stdout:2866: expect (ObjNum 945 snap 294 seq_num 945) 2026-02-12T17:40:46.004 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 920542 2026-02-12T17:40:46.044 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 118128 2026-02-12T17:40:46.116 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2656973 2026-02-12T17:40:46.135 INFO:tasks.rados.rados.0.trial082.stdout:2868: finishing copy_from racing read to trial08226312-42 2026-02-12T17:40:46.135 INFO:tasks.rados.rados.0.trial082.stdout:2868: finishing copy_from to trial08226312-42 2026-02-12T17:40:46.135 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 1889 (ObjNum 816 snap 253 seq_num 816) dirty exists 2026-02-12T17:40:46.135 INFO:tasks.rados.rados.0.trial082.stdout:2869: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:40:46.135 INFO:tasks.rados.rados.0.trial082.stdout:2869: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:40:46.136 INFO:tasks.rados.rados.0.trial082.stdout:2864: done (4 left) 2026-02-12T17:40:46.136 INFO:tasks.rados.rados.0.trial082.stdout:2865: done (3 left) 2026-02-12T17:40:46.136 INFO:tasks.rados.rados.0.trial082.stdout:2866: done (2 left) 2026-02-12T17:40:46.136 INFO:tasks.rados.rados.0.trial082.stdout:2868: done (1 left) 2026-02-12T17:40:46.136 INFO:tasks.rados.rados.0.trial082.stdout:2870: delete oid 14 current snap is 301 2026-02-12T17:40:46.136 INFO:tasks.rados.rados.0.trial082.stdout:2869: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:40:46.136 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1892 (ObjNum 907 snap 287 seq_num 907) dirty exists 2026-02-12T17:40:46.136 INFO:tasks.rados.rados.0.trial082.stdout:2869: done (1 left) 2026-02-12T17:40:46.136 INFO:tasks.rados.rados.0.trial082.stdout:2870: done (0 left) 2026-02-12T17:40:46.137 INFO:tasks.rados.rados.0.trial082.stdout:2871: delete oid 34 current snap is 301 2026-02-12T17:40:46.138 INFO:tasks.rados.rados.0.trial082.stdout:2871: done (0 left) 2026-02-12T17:40:46.138 INFO:tasks.rados.rados.0.trial082.stdout:2872: snap_create 2026-02-12T17:40:46.381 INFO:tasks.rados.rados.0.trial082.stdout:2872: done (0 left) 2026-02-12T17:40:46.381 INFO:tasks.rados.rados.0.trial082.stdout:2873: snap_create 2026-02-12T17:40:47.379 INFO:tasks.rados.rados.0.trial082.stdout:2873: done (0 left) 2026-02-12T17:40:47.380 INFO:tasks.rados.rados.0.trial082.stdout:2874: delete oid 1 current snap is 303 2026-02-12T17:40:47.384 INFO:tasks.rados.rados.0.trial082.stdout:2874: done (0 left) 2026-02-12T17:40:47.384 INFO:tasks.rados.rados.0.trial082.stdout:2875: delete oid 3 current snap is 303 2026-02-12T17:40:47.386 INFO:tasks.rados.rados.0.trial082.stdout:2875: done (0 left) 2026-02-12T17:40:47.386 INFO:tasks.rados.rados.0.trial082.stdout:2876: snap_remove snap 294 2026-02-12T17:40:48.383 INFO:tasks.rados.rados.0.trial082.stdout:2876: done (0 left) 2026-02-12T17:40:48.383 INFO:tasks.rados.rados.0.trial082.stdout:2877: read oid 35 snap 283 2026-02-12T17:40:48.383 INFO:tasks.rados.rados.0.trial082.stdout:2877: expect (ObjNum 875 snap 277 seq_num 875) 2026-02-12T17:40:48.383 INFO:tasks.rados.rados.0.trial082.stdout:2878: write oid 30 current snap is 303 2026-02-12T17:40:48.383 INFO:tasks.rados.rados.0.trial082.stdout:2878: seq_num 976 ranges {403632=736208,1763249=619999} 2026-02-12T17:40:48.388 INFO:tasks.rados.rados.0.trial082.stdout:2878: writing trial08226312-30 from 403632 to 1139840 tid 1 2026-02-12T17:40:48.392 INFO:tasks.rados.rados.0.trial082.stdout:2878: writing trial08226312-30 from 1763249 to 2383248 tid 2 2026-02-12T17:40:48.392 INFO:tasks.rados.rados.0.trial082.stdout:2879: write oid 13 current snap is 303 2026-02-12T17:40:48.392 INFO:tasks.rados.rados.0.trial082.stdout:2879: seq_num 977 ranges {420439=411457,1421731=480010} 2026-02-12T17:40:48.395 INFO:tasks.rados.rados.0.trial082.stdout:2879: writing trial08226312-13 from 420439 to 831896 tid 1 2026-02-12T17:40:48.399 INFO:tasks.rados.rados.0.trial082.stdout:2879: writing trial08226312-13 from 1421731 to 1901741 tid 2 2026-02-12T17:40:48.399 INFO:tasks.rados.rados.0.trial082.stdout:2880: rollback oid 12 current snap is 303 2026-02-12T17:40:48.399 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 283 2026-02-12T17:40:48.399 INFO:tasks.rados.rados.0.trial082.stdout:2877: expect (ObjNum 875 snap 277 seq_num 875) 2026-02-12T17:40:48.418 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2218766 2026-02-12T17:40:48.454 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:48.488 INFO:tasks.rados.rados.0.trial082.stdout:2879: finishing write tid 1 to trial08226312-13 2026-02-12T17:40:48.489 INFO:tasks.rados.rados.0.trial082.stdout:2877: done (3 left) 2026-02-12T17:40:48.489 INFO:tasks.rados.rados.0.trial082.stdout:2881: snap_remove snap 300 2026-02-12T17:40:49.388 INFO:tasks.rados.rados.0.trial082.stdout:2881: done (3 left) 2026-02-12T17:40:49.388 INFO:tasks.rados.rados.0.trial082.stdout:2882: write (excl) oid 40 current snap is 303 2026-02-12T17:40:49.388 INFO:tasks.rados.rados.0.trial082.stdout:2878: finishing write tid 1 to trial08226312-30 2026-02-12T17:40:49.388 INFO:tasks.rados.rados.0.trial082.stdout:2879: finishing write tid 2 to trial08226312-13 2026-02-12T17:40:49.388 INFO:tasks.rados.rados.0.trial082.stdout:2879: finishing write tid 3 to trial08226312-13 2026-02-12T17:40:49.388 INFO:tasks.rados.rados.0.trial082.stdout:2879: finishing write tid 4 to trial08226312-13 2026-02-12T17:40:49.389 INFO:tasks.rados.rados.0.trial082.stdout:2879: oid 13 updating version 0 to 2205 2026-02-12T17:40:49.389 INFO:tasks.rados.rados.0.trial082.stdout:2879: oid 13 updating version 2205 to 2206 2026-02-12T17:40:49.389 INFO:tasks.rados.rados.0.trial082.stdout:2879: oid 13 version 2206 is already newer than 2204 2026-02-12T17:40:49.389 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2206 (ObjNum 977 snap 303 seq_num 977) dirty exists 2026-02-12T17:40:49.389 INFO:tasks.rados.rados.0.trial082.stdout:2879: left oid 13 (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:40:49.389 INFO:tasks.rados.rados.0.trial082.stdout:2880: finishing rollback tid 0 to trial08226312-12 2026-02-12T17:40:49.389 INFO:tasks.rados.rados.0.trial082.stdout:2882: seq_num 978 ranges {437246=486706,1363860=623668} 2026-02-12T17:40:49.391 INFO:tasks.rados.rados.0.trial082.stdout:2882: writing trial08226312-40 from 437246 to 923952 tid 1 2026-02-12T17:40:49.395 INFO:tasks.rados.rados.0.trial082.stdout:2882: writing trial08226312-40 from 1363860 to 1987528 tid 2 2026-02-12T17:40:49.395 INFO:tasks.rados.rados.0.trial082.stdout:2879: done (3 left) 2026-02-12T17:40:49.395 INFO:tasks.rados.rados.0.trial082.stdout:2883: snap_remove snap 296 2026-02-12T17:40:50.399 INFO:tasks.rados.rados.0.trial082.stdout:2883: done (3 left) 2026-02-12T17:40:50.399 INFO:tasks.rados.rados.0.trial082.stdout:2884: snap_remove snap 298 2026-02-12T17:40:51.400 INFO:tasks.rados.rados.0.trial082.stdout:2884: done (3 left) 2026-02-12T17:40:51.400 INFO:tasks.rados.rados.0.trial082.stdout:2885: delete oid 41 current snap is 303 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2878: finishing write tid 2 to trial08226312-30 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2878: finishing write tid 3 to trial08226312-30 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2878: finishing write tid 4 to trial08226312-30 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2878: oid 30 updating version 0 to 2213 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2878: oid 30 updating version 2213 to 2214 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2878: oid 30 updating version 2214 to 2215 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2215 (ObjNum 976 snap 303 seq_num 976) dirty exists 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2878: left oid 30 (ObjNum 976 snap 303 seq_num 976) 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2880: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2880: finishing rollback tid 2 to trial08226312-12 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1953 (ObjNum 758 snap 231 seq_num 758) dirty exists 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2882: finishing write tid 1 to trial08226312-40 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2882: finishing write tid 2 to trial08226312-40 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2882: finishing write tid 3 to trial08226312-40 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2882: finishing write tid 4 to trial08226312-40 2026-02-12T17:40:51.401 INFO:tasks.rados.rados.0.trial082.stdout:2882: oid 40 updating version 0 to 1893 2026-02-12T17:40:51.402 INFO:tasks.rados.rados.0.trial082.stdout:2882: oid 40 updating version 1893 to 1895 2026-02-12T17:40:51.402 INFO:tasks.rados.rados.0.trial082.stdout:2882: oid 40 version 1895 is already newer than 1894 2026-02-12T17:40:51.402 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1895 (ObjNum 978 snap 303 seq_num 978) dirty exists 2026-02-12T17:40:51.402 INFO:tasks.rados.rados.0.trial082.stdout:2882: left oid 40 (ObjNum 978 snap 303 seq_num 978) 2026-02-12T17:40:51.405 INFO:tasks.rados.rados.0.trial082.stdout:2878: done (3 left) 2026-02-12T17:40:51.405 INFO:tasks.rados.rados.0.trial082.stdout:2880: done (2 left) 2026-02-12T17:40:51.405 INFO:tasks.rados.rados.0.trial082.stdout:2882: done (1 left) 2026-02-12T17:40:51.405 INFO:tasks.rados.rados.0.trial082.stdout:2885: done (0 left) 2026-02-12T17:40:51.405 INFO:tasks.rados.rados.0.trial082.stdout:2886: read oid 36 snap -1 2026-02-12T17:40:51.405 INFO:tasks.rados.rados.0.trial082.stdout:2886: expect (ObjNum 908 snap 287 seq_num 908) 2026-02-12T17:40:51.405 INFO:tasks.rados.rados.0.trial082.stdout:2887: write oid 42 current snap is 303 2026-02-12T17:40:51.405 INFO:tasks.rados.rados.0.trial082.stdout:2887: seq_num 980 ranges {470860=637204,1880824=590036} 2026-02-12T17:40:51.409 INFO:tasks.rados.rados.0.trial082.stdout:2887: writing trial08226312-42 from 470860 to 1108064 tid 1 2026-02-12T17:40:51.414 INFO:tasks.rados.rados.0.trial082.stdout:2887: writing trial08226312-42 from 1880824 to 2470860 tid 2 2026-02-12T17:40:51.414 INFO:tasks.rados.rados.0.trial082.stdout:2888: rollback oid 48 current snap is 303 2026-02-12T17:40:51.414 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 299 2026-02-12T17:40:51.414 INFO:tasks.rados.rados.0.trial082.stdout:2886: expect (ObjNum 908 snap 287 seq_num 908) 2026-02-12T17:40:51.427 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2359179 2026-02-12T17:40:51.441 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2887: finishing write tid 1 to trial08226312-42 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2888: finishing rollback tid 0 to trial08226312-48 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2888: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2887: finishing write tid 2 to trial08226312-42 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2888: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1606 (ObjNum 943 snap 294 seq_num 943) dirty exists 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2887: finishing write tid 3 to trial08226312-42 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2887: finishing write tid 4 to trial08226312-42 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2887: oid 42 updating version 0 to 1896 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2887: oid 42 updating version 1896 to 1897 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2887: oid 42 updating version 1897 to 1898 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 1898 (ObjNum 980 snap 303 seq_num 980) dirty exists 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2887: left oid 42 (ObjNum 980 snap 303 seq_num 980) 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2886: done (2 left) 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2887: done (1 left) 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2888: done (0 left) 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2889: read oid 3 snap -1 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2889: expect deleted 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2890: read oid 32 snap -1 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2890: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:40:51.507 INFO:tasks.rados.rados.0.trial082.stdout:2891: delete oid 38 current snap is 303 2026-02-12T17:40:51.510 INFO:tasks.rados.rados.0.trial082.stdout:2890: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:40:51.550 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:51.628 INFO:tasks.rados.rados.0.trial082.stdout:2889: done (2 left) 2026-02-12T17:40:51.628 INFO:tasks.rados.rados.0.trial082.stdout:2890: done (1 left) 2026-02-12T17:40:51.628 INFO:tasks.rados.rados.0.trial082.stdout:2891: done (0 left) 2026-02-12T17:40:51.629 INFO:tasks.rados.rados.0.trial082.stdout:2892: read oid 11 snap -1 2026-02-12T17:40:51.629 INFO:tasks.rados.rados.0.trial082.stdout:2892: expect (ObjNum 944 snap 294 seq_num 944) 2026-02-12T17:40:51.629 INFO:tasks.rados.rados.0.trial082.stdout:2893: snap_remove snap 299 2026-02-12T17:40:52.820 INFO:tasks.rados.rados.0.trial082.stdout:2893: done (1 left) 2026-02-12T17:40:52.820 INFO:tasks.rados.rados.0.trial082.stdout:2894: write (excl) oid 36 current snap is 303 2026-02-12T17:40:52.820 INFO:tasks.rados.rados.0.trial082.stdout:2894: seq_num 982 ranges {504474=504055,1714141=631006} 2026-02-12T17:40:52.824 INFO:tasks.rados.rados.0.trial082.stdout:2894: writing trial08226312-36 from 504474 to 1008529 tid 1 2026-02-12T17:40:52.830 INFO:tasks.rados.rados.0.trial082.stdout:2894: writing trial08226312-36 from 1714141 to 2345147 tid 2 2026-02-12T17:40:52.831 INFO:tasks.rados.rados.0.trial082.stdout:2895: write oid 43 current snap is 303 2026-02-12T17:40:52.831 INFO:tasks.rados.rados.0.trial082.stdout:2892: expect (ObjNum 944 snap 294 seq_num 944) 2026-02-12T17:40:52.855 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2884967 2026-02-12T17:40:52.953 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3133701 2026-02-12T17:40:52.960 INFO:tasks.rados.rados.0.trial082.stdout:2894: finishing write tid 1 to trial08226312-36 2026-02-12T17:40:52.960 INFO:tasks.rados.rados.0.trial082.stdout:2894: finishing write tid 2 to trial08226312-36 2026-02-12T17:40:52.960 INFO:tasks.rados.rados.0.trial082.stdout:2894: finishing write tid 3 to trial08226312-36 2026-02-12T17:40:52.960 INFO:tasks.rados.rados.0.trial082.stdout:2894: finishing write tid 4 to trial08226312-36 2026-02-12T17:40:52.961 INFO:tasks.rados.rados.0.trial082.stdout:2894: oid 36 updating version 0 to 1898 2026-02-12T17:40:52.961 INFO:tasks.rados.rados.0.trial082.stdout:2894: oid 36 version 1898 is already newer than 1897 2026-02-12T17:40:52.961 INFO:tasks.rados.rados.0.trial082.stdout:2894: oid 36 version 1898 is already newer than 1896 2026-02-12T17:40:52.961 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 1898 (ObjNum 982 snap 303 seq_num 982) dirty exists 2026-02-12T17:40:52.961 INFO:tasks.rados.rados.0.trial082.stdout:2894: left oid 36 (ObjNum 982 snap 303 seq_num 982) 2026-02-12T17:40:52.961 INFO:tasks.rados.rados.0.trial082.stdout:2895: seq_num 983 ranges {521281=579304,1656270=774664} 2026-02-12T17:40:52.964 INFO:tasks.rados.rados.0.trial082.stdout:2895: writing trial08226312-43 from 521281 to 1100585 tid 1 2026-02-12T17:40:52.970 INFO:tasks.rados.rados.0.trial082.stdout:2895: writing trial08226312-43 from 1656270 to 2430934 tid 2 2026-02-12T17:40:52.970 INFO:tasks.rados.rados.0.trial082.stdout:2892: done (2 left) 2026-02-12T17:40:52.970 INFO:tasks.rados.rados.0.trial082.stdout:2894: done (1 left) 2026-02-12T17:40:52.970 INFO:tasks.rados.rados.0.trial082.stdout:2896: read oid 32 snap -1 2026-02-12T17:40:52.970 INFO:tasks.rados.rados.0.trial082.stdout:2896: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:40:52.970 INFO:tasks.rados.rados.0.trial082.stdout:2897: read oid 8 snap -1 2026-02-12T17:40:52.970 INFO:tasks.rados.rados.0.trial082.stdout:2897: expect (ObjNum 930 snap 291 seq_num 930) 2026-02-12T17:40:52.970 INFO:tasks.rados.rados.0.trial082.stdout:2898: copy_from oid 28 from oid 20 current snap is 303 2026-02-12T17:40:52.971 INFO:tasks.rados.rados.0.trial082.stdout:2895: finishing write tid 1 to trial08226312-43 2026-02-12T17:40:52.971 INFO:tasks.rados.rados.0.trial082.stdout:2899: snap_create 2026-02-12T17:40:52.972 INFO:tasks.rados.rados.0.trial082.stdout:2896: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:40:53.027 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1903266 2026-02-12T17:40:53.044 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:53.086 INFO:tasks.rados.rados.0.trial082.stdout:2897: expect (ObjNum 930 snap 291 seq_num 930) 2026-02-12T17:40:53.194 INFO:tasks.rados.rados.0.trial082.stdout:2895: finishing write tid 2 to trial08226312-43 2026-02-12T17:40:53.194 INFO:tasks.rados.rados.0.trial082.stdout:2895: finishing write tid 3 to trial08226312-43 2026-02-12T17:40:53.194 INFO:tasks.rados.rados.0.trial082.stdout:2895: finishing write tid 4 to trial08226312-43 2026-02-12T17:40:53.194 INFO:tasks.rados.rados.0.trial082.stdout:2895: oid 43 updating version 0 to 2216 2026-02-12T17:40:53.194 INFO:tasks.rados.rados.0.trial082.stdout:2895: oid 43 updating version 2216 to 2218 2026-02-12T17:40:53.194 INFO:tasks.rados.rados.0.trial082.stdout:2895: oid 43 version 2218 is already newer than 2217 2026-02-12T17:40:53.194 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2218 (ObjNum 983 snap 303 seq_num 983) dirty exists 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:2895: left oid 43 (ObjNum 983 snap 303 seq_num 983) 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:2898: finishing copy_from racing read to trial08226312-28 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:2898: finishing copy_from to trial08226312-28 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1879 (ObjNum 942 snap 294 seq_num 942) dirty exists 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:2895: done (4 left) 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:2896: done (3 left) 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:2897: done (2 left) 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:2898: done (1 left) 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:2899: done (0 left) 2026-02-12T17:40:53.195 INFO:tasks.rados.rados.0.trial082.stdout:2900: rollback oid 3 current snap is 304 2026-02-12T17:40:53.196 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 283 2026-02-12T17:40:53.196 INFO:tasks.rados.rados.0.trial082.stdout:2901: delete oid 26 current snap is 304 2026-02-12T17:40:53.196 INFO:tasks.rados.rados.0.trial082.stdout:2901: done (1 left) 2026-02-12T17:40:53.196 INFO:tasks.rados.rados.0.trial082.stdout:2902: write oid 5 current snap is 304 2026-02-12T17:40:53.197 INFO:tasks.rados.rados.0.trial082.stdout:2902: seq_num 985 ranges {554895=729802,1773234=778333} 2026-02-12T17:40:53.200 INFO:tasks.rados.rados.0.trial082.stdout:2902: writing trial08226312-5 from 554895 to 1284697 tid 1 2026-02-12T17:40:53.205 INFO:tasks.rados.rados.0.trial082.stdout:2902: writing trial08226312-5 from 1773234 to 2551567 tid 2 2026-02-12T17:40:53.205 INFO:tasks.rados.rados.0.trial082.stdout:2903: read oid 31 snap -1 2026-02-12T17:40:53.205 INFO:tasks.rados.rados.0.trial082.stdout:2903: expect deleted 2026-02-12T17:40:53.205 INFO:tasks.rados.rados.0.trial082.stdout:2904: write (excl) oid 45 current snap is 304 2026-02-12T17:40:53.205 INFO:tasks.rados.rados.0.trial082.stdout:2904: seq_num 986 ranges {571702=405051,1431716=638344,2560365=11337} 2026-02-12T17:40:53.208 INFO:tasks.rados.rados.0.trial082.stdout:2904: writing trial08226312-45 from 571702 to 976753 tid 1 2026-02-12T17:40:53.212 INFO:tasks.rados.rados.0.trial082.stdout:2904: writing trial08226312-45 from 1431716 to 2070060 tid 2 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:2904: writing trial08226312-45 from 2560365 to 2571702 tid 3 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:2905: read oid 11 snap 283 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:2905: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:2906: rollback oid 41 current snap is 304 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 302 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:2900: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:2907: write oid 21 current snap is 304 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:2900: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1260 (ObjNum 806 snap 251 seq_num 806) dirty exists 2026-02-12T17:40:53.215 INFO:tasks.rados.rados.0.trial082.stdout:2902: finishing write tid 1 to trial08226312-5 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2902: finishing write tid 2 to trial08226312-5 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2902: finishing write tid 3 to trial08226312-5 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2902: finishing write tid 4 to trial08226312-5 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2902: oid 5 updating version 0 to 1263 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2902: oid 5 updating version 1263 to 1264 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2902: oid 5 version 1264 is already newer than 1262 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 1264 (ObjNum 985 snap 304 seq_num 985) dirty exists 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2902: left oid 5 (ObjNum 985 snap 304 seq_num 985) 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2904: finishing write tid 1 to trial08226312-45 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2904: finishing write tid 2 to trial08226312-45 2026-02-12T17:40:53.216 INFO:tasks.rados.rados.0.trial082.stdout:2907: seq_num 987 ranges {588509=480300,1773845=782002} 2026-02-12T17:40:53.218 INFO:tasks.rados.rados.0.trial082.stdout:2907: writing trial08226312-21 from 588509 to 1068809 tid 1 2026-02-12T17:40:53.224 INFO:tasks.rados.rados.0.trial082.stdout:2907: writing trial08226312-21 from 1773845 to 2555847 tid 2 2026-02-12T17:40:53.224 INFO:tasks.rados.rados.0.trial082.stdout:2900: done (6 left) 2026-02-12T17:40:53.224 INFO:tasks.rados.rados.0.trial082.stdout:2902: done (5 left) 2026-02-12T17:40:53.224 INFO:tasks.rados.rados.0.trial082.stdout:2903: done (4 left) 2026-02-12T17:40:53.225 INFO:tasks.rados.rados.0.trial082.stdout:2908: write oid 18 current snap is 304 2026-02-12T17:40:53.225 INFO:tasks.rados.rados.0.trial082.stdout:2908: seq_num 988 ranges {605316=555549,1832327=642013} 2026-02-12T17:40:53.228 INFO:tasks.rados.rados.0.trial082.stdout:2908: writing trial08226312-18 from 605316 to 1160865 tid 1 2026-02-12T17:40:53.233 INFO:tasks.rados.rados.0.trial082.stdout:2908: writing trial08226312-18 from 1832327 to 2474340 tid 2 2026-02-12T17:40:53.234 INFO:tasks.rados.rados.0.trial082.stdout:2909: snap_create 2026-02-12T17:40:53.234 INFO:tasks.rados.rados.0.trial082.stdout:2904: finishing write tid 3 to trial08226312-45 2026-02-12T17:40:53.234 INFO:tasks.rados.rados.0.trial082.stdout:2904: finishing write tid 4 to trial08226312-45 2026-02-12T17:40:53.234 INFO:tasks.rados.rados.0.trial082.stdout:2904: finishing write tid 5 to trial08226312-45 2026-02-12T17:40:53.234 INFO:tasks.rados.rados.0.trial082.stdout:2904: oid 45 updating version 0 to 1901 2026-02-12T17:40:53.234 INFO:tasks.rados.rados.0.trial082.stdout:2904: oid 45 version 1901 is already newer than 1900 2026-02-12T17:40:53.234 INFO:tasks.rados.rados.0.trial082.stdout:2904: oid 45 updating version 1901 to 1902 2026-02-12T17:40:53.234 INFO:tasks.rados.rados.0.trial082.stdout:2904: oid 45 updating version 1902 to 1903 2026-02-12T17:40:53.235 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1903 (ObjNum 986 snap 304 seq_num 986) dirty exists 2026-02-12T17:40:53.235 INFO:tasks.rados.rados.0.trial082.stdout:2904: left oid 45 (ObjNum 986 snap 304 seq_num 986) 2026-02-12T17:40:53.235 INFO:tasks.rados.rados.0.trial082.stdout:2906: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:40:53.235 INFO:tasks.rados.rados.0.trial082.stdout:2906: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:40:53.235 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1956 (ObjNum 952 snap 296 seq_num 952) dirty exists 2026-02-12T17:40:53.235 INFO:tasks.rados.rados.0.trial082.stdout:2905: expect (ObjNum 692 snap 208 seq_num 692) 2026-02-12T17:40:53.247 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:40:53.297 INFO:tasks.rados.rados.0.trial082.stdout:2907: finishing write tid 1 to trial08226312-21 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:2907: finishing write tid 2 to trial08226312-21 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:2907: finishing write tid 3 to trial08226312-21 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:2907: finishing write tid 4 to trial08226312-21 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:2907: oid 21 updating version 0 to 2221 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:2907: oid 21 version 2221 is already newer than 2220 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:2907: oid 21 version 2221 is already newer than 2219 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 2221 (ObjNum 987 snap 304 seq_num 987) dirty exists 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:2907: left oid 21 (ObjNum 987 snap 304 seq_num 987) 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:2908: finishing write tid 1 to trial08226312-18 2026-02-12T17:40:53.298 INFO:tasks.rados.rados.0.trial082.stdout:2908: finishing write tid 2 to trial08226312-18 2026-02-12T17:40:53.299 INFO:tasks.rados.rados.0.trial082.stdout:2908: finishing write tid 3 to trial08226312-18 2026-02-12T17:40:53.299 INFO:tasks.rados.rados.0.trial082.stdout:2908: finishing write tid 4 to trial08226312-18 2026-02-12T17:40:53.299 INFO:tasks.rados.rados.0.trial082.stdout:2908: oid 18 updating version 0 to 1569 2026-02-12T17:40:53.299 INFO:tasks.rados.rados.0.trial082.stdout:2908: oid 18 updating version 1569 to 1570 2026-02-12T17:40:53.299 INFO:tasks.rados.rados.0.trial082.stdout:2908: oid 18 updating version 1570 to 1571 2026-02-12T17:40:53.299 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 1571 (ObjNum 988 snap 304 seq_num 988) dirty exists 2026-02-12T17:40:53.299 INFO:tasks.rados.rados.0.trial082.stdout:2908: left oid 18 (ObjNum 988 snap 304 seq_num 988) 2026-02-12T17:40:54.099 INFO:tasks.rados.rados.0.trial082.stdout:2904: done (5 left) 2026-02-12T17:40:54.099 INFO:tasks.rados.rados.0.trial082.stdout:2905: done (4 left) 2026-02-12T17:40:54.099 INFO:tasks.rados.rados.0.trial082.stdout:2906: done (3 left) 2026-02-12T17:40:54.099 INFO:tasks.rados.rados.0.trial082.stdout:2907: done (2 left) 2026-02-12T17:40:54.100 INFO:tasks.rados.rados.0.trial082.stdout:2908: done (1 left) 2026-02-12T17:40:54.100 INFO:tasks.rados.rados.0.trial082.stdout:2909: done (0 left) 2026-02-12T17:40:54.100 INFO:tasks.rados.rados.0.trial082.stdout:2910: write oid 41 current snap is 305 2026-02-12T17:40:54.100 INFO:tasks.rados.rados.0.trial082.stdout:2910: seq_num 989 ranges {622123=747151,2007162=614961} 2026-02-12T17:40:54.104 INFO:tasks.rados.rados.0.trial082.stdout:2910: writing trial08226312-41 from 622123 to 1369274 tid 1 2026-02-12T17:40:54.109 INFO:tasks.rados.rados.0.trial082.stdout:2910: writing trial08226312-41 from 2007162 to 2622123 tid 2 2026-02-12T17:40:54.109 INFO:tasks.rados.rados.0.trial082.stdout:2911: snap_create 2026-02-12T17:40:54.109 INFO:tasks.rados.rados.0.trial082.stdout:2910: finishing write tid 1 to trial08226312-41 2026-02-12T17:40:54.111 INFO:tasks.rados.rados.0.trial082.stdout:2910: finishing write tid 2 to trial08226312-41 2026-02-12T17:40:54.111 INFO:tasks.rados.rados.0.trial082.stdout:2910: finishing write tid 3 to trial08226312-41 2026-02-12T17:40:54.111 INFO:tasks.rados.rados.0.trial082.stdout:2910: finishing write tid 4 to trial08226312-41 2026-02-12T17:40:54.111 INFO:tasks.rados.rados.0.trial082.stdout:2910: oid 41 updating version 0 to 1959 2026-02-12T17:40:54.111 INFO:tasks.rados.rados.0.trial082.stdout:2910: oid 41 version 1959 is already newer than 1958 2026-02-12T17:40:54.111 INFO:tasks.rados.rados.0.trial082.stdout:2910: oid 41 version 1959 is already newer than 1957 2026-02-12T17:40:54.111 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1959 (ObjNum 989 snap 305 seq_num 989) dirty exists 2026-02-12T17:40:54.112 INFO:tasks.rados.rados.0.trial082.stdout:2910: left oid 41 (ObjNum 989 snap 305 seq_num 989) 2026-02-12T17:40:55.100 INFO:tasks.rados.rados.0.trial082.stdout:2910: done (1 left) 2026-02-12T17:40:55.100 INFO:tasks.rados.rados.0.trial082.stdout:2911: done (0 left) 2026-02-12T17:40:55.100 INFO:tasks.rados.rados.0.trial082.stdout:2912: write oid 41 current snap is 306 2026-02-12T17:40:55.100 INFO:tasks.rados.rados.0.trial082.stdout:2912: seq_num 990 ranges {638930=422400,1665644=645682} 2026-02-12T17:40:55.103 INFO:tasks.rados.rados.0.trial082.stdout:2912: writing trial08226312-41 from 638930 to 1061330 tid 1 2026-02-12T17:40:55.108 INFO:tasks.rados.rados.0.trial082.stdout:2912: writing trial08226312-41 from 1665644 to 2311326 tid 2 2026-02-12T17:40:55.108 INFO:tasks.rados.rados.0.trial082.stdout:2913: delete oid 4 current snap is 306 2026-02-12T17:40:55.108 INFO:tasks.rados.rados.0.trial082.stdout:2912: finishing write tid 1 to trial08226312-41 2026-02-12T17:40:55.110 INFO:tasks.rados.rados.0.trial082.stdout:2912: finishing write tid 2 to trial08226312-41 2026-02-12T17:40:55.110 INFO:tasks.rados.rados.0.trial082.stdout:2912: finishing write tid 3 to trial08226312-41 2026-02-12T17:40:55.110 INFO:tasks.rados.rados.0.trial082.stdout:2912: finishing write tid 4 to trial08226312-41 2026-02-12T17:40:55.111 INFO:tasks.rados.rados.0.trial082.stdout:2912: oid 41 updating version 0 to 1962 2026-02-12T17:40:55.111 INFO:tasks.rados.rados.0.trial082.stdout:2912: oid 41 version 1962 is already newer than 1960 2026-02-12T17:40:55.111 INFO:tasks.rados.rados.0.trial082.stdout:2912: oid 41 version 1962 is already newer than 1961 2026-02-12T17:40:55.111 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1962 (ObjNum 990 snap 306 seq_num 990) dirty exists 2026-02-12T17:40:55.111 INFO:tasks.rados.rados.0.trial082.stdout:2912: left oid 41 (ObjNum 990 snap 306 seq_num 990) 2026-02-12T17:40:55.111 INFO:tasks.rados.rados.0.trial082.stdout:2912: done (1 left) 2026-02-12T17:40:55.112 INFO:tasks.rados.rados.0.trial082.stdout:2913: done (0 left) 2026-02-12T17:40:55.112 INFO:tasks.rados.rados.0.trial082.stdout:2914: copy_from oid 18 from oid 19 current snap is 306 2026-02-12T17:40:55.112 INFO:tasks.rados.rados.0.trial082.stdout:2915: delete oid 47 current snap is 306 2026-02-12T17:40:55.112 INFO:tasks.rados.rados.0.trial082.stdout:2914: finishing copy_from to trial08226312-18 2026-02-12T17:40:55.113 INFO:tasks.rados.rados.0.trial082.stdout:2914: got expected ENOENT (src dne) 2026-02-12T17:40:55.113 INFO:tasks.rados.rados.0.trial082.stdout:2914: finishing copy_from racing read to trial08226312-18 2026-02-12T17:40:55.113 INFO:tasks.rados.rados.0.trial082.stdout:2914: done (1 left) 2026-02-12T17:40:55.113 INFO:tasks.rados.rados.0.trial082.stdout:2915: done (0 left) 2026-02-12T17:40:55.113 INFO:tasks.rados.rados.0.trial082.stdout:2916: delete oid 6 current snap is 306 2026-02-12T17:40:55.114 INFO:tasks.rados.rados.0.trial082.stdout:2916: done (0 left) 2026-02-12T17:40:55.114 INFO:tasks.rados.rados.0.trial082.stdout:2917: read oid 31 snap -1 2026-02-12T17:40:55.114 INFO:tasks.rados.rados.0.trial082.stdout:2917: expect deleted 2026-02-12T17:40:55.114 INFO:tasks.rados.rados.0.trial082.stdout:2918: snap_create 2026-02-12T17:40:56.102 INFO:tasks.rados.rados.0.trial082.stdout:2917: done (1 left) 2026-02-12T17:40:56.102 INFO:tasks.rados.rados.0.trial082.stdout:2918: done (0 left) 2026-02-12T17:40:56.102 INFO:tasks.rados.rados.0.trial082.stdout:2919: write (excl) oid 43 current snap is 307 2026-02-12T17:40:56.102 INFO:tasks.rados.rados.0.trial082.stdout:2919: seq_num 994 ranges {706158=723396,2183219=522939} 2026-02-12T17:40:56.107 INFO:tasks.rados.rados.0.trial082.stdout:2919: writing trial08226312-43 from 706158 to 1429554 tid 1 2026-02-12T17:40:56.113 INFO:tasks.rados.rados.0.trial082.stdout:2919: writing trial08226312-43 from 2183219 to 2706158 tid 2 2026-02-12T17:40:56.113 INFO:tasks.rados.rados.0.trial082.stdout:2920: snap_create 2026-02-12T17:40:56.113 INFO:tasks.rados.rados.0.trial082.stdout:2919: finishing write tid 1 to trial08226312-43 2026-02-12T17:40:56.115 INFO:tasks.rados.rados.0.trial082.stdout:2919: finishing write tid 2 to trial08226312-43 2026-02-12T17:40:56.115 INFO:tasks.rados.rados.0.trial082.stdout:2919: finishing write tid 3 to trial08226312-43 2026-02-12T17:40:56.115 INFO:tasks.rados.rados.0.trial082.stdout:2919: finishing write tid 4 to trial08226312-43 2026-02-12T17:40:56.115 INFO:tasks.rados.rados.0.trial082.stdout:2919: oid 43 updating version 0 to 2224 2026-02-12T17:40:56.115 INFO:tasks.rados.rados.0.trial082.stdout:2919: oid 43 version 2224 is already newer than 2222 2026-02-12T17:40:56.115 INFO:tasks.rados.rados.0.trial082.stdout:2919: oid 43 version 2224 is already newer than 2223 2026-02-12T17:40:56.115 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2224 (ObjNum 994 snap 307 seq_num 994) dirty exists 2026-02-12T17:40:56.115 INFO:tasks.rados.rados.0.trial082.stdout:2919: left oid 43 (ObjNum 994 snap 307 seq_num 994) 2026-02-12T17:40:57.348 INFO:tasks.rados.rados.0.trial082.stdout:2919: done (1 left) 2026-02-12T17:40:57.348 INFO:tasks.rados.rados.0.trial082.stdout:2920: done (0 left) 2026-02-12T17:40:57.348 INFO:tasks.rados.rados.0.trial082.stdout:2921: rollback oid 35 current snap is 308 2026-02-12T17:40:57.348 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 35 to 283 2026-02-12T17:40:57.348 INFO:tasks.rados.rados.0.trial082.stdout:2922: read oid 49 snap -1 2026-02-12T17:40:57.348 INFO:tasks.rados.rados.0.trial082.stdout:2922: expect (ObjNum 969 snap 301 seq_num 969) 2026-02-12T17:40:57.348 INFO:tasks.rados.rados.0.trial082.stdout:2923: snap_create 2026-02-12T17:40:57.352 INFO:tasks.rados.rados.0.trial082.stdout:2921: finishing rollback tid 0 to trial08226312-35 2026-02-12T17:40:57.352 INFO:tasks.rados.rados.0.trial082.stdout:2921: finishing rollback tid 1 to trial08226312-35 2026-02-12T17:40:57.353 INFO:tasks.rados.rados.0.trial082.stdout:2921: finishing rollback tid 2 to trial08226312-35 2026-02-12T17:40:57.353 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1906 (ObjNum 875 snap 277 seq_num 875) dirty exists 2026-02-12T17:40:57.353 INFO:tasks.rados.rados.0.trial082.stdout:2922: expect (ObjNum 969 snap 301 seq_num 969) 2026-02-12T17:40:57.356 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 712148 2026-02-12T17:40:57.369 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1592424 2026-02-12T17:40:58.095 INFO:tasks.rados.rados.0.trial082.stdout:2921: done (2 left) 2026-02-12T17:40:58.095 INFO:tasks.rados.rados.0.trial082.stdout:2922: done (1 left) 2026-02-12T17:40:58.095 INFO:tasks.rados.rados.0.trial082.stdout:2923: done (0 left) 2026-02-12T17:40:58.095 INFO:tasks.rados.rados.0.trial082.stdout:2924: rollback oid 8 current snap is 309 2026-02-12T17:40:58.095 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 8 to 306 2026-02-12T17:40:58.095 INFO:tasks.rados.rados.0.trial082.stdout:2925: write (excl) oid 11 current snap is 309 2026-02-12T17:40:58.096 INFO:tasks.rados.rados.0.trial082.stdout:2925: seq_num 995 ranges {722965=798645,2125348=597617} 2026-02-12T17:40:58.100 INFO:tasks.rados.rados.0.trial082.stdout:2925: writing trial08226312-11 from 722965 to 1521610 tid 1 2026-02-12T17:40:58.105 INFO:tasks.rados.rados.0.trial082.stdout:2925: writing trial08226312-11 from 2125348 to 2722965 tid 2 2026-02-12T17:40:58.105 INFO:tasks.rados.rados.0.trial082.stdout:2926: copy_from oid 29 from oid 2 current snap is 309 2026-02-12T17:40:58.105 INFO:tasks.rados.rados.0.trial082.stdout:2924: finishing rollback tid 0 to trial08226312-8 2026-02-12T17:40:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2924: finishing rollback tid 1 to trial08226312-8 2026-02-12T17:40:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2924: finishing rollback tid 2 to trial08226312-8 2026-02-12T17:40:58.106 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 2284 (ObjNum 930 snap 291 seq_num 930) dirty exists 2026-02-12T17:40:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2925: finishing write tid 1 to trial08226312-11 2026-02-12T17:40:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2924: done (2 left) 2026-02-12T17:40:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2927: rollback oid 35 current snap is 309 2026-02-12T17:40:58.106 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 35 to 283 2026-02-12T17:40:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2928: write oid 10 current snap is 309 2026-02-12T17:40:58.106 INFO:tasks.rados.rados.0.trial082.stdout:2928: seq_num 996 ranges {739772=590247,1900183=540336} 2026-02-12T17:40:58.110 INFO:tasks.rados.rados.0.trial082.stdout:2928: writing trial08226312-10 from 739772 to 1330019 tid 1 2026-02-12T17:40:58.114 INFO:tasks.rados.rados.0.trial082.stdout:2928: writing trial08226312-10 from 1900183 to 2440519 tid 2 2026-02-12T17:40:58.114 INFO:tasks.rados.rados.0.trial082.stdout:2929: snap_remove snap 292 2026-02-12T17:40:59.096 INFO:tasks.rados.rados.0.trial082.stdout:2929: done (4 left) 2026-02-12T17:40:59.096 INFO:tasks.rados.rados.0.trial082.stdout:2930: write oid 33 current snap is 309 2026-02-12T17:40:59.096 INFO:tasks.rados.rados.0.trial082.stdout:2930: seq_num 997 ranges {756579=665496,1958665=400347} 2026-02-12T17:40:59.101 INFO:tasks.rados.rados.0.trial082.stdout:2930: writing trial08226312-33 from 756579 to 1422075 tid 1 2026-02-12T17:40:59.105 INFO:tasks.rados.rados.0.trial082.stdout:2930: writing trial08226312-33 from 1958665 to 2359012 tid 2 2026-02-12T17:40:59.105 INFO:tasks.rados.rados.0.trial082.stdout:2931: write oid 36 current snap is 309 2026-02-12T17:40:59.105 INFO:tasks.rados.rados.0.trial082.stdout:2925: finishing write tid 2 to trial08226312-11 2026-02-12T17:40:59.105 INFO:tasks.rados.rados.0.trial082.stdout:2925: finishing write tid 3 to trial08226312-11 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2925: finishing write tid 4 to trial08226312-11 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2925: oid 11 updating version 0 to 1895 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2925: oid 11 version 1895 is already newer than 1894 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2925: oid 11 version 1895 is already newer than 1893 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 1895 (ObjNum 995 snap 309 seq_num 995) dirty exists 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2925: left oid 11 (ObjNum 995 snap 309 seq_num 995) 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2927: finishing rollback tid 0 to trial08226312-35 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2927: finishing rollback tid 1 to trial08226312-35 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2927: finishing rollback tid 2 to trial08226312-35 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1909 (ObjNum 875 snap 277 seq_num 875) dirty exists 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2926: finishing copy_from racing read to trial08226312-29 2026-02-12T17:40:59.106 INFO:tasks.rados.rados.0.trial082.stdout:2931: seq_num 998 ranges {773386=740745,2017147=544005} 2026-02-12T17:40:59.111 INFO:tasks.rados.rados.0.trial082.stdout:2931: writing trial08226312-36 from 773386 to 1514131 tid 1 2026-02-12T17:40:59.115 INFO:tasks.rados.rados.0.trial082.stdout:2931: writing trial08226312-36 from 2017147 to 2561152 tid 2 2026-02-12T17:40:59.115 INFO:tasks.rados.rados.0.trial082.stdout:2925: done (5 left) 2026-02-12T17:40:59.115 INFO:tasks.rados.rados.0.trial082.stdout:2927: done (4 left) 2026-02-12T17:40:59.116 INFO:tasks.rados.rados.0.trial082.stdout:2932: snap_remove snap 307 2026-02-12T17:41:00.097 INFO:tasks.rados.rados.0.trial082.stdout:2932: done (4 left) 2026-02-12T17:41:00.097 INFO:tasks.rados.rados.0.trial082.stdout:2933: read oid 48 snap -1 2026-02-12T17:41:00.097 INFO:tasks.rados.rados.0.trial082.stdout:2933: expect (ObjNum 943 snap 294 seq_num 943) 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2934: read oid 7 snap 301 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2934: expect (ObjNum 954 snap 297 seq_num 954) 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2935: snap_create 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2928: finishing write tid 1 to trial08226312-10 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2926: finishing copy_from to trial08226312-29 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2209 (ObjNum 955 snap 297 seq_num 955) dirty exists 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2928: finishing write tid 2 to trial08226312-10 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2928: finishing write tid 3 to trial08226312-10 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2928: finishing write tid 4 to trial08226312-10 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2928: oid 10 updating version 0 to 2227 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2928: oid 10 version 2227 is already newer than 2226 2026-02-12T17:41:00.098 INFO:tasks.rados.rados.0.trial082.stdout:2928: oid 10 version 2227 is already newer than 2225 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2227 (ObjNum 996 snap 309 seq_num 996) dirty exists 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2928: left oid 10 (ObjNum 996 snap 309 seq_num 996) 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2930: finishing write tid 1 to trial08226312-33 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2930: finishing write tid 2 to trial08226312-33 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2930: finishing write tid 3 to trial08226312-33 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2930: finishing write tid 4 to trial08226312-33 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2930: oid 33 updating version 0 to 1965 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2930: oid 33 version 1965 is already newer than 1963 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2930: oid 33 version 1965 is already newer than 1964 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1965 (ObjNum 997 snap 309 seq_num 997) dirty exists 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2930: left oid 33 (ObjNum 997 snap 309 seq_num 997) 2026-02-12T17:41:00.099 INFO:tasks.rados.rados.0.trial082.stdout:2931: finishing write tid 1 to trial08226312-36 2026-02-12T17:41:00.100 INFO:tasks.rados.rados.0.trial082.stdout:2931: finishing write tid 2 to trial08226312-36 2026-02-12T17:41:00.100 INFO:tasks.rados.rados.0.trial082.stdout:2931: finishing write tid 3 to trial08226312-36 2026-02-12T17:41:00.100 INFO:tasks.rados.rados.0.trial082.stdout:2931: finishing write tid 4 to trial08226312-36 2026-02-12T17:41:00.100 INFO:tasks.rados.rados.0.trial082.stdout:2931: oid 36 updating version 0 to 1912 2026-02-12T17:41:00.100 INFO:tasks.rados.rados.0.trial082.stdout:2931: oid 36 version 1912 is already newer than 1910 2026-02-12T17:41:00.100 INFO:tasks.rados.rados.0.trial082.stdout:2931: oid 36 version 1912 is already newer than 1911 2026-02-12T17:41:00.100 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 1912 (ObjNum 998 snap 309 seq_num 998) dirty exists 2026-02-12T17:41:00.100 INFO:tasks.rados.rados.0.trial082.stdout:2931: left oid 36 (ObjNum 998 snap 309 seq_num 998) 2026-02-12T17:41:00.102 INFO:tasks.rados.rados.0.trial082.stdout:2934: expect (ObjNum 954 snap 297 seq_num 954) 2026-02-12T17:41:00.105 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 812812 2026-02-12T17:41:00.118 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:00.137 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:00.156 INFO:tasks.rados.rados.0.trial082.stdout:2933: expect (ObjNum 943 snap 294 seq_num 943) 2026-02-12T17:41:00.164 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2289527 2026-02-12T17:41:00.209 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3658676 2026-02-12T17:41:00.228 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3044419 2026-02-12T17:41:01.098 INFO:tasks.rados.rados.0.trial082.stdout:2926: done (6 left) 2026-02-12T17:41:01.098 INFO:tasks.rados.rados.0.trial082.stdout:2928: done (5 left) 2026-02-12T17:41:01.098 INFO:tasks.rados.rados.0.trial082.stdout:2930: done (4 left) 2026-02-12T17:41:01.098 INFO:tasks.rados.rados.0.trial082.stdout:2931: done (3 left) 2026-02-12T17:41:01.098 INFO:tasks.rados.rados.0.trial082.stdout:2933: done (2 left) 2026-02-12T17:41:01.098 INFO:tasks.rados.rados.0.trial082.stdout:2934: done (1 left) 2026-02-12T17:41:01.098 INFO:tasks.rados.rados.0.trial082.stdout:2935: done (0 left) 2026-02-12T17:41:01.098 INFO:tasks.rados.rados.0.trial082.stdout:2936: snap_create 2026-02-12T17:41:02.098 INFO:tasks.rados.rados.0.trial082.stdout:2936: done (0 left) 2026-02-12T17:41:02.099 INFO:tasks.rados.rados.0.trial082.stdout:2937: read oid 30 snap -1 2026-02-12T17:41:02.099 INFO:tasks.rados.rados.0.trial082.stdout:2937: expect (ObjNum 976 snap 303 seq_num 976) 2026-02-12T17:41:02.099 INFO:tasks.rados.rados.0.trial082.stdout:2938: write (excl) oid 41 current snap is 311 2026-02-12T17:41:02.099 INFO:tasks.rados.rados.0.trial082.stdout:2938: seq_num 999 ranges {790193=415994,1959276=404016} 2026-02-12T17:41:02.103 INFO:tasks.rados.rados.0.trial082.stdout:2938: writing trial08226312-41 from 790193 to 1206187 tid 1 2026-02-12T17:41:02.107 INFO:tasks.rados.rados.0.trial082.stdout:2938: writing trial08226312-41 from 1959276 to 2363292 tid 2 2026-02-12T17:41:02.108 INFO:tasks.rados.rados.0.trial082.stdout:2939: write oid 10 current snap is 311 2026-02-12T17:41:02.108 INFO:tasks.rados.rados.0.trial082.stdout:2939: seq_num 1000 ranges {407000=491243,1617758=547674,2595228=211772} 2026-02-12T17:41:02.110 INFO:tasks.rados.rados.0.trial082.stdout:2939: writing trial08226312-10 from 407000 to 898243 tid 1 2026-02-12T17:41:02.115 INFO:tasks.rados.rados.0.trial082.stdout:2939: writing trial08226312-10 from 1617758 to 2165432 tid 2 2026-02-12T17:41:02.118 INFO:tasks.rados.rados.0.trial082.stdout:2939: writing trial08226312-10 from 2595228 to 2807000 tid 3 2026-02-12T17:41:02.118 INFO:tasks.rados.rados.0.trial082.stdout:2940: snap_remove snap 306 2026-02-12T17:41:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2940: done (3 left) 2026-02-12T17:41:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2941: read oid 13 snap -1 2026-02-12T17:41:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2941: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:41:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2942: read oid 28 snap 303 2026-02-12T17:41:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2942: expect (ObjNum 942 snap 294 seq_num 942) 2026-02-12T17:41:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2943: snap_create 2026-02-12T17:41:03.097 INFO:tasks.rados.rados.0.trial082.stdout:2937: expect (ObjNum 976 snap 303 seq_num 976) 2026-02-12T17:41:03.098 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:03.141 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1459932 2026-02-12T17:41:03.168 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 264665 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2938: finishing write tid 1 to trial08226312-41 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2938: finishing write tid 2 to trial08226312-41 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2938: finishing write tid 3 to trial08226312-41 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2938: finishing write tid 4 to trial08226312-41 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2938: oid 41 updating version 0 to 1967 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2938: oid 41 version 1967 is already newer than 1966 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2938: oid 41 updating version 1967 to 1968 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1968 (ObjNum 999 snap 311 seq_num 999) dirty exists 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2938: left oid 41 (ObjNum 999 snap 311 seq_num 999) 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2939: finishing write tid 1 to trial08226312-10 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2939: finishing write tid 2 to trial08226312-10 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2939: finishing write tid 3 to trial08226312-10 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2939: finishing write tid 4 to trial08226312-10 2026-02-12T17:41:03.203 INFO:tasks.rados.rados.0.trial082.stdout:2939: finishing write tid 5 to trial08226312-10 2026-02-12T17:41:03.204 INFO:tasks.rados.rados.0.trial082.stdout:2939: oid 10 updating version 0 to 2229 2026-02-12T17:41:03.204 INFO:tasks.rados.rados.0.trial082.stdout:2939: oid 10 updating version 2229 to 2231 2026-02-12T17:41:03.204 INFO:tasks.rados.rados.0.trial082.stdout:2939: oid 10 version 2231 is already newer than 2228 2026-02-12T17:41:03.204 INFO:tasks.rados.rados.0.trial082.stdout:2939: oid 10 version 2231 is already newer than 2230 2026-02-12T17:41:03.204 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2231 (ObjNum 1000 snap 311 seq_num 1000) dirty exists 2026-02-12T17:41:03.204 INFO:tasks.rados.rados.0.trial082.stdout:2939: left oid 10 (ObjNum 1000 snap 311 seq_num 1000) 2026-02-12T17:41:03.204 INFO:tasks.rados.rados.0.trial082.stdout:2941: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:41:03.220 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2081545 2026-02-12T17:41:03.240 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1862296 2026-02-12T17:41:03.277 INFO:tasks.rados.rados.0.trial082.stdout:2942: expect (ObjNum 942 snap 294 seq_num 942) 2026-02-12T17:41:03.314 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:04.097 INFO:tasks.rados.rados.0.trial082.stdout:2937: done (5 left) 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2938: done (4 left) 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2939: done (3 left) 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2941: done (2 left) 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2942: done (1 left) 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2943: done (0 left) 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2944: copy_from oid 10 from oid 11 current snap is 312 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2945: read oid 40 snap 283 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2945: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2946: read oid 25 snap -1 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2946: expect (ObjNum 948 snap 294 seq_num 948) 2026-02-12T17:41:04.098 INFO:tasks.rados.rados.0.trial082.stdout:2947: read oid 38 snap 308 2026-02-12T17:41:04.099 INFO:tasks.rados.rados.0.trial082.stdout:2947: expect deleted 2026-02-12T17:41:04.099 INFO:tasks.rados.rados.0.trial082.stdout:2948: rollback oid 29 current snap is 312 2026-02-12T17:41:04.099 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 29 to 283 2026-02-12T17:41:04.099 INFO:tasks.rados.rados.0.trial082.stdout:2949: snap_create 2026-02-12T17:41:04.099 INFO:tasks.rados.rados.0.trial082.stdout:2948: finishing rollback tid 0 to trial08226312-29 2026-02-12T17:41:04.100 INFO:tasks.rados.rados.0.trial082.stdout:2948: finishing rollback tid 1 to trial08226312-29 2026-02-12T17:41:04.100 INFO:tasks.rados.rados.0.trial082.stdout:2948: finishing rollback tid 2 to trial08226312-29 2026-02-12T17:41:04.100 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2212 (ObjNum 883 snap 281 seq_num 883) dirty exists 2026-02-12T17:41:04.102 INFO:tasks.rados.rados.0.trial082.stdout:2945: expect (ObjNum 750 snap 227 seq_num 750) 2026-02-12T17:41:04.211 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 351792 2026-02-12T17:41:04.263 INFO:tasks.rados.rados.0.trial082.stdout:2946: expect (ObjNum 948 snap 294 seq_num 948) 2026-02-12T17:41:04.288 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3043848 2026-02-12T17:41:04.296 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 359857 2026-02-12T17:41:04.372 INFO:tasks.rados.rados.0.trial082.stdout:2944: finishing copy_from racing read to trial08226312-10 2026-02-12T17:41:04.372 INFO:tasks.rados.rados.0.trial082.stdout:2944: finishing copy_from to trial08226312-10 2026-02-12T17:41:04.372 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1895 (ObjNum 995 snap 309 seq_num 995) dirty exists 2026-02-12T17:41:05.098 INFO:tasks.rados.rados.0.trial082.stdout:2944: done (5 left) 2026-02-12T17:41:05.098 INFO:tasks.rados.rados.0.trial082.stdout:2945: done (4 left) 2026-02-12T17:41:05.098 INFO:tasks.rados.rados.0.trial082.stdout:2946: done (3 left) 2026-02-12T17:41:05.099 INFO:tasks.rados.rados.0.trial082.stdout:2947: done (2 left) 2026-02-12T17:41:05.099 INFO:tasks.rados.rados.0.trial082.stdout:2948: done (1 left) 2026-02-12T17:41:05.099 INFO:tasks.rados.rados.0.trial082.stdout:2949: done (0 left) 2026-02-12T17:41:05.099 INFO:tasks.rados.rados.0.trial082.stdout:2950: read oid 19 snap -1 2026-02-12T17:41:05.099 INFO:tasks.rados.rados.0.trial082.stdout:2950: expect deleted 2026-02-12T17:41:05.099 INFO:tasks.rados.rados.0.trial082.stdout:2951: snap_remove snap 302 2026-02-12T17:41:06.098 INFO:tasks.rados.rados.0.trial082.stdout:2951: done (1 left) 2026-02-12T17:41:06.098 INFO:tasks.rados.rados.0.trial082.stdout:2952: read oid 45 snap 312 2026-02-12T17:41:06.098 INFO:tasks.rados.rados.0.trial082.stdout:2952: expect (ObjNum 986 snap 304 seq_num 986) 2026-02-12T17:41:06.098 INFO:tasks.rados.rados.0.trial082.stdout:2953: rollback oid 37 current snap is 313 2026-02-12T17:41:06.099 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 37 to 304 2026-02-12T17:41:06.099 INFO:tasks.rados.rados.0.trial082.stdout:2950: done (2 left) 2026-02-12T17:41:06.099 INFO:tasks.rados.rados.0.trial082.stdout:2954: snap_remove snap 305 2026-02-12T17:41:07.099 INFO:tasks.rados.rados.0.trial082.stdout:2954: done (2 left) 2026-02-12T17:41:07.099 INFO:tasks.rados.rados.0.trial082.stdout:2955: write (excl) oid 15 current snap is 313 2026-02-12T17:41:07.099 INFO:tasks.rados.rados.0.trial082.stdout:2955: seq_num 1001 ranges {423807=566492,1676240=407685,2739004=84803} 2026-02-12T17:41:07.102 INFO:tasks.rados.rados.0.trial082.stdout:2955: writing trial08226312-15 from 423807 to 990299 tid 1 2026-02-12T17:41:07.106 INFO:tasks.rados.rados.0.trial082.stdout:2955: writing trial08226312-15 from 1676240 to 2083925 tid 2 2026-02-12T17:41:07.109 INFO:tasks.rados.rados.0.trial082.stdout:2955: writing trial08226312-15 from 2739004 to 2823807 tid 3 2026-02-12T17:41:07.109 INFO:tasks.rados.rados.0.trial082.stdout:2956: delete oid 20 current snap is 313 2026-02-12T17:41:07.110 INFO:tasks.rados.rados.0.trial082.stdout:2952: expect (ObjNum 986 snap 304 seq_num 986) 2026-02-12T17:41:07.127 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 531317 2026-02-12T17:41:07.143 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:07.162 INFO:tasks.rados.rados.0.trial082.stdout:2953: finishing rollback tid 0 to trial08226312-37 2026-02-12T17:41:07.162 INFO:tasks.rados.rados.0.trial082.stdout:2953: finishing rollback tid 1 to trial08226312-37 2026-02-12T17:41:07.162 INFO:tasks.rados.rados.0.trial082.stdout:2953: finishing rollback tid 2 to trial08226312-37 2026-02-12T17:41:07.162 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1971 (ObjNum 970 snap 301 seq_num 970) dirty exists 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: finishing write tid 1 to trial08226312-15 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: finishing write tid 2 to trial08226312-15 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: finishing write tid 3 to trial08226312-15 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: finishing write tid 4 to trial08226312-15 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: finishing write tid 5 to trial08226312-15 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: oid 15 updating version 0 to 1277 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: oid 15 version 1277 is already newer than 1275 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: oid 15 version 1277 is already newer than 1276 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: oid 15 version 1277 is already newer than 1274 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 1277 (ObjNum 1001 snap 313 seq_num 1001) dirty exists 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2955: left oid 15 (ObjNum 1001 snap 313 seq_num 1001) 2026-02-12T17:41:07.163 INFO:tasks.rados.rados.0.trial082.stdout:2952: done (3 left) 2026-02-12T17:41:07.164 INFO:tasks.rados.rados.0.trial082.stdout:2953: done (2 left) 2026-02-12T17:41:07.164 INFO:tasks.rados.rados.0.trial082.stdout:2955: done (1 left) 2026-02-12T17:41:07.164 INFO:tasks.rados.rados.0.trial082.stdout:2956: done (0 left) 2026-02-12T17:41:07.164 INFO:tasks.rados.rados.0.trial082.stdout:2957: read oid 26 snap 311 2026-02-12T17:41:07.164 INFO:tasks.rados.rados.0.trial082.stdout:2957: expect deleted 2026-02-12T17:41:07.164 INFO:tasks.rados.rados.0.trial082.stdout:2958: copy_from oid 28 from oid 44 current snap is 313 2026-02-12T17:41:07.164 INFO:tasks.rados.rados.0.trial082.stdout:2959: write (excl) oid 41 current snap is 313 2026-02-12T17:41:07.164 INFO:tasks.rados.rados.0.trial082.stdout:2959: seq_num 1003 ranges {457421=716990,1676851=411354,2677497=179924} 2026-02-12T17:41:07.166 INFO:tasks.rados.rados.0.trial082.stdout:2959: writing trial08226312-41 from 457421 to 1174411 tid 1 2026-02-12T17:41:07.169 INFO:tasks.rados.rados.0.trial082.stdout:2959: writing trial08226312-41 from 1676851 to 2088205 tid 2 2026-02-12T17:41:07.172 INFO:tasks.rados.rados.0.trial082.stdout:2959: writing trial08226312-41 from 2677497 to 2857421 tid 3 2026-02-12T17:41:07.172 INFO:tasks.rados.rados.0.trial082.stdout:2960: delete oid 39 current snap is 313 2026-02-12T17:41:07.172 INFO:tasks.rados.rados.0.trial082.stdout:2958: finishing copy_from racing read to trial08226312-28 2026-02-12T17:41:07.173 INFO:tasks.rados.rados.0.trial082.stdout:2959: finishing write tid 1 to trial08226312-41 2026-02-12T17:41:07.173 INFO:tasks.rados.rados.0.trial082.stdout:2958: finishing copy_from to trial08226312-28 2026-02-12T17:41:07.173 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1882 (ObjNum 851 snap 268 seq_num 851) dirty exists 2026-02-12T17:41:07.173 INFO:tasks.rados.rados.0.trial082.stdout:2959: finishing write tid 2 to trial08226312-41 2026-02-12T17:41:07.174 INFO:tasks.rados.rados.0.trial082.stdout:2959: finishing write tid 3 to trial08226312-41 2026-02-12T17:41:07.174 INFO:tasks.rados.rados.0.trial082.stdout:2959: finishing write tid 4 to trial08226312-41 2026-02-12T17:41:07.174 INFO:tasks.rados.rados.0.trial082.stdout:2959: finishing write tid 5 to trial08226312-41 2026-02-12T17:41:07.174 INFO:tasks.rados.rados.0.trial082.stdout:2959: oid 41 updating version 0 to 1975 2026-02-12T17:41:07.174 INFO:tasks.rados.rados.0.trial082.stdout:2959: oid 41 version 1975 is already newer than 1974 2026-02-12T17:41:07.174 INFO:tasks.rados.rados.0.trial082.stdout:2959: oid 41 version 1975 is already newer than 1972 2026-02-12T17:41:07.174 INFO:tasks.rados.rados.0.trial082.stdout:2959: oid 41 version 1975 is already newer than 1973 2026-02-12T17:41:07.175 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1975 (ObjNum 1003 snap 313 seq_num 1003) dirty exists 2026-02-12T17:41:07.175 INFO:tasks.rados.rados.0.trial082.stdout:2959: left oid 41 (ObjNum 1003 snap 313 seq_num 1003) 2026-02-12T17:41:07.175 INFO:tasks.rados.rados.0.trial082.stdout:2957: done (3 left) 2026-02-12T17:41:07.175 INFO:tasks.rados.rados.0.trial082.stdout:2958: done (2 left) 2026-02-12T17:41:07.175 INFO:tasks.rados.rados.0.trial082.stdout:2959: done (1 left) 2026-02-12T17:41:07.175 INFO:tasks.rados.rados.0.trial082.stdout:2960: done (0 left) 2026-02-12T17:41:07.175 INFO:tasks.rados.rados.0.trial082.stdout:2961: delete oid 2 current snap is 313 2026-02-12T17:41:07.175 INFO:tasks.rados.rados.0.trial082.stdout:2961: done (0 left) 2026-02-12T17:41:07.176 INFO:tasks.rados.rados.0.trial082.stdout:2962: snap_create 2026-02-12T17:41:08.097 INFO:tasks.rados.rados.0.trial082.stdout:2962: done (0 left) 2026-02-12T17:41:08.097 INFO:tasks.rados.rados.0.trial082.stdout:2963: rollback oid 2 current snap is 314 2026-02-12T17:41:08.097 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 308 2026-02-12T17:41:08.097 INFO:tasks.rados.rados.0.trial082.stdout:2964: write oid 27 current snap is 314 2026-02-12T17:41:08.097 INFO:tasks.rados.rados.0.trial082.stdout:2964: seq_num 1006 ranges {507842=659090,1568650=558681,2759766=148076} 2026-02-12T17:41:08.101 INFO:tasks.rados.rados.0.trial082.stdout:2964: writing trial08226312-27 from 507842 to 1166932 tid 1 2026-02-12T17:41:08.104 INFO:tasks.rados.rados.0.trial082.stdout:2964: writing trial08226312-27 from 1568650 to 2127331 tid 2 2026-02-12T17:41:08.107 INFO:tasks.rados.rados.0.trial082.stdout:2964: writing trial08226312-27 from 2759766 to 2907842 tid 3 2026-02-12T17:41:08.107 INFO:tasks.rados.rados.0.trial082.stdout:2965: write (excl) oid 18 current snap is 314 2026-02-12T17:41:08.108 INFO:tasks.rados.rados.0.trial082.stdout:2965: seq_num 1007 ranges {524649=734339,1910779=702339} 2026-02-12T17:41:08.112 INFO:tasks.rados.rados.0.trial082.stdout:2965: writing trial08226312-18 from 524649 to 1258988 tid 1 2026-02-12T17:41:08.117 INFO:tasks.rados.rados.0.trial082.stdout:2965: writing trial08226312-18 from 1910779 to 2613118 tid 2 2026-02-12T17:41:08.117 INFO:tasks.rados.rados.0.trial082.stdout:2966: write (excl) oid 38 current snap is 314 2026-02-12T17:41:08.117 INFO:tasks.rados.rados.0.trial082.stdout:2966: seq_num 1008 ranges {541456=409588,1569261=562350,2814612=126844} 2026-02-12T17:41:08.120 INFO:tasks.rados.rados.0.trial082.stdout:2966: writing trial08226312-38 from 541456 to 951044 tid 1 2026-02-12T17:41:08.125 INFO:tasks.rados.rados.0.trial082.stdout:2966: writing trial08226312-38 from 1569261 to 2131611 tid 2 2026-02-12T17:41:08.128 INFO:tasks.rados.rados.0.trial082.stdout:2966: writing trial08226312-38 from 2814612 to 2941456 tid 3 2026-02-12T17:41:08.128 INFO:tasks.rados.rados.0.trial082.stdout:2967: write oid 48 current snap is 314 2026-02-12T17:41:08.128 INFO:tasks.rados.rados.0.trial082.stdout:2967: seq_num 1009 ranges {558263=484837,1627743=706008} 2026-02-12T17:41:08.132 INFO:tasks.rados.rados.0.trial082.stdout:2967: writing trial08226312-48 from 558263 to 1043100 tid 1 2026-02-12T17:41:08.137 INFO:tasks.rados.rados.0.trial082.stdout:2967: writing trial08226312-48 from 1627743 to 2333751 tid 2 2026-02-12T17:41:08.137 INFO:tasks.rados.rados.0.trial082.stdout:2968: snap_create 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2963: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2963: finishing rollback tid 2 to trial08226312-2 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 2213 (ObjNum 955 snap 297 seq_num 955) dirty exists 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2964: finishing write tid 1 to trial08226312-27 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2964: finishing write tid 2 to trial08226312-27 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2964: finishing write tid 3 to trial08226312-27 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2964: finishing write tid 4 to trial08226312-27 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2964: finishing write tid 5 to trial08226312-27 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2964: oid 27 updating version 0 to 1124 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2964: oid 27 updating version 1124 to 1126 2026-02-12T17:41:08.138 INFO:tasks.rados.rados.0.trial082.stdout:2964: oid 27 updating version 1126 to 1127 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2964: oid 27 version 1127 is already newer than 1125 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1127 (ObjNum 1006 snap 314 seq_num 1006) dirty exists 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2964: left oid 27 (ObjNum 1006 snap 314 seq_num 1006) 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2965: finishing write tid 1 to trial08226312-18 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2965: finishing write tid 2 to trial08226312-18 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2965: finishing write tid 3 to trial08226312-18 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2965: finishing write tid 4 to trial08226312-18 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2965: oid 18 updating version 0 to 1574 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2965: oid 18 version 1574 is already newer than 1573 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2965: oid 18 version 1574 is already newer than 1572 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 1574 (ObjNum 1007 snap 314 seq_num 1007) dirty exists 2026-02-12T17:41:08.139 INFO:tasks.rados.rados.0.trial082.stdout:2965: left oid 18 (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: finishing write tid 1 to trial08226312-38 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: finishing write tid 2 to trial08226312-38 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: finishing write tid 3 to trial08226312-38 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: finishing write tid 4 to trial08226312-38 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: finishing write tid 5 to trial08226312-38 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: oid 38 updating version 0 to 1881 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: oid 38 updating version 1881 to 1883 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: oid 38 version 1883 is already newer than 1882 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: oid 38 updating version 1883 to 1884 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 1884 (ObjNum 1008 snap 314 seq_num 1008) dirty exists 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2966: left oid 38 (ObjNum 1008 snap 314 seq_num 1008) 2026-02-12T17:41:08.140 INFO:tasks.rados.rados.0.trial082.stdout:2967: finishing write tid 1 to trial08226312-48 2026-02-12T17:41:08.141 INFO:tasks.rados.rados.0.trial082.stdout:2967: finishing write tid 2 to trial08226312-48 2026-02-12T17:41:08.142 INFO:tasks.rados.rados.0.trial082.stdout:2967: finishing write tid 3 to trial08226312-48 2026-02-12T17:41:08.142 INFO:tasks.rados.rados.0.trial082.stdout:2967: finishing write tid 4 to trial08226312-48 2026-02-12T17:41:08.142 INFO:tasks.rados.rados.0.trial082.stdout:2967: oid 48 updating version 0 to 1609 2026-02-12T17:41:08.142 INFO:tasks.rados.rados.0.trial082.stdout:2967: oid 48 version 1609 is already newer than 1608 2026-02-12T17:41:08.142 INFO:tasks.rados.rados.0.trial082.stdout:2967: oid 48 version 1609 is already newer than 1607 2026-02-12T17:41:08.142 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1609 (ObjNum 1009 snap 314 seq_num 1009) dirty exists 2026-02-12T17:41:08.142 INFO:tasks.rados.rados.0.trial082.stdout:2967: left oid 48 (ObjNum 1009 snap 314 seq_num 1009) 2026-02-12T17:41:09.105 INFO:tasks.rados.rados.0.trial082.stdout:2963: done (5 left) 2026-02-12T17:41:09.105 INFO:tasks.rados.rados.0.trial082.stdout:2964: done (4 left) 2026-02-12T17:41:09.105 INFO:tasks.rados.rados.0.trial082.stdout:2965: done (3 left) 2026-02-12T17:41:09.106 INFO:tasks.rados.rados.0.trial082.stdout:2966: done (2 left) 2026-02-12T17:41:09.106 INFO:tasks.rados.rados.0.trial082.stdout:2967: done (1 left) 2026-02-12T17:41:09.106 INFO:tasks.rados.rados.0.trial082.stdout:2968: done (0 left) 2026-02-12T17:41:09.106 INFO:tasks.rados.rados.0.trial082.stdout:2969: snap_create 2026-02-12T17:41:10.106 INFO:tasks.rados.rados.0.trial082.stdout:2969: done (0 left) 2026-02-12T17:41:10.106 INFO:tasks.rados.rados.0.trial082.stdout:2970: copy_from oid 8 from oid 40 current snap is 316 2026-02-12T17:41:10.106 INFO:tasks.rados.rados.0.trial082.stdout:2971: read oid 30 snap 310 2026-02-12T17:41:10.106 INFO:tasks.rados.rados.0.trial082.stdout:2971: expect (ObjNum 976 snap 303 seq_num 976) 2026-02-12T17:41:10.106 INFO:tasks.rados.rados.0.trial082.stdout:2972: write oid 39 current snap is 316 2026-02-12T17:41:10.106 INFO:tasks.rados.rados.0.trial082.stdout:2972: seq_num 1010 ranges {575070=560086,1686225=566019,2869458=105612} 2026-02-12T17:41:10.110 INFO:tasks.rados.rados.0.trial082.stdout:2972: writing trial08226312-39 from 575070 to 1135156 tid 1 2026-02-12T17:41:10.115 INFO:tasks.rados.rados.0.trial082.stdout:2972: writing trial08226312-39 from 1686225 to 2252244 tid 2 2026-02-12T17:41:10.117 INFO:tasks.rados.rados.0.trial082.stdout:2972: writing trial08226312-39 from 2869458 to 2975070 tid 3 2026-02-12T17:41:10.117 INFO:tasks.rados.rados.0.trial082.stdout:2973: snap_remove snap 315 2026-02-12T17:41:11.113 INFO:tasks.rados.rados.0.trial082.stdout:2973: done (3 left) 2026-02-12T17:41:11.113 INFO:tasks.rados.rados.0.trial082.stdout:2974: write oid 47 current snap is 316 2026-02-12T17:41:11.113 INFO:tasks.rados.rados.0.trial082.stdout:2974: seq_num 1011 ranges {591877=635335,1628354=709677} 2026-02-12T17:41:11.117 INFO:tasks.rados.rados.0.trial082.stdout:2974: writing trial08226312-47 from 591877 to 1227212 tid 1 2026-02-12T17:41:11.122 INFO:tasks.rados.rados.0.trial082.stdout:2974: writing trial08226312-47 from 1628354 to 2338031 tid 2 2026-02-12T17:41:11.122 INFO:tasks.rados.rados.0.trial082.stdout:2975: copy_from oid 25 from oid 3 current snap is 316 2026-02-12T17:41:11.122 INFO:tasks.rados.rados.0.trial082.stdout:2971: expect (ObjNum 976 snap 303 seq_num 976) 2026-02-12T17:41:11.146 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2113315 2026-02-12T17:41:11.152 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:11.226 INFO:tasks.rados.rados.0.trial082.stdout:2972: finishing write tid 1 to trial08226312-39 2026-02-12T17:41:11.226 INFO:tasks.rados.rados.0.trial082.stdout:2971: done (4 left) 2026-02-12T17:41:11.226 INFO:tasks.rados.rados.0.trial082.stdout:2976: read oid 34 snap -1 2026-02-12T17:41:11.226 INFO:tasks.rados.rados.0.trial082.stdout:2976: expect deleted 2026-02-12T17:41:11.226 INFO:tasks.rados.rados.0.trial082.stdout:2977: snap_create 2026-02-12T17:41:11.226 INFO:tasks.rados.rados.0.trial082.stdout:2972: finishing write tid 2 to trial08226312-39 2026-02-12T17:41:11.226 INFO:tasks.rados.rados.0.trial082.stdout:2970: finishing copy_from racing read to trial08226312-8 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2970: finishing copy_from to trial08226312-8 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1895 (ObjNum 978 snap 303 seq_num 978) dirty exists 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2972: finishing write tid 3 to trial08226312-39 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2972: finishing write tid 4 to trial08226312-39 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2972: finishing write tid 5 to trial08226312-39 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2972: oid 39 updating version 0 to 2214 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2972: oid 39 updating version 2214 to 2217 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2972: oid 39 version 2217 is already newer than 2216 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2972: oid 39 version 2217 is already newer than 2215 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 2217 (ObjNum 1010 snap 316 seq_num 1010) dirty exists 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2972: left oid 39 (ObjNum 1010 snap 316 seq_num 1010) 2026-02-12T17:41:11.227 INFO:tasks.rados.rados.0.trial082.stdout:2974: finishing write tid 1 to trial08226312-47 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:2974: finishing write tid 2 to trial08226312-47 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:2974: finishing write tid 3 to trial08226312-47 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:2974: finishing write tid 4 to trial08226312-47 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:2974: oid 47 updating version 0 to 2310 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:2974: oid 47 version 2310 is already newer than 2307 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:2974: oid 47 updating version 2310 to 2311 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 2311 (ObjNum 1011 snap 316 seq_num 1011) dirty exists 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:2974: left oid 47 (ObjNum 1011 snap 316 seq_num 1011) 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:2975: finishing copy_from racing read to trial08226312-25 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:2975: finishing copy_from to trial08226312-25 2026-02-12T17:41:11.228 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 1260 (ObjNum 806 snap 251 seq_num 806) dirty exists 2026-02-12T17:41:12.126 INFO:tasks.rados.rados.0.trial082.stdout:2970: done (5 left) 2026-02-12T17:41:12.127 INFO:tasks.rados.rados.0.trial082.stdout:2972: done (4 left) 2026-02-12T17:41:12.127 INFO:tasks.rados.rados.0.trial082.stdout:2974: done (3 left) 2026-02-12T17:41:12.127 INFO:tasks.rados.rados.0.trial082.stdout:2975: done (2 left) 2026-02-12T17:41:12.127 INFO:tasks.rados.rados.0.trial082.stdout:2976: done (1 left) 2026-02-12T17:41:12.127 INFO:tasks.rados.rados.0.trial082.stdout:2977: done (0 left) 2026-02-12T17:41:12.127 INFO:tasks.rados.rados.0.trial082.stdout:2978: snap_create 2026-02-12T17:41:13.097 INFO:tasks.rados.rados.0.trial082.stdout:2978: done (0 left) 2026-02-12T17:41:13.097 INFO:tasks.rados.rados.0.trial082.stdout:2979: snap_remove snap 311 2026-02-12T17:41:14.098 INFO:tasks.rados.rados.0.trial082.stdout:2979: done (0 left) 2026-02-12T17:41:14.098 INFO:tasks.rados.rados.0.trial082.stdout:2980: delete oid 7 current snap is 318 2026-02-12T17:41:14.101 INFO:tasks.rados.rados.0.trial082.stdout:2980: done (0 left) 2026-02-12T17:41:14.102 INFO:tasks.rados.rados.0.trial082.stdout:2981: snap_remove snap 304 2026-02-12T17:41:15.100 INFO:tasks.rados.rados.0.trial082.stdout:2981: done (0 left) 2026-02-12T17:41:15.100 INFO:tasks.rados.rados.0.trial082.stdout:2982: snap_create 2026-02-12T17:41:16.102 INFO:tasks.rados.rados.0.trial082.stdout:2982: done (0 left) 2026-02-12T17:41:16.102 INFO:tasks.rados.rados.0.trial082.stdout:2983: copy_from oid 30 from oid 21 current snap is 319 2026-02-12T17:41:16.102 INFO:tasks.rados.rados.0.trial082.stdout:2984: rollback oid 2 current snap is 319 2026-02-12T17:41:16.102 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 309 2026-02-12T17:41:16.102 INFO:tasks.rados.rados.0.trial082.stdout:2985: copy_from oid 10 from oid 37 current snap is 319 2026-02-12T17:41:16.103 INFO:tasks.rados.rados.0.trial082.stdout:2986: copy_from oid 35 from oid 3 current snap is 319 2026-02-12T17:41:16.103 INFO:tasks.rados.rados.0.trial082.stdout:2987: copy_from oid 42 from oid 16 current snap is 319 2026-02-12T17:41:16.103 INFO:tasks.rados.rados.0.trial082.stdout:2988: snap_create 2026-02-12T17:41:16.103 INFO:tasks.rados.rados.0.trial082.stdout:2987: finishing copy_from to trial08226312-42 2026-02-12T17:41:16.103 INFO:tasks.rados.rados.0.trial082.stdout:2987: got expected ENOENT (src dne) 2026-02-12T17:41:16.103 INFO:tasks.rados.rados.0.trial082.stdout:2987: finishing copy_from racing read to trial08226312-42 2026-02-12T17:41:16.104 INFO:tasks.rados.rados.0.trial082.stdout:2984: finishing rollback tid 0 to trial08226312-2 2026-02-12T17:41:16.104 INFO:tasks.rados.rados.0.trial082.stdout:2984: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:41:16.104 INFO:tasks.rados.rados.0.trial082.stdout:2984: finishing rollback tid 2 to trial08226312-2 2026-02-12T17:41:16.104 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 2220 (ObjNum 955 snap 297 seq_num 955) dirty exists 2026-02-12T17:41:16.112 INFO:tasks.rados.rados.0.trial082.stdout:2986: finishing copy_from racing read to trial08226312-35 2026-02-12T17:41:16.113 INFO:tasks.rados.rados.0.trial082.stdout:2986: finishing copy_from to trial08226312-35 2026-02-12T17:41:16.113 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1260 (ObjNum 806 snap 251 seq_num 806) dirty exists 2026-02-12T17:41:16.114 INFO:tasks.rados.rados.0.trial082.stdout:2983: finishing copy_from racing read to trial08226312-30 2026-02-12T17:41:16.114 INFO:tasks.rados.rados.0.trial082.stdout:2985: finishing copy_from racing read to trial08226312-10 2026-02-12T17:41:16.115 INFO:tasks.rados.rados.0.trial082.stdout:2985: finishing copy_from to trial08226312-10 2026-02-12T17:41:16.115 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 1971 (ObjNum 970 snap 301 seq_num 970) dirty exists 2026-02-12T17:41:16.115 INFO:tasks.rados.rados.0.trial082.stdout:2983: finishing copy_from to trial08226312-30 2026-02-12T17:41:16.116 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2221 (ObjNum 987 snap 304 seq_num 987) dirty exists 2026-02-12T17:41:17.104 INFO:tasks.rados.rados.0.trial082.stdout:2983: done (5 left) 2026-02-12T17:41:17.104 INFO:tasks.rados.rados.0.trial082.stdout:2984: done (4 left) 2026-02-12T17:41:17.104 INFO:tasks.rados.rados.0.trial082.stdout:2985: done (3 left) 2026-02-12T17:41:17.104 INFO:tasks.rados.rados.0.trial082.stdout:2986: done (2 left) 2026-02-12T17:41:17.104 INFO:tasks.rados.rados.0.trial082.stdout:2987: done (1 left) 2026-02-12T17:41:17.104 INFO:tasks.rados.rados.0.trial082.stdout:2988: done (0 left) 2026-02-12T17:41:17.105 INFO:tasks.rados.rados.0.trial082.stdout:2989: delete oid 5 current snap is 320 2026-02-12T17:41:17.106 INFO:tasks.rados.rados.0.trial082.stdout:2989: done (0 left) 2026-02-12T17:41:17.107 INFO:tasks.rados.rados.0.trial082.stdout:2990: write oid 29 current snap is 320 2026-02-12T17:41:17.107 INFO:tasks.rados.rados.0.trial082.stdout:2990: seq_num 1014 ranges {642298=577435,1920153=573357,2979150=63148} 2026-02-12T17:41:17.111 INFO:tasks.rados.rados.0.trial082.stdout:2990: writing trial08226312-29 from 642298 to 1219733 tid 1 2026-02-12T17:41:17.116 INFO:tasks.rados.rados.0.trial082.stdout:2990: writing trial08226312-29 from 1920153 to 2493510 tid 2 2026-02-12T17:41:17.118 INFO:tasks.rados.rados.0.trial082.stdout:2990: writing trial08226312-29 from 2979150 to 3042298 tid 3 2026-02-12T17:41:17.118 INFO:tasks.rados.rados.0.trial082.stdout:2991: snap_create 2026-02-12T17:41:17.118 INFO:tasks.rados.rados.0.trial082.stdout:2990: finishing write tid 1 to trial08226312-29 2026-02-12T17:41:17.118 INFO:tasks.rados.rados.0.trial082.stdout:2990: finishing write tid 2 to trial08226312-29 2026-02-12T17:41:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2990: finishing write tid 3 to trial08226312-29 2026-02-12T17:41:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2990: finishing write tid 4 to trial08226312-29 2026-02-12T17:41:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2990: finishing write tid 5 to trial08226312-29 2026-02-12T17:41:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2990: oid 29 updating version 0 to 2215 2026-02-12T17:41:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2990: oid 29 version 2215 is already newer than 2214 2026-02-12T17:41:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2990: oid 29 version 2215 is already newer than 2213 2026-02-12T17:41:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2990: oid 29 updating version 2215 to 2216 2026-02-12T17:41:17.119 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2216 (ObjNum 1014 snap 320 seq_num 1014) dirty exists 2026-02-12T17:41:17.119 INFO:tasks.rados.rados.0.trial082.stdout:2990: left oid 29 (ObjNum 1014 snap 320 seq_num 1014) 2026-02-12T17:41:18.108 INFO:tasks.rados.rados.0.trial082.stdout:2990: done (1 left) 2026-02-12T17:41:18.108 INFO:tasks.rados.rados.0.trial082.stdout:2991: done (0 left) 2026-02-12T17:41:18.108 INFO:tasks.rados.rados.0.trial082.stdout:2992: snap_remove snap 313 2026-02-12T17:41:19.110 INFO:tasks.rados.rados.0.trial082.stdout:2992: done (0 left) 2026-02-12T17:41:19.110 INFO:tasks.rados.rados.0.trial082.stdout:2993: snap_remove snap 301 2026-02-12T17:41:20.110 INFO:tasks.rados.rados.0.trial082.stdout:2993: done (0 left) 2026-02-12T17:41:20.110 INFO:tasks.rados.rados.0.trial082.stdout:2994: write (excl) oid 35 current snap is 321 2026-02-12T17:41:20.111 INFO:tasks.rados.rados.0.trial082.stdout:2994: seq_num 1015 ranges {659105=652684,1862282=717015} 2026-02-12T17:41:20.116 INFO:tasks.rados.rados.0.trial082.stdout:2994: writing trial08226312-35 from 659105 to 1311789 tid 1 2026-02-12T17:41:20.121 INFO:tasks.rados.rados.0.trial082.stdout:2994: writing trial08226312-35 from 1862282 to 2579297 tid 2 2026-02-12T17:41:20.121 INFO:tasks.rados.rados.0.trial082.stdout:2995: read oid 9 snap 320 2026-02-12T17:41:20.121 INFO:tasks.rados.rados.0.trial082.stdout:2995: expect (ObjNum 956 snap 298 seq_num 956) 2026-02-12T17:41:20.122 INFO:tasks.rados.rados.0.trial082.stdout:2996: write (excl) oid 12 current snap is 321 2026-02-12T17:41:20.122 INFO:tasks.rados.rados.0.trial082.stdout:2996: seq_num 1016 ranges {675912=727933,1920764=460673,2801290=274622} 2026-02-12T17:41:20.126 INFO:tasks.rados.rados.0.trial082.stdout:2996: writing trial08226312-12 from 675912 to 1403845 tid 1 2026-02-12T17:41:20.130 INFO:tasks.rados.rados.0.trial082.stdout:2996: writing trial08226312-12 from 1920764 to 2381437 tid 2 2026-02-12T17:41:20.133 INFO:tasks.rados.rados.0.trial082.stdout:2996: writing trial08226312-12 from 2801290 to 3075912 tid 3 2026-02-12T17:41:20.133 INFO:tasks.rados.rados.0.trial082.stdout:2997: delete oid 25 current snap is 321 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:2994: finishing write tid 1 to trial08226312-35 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:2994: finishing write tid 2 to trial08226312-35 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:2994: finishing write tid 3 to trial08226312-35 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:2994: finishing write tid 4 to trial08226312-35 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:2994: oid 35 updating version 0 to 1913 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:2994: oid 35 updating version 1913 to 1915 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:2994: oid 35 version 1915 is already newer than 1914 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1915 (ObjNum 1015 snap 321 seq_num 1015) dirty exists 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:2994: left oid 35 (ObjNum 1015 snap 321 seq_num 1015) 2026-02-12T17:41:20.134 INFO:tasks.rados.rados.0.trial082.stdout:2995: expect (ObjNum 956 snap 298 seq_num 956) 2026-02-12T17:41:20.137 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 945319 2026-02-12T17:41:20.147 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1378877 2026-02-12T17:41:20.155 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 51237 2026-02-12T17:41:20.170 INFO:tasks.rados.rados.0.trial082.stdout:2996: finishing write tid 1 to trial08226312-12 2026-02-12T17:41:20.170 INFO:tasks.rados.rados.0.trial082.stdout:2996: finishing write tid 2 to trial08226312-12 2026-02-12T17:41:20.170 INFO:tasks.rados.rados.0.trial082.stdout:2994: done (3 left) 2026-02-12T17:41:20.170 INFO:tasks.rados.rados.0.trial082.stdout:2995: done (2 left) 2026-02-12T17:41:20.170 INFO:tasks.rados.rados.0.trial082.stdout:2997: done (1 left) 2026-02-12T17:41:20.170 INFO:tasks.rados.rados.0.trial082.stdout:2998: delete oid 10 current snap is 321 2026-02-12T17:41:20.170 INFO:tasks.rados.rados.0.trial082.stdout:2996: finishing write tid 3 to trial08226312-12 2026-02-12T17:41:20.170 INFO:tasks.rados.rados.0.trial082.stdout:2996: finishing write tid 4 to trial08226312-12 2026-02-12T17:41:20.170 INFO:tasks.rados.rados.0.trial082.stdout:2996: finishing write tid 5 to trial08226312-12 2026-02-12T17:41:20.171 INFO:tasks.rados.rados.0.trial082.stdout:2996: oid 12 updating version 0 to 1979 2026-02-12T17:41:20.171 INFO:tasks.rados.rados.0.trial082.stdout:2996: oid 12 version 1979 is already newer than 1976 2026-02-12T17:41:20.171 INFO:tasks.rados.rados.0.trial082.stdout:2996: oid 12 version 1979 is already newer than 1977 2026-02-12T17:41:20.171 INFO:tasks.rados.rados.0.trial082.stdout:2996: oid 12 version 1979 is already newer than 1978 2026-02-12T17:41:20.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1979 (ObjNum 1016 snap 321 seq_num 1016) dirty exists 2026-02-12T17:41:20.171 INFO:tasks.rados.rados.0.trial082.stdout:2996: left oid 12 (ObjNum 1016 snap 321 seq_num 1016) 2026-02-12T17:41:20.171 INFO:tasks.rados.rados.0.trial082.stdout:2996: done (1 left) 2026-02-12T17:41:20.172 INFO:tasks.rados.rados.0.trial082.stdout:2998: done (0 left) 2026-02-12T17:41:20.172 INFO:tasks.rados.rados.0.trial082.stdout:2999: delete oid 3 current snap is 321 2026-02-12T17:41:20.172 INFO:tasks.rados.rados.0.trial082.stdout:2999: done (0 left) 2026-02-12T17:41:20.172 INFO:tasks.rados.rados.0.trial082.stdout:3000: snap_remove snap 316 2026-02-12T17:41:21.116 INFO:tasks.rados.rados.0.trial082.stdout:3000: done (0 left) 2026-02-12T17:41:21.116 INFO:tasks.rados.rados.0.trial082.stdout:3001: read oid 14 snap -1 2026-02-12T17:41:21.116 INFO:tasks.rados.rados.0.trial082.stdout:3001: expect deleted 2026-02-12T17:41:21.116 INFO:tasks.rados.rados.0.trial082.stdout:3002: read oid 24 snap -1 2026-02-12T17:41:21.117 INFO:tasks.rados.rados.0.trial082.stdout:3002: expect (ObjNum 923 snap 290 seq_num 923) 2026-02-12T17:41:21.117 INFO:tasks.rados.rados.0.trial082.stdout:3003: read oid 13 snap -1 2026-02-12T17:41:21.117 INFO:tasks.rados.rados.0.trial082.stdout:3003: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:41:21.117 INFO:tasks.rados.rados.0.trial082.stdout:3004: write oid 15 current snap is 321 2026-02-12T17:41:21.117 INFO:tasks.rados.rados.0.trial082.stdout:3004: seq_num 1020 ranges {743140=745282,2154692=468011} 2026-02-12T17:41:21.122 INFO:tasks.rados.rados.0.trial082.stdout:3004: writing trial08226312-15 from 743140 to 1488422 tid 1 2026-02-12T17:41:21.126 INFO:tasks.rados.rados.0.trial082.stdout:3004: writing trial08226312-15 from 2154692 to 2622703 tid 2 2026-02-12T17:41:21.126 INFO:tasks.rados.rados.0.trial082.stdout:3005: write oid 45 current snap is 321 2026-02-12T17:41:21.127 INFO:tasks.rados.rados.0.trial082.stdout:3005: seq_num 1021 ranges {759947=420531,1813174=728022} 2026-02-12T17:41:21.131 INFO:tasks.rados.rados.0.trial082.stdout:3005: writing trial08226312-45 from 759947 to 1180478 tid 1 2026-02-12T17:41:21.136 INFO:tasks.rados.rados.0.trial082.stdout:3005: writing trial08226312-45 from 1813174 to 2541196 tid 2 2026-02-12T17:41:21.136 INFO:tasks.rados.rados.0.trial082.stdout:3006: rollback oid 37 current snap is 321 2026-02-12T17:41:21.136 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 37 to 314 2026-02-12T17:41:21.136 INFO:tasks.rados.rados.0.trial082.stdout:3002: expect (ObjNum 923 snap 290 seq_num 923) 2026-02-12T17:41:21.153 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:21.203 INFO:tasks.rados.rados.0.trial082.stdout:3003: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:41:21.231 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:21.288 INFO:tasks.rados.rados.0.trial082.stdout:3004: finishing write tid 1 to trial08226312-15 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:3004: finishing write tid 2 to trial08226312-15 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:3004: finishing write tid 3 to trial08226312-15 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:3001: done (5 left) 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:3002: done (4 left) 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:3003: done (3 left) 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:3007: rollback oid 33 current snap is 321 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 33 to 312 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:3004: finishing write tid 4 to trial08226312-15 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:3004: oid 15 updating version 0 to 1300 2026-02-12T17:41:21.289 INFO:tasks.rados.rados.0.trial082.stdout:3004: oid 15 updating version 1300 to 1301 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3004: oid 15 version 1301 is already newer than 1299 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 1301 (ObjNum 1020 snap 321 seq_num 1020) dirty exists 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3004: left oid 15 (ObjNum 1020 snap 321 seq_num 1020) 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3005: finishing write tid 1 to trial08226312-45 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3005: finishing write tid 2 to trial08226312-45 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3005: finishing write tid 3 to trial08226312-45 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3005: finishing write tid 4 to trial08226312-45 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3005: oid 45 updating version 0 to 1918 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3005: oid 45 version 1918 is already newer than 1916 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3005: oid 45 version 1918 is already newer than 1917 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1918 (ObjNum 1021 snap 321 seq_num 1021) dirty exists 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3005: left oid 45 (ObjNum 1021 snap 321 seq_num 1021) 2026-02-12T17:41:21.290 INFO:tasks.rados.rados.0.trial082.stdout:3006: finishing rollback tid 0 to trial08226312-37 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3006: finishing rollback tid 1 to trial08226312-37 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3006: finishing rollback tid 2 to trial08226312-37 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1982 (ObjNum 970 snap 301 seq_num 970) dirty exists 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3004: done (3 left) 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3005: done (2 left) 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3006: done (1 left) 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3008: copy_from oid 27 from oid 40 current snap is 321 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3009: rollback oid 10 current snap is 321 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 10 to 319 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3010: copy_from oid 25 from oid 13 current snap is 321 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3011: write oid 4 current snap is 321 2026-02-12T17:41:21.291 INFO:tasks.rados.rados.0.trial082.stdout:3011: seq_num 1022 ranges {776754=495780,1871656=471680,2965828=210926} 2026-02-12T17:41:21.293 INFO:tasks.rados.rados.0.trial082.stdout:3011: writing trial08226312-4 from 776754 to 1272534 tid 1 2026-02-12T17:41:21.297 INFO:tasks.rados.rados.0.trial082.stdout:3011: writing trial08226312-4 from 1871656 to 2343336 tid 2 2026-02-12T17:41:21.300 INFO:tasks.rados.rados.0.trial082.stdout:3011: writing trial08226312-4 from 2965828 to 3176754 tid 3 2026-02-12T17:41:21.300 INFO:tasks.rados.rados.0.trial082.stdout:3012: write oid 28 current snap is 321 2026-02-12T17:41:21.300 INFO:tasks.rados.rados.0.trial082.stdout:3012: seq_num 1023 ranges {793561=571029,1813785=731691,2993251=200310} 2026-02-12T17:41:21.305 INFO:tasks.rados.rados.0.trial082.stdout:3012: writing trial08226312-28 from 793561 to 1364590 tid 1 2026-02-12T17:41:21.309 INFO:tasks.rados.rados.0.trial082.stdout:3012: writing trial08226312-28 from 1813785 to 2545476 tid 2 2026-02-12T17:41:21.312 INFO:tasks.rados.rados.0.trial082.stdout:3012: writing trial08226312-28 from 2993251 to 3193561 tid 3 2026-02-12T17:41:21.312 INFO:tasks.rados.rados.0.trial082.stdout:3013: snap_remove snap 314 2026-02-12T17:41:22.121 INFO:tasks.rados.rados.0.trial082.stdout:3013: done (6 left) 2026-02-12T17:41:22.121 INFO:tasks.rados.rados.0.trial082.stdout:3014: copy_from oid 29 from oid 36 current snap is 321 2026-02-12T17:41:22.121 INFO:tasks.rados.rados.0.trial082.stdout:3009: finishing rollback tid 1 to trial08226312-10 2026-02-12T17:41:22.121 INFO:tasks.rados.rados.0.trial082.stdout:3007: finishing rollback tid 0 to trial08226312-33 2026-02-12T17:41:22.121 INFO:tasks.rados.rados.0.trial082.stdout:3009: finishing rollback tid 2 to trial08226312-10 2026-02-12T17:41:22.121 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2234 (ObjNum 970 snap 301 seq_num 970) dirty exists 2026-02-12T17:41:22.121 INFO:tasks.rados.rados.0.trial082.stdout:3007: finishing rollback tid 1 to trial08226312-33 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3007: finishing rollback tid 2 to trial08226312-33 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1985 (ObjNum 997 snap 309 seq_num 997) dirty exists 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3008: finishing copy_from racing read to trial08226312-27 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3010: finishing copy_from racing read to trial08226312-25 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3011: finishing write tid 1 to trial08226312-4 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3010: finishing copy_from to trial08226312-25 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 2206 (ObjNum 977 snap 303 seq_num 977) dirty exists 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3008: finishing copy_from to trial08226312-27 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 1895 (ObjNum 978 snap 303 seq_num 978) dirty exists 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3011: finishing write tid 2 to trial08226312-4 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3007: done (6 left) 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3008: done (5 left) 2026-02-12T17:41:22.122 INFO:tasks.rados.rados.0.trial082.stdout:3009: done (4 left) 2026-02-12T17:41:22.123 INFO:tasks.rados.rados.0.trial082.stdout:3010: done (3 left) 2026-02-12T17:41:22.123 INFO:tasks.rados.rados.0.trial082.stdout:3015: write (excl) oid 1 current snap is 321 2026-02-12T17:41:22.123 INFO:tasks.rados.rados.0.trial082.stdout:3015: seq_num 1024 ranges {410368=646278,1472267=475349,2504321=405600} 2026-02-12T17:41:22.124 INFO:tasks.rados.rados.0.trial082.stdout:3015: writing trial08226312-1 from 410368 to 1056646 tid 1 2026-02-12T17:41:22.127 INFO:tasks.rados.rados.0.trial082.stdout:3015: writing trial08226312-1 from 1472267 to 1947616 tid 2 2026-02-12T17:41:22.131 INFO:tasks.rados.rados.0.trial082.stdout:3015: writing trial08226312-1 from 2504321 to 2909921 tid 3 2026-02-12T17:41:22.131 INFO:tasks.rados.rados.0.trial082.stdout:3016: write oid 22 current snap is 321 2026-02-12T17:41:22.131 INFO:tasks.rados.rados.0.trial082.stdout:3011: finishing write tid 3 to trial08226312-4 2026-02-12T17:41:22.131 INFO:tasks.rados.rados.0.trial082.stdout:3011: finishing write tid 4 to trial08226312-4 2026-02-12T17:41:22.131 INFO:tasks.rados.rados.0.trial082.stdout:3016: seq_num 1025 ranges {427175=721527,1930749=735360} 2026-02-12T17:41:22.135 INFO:tasks.rados.rados.0.trial082.stdout:3016: writing trial08226312-22 from 427175 to 1148702 tid 1 2026-02-12T17:41:22.142 INFO:tasks.rados.rados.0.trial082.stdout:3016: writing trial08226312-22 from 1930749 to 2666109 tid 2 2026-02-12T17:41:22.142 INFO:tasks.rados.rados.0.trial082.stdout:3017: read oid 21 snap 318 2026-02-12T17:41:22.142 INFO:tasks.rados.rados.0.trial082.stdout:3017: expect (ObjNum 987 snap 304 seq_num 987) 2026-02-12T17:41:22.142 INFO:tasks.rados.rados.0.trial082.stdout:3018: snap_create 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3011: finishing write tid 5 to trial08226312-4 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3011: oid 4 updating version 0 to 2330 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3011: oid 4 updating version 2330 to 2332 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3011: oid 4 updating version 2332 to 2333 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3011: oid 4 version 2333 is already newer than 2331 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 2333 (ObjNum 1022 snap 321 seq_num 1022) dirty exists 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3011: left oid 4 (ObjNum 1022 snap 321 seq_num 1022) 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3012: finishing write tid 1 to trial08226312-28 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3012: finishing write tid 2 to trial08226312-28 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3012: finishing write tid 3 to trial08226312-28 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3012: finishing write tid 4 to trial08226312-28 2026-02-12T17:41:22.143 INFO:tasks.rados.rados.0.trial082.stdout:3012: finishing write tid 5 to trial08226312-28 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3012: oid 28 updating version 0 to 1901 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3012: oid 28 updating version 1901 to 1903 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3012: oid 28 version 1903 is already newer than 1900 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3012: oid 28 version 1903 is already newer than 1902 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1903 (ObjNum 1023 snap 321 seq_num 1023) dirty exists 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3012: left oid 28 (ObjNum 1023 snap 321 seq_num 1023) 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3015: finishing write tid 1 to trial08226312-1 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3015: finishing write tid 2 to trial08226312-1 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3014: finishing copy_from racing read to trial08226312-29 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3014: finishing copy_from to trial08226312-29 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 1912 (ObjNum 998 snap 309 seq_num 998) dirty exists 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3015: finishing write tid 3 to trial08226312-1 2026-02-12T17:41:22.144 INFO:tasks.rados.rados.0.trial082.stdout:3015: finishing write tid 4 to trial08226312-1 2026-02-12T17:41:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3015: finishing write tid 5 to trial08226312-1 2026-02-12T17:41:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3015: oid 1 updating version 0 to 2130 2026-02-12T17:41:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3015: oid 1 updating version 2130 to 2131 2026-02-12T17:41:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3015: oid 1 updating version 2131 to 2132 2026-02-12T17:41:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3015: oid 1 updating version 2132 to 2133 2026-02-12T17:41:22.145 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2133 (ObjNum 1024 snap 321 seq_num 1024) dirty exists 2026-02-12T17:41:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3015: left oid 1 (ObjNum 1024 snap 321 seq_num 1024) 2026-02-12T17:41:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3016: finishing write tid 1 to trial08226312-22 2026-02-12T17:41:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3017: expect (ObjNum 987 snap 304 seq_num 987) 2026-02-12T17:41:22.234 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 969258 2026-02-12T17:41:22.267 INFO:tasks.rados.rados.0.trial082.stdout:3016: finishing write tid 2 to trial08226312-22 2026-02-12T17:41:22.268 INFO:tasks.rados.rados.0.trial082.stdout:3016: finishing write tid 3 to trial08226312-22 2026-02-12T17:41:22.268 INFO:tasks.rados.rados.0.trial082.stdout:3016: finishing write tid 4 to trial08226312-22 2026-02-12T17:41:22.268 INFO:tasks.rados.rados.0.trial082.stdout:3016: oid 22 updating version 0 to 2236 2026-02-12T17:41:22.268 INFO:tasks.rados.rados.0.trial082.stdout:3016: oid 22 version 2236 is already newer than 2235 2026-02-12T17:41:22.268 INFO:tasks.rados.rados.0.trial082.stdout:3016: oid 22 updating version 2236 to 2237 2026-02-12T17:41:22.268 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2237 (ObjNum 1025 snap 321 seq_num 1025) dirty exists 2026-02-12T17:41:22.268 INFO:tasks.rados.rados.0.trial082.stdout:3016: left oid 22 (ObjNum 1025 snap 321 seq_num 1025) 2026-02-12T17:41:23.100 INFO:tasks.rados.rados.0.trial082.stdout:3011: done (6 left) 2026-02-12T17:41:23.100 INFO:tasks.rados.rados.0.trial082.stdout:3012: done (5 left) 2026-02-12T17:41:23.100 INFO:tasks.rados.rados.0.trial082.stdout:3014: done (4 left) 2026-02-12T17:41:23.100 INFO:tasks.rados.rados.0.trial082.stdout:3015: done (3 left) 2026-02-12T17:41:23.101 INFO:tasks.rados.rados.0.trial082.stdout:3016: done (2 left) 2026-02-12T17:41:23.101 INFO:tasks.rados.rados.0.trial082.stdout:3017: done (1 left) 2026-02-12T17:41:23.101 INFO:tasks.rados.rados.0.trial082.stdout:3018: done (0 left) 2026-02-12T17:41:23.101 INFO:tasks.rados.rados.0.trial082.stdout:3019: delete oid 10 current snap is 322 2026-02-12T17:41:23.102 INFO:tasks.rados.rados.0.trial082.stdout:3019: done (0 left) 2026-02-12T17:41:23.102 INFO:tasks.rados.rados.0.trial082.stdout:3020: copy_from oid 1 from oid 45 current snap is 322 2026-02-12T17:41:23.102 INFO:tasks.rados.rados.0.trial082.stdout:3021: delete oid 41 current snap is 322 2026-02-12T17:41:23.104 INFO:tasks.rados.rados.0.trial082.stdout:3021: done (1 left) 2026-02-12T17:41:23.104 INFO:tasks.rados.rados.0.trial082.stdout:3022: rollback oid 24 current snap is 322 2026-02-12T17:41:23.105 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 318 2026-02-12T17:41:23.105 INFO:tasks.rados.rados.0.trial082.stdout:3023: rollback oid 40 current snap is 322 2026-02-12T17:41:23.105 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 40 to 320 2026-02-12T17:41:23.105 INFO:tasks.rados.rados.0.trial082.stdout:3024: write (excl) oid 9 current snap is 322 2026-02-12T17:41:23.105 INFO:tasks.rados.rados.0.trial082.stdout:3024: seq_num 1028 ranges {477596=663627,1706195=482687,2614013=567041} 2026-02-12T17:41:23.108 INFO:tasks.rados.rados.0.trial082.stdout:3024: writing trial08226312-9 from 477596 to 1141223 tid 1 2026-02-12T17:41:23.112 INFO:tasks.rados.rados.0.trial082.stdout:3024: writing trial08226312-9 from 1706195 to 2188882 tid 2 2026-02-12T17:41:23.116 INFO:tasks.rados.rados.0.trial082.stdout:3024: writing trial08226312-9 from 2614013 to 3181054 tid 3 2026-02-12T17:41:23.117 INFO:tasks.rados.rados.0.trial082.stdout:3025: write oid 3 current snap is 322 2026-02-12T17:41:23.117 INFO:tasks.rados.rados.0.trial082.stdout:3022: finishing rollback tid 0 to trial08226312-24 2026-02-12T17:41:23.117 INFO:tasks.rados.rados.0.trial082.stdout:3025: seq_num 1029 ranges {494403=738876,1764677=626345,3041436=252967} 2026-02-12T17:41:23.121 INFO:tasks.rados.rados.0.trial082.stdout:3025: writing trial08226312-3 from 494403 to 1233279 tid 1 2026-02-12T17:41:23.125 INFO:tasks.rados.rados.0.trial082.stdout:3025: writing trial08226312-3 from 1764677 to 2391022 tid 2 2026-02-12T17:41:23.130 INFO:tasks.rados.rados.0.trial082.stdout:3025: writing trial08226312-3 from 3041436 to 3294403 tid 3 2026-02-12T17:41:23.130 INFO:tasks.rados.rados.0.trial082.stdout:3026: delete oid 39 current snap is 322 2026-02-12T17:41:23.130 INFO:tasks.rados.rados.0.trial082.stdout:3022: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:41:23.130 INFO:tasks.rados.rados.0.trial082.stdout:3023: finishing rollback tid 0 to trial08226312-40 2026-02-12T17:41:23.130 INFO:tasks.rados.rados.0.trial082.stdout:3022: finishing rollback tid 2 to trial08226312-24 2026-02-12T17:41:23.130 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 2339 (ObjNum 923 snap 290 seq_num 923) dirty exists 2026-02-12T17:41:23.130 INFO:tasks.rados.rados.0.trial082.stdout:3023: finishing rollback tid 1 to trial08226312-40 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3023: finishing rollback tid 2 to trial08226312-40 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 1906 (ObjNum 978 snap 303 seq_num 978) dirty exists 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3020: finishing copy_from racing read to trial08226312-1 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3020: finishing copy_from to trial08226312-1 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 1918 (ObjNum 1021 snap 321 seq_num 1021) dirty exists 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3024: finishing write tid 1 to trial08226312-9 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3024: finishing write tid 2 to trial08226312-9 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3024: finishing write tid 3 to trial08226312-9 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3024: finishing write tid 4 to trial08226312-9 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3024: finishing write tid 5 to trial08226312-9 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3024: oid 9 updating version 0 to 1907 2026-02-12T17:41:23.131 INFO:tasks.rados.rados.0.trial082.stdout:3024: oid 9 updating version 1907 to 1908 2026-02-12T17:41:23.132 INFO:tasks.rados.rados.0.trial082.stdout:3024: oid 9 updating version 1908 to 1909 2026-02-12T17:41:23.132 INFO:tasks.rados.rados.0.trial082.stdout:3024: oid 9 updating version 1909 to 1910 2026-02-12T17:41:23.132 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 1910 (ObjNum 1028 snap 322 seq_num 1028) dirty exists 2026-02-12T17:41:23.132 INFO:tasks.rados.rados.0.trial082.stdout:3024: left oid 9 (ObjNum 1028 snap 322 seq_num 1028) 2026-02-12T17:41:23.132 INFO:tasks.rados.rados.0.trial082.stdout:3025: finishing write tid 1 to trial08226312-3 2026-02-12T17:41:23.132 INFO:tasks.rados.rados.0.trial082.stdout:3025: finishing write tid 2 to trial08226312-3 2026-02-12T17:41:23.133 INFO:tasks.rados.rados.0.trial082.stdout:3020: done (5 left) 2026-02-12T17:41:23.133 INFO:tasks.rados.rados.0.trial082.stdout:3022: done (4 left) 2026-02-12T17:41:23.133 INFO:tasks.rados.rados.0.trial082.stdout:3023: done (3 left) 2026-02-12T17:41:23.133 INFO:tasks.rados.rados.0.trial082.stdout:3024: done (2 left) 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3026: done (1 left) 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3027: delete oid 16 current snap is 322 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3025: finishing write tid 3 to trial08226312-3 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3025: finishing write tid 4 to trial08226312-3 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3025: finishing write tid 5 to trial08226312-3 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3025: oid 3 updating version 0 to 1308 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3025: oid 3 updating version 1308 to 1310 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3025: oid 3 updating version 1310 to 1311 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3025: oid 3 version 1311 is already newer than 1309 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1311 (ObjNum 1029 snap 322 seq_num 1029) dirty exists 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3025: left oid 3 (ObjNum 1029 snap 322 seq_num 1029) 2026-02-12T17:41:23.134 INFO:tasks.rados.rados.0.trial082.stdout:3025: done (1 left) 2026-02-12T17:41:23.135 INFO:tasks.rados.rados.0.trial082.stdout:3027: done (0 left) 2026-02-12T17:41:23.135 INFO:tasks.rados.rados.0.trial082.stdout:3028: read oid 40 snap -1 2026-02-12T17:41:23.135 INFO:tasks.rados.rados.0.trial082.stdout:3028: expect (ObjNum 978 snap 303 seq_num 978) 2026-02-12T17:41:23.135 INFO:tasks.rados.rados.0.trial082.stdout:3029: snap_create 2026-02-12T17:41:23.142 INFO:tasks.rados.rados.0.trial082.stdout:3028: expect (ObjNum 978 snap 303 seq_num 978) 2026-02-12T17:41:23.142 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 83812 2026-02-12T17:41:24.124 INFO:tasks.rados.rados.0.trial082.stdout:3028: done (1 left) 2026-02-12T17:41:24.124 INFO:tasks.rados.rados.0.trial082.stdout:3029: done (0 left) 2026-02-12T17:41:24.124 INFO:tasks.rados.rados.0.trial082.stdout:3030: copy_from oid 11 from oid 24 current snap is 323 2026-02-12T17:41:24.124 INFO:tasks.rados.rados.0.trial082.stdout:3031: read oid 35 snap -1 2026-02-12T17:41:24.124 INFO:tasks.rados.rados.0.trial082.stdout:3031: expect (ObjNum 1015 snap 321 seq_num 1015) 2026-02-12T17:41:24.124 INFO:tasks.rados.rados.0.trial082.stdout:3032: read oid 12 snap -1 2026-02-12T17:41:24.124 INFO:tasks.rados.rados.0.trial082.stdout:3032: expect (ObjNum 1016 snap 321 seq_num 1016) 2026-02-12T17:41:24.125 INFO:tasks.rados.rados.0.trial082.stdout:3033: read oid 8 snap -1 2026-02-12T17:41:24.125 INFO:tasks.rados.rados.0.trial082.stdout:3033: expect (ObjNum 978 snap 303 seq_num 978) 2026-02-12T17:41:24.125 INFO:tasks.rados.rados.0.trial082.stdout:3034: read oid 14 snap -1 2026-02-12T17:41:24.125 INFO:tasks.rados.rados.0.trial082.stdout:3034: expect deleted 2026-02-12T17:41:24.125 INFO:tasks.rados.rados.0.trial082.stdout:3035: write oid 48 current snap is 323 2026-02-12T17:41:24.125 INFO:tasks.rados.rados.0.trial082.stdout:3035: seq_num 1032 ranges {544824=564623,1823770=490025,3007352=337472} 2026-02-12T17:41:24.127 INFO:tasks.rados.rados.0.trial082.stdout:3035: writing trial08226312-48 from 544824 to 1109447 tid 1 2026-02-12T17:41:24.132 INFO:tasks.rados.rados.0.trial082.stdout:3035: writing trial08226312-48 from 1823770 to 2313795 tid 2 2026-02-12T17:41:24.136 INFO:tasks.rados.rados.0.trial082.stdout:3035: writing trial08226312-48 from 3007352 to 3344824 tid 3 2026-02-12T17:41:24.136 INFO:tasks.rados.rados.0.trial082.stdout:3036: delete oid 29 current snap is 323 2026-02-12T17:41:24.136 INFO:tasks.rados.rados.0.trial082.stdout:3031: expect (ObjNum 1015 snap 321 seq_num 1015) 2026-02-12T17:41:24.295 INFO:tasks.rados.rados.0.trial082.stdout:3032: expect (ObjNum 1016 snap 321 seq_num 1016) 2026-02-12T17:41:24.305 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1559986 2026-02-12T17:41:24.362 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2925907 2026-02-12T17:41:24.398 INFO:tasks.rados.rados.0.trial082.stdout:3033: expect (ObjNum 978 snap 303 seq_num 978) 2026-02-12T17:41:24.399 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 526057 2026-02-12T17:41:24.459 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:24.492 INFO:tasks.rados.rados.0.trial082.stdout:3035: finishing write tid 1 to trial08226312-48 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3035: finishing write tid 2 to trial08226312-48 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3030: finishing copy_from racing read to trial08226312-11 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3035: finishing write tid 3 to trial08226312-48 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3035: finishing write tid 4 to trial08226312-48 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3035: finishing write tid 5 to trial08226312-48 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3035: oid 48 updating version 0 to 1613 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3035: oid 48 version 1613 is already newer than 1612 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3035: oid 48 version 1613 is already newer than 1611 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3035: oid 48 version 1613 is already newer than 1610 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1613 (ObjNum 1032 snap 323 seq_num 1032) dirty exists 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3035: left oid 48 (ObjNum 1032 snap 323 seq_num 1032) 2026-02-12T17:41:24.493 INFO:tasks.rados.rados.0.trial082.stdout:3030: finishing copy_from to trial08226312-11 2026-02-12T17:41:24.494 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 2339 (ObjNum 923 snap 290 seq_num 923) dirty exists 2026-02-12T17:41:24.494 INFO:tasks.rados.rados.0.trial082.stdout:3030: done (6 left) 2026-02-12T17:41:24.494 INFO:tasks.rados.rados.0.trial082.stdout:3031: done (5 left) 2026-02-12T17:41:24.494 INFO:tasks.rados.rados.0.trial082.stdout:3032: done (4 left) 2026-02-12T17:41:24.494 INFO:tasks.rados.rados.0.trial082.stdout:3033: done (3 left) 2026-02-12T17:41:24.494 INFO:tasks.rados.rados.0.trial082.stdout:3034: done (2 left) 2026-02-12T17:41:24.494 INFO:tasks.rados.rados.0.trial082.stdout:3035: done (1 left) 2026-02-12T17:41:24.494 INFO:tasks.rados.rados.0.trial082.stdout:3036: done (0 left) 2026-02-12T17:41:24.494 INFO:tasks.rados.rados.0.trial082.stdout:3037: delete oid 27 current snap is 323 2026-02-12T17:41:24.495 INFO:tasks.rados.rados.0.trial082.stdout:3037: done (0 left) 2026-02-12T17:41:24.495 INFO:tasks.rados.rados.0.trial082.stdout:3038: rollback oid 47 current snap is 323 2026-02-12T17:41:24.495 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 47 to 317 2026-02-12T17:41:24.496 INFO:tasks.rados.rados.0.trial082.stdout:3039: read oid 25 snap 319 2026-02-12T17:41:24.496 INFO:tasks.rados.rados.0.trial082.stdout:3039: expect (ObjNum 806 snap 251 seq_num 806) 2026-02-12T17:41:24.496 INFO:tasks.rados.rados.0.trial082.stdout:3040: snap_create 2026-02-12T17:41:24.497 INFO:tasks.rados.rados.0.trial082.stdout:3038: finishing rollback tid 0 to trial08226312-47 2026-02-12T17:41:24.497 INFO:tasks.rados.rados.0.trial082.stdout:3038: finishing rollback tid 1 to trial08226312-47 2026-02-12T17:41:24.497 INFO:tasks.rados.rados.0.trial082.stdout:3038: finishing rollback tid 2 to trial08226312-47 2026-02-12T17:41:24.497 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 2343 (ObjNum 1011 snap 316 seq_num 1011) dirty exists 2026-02-12T17:41:24.501 INFO:tasks.rados.rados.0.trial082.stdout:3039: expect (ObjNum 806 snap 251 seq_num 806) 2026-02-12T17:41:24.528 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2158764 2026-02-12T17:41:24.552 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 726887 2026-02-12T17:41:25.128 INFO:tasks.rados.rados.0.trial082.stdout:3038: done (2 left) 2026-02-12T17:41:25.129 INFO:tasks.rados.rados.0.trial082.stdout:3039: done (1 left) 2026-02-12T17:41:25.129 INFO:tasks.rados.rados.0.trial082.stdout:3040: done (0 left) 2026-02-12T17:41:25.129 INFO:tasks.rados.rados.0.trial082.stdout:3041: rollback oid 44 current snap is 324 2026-02-12T17:41:25.129 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 283 2026-02-12T17:41:25.129 INFO:tasks.rados.rados.0.trial082.stdout:3042: delete oid 28 current snap is 324 2026-02-12T17:41:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3041: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:41:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3041: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:41:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3041: finishing rollback tid 2 to trial08226312-44 2026-02-12T17:41:25.132 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 1921 (ObjNum 851 snap 268 seq_num 851) dirty exists 2026-02-12T17:41:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3041: done (1 left) 2026-02-12T17:41:25.133 INFO:tasks.rados.rados.0.trial082.stdout:3042: done (0 left) 2026-02-12T17:41:25.133 INFO:tasks.rados.rados.0.trial082.stdout:3043: delete oid 20 current snap is 324 2026-02-12T17:41:25.133 INFO:tasks.rados.rados.0.trial082.stdout:3043: done (0 left) 2026-02-12T17:41:25.133 INFO:tasks.rados.rados.0.trial082.stdout:3044: rollback oid 43 current snap is 324 2026-02-12T17:41:25.134 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 43 to 317 2026-02-12T17:41:25.134 INFO:tasks.rados.rados.0.trial082.stdout:3045: snap_create 2026-02-12T17:41:25.135 INFO:tasks.rados.rados.0.trial082.stdout:3044: finishing rollback tid 0 to trial08226312-43 2026-02-12T17:41:25.136 INFO:tasks.rados.rados.0.trial082.stdout:3044: finishing rollback tid 1 to trial08226312-43 2026-02-12T17:41:25.136 INFO:tasks.rados.rados.0.trial082.stdout:3044: finishing rollback tid 2 to trial08226312-43 2026-02-12T17:41:25.136 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2241 (ObjNum 994 snap 307 seq_num 994) dirty exists 2026-02-12T17:41:26.131 INFO:tasks.rados.rados.0.trial082.stdout:3044: done (1 left) 2026-02-12T17:41:26.131 INFO:tasks.rados.rados.0.trial082.stdout:3045: done (0 left) 2026-02-12T17:41:26.131 INFO:tasks.rados.rados.0.trial082.stdout:3046: delete oid 33 current snap is 325 2026-02-12T17:41:26.134 INFO:tasks.rados.rados.0.trial082.stdout:3046: done (0 left) 2026-02-12T17:41:26.134 INFO:tasks.rados.rados.0.trial082.stdout:3047: write (excl) oid 3 current snap is 325 2026-02-12T17:41:26.134 INFO:tasks.rados.rados.0.trial082.stdout:3047: seq_num 1038 ranges {645666=732470,2174662=501032,3288243=157423} 2026-02-12T17:41:26.140 INFO:tasks.rados.rados.0.trial082.stdout:3047: writing trial08226312-3 from 645666 to 1378136 tid 1 2026-02-12T17:41:26.144 INFO:tasks.rados.rados.0.trial082.stdout:3047: writing trial08226312-3 from 2174662 to 2675694 tid 2 2026-02-12T17:41:26.147 INFO:tasks.rados.rados.0.trial082.stdout:3047: writing trial08226312-3 from 3288243 to 3445666 tid 3 2026-02-12T17:41:26.147 INFO:tasks.rados.rados.0.trial082.stdout:3048: snap_remove snap 320 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3048: done (1 left) 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3049: copy_from oid 46 from oid 9 current snap is 325 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3047: finishing write tid 1 to trial08226312-3 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3047: finishing write tid 2 to trial08226312-3 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3047: finishing write tid 3 to trial08226312-3 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3047: finishing write tid 4 to trial08226312-3 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3047: finishing write tid 5 to trial08226312-3 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3047: oid 3 updating version 0 to 1314 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3047: oid 3 version 1314 is already newer than 1313 2026-02-12T17:41:27.133 INFO:tasks.rados.rados.0.trial082.stdout:3047: oid 3 updating version 1314 to 1316 2026-02-12T17:41:27.134 INFO:tasks.rados.rados.0.trial082.stdout:3047: oid 3 version 1316 is already newer than 1315 2026-02-12T17:41:27.134 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1316 (ObjNum 1038 snap 325 seq_num 1038) dirty exists 2026-02-12T17:41:27.134 INFO:tasks.rados.rados.0.trial082.stdout:3047: left oid 3 (ObjNum 1038 snap 325 seq_num 1038) 2026-02-12T17:41:27.134 INFO:tasks.rados.rados.0.trial082.stdout:3047: done (1 left) 2026-02-12T17:41:27.134 INFO:tasks.rados.rados.0.trial082.stdout:3050: write (excl) oid 15 current snap is 325 2026-02-12T17:41:27.134 INFO:tasks.rados.rados.0.trial082.stdout:3050: seq_num 1039 ranges {662473=407719,1833144=644690,3199313=263160} 2026-02-12T17:41:27.136 INFO:tasks.rados.rados.0.trial082.stdout:3050: writing trial08226312-15 from 662473 to 1070192 tid 1 2026-02-12T17:41:27.141 INFO:tasks.rados.rados.0.trial082.stdout:3050: writing trial08226312-15 from 1833144 to 2477834 tid 2 2026-02-12T17:41:27.145 INFO:tasks.rados.rados.0.trial082.stdout:3050: writing trial08226312-15 from 3199313 to 3462473 tid 3 2026-02-12T17:41:27.145 INFO:tasks.rados.rados.0.trial082.stdout:3051: write (excl) oid 6 current snap is 325 2026-02-12T17:41:27.145 INFO:tasks.rados.rados.0.trial082.stdout:3051: seq_num 1040 ranges {679280=482968,1775273=788348,3110383=368897} 2026-02-12T17:41:27.150 INFO:tasks.rados.rados.0.trial082.stdout:3051: writing trial08226312-6 from 679280 to 1162248 tid 1 2026-02-12T17:41:27.155 INFO:tasks.rados.rados.0.trial082.stdout:3051: writing trial08226312-6 from 1775273 to 2563621 tid 2 2026-02-12T17:41:27.159 INFO:tasks.rados.rados.0.trial082.stdout:3051: writing trial08226312-6 from 3110383 to 3479280 tid 3 2026-02-12T17:41:27.159 INFO:tasks.rados.rados.0.trial082.stdout:3052: rollback oid 17 current snap is 325 2026-02-12T17:41:27.159 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 303 2026-02-12T17:41:27.159 INFO:tasks.rados.rados.0.trial082.stdout:3050: finishing write tid 1 to trial08226312-15 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3053: delete oid 29 current snap is 325 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3049: finishing copy_from racing read to trial08226312-46 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3049: finishing copy_from to trial08226312-46 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 1910 (ObjNum 1028 snap 322 seq_num 1028) dirty exists 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3050: finishing write tid 2 to trial08226312-15 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3050: finishing write tid 3 to trial08226312-15 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3050: finishing write tid 4 to trial08226312-15 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3050: finishing write tid 5 to trial08226312-15 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3050: oid 15 updating version 0 to 1325 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3050: oid 15 version 1325 is already newer than 1323 2026-02-12T17:41:27.160 INFO:tasks.rados.rados.0.trial082.stdout:3050: oid 15 version 1325 is already newer than 1324 2026-02-12T17:41:27.161 INFO:tasks.rados.rados.0.trial082.stdout:3050: oid 15 version 1325 is already newer than 1322 2026-02-12T17:41:27.161 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 1325 (ObjNum 1039 snap 325 seq_num 1039) dirty exists 2026-02-12T17:41:27.161 INFO:tasks.rados.rados.0.trial082.stdout:3050: left oid 15 (ObjNum 1039 snap 325 seq_num 1039) 2026-02-12T17:41:27.161 INFO:tasks.rados.rados.0.trial082.stdout:3051: finishing write tid 1 to trial08226312-6 2026-02-12T17:41:27.161 INFO:tasks.rados.rados.0.trial082.stdout:3051: finishing write tid 2 to trial08226312-6 2026-02-12T17:41:27.161 INFO:tasks.rados.rados.0.trial082.stdout:3052: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:41:27.161 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 0 (ObjNum 33 snap 0 seq_num 26820640) dirty dne 2026-02-12T17:41:27.162 INFO:tasks.rados.rados.0.trial082.stdout:3051: finishing write tid 3 to trial08226312-6 2026-02-12T17:41:27.163 INFO:tasks.rados.rados.0.trial082.stdout:3051: finishing write tid 4 to trial08226312-6 2026-02-12T17:41:27.163 INFO:tasks.rados.rados.0.trial082.stdout:3051: finishing write tid 5 to trial08226312-6 2026-02-12T17:41:27.163 INFO:tasks.rados.rados.0.trial082.stdout:3051: oid 6 updating version 0 to 2218 2026-02-12T17:41:27.163 INFO:tasks.rados.rados.0.trial082.stdout:3051: oid 6 updating version 2218 to 2221 2026-02-12T17:41:27.163 INFO:tasks.rados.rados.0.trial082.stdout:3051: oid 6 version 2221 is already newer than 2219 2026-02-12T17:41:27.163 INFO:tasks.rados.rados.0.trial082.stdout:3051: oid 6 version 2221 is already newer than 2220 2026-02-12T17:41:27.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 2221 (ObjNum 1040 snap 325 seq_num 1040) dirty exists 2026-02-12T17:41:27.163 INFO:tasks.rados.rados.0.trial082.stdout:3051: left oid 6 (ObjNum 1040 snap 325 seq_num 1040) 2026-02-12T17:41:27.163 INFO:tasks.rados.rados.0.trial082.stdout:3049: done (4 left) 2026-02-12T17:41:27.164 INFO:tasks.rados.rados.0.trial082.stdout:3050: done (3 left) 2026-02-12T17:41:27.164 INFO:tasks.rados.rados.0.trial082.stdout:3051: done (2 left) 2026-02-12T17:41:27.164 INFO:tasks.rados.rados.0.trial082.stdout:3052: done (1 left) 2026-02-12T17:41:27.164 INFO:tasks.rados.rados.0.trial082.stdout:3053: done (0 left) 2026-02-12T17:41:27.164 INFO:tasks.rados.rados.0.trial082.stdout:3054: write (excl) oid 16 current snap is 325 2026-02-12T17:41:27.164 INFO:tasks.rados.rados.0.trial082.stdout:3054: seq_num 1042 ranges {712894=749819,2008590=792017,3281582=231312} 2026-02-12T17:41:27.165 INFO:tasks.rados.rados.0.trial082.stdout:3054: writing trial08226312-16 from 712894 to 1462713 tid 1 2026-02-12T17:41:27.170 INFO:tasks.rados.rados.0.trial082.stdout:3054: writing trial08226312-16 from 2008590 to 2800607 tid 2 2026-02-12T17:41:27.174 INFO:tasks.rados.rados.0.trial082.stdout:3054: writing trial08226312-16 from 3281582 to 3512894 tid 3 2026-02-12T17:41:27.174 INFO:tasks.rados.rados.0.trial082.stdout:3055: rollback oid 35 current snap is 325 2026-02-12T17:41:27.174 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 35 to 318 2026-02-12T17:41:27.174 INFO:tasks.rados.rados.0.trial082.stdout:3054: finishing write tid 1 to trial08226312-16 2026-02-12T17:41:27.174 INFO:tasks.rados.rados.0.trial082.stdout:3054: finishing write tid 2 to trial08226312-16 2026-02-12T17:41:27.174 INFO:tasks.rados.rados.0.trial082.stdout:3056: read oid 33 snap -1 2026-02-12T17:41:27.174 INFO:tasks.rados.rados.0.trial082.stdout:3056: expect deleted 2026-02-12T17:41:27.174 INFO:tasks.rados.rados.0.trial082.stdout:3057: read oid 30 snap -1 2026-02-12T17:41:27.174 INFO:tasks.rados.rados.0.trial082.stdout:3057: expect (ObjNum 987 snap 304 seq_num 987) 2026-02-12T17:41:27.175 INFO:tasks.rados.rados.0.trial082.stdout:3058: copy_from oid 42 from oid 9 current snap is 325 2026-02-12T17:41:27.175 INFO:tasks.rados.rados.0.trial082.stdout:3059: snap_remove snap 308 2026-02-12T17:41:28.101 INFO:tasks.rados.rados.0.trial082.stdout:3059: done (5 left) 2026-02-12T17:41:28.101 INFO:tasks.rados.rados.0.trial082.stdout:3060: read oid 29 snap -1 2026-02-12T17:41:28.101 INFO:tasks.rados.rados.0.trial082.stdout:3060: expect deleted 2026-02-12T17:41:28.101 INFO:tasks.rados.rados.0.trial082.stdout:3061: write oid 3 current snap is 325 2026-02-12T17:41:28.101 INFO:tasks.rados.rados.0.trial082.stdout:3061: seq_num 1043 ranges {729701=425068,1667072=652028,2909005=485180} 2026-02-12T17:41:28.105 INFO:tasks.rados.rados.0.trial082.stdout:3061: writing trial08226312-3 from 729701 to 1154769 tid 1 2026-02-12T17:41:28.109 INFO:tasks.rados.rados.0.trial082.stdout:3061: writing trial08226312-3 from 1667072 to 2319100 tid 2 2026-02-12T17:41:28.113 INFO:tasks.rados.rados.0.trial082.stdout:3061: writing trial08226312-3 from 2909005 to 3394185 tid 3 2026-02-12T17:41:28.114 INFO:tasks.rados.rados.0.trial082.stdout:3062: read oid 20 snap 309 2026-02-12T17:41:28.114 INFO:tasks.rados.rados.0.trial082.stdout:3062: expect (ObjNum 942 snap 294 seq_num 942) 2026-02-12T17:41:28.114 INFO:tasks.rados.rados.0.trial082.stdout:3063: copy_from oid 47 from oid 32 current snap is 325 2026-02-12T17:41:28.114 INFO:tasks.rados.rados.0.trial082.stdout:3054: finishing write tid 3 to trial08226312-16 2026-02-12T17:41:28.114 INFO:tasks.rados.rados.0.trial082.stdout:3054: finishing write tid 4 to trial08226312-16 2026-02-12T17:41:28.114 INFO:tasks.rados.rados.0.trial082.stdout:3056: done (8 left) 2026-02-12T17:41:28.114 INFO:tasks.rados.rados.0.trial082.stdout:3064: write (excl) oid 24 current snap is 325 2026-02-12T17:41:28.114 INFO:tasks.rados.rados.0.trial082.stdout:3064: seq_num 1044 ranges {746508=500317,2009201=795686,3220075=326433} 2026-02-12T17:41:28.118 INFO:tasks.rados.rados.0.trial082.stdout:3064: writing trial08226312-24 from 746508 to 1246825 tid 1 2026-02-12T17:41:28.123 INFO:tasks.rados.rados.0.trial082.stdout:3064: writing trial08226312-24 from 2009201 to 2804887 tid 2 2026-02-12T17:41:28.126 INFO:tasks.rados.rados.0.trial082.stdout:3064: writing trial08226312-24 from 3220075 to 3546508 tid 3 2026-02-12T17:41:28.126 INFO:tasks.rados.rados.0.trial082.stdout:3065: write oid 10 current snap is 325 2026-02-12T17:41:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3065: seq_num 1045 ranges {763315=575566,2067683=655697,3247498=315817} 2026-02-12T17:41:28.131 INFO:tasks.rados.rados.0.trial082.stdout:3065: writing trial08226312-10 from 763315 to 1338881 tid 1 2026-02-12T17:41:28.136 INFO:tasks.rados.rados.0.trial082.stdout:3065: writing trial08226312-10 from 2067683 to 2723380 tid 2 2026-02-12T17:41:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3065: writing trial08226312-10 from 3247498 to 3563315 tid 3 2026-02-12T17:41:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3066: read oid 19 snap 324 2026-02-12T17:41:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3066: expect deleted 2026-02-12T17:41:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3067: rollback oid 28 current snap is 325 2026-02-12T17:41:28.140 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 324 2026-02-12T17:41:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3054: finishing write tid 5 to trial08226312-16 2026-02-12T17:41:28.141 INFO:tasks.rados.rados.0.trial082.stdout:3054: oid 16 updating version 0 to 1912 2026-02-12T17:41:28.141 INFO:tasks.rados.rados.0.trial082.stdout:3054: oid 16 updating version 1912 to 1913 2026-02-12T17:41:28.141 INFO:tasks.rados.rados.0.trial082.stdout:3054: oid 16 updating version 1913 to 1914 2026-02-12T17:41:28.141 INFO:tasks.rados.rados.0.trial082.stdout:3054: oid 16 updating version 1914 to 1915 2026-02-12T17:41:28.141 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1915 (ObjNum 1042 snap 325 seq_num 1042) dirty exists 2026-02-12T17:41:28.141 INFO:tasks.rados.rados.0.trial082.stdout:3054: left oid 16 (ObjNum 1042 snap 325 seq_num 1042) 2026-02-12T17:41:28.141 INFO:tasks.rados.rados.0.trial082.stdout:3055: finishing rollback tid 0 to trial08226312-35 2026-02-12T17:41:28.141 INFO:tasks.rados.rados.0.trial082.stdout:3055: finishing rollback tid 1 to trial08226312-35 2026-02-12T17:41:28.141 INFO:tasks.rados.rados.0.trial082.stdout:3057: expect (ObjNum 987 snap 304 seq_num 987) 2026-02-12T17:41:28.271 INFO:tasks.rados.rados.0.trial082.stdout:3055: finishing rollback tid 2 to trial08226312-35 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1924 (ObjNum 875 snap 277 seq_num 875) dirty exists 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:3058: finishing copy_from racing read to trial08226312-42 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:3058: finishing copy_from to trial08226312-42 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 1910 (ObjNum 1028 snap 322 seq_num 1028) dirty exists 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:3054: done (11 left) 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:3055: done (10 left) 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:3057: done (9 left) 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:3058: done (8 left) 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:3060: done (7 left) 2026-02-12T17:41:28.272 INFO:tasks.rados.rados.0.trial082.stdout:3068: snap_create 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: finishing write tid 1 to trial08226312-3 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: finishing write tid 2 to trial08226312-3 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: finishing write tid 3 to trial08226312-3 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: finishing write tid 4 to trial08226312-3 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: finishing write tid 5 to trial08226312-3 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: oid 3 updating version 0 to 1333 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: oid 3 version 1333 is already newer than 1332 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: oid 3 updating version 1333 to 1334 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: oid 3 updating version 1334 to 1335 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1335 (ObjNum 1043 snap 325 seq_num 1043) dirty exists 2026-02-12T17:41:28.273 INFO:tasks.rados.rados.0.trial082.stdout:3061: left oid 3 (ObjNum 1043 snap 325 seq_num 1043) 2026-02-12T17:41:28.274 INFO:tasks.rados.rados.0.trial082.stdout:3062: expect (ObjNum 942 snap 294 seq_num 942) 2026-02-12T17:41:28.276 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 924673 2026-02-12T17:41:28.340 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:28.376 INFO:tasks.rados.rados.0.trial082.stdout:3063: finishing copy_from racing read to trial08226312-47 2026-02-12T17:41:28.376 INFO:tasks.rados.rados.0.trial082.stdout:3064: finishing write tid 1 to trial08226312-24 2026-02-12T17:41:28.376 INFO:tasks.rados.rados.0.trial082.stdout:3063: finishing copy_from to trial08226312-47 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 1560 (ObjNum 925 snap 290 seq_num 925) dirty exists 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:3064: finishing write tid 2 to trial08226312-24 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:3064: finishing write tid 3 to trial08226312-24 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:3064: finishing write tid 4 to trial08226312-24 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:3064: finishing write tid 5 to trial08226312-24 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:3064: oid 24 updating version 0 to 2356 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:3064: oid 24 updating version 2356 to 2359 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:3064: oid 24 updating version 2359 to 2361 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:3064: oid 24 version 2361 is already newer than 2360 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 2361 (ObjNum 1044 snap 325 seq_num 1044) dirty exists 2026-02-12T17:41:28.377 INFO:tasks.rados.rados.0.trial082.stdout:3064: left oid 24 (ObjNum 1044 snap 325 seq_num 1044) 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3065: finishing write tid 1 to trial08226312-10 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3065: finishing write tid 2 to trial08226312-10 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3065: finishing write tid 3 to trial08226312-10 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3067: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 1911 (ObjNum 33 snap 0 seq_num 1348043894) dirty dne 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3065: finishing write tid 4 to trial08226312-10 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3065: finishing write tid 5 to trial08226312-10 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3065: oid 10 updating version 0 to 2245 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3065: oid 10 version 2245 is already newer than 2244 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3065: oid 10 version 2245 is already newer than 2243 2026-02-12T17:41:28.378 INFO:tasks.rados.rados.0.trial082.stdout:3065: oid 10 version 2245 is already newer than 2242 2026-02-12T17:41:28.379 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2245 (ObjNum 1045 snap 325 seq_num 1045) dirty exists 2026-02-12T17:41:28.379 INFO:tasks.rados.rados.0.trial082.stdout:3065: left oid 10 (ObjNum 1045 snap 325 seq_num 1045) 2026-02-12T17:41:29.141 INFO:tasks.rados.rados.0.trial082.stdout:3061: done (7 left) 2026-02-12T17:41:29.141 INFO:tasks.rados.rados.0.trial082.stdout:3062: done (6 left) 2026-02-12T17:41:29.141 INFO:tasks.rados.rados.0.trial082.stdout:3063: done (5 left) 2026-02-12T17:41:29.141 INFO:tasks.rados.rados.0.trial082.stdout:3064: done (4 left) 2026-02-12T17:41:29.141 INFO:tasks.rados.rados.0.trial082.stdout:3065: done (3 left) 2026-02-12T17:41:29.142 INFO:tasks.rados.rados.0.trial082.stdout:3066: done (2 left) 2026-02-12T17:41:29.142 INFO:tasks.rados.rados.0.trial082.stdout:3067: done (1 left) 2026-02-12T17:41:29.142 INFO:tasks.rados.rados.0.trial082.stdout:3068: done (0 left) 2026-02-12T17:41:29.142 INFO:tasks.rados.rados.0.trial082.stdout:3069: rollback oid 1 current snap is 326 2026-02-12T17:41:29.142 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 324 2026-02-12T17:41:29.142 INFO:tasks.rados.rados.0.trial082.stdout:3070: write oid 14 current snap is 326 2026-02-12T17:41:29.142 INFO:tasks.rados.rados.0.trial082.stdout:3070: seq_num 1046 ranges {780122=650815,2126165=799355} 2026-02-12T17:41:29.146 INFO:tasks.rados.rados.0.trial082.stdout:3070: writing trial08226312-14 from 780122 to 1430937 tid 1 2026-02-12T17:41:29.152 INFO:tasks.rados.rados.0.trial082.stdout:3070: writing trial08226312-14 from 2126165 to 2925520 tid 2 2026-02-12T17:41:29.152 INFO:tasks.rados.rados.0.trial082.stdout:3071: snap_create 2026-02-12T17:41:29.152 INFO:tasks.rados.rados.0.trial082.stdout:3069: finishing rollback tid 0 to trial08226312-1 2026-02-12T17:41:29.152 INFO:tasks.rados.rados.0.trial082.stdout:3069: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:41:29.152 INFO:tasks.rados.rados.0.trial082.stdout:3069: finishing rollback tid 2 to trial08226312-1 2026-02-12T17:41:29.152 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2136 (ObjNum 1021 snap 321 seq_num 1021) dirty exists 2026-02-12T17:41:29.152 INFO:tasks.rados.rados.0.trial082.stdout:3070: finishing write tid 1 to trial08226312-14 2026-02-12T17:41:29.154 INFO:tasks.rados.rados.0.trial082.stdout:3070: finishing write tid 2 to trial08226312-14 2026-02-12T17:41:29.155 INFO:tasks.rados.rados.0.trial082.stdout:3070: finishing write tid 3 to trial08226312-14 2026-02-12T17:41:29.155 INFO:tasks.rados.rados.0.trial082.stdout:3070: finishing write tid 4 to trial08226312-14 2026-02-12T17:41:29.155 INFO:tasks.rados.rados.0.trial082.stdout:3070: oid 14 updating version 0 to 1336 2026-02-12T17:41:29.155 INFO:tasks.rados.rados.0.trial082.stdout:3070: oid 14 updating version 1336 to 1337 2026-02-12T17:41:29.155 INFO:tasks.rados.rados.0.trial082.stdout:3070: oid 14 updating version 1337 to 1338 2026-02-12T17:41:29.155 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 1338 (ObjNum 1046 snap 326 seq_num 1046) dirty exists 2026-02-12T17:41:29.155 INFO:tasks.rados.rados.0.trial082.stdout:3070: left oid 14 (ObjNum 1046 snap 326 seq_num 1046) 2026-02-12T17:41:30.143 INFO:tasks.rados.rados.0.trial082.stdout:3069: done (2 left) 2026-02-12T17:41:30.143 INFO:tasks.rados.rados.0.trial082.stdout:3070: done (1 left) 2026-02-12T17:41:30.143 INFO:tasks.rados.rados.0.trial082.stdout:3071: done (0 left) 2026-02-12T17:41:30.143 INFO:tasks.rados.rados.0.trial082.stdout:3072: read oid 17 snap 312 2026-02-12T17:41:30.143 INFO:tasks.rados.rados.0.trial082.stdout:3072: expect deleted 2026-02-12T17:41:30.143 INFO:tasks.rados.rados.0.trial082.stdout:3073: delete oid 7 current snap is 327 2026-02-12T17:41:30.146 INFO:tasks.rados.rados.0.trial082.stdout:3072: done (1 left) 2026-02-12T17:41:30.146 INFO:tasks.rados.rados.0.trial082.stdout:3073: done (0 left) 2026-02-12T17:41:30.146 INFO:tasks.rados.rados.0.trial082.stdout:3074: delete oid 3 current snap is 327 2026-02-12T17:41:30.148 INFO:tasks.rados.rados.0.trial082.stdout:3074: done (0 left) 2026-02-12T17:41:30.148 INFO:tasks.rados.rados.0.trial082.stdout:3075: snap_create 2026-02-12T17:41:30.629 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:41:30.629 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:41:30.629 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T17:41:30.629 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T17:41:30.635 INFO:tasks.ceph.mon.c:Started 2026-02-12T17:41:30.636 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:41:30.636 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:41:30.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient: get_monmap_and_config 2026-02-12T17:41:30.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient: build_initial_monmap 2026-02-12T17:41:30.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient: monmap: 2026-02-12T17:41:30.704 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:30.704 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.704 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:30.706957+0000 2026-02-12T17:41:30.704 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:30.706957+0000 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 1 Processor -- start 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 1 -- start start 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient: init 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:30.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient(hunting): picked mon.noname-b con 0x7f982808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient(hunting): picked mon.noname-a con 0x7f982808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient(hunting): picked mon.noname-c con 0x7f982808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982808d600 con 0x7f982808c730 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982808b1f0 con 0x7f982808cb30 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982808d1f0 con 0x7f982808ae20 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f983025b640 10 monclient(hunting): authenticate will time out at 1370.525832s 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f982dfd0640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f982808ae20 0x7f982808c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39752/0 (socket says 10.20.193.57:39752) 2026-02-12T17:41:30.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.705+0000 7f982dfd0640 1 -- 10.20.193.57:0/2299475396 learned_addr learned my addr 10.20.193.57:0/2299475396 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:30.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.708+0000 7f982dfd0640 1 -- 10.20.193.57:0/2299475396 >> v1:10.20.193.57:6790/0 conn(0x7f982808ae20 legacy=0x7f982808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.709+0000 7f982d7cf640 1 -- 10.20.193.57:0/2299475396 >> v1:10.20.193.57:6789/0 conn(0x7f982808c730 legacy=0x7f9828181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.709+0000 7f982cfce640 1 -- 10.20.193.57:0/2299475396 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015734259 0 0) 0x7f982808d600 con 0x7f982808c730 2026-02-12T17:41:30.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.709+0000 7f982cfce640 10 monclient(hunting): _negotiate 2026-02-12T17:41:30.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.709+0000 7f982cfce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:30.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.709+0000 7f982cfce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:30.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.709+0000 7f982cfce640 10 monclient(hunting): my global_id is 74256 2026-02-12T17:41:30.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.709+0000 7f982cfce640 1 -- 10.20.193.57:0/2299475396 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98100035e0 con 0x7f982808c730 2026-02-12T17:41:30.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 1 -- 10.20.193.57:0/2299475396 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2280897827 0 0) 0x7f98100035e0 con 0x7f982808c730 2026-02-12T17:41:30.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 1 -- 10.20.193.57:0/2299475396 >> v1:10.20.193.57:6790/0 conn(0x7f982808ae20 legacy=0x7f982808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 1 -- 10.20.193.57:0/2299475396 >> v1:10.20.193.82:6789/0 conn(0x7f982808cb30 legacy=0x7f98281a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:41:30.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: _finish_hunting 0 2026-02-12T17:41:30.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 1 monclient: found mon.noname-a 2026-02-12T17:41:30.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:30.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:30.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 1 -- 10.20.193.57:0/2299475396 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9828057320 con 0x7f982808c730 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: _finish_auth 0 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: _check_auth_tickets 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 1 -- 10.20.193.57:0/2299475396 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f981c003120 con 0x7f982808c730 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f983025b640 5 monclient: authenticate success, global_id 74256 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f983025b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: dump: 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.715 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f983025b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 1 -- 10.20.193.57:0/2299475396 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f981c0033b0 con 0x7f982808c730 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:30.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 1 -- 10.20.193.57:0/2299475396 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f981c003550 con 0x7f982808c730 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f982cfce640 10 monclient: dump: 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.717 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f983025b640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.713+0000 7f983025b640 4 set_mon_vals no callback set 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 10 monclient: shutdown 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 1 -- 10.20.193.57:0/2299475396 >> v1:10.20.193.57:6789/0 conn(0x7f982808c730 legacy=0x7f9828181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 1 -- 10.20.193.57:0/2299475396 shutdown_connections 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 1 -- 10.20.193.57:0/2299475396 >> 10.20.193.57:0/2299475396 conn(0x7f9828091620 msgr2=0x7f9828091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 1 -- 10.20.193.57:0/2299475396 shutdown_connections 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 1 -- 10.20.193.57:0/2299475396 wait complete. 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 10 monclient: build_initial_monmap 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 10 monclient: monmap: 2026-02-12T17:41:30.718 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 1 Processor -- start 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 1 -- start start 2026-02-12T17:41:30.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.714+0000 7f983025b640 10 monclient: init 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 10 monclient(hunting): picked mon.noname-c con 0x7f982808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 10 monclient(hunting): picked mon.noname-a con 0x7f982808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 10 monclient(hunting): picked mon.noname-b con 0x7f982808cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982808d9c0 con 0x7f982808c730 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9828141570 con 0x7f982808cb30 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982813d8d0 con 0x7f982808ae20 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f983025b640 10 monclient(hunting): authenticate will time out at 1370.535225s 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f982d7cf640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f982808c730 0x7f9828216b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34208/0 (socket says 10.20.193.57:34208) 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f982d7cf640 1 -- 10.20.193.57:0/2067857057 learned_addr learned my addr 10.20.193.57:0/2067857057 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:30.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.715+0000 7f982dfd0640 1 --1- 10.20.193.57:0/2067857057 >> v1:10.20.193.57:6790/0 conn(0x7f982808ae20 0x7f98281d5b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39766/0 (socket says 10.20.193.57:39766) 2026-02-12T17:41:30.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f982dfd0640 1 -- 10.20.193.57:0/2067857057 >> v1:10.20.193.57:6790/0 conn(0x7f982808ae20 legacy=0x7f98281d5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f982d7cf640 1 -- 10.20.193.57:0/2067857057 >> v1:10.20.193.57:6789/0 conn(0x7f982808c730 legacy=0x7f9828216b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083118312 0 0) 0x7f982808d9c0 con 0x7f982808c730 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 10 monclient(hunting): my global_id is 74259 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97f80035e0 con 0x7f982808c730 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f982e7d1640 1 -- 10.20.193.57:0/2067857057 >> v1:10.20.193.82:6789/0 conn(0x7f982808cb30 legacy=0x7f98282382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412330514 0 0) 0x7f9828141570 con 0x7f982808cb30 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:30.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 10 monclient(hunting): my global_id is 5020 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.717+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f982808d9c0 con 0x7f982808cb30 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.718+0000 7f982e7d1640 1 --1- 10.20.193.57:0/2067857057 >> v1:10.20.193.82:6789/0 conn(0x7f982808cb30 0x7f98282382c0 :-1 s=OPENED pgs=579 gs=3 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f9824005350 mon_map magic: 0 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.718+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2446036171 0 0) 0x7f982808d9c0 con 0x7f982808cb30 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.718+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9828141570 con 0x7f982808cb30 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.718+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f9824005350 con 0x7f982808cb30 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.718+0000 7f98167fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.718+0000 7f98167fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.718+0000 7f98167fc640 10 monclient(hunting): dump: 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.726 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.718+0000 7f98167fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 57607325 0 0) 0x7f97f80035e0 con 0x7f982808c730 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f982808d9c0 con 0x7f982808c730 2026-02-12T17:41:30.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f981c002b20 con 0x7f982808c730 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient(hunting): dump: 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.728 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 138901813 0 0) 0x7f982808d9c0 con 0x7f982808c730 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 >> v1:10.20.193.57:6790/0 conn(0x7f982808ae20 legacy=0x7f98281d5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 >> v1:10.20.193.82:6789/0 conn(0x7f982808cb30 legacy=0x7f98282382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient: _finish_hunting 0 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 monclient: found mon.a 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982813be10 con 0x7f982808c730 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient: _finish_auth 0 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient: _check_auth_tickets 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:30.729 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2656058846 0 0) 0x7f9828141570 con 0x7f982808cb30 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f983025b640 5 monclient: authenticate success, global_id 74259 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f983025b640 10 monclient: _renew_subs 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f983025b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f982813e170 con 0x7f982808c730 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f983025b640 10 monclient: _renew_subs 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f983025b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f982813eb80 con 0x7f982808c730 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f981c003d80 con 0x7f982808c730 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f981c0040e0 con 0x7f982808c730 2026-02-12T17:41:30.730 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f98167fc640 10 monclient: dump: 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.731 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.719+0000 7f9817fff640 4 set_mon_vals no callback set 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.720+0000 7f983025b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.720+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f981c004370 con 0x7f982808c730 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.720+0000 7f983025b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.720+0000 7f983025b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.720+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98280008d0 con 0x7f982808c730 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.720+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(668..668 src has 461..668) ==== 3947+0+0 (unknown 182921757 0 0) 0x7f981c04ed80 con 0x7f982808c730 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.720+0000 7f982dfd0640 10 monclient: get_auth_request con 0x7f97f803faa0 auth_method 0 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.722+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f981c016e20 con 0x7f982808c730 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.722+0000 7f98167fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:30.732 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.722+0000 7f98167fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:30.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.866+0000 7f983025b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:41:30.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.866+0000 7f983025b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:30.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.866+0000 7f983025b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:30.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.866+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9828055340 con 0x7f982808c730 2026-02-12T17:41:30.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.867+0000 7f98167fc640 1 -- 10.20.193.57:0/2067857057 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 691330276) 0x7f981c016c40 con 0x7f982808c730 2026-02-12T17:41:30.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.867+0000 7f98167fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:30.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.867+0000 7f98167fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:30.866 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:41:30.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.868+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 >> v1:10.20.193.82:6800/2441377515 conn(0x7f97f803faa0 legacy=0x7f97f805ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.868+0000 7f983025b640 10 monclient: shutdown 2026-02-12T17:41:30.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.868+0000 7f983025b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:30.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.868+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 >> v1:10.20.193.57:6789/0 conn(0x7f982808c730 legacy=0x7f9828216b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.868+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 shutdown_connections 2026-02-12T17:41:30.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.868+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 >> 10.20.193.57:0/2067857057 conn(0x7f9828091620 msgr2=0x7f982805cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:30.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.868+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 shutdown_connections 2026-02-12T17:41:30.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.868+0000 7f983025b640 1 -- 10.20.193.57:0/2067857057 wait complete. 2026-02-12T17:41:30.874 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:41:30.874 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:41:30.874 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.942+0000 7f7ae26cc640 10 monclient: get_monmap_and_config 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.942+0000 7f7ae26cc640 10 monclient: build_initial_monmap 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.942+0000 7f7ae26cc640 10 monclient: monmap: 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:30.944317+0000 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:30.944317+0000 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:30.940 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.942+0000 7f7ae26cc640 1 Processor -- start 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.942+0000 7f7ae26cc640 1 -- start start 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.942+0000 7f7ae26cc640 10 monclient: init 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 10 monclient(hunting): picked mon.noname-c con 0x7f7adc0906d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 10 monclient(hunting): picked mon.noname-b con 0x7f7adc0911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 10 monclient(hunting): picked mon.noname-a con 0x7f7adc185070 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7adc090100 con 0x7f7adc185070 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7adc091a70 con 0x7f7adc0906d0 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7adc092360 con 0x7f7adc0911b0 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae26cc640 10 monclient(hunting): authenticate will time out at 1370.763288s 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae0c42640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f7adc185070 0x7f7adc1a5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34220/0 (socket says 10.20.193.57:34220) 2026-02-12T17:41:30.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.943+0000 7f7ae0c42640 1 -- 10.20.193.57:0/550248145 learned_addr learned my addr 10.20.193.57:0/550248145 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:30.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7ae0c42640 1 -- 10.20.193.57:0/550248145 >> v1:10.20.193.57:6789/0 conn(0x7f7adc185070 legacy=0x7f7adc1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adb7fe640 1 -- 10.20.193.57:0/550248145 >> v1:10.20.193.57:6790/0 conn(0x7f7adc0911b0 legacy=0x7f7adc183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 1 -- 10.20.193.57:0/550248145 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2108425009 0 0) 0x7f7adc090100 con 0x7f7adc185070 2026-02-12T17:41:30.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:30.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:30.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:30.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient(hunting): my global_id is 74262 2026-02-12T17:41:30.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 1 -- 10.20.193.57:0/550248145 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ac00035e0 con 0x7f7adc185070 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adbfff640 1 -- 10.20.193.57:0/550248145 >> v1:10.20.193.82:6789/0 conn(0x7f7adc0906d0 legacy=0x7f7adc090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 1 -- 10.20.193.57:0/550248145 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3970033744 0 0) 0x7f7ac00035e0 con 0x7f7adc185070 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 1 -- 10.20.193.57:0/550248145 >> v1:10.20.193.57:6790/0 conn(0x7f7adc0911b0 legacy=0x7f7adc183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 1 -- 10.20.193.57:0/550248145 >> v1:10.20.193.82:6789/0 conn(0x7f7adc0906d0 legacy=0x7f7adc090aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient: _finish_hunting 0 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 1 monclient: found mon.noname-a 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 1 -- 10.20.193.57:0/550248145 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc05cf80 con 0x7f7adc185070 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient: _finish_auth 0 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient: _check_auth_tickets 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 1 -- 10.20.193.57:0/550248145 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ad00041b0 con 0x7f7adc185070 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7adaffd640 10 monclient: dump: 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7ae26cc640 5 monclient: authenticate success, global_id 74262 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.945+0000 7f7ae26cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7adaffd640 1 -- 10.20.193.57:0/550248145 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ad0004440 con 0x7f7adc185070 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7adaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7adaffd640 1 -- 10.20.193.57:0/550248145 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ad0005a40 con 0x7f7adc185070 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7adaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7adaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7adaffd640 10 monclient: dump: 2026-02-12T17:41:30.944 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 4 set_mon_vals no callback set 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 10 monclient: shutdown 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 1 -- 10.20.193.57:0/550248145 >> v1:10.20.193.57:6789/0 conn(0x7f7adc185070 legacy=0x7f7adc1a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 1 -- 10.20.193.57:0/550248145 shutdown_connections 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 1 -- 10.20.193.57:0/550248145 >> 10.20.193.57:0/550248145 conn(0x7f7adc054330 msgr2=0x7f7adc054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:30.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 1 -- 10.20.193.57:0/550248145 shutdown_connections 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 1 -- 10.20.193.57:0/550248145 wait complete. 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 10 monclient: build_initial_monmap 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.946+0000 7f7ae26cc640 10 monclient: monmap: 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 1 Processor -- start 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 1 -- start start 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 10 monclient: init 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 10 monclient(hunting): picked mon.noname-a con 0x7f7adc0906d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 10 monclient(hunting): picked mon.noname-c con 0x7f7adc0911b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 10 monclient(hunting): picked mon.noname-b con 0x7f7adc185070 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7adc08b8b0 con 0x7f7adc0906d0 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7adc062bb0 con 0x7f7adc185070 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7adc131b10 con 0x7f7adc0911b0 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7ae26cc640 10 monclient(hunting): authenticate will time out at 1370.767480s 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7adbfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f7adc0906d0 0x7f7adc152c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34236/0 (socket says 10.20.193.57:34236) 2026-02-12T17:41:30.946 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.947+0000 7f7adbfff640 1 -- 10.20.193.57:0/2960808122 learned_addr learned my addr 10.20.193.57:0/2960808122 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:30.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7adbfff640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6789/0 conn(0x7f7adc0906d0 legacy=0x7f7adc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.947 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7adb7fe640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6790/0 conn(0x7f7adc0911b0 legacy=0x7f7adc173e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3774957012 0 0) 0x7f7adc08b8b0 con 0x7f7adc0906d0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 10 monclient(hunting): my global_id is 74265 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ae0c42640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.82:6789/0 conn(0x7f7adc185070 legacy=0x7f7adc1755a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aac0035e0 con 0x7f7adc0906d0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686411641 0 0) 0x7f7adc131b10 con 0x7f7adc0911b0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 10 monclient(hunting): my global_id is 94100 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.949+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7adc08b8b0 con 0x7f7adc0911b0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7adbfff640 1 --1- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6789/0 conn(0x7f7adc0906d0 0x7f7adc152c50 :-1 s=OPENED pgs=483 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f7aac0035e0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2730189260 0 0) 0x7f7aac0035e0 con 0x7f7adc0906d0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7adc131b10 con 0x7f7adc0906d0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2231617166 0 0) 0x7f7adc062bb0 con 0x7f7adc185070 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): my global_id is 5023 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aac0035e0 con 0x7f7adc185070 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 556088843 0 0) 0x7f7adc08b8b0 con 0x7f7adc0911b0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7adc062bb0 con 0x7f7adc0911b0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7acc003340 con 0x7f7adc0911b0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): dump: 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.948 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ac8003340 con 0x7f7adc0906d0 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): dump: 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2531174936 0 0) 0x7f7aac0035e0 con 0x7f7adc185070 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7adc08b8b0 con 0x7f7adc185070 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ad0003c50 con 0x7f7adc185070 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient(hunting): dump: 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2261526161 0 0) 0x7f7adc062bb0 con 0x7f7adc0911b0 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.82:6789/0 conn(0x7f7adc185070 legacy=0x7f7adc1755a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6789/0 conn(0x7f7adc0906d0 legacy=0x7f7adc152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 monclient: found mon.c 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc133e70 con 0x7f7adc0911b0 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient: _finish_auth 0 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:30.949 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1068043345 0 0) 0x7f7adc131b10 con 0x7f7adc0906d0 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ae26cc640 5 monclient: authenticate success, global_id 94100 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ae26cc640 10 monclient: _renew_subs 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ae26cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7adc132670 con 0x7f7adc0911b0 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ae26cc640 10 monclient: _renew_subs 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ae26cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7adc131060 con 0x7f7adc0911b0 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7acc003980 con 0x7f7adc0911b0 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7acc003cd0 con 0x7f7adc0911b0 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ada7fc640 4 set_mon_vals no callback set 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 10 monclient: dump: 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.950 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ae26cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7adc133c90 con 0x7f7adc153360 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.950+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f7acc003e70 con 0x7f7adc0911b0 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.951+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(668..668 src has 461..668) ==== 3947+0+0 (unknown 182921757 0 0) 0x7f7acc04eae0 con 0x7f7adc0911b0 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.951+0000 7f7ae0c42640 10 monclient: get_auth_request con 0x7f7aac03ff60 auth_method 0 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.952+0000 7f7adbfff640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6789/0 conn(0x7f7adc153360 legacy=0x7f7adc12c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895550585 0 0) 0x7f7adc133c90 con 0x7f7adc153360 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 10 monclient(hunting): my global_id is 74268 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7adc131b10 con 0x7f7adc153360 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2821987162 0 0) 0x7f7adc131b10 con 0x7f7adc153360 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7adc133c90 con 0x7f7adc153360 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ac8003e10 con 0x7f7adc153360 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 10 monclient: dump: 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3598907367 0 0) 0x7f7adc133c90 con 0x7f7adc153360 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7adc05c950 con 0x7f7adc153360 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7ac8004300 con 0x7f7adc153360 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:30.951 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6789/0 conn(0x7f7adc153360 legacy=0x7f7adc12c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.953+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6789/0 conn(0x7f7adc153360 legacy=0x7f7adc12c330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:30.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.957+0000 7f7ae26cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:41:30.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.957+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7adc055340 con 0x7f7adc12ca40 2026-02-12T17:41:30.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7adbfff640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6789/0 conn(0x7f7adc12ca40 legacy=0x7f7adc177cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:30.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132662889 0 0) 0x7f7adc055340 con 0x7f7adc12ca40 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 10 monclient(hunting): my global_id is 74271 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7adc133c90 con 0x7f7adc12ca40 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3449469578 0 0) 0x7f7adc133c90 con 0x7f7adc12ca40 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7adc055340 con 0x7f7adc12ca40 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7ac8005c20 con 0x7f7adc12ca40 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 10 monclient: dump: 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 626290997 0 0) 0x7f7adc055340 con 0x7f7adc12ca40 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7adc131360 con 0x7f7adc12ca40 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 769713556) 0x7f7ac80071b0 con 0x7f7adc12ca40 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:41:30.957 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6789/0 conn(0x7f7adc12ca40 legacy=0x7f7adc177cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.959+0000 7f7ad8ff9640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6789/0 conn(0x7f7adc12ca40 legacy=0x7f7adc177cd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 52, 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 217423, 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:30.958 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:30.959 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:30.960 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:41:30.961 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.82:6800/2441377515 conn(0x7f7aac03ff60 legacy=0x7f7aac060410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae26cc640 10 monclient: shutdown 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae26cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 >> v1:10.20.193.57:6790/0 conn(0x7f7adc0911b0 legacy=0x7f7adc173e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae0c42640 1 -- 10.20.193.57:0/2960808122 reap_dead start 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae0c42640 1 -- 10.20.193.57:0/2960808122 reap_dead start 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 shutdown_connections 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 >> 10.20.193.57:0/2960808122 conn(0x7f7adc054330 msgr2=0x7f7adc08ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 shutdown_connections 2026-02-12T17:41:30.962 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:30.960+0000 7f7ae26cc640 1 -- 10.20.193.57:0/2960808122 wait complete. 2026-02-12T17:41:30.962 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:41:30.962 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:41:30.962 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.030+0000 7ff0a1acc640 10 monclient: get_monmap_and_config 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.030+0000 7ff0a1acc640 10 monclient: build_initial_monmap 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.030+0000 7ff0a1acc640 10 monclient: monmap: 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:31.032463+0000 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:31.032463+0000 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 1 Processor -- start 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 1 -- start start 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 10 monclient: init 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 10 monclient(hunting): picked mon.noname-c con 0x7ff09c08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 10 monclient(hunting): picked mon.noname-a con 0x7ff09c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 10 monclient(hunting): picked mon.noname-b con 0x7ff09c182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c08a820 con 0x7ff09c08c620 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c089450 con 0x7ff09c08c250 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c089730 con 0x7ff09c182cc0 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff0a1acc640 10 monclient(hunting): authenticate will time out at 1370.851352s 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff09affd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff09c08c620 0x7ff09c08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34260/0 (socket says 10.20.193.57:34260) 2026-02-12T17:41:31.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.031+0000 7ff09affd640 1 -- 10.20.193.57:0/1935386621 learned_addr learned my addr 10.20.193.57:0/1935386621 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09bfff640 1 -- 10.20.193.57:0/1935386621 >> v1:10.20.193.57:6790/0 conn(0x7ff09c182cc0 legacy=0x7ff09c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09affd640 1 -- 10.20.193.57:0/1935386621 >> v1:10.20.193.57:6789/0 conn(0x7ff09c08c620 legacy=0x7ff09c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25736665 0 0) 0x7ff09c089730 con 0x7ff09c182cc0 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient(hunting): my global_id is 94103 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0800035e0 con 0x7ff09c182cc0 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561842618 0 0) 0x7ff08c002c20 con 0x7ff09c08c620 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient(hunting): my global_id is 74274 2026-02-12T17:41:31.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c089730 con 0x7ff09c08c620 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09b7fe640 1 -- 10.20.193.57:0/1935386621 >> v1:10.20.193.82:6789/0 conn(0x7ff09c08c250 legacy=0x7ff09c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1216098144 0 0) 0x7ff0800035e0 con 0x7ff09c182cc0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 >> v1:10.20.193.82:6789/0 conn(0x7ff09c08c250 legacy=0x7ff09c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 >> v1:10.20.193.57:6789/0 conn(0x7ff09c08c620 legacy=0x7ff09c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 monclient: found mon.noname-b 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c089a10 con 0x7ff09c182cc0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient: _finish_auth 0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff090004200 con 0x7ff09c182cc0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.033+0000 7ff09a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff09a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff09a7fc640 10 monclient: dump: 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 5 monclient: authenticate success, global_id 94103 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff090004500 con 0x7ff09c182cc0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff09a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff09a7fc640 1 -- 10.20.193.57:0/1935386621 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff090004960 con 0x7ff09c182cc0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff09a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff09a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff09a7fc640 10 monclient: dump: 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.032 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 4 set_mon_vals no callback set 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 10 monclient: shutdown 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 1 -- 10.20.193.57:0/1935386621 >> v1:10.20.193.57:6790/0 conn(0x7ff09c182cc0 legacy=0x7ff09c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 1 -- 10.20.193.57:0/1935386621 shutdown_connections 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 1 -- 10.20.193.57:0/1935386621 >> 10.20.193.57:0/1935386621 conn(0x7ff09c0916b0 msgr2=0x7ff09c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 1 -- 10.20.193.57:0/1935386621 shutdown_connections 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 1 -- 10.20.193.57:0/1935386621 wait complete. 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 10 monclient: build_initial_monmap 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.034+0000 7ff0a1acc640 10 monclient: monmap: 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:31.033 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 1 Processor -- start 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 1 -- start start 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 10 monclient: init 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 10 monclient(hunting): picked mon.noname-a con 0x7ff09c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 10 monclient(hunting): picked mon.noname-b con 0x7ff09c08c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 10 monclient(hunting): picked mon.noname-c con 0x7ff09c182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c182ad0 con 0x7ff09c08c250 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c13e990 con 0x7ff09c08c620 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0888a0 con 0x7ff09c182cc0 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff0a1acc640 10 monclient(hunting): authenticate will time out at 1370.855421s 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff09b7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff09c08c250 0x7ff09c13dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34272/0 (socket says 10.20.193.57:34272) 2026-02-12T17:41:31.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.035+0000 7ff09b7fe640 1 -- 10.20.193.57:0/3013208204 learned_addr learned my addr 10.20.193.57:0/3013208204 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:31.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff09b7fe640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6789/0 conn(0x7ff09c08c250 legacy=0x7ff09c13dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff09bfff640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6790/0 conn(0x7ff09c182cc0 legacy=0x7ff09c1823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315088156 0 0) 0x7ff09c182ad0 con 0x7ff09c08c250 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): my global_id is 74277 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff06c0035e0 con 0x7ff09c08c250 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296199999 0 0) 0x7ff09c0888a0 con 0x7ff09c182cc0 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): my global_id is 94106 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c182ad0 con 0x7ff09c182cc0 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff09affd640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.82:6789/0 conn(0x7ff09c08c620 legacy=0x7ff09c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 706634837 0 0) 0x7ff06c0035e0 con 0x7ff09c08c250 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff09c0888a0 con 0x7ff09c08c250 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2546516902 0 0) 0x7ff09c182ad0 con 0x7ff09c182cc0 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff06c0035e0 con 0x7ff09c182cc0 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff088003340 con 0x7ff09c08c250 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): dump: 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff0900043a0 con 0x7ff09c182cc0 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:31.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.037+0000 7ff077fff640 10 monclient(hunting): dump: 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1454922222 0 0) 0x7ff09c13e990 con 0x7ff09c08c620 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient(hunting): my global_id is 5029 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c182ad0 con 0x7ff09c08c620 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4053012906 0 0) 0x7ff06c0035e0 con 0x7ff09c182cc0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.82:6789/0 conn(0x7ff09c08c620 legacy=0x7ff09c181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6789/0 conn(0x7ff09c08c250 legacy=0x7ff09c13dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient: _finish_hunting 0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 monclient: found mon.c 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c1902f0 con 0x7ff09c182cc0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient: _finish_auth 0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient: _check_auth_tickets 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff0a1acc640 5 monclient: authenticate success, global_id 94106 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff0a1acc640 10 monclient: _renew_subs 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff0a1acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c1381e0 con 0x7ff09c182cc0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff0a1acc640 10 monclient: _renew_subs 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff0a1acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff09c1374a0 con 0x7ff09c182cc0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0900041a0 con 0x7ff09c182cc0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff090004020 con 0x7ff09c182cc0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 10 monclient: dump: 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.037 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff099ffb640 4 set_mon_vals no callback set 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff0a1acc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff09c138af0 con 0x7ff09c18f530 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.038+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff0900050f0 con 0x7ff09c182cc0 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.039+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(668..668 src has 461..668) ==== 3947+0+0 (unknown 182921757 0 0) 0x7ff09004fb40 con 0x7ff09c182cc0 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.039+0000 7ff09affd640 10 monclient: get_auth_request con 0x7ff06c03fc80 auth_method 0 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff09b7fe640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6790/0 conn(0x7ff09c18f530 legacy=0x7ff09c18c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240973294 0 0) 0x7ff09c089450 con 0x7ff09c18f530 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 10 monclient(hunting): my global_id is 94109 2026-02-12T17:41:31.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff06c0035e0 con 0x7ff09c18f530 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4200720687 0 0) 0x7ff06c0035e0 con 0x7ff09c18f530 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff09c089450 con 0x7ff09c18f530 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff088003dd0 con 0x7ff09c18f530 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 10 monclient: dump: 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3916392805 0 0) 0x7ff09c089450 con 0x7ff09c18f530 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff09c18f900 con 0x7ff09c18f530 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff088004330 con 0x7ff09c18f530 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6790/0 conn(0x7ff09c18f530 legacy=0x7ff09c18c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.041+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6790/0 conn(0x7ff09c18f530 legacy=0x7ff09c18c300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:31.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.045+0000 7ff0a1acc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:41:31.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.045+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff09c08f580 con 0x7ff09c18ca10 2026-02-12T17:41:31.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff09b7fe640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6790/0 conn(0x7ff09c18ca10 legacy=0x7ff09c197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3557480847 0 0) 0x7ff09c08f580 con 0x7ff09c18ca10 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 10 monclient(hunting): my global_id is 94112 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c089450 con 0x7ff09c18ca10 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3088688591 0 0) 0x7ff09c089450 con 0x7ff09c18ca10 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff09c08f580 con 0x7ff09c18ca10 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff088005a30 con 0x7ff09c18ca10 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 10 monclient: dump: 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 226068206 0 0) 0x7ff09c08f580 con 0x7ff09c18ca10 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.047+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff09c055340 con 0x7ff09c18ca10 2026-02-12T17:41:31.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4335 (unknown 0 0 1744751878) 0x7ff088005f40 con 0x7ff09c18ca10 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff077fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff077fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6790/0 conn(0x7ff09c18ca10 legacy=0x7ff09c197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff077fff640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6790/0 conn(0x7ff09c18ca10 legacy=0x7ff09c197f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 52, 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 349, 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:31.046 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:31.047 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:31.048 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:41:31.049 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff06c03fc80 legacy=0x7ff06c060130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff0a1acc640 10 monclient: shutdown 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff0a1acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 >> v1:10.20.193.57:6790/0 conn(0x7ff09c182cc0 legacy=0x7ff09c1823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff09bfff640 1 -- 10.20.193.57:0/3013208204 reap_dead start 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff09bfff640 1 -- 10.20.193.57:0/3013208204 reap_dead start 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 shutdown_connections 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 >> 10.20.193.57:0/3013208204 conn(0x7ff09c0916b0 msgr2=0x7ff09c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 shutdown_connections 2026-02-12T17:41:31.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.048+0000 7ff0a1acc640 1 -- 10.20.193.57:0/3013208204 wait complete. 2026-02-12T17:41:31.051 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:41:31.051 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:41:31.051 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.118+0000 7f501530c640 10 monclient: get_monmap_and_config 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.118+0000 7f501530c640 10 monclient: build_initial_monmap 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 10 monclient: monmap: 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:31.120823+0000 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:31.120823+0000 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:31.116 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 1 Processor -- start 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 1 -- start start 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 10 monclient: init 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 10 monclient(hunting): picked mon.noname-a con 0x7f501008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 10 monclient(hunting): picked mon.noname-b con 0x7f501008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 10 monclient(hunting): picked mon.noname-c con 0x7f5010182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501008a820 con 0x7f501008c250 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5010089450 con 0x7f5010182cc0 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5010089730 con 0x7f501008c620 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f501530c640 10 monclient(hunting): authenticate will time out at 1370.939711s 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f500effd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f501008c250 0x7f501008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34280/0 (socket says 10.20.193.57:34280) 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f500effd640 1 -- 10.20.193.57:0/2494982482 learned_addr learned my addr 10.20.193.57:0/2494982482 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:31.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.119+0000 7f500e7fc640 1 --1- 10.20.193.57:0/2494982482 >> v1:10.20.193.57:6790/0 conn(0x7f501008c620 0x7f501008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39818/0 (socket says 10.20.193.57:39818) 2026-02-12T17:41:31.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.121+0000 7f500effd640 1 -- 10.20.193.57:0/2494982482 >> v1:10.20.193.57:6789/0 conn(0x7f501008c250 legacy=0x7f501008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.119 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.121+0000 7f500e7fc640 1 -- 10.20.193.57:0/2494982482 >> v1:10.20.193.57:6790/0 conn(0x7f501008c620 legacy=0x7f501008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4249696995 0 0) 0x7f5004002c20 con 0x7f501008c250 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): my global_id is 74280 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ffc0035e0 con 0x7f501008c250 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2118255411 0 0) 0x7f5010089730 con 0x7f501008c620 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): my global_id is 94115 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5004002c20 con 0x7f501008c620 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500f7fe640 1 -- 10.20.193.57:0/2494982482 >> v1:10.20.193.82:6789/0 conn(0x7f5010182cc0 legacy=0x7f50101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498685019 0 0) 0x7f5010089450 con 0x7f5010182cc0 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient(hunting): my global_id is 5032 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5010089730 con 0x7f5010182cc0 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2590610305 0 0) 0x7f4ffc0035e0 con 0x7f501008c250 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 >> v1:10.20.193.57:6790/0 conn(0x7f501008c620 legacy=0x7f501008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 >> v1:10.20.193.82:6789/0 conn(0x7f5010182cc0 legacy=0x7f50101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: _finish_hunting 0 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 monclient: found mon.noname-a 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5010089a10 con 0x7f501008c250 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: _finish_auth 0 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: _check_auth_tickets 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5004003260 con 0x7f501008c250 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: dump: 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.120 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 5 monclient: authenticate success, global_id 74280 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5004003560 con 0x7f501008c250 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 1 -- 10.20.193.57:0/2494982482 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5004004b10 con 0x7f501008c250 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f500dffb640 10 monclient: dump: 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:31.121 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 4 set_mon_vals no callback set 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 10 monclient: shutdown 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 1 -- 10.20.193.57:0/2494982482 >> v1:10.20.193.57:6789/0 conn(0x7f501008c250 legacy=0x7f501008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 1 -- 10.20.193.57:0/2494982482 shutdown_connections 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 1 -- 10.20.193.57:0/2494982482 >> 10.20.193.57:0/2494982482 conn(0x7f50100916b0 msgr2=0x7f5010091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 1 -- 10.20.193.57:0/2494982482 shutdown_connections 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.122+0000 7f501530c640 1 -- 10.20.193.57:0/2494982482 wait complete. 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient: build_initial_monmap 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient: monmap: 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 1 Processor -- start 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 1 -- start start 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient: init 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient(hunting): picked mon.noname-a con 0x7f501008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient(hunting): picked mon.noname-c con 0x7f501008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient(hunting): picked mon.noname-b con 0x7f5010182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501005cd80 con 0x7f501008c250 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501005dfc0 con 0x7f5010182cc0 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501005cb00 con 0x7f501008c620 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f501530c640 10 monclient(hunting): authenticate will time out at 1370.943687s 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f500effd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f501008c250 0x7f501005a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34296/0 (socket says 10.20.193.57:34296) 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f500effd640 1 -- 10.20.193.57:0/1864350597 learned_addr learned my addr 10.20.193.57:0/1864350597 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:31.122 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.123+0000 7f500e7fc640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f501008c620 0x7f501005aec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39834/0 (socket says 10.20.193.57:39834) 2026-02-12T17:41:31.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f500effd640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.57:6789/0 conn(0x7f501008c250 legacy=0x7f501005a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.123 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f500e7fc640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.57:6790/0 conn(0x7f501008c620 legacy=0x7f501005aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964641531 0 0) 0x7f501005cd80 con 0x7f501008c250 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 10 monclient(hunting): my global_id is 74283 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fdc0035e0 con 0x7f501008c250 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184184929 0 0) 0x7f501005cb00 con 0x7f501008c620 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 10 monclient(hunting): my global_id is 94118 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.125+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f501005cd80 con 0x7f501008c620 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f500f7fe640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.82:6789/0 conn(0x7f5010182cc0 legacy=0x7f50101935e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3171672050 0 0) 0x7f4fdc0035e0 con 0x7f501008c250 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f501005cb00 con 0x7f501008c250 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5004003400 con 0x7f501008c250 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): dump: 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1695120463 0 0) 0x7f501005cd80 con 0x7f501008c620 2026-02-12T17:41:31.124 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fdc0035e0 con 0x7f501008c620 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4ff8003360 con 0x7f501008c620 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): dump: 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872226328 0 0) 0x7f501005dfc0 con 0x7f5010182cc0 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient(hunting): my global_id is 5035 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f501005cd80 con 0x7f5010182cc0 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1902269930 0 0) 0x7f501005cb00 con 0x7f501008c250 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.57:6790/0 conn(0x7f501008c620 legacy=0x7f501005aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.82:6789/0 conn(0x7f5010182cc0 legacy=0x7f50101935e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 monclient: found mon.a 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501005b5d0 con 0x7f501008c250 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient: _finish_auth 0 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f501530c640 5 monclient: authenticate success, global_id 74283 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f501530c640 10 monclient: _renew_subs 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f501530c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f501005c6c0 con 0x7f501008c250 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f501530c640 10 monclient: _renew_subs 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f501530c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f501013e990 con 0x7f501008c250 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5004004f60 con 0x7f501008c250 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5004002ee0 con 0x7f501008c250 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f4fef7fe640 10 monclient: dump: 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.125 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f500d7fa640 4 set_mon_vals no callback set 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.126+0000 7f501530c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.127+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5010085180 con 0x7f5010084db0 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.127+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f50040052c0 con 0x7f501008c250 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.127+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(668..668 src has 461..668) ==== 3947+0+0 (unknown 182921757 0 0) 0x7f500404ecd0 con 0x7f501008c250 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.127+0000 7f500f7fe640 10 monclient: get_auth_request con 0x7f4fdc03fd10 auth_method 0 2026-02-12T17:41:31.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f500e7fc640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.82:6789/0 conn(0x7f5010084db0 legacy=0x7f501018d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545874877 0 0) 0x7f5010085180 con 0x7f5010084db0 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 10 monclient(hunting): my global_id is 5038 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f501005cb00 con 0x7f5010084db0 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1664799277 0 0) 0x7f501005cb00 con 0x7f5010084db0 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5010085180 con 0x7f5010084db0 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4ff8004c40 con 0x7f5010084db0 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 10 monclient: dump: 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2699601072 0 0) 0x7f5010085180 con 0x7f5010084db0 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.129+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5010090810 con 0x7f5010084db0 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.130+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4ff8007a20 con 0x7f5010084db0 2026-02-12T17:41:31.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.130+0000 7f4fef7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:31.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.130+0000 7f4fef7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:31.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.130+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.82:6789/0 conn(0x7f5010084db0 legacy=0x7f501018d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.128 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.130+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.82:6789/0 conn(0x7f5010084db0 legacy=0x7f501018d340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:31.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.133+0000 7f501530c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:41:31.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.133+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f501008caa0 con 0x7f501018da50 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.135+0000 7f500e7fc640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.82:6789/0 conn(0x7f501018da50 legacy=0x7f5010195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.135+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927818405 0 0) 0x7f501008caa0 con 0x7f501018da50 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.135+0000 7f4fef7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.135+0000 7f4fef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.135+0000 7f4fef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.135+0000 7f4fef7fe640 10 monclient(hunting): my global_id is 5041 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.135+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5010085180 con 0x7f501018da50 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2366406437 0 0) 0x7f5010085180 con 0x7f501018da50 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f501008caa0 con 0x7f501018da50 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4ff80053d0 con 0x7f501018da50 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 10 monclient: dump: 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.133 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1052660392 0 0) 0x7f501008caa0 con 0x7f501018da50 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f501008f5b0 con 0x7f501018da50 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 2474470858) 0x7f4ff8005630 con 0x7f501018da50 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.82:6789/0 conn(0x7f501018da50 legacy=0x7f5010195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f4fef7fe640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.82:6789/0 conn(0x7f501018da50 legacy=0x7f5010195d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 52, 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 812633, 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:41:31.134 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:41:31.135 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:31.136 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:41:31.137 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.82:6800/2441377515 conn(0x7f4fdc03fd10 legacy=0x7f4fdc0601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f501530c640 10 monclient: shutdown 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f501530c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 >> v1:10.20.193.57:6789/0 conn(0x7f501008c250 legacy=0x7f501005a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f500f7fe640 1 -- 10.20.193.57:0/1864350597 reap_dead start 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f500f7fe640 1 -- 10.20.193.57:0/1864350597 reap_dead start 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 shutdown_connections 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 >> 10.20.193.57:0/1864350597 conn(0x7f50100916b0 msgr2=0x7f501008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 shutdown_connections 2026-02-12T17:41:31.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.136+0000 7f501530c640 1 -- 10.20.193.57:0/1864350597 wait complete. 2026-02-12T17:41:31.139 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:41:31.139 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:41:31.139 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:41:31.146 INFO:tasks.rados.rados.0.trial082.stdout:3075: done (0 left) 2026-02-12T17:41:31.146 INFO:tasks.rados.rados.0.trial082.stdout:3076: snap_remove snap 317 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.207+0000 7f410370c640 10 monclient: get_monmap_and_config 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.207+0000 7f410370c640 10 monclient: build_initial_monmap 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.207+0000 7f410370c640 10 monclient: monmap: 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:31.209455+0000 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:31.209455+0000 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:31.205 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 1 Processor -- start 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 1 -- start start 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 10 monclient: init 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 10 monclient(hunting): picked mon.noname-a con 0x7f40fc08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 10 monclient(hunting): picked mon.noname-b con 0x7f40fc08c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 10 monclient(hunting): picked mon.noname-c con 0x7f40fc08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40fc08d600 con 0x7f40fc08ae20 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40fc08b1f0 con 0x7f40fc08cb30 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40fc08d1f0 con 0x7f40fc08c730 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f410370c640 10 monclient(hunting): authenticate will time out at 1371.028379s 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f4100c80640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f40fc08c730 0x7f40fc181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39838/0 (socket says 10.20.193.57:39838) 2026-02-12T17:41:31.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.208+0000 7f4100c80640 1 -- 10.20.193.57:0/1239465416 learned_addr learned my addr 10.20.193.57:0/1239465416 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f4101481640 1 -- 10.20.193.57:0/1239465416 >> v1:10.20.193.57:6789/0 conn(0x7f40fc08ae20 legacy=0x7f40fc08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f4100c80640 1 -- 10.20.193.57:0/1239465416 >> v1:10.20.193.57:6790/0 conn(0x7f40fc08c730 legacy=0x7f40fc181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664748949 0 0) 0x7f40fc08d600 con 0x7f40fc08ae20 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient(hunting): my global_id is 74286 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40e40035e0 con 0x7f40fc08ae20 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598534769 0 0) 0x7f40fc08d1f0 con 0x7f40fc08c730 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient(hunting): my global_id is 94121 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40fc08d600 con 0x7f40fc08c730 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 526846881 0 0) 0x7f40e40035e0 con 0x7f40fc08ae20 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 >> v1:10.20.193.57:6790/0 conn(0x7f40fc08c730 legacy=0x7f40fc181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 >> v1:10.20.193.82:6789/0 conn(0x7f40fc08cb30 legacy=0x7f40fc1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient: _finish_hunting 0 2026-02-12T17:41:31.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 monclient: found mon.noname-a 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc057320 con 0x7f40fc08ae20 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient: _finish_auth 0 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient: _check_auth_tickets 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f40ec0031a0 con 0x7f40fc08ae20 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f40ebfff640 10 monclient: dump: 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f410370c640 5 monclient: authenticate success, global_id 74286 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.210+0000 7f410370c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f40ec0033f0 con 0x7f40fc08ae20 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f40ebfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 4 set_mon_vals no callback set 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f40ebfff640 1 -- 10.20.193.57:0/1239465416 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f40ec003880 con 0x7f40fc08ae20 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f40ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f40ebfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f40ebfff640 10 monclient: dump: 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.209 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 10 monclient: shutdown 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 1 -- 10.20.193.57:0/1239465416 >> v1:10.20.193.57:6789/0 conn(0x7f40fc08ae20 legacy=0x7f40fc08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 1 -- 10.20.193.57:0/1239465416 shutdown_connections 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 1 -- 10.20.193.57:0/1239465416 >> 10.20.193.57:0/1239465416 conn(0x7f40fc091620 msgr2=0x7f40fc091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 1 -- 10.20.193.57:0/1239465416 shutdown_connections 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 1 -- 10.20.193.57:0/1239465416 wait complete. 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 10 monclient: build_initial_monmap 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 10 monclient: monmap: 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 1 Processor -- start 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 1 -- start start 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.211+0000 7f410370c640 10 monclient: init 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 10 monclient(hunting): picked mon.noname-c con 0x7f40fc08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 10 monclient(hunting): picked mon.noname-a con 0x7f40fc08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:31.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 10 monclient(hunting): picked mon.noname-b con 0x7f40fc08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40fc08d9c0 con 0x7f40fc08c730 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40fc088020 con 0x7f40fc08cb30 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40fc088810 con 0x7f40fc08ae20 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f410370c640 10 monclient(hunting): authenticate will time out at 1371.032141s 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f4101481640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f40fc08ae20 0x7f40fc152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39844/0 (socket says 10.20.193.57:39844) 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f4101481640 1 -- 10.20.193.57:0/1491690144 learned_addr learned my addr 10.20.193.57:0/1491690144 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.212+0000 7f4100c80640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f40fc08c730 0x7f40fc194140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34314/0 (socket says 10.20.193.57:34314) 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f4101481640 1 -- 10.20.193.57:0/1491690144 >> v1:10.20.193.57:6790/0 conn(0x7f40fc08ae20 legacy=0x7f40fc152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f4100c80640 1 -- 10.20.193.57:0/1491690144 >> v1:10.20.193.57:6789/0 conn(0x7f40fc08c730 legacy=0x7f40fc194140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4046594849 0 0) 0x7f40fc088810 con 0x7f40fc08ae20 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): my global_id is 94124 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40cc0035e0 con 0x7f40fc08ae20 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935848304 0 0) 0x7f40fc08d9c0 con 0x7f40fc08c730 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): my global_id is 74289 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40fc088810 con 0x7f40fc08c730 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f4101c82640 1 -- 10.20.193.57:0/1491690144 >> v1:10.20.193.82:6789/0 conn(0x7f40fc08cb30 legacy=0x7f40fc195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982205782 0 0) 0x7f40fc088020 con 0x7f40fc08cb30 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): my global_id is 5044 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40fc08d9c0 con 0x7f40fc08cb30 2026-02-12T17:41:31.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 920352745 0 0) 0x7f40fc088810 con 0x7f40fc08c730 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40fc088020 con 0x7f40fc08c730 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f40f0003380 con 0x7f40fc08c730 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): dump: 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2294174303 0 0) 0x7f40cc0035e0 con 0x7f40fc08ae20 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40fc088810 con 0x7f40fc08ae20 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f40ec003880 con 0x7f40fc08ae20 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient(hunting): dump: 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3261545981 0 0) 0x7f40fc088020 con 0x7f40fc08c730 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 >> v1:10.20.193.57:6790/0 conn(0x7f40fc08ae20 legacy=0x7f40fc152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 >> v1:10.20.193.82:6789/0 conn(0x7f40fc08cb30 legacy=0x7f40fc195860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 monclient: found mon.a 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc083180 con 0x7f40fc08c730 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient: _finish_auth 0 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f40e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f410370c640 5 monclient: authenticate success, global_id 74289 2026-02-12T17:41:31.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f410370c640 10 monclient: _renew_subs 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f410370c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc0854e0 con 0x7f40fc08c730 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f410370c640 10 monclient: _renew_subs 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f410370c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.214+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f40fc083ce0 con 0x7f40fc08c730 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f40f0004b50 con 0x7f40fc08c730 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f40e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f40f0004ea0 con 0x7f40fc08c730 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f40e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f40e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f40e9ffb640 10 monclient: dump: 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f40eb7fe640 4 set_mon_vals no callback set 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f410370c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f410370c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f410370c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40fc0008d0 con 0x7f40fc08c730 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f40f00050f0 con 0x7f40fc08c730 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.215+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(669..669 src has 461..669) ==== 3947+0+0 (unknown 2605875505 0 0) 0x7f40f004ebb0 con 0x7f40fc08c730 2026-02-12T17:41:31.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.216+0000 7f4101481640 10 monclient: get_auth_request con 0x7f40cc03fb90 auth_method 0 2026-02-12T17:41:31.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.218+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f40f0016c50 con 0x7f40fc08c730 2026-02-12T17:41:31.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.218+0000 7f40e9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:31.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.218+0000 7f40e9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:31.358 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.361+0000 7f410370c640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:41:31.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.361+0000 7f410370c640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:41:31.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.361+0000 7f410370c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:31.359 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.361+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f40fc08f520 con 0x7f40fc08c730 2026-02-12T17:41:31.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.362+0000 7f40e9ffb640 1 -- 10.20.193.57:0/1491690144 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f40f0016a70 con 0x7f40fc08c730 2026-02-12T17:41:31.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.362+0000 7f40e9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:41:31.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.362+0000 7f40e9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=18,config=2,health=13,kv=11,logm=56} crc {auth=1817431234,config=1618278320,health=3811746669,kv=1466688342,logm=3250425140}) 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=13,kv=9,logm=59} crc {auth=3730002391,config=1618278320,health=3811746669,kv=2008843389,logm=4161702198}) 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=18,config=2,health=13,kv=11,logm=56} crc {auth=1817431234,config=1618278320,health=3811746669,kv=1466688342,logm=3250425140}) 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=8,logm=61} crc {auth=466168161,config=1618278320,health=327327691,kv=2898404607,logm=1304379186}) 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1930719648}) 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=812528589}) 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1930719648}) 2026-02-12T17:41:31.360 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3276507907}) 2026-02-12T17:41:31.361 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.361 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1324276243}) 2026-02-12T17:41:31.361 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688634521}) 2026-02-12T17:41:31.361 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.361 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1324276243}) 2026-02-12T17:41:31.361 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2121122924}) 2026-02-12T17:41:31.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.363+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 >> v1:10.20.193.82:6800/2441377515 conn(0x7f40cc03fb90 legacy=0x7f40cc060040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.363+0000 7f410370c640 10 monclient: shutdown 2026-02-12T17:41:31.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.363+0000 7f410370c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:31.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.363+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 >> v1:10.20.193.57:6789/0 conn(0x7f40fc08c730 legacy=0x7f40fc194140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:31.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.363+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 shutdown_connections 2026-02-12T17:41:31.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.363+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 >> 10.20.193.57:0/1491690144 conn(0x7f40fc091620 msgr2=0x7f40fc089310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:31.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.363+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 shutdown_connections 2026-02-12T17:41:31.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:31.363+0000 7f410370c640 1 -- 10.20.193.57:0/1491690144 wait complete. 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3814024176}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1101070838}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3814024176}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3557749766}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=907970754}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2976707598}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=907970754}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4237198366}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2314168301}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238660140}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2314168301}) 2026-02-12T17:41:31.362 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3233646788}) 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3370306925}) 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3330481079}) 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3370306925}) 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2323105312}) 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1366848917}) 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244065187}) 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1366848917}) 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2080707367}) 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.363 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2692193735}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3271041482}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2692193735}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=753646199}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2513504291}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=453659547}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2513504291}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3339799757}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1400266463}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4019944122}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1400266463}) 2026-02-12T17:41:31.364 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=635167399}) 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2576580066}) 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=522932772}) 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2576580066}) 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2943299066}) 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=669750020}) 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=111159405}) 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=669750020}) 2026-02-12T17:41:31.365 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3562048667}) 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3333094829}) 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2595802356}) 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3333094829}) 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3106277789}) 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1447741088}) 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2927193411}) 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1447741088}) 2026-02-12T17:41:31.366 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1151346508}) 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=684787252}) 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3490741263}) 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=684787252}) 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.365+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=951588908}) 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4120338430}) 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=298969589}) 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4120338430}) 2026-02-12T17:41:31.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=800044040}) 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1843116360}) 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=483747612}) 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1843116360}) 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.366+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1743505559}) 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3356032430}) 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1617679482}) 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3356032430}) 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3930402119}) 2026-02-12T17:41:31.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3245048645}) 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=241381632}) 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3245048645}) 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.367+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3552092047}) 2026-02-12T17:41:31.369 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1184676068}) 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3263502661}) 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1184676068}) 2026-02-12T17:41:31.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1592072577}) 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2369651891}) 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287739975}) 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2369651891}) 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.368+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=716013490}) 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2628946460}) 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1452816901}) 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2628946460}) 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1161210249}) 2026-02-12T17:41:31.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=354764261}) 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=159100138}) 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=354764261}) 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.369+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2201310803}) 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=486587024}) 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=888132412}) 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=486587024}) 2026-02-12T17:41:31.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1524815061}) 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2810601786}) 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3873712498}) 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2810601786}) 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.370+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2708099192}) 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1501132336}) 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1401948439}) 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1501132336}) 2026-02-12T17:41:31.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2316304943}) 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2934952505}) 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4274092321}) 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2934952505}) 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.371+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=178021995}) 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=611186896}) 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1111066854}) 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=611186896}) 2026-02-12T17:41:31.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2436008591}) 2026-02-12T17:41:31.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2485398885,mdsmap=2204869053,mgr=2026909952}) 2026-02-12T17:41:31.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=95,mdsmap=3,mgr=2} crc {logm=2061356989,mdsmap=2204869053,mgr=2935658188}) 2026-02-12T17:41:31.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=2485398885,mdsmap=2204869053,mgr=2026909952}) 2026-02-12T17:41:31.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.372+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=95,mdsmap=3,mgr=2} crc {logm=1155834660,mdsmap=2204869053,mgr=2935658188}) 2026-02-12T17:41:31.713 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.710+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.713 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.710+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=62} crc {mgr=2586702516,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3906399647,mon_config_key=383892656,monmap=2432750869,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1927390216,osd_snap=1914514046}) 2026-02-12T17:41:31.713 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.710+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=62} crc {mgr=2586702516,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3906399647,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=2583317809,osd_pg_creating=1927390216,osd_snap=4092785719}) 2026-02-12T17:41:31.713 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.710+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.713 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.710+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=62} crc {mgr=2586702516,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3906399647,mon_config_key=383892656,monmap=2432750869,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1927390216,osd_snap=1914514046}) 2026-02-12T17:41:31.714 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.710+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgr=2,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=62} crc {mgr=2586702516,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3906399647,mon_config_key=2771891197,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1927390216,osd_snap=861955482}) 2026-02-12T17:41:31.734 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.732+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.734 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.732+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=57,osdmap=43} crc {osd_snap=3852438224,osdmap=2591226885}) 2026-02-12T17:41:31.734 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.732+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=58,osdmap=42} crc {osd_snap=1452998078,osdmap=2437137724}) 2026-02-12T17:41:31.734 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.732+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.734 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.732+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=57,osdmap=43} crc {osd_snap=3852438224,osdmap=2591226885}) 2026-02-12T17:41:31.735 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.732+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=58,osdmap=42} crc {osd_snap=1909553713,osdmap=3799546429}) 2026-02-12T17:41:31.762 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.762 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1645417281}) 2026-02-12T17:41:31.762 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1370741500}) 2026-02-12T17:41:31.762 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.762 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1645417281}) 2026-02-12T17:41:31.762 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2572310489}) 2026-02-12T17:41:31.763 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.763 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3519044621}) 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3452717429}) 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3519044621}) 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.760+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1728182666}) 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.761+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.761+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=65} crc {osdmap=3432756489}) 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.761+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=62} crc {osdmap=2948455571}) 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.761+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.761+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=65} crc {osdmap=3432756489}) 2026-02-12T17:41:31.764 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:41:31.761+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=65} crc {osdmap=4181425756}) 2026-02-12T17:41:32.148 INFO:tasks.rados.rados.0.trial082.stdout:3076: done (0 left) 2026-02-12T17:41:32.148 INFO:tasks.rados.rados.0.trial082.stdout:3077: snap_create 2026-02-12T17:41:32.370 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:41:32.370 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:41:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient: get_monmap_and_config 2026-02-12T17:41:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient: build_initial_monmap 2026-02-12T17:41:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient: monmap: 2026-02-12T17:41:32.437 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:32.437 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.437 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:32.440978+0000 2026-02-12T17:41:32.437 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:32.440978+0000 2026-02-12T17:41:32.437 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:32.437 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.438 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:32.438 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:32.438 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 1 Processor -- start 2026-02-12T17:41:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 1 -- start start 2026-02-12T17:41:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient: init 2026-02-12T17:41:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient(hunting): picked mon.noname-b con 0x7f158808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient(hunting): picked mon.noname-c con 0x7f158808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient(hunting): picked mon.noname-a con 0x7f158808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158808d600 con 0x7f158808cb30 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158808b1f0 con 0x7f158808c730 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158808d1f0 con 0x7f158808ae20 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f158e85b640 10 monclient(hunting): authenticate will time out at 1372.259862s 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f1587fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f158808ae20 0x7f158808c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39846/0 (socket says 10.20.193.57:39846) 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.439+0000 7f1587fff640 1 -- 10.20.193.57:0/1823253685 learned_addr learned my addr 10.20.193.57:0/1823253685 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1587fff640 1 -- 10.20.193.57:0/1823253685 >> v1:10.20.193.57:6790/0 conn(0x7f158808ae20 legacy=0x7f158808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f158cdd1640 1 -- 10.20.193.57:0/1823253685 >> v1:10.20.193.57:6789/0 conn(0x7f158808cb30 legacy=0x7f15881a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2312318198 0 0) 0x7f158808d1f0 con 0x7f158808ae20 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): my global_id is 94127 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f15877fe640 1 -- 10.20.193.57:0/1823253685 >> v1:10.20.193.82:6789/0 conn(0x7f158808c730 legacy=0x7f1588181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f156c0035e0 con 0x7f158808ae20 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511644458 0 0) 0x7f158808d600 con 0x7f158808cb30 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): my global_id is 74292 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158808d1f0 con 0x7f158808cb30 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123521112 0 0) 0x7f158808b1f0 con 0x7f158808c730 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient(hunting): my global_id is 5047 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158808d600 con 0x7f158808c730 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1033306987 0 0) 0x7f156c0035e0 con 0x7f158808ae20 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 >> v1:10.20.193.82:6789/0 conn(0x7f158808c730 legacy=0x7f1588181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 >> v1:10.20.193.57:6789/0 conn(0x7f158808cb30 legacy=0x7f15881a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 monclient: found mon.noname-b 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1588057320 con 0x7f158808ae20 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: _finish_auth 0 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f15740030c0 con 0x7f158808ae20 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: dump: 2026-02-12T17:41:32.447 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f158e85b640 5 monclient: authenticate success, global_id 94127 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f158e85b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:32.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1574003350 con 0x7f158808ae20 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 1 -- 10.20.193.57:0/1823253685 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1574004960 con 0x7f158808ae20 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f1586ffd640 10 monclient: dump: 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.449 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f158e85b640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f158e85b640 4 set_mon_vals no callback set 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f158e85b640 10 monclient: shutdown 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f158e85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.442+0000 7f158e85b640 1 -- 10.20.193.57:0/1823253685 >> v1:10.20.193.57:6790/0 conn(0x7f158808ae20 legacy=0x7f158808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 1 -- 10.20.193.57:0/1823253685 shutdown_connections 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 1 -- 10.20.193.57:0/1823253685 >> 10.20.193.57:0/1823253685 conn(0x7f1588091620 msgr2=0x7f1588091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 1 -- 10.20.193.57:0/1823253685 shutdown_connections 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 1 -- 10.20.193.57:0/1823253685 wait complete. 2026-02-12T17:41:32.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient: build_initial_monmap 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient: monmap: 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 1 Processor -- start 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 1 -- start start 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient: init 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient(hunting): picked mon.noname-b con 0x7f158808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient(hunting): picked mon.noname-a con 0x7f158808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient(hunting): picked mon.noname-c con 0x7f158808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158808d9c0 con 0x7f158808c730 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158805cd30 con 0x7f158808ae20 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158805b190 con 0x7f158808cb30 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.443+0000 7f158e85b640 10 monclient(hunting): authenticate will time out at 1372.263975s 2026-02-12T17:41:32.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.444+0000 7f158cdd1640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f158808cb30 0x7f15881a2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39850/0 (socket says 10.20.193.57:39850) 2026-02-12T17:41:32.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.444+0000 7f15877fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f158808c730 0x7f1588089230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34330/0 (socket says 10.20.193.57:34330) 2026-02-12T17:41:32.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.444+0000 7f158cdd1640 1 -- 10.20.193.57:0/1163191830 learned_addr learned my addr 10.20.193.57:0/1163191830 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:32.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f158cdd1640 1 -- 10.20.193.57:0/1163191830 >> v1:10.20.193.57:6790/0 conn(0x7f158808cb30 legacy=0x7f15881a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f15877fe640 1 -- 10.20.193.57:0/1163191830 >> v1:10.20.193.57:6789/0 conn(0x7f158808c730 legacy=0x7f1588089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895904952 0 0) 0x7f158805b190 con 0x7f158808cb30 2026-02-12T17:41:32.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): my global_id is 94130 2026-02-12T17:41:32.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15580035e0 con 0x7f158808cb30 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757198599 0 0) 0x7f158808d9c0 con 0x7f158808c730 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): my global_id is 74295 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158805b190 con 0x7f158808c730 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1587fff640 1 -- 10.20.193.57:0/1163191830 >> v1:10.20.193.82:6789/0 conn(0x7f158808ae20 legacy=0x7f1588088b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1399639028 0 0) 0x7f15580035e0 con 0x7f158808cb30 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f158808d9c0 con 0x7f158808cb30 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f157c0044f0 con 0x7f158808cb30 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:32.458 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): dump: 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2394708951 0 0) 0x7f158808d9c0 con 0x7f158808cb30 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 >> v1:10.20.193.82:6789/0 conn(0x7f158808ae20 legacy=0x7f1588088b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 >> v1:10.20.193.57:6789/0 conn(0x7f158808c730 legacy=0x7f1588089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 monclient: found mon.c 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1588089940 con 0x7f158808cb30 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient: _finish_auth 0 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:32.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f158e85b640 5 monclient: authenticate success, global_id 94130 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f158e85b640 10 monclient: _renew_subs 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f158e85b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f158811f2d0 con 0x7f158808cb30 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f158e85b640 10 monclient: _renew_subs 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f158e85b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1588088810 con 0x7f158808cb30 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f157c004a60 con 0x7f158808cb30 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f157c004db0 con 0x7f158808cb30 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f1584ff9640 10 monclient: dump: 2026-02-12T17:41:32.461 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.446+0000 7f15867fc640 4 set_mon_vals no callback set 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.447+0000 7f158e85b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:32.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.447+0000 7f158e85b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:32.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.447+0000 7f158e85b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.447+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15880008d0 con 0x7f158808cb30 2026-02-12T17:41:32.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.447+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f157c005000 con 0x7f158808cb30 2026-02-12T17:41:32.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.447+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(670..670 src has 461..670) ==== 3975+0+0 (unknown 4256648994 0 0) 0x7f157c04fcf0 con 0x7f158808cb30 2026-02-12T17:41:32.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.447+0000 7f1587fff640 10 monclient: get_auth_request con 0x7f155803f830 auth_method 0 2026-02-12T17:41:32.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.449+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f157c018430 con 0x7f158808cb30 2026-02-12T17:41:32.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.449+0000 7f1584ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:32.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.449+0000 7f1584ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:32.589 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.591+0000 7f158e85b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:41:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.591+0000 7f158e85b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.591+0000 7f158e85b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.591+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f158808f520 con 0x7f158808cb30 2026-02-12T17:41:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.591+0000 7f1584ff9640 1 -- 10.20.193.57:0/1163191830 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 4227281406) 0x7f157c017be0 con 0x7f158808cb30 2026-02-12T17:41:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.591+0000 7f1584ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:32.590 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.591+0000 7f1584ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:32.590 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:41:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.592+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 >> v1:10.20.193.82:6800/2441377515 conn(0x7f155803f830 legacy=0x7f155805fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.591 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.592+0000 7f158e85b640 10 monclient: shutdown 2026-02-12T17:41:32.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.592+0000 7f158e85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:32.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.592+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 >> v1:10.20.193.57:6790/0 conn(0x7f158808cb30 legacy=0x7f15881a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.592+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 shutdown_connections 2026-02-12T17:41:32.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.592+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 >> 10.20.193.57:0/1163191830 conn(0x7f1588091620 msgr2=0x7f15880597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:32.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.592+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 shutdown_connections 2026-02-12T17:41:32.592 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.592+0000 7f158e85b640 1 -- 10.20.193.57:0/1163191830 wait complete. 2026-02-12T17:41:32.598 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:41:32.598 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:41:32.598 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:41:32.598 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:41:32.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 10 monclient: get_monmap_and_config 2026-02-12T17:41:32.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 10 monclient: build_initial_monmap 2026-02-12T17:41:32.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 10 monclient: monmap: 2026-02-12T17:41:32.665 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:32.665 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:32.668165+0000 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:32.668165+0000 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 1 Processor -- start 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 1 -- start start 2026-02-12T17:41:32.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 10 monclient: init 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 10 monclient(hunting): picked mon.noname-c con 0x7f4f9c08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.666+0000 7f4fa43dd640 10 monclient(hunting): picked mon.noname-a con 0x7f4f9c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.667+0000 7f4fa43dd640 10 monclient(hunting): picked mon.noname-b con 0x7f4f9c182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.667+0000 7f4fa43dd640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c08a820 con 0x7f4f9c08c620 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.667+0000 7f4fa43dd640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c089450 con 0x7f4f9c08c250 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.667+0000 7f4fa43dd640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c089730 con 0x7f4f9c182cc0 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.667+0000 7f4fa43dd640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.667+0000 7f4fa43dd640 10 monclient(hunting): authenticate will time out at 1372.487037s 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.667+0000 7f4fa2152640 1 --1- >> v1:10.20.193.82:6789/0 conn(0x7f4f9c08c250 0x7f4f9c08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:37890/0 (socket says 10.20.193.57:37890) 2026-02-12T17:41:32.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.667+0000 7f4fa2152640 1 -- 10.20.193.57:0/1063415326 learned_addr learned my addr 10.20.193.57:0/1063415326 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:32.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.667+0000 7f4fa1951640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f4f9c08c620 0x7f4f9c08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34338/0 (socket says 10.20.193.57:34338) 2026-02-12T17:41:32.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1951640 1 -- 10.20.193.57:0/1063415326 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c08c620 legacy=0x7f4f9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa2953640 1 -- 10.20.193.57:0/1063415326 >> v1:10.20.193.57:6790/0 conn(0x7f4f9c182cc0 legacy=0x7f4f9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa2152640 1 -- 10.20.193.57:0/1063415326 >> v1:10.20.193.82:6789/0 conn(0x7f4f9c08c250 legacy=0x7f4f9c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828460061 0 0) 0x7f4f90002c20 con 0x7f4f9c08c620 2026-02-12T17:41:32.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): my global_id is 74298 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f840035e0 con 0x7f4f9c08c620 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 998545310 0 0) 0x7f4f9c089730 con 0x7f4f9c182cc0 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): my global_id is 94133 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f90002c20 con 0x7f4f9c182cc0 2026-02-12T17:41:32.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990464907 0 0) 0x7f4f9c089450 con 0x7f4f9c08c250 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient(hunting): my global_id is 5053 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f9c089730 con 0x7f4f9c08c250 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3713020126 0 0) 0x7f4f840035e0 con 0x7f4f9c08c620 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 >> v1:10.20.193.57:6790/0 conn(0x7f4f9c182cc0 legacy=0x7f4f9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 >> v1:10.20.193.82:6789/0 conn(0x7f4f9c08c250 legacy=0x7f4f9c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: _finish_hunting 0 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 monclient: found mon.noname-a 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:32.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c089a10 con 0x7f4f9c08c620 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: _finish_auth 0 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: _check_auth_tickets 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4f90003260 con 0x7f4f9c08c620 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: dump: 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.679 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa43dd640 5 monclient: authenticate success, global_id 74298 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa43dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f900034f0 con 0x7f4f9c08c620 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 1 -- 10.20.193.57:0/1063415326 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4f90004a50 con 0x7f4f9c08c620 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.680 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa1150640 10 monclient: dump: 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa43dd640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.669+0000 7f4fa43dd640 4 set_mon_vals no callback set 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 10 monclient: shutdown 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 1 -- 10.20.193.57:0/1063415326 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c08c620 legacy=0x7f4f9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 1 -- 10.20.193.57:0/1063415326 shutdown_connections 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 1 -- 10.20.193.57:0/1063415326 >> 10.20.193.57:0/1063415326 conn(0x7f4f9c0916b0 msgr2=0x7f4f9c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 1 -- 10.20.193.57:0/1063415326 shutdown_connections 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 1 -- 10.20.193.57:0/1063415326 wait complete. 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 10 monclient: build_initial_monmap 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 10 monclient: monmap: 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:32.682 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.670+0000 7f4fa43dd640 1 Processor -- start 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 1 -- start start 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 10 monclient: init 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:41:32.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 10 monclient(hunting): picked mon.noname-b con 0x7f4f9c08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 10 monclient(hunting): picked mon.noname-c con 0x7f4f9c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 10 monclient(hunting): picked mon.noname-a con 0x7f4f9c182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c1392d0 con 0x7f4f9c182cc0 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c13a7f0 con 0x7f4f9c08c250 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9c18ffe0 con 0x7f4f9c08c620 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa43dd640 10 monclient(hunting): authenticate will time out at 1372.491281s 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa1951640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f4f9c08c620 0x7f4f9c18f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39864/0 (socket says 10.20.193.57:39864) 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.671+0000 7f4fa1951640 1 -- 10.20.193.57:0/554432827 learned_addr learned my addr 10.20.193.57:0/554432827 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa1951640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6790/0 conn(0x7f4f9c08c620 legacy=0x7f4f9c18f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa2953640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c182cc0 legacy=0x7f4f9c195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa2953640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c182cc0 legacy=0x7f4f9c195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa2953640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c182cc0 legacy=0x7f4f9c195530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa2953640 1 --1- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c182cc0 0x7f4f9c195530 :-1 s=OPENED pgs=496 gs=3 cs=1 l=1).handle_message read tag failed 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa2953640 1 --1- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c182cc0 0x7f4f9c195530 :-1 s=OPENED pgs=496 gs=3 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.57:6789/0 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986190386 0 0) 0x7f4f9c18ffe0 con 0x7f4f9c08c620 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient(hunting): my global_id is 94136 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f6c0035e0 con 0x7f4f9c08c620 2026-02-12T17:41:32.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa2152640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.82:6789/0 conn(0x7f4f9c08c250 legacy=0x7f4f9c18f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3991741844 0 0) 0x7f4f6c0035e0 con 0x7f4f9c08c620 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f9c18ffe0 con 0x7f4f9c08c620 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4f90004a50 con 0x7f4f9c08c620 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient(hunting): dump: 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.686 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2338411989 0 0) 0x7f4f9c18ffe0 con 0x7f4f9c08c620 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.82:6789/0 conn(0x7f4f9c08c250 legacy=0x7f4f9c18f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c182cc0 legacy=0x7f4f9c195530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 monclient: found mon.c 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c13aad0 con 0x7f4f9c08c620 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient: _finish_auth 0 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4f82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa43dd640 5 monclient: authenticate success, global_id 94136 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa43dd640 10 monclient: _renew_subs 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa43dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c13ea00 con 0x7f4f9c08c620 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa43dd640 10 monclient: _renew_subs 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa43dd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.673+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f9c13a510 con 0x7f4f9c08c620 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f90005030 con 0x7f4f9c08c620 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4f82ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:32.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4f90002bc0 con 0x7f4f9c08c620 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4f82ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4f82ffd640 10 monclient: dump: 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.689 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4fa094f640 4 set_mon_vals no callback set 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4fa43dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f9c190e20 con 0x7f4f9c190a50 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f4f90011e60 con 0x7f4f9c08c620 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(670..670 src has 461..670) ==== 3975+0+0 (unknown 4256648994 0 0) 0x7f4f9004ebc0 con 0x7f4f9c08c620 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.674+0000 7f4fa2953640 10 monclient: get_auth_request con 0x7f4f6c03f6d0 auth_method 0 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4fa2152640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c190a50 legacy=0x7f4f9c085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1281762870 0 0) 0x7f4f9c190e20 con 0x7f4f9c190a50 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 10 monclient(hunting): my global_id is 74301 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f9c18ffe0 con 0x7f4f9c190a50 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 512224752 0 0) 0x7f4f9c18ffe0 con 0x7f4f9c190a50 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f9c190e20 con 0x7f4f9c190a50 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4f8c002ca0 con 0x7f4f9c190a50 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 10 monclient: dump: 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.691 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 165582459 0 0) 0x7f4f9c190e20 con 0x7f4f9c190a50 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.676+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f9c090810 con 0x7f4f9c190a50 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.677+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4f8c0048a0 con 0x7f4f9c190a50 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.677+0000 7f4f82ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.677+0000 7f4f82ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.677+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c190a50 legacy=0x7f4f9c085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.677+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c190a50 legacy=0x7f4f9c085720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.680+0000 7f4fa43dd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:41:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.680+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f9c1387d0 con 0x7f4f9c085e30 2026-02-12T17:41:32.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.682+0000 7f4fa2152640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c085e30 legacy=0x7f4f9c197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.682+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620988678 0 0) 0x7f4f9c1387d0 con 0x7f4f9c085e30 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.682+0000 7f4f82ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.682+0000 7f4f82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.682+0000 7f4f82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.682+0000 7f4f82ffd640 10 monclient(hunting): my global_id is 74304 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.682+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f9c190e20 con 0x7f4f9c085e30 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1782687277 0 0) 0x7f4f9c190e20 con 0x7f4f9c085e30 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f9c1387d0 con 0x7f4f9c085e30 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4f8c004e30 con 0x7f4f9c085e30 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:32.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 10 monclient: dump: 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2696443743 0 0) 0x7f4f9c1387d0 con 0x7f4f9c085e30 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f9c13e770 con 0x7f4f9c085e30 2026-02-12T17:41:32.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 1514160702) 0x7f4f8c007070 con 0x7f4f9c085e30 2026-02-12T17:41:32.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:41:32.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:32.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c085e30 legacy=0x7f4f9c197c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4f82ffd640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6789/0 conn(0x7f4f9c085e30 legacy=0x7f4f9c197c60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:32.697 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:41:32.697 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:32.697 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:32.697 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:41:32.697 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 52, 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 219147, 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 1, 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:32.698 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:41:32.699 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:32.700 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:41:32.701 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:32.702 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:32.703 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.704 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:41:32.705 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:32.706 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:32.707 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:41:32.708 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:41:32.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.82:6800/2441377515 conn(0x7f4f6c03f6d0 legacy=0x7f4f6c05fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa43dd640 10 monclient: shutdown 2026-02-12T17:41:32.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa43dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 >> v1:10.20.193.57:6790/0 conn(0x7f4f9c08c620 legacy=0x7f4f9c18f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa2953640 1 -- 10.20.193.57:0/554432827 reap_dead start 2026-02-12T17:41:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa2953640 1 -- 10.20.193.57:0/554432827 reap_dead start 2026-02-12T17:41:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 shutdown_connections 2026-02-12T17:41:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 >> 10.20.193.57:0/554432827 conn(0x7f4f9c0916b0 msgr2=0x7f4f9c1911e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 shutdown_connections 2026-02-12T17:41:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.683+0000 7f4fa43dd640 1 -- 10.20.193.57:0/554432827 wait complete. 2026-02-12T17:41:32.710 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:41:32.710 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:41:32.710 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.778+0000 7f828a45b640 10 monclient: get_monmap_and_config 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.778+0000 7f828a45b640 10 monclient: build_initial_monmap 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.778+0000 7f828a45b640 10 monclient: monmap: 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:32.780425+0000 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:32.780425+0000 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:32.776 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:32.777 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:32.777 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.777 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.778+0000 7f828a45b640 1 Processor -- start 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 1 -- start start 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 10 monclient: init 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 10 monclient(hunting): picked mon.noname-b con 0x7f828408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 10 monclient(hunting): picked mon.noname-a con 0x7f828408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 10 monclient(hunting): picked mon.noname-c con 0x7f8284182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828408a820 con 0x7f828408c620 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8284089450 con 0x7f8284182cc0 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8284089730 con 0x7f828408c250 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f828a45b640 10 monclient(hunting): authenticate will time out at 1372.599308s 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f8283fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 0x7f828408a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39878/0 (socket says 10.20.193.57:39878) 2026-02-12T17:41:32.778 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.779+0000 7f8283fff640 1 -- 10.20.193.57:0/1081510587 learned_addr learned my addr 10.20.193.57:0/1081510587 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f82837fe640 1 -- 10.20.193.57:0/1081510587 >> v1:10.20.193.57:6789/0 conn(0x7f828408c620 legacy=0x7f828408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8283fff640 1 -- 10.20.193.57:0/1081510587 >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 legacy=0x7f828408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014899569 0 0) 0x7f8274002c70 con 0x7f828408c620 2026-02-12T17:41:32.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient(hunting): my global_id is 74307 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82680035e0 con 0x7f828408c620 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 460933789 0 0) 0x7f8284089730 con 0x7f828408c250 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient(hunting): my global_id is 94139 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8274002c70 con 0x7f828408c250 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f82889d1640 1 -- 10.20.193.57:0/1081510587 >> v1:10.20.193.82:6789/0 conn(0x7f8284182cc0 legacy=0x7f82841a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 409377653 0 0) 0x7f82680035e0 con 0x7f828408c620 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 legacy=0x7f828408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 >> v1:10.20.193.82:6789/0 conn(0x7f8284182cc0 legacy=0x7f82841a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 monclient: found mon.noname-a 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8284089a10 con 0x7f828408c620 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: _finish_auth 0 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f82740032b0 con 0x7f828408c620 2026-02-12T17:41:32.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f828a45b640 5 monclient: authenticate success, global_id 74307 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: dump: 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.785 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f828a45b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82740036d0 con 0x7f828408c620 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 1 -- 10.20.193.57:0/1081510587 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8274003a20 con 0x7f828408c620 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f828a45b640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f828a45b640 4 set_mon_vals no callback set 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.781+0000 7f8282ffd640 10 monclient: dump: 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.786 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 10 monclient: shutdown 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 1 -- 10.20.193.57:0/1081510587 >> v1:10.20.193.57:6789/0 conn(0x7f828408c620 legacy=0x7f828408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 1 -- 10.20.193.57:0/1081510587 shutdown_connections 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 1 -- 10.20.193.57:0/1081510587 >> 10.20.193.57:0/1081510587 conn(0x7f82840916b0 msgr2=0x7f8284091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 1 -- 10.20.193.57:0/1081510587 shutdown_connections 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 1 -- 10.20.193.57:0/1081510587 wait complete. 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 10 monclient: build_initial_monmap 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 10 monclient: monmap: 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:32.788 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 1 Processor -- start 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 1 -- start start 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.782+0000 7f828a45b640 10 monclient: init 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 10 monclient(hunting): picked mon.noname-c con 0x7f828408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 10 monclient(hunting): picked mon.noname-b con 0x7f828408c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 10 monclient(hunting): picked mon.noname-a con 0x7f8284182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82840888a0 con 0x7f8284182cc0 2026-02-12T17:41:32.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828405e060 con 0x7f828408c620 2026-02-12T17:41:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8284136920 con 0x7f828408c250 2026-02-12T17:41:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f828a45b640 10 monclient(hunting): authenticate will time out at 1372.603067s 2026-02-12T17:41:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f8283fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 0x7f828405a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39888/0 (socket says 10.20.193.57:39888) 2026-02-12T17:41:32.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.783+0000 7f8283fff640 1 -- 10.20.193.57:0/2225359721 learned_addr learned my addr 10.20.193.57:0/2225359721 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:32.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8283fff640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 legacy=0x7f828405a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f82889d1640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6789/0 conn(0x7f8284182cc0 legacy=0x7f8284193550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8283fff640 1 --1- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 0x7f828405a840 :-1 s=OPENED pgs=263 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f8284136920 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294927586 0 0) 0x7f82840888a0 con 0x7f8284182cc0 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient(hunting): my global_id is 74310 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82540035e0 con 0x7f8284182cc0 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f82837fe640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.82:6789/0 conn(0x7f828408c620 legacy=0x7f828405af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4061407616 0 0) 0x7f82540035e0 con 0x7f8284182cc0 2026-02-12T17:41:32.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82840888a0 con 0x7f8284182cc0 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8278004420 con 0x7f8284182cc0 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient(hunting): dump: 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.797 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1163926028 0 0) 0x7f82840888a0 con 0x7f8284182cc0 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6790/0 conn(0x7f828408c250 legacy=0x7f828405a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.82:6789/0 conn(0x7f828408c620 legacy=0x7f828405af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 monclient: found mon.a 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828405b660 con 0x7f8284182cc0 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient: _finish_auth 0 2026-02-12T17:41:32.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f828a45b640 5 monclient: authenticate success, global_id 74310 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155436772 0 0) 0x7f8284136920 con 0x7f828408c250 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f828a45b640 10 monclient: _renew_subs 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f828a45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f828413e900 con 0x7f8284182cc0 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f828a45b640 10 monclient: _renew_subs 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f828a45b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8284084f20 con 0x7f8284182cc0 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8278004600 con 0x7f8284182cc0 2026-02-12T17:41:32.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8278004c10 con 0x7f8284182cc0 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f82827fc640 4 set_mon_vals no callback set 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.785+0000 7f8280ff9640 10 monclient: dump: 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.800 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.786+0000 7f828a45b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.786+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8284090810 con 0x7f828413e300 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.786+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f8278004ea0 con 0x7f8284182cc0 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.786+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(670..670 src has 461..670) ==== 3975+0+0 (unknown 4256648994 0 0) 0x7f827804fc90 con 0x7f8284182cc0 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.786+0000 7f82837fe640 10 monclient: get_auth_request con 0x7f825403f6e0 auth_method 0 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8283fff640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6790/0 conn(0x7f828413e300 legacy=0x7f828418d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884620198 0 0) 0x7f8284090810 con 0x7f828413e300 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 10 monclient(hunting): my global_id is 94145 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8284136920 con 0x7f828413e300 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1966714594 0 0) 0x7f8284136920 con 0x7f828413e300 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8284090810 con 0x7f828413e300 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8270002f00 con 0x7f828413e300 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 10 monclient: dump: 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.802 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 369784573 0 0) 0x7f8284090810 con 0x7f828413e300 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.788+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f828405ced0 con 0x7f828413e300 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.789+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f82700049d0 con 0x7f828413e300 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.789+0000 7f8280ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.789+0000 7f8280ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.789+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6790/0 conn(0x7f828413e300 legacy=0x7f828418d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.789+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6790/0 conn(0x7f828413e300 legacy=0x7f828418d340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.792+0000 7f828a45b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.792+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f828413e6d0 con 0x7f828418da50 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8283fff640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6790/0 conn(0x7f828418da50 legacy=0x7f8284195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467835224 0 0) 0x7f828413e6d0 con 0x7f828418da50 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 10 monclient(hunting): my global_id is 94148 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8284090810 con 0x7f828418da50 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 874844078 0 0) 0x7f8284090810 con 0x7f828418da50 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f828413e6d0 con 0x7f828418da50 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8270004ff0 con 0x7f828418da50 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.804 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 10 monclient: dump: 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 875327054 0 0) 0x7f828413e6d0 con 0x7f828418da50 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.794+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f828408f5b0 con 0x7f828418da50 2026-02-12T17:41:32.805 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4336 (unknown 0 0 812758263) 0x7f82700072b0 con 0x7f828418da50 2026-02-12T17:41:32.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f8280ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:41:32.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f8280ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:32.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6790/0 conn(0x7f828418da50 legacy=0x7f8284195c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.806 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f8280ff9640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6790/0 conn(0x7f828418da50 legacy=0x7f8284195c80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:32.806 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:41:32.806 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:32.806 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:32.806 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:41:32.806 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 52, 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 2097, 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:32.807 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:41:32.808 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:32.809 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:41:32.810 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:32.811 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.812 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:32.813 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:32.814 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:41:32.815 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:41:32.816 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:41:32.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.82:6800/2441377515 conn(0x7f825403f6e0 legacy=0x7f825405fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f828a45b640 10 monclient: shutdown 2026-02-12T17:41:32.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f828a45b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:32.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 >> v1:10.20.193.57:6789/0 conn(0x7f8284182cc0 legacy=0x7f8284193550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f82889d1640 1 -- 10.20.193.57:0/2225359721 reap_dead start 2026-02-12T17:41:32.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 shutdown_connections 2026-02-12T17:41:32.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 >> 10.20.193.57:0/2225359721 conn(0x7f82840916b0 msgr2=0x7f828408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:32.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 shutdown_connections 2026-02-12T17:41:32.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.795+0000 7f828a45b640 1 -- 10.20.193.57:0/2225359721 wait complete. 2026-02-12T17:41:32.818 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:41:32.818 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:41:32.818 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:41:32.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.886+0000 7f045a70c640 10 monclient: get_monmap_and_config 2026-02-12T17:41:32.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.886+0000 7f045a70c640 10 monclient: build_initial_monmap 2026-02-12T17:41:32.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.886+0000 7f045a70c640 10 monclient: monmap: 2026-02-12T17:41:32.884 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:32.884 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:32.888194+0000 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:32.888194+0000 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.886+0000 7f045a70c640 1 Processor -- start 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.886+0000 7f045a70c640 1 -- start start 2026-02-12T17:41:32.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.886+0000 7f045a70c640 10 monclient: init 2026-02-12T17:41:32.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 10 monclient(hunting): picked mon.noname-c con 0x7f045408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 10 monclient(hunting): picked mon.noname-a con 0x7f045408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 10 monclient(hunting): picked mon.noname-b con 0x7f0454182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045408a820 con 0x7f045408c620 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0454089450 con 0x7f045408c250 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0454089730 con 0x7f0454182cc0 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f045a70c640 10 monclient(hunting): authenticate will time out at 1372.707072s 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f04537fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f045408c620 0x7f045408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34388/0 (socket says 10.20.193.57:34388) 2026-02-12T17:41:32.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f0458c82640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0454182cc0 0x7f04541a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:39918/0 (socket says 10.20.193.57:39918) 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.887+0000 7f04537fe640 1 -- 10.20.193.57:0/2434847585 learned_addr learned my addr 10.20.193.57:0/2434847585 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f04537fe640 1 -- 10.20.193.57:0/2434847585 >> v1:10.20.193.57:6789/0 conn(0x7f045408c620 legacy=0x7f045408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0458c82640 1 -- 10.20.193.57:0/2434847585 >> v1:10.20.193.57:6790/0 conn(0x7f0454182cc0 legacy=0x7f04541a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141934296 0 0) 0x7f0444002c20 con 0x7f045408c620 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): my global_id is 74313 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04380035e0 con 0x7f045408c620 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311374588 0 0) 0x7f0454089730 con 0x7f0454182cc0 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0453fff640 1 -- 10.20.193.57:0/2434847585 >> v1:10.20.193.82:6789/0 conn(0x7f045408c250 legacy=0x7f045408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): my global_id is 94151 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0444002c20 con 0x7f0454182cc0 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499491328 0 0) 0x7f0454089450 con 0x7f045408c250 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient(hunting): my global_id is 5065 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0454089730 con 0x7f045408c250 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2074340716 0 0) 0x7f04380035e0 con 0x7f045408c620 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 >> v1:10.20.193.57:6790/0 conn(0x7f0454182cc0 legacy=0x7f04541a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 >> v1:10.20.193.82:6789/0 conn(0x7f045408c250 legacy=0x7f045408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:41:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 monclient: found mon.noname-a 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0454089a10 con 0x7f045408c620 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient: _finish_auth 0 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0444003260 con 0x7f045408c620 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient: dump: 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.893 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f045a70c640 5 monclient: authenticate success, global_id 74313 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f045a70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f04537fe640 1 --1- 10.20.193.57:0/2434847585 >> v1:10.20.193.57:6789/0 conn(0x7f045408c620 0x7f045408caa0 :-1 s=OPENED pgs=501 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f0444004960 config(0 keys) 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0444004960 con 0x7f045408c620 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f0452ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f045a70c640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:32.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.889+0000 7f045a70c640 4 set_mon_vals no callback set 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 10 monclient: shutdown 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 1 -- 10.20.193.57:0/2434847585 >> v1:10.20.193.57:6789/0 conn(0x7f045408c620 legacy=0x7f045408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f0452ffd640 1 -- 10.20.193.57:0/2434847585 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0444004cb0 con 0x7f045408c620 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f0452ffd640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 1 -- 10.20.193.57:0/2434847585 shutdown_connections 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 1 -- 10.20.193.57:0/2434847585 >> 10.20.193.57:0/2434847585 conn(0x7f04540916b0 msgr2=0x7f0454091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 1 -- 10.20.193.57:0/2434847585 shutdown_connections 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 1 -- 10.20.193.57:0/2434847585 wait complete. 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 10 monclient: build_initial_monmap 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 10 monclient: monmap: 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:32.895 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 1 Processor -- start 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 1 -- start start 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 10 monclient: init 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.890+0000 7f045a70c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:41:32.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f045a70c640 10 monclient(hunting): picked mon.noname-a con 0x7f045408c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:32.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f045a70c640 10 monclient(hunting): picked mon.noname-c con 0x7f045408c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:32.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f045a70c640 10 monclient(hunting): picked mon.noname-b con 0x7f0454182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:32.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f045a70c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045413e2a0 con 0x7f045408c250 2026-02-12T17:41:32.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f045a70c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045413e900 con 0x7f0454182cc0 2026-02-12T17:41:32.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f045a70c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045413ed30 con 0x7f045408c620 2026-02-12T17:41:32.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f045a70c640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:32.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f045a70c640 10 monclient(hunting): authenticate will time out at 1372.711037s 2026-02-12T17:41:32.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f0453fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f045408c250 0x7f0454085720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34392/0 (socket says 10.20.193.57:34392) 2026-02-12T17:41:32.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.891+0000 7f0453fff640 1 -- 10.20.193.57:0/1391709022 learned_addr learned my addr 10.20.193.57:0/1391709022 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0453fff640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.57:6789/0 conn(0x7f045408c250 legacy=0x7f0454085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f04537fe640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.57:6790/0 conn(0x7f045408c620 legacy=0x7f0454085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285237386 0 0) 0x7f045413ed30 con 0x7f045408c620 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): my global_id is 94154 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04240035e0 con 0x7f045408c620 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477054126 0 0) 0x7f045413e2a0 con 0x7f045408c250 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): my global_id is 74316 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f045413ed30 con 0x7f045408c250 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2139146447 0 0) 0x7f04240035e0 con 0x7f045408c620 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f045413e2a0 con 0x7f045408c620 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0444003400 con 0x7f045408c620 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): dump: 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.904 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 887362345 0 0) 0x7f045413ed30 con 0x7f045408c250 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04240035e0 con 0x7f045408c250 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0440003460 con 0x7f045408c250 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient(hunting): dump: 2026-02-12T17:41:32.905 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0458c82640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.82:6789/0 conn(0x7f0454182cc0 legacy=0x7f04541954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 182581342 0 0) 0x7f045413e2a0 con 0x7f045408c620 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.82:6789/0 conn(0x7f0454182cc0 legacy=0x7f04541954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.57:6789/0 conn(0x7f045408c250 legacy=0x7f0454085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 monclient: found mon.c 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0454086540 con 0x7f045408c620 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient: _finish_auth 0 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f045a70c640 5 monclient: authenticate success, global_id 94154 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f045a70c640 10 monclient: _renew_subs 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f045a70c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f04540877b0 con 0x7f045408c620 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f045a70c640 10 monclient: _renew_subs 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f045a70c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:41:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0454086850 con 0x7f045408c620 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0444005050 con 0x7f045408c620 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0444005370 con 0x7f045408c620 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f04527fc640 4 set_mon_vals no callback set 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.893+0000 7f0450ff9640 10 monclient: dump: 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.908 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.894+0000 7f045a70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.894+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f045405d3b0 con 0x7f045405cfe0 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.894+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0444011fe0 con 0x7f045408c620 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.894+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(670..670 src has 461..670) ==== 3975+0+0 (unknown 4256648994 0 0) 0x7f044404eb80 con 0x7f045408c620 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.894+0000 7f0458c82640 10 monclient: get_auth_request con 0x7f042403faa0 auth_method 0 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.896+0000 7f0453fff640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.82:6789/0 conn(0x7f045405cfe0 legacy=0x7f04540582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.896+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522853671 0 0) 0x7f045405d3b0 con 0x7f045405cfe0 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.896+0000 7f0450ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.896+0000 7f0450ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.896+0000 7f0450ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.896+0000 7f0450ff9640 10 monclient(hunting): my global_id is 5071 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.896+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f045413e2a0 con 0x7f045405cfe0 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3849864967 0 0) 0x7f045413e2a0 con 0x7f045405cfe0 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f045405d3b0 con 0x7f045405cfe0 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0440003ab0 con 0x7f045405cfe0 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 10 monclient: dump: 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.910 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3598405821 0 0) 0x7f045405d3b0 con 0x7f045405cfe0 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0454090810 con 0x7f045405cfe0 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f0440004040 con 0x7f045405cfe0 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.82:6789/0 conn(0x7f045405cfe0 legacy=0x7f04540582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.897+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.82:6789/0 conn(0x7f045405cfe0 legacy=0x7f04540582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.901+0000 7f045a70c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.901+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f045405dae0 con 0x7f04540589d0 2026-02-12T17:41:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0453fff640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.82:6789/0 conn(0x7f04540589d0 legacy=0x7f0454197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676306222 0 0) 0x7f045405dae0 con 0x7f04540589d0 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 10 monclient(hunting): my global_id is 5074 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f045405d3b0 con 0x7f04540589d0 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3117727767 0 0) 0x7f045405d3b0 con 0x7f04540589d0 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f045405dae0 con 0x7f04540589d0 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0440005880 con 0x7f04540589d0 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.903+0000 7f0450ff9640 10 monclient: dump: 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:32.912 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2833731677 0 0) 0x7f045405dae0 con 0x7f04540589d0 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0454087430 con 0x7f04540589d0 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 2142261288) 0x7f0440007a60 con 0x7f04540589d0 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f0450ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f0450ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.82:6789/0 conn(0x7f04540589d0 legacy=0x7f0454197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f0450ff9640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.82:6789/0 conn(0x7f04540589d0 legacy=0x7f0454197c00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:32.914 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:41:32.914 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:32.914 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:32.914 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:41:32.914 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 52, 2026-02-12T17:41:32.914 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 814401, 2026-02-12T17:41:32.914 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:41:32.914 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:41:32.914 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:32.915 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:32.916 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:41:32.917 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:32.918 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.919 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:32.920 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:32.921 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:32.922 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:41:32.923 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:41:32.924 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:41:32.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.82:6800/2441377515 conn(0x7f042403faa0 legacy=0x7f042405ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f045a70c640 10 monclient: shutdown 2026-02-12T17:41:32.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f045a70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:32.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 >> v1:10.20.193.57:6790/0 conn(0x7f045408c620 legacy=0x7f0454085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:32.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f0458c82640 1 -- 10.20.193.57:0/1391709022 reap_dead start 2026-02-12T17:41:32.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f0458c82640 1 -- 10.20.193.57:0/1391709022 reap_dead start 2026-02-12T17:41:32.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 shutdown_connections 2026-02-12T17:41:32.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 >> 10.20.193.57:0/1391709022 conn(0x7f04540916b0 msgr2=0x7f045408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:32.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 shutdown_connections 2026-02-12T17:41:32.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:32.904+0000 7f045a70c640 1 -- 10.20.193.57:0/1391709022 wait complete. 2026-02-12T17:41:32.926 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:41:32.926 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-12T17:41:32.926 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T17:41:32.926 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-12T17:41:32.926 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-12T17:41:32.927 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T17:41:32.927 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:41:32.935 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T17:41:32.935 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:41:32.935 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:41:33.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.041+0000 7ff1aadae640 10 monclient: get_monmap_and_config 2026-02-12T17:41:33.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.041+0000 7ff1aadae640 10 monclient: build_initial_monmap 2026-02-12T17:41:33.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.041+0000 7ff1aadae640 10 monclient: monmap: 2026-02-12T17:41:33.039 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:33.040 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:33.040 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:33.043383+0000 2026-02-12T17:41:33.040 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:33.043383+0000 2026-02-12T17:41:33.040 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:33.040 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:33.040 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:33.040 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:33.040 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:33.040 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:33.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.041+0000 7ff1aadae640 1 Processor -- start 2026-02-12T17:41:33.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.041+0000 7ff1aadae640 1 -- start start 2026-02-12T17:41:33.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.041+0000 7ff1aadae640 10 monclient: init 2026-02-12T17:41:33.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 10 monclient(hunting): picked mon.noname-c con 0x7ff1a408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 10 monclient(hunting): picked mon.noname-b con 0x7ff1a408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 10 monclient(hunting): picked mon.noname-a con 0x7ff1a408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a408d600 con 0x7ff1a408cb30 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a408b1f0 con 0x7ff1a408ae20 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a408d1f0 con 0x7ff1a408c730 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1aadae640 10 monclient(hunting): authenticate will time out at 1372.862270s 2026-02-12T17:41:33.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff19bfff640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7ff1a408c730 legacy=0x7ff1a4181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1a9324640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff1a408cb30 0x7ff1a41a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:53410/0 (socket says 10.20.193.57:53410) 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.042+0000 7ff1a9324640 1 -- 10.20.193.57:0/4258076473 learned_addr learned my addr 10.20.193.57:0/4258076473 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff1a9324640 1 -- 10.20.193.57:0/4258076473 >> v1:10.20.193.57:6789/0 conn(0x7ff1a408cb30 legacy=0x7ff1a41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 -- 10.20.193.57:0/4258076473 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701403767 0 0) 0x7ff1a408d600 con 0x7ff1a408cb30 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient(hunting): my global_id is 74319 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff1a8b23640 1 -- 10.20.193.57:0/4258076473 >> v1:10.20.193.82:6789/0 conn(0x7ff1a408ae20 legacy=0x7ff1a408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 -- 10.20.193.57:0/4258076473 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1900035e0 con 0x7ff1a408cb30 2026-02-12T17:41:33.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 -- 10.20.193.57:0/4258076473 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 153074113 0 0) 0x7ff1900035e0 con 0x7ff1a408cb30 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 -- 10.20.193.57:0/4258076473 >> v1:10.20.193.57:6790/0 conn(0x7ff1a408c730 legacy=0x7ff1a4181be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 -- 10.20.193.57:0/4258076473 >> v1:10.20.193.82:6789/0 conn(0x7ff1a408ae20 legacy=0x7ff1a408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 monclient: found mon.noname-a 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 -- 10.20.193.57:0/4258076473 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a4057320 con 0x7ff1a408cb30 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:41:33.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:33.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 -- 10.20.193.57:0/4258076473 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff1a00041b0 con 0x7ff1a408cb30 2026-02-12T17:41:33.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:33.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:33.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: dump: 2026-02-12T17:41:33.049 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:33.049 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:33.049 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:33.049 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:33.049 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff1aadae640 5 monclient: authenticate success, global_id 74319 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff1aadae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 -- 10.20.193.57:0/4258076473 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1a0004440 con 0x7ff1a408cb30 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 1 -- 10.20.193.57:0/4258076473 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff1a0005a40 con 0x7ff1a408cb30 2026-02-12T17:41:33.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff1aadae640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff1aadae640 4 set_mon_vals no callback set 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.044+0000 7ff19b7fe640 10 monclient: dump: 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:33.051 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 10 monclient: shutdown 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 1 -- 10.20.193.57:0/4258076473 >> v1:10.20.193.57:6789/0 conn(0x7ff1a408cb30 legacy=0x7ff1a41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 1 -- 10.20.193.57:0/4258076473 shutdown_connections 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 1 -- 10.20.193.57:0/4258076473 >> 10.20.193.57:0/4258076473 conn(0x7ff1a4091620 msgr2=0x7ff1a4091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:33.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 1 -- 10.20.193.57:0/4258076473 shutdown_connections 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 1 -- 10.20.193.57:0/4258076473 wait complete. 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 10 monclient: build_initial_monmap 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 10 monclient: monmap: 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:33.053 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 1 Processor -- start 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 1 -- start start 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.045+0000 7ff1aadae640 10 monclient: init 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 10 monclient(hunting): picked mon.noname-a con 0x7ff1a408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 10 monclient(hunting): picked mon.noname-b con 0x7ff1a408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 10 monclient(hunting): picked mon.noname-c con 0x7ff1a408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a408d9c0 con 0x7ff1a408ae20 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a4084a70 con 0x7ff1a408c730 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a4089d70 con 0x7ff1a408cb30 2026-02-12T17:41:33.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:33.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1aadae640 10 monclient(hunting): authenticate will time out at 1372.866080s 2026-02-12T17:41:33.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1a9324640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7ff1a408cb30 legacy=0x7ff1a41958f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:33.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1a8b23640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff1a408ae20 0x7ff1a4152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:53424/0 (socket says 10.20.193.57:53424) 2026-02-12T17:41:33.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.046+0000 7ff1a8b23640 1 -- 10.20.193.57:0/526115970 learned_addr learned my addr 10.20.193.57:0/526115970 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:33.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1a8b23640 1 -- 10.20.193.57:0/526115970 >> v1:10.20.193.57:6789/0 conn(0x7ff1a408ae20 legacy=0x7ff1a4152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:33.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413366393 0 0) 0x7ff1a408d9c0 con 0x7ff1a408ae20 2026-02-12T17:41:33.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): _negotiate 2026-02-12T17:41:33.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): my global_id is 74322 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff19bfff640 1 -- 10.20.193.57:0/526115970 >> v1:10.20.193.82:6789/0 conn(0x7ff1a408c730 legacy=0x7ff1a41941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1740035e0 con 0x7ff1a408ae20 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1397635894 0 0) 0x7ff1740035e0 con 0x7ff1a408ae20 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1a408d9c0 con 0x7ff1a408ae20 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff194003340 con 0x7ff1a408ae20 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:33.060 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): dump: 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:33.061 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26307931 0 0) 0x7ff1a4084a70 con 0x7ff1a408c730 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): _negotiate 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient(hunting): my global_id is 5080 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1740035e0 con 0x7ff1a408c730 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4008121620 0 0) 0x7ff1a408d9c0 con 0x7ff1a408ae20 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 >> v1:10.20.193.57:6790/0 conn(0x7ff1a408cb30 legacy=0x7ff1a41958f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:41:33.062 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 >> v1:10.20.193.82:6789/0 conn(0x7ff1a408c730 legacy=0x7ff1a41941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient: _finish_hunting 0 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 monclient: found mon.a 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a4084f80 con 0x7ff1a408ae20 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient: _finish_auth 0 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient: _check_auth_tickets 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1aadae640 5 monclient: authenticate success, global_id 74322 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1aadae640 10 monclient: _renew_subs 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1aadae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a4085260 con 0x7ff1a408ae20 2026-02-12T17:41:33.063 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1aadae640 10 monclient: _renew_subs 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1aadae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1a4083d40 con 0x7ff1a408ae20 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff194003980 con 0x7ff1a408ae20 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff194003ca0 con 0x7ff1a408ae20 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff1997fa640 10 monclient: dump: 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:33.064 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.048+0000 7ff19affd640 4 set_mon_vals no callback set 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.049+0000 7ff1aadae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.049+0000 7ff1aadae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.049+0000 7ff1aadae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.049+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a40008d0 con 0x7ff1a408ae20 2026-02-12T17:41:33.065 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.049+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff194003ef0 con 0x7ff1a408ae20 2026-02-12T17:41:33.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.049+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(670..670 src has 461..670) ==== 3975+0+0 (unknown 4256648994 0 0) 0x7ff19404ec70 con 0x7ff1a408ae20 2026-02-12T17:41:33.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.049+0000 7ff19bfff640 10 monclient: get_auth_request con 0x7ff17403f7c0 auth_method 0 2026-02-12T17:41:33.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.051+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff1940043c0 con 0x7ff1a408ae20 2026-02-12T17:41:33.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.051+0000 7ff1997fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:33.066 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.051+0000 7ff1997fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:33.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.203+0000 7ff1aadae640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:41:33.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.203+0000 7ff1aadae640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:33.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.203+0000 7ff1aadae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:33.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.203+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff1a408f520 con 0x7ff1a408ae20 2026-02-12T17:41:33.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.203+0000 7ff1997fa640 1 -- 10.20.193.57:0/526115970 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2304733217) 0x7ff194016b10 con 0x7ff1a408ae20 2026-02-12T17:41:33.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.203+0000 7ff1997fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:33.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.203+0000 7ff1997fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:33.202 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:41:33.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.204+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff17403f7c0 legacy=0x7ff17405fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:33.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.204+0000 7ff1aadae640 10 monclient: shutdown 2026-02-12T17:41:33.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.204+0000 7ff1aadae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:33.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.204+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 >> v1:10.20.193.57:6789/0 conn(0x7ff1a408ae20 legacy=0x7ff1a4152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:33.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.204+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 shutdown_connections 2026-02-12T17:41:33.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.204+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 >> 10.20.193.57:0/526115970 conn(0x7ff1a4091620 msgr2=0x7ff1a4089310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:33.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.204+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 shutdown_connections 2026-02-12T17:41:33.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:33.204+0000 7ff1aadae640 1 -- 10.20.193.57:0/526115970 wait complete. 2026-02-12T17:41:36.210 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:41:36.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.280+0000 7f3382c5b640 10 monclient: get_monmap_and_config 2026-02-12T17:41:36.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.280+0000 7f3382c5b640 10 monclient: build_initial_monmap 2026-02-12T17:41:36.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.280+0000 7f3382c5b640 10 monclient: monmap: 2026-02-12T17:41:36.280 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:36.280 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:36.280 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:36.282761+0000 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:36.282761+0000 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 1 Processor -- start 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 1 -- start start 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 10 monclient: init 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:36.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f337c08ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f337c08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f337c08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c08d600 con 0x7f337c08c730 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c08b1f0 con 0x7f337c08ae20 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c08d1f0 con 0x7f337c08cb30 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3382c5b640 10 monclient(hunting): authenticate will time out at 1376.101685s 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f33811d1640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f337c08cb30 legacy=0x7f337c1a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3373fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f337c08c730 0x7f337c181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:53430/0 (socket says 10.20.193.57:53430) 2026-02-12T17:41:36.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.281+0000 7f3373fff640 1 -- 10.20.193.57:0/601509514 learned_addr learned my addr 10.20.193.57:0/601509514 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:36.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.283+0000 7f3373fff640 1 -- 10.20.193.57:0/601509514 >> v1:10.20.193.57:6789/0 conn(0x7f337c08c730 legacy=0x7f337c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:36.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33809d0640 1 -- 10.20.193.57:0/601509514 >> v1:10.20.193.82:6789/0 conn(0x7f337c08ae20 legacy=0x7f337c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:36.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 -- 10.20.193.57:0/601509514 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555277298 0 0) 0x7f337c08b1f0 con 0x7f337c08ae20 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient(hunting): _negotiate 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient(hunting): my global_id is 5083 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 -- 10.20.193.57:0/601509514 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33680035e0 con 0x7f337c08ae20 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 -- 10.20.193.57:0/601509514 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1685068145 0 0) 0x7f33680035e0 con 0x7f337c08ae20 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 -- 10.20.193.57:0/601509514 >> v1:10.20.193.57:6790/0 conn(0x7f337c08cb30 legacy=0x7f337c1a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 -- 10.20.193.57:0/601509514 >> v1:10.20.193.57:6789/0 conn(0x7f337c08c730 legacy=0x7f337c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: _finish_hunting 0 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 monclient: found mon.noname-c 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:36.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 -- 10.20.193.57:0/601509514 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c057320 con 0x7f337c08ae20 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: _finish_auth 0 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: _check_auth_tickets 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f3382c5b640 5 monclient: authenticate success, global_id 5083 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f3382c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 -- 10.20.193.57:0/601509514 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f336c0031a0 con 0x7f337c08ae20 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: dump: 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:36.291 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f3382c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 -- 10.20.193.57:0/601509514 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f336c0033b0 con 0x7f337c08ae20 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:36.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 1 -- 10.20.193.57:0/601509514 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f336c003880 con 0x7f337c08ae20 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f33737fe640 10 monclient: dump: 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:36.293 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f3382c5b640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.284+0000 7f3382c5b640 4 set_mon_vals no callback set 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 10 monclient: shutdown 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 1 -- 10.20.193.57:0/601509514 >> v1:10.20.193.82:6789/0 conn(0x7f337c08ae20 legacy=0x7f337c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 1 -- 10.20.193.57:0/601509514 shutdown_connections 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 1 -- 10.20.193.57:0/601509514 >> 10.20.193.57:0/601509514 conn(0x7f337c091620 msgr2=0x7f337c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 1 -- 10.20.193.57:0/601509514 shutdown_connections 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 1 -- 10.20.193.57:0/601509514 wait complete. 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 10 monclient: build_initial_monmap 2026-02-12T17:41:36.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 10 monclient: monmap: 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 1 Processor -- start 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 1 -- start start 2026-02-12T17:41:36.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 10 monclient: init 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.285+0000 7f3382c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f337c08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f3382c5b640 10 monclient(hunting): picked mon.noname-b con 0x7f337c08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f3382c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f337c08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f3382c5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c08d9c0 con 0x7f337c08ae20 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f3382c5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c05b0b0 con 0x7f337c08c730 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f3382c5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f337c088810 con 0x7f337c08cb30 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f3382c5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f3382c5b640 10 monclient(hunting): authenticate will time out at 1376.106026s 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f33811d1640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f337c08cb30 legacy=0x7f337c1950d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f33809d0640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f337c08ae20 0x7f337c152d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:53438/0 (socket says 10.20.193.57:53438) 2026-02-12T17:41:36.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.286+0000 7f33809d0640 1 -- 10.20.193.57:0/658157919 learned_addr learned my addr 10.20.193.57:0/658157919 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.288+0000 7f33809d0640 1 -- 10.20.193.57:0/658157919 >> v1:10.20.193.57:6789/0 conn(0x7f337c08ae20 legacy=0x7f337c152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.288+0000 7f3373fff640 1 -- 10.20.193.57:0/658157919 >> v1:10.20.193.82:6789/0 conn(0x7f337c08c730 legacy=0x7f337c086ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.288+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2697006595 0 0) 0x7f337c05b0b0 con 0x7f337c08c730 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.288+0000 7f33717fa640 10 monclient(hunting): _negotiate 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.288+0000 7f33717fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.288+0000 7f33717fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.288+0000 7f33717fa640 10 monclient(hunting): my global_id is 5086 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.288+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f334c0035e0 con 0x7f337c08c730 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 424478686 0 0) 0x7f334c0035e0 con 0x7f337c08c730 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f337c05b0b0 con 0x7f337c08c730 2026-02-12T17:41:36.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f33640031c0 con 0x7f337c08c730 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient(hunting): dump: 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:36.298 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 703772142 0 0) 0x7f337c05b0b0 con 0x7f337c08c730 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 >> v1:10.20.193.57:6790/0 conn(0x7f337c08cb30 legacy=0x7f337c1950d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 >> v1:10.20.193.57:6789/0 conn(0x7f337c08ae20 legacy=0x7f337c152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient: _finish_hunting 0 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 monclient: found mon.b 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337c153450 con 0x7f337c08c730 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient: _finish_auth 0 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient: _check_auth_tickets 2026-02-12T17:41:36.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 5 monclient: authenticate success, global_id 5086 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 10 monclient: _renew_subs 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f337c083310 con 0x7f337c08c730 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 10 monclient: _renew_subs 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f337c083e70 con 0x7f337c08c730 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33640033a0 con 0x7f337c08c730 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3364004d00 con 0x7f337c08c730 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:36.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f33717fa640 10 monclient: dump: 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3372ffd640 4 set_mon_vals no callback set 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:36.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.289+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337c0008d0 con 0x7f337c08c730 2026-02-12T17:41:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.290+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3364004ea0 con 0x7f337c08c730 2026-02-12T17:41:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.290+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(670..670 src has 461..670) ==== 3975+0+0 (unknown 4256648994 0 0) 0x7f336404ebf0 con 0x7f337c08c730 2026-02-12T17:41:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.290+0000 7f33809d0640 10 monclient: get_auth_request con 0x7f334c03f680 auth_method 0 2026-02-12T17:41:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.292+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3364005730 con 0x7f337c08c730 2026-02-12T17:41:36.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.292+0000 7f33717fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:36.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.292+0000 7f33717fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:36.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.439+0000 7f3382c5b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:41:36.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.439+0000 7f3382c5b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:36.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.439+0000 7f3382c5b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:36.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.439+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f337c084fd0 con 0x7f337c08c730 2026-02-12T17:41:36.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.439+0000 7f33717fa640 1 -- 10.20.193.57:0/658157919 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 3201048197) 0x7f337c084fd0 con 0x7f337c08c730 2026-02-12T17:41:36.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.439+0000 7f33717fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:36.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.439+0000 7f33717fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:36.438 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":52,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:41:36.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.441+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 >> v1:10.20.193.82:6800/2441377515 conn(0x7f334c03f680 legacy=0x7f334c05fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:36.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.441+0000 7f3382c5b640 10 monclient: shutdown 2026-02-12T17:41:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.441+0000 7f3382c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.441+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 >> v1:10.20.193.82:6789/0 conn(0x7f337c08c730 legacy=0x7f337c086ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.441+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 shutdown_connections 2026-02-12T17:41:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.441+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 >> 10.20.193.57:0/658157919 conn(0x7f337c091620 msgr2=0x7f337c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.441+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 shutdown_connections 2026-02-12T17:41:36.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:36.441+0000 7f3382c5b640 1 -- 10.20.193.57:0/658157919 wait complete. 2026-02-12T17:41:39.448 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:41:39.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.517+0000 7f3679dc2640 10 monclient: get_monmap_and_config 2026-02-12T17:41:39.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.517+0000 7f3679dc2640 10 monclient: build_initial_monmap 2026-02-12T17:41:39.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.517+0000 7f3679dc2640 10 monclient: monmap: 2026-02-12T17:41:39.517 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:39.517 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:39.517 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:39.519646+0000 2026-02-12T17:41:39.518 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:39.519646+0000 2026-02-12T17:41:39.518 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:39.518 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:39.518 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:39.518 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:39.518 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:39.518 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:39.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 1 Processor -- start 2026-02-12T17:41:39.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 1 -- start start 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 10 monclient: init 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 10 monclient(hunting): picked mon.noname-c con 0x7f367408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 10 monclient(hunting): picked mon.noname-a con 0x7f367408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 10 monclient(hunting): picked mon.noname-b con 0x7f367408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367408d600 con 0x7f367408c730 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367408b1f0 con 0x7f367408ae20 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367408d1f0 con 0x7f367408cb30 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:39.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3679dc2640 10 monclient(hunting): authenticate will time out at 1379.338540s 2026-02-12T17:41:39.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3673fff640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f36741a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:39.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3672ffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f367408c730 0x7f3674181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:53448/0 (socket says 10.20.193.57:53448) 2026-02-12T17:41:39.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.518+0000 7f3672ffd640 1 -- 10.20.193.57:0/1013123736 learned_addr learned my addr 10.20.193.57:0/1013123736 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:39.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.520+0000 7f3672ffd640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6789/0 conn(0x7f367408c730 legacy=0x7f3674181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:39.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.520+0000 7f36737fe640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.82:6789/0 conn(0x7f367408ae20 legacy=0x7f367408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:39.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:39.719+0000 7f3673fff640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f36741a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:40.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:40.120+0000 7f3673fff640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f36741a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:40.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:40.922+0000 7f3673fff640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f36741a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 10 monclient(hunting): tick 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 1 monclient(hunting): continuing hunt 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f36741a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.82:6789/0 conn(0x7f367408ae20 legacy=0x7f367408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6789/0 conn(0x7f367408c730 legacy=0x7f3674181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 10 monclient(hunting): picked mon.noname-c con 0x7f367408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 10 monclient(hunting): picked mon.noname-b con 0x7f367408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 10 monclient(hunting): picked mon.noname-a con 0x7f367408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3674057320 con 0x7f367408c730 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367408d1f0 con 0x7f367408ae20 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f3672ffd640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365006a0a0 con 0x7f367408cb30 2026-02-12T17:41:42.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.519+0000 7f36717fa640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:42.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.521+0000 7f3673fff640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6789/0 conn(0x7f367408c730 legacy=0x7f3650066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:42.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.522+0000 7f36737fe640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.82:6789/0 conn(0x7f367408ae20 legacy=0x7f3650023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:42.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:42.720+0000 7f3672ffd640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:43.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:43.121+0000 7f3672ffd640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:43.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:43.922+0000 7f3672ffd640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:45.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 10 monclient(hunting): tick 2026-02-12T17:41:45.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:41:45.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 1 monclient(hunting): continuing hunt 2026-02-12T17:41:45.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:41:45.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:41:45.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.82:6789/0 conn(0x7f367408ae20 legacy=0x7f3650023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:45.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6789/0 conn(0x7f367408c730 legacy=0x7f3650066850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:45.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:41:45.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 10 monclient(hunting): picked mon.noname-c con 0x7f367408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:45.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 10 monclient(hunting): picked mon.noname-a con 0x7f367408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:45.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 10 monclient(hunting): picked mon.noname-b con 0x7f367408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:45.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365006b3c0 con 0x7f367408c730 2026-02-12T17:41:45.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365006a0a0 con 0x7f367408ae20 2026-02-12T17:41:45.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 1 -- 10.20.193.57:0/1013123736 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365006a460 con 0x7f367408cb30 2026-02-12T17:41:45.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f36717fa640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:45.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.519+0000 7f3673fff640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:45.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.522+0000 7f3672ffd640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6789/0 conn(0x7f367408c730 legacy=0x7f36500667d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:45.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.522+0000 7f36737fe640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.82:6789/0 conn(0x7f367408ae20 legacy=0x7f3650023840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:45.716 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:45.720+0000 7f3673fff640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:46.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:46.121+0000 7f3673fff640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:46.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:46.922+0000 7f3673fff640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:47.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 -- 10.20.193.57:0/1013123736 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749410716 0 0) 0x7f365006b3c0 con 0x7f367408c730 2026-02-12T17:41:47.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient(hunting): my global_id is 74325 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 -- 10.20.193.57:0/1013123736 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36580035e0 con 0x7f367408c730 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 -- 10.20.193.57:0/1013123736 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3815458911 0 0) 0x7f36580035e0 con 0x7f367408c730 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6790/0 conn(0x7f367408cb30 legacy=0x7f3650045050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.82:6789/0 conn(0x7f367408ae20 legacy=0x7f3650023840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: _finish_hunting 0 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 monclient: found mon.noname-a 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:47.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 -- 10.20.193.57:0/1013123736 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365006a6b0 con 0x7f367408c730 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: _finish_auth 0 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: _check_auth_tickets 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 -- 10.20.193.57:0/1013123736 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3664003120 con 0x7f367408c730 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: dump: 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.180 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f3679dc2640 5 monclient: authenticate success, global_id 74325 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f3679dc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 -- 10.20.193.57:0/1013123736 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3664003420 con 0x7f367408c730 2026-02-12T17:41:47.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 1 -- 10.20.193.57:0/1013123736 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3664004b10 con 0x7f367408c730 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f36727fc640 10 monclient: dump: 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.182 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f3679dc2640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.178+0000 7f3679dc2640 4 set_mon_vals no callback set 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 10 monclient: shutdown 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 1 -- 10.20.193.57:0/1013123736 >> v1:10.20.193.57:6789/0 conn(0x7f367408c730 legacy=0x7f36500667d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 1 -- 10.20.193.57:0/1013123736 shutdown_connections 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 1 -- 10.20.193.57:0/1013123736 >> 10.20.193.57:0/1013123736 conn(0x7f3674091620 msgr2=0x7f3674091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 1 -- 10.20.193.57:0/1013123736 shutdown_connections 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 1 -- 10.20.193.57:0/1013123736 wait complete. 2026-02-12T17:41:47.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 10 monclient: build_initial_monmap 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 10 monclient: monmap: 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:47.184 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 1 Processor -- start 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 1 -- start start 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 10 monclient: init 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.179+0000 7f3679dc2640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3679dc2640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3679dc2640 10 monclient(hunting): picked mon.noname-a con 0x7f367408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3679dc2640 10 monclient(hunting): picked mon.noname-c con 0x7f367408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3679dc2640 10 monclient(hunting): picked mon.noname-b con 0x7f367408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3679dc2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367408d9c0 con 0x7f367408ae20 2026-02-12T17:41:47.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3679dc2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3674088810 con 0x7f367408cb30 2026-02-12T17:41:47.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3679dc2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367413f780 con 0x7f367408c730 2026-02-12T17:41:47.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3679dc2640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:47.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3679dc2640 10 monclient(hunting): authenticate will time out at 1386.999069s 2026-02-12T17:41:47.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f3672ffd640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f367408c730 legacy=0x7f3674218d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:47.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f36737fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f367408ae20 0x7f36741d7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38278/0 (socket says 10.20.193.57:38278) 2026-02-12T17:41:47.186 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.180+0000 7f36737fe640 1 -- 10.20.193.57:0/875448694 learned_addr learned my addr 10.20.193.57:0/875448694 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:47.190 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.182+0000 7f36737fe640 1 -- 10.20.193.57:0/875448694 >> v1:10.20.193.57:6789/0 conn(0x7f367408ae20 legacy=0x7f36741d7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.190 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.182+0000 7f3673fff640 1 -- 10.20.193.57:0/875448694 >> v1:10.20.193.82:6789/0 conn(0x7f367408cb30 legacy=0x7f367423a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.190 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.182+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577238680 0 0) 0x7f3674088810 con 0x7f367408cb30 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.182+0000 7f364ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.182+0000 7f364ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.182+0000 7f364ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.182+0000 7f364ffff640 10 monclient(hunting): my global_id is 5089 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.182+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36440035e0 con 0x7f367408cb30 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1687875084 0 0) 0x7f36440035e0 con 0x7f367408cb30 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3674088810 con 0x7f367408cb30 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354071990 0 0) 0x7f367408d9c0 con 0x7f367408ae20 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient(hunting): my global_id is 74328 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36440035e0 con 0x7f367408ae20 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3668005710 con 0x7f367408cb30 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient(hunting): dump: 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.192 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3379512398 0 0) 0x7f3674088810 con 0x7f367408cb30 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 >> v1:10.20.193.57:6790/0 conn(0x7f367408c730 legacy=0x7f3674218d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 >> v1:10.20.193.57:6789/0 conn(0x7f367408ae20 legacy=0x7f36741d7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient: _finish_hunting 0 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 monclient: found mon.b 2026-02-12T17:41:47.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367405cc80 con 0x7f367408cb30 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient: _finish_auth 0 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 10 monclient: _check_auth_tickets 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f364ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f3679dc2640 5 monclient: authenticate success, global_id 5089 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f3679dc2640 10 monclient: _renew_subs 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f3679dc2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f367405b0b0 con 0x7f367408cb30 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f3679dc2640 10 monclient: _renew_subs 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f3679dc2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:47.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.183+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f367413df80 con 0x7f367408cb30 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3668005c10 con 0x7f367408cb30 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f364ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3668005f60 con 0x7f367408cb30 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f364ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f364ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f364ffff640 10 monclient: dump: 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.195 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f3671ffb640 4 set_mon_vals no callback set 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f3679dc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f3679dc2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f3679dc2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36740008d0 con 0x7f367408cb30 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f36680061f0 con 0x7f367408cb30 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.184+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(671..671 src has 461..671) ==== 3975+0+0 (unknown 2230752518 0 0) 0x7f366804fd90 con 0x7f367408cb30 2026-02-12T17:41:47.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.185+0000 7f36737fe640 10 monclient: get_auth_request con 0x7f3644043c00 auth_method 0 2026-02-12T17:41:47.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.187+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3668018530 con 0x7f367408cb30 2026-02-12T17:41:47.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.187+0000 7f364ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:47.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.187+0000 7f364ffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:47.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.329+0000 7f3679dc2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:41:47.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.329+0000 7f3679dc2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:47.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.329+0000 7f3679dc2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:41:47.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.329+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f367408f520 con 0x7f367408cb30 2026-02-12T17:41:47.326 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.329+0000 7f364ffff640 1 -- 10.20.193.57:0/875448694 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 48256705) 0x7f3668017ce0 con 0x7f367408cb30 2026-02-12T17:41:47.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.329+0000 7f364ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:41:47.327 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.329+0000 7f364ffff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:47.327 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":56,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:41:47.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.330+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 >> v1:10.20.193.82:6800/2441377515 conn(0x7f3644043c00 legacy=0x7f36440640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.330+0000 7f3679dc2640 10 monclient: shutdown 2026-02-12T17:41:47.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.330+0000 7f3679dc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:47.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.330+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 >> v1:10.20.193.82:6789/0 conn(0x7f367408cb30 legacy=0x7f367423a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.330+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 shutdown_connections 2026-02-12T17:41:47.328 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.330+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 >> 10.20.193.57:0/875448694 conn(0x7f3674091620 msgr2=0x7f3674088030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:47.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.330+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 shutdown_connections 2026-02-12T17:41:47.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.330+0000 7f3679dc2640 1 -- 10.20.193.57:0/875448694 wait complete. 2026-02-12T17:41:47.335 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:41:47.335 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-12T17:41:47.335 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:41:47.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.406+0000 7f859cbd2640 10 monclient: get_monmap_and_config 2026-02-12T17:41:47.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.406+0000 7f859cbd2640 10 monclient: build_initial_monmap 2026-02-12T17:41:47.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.406+0000 7f859cbd2640 10 monclient: monmap: 2026-02-12T17:41:47.404 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:47.407155+0000 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:47.407155+0000 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.406+0000 7f859cbd2640 1 Processor -- start 2026-02-12T17:41:47.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.406+0000 7f859cbd2640 1 -- start start 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.406+0000 7f859cbd2640 10 monclient: init 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 10 monclient(hunting): picked mon.noname-a con 0x7f8598091bb0 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 10 monclient(hunting): picked mon.noname-c con 0x7f859808c5b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 10 monclient(hunting): picked mon.noname-b con 0x7f859808c9f0 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8598087dd0 con 0x7f8598091bb0 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8598091f80 con 0x7f859808c5b0 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859808d420 con 0x7f859808c9f0 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f859cbd2640 10 monclient(hunting): authenticate will time out at 1387.226074s 2026-02-12T17:41:47.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f8597fff640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f859808c9f0 legacy=0x7f85981a2d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:47.407 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f85977fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f8598091bb0 0x7f859808bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38290/0 (socket says 10.20.193.57:38290) 2026-02-12T17:41:47.407 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.407+0000 7f85977fe640 1 -- 10.20.193.57:0/1371651919 learned_addr learned my addr 10.20.193.57:0/1371651919 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:47.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85977fe640 1 -- 10.20.193.57:0/1371651919 >> v1:10.20.193.57:6789/0 conn(0x7f8598091bb0 legacy=0x7f859808bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f8596ffd640 1 -- 10.20.193.57:0/1371651919 >> v1:10.20.193.82:6789/0 conn(0x7f859808c5b0 legacy=0x7f8598181640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808130496 0 0) 0x7f8598087dd0 con 0x7f8598091bb0 2026-02-12T17:41:47.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient(hunting): my global_id is 74331 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f857c0035e0 con 0x7f8598091bb0 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043772754 0 0) 0x7f8598091f80 con 0x7f859808c5b0 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient(hunting): my global_id is 5092 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8598087dd0 con 0x7f859808c5b0 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2952268087 0 0) 0x7f857c0035e0 con 0x7f8598091bb0 2026-02-12T17:41:47.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 >> v1:10.20.193.57:6790/0 conn(0x7f859808c9f0 legacy=0x7f85981a2d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 >> v1:10.20.193.82:6789/0 conn(0x7f859808c5b0 legacy=0x7f8598181640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: _finish_hunting 0 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 monclient: found mon.noname-a 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598088490 con 0x7f8598091bb0 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: _finish_auth 0 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: _check_auth_tickets 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f85840030d0 con 0x7f8598091bb0 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f859cbd2640 5 monclient: authenticate success, global_id 74331 2026-02-12T17:41:47.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f859cbd2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: dump: 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.418 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f859cbd2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8584003360 con 0x7f8598091bb0 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 1 -- 10.20.193.57:0/1371651919 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8584004960 con 0x7f8598091bb0 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f85967fc640 10 monclient: dump: 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.419 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f859cbd2640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.409+0000 7f859cbd2640 4 set_mon_vals no callback set 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 10 monclient: shutdown 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:47.420 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 1 -- 10.20.193.57:0/1371651919 >> v1:10.20.193.57:6789/0 conn(0x7f8598091bb0 legacy=0x7f859808bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 1 -- 10.20.193.57:0/1371651919 shutdown_connections 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 1 -- 10.20.193.57:0/1371651919 >> 10.20.193.57:0/1371651919 conn(0x7f8598090410 msgr2=0x7f85980914a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 1 -- 10.20.193.57:0/1371651919 shutdown_connections 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 1 -- 10.20.193.57:0/1371651919 wait complete. 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 10 monclient: build_initial_monmap 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 10 monclient: monmap: 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:47.421 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 1 Processor -- start 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 1 -- start start 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.410+0000 7f859cbd2640 10 monclient: init 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 10 monclient(hunting): picked mon.noname-b con 0x7f859808c5b0 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:47.422 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 10 monclient(hunting): picked mon.noname-a con 0x7f859808c9f0 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 10 monclient(hunting): picked mon.noname-c con 0x7f8598091bb0 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8598085070 con 0x7f859808c9f0 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8598085350 con 0x7f859808c5b0 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8598083b50 con 0x7f8598091bb0 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f859cbd2640 10 monclient(hunting): authenticate will time out at 1387.230098s 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f8597fff640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f8598091bb0 legacy=0x7f859823bf40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f8596ffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f859808c9f0 0x7f859821a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38302/0 (socket says 10.20.193.57:38302) 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.411+0000 7f8596ffd640 1 -- 10.20.193.57:0/3616834867 learned_addr learned my addr 10.20.193.57:0/3616834867 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8596ffd640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.57:6789/0 conn(0x7f859808c9f0 legacy=0x7f859821a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332396947 0 0) 0x7f8598085070 con 0x7f859808c9f0 2026-02-12T17:41:47.423 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient(hunting): my global_id is 74334 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85680035e0 con 0x7f859808c9f0 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f85977fe640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.82:6789/0 conn(0x7f859808c5b0 legacy=0x7f8598086880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 631177788 0 0) 0x7f85680035e0 con 0x7f859808c9f0 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8598085070 con 0x7f859808c9f0 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8588003450 con 0x7f859808c9f0 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:47.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient(hunting): dump: 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:47.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2869680744 0 0) 0x7f8598085070 con 0x7f859808c9f0 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.57:6790/0 conn(0x7f8598091bb0 legacy=0x7f859823bf40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.82:6789/0 conn(0x7f859808c5b0 legacy=0x7f8598086880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient: _finish_hunting 0 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 monclient: found mon.a 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8598088690 con 0x7f859808c9f0 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient: _finish_auth 0 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient: _check_auth_tickets 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f859cbd2640 5 monclient: authenticate success, global_id 74334 2026-02-12T17:41:47.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f859cbd2640 10 monclient: _renew_subs 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f859cbd2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8598083f00 con 0x7f859808c9f0 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f859cbd2640 10 monclient: _renew_subs 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f859cbd2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8598086f90 con 0x7f859808c9f0 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8588003b80 con 0x7f859808c9f0 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8588003750 con 0x7f859808c9f0 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8573fff640 10 monclient: dump: 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.427 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.413+0000 7f8595ffb640 4 set_mon_vals no callback set 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.414+0000 7f859cbd2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.414+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8598084c50 con 0x7f85981d9690 2026-02-12T17:41:47.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.414+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f8588003f10 con 0x7f859808c9f0 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.414+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(671..671 src has 461..671) ==== 3975+0+0 (unknown 2230752518 0 0) 0x7f858804ed30 con 0x7f859808c9f0 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.414+0000 7f8597fff640 10 monclient: get_auth_request con 0x7f856803f680 auth_method 0 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f85977fe640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.57:6789/0 conn(0x7f85981d9690 legacy=0x7f859807e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079516319 0 0) 0x7f8598084c50 con 0x7f85981d9690 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 10 monclient(hunting): my global_id is 74337 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8598085070 con 0x7f85981d9690 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2712121311 0 0) 0x7f8598085070 con 0x7f85981d9690 2026-02-12T17:41:47.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8598084c50 con 0x7f85981d9690 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f85840048a0 con 0x7f85981d9690 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 10 monclient: dump: 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.430 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.431 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.431 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3492477759 0 0) 0x7f8598084c50 con 0x7f85981d9690 2026-02-12T17:41:47.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.416+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f859808ce30 con 0x7f85981d9690 2026-02-12T17:41:47.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.417+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f8584002ed0 con 0x7f85981d9690 2026-02-12T17:41:47.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.417+0000 7f8573fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:47.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.417+0000 7f8573fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:47.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.417+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.57:6789/0 conn(0x7f85981d9690 legacy=0x7f859807e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.417+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.57:6789/0 conn(0x7f85981d9690 legacy=0x7f859807e870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:47.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.420+0000 7f859cbd2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:41:47.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.420+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f859808b6f0 con 0x7f859807ef80 2026-02-12T17:41:47.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f85977fe640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.57:6789/0 conn(0x7f859807ef80 legacy=0x7f859825e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428594949 0 0) 0x7f859808b6f0 con 0x7f859807ef80 2026-02-12T17:41:47.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 10 monclient(hunting): my global_id is 74340 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8598084c50 con 0x7f859807ef80 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2833209578 0 0) 0x7f8598084c50 con 0x7f859807ef80 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f859808b6f0 con 0x7f859807ef80 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f85840030f0 con 0x7f859807ef80 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 10 monclient: dump: 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.434 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4273155797 0 0) 0x7f859808b6f0 con 0x7f859807ef80 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.422+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f85981d9a60 con 0x7f859807ef80 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4494 (unknown 0 0 3873105054) 0x7f8584007580 con 0x7f859807ef80 2026-02-12T17:41:47.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f8573fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:41:47.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f8573fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:47.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.57:6789/0 conn(0x7f859807ef80 legacy=0x7f859825e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f8573fff640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.57:6789/0 conn(0x7f859807ef80 legacy=0x7f859825e680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:47.436 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:41:47.436 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:47.436 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 56, 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 233887, 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:41:47.437 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:47.438 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:47.439 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:47.440 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:47.441 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:41:47.442 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:47.443 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.444 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:41:47.445 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.446 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:41:47.447 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.448 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.448 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.448 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:41:47.448 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:41:47.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.82:6800/2441377515 conn(0x7f856803f680 legacy=0x7f856805fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f859cbd2640 10 monclient: shutdown 2026-02-12T17:41:47.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f859cbd2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:47.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 >> v1:10.20.193.57:6789/0 conn(0x7f859808c9f0 legacy=0x7f859821a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f8597fff640 1 -- 10.20.193.57:0/3616834867 reap_dead start 2026-02-12T17:41:47.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 shutdown_connections 2026-02-12T17:41:47.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 >> 10.20.193.57:0/3616834867 conn(0x7f8598090410 msgr2=0x7f8598059c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:47.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 shutdown_connections 2026-02-12T17:41:47.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.423+0000 7f859cbd2640 1 -- 10.20.193.57:0/3616834867 wait complete. 2026-02-12T17:41:47.450 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:41:47.450 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:41:47.450 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:41:47.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.518+0000 7fe8e7fa5640 10 monclient: get_monmap_and_config 2026-02-12T17:41:47.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.518+0000 7fe8e7fa5640 10 monclient: build_initial_monmap 2026-02-12T17:41:47.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.518+0000 7fe8e7fa5640 10 monclient: monmap: 2026-02-12T17:41:47.515 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:47.515 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.516 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:41:47.519452+0000 2026-02-12T17:41:47.516 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:41:47.519452+0000 2026-02-12T17:41:47.516 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:47.516 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.516 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:47.516 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:41:47.516 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:41:47.516 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 1 Processor -- start 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 1 -- start start 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 10 monclient: init 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 10 monclient(hunting): picked mon.noname-b con 0x7fe8e008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 10 monclient(hunting): picked mon.noname-a con 0x7fe8e008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 10 monclient(hunting): picked mon.noname-c con 0x7fe8e0182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e008a820 con 0x7fe8e008c620 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e0089450 con 0x7fe8e0182cc0 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e0089730 con 0x7fe8e008c250 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e5d1a640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fe8e008c250 legacy=0x7fe8e008a110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:47.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e7fa5640 10 monclient(hunting): authenticate will time out at 1387.338558s 2026-02-12T17:41:47.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e5519640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe8e008c620 0x7fe8e008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38328/0 (socket says 10.20.193.57:38328) 2026-02-12T17:41:47.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.519+0000 7fe8e5519640 1 -- 10.20.193.57:0/634218405 learned_addr learned my addr 10.20.193.57:0/634218405 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:47.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.521+0000 7fe8e5519640 1 -- 10.20.193.57:0/634218405 >> v1:10.20.193.57:6789/0 conn(0x7fe8e008c620 legacy=0x7fe8e008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.521+0000 7fe8e651b640 1 -- 10.20.193.57:0/634218405 >> v1:10.20.193.82:6789/0 conn(0x7fe8e0182cc0 legacy=0x7fe8e01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.521+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1734915797 0 0) 0x7fe8d4002c20 con 0x7fe8e008c620 2026-02-12T17:41:47.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.521+0000 7fe8e4d18640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.521+0000 7fe8e4d18640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.521+0000 7fe8e4d18640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.521+0000 7fe8e4d18640 10 monclient(hunting): my global_id is 74343 2026-02-12T17:41:47.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.521+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8c80035e0 con 0x7fe8e008c620 2026-02-12T17:41:47.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119151899 0 0) 0x7fe8e0089450 con 0x7fe8e0182cc0 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient(hunting): my global_id is 5098 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8d4002c20 con 0x7fe8e0182cc0 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3663806465 0 0) 0x7fe8c80035e0 con 0x7fe8e008c620 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 >> v1:10.20.193.57:6790/0 conn(0x7fe8e008c250 legacy=0x7fe8e008a110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 >> v1:10.20.193.82:6789/0 conn(0x7fe8e0182cc0 legacy=0x7fe8e01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: _finish_hunting 0 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 monclient: found mon.noname-a 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e0089a10 con 0x7fe8e008c620 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: _finish_auth 0 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: _check_auth_tickets 2026-02-12T17:41:47.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe8d40032e0 con 0x7fe8e008c620 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: dump: 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 5 monclient: authenticate success, global_id 74343 2026-02-12T17:41:47.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8d4004960 con 0x7fe8e008c620 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 10 monclient: get_monmap_and_config success 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 4 set_mon_vals no callback set 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 1 -- 10.20.193.57:0/634218405 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe8d4004d70 con 0x7fe8e008c620 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e4d18640 10 monclient: dump: 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.527 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 10 monclient: shutdown 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/634218405 >> v1:10.20.193.57:6789/0 conn(0x7fe8e008c620 legacy=0x7fe8e008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/634218405 shutdown_connections 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/634218405 >> 10.20.193.57:0/634218405 conn(0x7fe8e00916b0 msgr2=0x7fe8e0091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/634218405 shutdown_connections 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/634218405 wait complete. 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 10 monclient: build_initial_monmap 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.522+0000 7fe8e7fa5640 10 monclient: monmap: 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:41:47.528 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 1 Processor -- start 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 1 -- start start 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 10 monclient: init 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 10 monclient: _reopen_session rank -1 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 10 monclient(hunting): picked mon.noname-b con 0x7fe8e008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 10 monclient(hunting): picked mon.noname-a con 0x7fe8e008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 10 monclient(hunting): picked mon.noname-c con 0x7fe8e0182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e00868c0 con 0x7fe8e008c620 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e008ee80 con 0x7fe8e008c250 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e013e370 con 0x7fe8e0182cc0 2026-02-12T17:41:47.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 10 monclient(hunting): _renew_subs 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e7fa5640 10 monclient(hunting): authenticate will time out at 1387.342394s 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e651b640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fe8e0182cc0 legacy=0x7fe8e0195360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e5519640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe8e008c620 0x7fe8e0085e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:38330/0 (socket says 10.20.193.57:38330) 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.523+0000 7fe8e5519640 1 -- 10.20.193.57:0/3593965416 learned_addr learned my addr 10.20.193.57:0/3593965416 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8e5519640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.57:6789/0 conn(0x7fe8e008c620 legacy=0x7fe8e0085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991440525 0 0) 0x7fe8e00868c0 con 0x7fe8e008c620 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 10 monclient(hunting): my global_id is 74346 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8b00035e0 con 0x7fe8e008c620 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8e5d1a640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.82:6789/0 conn(0x7fe8e008c250 legacy=0x7fe8e0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 968150614 0 0) 0x7fe8b00035e0 con 0x7fe8e008c620 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8e00868c0 con 0x7fe8e008c620 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe8d40032e0 con 0x7fe8e008c620 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:41:47.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 10 monclient(hunting): dump: 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.525+0000 7fe8ce7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255488496 0 0) 0x7fe8e008ee80 con 0x7fe8e008c250 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient(hunting): my global_id is 5101 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8b00035e0 con 0x7fe8e008c250 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3710834159 0 0) 0x7fe8e00868c0 con 0x7fe8e008c620 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.57:6790/0 conn(0x7fe8e0182cc0 legacy=0x7fe8e0195360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.82:6789/0 conn(0x7fe8e008c250 legacy=0x7fe8e0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 monclient: found mon.a 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e013b3f0 con 0x7fe8e008c620 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient: _finish_auth 0 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8e7fa5640 5 monclient: authenticate success, global_id 74346 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8e7fa5640 10 monclient: _renew_subs 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8e7fa5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:47.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e013e8e0 con 0x7fe8e008c620 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8e7fa5640 10 monclient: _renew_subs 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8e7fa5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8e013b110 con 0x7fe8e008c620 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8d40052d0 con 0x7fe8e008c620 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe8d40055f0 con 0x7fe8e008c620 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 10 monclient: dump: 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.533 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.534 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8cffff640 4 set_mon_vals no callback set 2026-02-12T17:41:47.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8e7fa5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:47.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe8e0087590 con 0x7fe8e005cf50 2026-02-12T17:41:47.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe8d4012260 con 0x7fe8e008c620 2026-02-12T17:41:47.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.526+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(671..671 src has 461..671) ==== 3975+0+0 (unknown 2230752518 0 0) 0x7fe8d404ec80 con 0x7fe8e008c620 2026-02-12T17:41:47.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.527+0000 7fe8e651b640 10 monclient: get_auth_request con 0x7fe8b003f7c0 auth_method 0 2026-02-12T17:41:47.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.528+0000 7fe8e5d1a640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.82:6789/0 conn(0x7fe8e005cf50 legacy=0x7fe8e00582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 749494249 0 0) 0x7fe8b00035e0 con 0x7fe8e005cf50 2026-02-12T17:41:47.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 10 monclient(hunting): my global_id is 5104 2026-02-12T17:41:47.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e00868c0 con 0x7fe8e005cf50 2026-02-12T17:41:47.536 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1993448202 0 0) 0x7fe8e00868c0 con 0x7fe8e005cf50 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8b00035e0 con 0x7fe8e005cf50 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe8d00043a0 con 0x7fe8e005cf50 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 10 monclient: dump: 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.537 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2461679424 0 0) 0x7fe8b00035e0 con 0x7fe8e005cf50 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8e005d320 con 0x7fe8e005cf50 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe8d00059d0 con 0x7fe8e005cf50 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.82:6789/0 conn(0x7fe8e005cf50 legacy=0x7fe8e00582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.529+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.82:6789/0 conn(0x7fe8e005cf50 legacy=0x7fe8e00582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.533+0000 7fe8e7fa5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.533+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe8e013e8e0 con 0x7fe8e00589d0 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.535+0000 7fe8e5d1a640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.82:6789/0 conn(0x7fe8e00589d0 legacy=0x7fe8e0197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661039792 0 0) 0x7fe8d00046c0 con 0x7fe8e00589d0 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 10 monclient(hunting): my global_id is 5107 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8b00035e0 con 0x7fe8e00589d0 2026-02-12T17:41:47.538 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3088385453 0 0) 0x7fe8b00035e0 con 0x7fe8e00589d0 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8d00046c0 con 0x7fe8e00589d0 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe8d0004c30 con 0x7fe8e00589d0 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 10 monclient: dump: 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:41:47.539 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2833582228 0 0) 0x7fe8d00046c0 con 0x7fe8e00589d0 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe8e0090810 con 0x7fe8e00589d0 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 531902915) 0x7fe8d00050f0 con 0x7fe8e00589d0 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.82:6789/0 conn(0x7fe8e00589d0 legacy=0x7fe8e0197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8ce7fc640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.82:6789/0 conn(0x7fe8e00589d0 legacy=0x7fe8e0197a90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:41:47.540 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 56, 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 829031, 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:47.541 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:47.542 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:47.543 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:41:47.544 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:41:47.545 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.546 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.547 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:47.548 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:41:47.549 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:41:47.550 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:41:47.550 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:41:47.550 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:41:47.550 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:41:47.550 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:41:47.550 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:41:47.550 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:41:47.550 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe8b003f7c0 legacy=0x7fe8b005fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e7fa5640 10 monclient: shutdown 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e7fa5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 >> v1:10.20.193.57:6789/0 conn(0x7fe8e008c620 legacy=0x7fe8e0085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e651b640 1 -- 10.20.193.57:0/3593965416 reap_dead start 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e651b640 1 -- 10.20.193.57:0/3593965416 reap_dead start 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 shutdown_connections 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 >> 10.20.193.57:0/3593965416 conn(0x7fe8e00916b0 msgr2=0x7fe8e008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 shutdown_connections 2026-02-12T17:41:47.551 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:41:47.536+0000 7fe8e7fa5640 1 -- 10.20.193.57:0/3593965416 wait complete. 2026-02-12T17:41:47.552 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:41:47.552 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:41:48.352 INFO:tasks.rados.rados.0.trial082.stdout:3077: done (0 left) 2026-02-12T17:41:48.353 INFO:tasks.rados.rados.0.trial082.stdout:3078: snap_create 2026-02-12T17:41:49.354 INFO:tasks.rados.rados.0.trial082.stdout:3078: done (0 left) 2026-02-12T17:41:49.355 INFO:tasks.rados.rados.0.trial082.stdout:3079: read oid 42 snap -1 2026-02-12T17:41:49.355 INFO:tasks.rados.rados.0.trial082.stdout:3079: expect (ObjNum 1028 snap 322 seq_num 1028) 2026-02-12T17:41:49.355 INFO:tasks.rados.rados.0.trial082.stdout:3080: read oid 48 snap -1 2026-02-12T17:41:49.355 INFO:tasks.rados.rados.0.trial082.stdout:3080: expect (ObjNum 1032 snap 323 seq_num 1032) 2026-02-12T17:41:49.355 INFO:tasks.rados.rados.0.trial082.stdout:3081: write (excl) oid 31 current snap is 330 2026-02-12T17:41:49.355 INFO:tasks.rados.rados.0.trial082.stdout:3081: seq_num 1049 ranges {430543=476562,1385258=663035,2840837=669165} 2026-02-12T17:41:49.358 INFO:tasks.rados.rados.0.trial082.stdout:3081: writing trial08226312-31 from 430543 to 907105 tid 1 2026-02-12T17:41:49.363 INFO:tasks.rados.rados.0.trial082.stdout:3081: writing trial08226312-31 from 1385258 to 2048293 tid 2 2026-02-12T17:41:49.369 INFO:tasks.rados.rados.0.trial082.stdout:3081: writing trial08226312-31 from 2840837 to 3510002 tid 3 2026-02-12T17:41:49.369 INFO:tasks.rados.rados.0.trial082.stdout:3082: copy_from oid 21 from oid 23 current snap is 330 2026-02-12T17:41:49.369 INFO:tasks.rados.rados.0.trial082.stdout:3081: finishing write tid 1 to trial08226312-31 2026-02-12T17:41:49.369 INFO:tasks.rados.rados.0.trial082.stdout:3080: expect (ObjNum 1032 snap 323 seq_num 1032) 2026-02-12T17:41:49.414 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:49.518 INFO:tasks.rados.rados.0.trial082.stdout:3079: expect (ObjNum 1028 snap 322 seq_num 1028) 2026-02-12T17:41:49.546 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:49.580 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:49.614 INFO:tasks.rados.rados.0.trial082.stdout:3081: finishing write tid 2 to trial08226312-31 2026-02-12T17:41:49.614 INFO:tasks.rados.rados.0.trial082.stdout:3081: finishing write tid 3 to trial08226312-31 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:3081: finishing write tid 4 to trial08226312-31 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:3081: finishing write tid 5 to trial08226312-31 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:3081: oid 31 updating version 0 to 1899 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:3081: oid 31 version 1899 is already newer than 1897 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:3081: oid 31 updating version 1899 to 1900 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:3081: oid 31 version 1900 is already newer than 1898 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 1900 (ObjNum 1049 snap 330 seq_num 1049) dirty exists 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:3081: left oid 31 (ObjNum 1049 snap 330 seq_num 1049) 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:3082: finishing copy_from racing read to trial08226312-21 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:3082: finishing copy_from to trial08226312-21 2026-02-12T17:41:49.615 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 1871 (ObjNum 916 snap 288 seq_num 916) dirty exists 2026-02-12T17:41:49.616 INFO:tasks.rados.rados.0.trial082.stdout:3079: done (3 left) 2026-02-12T17:41:49.616 INFO:tasks.rados.rados.0.trial082.stdout:3080: done (2 left) 2026-02-12T17:41:49.616 INFO:tasks.rados.rados.0.trial082.stdout:3081: done (1 left) 2026-02-12T17:41:49.616 INFO:tasks.rados.rados.0.trial082.stdout:3082: done (0 left) 2026-02-12T17:41:49.616 INFO:tasks.rados.rados.0.trial082.stdout:3083: snap_remove snap 323 2026-02-12T17:41:50.360 INFO:tasks.rados.rados.0.trial082.stdout:3083: done (0 left) 2026-02-12T17:41:50.360 INFO:tasks.rados.rados.0.trial082.stdout:3084: delete oid 38 current snap is 330 2026-02-12T17:41:50.363 INFO:tasks.rados.rados.0.trial082.stdout:3084: done (0 left) 2026-02-12T17:41:50.363 INFO:tasks.rados.rados.0.trial082.stdout:3085: write (excl) oid 30 current snap is 330 2026-02-12T17:41:50.363 INFO:tasks.rados.rados.0.trial082.stdout:3085: seq_num 1051 ranges {464157=743413,1618575=666704,3012036=408062} 2026-02-12T17:41:50.368 INFO:tasks.rados.rados.0.trial082.stdout:3085: writing trial08226312-30 from 464157 to 1207570 tid 1 2026-02-12T17:41:50.372 INFO:tasks.rados.rados.0.trial082.stdout:3085: writing trial08226312-30 from 1618575 to 2285279 tid 2 2026-02-12T17:41:50.377 INFO:tasks.rados.rados.0.trial082.stdout:3085: writing trial08226312-30 from 3012036 to 3420098 tid 3 2026-02-12T17:41:50.377 INFO:tasks.rados.rados.0.trial082.stdout:3086: rollback oid 3 current snap is 330 2026-02-12T17:41:50.377 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 321 2026-02-12T17:41:50.377 INFO:tasks.rados.rados.0.trial082.stdout:3085: finishing write tid 1 to trial08226312-30 2026-02-12T17:41:50.377 INFO:tasks.rados.rados.0.trial082.stdout:3085: finishing write tid 2 to trial08226312-30 2026-02-12T17:41:50.377 INFO:tasks.rados.rados.0.trial082.stdout:3087: write (excl) oid 45 current snap is 330 2026-02-12T17:41:50.378 INFO:tasks.rados.rados.0.trial082.stdout:3087: seq_num 1052 ranges {480964=418662,1560704=410362,2523106=619334} 2026-02-12T17:41:50.380 INFO:tasks.rados.rados.0.trial082.stdout:3087: writing trial08226312-45 from 480964 to 899626 tid 1 2026-02-12T17:41:50.384 INFO:tasks.rados.rados.0.trial082.stdout:3087: writing trial08226312-45 from 1560704 to 1971066 tid 2 2026-02-12T17:41:50.390 INFO:tasks.rados.rados.0.trial082.stdout:3087: writing trial08226312-45 from 2523106 to 3142440 tid 3 2026-02-12T17:41:50.390 INFO:tasks.rados.rados.0.trial082.stdout:3088: snap_create 2026-02-12T17:41:50.390 INFO:tasks.rados.rados.0.trial082.stdout:3086: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:41:50.390 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1340 (ObjNum 289 snap 0 seq_num 0) dirty dne 2026-02-12T17:41:50.390 INFO:tasks.rados.rados.0.trial082.stdout:3085: finishing write tid 3 to trial08226312-30 2026-02-12T17:41:50.390 INFO:tasks.rados.rados.0.trial082.stdout:3085: finishing write tid 4 to trial08226312-30 2026-02-12T17:41:50.390 INFO:tasks.rados.rados.0.trial082.stdout:3085: finishing write tid 5 to trial08226312-30 2026-02-12T17:41:50.390 INFO:tasks.rados.rados.0.trial082.stdout:3085: oid 30 updating version 0 to 2247 2026-02-12T17:41:50.390 INFO:tasks.rados.rados.0.trial082.stdout:3085: oid 30 version 2247 is already newer than 2246 2026-02-12T17:41:50.391 INFO:tasks.rados.rados.0.trial082.stdout:3085: oid 30 updating version 2247 to 2249 2026-02-12T17:41:50.391 INFO:tasks.rados.rados.0.trial082.stdout:3085: oid 30 version 2249 is already newer than 2248 2026-02-12T17:41:50.391 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2249 (ObjNum 1051 snap 330 seq_num 1051) dirty exists 2026-02-12T17:41:50.391 INFO:tasks.rados.rados.0.trial082.stdout:3085: left oid 30 (ObjNum 1051 snap 330 seq_num 1051) 2026-02-12T17:41:50.391 INFO:tasks.rados.rados.0.trial082.stdout:3087: finishing write tid 1 to trial08226312-45 2026-02-12T17:41:50.391 INFO:tasks.rados.rados.0.trial082.stdout:3087: finishing write tid 2 to trial08226312-45 2026-02-12T17:41:50.392 INFO:tasks.rados.rados.0.trial082.stdout:3087: finishing write tid 3 to trial08226312-45 2026-02-12T17:41:50.392 INFO:tasks.rados.rados.0.trial082.stdout:3087: finishing write tid 4 to trial08226312-45 2026-02-12T17:41:50.392 INFO:tasks.rados.rados.0.trial082.stdout:3087: finishing write tid 5 to trial08226312-45 2026-02-12T17:41:50.392 INFO:tasks.rados.rados.0.trial082.stdout:3087: oid 45 updating version 0 to 1927 2026-02-12T17:41:50.392 INFO:tasks.rados.rados.0.trial082.stdout:3087: oid 45 version 1927 is already newer than 1925 2026-02-12T17:41:50.392 INFO:tasks.rados.rados.0.trial082.stdout:3087: oid 45 version 1927 is already newer than 1926 2026-02-12T17:41:50.392 INFO:tasks.rados.rados.0.trial082.stdout:3087: oid 45 updating version 1927 to 1928 2026-02-12T17:41:50.392 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1928 (ObjNum 1052 snap 330 seq_num 1052) dirty exists 2026-02-12T17:41:50.393 INFO:tasks.rados.rados.0.trial082.stdout:3087: left oid 45 (ObjNum 1052 snap 330 seq_num 1052) 2026-02-12T17:41:51.363 INFO:tasks.rados.rados.0.trial082.stdout:3085: done (3 left) 2026-02-12T17:41:51.363 INFO:tasks.rados.rados.0.trial082.stdout:3086: done (2 left) 2026-02-12T17:41:51.363 INFO:tasks.rados.rados.0.trial082.stdout:3087: done (1 left) 2026-02-12T17:41:51.363 INFO:tasks.rados.rados.0.trial082.stdout:3088: done (0 left) 2026-02-12T17:41:51.363 INFO:tasks.rados.rados.0.trial082.stdout:3089: write (excl) oid 16 current snap is 331 2026-02-12T17:41:51.363 INFO:tasks.rados.rados.0.trial082.stdout:3089: seq_num 1053 ranges {497771=493911,1619186=554020,2950529=430606} 2026-02-12T17:41:51.366 INFO:tasks.rados.rados.0.trial082.stdout:3089: writing trial08226312-16 from 497771 to 991682 tid 1 2026-02-12T17:41:51.371 INFO:tasks.rados.rados.0.trial082.stdout:3089: writing trial08226312-16 from 1619186 to 2173206 tid 2 2026-02-12T17:41:51.376 INFO:tasks.rados.rados.0.trial082.stdout:3089: writing trial08226312-16 from 2950529 to 3381135 tid 3 2026-02-12T17:41:51.376 INFO:tasks.rados.rados.0.trial082.stdout:3090: write oid 23 current snap is 331 2026-02-12T17:41:51.376 INFO:tasks.rados.rados.0.trial082.stdout:3090: seq_num 1054 ranges {514578=569160,1677668=414031,2577952=641878} 2026-02-12T17:41:51.379 INFO:tasks.rados.rados.0.trial082.stdout:3090: writing trial08226312-23 from 514578 to 1083738 tid 1 2026-02-12T17:41:51.383 INFO:tasks.rados.rados.0.trial082.stdout:3090: writing trial08226312-23 from 1677668 to 2091699 tid 2 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3090: writing trial08226312-23 from 2577952 to 3219830 tid 3 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3091: snap_create 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3089: finishing write tid 1 to trial08226312-16 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3089: finishing write tid 2 to trial08226312-16 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3089: finishing write tid 3 to trial08226312-16 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3089: finishing write tid 4 to trial08226312-16 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3089: finishing write tid 5 to trial08226312-16 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3089: oid 16 updating version 0 to 1919 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3089: oid 16 version 1919 is already newer than 1916 2026-02-12T17:41:51.388 INFO:tasks.rados.rados.0.trial082.stdout:3089: oid 16 version 1919 is already newer than 1917 2026-02-12T17:41:51.389 INFO:tasks.rados.rados.0.trial082.stdout:3089: oid 16 version 1919 is already newer than 1918 2026-02-12T17:41:51.389 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1919 (ObjNum 1053 snap 331 seq_num 1053) dirty exists 2026-02-12T17:41:51.389 INFO:tasks.rados.rados.0.trial082.stdout:3089: left oid 16 (ObjNum 1053 snap 331 seq_num 1053) 2026-02-12T17:41:51.389 INFO:tasks.rados.rados.0.trial082.stdout:3090: finishing write tid 1 to trial08226312-23 2026-02-12T17:41:51.389 INFO:tasks.rados.rados.0.trial082.stdout:3090: finishing write tid 2 to trial08226312-23 2026-02-12T17:41:51.390 INFO:tasks.rados.rados.0.trial082.stdout:3090: finishing write tid 3 to trial08226312-23 2026-02-12T17:41:51.390 INFO:tasks.rados.rados.0.trial082.stdout:3090: finishing write tid 4 to trial08226312-23 2026-02-12T17:41:51.390 INFO:tasks.rados.rados.0.trial082.stdout:3090: finishing write tid 5 to trial08226312-23 2026-02-12T17:41:51.390 INFO:tasks.rados.rados.0.trial082.stdout:3090: oid 23 updating version 0 to 1930 2026-02-12T17:41:51.390 INFO:tasks.rados.rados.0.trial082.stdout:3090: oid 23 version 1930 is already newer than 1929 2026-02-12T17:41:51.390 INFO:tasks.rados.rados.0.trial082.stdout:3090: oid 23 updating version 1930 to 1932 2026-02-12T17:41:51.390 INFO:tasks.rados.rados.0.trial082.stdout:3090: oid 23 version 1932 is already newer than 1931 2026-02-12T17:41:51.390 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 1932 (ObjNum 1054 snap 331 seq_num 1054) dirty exists 2026-02-12T17:41:51.391 INFO:tasks.rados.rados.0.trial082.stdout:3090: left oid 23 (ObjNum 1054 snap 331 seq_num 1054) 2026-02-12T17:41:52.366 INFO:tasks.rados.rados.0.trial082.stdout:3089: done (2 left) 2026-02-12T17:41:52.366 INFO:tasks.rados.rados.0.trial082.stdout:3090: done (1 left) 2026-02-12T17:41:52.366 INFO:tasks.rados.rados.0.trial082.stdout:3091: done (0 left) 2026-02-12T17:41:52.366 INFO:tasks.rados.rados.0.trial082.stdout:3092: snap_create 2026-02-12T17:41:53.103 INFO:tasks.rados.rados.0.trial082.stdout:3092: done (0 left) 2026-02-12T17:41:53.103 INFO:tasks.rados.rados.0.trial082.stdout:3093: write oid 26 current snap is 333 2026-02-12T17:41:53.104 INFO:tasks.rados.rados.0.trial082.stdout:3093: seq_num 1055 ranges {531385=644409,1736150=557689,3005375=569503} 2026-02-12T17:41:53.108 INFO:tasks.rados.rados.0.trial082.stdout:3093: writing trial08226312-26 from 531385 to 1175794 tid 1 2026-02-12T17:41:53.112 INFO:tasks.rados.rados.0.trial082.stdout:3093: writing trial08226312-26 from 1736150 to 2293839 tid 2 2026-02-12T17:41:53.117 INFO:tasks.rados.rados.0.trial082.stdout:3093: writing trial08226312-26 from 3005375 to 3574878 tid 3 2026-02-12T17:41:53.117 INFO:tasks.rados.rados.0.trial082.stdout:3094: delete oid 28 current snap is 333 2026-02-12T17:41:53.117 INFO:tasks.rados.rados.0.trial082.stdout:3093: finishing write tid 1 to trial08226312-26 2026-02-12T17:41:53.117 INFO:tasks.rados.rados.0.trial082.stdout:3093: finishing write tid 2 to trial08226312-26 2026-02-12T17:41:53.119 INFO:tasks.rados.rados.0.trial082.stdout:3093: finishing write tid 3 to trial08226312-26 2026-02-12T17:41:53.119 INFO:tasks.rados.rados.0.trial082.stdout:3093: finishing write tid 4 to trial08226312-26 2026-02-12T17:41:53.119 INFO:tasks.rados.rados.0.trial082.stdout:3093: finishing write tid 5 to trial08226312-26 2026-02-12T17:41:53.119 INFO:tasks.rados.rados.0.trial082.stdout:3093: oid 26 updating version 0 to 1935 2026-02-12T17:41:53.119 INFO:tasks.rados.rados.0.trial082.stdout:3093: oid 26 updating version 1935 to 1936 2026-02-12T17:41:53.119 INFO:tasks.rados.rados.0.trial082.stdout:3093: oid 26 version 1936 is already newer than 1934 2026-02-12T17:41:53.119 INFO:tasks.rados.rados.0.trial082.stdout:3093: oid 26 version 1936 is already newer than 1933 2026-02-12T17:41:53.119 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1936 (ObjNum 1055 snap 333 seq_num 1055) dirty exists 2026-02-12T17:41:53.120 INFO:tasks.rados.rados.0.trial082.stdout:3093: left oid 26 (ObjNum 1055 snap 333 seq_num 1055) 2026-02-12T17:41:53.120 INFO:tasks.rados.rados.0.trial082.stdout:3093: done (1 left) 2026-02-12T17:41:53.120 INFO:tasks.rados.rados.0.trial082.stdout:3094: done (0 left) 2026-02-12T17:41:53.120 INFO:tasks.rados.rados.0.trial082.stdout:3095: snap_remove snap 332 2026-02-12T17:41:54.105 INFO:tasks.rados.rados.0.trial082.stdout:3095: done (0 left) 2026-02-12T17:41:54.105 INFO:tasks.rados.rados.0.trial082.stdout:3096: rollback oid 50 current snap is 333 2026-02-12T17:41:54.105 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 50 to 328 2026-02-12T17:41:54.106 INFO:tasks.rados.rados.0.trial082.stdout:3097: write oid 1 current snap is 333 2026-02-12T17:41:54.106 INFO:tasks.rados.rados.0.trial082.stdout:3097: seq_num 1057 ranges {564999=511260,1853114=561358,3060221=592047} 2026-02-12T17:41:54.109 INFO:tasks.rados.rados.0.trial082.stdout:3097: writing trial08226312-1 from 564999 to 1076259 tid 1 2026-02-12T17:41:54.114 INFO:tasks.rados.rados.0.trial082.stdout:3097: writing trial08226312-1 from 1853114 to 2414472 tid 2 2026-02-12T17:41:54.119 INFO:tasks.rados.rados.0.trial082.stdout:3097: writing trial08226312-1 from 3060221 to 3652268 tid 3 2026-02-12T17:41:54.119 INFO:tasks.rados.rados.0.trial082.stdout:3098: read oid 2 snap -1 2026-02-12T17:41:54.119 INFO:tasks.rados.rados.0.trial082.stdout:3098: expect (ObjNum 955 snap 297 seq_num 955) 2026-02-12T17:41:54.120 INFO:tasks.rados.rados.0.trial082.stdout:3099: snap_remove snap 327 2026-02-12T17:41:55.108 INFO:tasks.rados.rados.0.trial082.stdout:3099: done (3 left) 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:3100: read oid 49 snap -1 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:3100: expect (ObjNum 969 snap 301 seq_num 969) 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:3101: copy_from oid 8 from oid 41 current snap is 333 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:3096: finishing rollback tid 0 to trial08226312-50 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:3096: finishing rollback tid 1 to trial08226312-50 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:3096: finishing rollback tid 2 to trial08226312-50 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 2224 (ObjNum 816 snap 253 seq_num 816) dirty exists 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:3097: finishing write tid 1 to trial08226312-1 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:3097: finishing write tid 2 to trial08226312-1 2026-02-12T17:41:55.109 INFO:tasks.rados.rados.0.trial082.stdout:3097: finishing write tid 3 to trial08226312-1 2026-02-12T17:41:55.110 INFO:tasks.rados.rados.0.trial082.stdout:3097: finishing write tid 4 to trial08226312-1 2026-02-12T17:41:55.110 INFO:tasks.rados.rados.0.trial082.stdout:3097: finishing write tid 5 to trial08226312-1 2026-02-12T17:41:55.110 INFO:tasks.rados.rados.0.trial082.stdout:3097: oid 1 updating version 0 to 2137 2026-02-12T17:41:55.110 INFO:tasks.rados.rados.0.trial082.stdout:3097: oid 1 updating version 2137 to 2138 2026-02-12T17:41:55.110 INFO:tasks.rados.rados.0.trial082.stdout:3097: oid 1 updating version 2138 to 2139 2026-02-12T17:41:55.110 INFO:tasks.rados.rados.0.trial082.stdout:3097: oid 1 updating version 2139 to 2140 2026-02-12T17:41:55.110 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2140 (ObjNum 1057 snap 333 seq_num 1057) dirty exists 2026-02-12T17:41:55.110 INFO:tasks.rados.rados.0.trial082.stdout:3097: left oid 1 (ObjNum 1057 snap 333 seq_num 1057) 2026-02-12T17:41:55.110 INFO:tasks.rados.rados.0.trial082.stdout:3098: expect (ObjNum 955 snap 297 seq_num 955) 2026-02-12T17:41:55.139 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 386597 2026-02-12T17:41:55.167 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:55.197 INFO:tasks.rados.rados.0.trial082.stdout:3101: finishing copy_from to trial08226312-8 2026-02-12T17:41:55.197 INFO:tasks.rados.rados.0.trial082.stdout:3101: got expected ENOENT (src dne) 2026-02-12T17:41:55.198 INFO:tasks.rados.rados.0.trial082.stdout:3101: finishing copy_from racing read to trial08226312-8 2026-02-12T17:41:55.198 INFO:tasks.rados.rados.0.trial082.stdout:3100: expect (ObjNum 969 snap 301 seq_num 969) 2026-02-12T17:41:55.198 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:41:55.248 INFO:tasks.rados.rados.0.trial082.stdout:3096: done (4 left) 2026-02-12T17:41:55.248 INFO:tasks.rados.rados.0.trial082.stdout:3097: done (3 left) 2026-02-12T17:41:55.248 INFO:tasks.rados.rados.0.trial082.stdout:3098: done (2 left) 2026-02-12T17:41:55.248 INFO:tasks.rados.rados.0.trial082.stdout:3100: done (1 left) 2026-02-12T17:41:55.248 INFO:tasks.rados.rados.0.trial082.stdout:3101: done (0 left) 2026-02-12T17:41:55.248 INFO:tasks.rados.rados.0.trial082.stdout:3102: rollback oid 2 current snap is 333 2026-02-12T17:41:55.248 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 328 2026-02-12T17:41:55.248 INFO:tasks.rados.rados.0.trial082.stdout:3103: delete oid 48 current snap is 333 2026-02-12T17:41:55.249 INFO:tasks.rados.rados.0.trial082.stdout:3102: finishing rollback tid 0 to trial08226312-2 2026-02-12T17:41:55.249 INFO:tasks.rados.rados.0.trial082.stdout:3102: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:41:55.249 INFO:tasks.rados.rados.0.trial082.stdout:3102: finishing rollback tid 2 to trial08226312-2 2026-02-12T17:41:55.250 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 2224 (ObjNum 955 snap 297 seq_num 955) dirty exists 2026-02-12T17:41:55.250 INFO:tasks.rados.rados.0.trial082.stdout:3102: done (1 left) 2026-02-12T17:41:55.250 INFO:tasks.rados.rados.0.trial082.stdout:3103: done (0 left) 2026-02-12T17:41:55.250 INFO:tasks.rados.rados.0.trial082.stdout:3104: copy_from oid 2 from oid 10 current snap is 333 2026-02-12T17:41:55.250 INFO:tasks.rados.rados.0.trial082.stdout:3105: snap_remove snap 322 2026-02-12T17:41:56.112 INFO:tasks.rados.rados.0.trial082.stdout:3105: done (1 left) 2026-02-12T17:41:56.112 INFO:tasks.rados.rados.0.trial082.stdout:3106: snap_create 2026-02-12T17:41:56.112 INFO:tasks.rados.rados.0.trial082.stdout:3104: finishing copy_from racing read to trial08226312-2 2026-02-12T17:41:56.112 INFO:tasks.rados.rados.0.trial082.stdout:3104: finishing copy_from to trial08226312-2 2026-02-12T17:41:56.112 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 2245 (ObjNum 1045 snap 325 seq_num 1045) dirty exists 2026-02-12T17:41:57.113 INFO:tasks.rados.rados.0.trial082.stdout:3104: done (1 left) 2026-02-12T17:41:57.113 INFO:tasks.rados.rados.0.trial082.stdout:3106: done (0 left) 2026-02-12T17:41:57.113 INFO:tasks.rados.rados.0.trial082.stdout:3107: rollback oid 48 current snap is 334 2026-02-12T17:41:57.113 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 283 2026-02-12T17:41:57.113 INFO:tasks.rados.rados.0.trial082.stdout:3108: read oid 34 snap -1 2026-02-12T17:41:57.113 INFO:tasks.rados.rados.0.trial082.stdout:3108: expect deleted 2026-02-12T17:41:57.113 INFO:tasks.rados.rados.0.trial082.stdout:3109: write oid 26 current snap is 334 2026-02-12T17:41:57.113 INFO:tasks.rados.rados.0.trial082.stdout:3109: seq_num 1059 ranges {598613=661758,1970078=565027,3115067=614591} 2026-02-12T17:41:57.118 INFO:tasks.rados.rados.0.trial082.stdout:3109: writing trial08226312-26 from 598613 to 1260371 tid 1 2026-02-12T17:41:57.123 INFO:tasks.rados.rados.0.trial082.stdout:3109: writing trial08226312-26 from 1970078 to 2535105 tid 2 2026-02-12T17:41:57.128 INFO:tasks.rados.rados.0.trial082.stdout:3109: writing trial08226312-26 from 3115067 to 3729658 tid 3 2026-02-12T17:41:57.128 INFO:tasks.rados.rados.0.trial082.stdout:3110: snap_remove snap 333 2026-02-12T17:41:58.104 INFO:tasks.rados.rados.0.trial082.stdout:3110: done (3 left) 2026-02-12T17:41:58.104 INFO:tasks.rados.rados.0.trial082.stdout:3111: write oid 41 current snap is 334 2026-02-12T17:41:58.104 INFO:tasks.rados.rados.0.trial082.stdout:3111: seq_num 1060 ranges {615420=737007,1912207=425038,3026137=542216} 2026-02-12T17:41:58.109 INFO:tasks.rados.rados.0.trial082.stdout:3111: writing trial08226312-41 from 615420 to 1352427 tid 1 2026-02-12T17:41:58.114 INFO:tasks.rados.rados.0.trial082.stdout:3111: writing trial08226312-41 from 1912207 to 2337245 tid 2 2026-02-12T17:41:58.119 INFO:tasks.rados.rados.0.trial082.stdout:3111: writing trial08226312-41 from 3026137 to 3568353 tid 3 2026-02-12T17:41:58.119 INFO:tasks.rados.rados.0.trial082.stdout:3112: snap_remove snap 318 2026-02-12T17:41:59.118 INFO:tasks.rados.rados.0.trial082.stdout:3112: done (4 left) 2026-02-12T17:41:59.118 INFO:tasks.rados.rados.0.trial082.stdout:3113: snap_remove snap 319 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3113: done (4 left) 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3114: rollback oid 23 current snap is 334 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 23 to 324 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3107: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3107: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1616 (ObjNum 886 snap 281 seq_num 886) dirty exists 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: finishing write tid 1 to trial08226312-26 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: finishing write tid 2 to trial08226312-26 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: finishing write tid 3 to trial08226312-26 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: finishing write tid 4 to trial08226312-26 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: finishing write tid 5 to trial08226312-26 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: oid 26 updating version 0 to 1938 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: oid 26 version 1938 is already newer than 1937 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: oid 26 updating version 1938 to 1940 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: oid 26 version 1940 is already newer than 1939 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1940 (ObjNum 1059 snap 334 seq_num 1059) dirty exists 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: left oid 26 (ObjNum 1059 snap 334 seq_num 1059) 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: finishing write tid 1 to trial08226312-41 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: finishing write tid 2 to trial08226312-41 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: finishing write tid 3 to trial08226312-41 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: finishing write tid 4 to trial08226312-41 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: finishing write tid 5 to trial08226312-41 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: oid 41 updating version 0 to 1988 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: oid 41 updating version 1988 to 1991 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: oid 41 version 1991 is already newer than 1989 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: oid 41 version 1991 is already newer than 1990 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1991 (ObjNum 1060 snap 334 seq_num 1060) dirty exists 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: left oid 41 (ObjNum 1060 snap 334 seq_num 1060) 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3107: done (4 left) 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3108: done (3 left) 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3109: done (2 left) 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3111: done (1 left) 2026-02-12T17:42:00.120 INFO:tasks.rados.rados.0.trial082.stdout:3115: snap_create 2026-02-12T17:42:00.125 INFO:tasks.rados.rados.0.trial082.stdout:3114: finishing rollback tid 0 to trial08226312-23 2026-02-12T17:42:00.125 INFO:tasks.rados.rados.0.trial082.stdout:3114: finishing rollback tid 1 to trial08226312-23 2026-02-12T17:42:00.127 INFO:tasks.rados.rados.0.trial082.stdout:3114: finishing rollback tid 2 to trial08226312-23 2026-02-12T17:42:00.127 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 1943 (ObjNum 916 snap 288 seq_num 916) dirty exists 2026-02-12T17:42:01.122 INFO:tasks.rados.rados.0.trial082.stdout:3114: done (1 left) 2026-02-12T17:42:01.122 INFO:tasks.rados.rados.0.trial082.stdout:3115: done (0 left) 2026-02-12T17:42:01.122 INFO:tasks.rados.rados.0.trial082.stdout:3116: read oid 37 snap -1 2026-02-12T17:42:01.122 INFO:tasks.rados.rados.0.trial082.stdout:3116: expect (ObjNum 970 snap 301 seq_num 970) 2026-02-12T17:42:01.122 INFO:tasks.rados.rados.0.trial082.stdout:3117: read oid 44 snap -1 2026-02-12T17:42:01.122 INFO:tasks.rados.rados.0.trial082.stdout:3117: expect (ObjNum 851 snap 268 seq_num 851) 2026-02-12T17:42:01.122 INFO:tasks.rados.rados.0.trial082.stdout:3118: copy_from oid 33 from oid 23 current snap is 335 2026-02-12T17:42:01.122 INFO:tasks.rados.rados.0.trial082.stdout:3119: read oid 25 snap -1 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3119: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3120: read oid 32 snap -1 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3120: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3121: copy_from oid 28 from oid 24 current snap is 335 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3122: read oid 47 snap -1 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3122: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3123: read oid 46 snap 309 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3123: expect (ObjNum 953 snap 297 seq_num 953) 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3124: read oid 13 snap 303 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3124: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3125: copy_from oid 35 from oid 48 current snap is 335 2026-02-12T17:42:01.123 INFO:tasks.rados.rados.0.trial082.stdout:3126: delete oid 11 current snap is 335 2026-02-12T17:42:01.124 INFO:tasks.rados.rados.0.trial082.stdout:3120: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:42:01.232 INFO:tasks.rados.rados.0.trial082.stdout:3120: done (10 left) 2026-02-12T17:42:01.232 INFO:tasks.rados.rados.0.trial082.stdout:3126: done (9 left) 2026-02-12T17:42:01.232 INFO:tasks.rados.rados.0.trial082.stdout:3127: delete oid 11 current snap is 335 2026-02-12T17:42:01.232 INFO:tasks.rados.rados.0.trial082.stdout:3117: expect (ObjNum 851 snap 268 seq_num 851) 2026-02-12T17:42:01.232 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:01.264 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 299522 2026-02-12T17:42:01.328 INFO:tasks.rados.rados.0.trial082.stdout:3119: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:42:01.351 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 416787 2026-02-12T17:42:01.377 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:01.405 INFO:tasks.rados.rados.0.trial082.stdout:3122: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:42:01.429 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2921619 2026-02-12T17:42:01.467 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:01.507 INFO:tasks.rados.rados.0.trial082.stdout:3124: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:42:01.524 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1982183 2026-02-12T17:42:01.558 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:01.587 INFO:tasks.rados.rados.0.trial082.stdout:3123: expect (ObjNum 953 snap 297 seq_num 953) 2026-02-12T17:42:01.608 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 947091 2026-02-12T17:42:01.637 INFO:tasks.rados.rados.0.trial082.stdout:3116: expect (ObjNum 970 snap 301 seq_num 970) 2026-02-12T17:42:01.641 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 590203 2026-02-12T17:42:01.672 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:01.695 INFO:tasks.rados.rados.0.trial082.stdout:3118: finishing copy_from racing read to trial08226312-33 2026-02-12T17:42:01.695 INFO:tasks.rados.rados.0.trial082.stdout:3116: done (9 left) 2026-02-12T17:42:01.695 INFO:tasks.rados.rados.0.trial082.stdout:3117: done (8 left) 2026-02-12T17:42:01.695 INFO:tasks.rados.rados.0.trial082.stdout:3119: done (7 left) 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3122: done (6 left) 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3123: done (5 left) 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3124: done (4 left) 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3127: done (3 left) 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3128: read oid 1 snap -1 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3128: expect (ObjNum 1057 snap 333 seq_num 1057) 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3129: rollback oid 15 current snap is 335 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 15 to 310 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3125: finishing copy_from racing read to trial08226312-35 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3121: finishing copy_from racing read to trial08226312-28 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3118: finishing copy_from to trial08226312-33 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 1943 (ObjNum 916 snap 288 seq_num 916) dirty exists 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3125: finishing copy_from to trial08226312-35 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1616 (ObjNum 886 snap 281 seq_num 886) dirty exists 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3121: finishing copy_from to trial08226312-28 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2361 (ObjNum 1044 snap 325 seq_num 1044) dirty exists 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3118: done (4 left) 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3121: done (3 left) 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3125: done (2 left) 2026-02-12T17:42:01.696 INFO:tasks.rados.rados.0.trial082.stdout:3130: snap_create 2026-02-12T17:42:01.698 INFO:tasks.rados.rados.0.trial082.stdout:3129: finishing rollback tid 0 to trial08226312-15 2026-02-12T17:42:01.698 INFO:tasks.rados.rados.0.trial082.stdout:3129: finishing rollback tid 1 to trial08226312-15 2026-02-12T17:42:01.698 INFO:tasks.rados.rados.0.trial082.stdout:3129: finishing rollback tid 2 to trial08226312-15 2026-02-12T17:42:01.699 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 1371 (ObjNum 951 snap 296 seq_num 951) dirty exists 2026-02-12T17:42:01.700 INFO:tasks.rados.rados.0.trial082.stdout:3128: expect (ObjNum 1057 snap 333 seq_num 1057) 2026-02-12T17:42:01.704 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 865444 2026-02-12T17:42:01.792 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:02.128 INFO:tasks.rados.rados.0.trial082.stdout:3128: done (2 left) 2026-02-12T17:42:02.128 INFO:tasks.rados.rados.0.trial082.stdout:3129: done (1 left) 2026-02-12T17:42:02.128 INFO:tasks.rados.rados.0.trial082.stdout:3130: done (0 left) 2026-02-12T17:42:02.128 INFO:tasks.rados.rados.0.trial082.stdout:3131: read oid 30 snap 283 2026-02-12T17:42:02.128 INFO:tasks.rados.rados.0.trial082.stdout:3131: expect (ObjNum 836 snap 260 seq_num 836) 2026-02-12T17:42:02.128 INFO:tasks.rados.rados.0.trial082.stdout:3132: snap_remove snap 321 2026-02-12T17:42:03.104 INFO:tasks.rados.rados.0.trial082.stdout:3132: done (1 left) 2026-02-12T17:42:03.105 INFO:tasks.rados.rados.0.trial082.stdout:3133: rollback oid 19 current snap is 336 2026-02-12T17:42:03.105 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 329 2026-02-12T17:42:03.105 INFO:tasks.rados.rados.0.trial082.stdout:3131: expect (ObjNum 836 snap 260 seq_num 836) 2026-02-12T17:42:03.116 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1965421 2026-02-12T17:42:03.135 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 426115 2026-02-12T17:42:03.152 INFO:tasks.rados.rados.0.trial082.stdout:3133: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:42:03.152 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 0 (ObjNum 513 snap 0 seq_num 26644199) dirty dne 2026-02-12T17:42:03.152 INFO:tasks.rados.rados.0.trial082.stdout:3131: done (1 left) 2026-02-12T17:42:03.152 INFO:tasks.rados.rados.0.trial082.stdout:3133: done (0 left) 2026-02-12T17:42:03.152 INFO:tasks.rados.rados.0.trial082.stdout:3134: delete oid 32 current snap is 336 2026-02-12T17:42:03.153 INFO:tasks.rados.rados.0.trial082.stdout:3134: done (0 left) 2026-02-12T17:42:03.154 INFO:tasks.rados.rados.0.trial082.stdout:3135: copy_from oid 4 from oid 20 current snap is 336 2026-02-12T17:42:03.154 INFO:tasks.rados.rados.0.trial082.stdout:3136: delete oid 34 current snap is 336 2026-02-12T17:42:03.154 INFO:tasks.rados.rados.0.trial082.stdout:3135: finishing copy_from to trial08226312-4 2026-02-12T17:42:03.154 INFO:tasks.rados.rados.0.trial082.stdout:3135: got expected ENOENT (src dne) 2026-02-12T17:42:03.154 INFO:tasks.rados.rados.0.trial082.stdout:3135: finishing copy_from racing read to trial08226312-4 2026-02-12T17:42:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3135: done (1 left) 2026-02-12T17:42:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3136: done (0 left) 2026-02-12T17:42:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3137: write oid 12 current snap is 336 2026-02-12T17:42:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3137: seq_num 1065 ranges {699455=429605,1804617=576034,3163252=514929} 2026-02-12T17:42:03.159 INFO:tasks.rados.rados.0.trial082.stdout:3137: writing trial08226312-12 from 699455 to 1129060 tid 1 2026-02-12T17:42:03.164 INFO:tasks.rados.rados.0.trial082.stdout:3137: writing trial08226312-12 from 1804617 to 2380651 tid 2 2026-02-12T17:42:03.169 INFO:tasks.rados.rados.0.trial082.stdout:3137: writing trial08226312-12 from 3163252 to 3678181 tid 3 2026-02-12T17:42:03.169 INFO:tasks.rados.rados.0.trial082.stdout:3138: copy_from oid 27 from oid 2 current snap is 336 2026-02-12T17:42:03.169 INFO:tasks.rados.rados.0.trial082.stdout:3137: finishing write tid 1 to trial08226312-12 2026-02-12T17:42:03.169 INFO:tasks.rados.rados.0.trial082.stdout:3137: finishing write tid 2 to trial08226312-12 2026-02-12T17:42:03.169 INFO:tasks.rados.rados.0.trial082.stdout:3139: delete oid 42 current snap is 336 2026-02-12T17:42:03.170 INFO:tasks.rados.rados.0.trial082.stdout:3139: done (2 left) 2026-02-12T17:42:03.170 INFO:tasks.rados.rados.0.trial082.stdout:3140: rollback oid 34 current snap is 336 2026-02-12T17:42:03.170 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 34 to 283 2026-02-12T17:42:03.170 INFO:tasks.rados.rados.0.trial082.stdout:3141: read oid 22 snap -1 2026-02-12T17:42:03.170 INFO:tasks.rados.rados.0.trial082.stdout:3141: expect (ObjNum 1025 snap 321 seq_num 1025) 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3142: delete oid 11 current snap is 336 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3137: finishing write tid 3 to trial08226312-12 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3137: finishing write tid 4 to trial08226312-12 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3137: finishing write tid 5 to trial08226312-12 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3137: oid 12 updating version 0 to 1995 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3137: oid 12 version 1995 is already newer than 1994 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3137: oid 12 version 1995 is already newer than 1992 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3137: oid 12 version 1995 is already newer than 1993 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1995 (ObjNum 1065 snap 336 seq_num 1065) dirty exists 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3137: left oid 12 (ObjNum 1065 snap 336 seq_num 1065) 2026-02-12T17:42:03.171 INFO:tasks.rados.rados.0.trial082.stdout:3140: finishing rollback tid 1 to trial08226312-34 2026-02-12T17:42:03.172 INFO:tasks.rados.rados.0.trial082.stdout:3137: done (4 left) 2026-02-12T17:42:03.172 INFO:tasks.rados.rados.0.trial082.stdout:3142: done (3 left) 2026-02-12T17:42:03.172 INFO:tasks.rados.rados.0.trial082.stdout:3143: write (excl) oid 5 current snap is 336 2026-02-12T17:42:03.172 INFO:tasks.rados.rados.0.trial082.stdout:3143: seq_num 1068 ranges {749876=655352,1863710=723361,3012815=748745} 2026-02-12T17:42:03.178 INFO:tasks.rados.rados.0.trial082.stdout:3143: writing trial08226312-5 from 749876 to 1405228 tid 1 2026-02-12T17:42:03.182 INFO:tasks.rados.rados.0.trial082.stdout:3143: writing trial08226312-5 from 1863710 to 2587071 tid 2 2026-02-12T17:42:03.187 INFO:tasks.rados.rados.0.trial082.stdout:3143: writing trial08226312-5 from 3012815 to 3761560 tid 3 2026-02-12T17:42:03.187 INFO:tasks.rados.rados.0.trial082.stdout:3144: read oid 31 snap -1 2026-02-12T17:42:03.187 INFO:tasks.rados.rados.0.trial082.stdout:3144: expect (ObjNum 1049 snap 330 seq_num 1049) 2026-02-12T17:42:03.187 INFO:tasks.rados.rados.0.trial082.stdout:3145: snap_remove snap 325 2026-02-12T17:42:04.133 INFO:tasks.rados.rados.0.trial082.stdout:3145: done (5 left) 2026-02-12T17:42:04.133 INFO:tasks.rados.rados.0.trial082.stdout:3146: snap_create 2026-02-12T17:42:04.134 INFO:tasks.rados.rados.0.trial082.stdout:3140: finishing rollback tid 2 to trial08226312-34 2026-02-12T17:42:04.134 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1576 (ObjNum 842 snap 265 seq_num 842) dirty exists 2026-02-12T17:42:04.134 INFO:tasks.rados.rados.0.trial082.stdout:3138: finishing copy_from racing read to trial08226312-27 2026-02-12T17:42:04.134 INFO:tasks.rados.rados.0.trial082.stdout:3141: expect (ObjNum 1025 snap 321 seq_num 1025) 2026-02-12T17:42:04.208 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:04.254 INFO:tasks.rados.rados.0.trial082.stdout:3143: finishing write tid 1 to trial08226312-5 2026-02-12T17:42:04.254 INFO:tasks.rados.rados.0.trial082.stdout:3143: finishing write tid 2 to trial08226312-5 2026-02-12T17:42:04.254 INFO:tasks.rados.rados.0.trial082.stdout:3138: finishing copy_from to trial08226312-27 2026-02-12T17:42:04.254 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2245 (ObjNum 1045 snap 325 seq_num 1045) dirty exists 2026-02-12T17:42:04.254 INFO:tasks.rados.rados.0.trial082.stdout:3144: expect (ObjNum 1049 snap 330 seq_num 1049) 2026-02-12T17:42:04.260 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1671044 2026-02-12T17:42:04.293 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:04.318 INFO:tasks.rados.rados.0.trial082.stdout:3143: finishing write tid 3 to trial08226312-5 2026-02-12T17:42:04.318 INFO:tasks.rados.rados.0.trial082.stdout:3143: finishing write tid 4 to trial08226312-5 2026-02-12T17:42:04.318 INFO:tasks.rados.rados.0.trial082.stdout:3143: finishing write tid 5 to trial08226312-5 2026-02-12T17:42:04.318 INFO:tasks.rados.rados.0.trial082.stdout:3143: oid 5 updating version 0 to 1374 2026-02-12T17:42:04.318 INFO:tasks.rados.rados.0.trial082.stdout:3143: oid 5 updating version 1374 to 1377 2026-02-12T17:42:04.318 INFO:tasks.rados.rados.0.trial082.stdout:3143: oid 5 version 1377 is already newer than 1375 2026-02-12T17:42:04.318 INFO:tasks.rados.rados.0.trial082.stdout:3143: oid 5 version 1377 is already newer than 1376 2026-02-12T17:42:04.318 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 1377 (ObjNum 1068 snap 336 seq_num 1068) dirty exists 2026-02-12T17:42:04.318 INFO:tasks.rados.rados.0.trial082.stdout:3143: left oid 5 (ObjNum 1068 snap 336 seq_num 1068) 2026-02-12T17:42:05.135 INFO:tasks.rados.rados.0.trial082.stdout:3138: done (5 left) 2026-02-12T17:42:05.135 INFO:tasks.rados.rados.0.trial082.stdout:3140: done (4 left) 2026-02-12T17:42:05.135 INFO:tasks.rados.rados.0.trial082.stdout:3141: done (3 left) 2026-02-12T17:42:05.135 INFO:tasks.rados.rados.0.trial082.stdout:3143: done (2 left) 2026-02-12T17:42:05.135 INFO:tasks.rados.rados.0.trial082.stdout:3144: done (1 left) 2026-02-12T17:42:05.135 INFO:tasks.rados.rados.0.trial082.stdout:3146: done (0 left) 2026-02-12T17:42:05.135 INFO:tasks.rados.rados.0.trial082.stdout:3147: write oid 49 current snap is 337 2026-02-12T17:42:05.136 INFO:tasks.rados.rados.0.trial082.stdout:3147: seq_num 1069 ranges {766683=730601,1922192=583372,3156591=676370} 2026-02-12T17:42:05.141 INFO:tasks.rados.rados.0.trial082.stdout:3147: writing trial08226312-49 from 766683 to 1497284 tid 1 2026-02-12T17:42:05.144 INFO:tasks.rados.rados.0.trial082.stdout:3147: writing trial08226312-49 from 1922192 to 2505564 tid 2 2026-02-12T17:42:05.150 INFO:tasks.rados.rados.0.trial082.stdout:3147: writing trial08226312-49 from 3156591 to 3832961 tid 3 2026-02-12T17:42:05.150 INFO:tasks.rados.rados.0.trial082.stdout:3148: copy_from oid 22 from oid 32 current snap is 337 2026-02-12T17:42:05.150 INFO:tasks.rados.rados.0.trial082.stdout:3149: read oid 3 snap -1 2026-02-12T17:42:05.150 INFO:tasks.rados.rados.0.trial082.stdout:3149: expect deleted 2026-02-12T17:42:05.150 INFO:tasks.rados.rados.0.trial082.stdout:3150: snap_create 2026-02-12T17:42:05.155 INFO:tasks.rados.rados.0.trial082.stdout:3147: finishing write tid 1 to trial08226312-49 2026-02-12T17:42:05.156 INFO:tasks.rados.rados.0.trial082.stdout:3148: finishing copy_from to trial08226312-22 2026-02-12T17:42:05.156 INFO:tasks.rados.rados.0.trial082.stdout:3148: got expected ENOENT (src dne) 2026-02-12T17:42:05.156 INFO:tasks.rados.rados.0.trial082.stdout:3148: finishing copy_from racing read to trial08226312-22 2026-02-12T17:42:05.157 INFO:tasks.rados.rados.0.trial082.stdout:3147: finishing write tid 2 to trial08226312-49 2026-02-12T17:42:05.158 INFO:tasks.rados.rados.0.trial082.stdout:3147: finishing write tid 3 to trial08226312-49 2026-02-12T17:42:05.158 INFO:tasks.rados.rados.0.trial082.stdout:3147: finishing write tid 4 to trial08226312-49 2026-02-12T17:42:05.158 INFO:tasks.rados.rados.0.trial082.stdout:3147: finishing write tid 5 to trial08226312-49 2026-02-12T17:42:05.158 INFO:tasks.rados.rados.0.trial082.stdout:3147: oid 49 updating version 0 to 1578 2026-02-12T17:42:05.159 INFO:tasks.rados.rados.0.trial082.stdout:3147: oid 49 version 1578 is already newer than 1577 2026-02-12T17:42:05.159 INFO:tasks.rados.rados.0.trial082.stdout:3147: oid 49 updating version 1578 to 1579 2026-02-12T17:42:05.159 INFO:tasks.rados.rados.0.trial082.stdout:3147: oid 49 updating version 1579 to 1580 2026-02-12T17:42:05.159 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 1580 (ObjNum 1069 snap 337 seq_num 1069) dirty exists 2026-02-12T17:42:05.159 INFO:tasks.rados.rados.0.trial082.stdout:3147: left oid 49 (ObjNum 1069 snap 337 seq_num 1069) 2026-02-12T17:42:06.140 INFO:tasks.rados.rados.0.trial082.stdout:3147: done (3 left) 2026-02-12T17:42:06.140 INFO:tasks.rados.rados.0.trial082.stdout:3148: done (2 left) 2026-02-12T17:42:06.140 INFO:tasks.rados.rados.0.trial082.stdout:3149: done (1 left) 2026-02-12T17:42:06.140 INFO:tasks.rados.rados.0.trial082.stdout:3150: done (0 left) 2026-02-12T17:42:06.140 INFO:tasks.rados.rados.0.trial082.stdout:3151: copy_from oid 50 from oid 49 current snap is 338 2026-02-12T17:42:06.140 INFO:tasks.rados.rados.0.trial082.stdout:3152: write (excl) oid 3 current snap is 338 2026-02-12T17:42:06.141 INFO:tasks.rados.rados.0.trial082.stdout:3152: seq_num 1070 ranges {783490=405850,1980674=727030,3184014=487642} 2026-02-12T17:42:06.144 INFO:tasks.rados.rados.0.trial082.stdout:3152: writing trial08226312-3 from 783490 to 1189340 tid 1 2026-02-12T17:42:06.149 INFO:tasks.rados.rados.0.trial082.stdout:3152: writing trial08226312-3 from 1980674 to 2707704 tid 2 2026-02-12T17:42:06.153 INFO:tasks.rados.rados.0.trial082.stdout:3152: writing trial08226312-3 from 3184014 to 3671656 tid 3 2026-02-12T17:42:06.153 INFO:tasks.rados.rados.0.trial082.stdout:3153: write oid 5 current snap is 338 2026-02-12T17:42:06.153 INFO:tasks.rados.rados.0.trial082.stdout:3153: seq_num 1071 ranges {400297=481099,1639156=361141} 2026-02-12T17:42:06.156 INFO:tasks.rados.rados.0.trial082.stdout:3153: writing trial08226312-5 from 400297 to 881396 tid 1 2026-02-12T17:42:06.161 INFO:tasks.rados.rados.0.trial082.stdout:3153: writing trial08226312-5 from 1639156 to 2000297 tid 2 2026-02-12T17:42:06.161 INFO:tasks.rados.rados.0.trial082.stdout:3154: rollback oid 45 current snap is 338 2026-02-12T17:42:06.161 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 329 2026-02-12T17:42:06.161 INFO:tasks.rados.rados.0.trial082.stdout:3152: finishing write tid 1 to trial08226312-3 2026-02-12T17:42:06.161 INFO:tasks.rados.rados.0.trial082.stdout:3151: finishing copy_from racing read to trial08226312-50 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3151: finishing copy_from to trial08226312-50 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 1580 (ObjNum 1069 snap 337 seq_num 1069) dirty exists 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3152: finishing write tid 2 to trial08226312-3 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3152: finishing write tid 3 to trial08226312-3 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3152: finishing write tid 4 to trial08226312-3 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3152: finishing write tid 5 to trial08226312-3 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3152: oid 3 updating version 0 to 1383 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3152: oid 3 updating version 1383 to 1384 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3152: oid 3 updating version 1384 to 1385 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3152: oid 3 version 1385 is already newer than 1382 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 1385 (ObjNum 1070 snap 338 seq_num 1070) dirty exists 2026-02-12T17:42:06.162 INFO:tasks.rados.rados.0.trial082.stdout:3152: left oid 3 (ObjNum 1070 snap 338 seq_num 1070) 2026-02-12T17:42:06.163 INFO:tasks.rados.rados.0.trial082.stdout:3153: finishing write tid 1 to trial08226312-5 2026-02-12T17:42:06.163 INFO:tasks.rados.rados.0.trial082.stdout:3151: done (3 left) 2026-02-12T17:42:06.163 INFO:tasks.rados.rados.0.trial082.stdout:3152: done (2 left) 2026-02-12T17:42:06.163 INFO:tasks.rados.rados.0.trial082.stdout:3155: write (excl) oid 27 current snap is 338 2026-02-12T17:42:06.163 INFO:tasks.rados.rados.0.trial082.stdout:3155: seq_num 1072 ranges {417104=672701,1813991=203113} 2026-02-12T17:42:06.165 INFO:tasks.rados.rados.0.trial082.stdout:3155: writing trial08226312-27 from 417104 to 1089805 tid 1 2026-02-12T17:42:06.168 INFO:tasks.rados.rados.0.trial082.stdout:3155: writing trial08226312-27 from 1813991 to 2017104 tid 2 2026-02-12T17:42:06.168 INFO:tasks.rados.rados.0.trial082.stdout:3156: snap_create 2026-02-12T17:42:06.168 INFO:tasks.rados.rados.0.trial082.stdout:3154: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:42:06.169 INFO:tasks.rados.rados.0.trial082.stdout:3154: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:42:06.169 INFO:tasks.rados.rados.0.trial082.stdout:3154: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:42:06.169 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 1946 (ObjNum 1021 snap 321 seq_num 1021) dirty exists 2026-02-12T17:42:06.169 INFO:tasks.rados.rados.0.trial082.stdout:3155: finishing write tid 1 to trial08226312-27 2026-02-12T17:42:06.170 INFO:tasks.rados.rados.0.trial082.stdout:3155: finishing write tid 2 to trial08226312-27 2026-02-12T17:42:06.170 INFO:tasks.rados.rados.0.trial082.stdout:3155: finishing write tid 3 to trial08226312-27 2026-02-12T17:42:06.170 INFO:tasks.rados.rados.0.trial082.stdout:3155: finishing write tid 4 to trial08226312-27 2026-02-12T17:42:06.170 INFO:tasks.rados.rados.0.trial082.stdout:3155: oid 27 updating version 0 to 2248 2026-02-12T17:42:06.170 INFO:tasks.rados.rados.0.trial082.stdout:3155: oid 27 version 2248 is already newer than 2246 2026-02-12T17:42:06.170 INFO:tasks.rados.rados.0.trial082.stdout:3155: oid 27 version 2248 is already newer than 2247 2026-02-12T17:42:06.170 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2248 (ObjNum 1072 snap 338 seq_num 1072) dirty exists 2026-02-12T17:42:06.170 INFO:tasks.rados.rados.0.trial082.stdout:3155: left oid 27 (ObjNum 1072 snap 338 seq_num 1072) 2026-02-12T17:42:06.171 INFO:tasks.rados.rados.0.trial082.stdout:3153: finishing write tid 2 to trial08226312-5 2026-02-12T17:42:06.171 INFO:tasks.rados.rados.0.trial082.stdout:3153: finishing write tid 3 to trial08226312-5 2026-02-12T17:42:06.171 INFO:tasks.rados.rados.0.trial082.stdout:3153: finishing write tid 4 to trial08226312-5 2026-02-12T17:42:06.171 INFO:tasks.rados.rados.0.trial082.stdout:3153: oid 5 updating version 0 to 1387 2026-02-12T17:42:06.171 INFO:tasks.rados.rados.0.trial082.stdout:3153: oid 5 updating version 1387 to 1388 2026-02-12T17:42:06.171 INFO:tasks.rados.rados.0.trial082.stdout:3153: oid 5 updating version 1388 to 1389 2026-02-12T17:42:06.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 1389 (ObjNum 1071 snap 338 seq_num 1071) dirty exists 2026-02-12T17:42:06.171 INFO:tasks.rados.rados.0.trial082.stdout:3153: left oid 5 (ObjNum 1071 snap 338 seq_num 1071) 2026-02-12T17:42:07.143 INFO:tasks.rados.rados.0.trial082.stdout:3153: done (3 left) 2026-02-12T17:42:07.144 INFO:tasks.rados.rados.0.trial082.stdout:3154: done (2 left) 2026-02-12T17:42:07.144 INFO:tasks.rados.rados.0.trial082.stdout:3155: done (1 left) 2026-02-12T17:42:07.144 INFO:tasks.rados.rados.0.trial082.stdout:3156: done (0 left) 2026-02-12T17:42:07.144 INFO:tasks.rados.rados.0.trial082.stdout:3157: read oid 9 snap -1 2026-02-12T17:42:07.144 INFO:tasks.rados.rados.0.trial082.stdout:3157: expect (ObjNum 1028 snap 322 seq_num 1028) 2026-02-12T17:42:07.144 INFO:tasks.rados.rados.0.trial082.stdout:3158: delete oid 20 current snap is 339 2026-02-12T17:42:07.147 INFO:tasks.rados.rados.0.trial082.stdout:3158: done (1 left) 2026-02-12T17:42:07.147 INFO:tasks.rados.rados.0.trial082.stdout:3159: snap_create 2026-02-12T17:42:07.148 INFO:tasks.rados.rados.0.trial082.stdout:3157: expect (ObjNum 1028 snap 322 seq_num 1028) 2026-02-12T17:42:07.183 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1500734 2026-02-12T17:42:07.208 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:08.105 INFO:tasks.rados.rados.0.trial082.stdout:3157: done (1 left) 2026-02-12T17:42:08.105 INFO:tasks.rados.rados.0.trial082.stdout:3159: done (0 left) 2026-02-12T17:42:08.105 INFO:tasks.rados.rados.0.trial082.stdout:3160: write (excl) oid 12 current snap is 340 2026-02-12T17:42:08.105 INFO:tasks.rados.rados.0.trial082.stdout:3160: seq_num 1074 ranges {450718=423199,1414602=636116} 2026-02-12T17:42:08.109 INFO:tasks.rados.rados.0.trial082.stdout:3160: writing trial08226312-12 from 450718 to 873917 tid 1 2026-02-12T17:42:08.113 INFO:tasks.rados.rados.0.trial082.stdout:3160: writing trial08226312-12 from 1414602 to 2050718 tid 2 2026-02-12T17:42:08.113 INFO:tasks.rados.rados.0.trial082.stdout:3161: delete oid 9 current snap is 340 2026-02-12T17:42:08.114 INFO:tasks.rados.rados.0.trial082.stdout:3160: finishing write tid 1 to trial08226312-12 2026-02-12T17:42:08.116 INFO:tasks.rados.rados.0.trial082.stdout:3161: done (1 left) 2026-02-12T17:42:08.116 INFO:tasks.rados.rados.0.trial082.stdout:3162: read oid 6 snap -1 2026-02-12T17:42:08.116 INFO:tasks.rados.rados.0.trial082.stdout:3162: expect (ObjNum 1040 snap 325 seq_num 1040) 2026-02-12T17:42:08.116 INFO:tasks.rados.rados.0.trial082.stdout:3163: copy_from oid 15 from oid 43 current snap is 340 2026-02-12T17:42:08.116 INFO:tasks.rados.rados.0.trial082.stdout:3164: write oid 25 current snap is 340 2026-02-12T17:42:08.116 INFO:tasks.rados.rados.0.trial082.stdout:3164: seq_num 1076 ranges {484332=573697,1531566=552766} 2026-02-12T17:42:08.120 INFO:tasks.rados.rados.0.trial082.stdout:3164: writing trial08226312-25 from 484332 to 1058029 tid 1 2026-02-12T17:42:08.124 INFO:tasks.rados.rados.0.trial082.stdout:3164: writing trial08226312-25 from 1531566 to 2084332 tid 2 2026-02-12T17:42:08.124 INFO:tasks.rados.rados.0.trial082.stdout:3165: write (excl) oid 50 current snap is 340 2026-02-12T17:42:08.124 INFO:tasks.rados.rados.0.trial082.stdout:3165: seq_num 1077 ranges {501139=648946,1873695=227444} 2026-02-12T17:42:08.128 INFO:tasks.rados.rados.0.trial082.stdout:3165: writing trial08226312-50 from 501139 to 1150085 tid 1 2026-02-12T17:42:08.131 INFO:tasks.rados.rados.0.trial082.stdout:3165: writing trial08226312-50 from 1873695 to 2101139 tid 2 2026-02-12T17:42:08.131 INFO:tasks.rados.rados.0.trial082.stdout:3166: write (excl) oid 13 current snap is 340 2026-02-12T17:42:08.131 INFO:tasks.rados.rados.0.trial082.stdout:3166: seq_num 1078 ranges {517946=724195,1932177=185769} 2026-02-12T17:42:08.136 INFO:tasks.rados.rados.0.trial082.stdout:3166: writing trial08226312-13 from 517946 to 1242141 tid 1 2026-02-12T17:42:08.139 INFO:tasks.rados.rados.0.trial082.stdout:3166: writing trial08226312-13 from 1932177 to 2117946 tid 2 2026-02-12T17:42:08.139 INFO:tasks.rados.rados.0.trial082.stdout:3167: snap_remove snap 337 2026-02-12T17:42:09.118 INFO:tasks.rados.rados.0.trial082.stdout:3167: done (6 left) 2026-02-12T17:42:09.119 INFO:tasks.rados.rados.0.trial082.stdout:3168: rollback oid 28 current snap is 340 2026-02-12T17:42:09.119 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 330 2026-02-12T17:42:09.119 INFO:tasks.rados.rados.0.trial082.stdout:3160: finishing write tid 2 to trial08226312-12 2026-02-12T17:42:09.119 INFO:tasks.rados.rados.0.trial082.stdout:3160: finishing write tid 3 to trial08226312-12 2026-02-12T17:42:09.119 INFO:tasks.rados.rados.0.trial082.stdout:3160: finishing write tid 4 to trial08226312-12 2026-02-12T17:42:09.119 INFO:tasks.rados.rados.0.trial082.stdout:3160: oid 12 updating version 0 to 1997 2026-02-12T17:42:09.119 INFO:tasks.rados.rados.0.trial082.stdout:3160: oid 12 version 1997 is already newer than 1996 2026-02-12T17:42:09.119 INFO:tasks.rados.rados.0.trial082.stdout:3160: oid 12 updating version 1997 to 1998 2026-02-12T17:42:09.120 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 1998 (ObjNum 1074 snap 340 seq_num 1074) dirty exists 2026-02-12T17:42:09.120 INFO:tasks.rados.rados.0.trial082.stdout:3160: left oid 12 (ObjNum 1074 snap 340 seq_num 1074) 2026-02-12T17:42:09.120 INFO:tasks.rados.rados.0.trial082.stdout:3162: expect (ObjNum 1040 snap 325 seq_num 1040) 2026-02-12T17:42:09.120 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:09.146 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1584448 2026-02-12T17:42:09.179 INFO:tasks.rados.rados.0.trial082.stdout:3164: finishing write tid 1 to trial08226312-25 2026-02-12T17:42:09.179 INFO:tasks.rados.rados.0.trial082.stdout:3160: done (6 left) 2026-02-12T17:42:09.179 INFO:tasks.rados.rados.0.trial082.stdout:3162: done (5 left) 2026-02-12T17:42:09.179 INFO:tasks.rados.rados.0.trial082.stdout:3169: write oid 19 current snap is 340 2026-02-12T17:42:09.180 INFO:tasks.rados.rados.0.trial082.stdout:3169: seq_num 1079 ranges {534753=799444,1990659=144094} 2026-02-12T17:42:09.184 INFO:tasks.rados.rados.0.trial082.stdout:3169: writing trial08226312-19 from 534753 to 1334197 tid 1 2026-02-12T17:42:09.189 INFO:tasks.rados.rados.0.trial082.stdout:3169: writing trial08226312-19 from 1990659 to 2134753 tid 2 2026-02-12T17:42:09.189 INFO:tasks.rados.rados.0.trial082.stdout:3170: delete oid 37 current snap is 340 2026-02-12T17:42:09.189 INFO:tasks.rados.rados.0.trial082.stdout:3164: finishing write tid 2 to trial08226312-25 2026-02-12T17:42:09.189 INFO:tasks.rados.rados.0.trial082.stdout:3164: finishing write tid 3 to trial08226312-25 2026-02-12T17:42:09.189 INFO:tasks.rados.rados.0.trial082.stdout:3164: finishing write tid 4 to trial08226312-25 2026-02-12T17:42:09.189 INFO:tasks.rados.rados.0.trial082.stdout:3164: oid 25 updating version 0 to 2210 2026-02-12T17:42:09.189 INFO:tasks.rados.rados.0.trial082.stdout:3164: oid 25 version 2210 is already newer than 2209 2026-02-12T17:42:09.189 INFO:tasks.rados.rados.0.trial082.stdout:3164: oid 25 version 2210 is already newer than 2208 2026-02-12T17:42:09.189 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 2210 (ObjNum 1076 snap 340 seq_num 1076) dirty exists 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3164: left oid 25 (ObjNum 1076 snap 340 seq_num 1076) 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3163: finishing copy_from racing read to trial08226312-15 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3163: finishing copy_from to trial08226312-15 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 2241 (ObjNum 994 snap 307 seq_num 994) dirty exists 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3165: finishing write tid 1 to trial08226312-50 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3165: finishing write tid 2 to trial08226312-50 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3165: finishing write tid 3 to trial08226312-50 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3165: finishing write tid 4 to trial08226312-50 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3165: oid 50 updating version 0 to 2225 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3165: oid 50 updating version 2225 to 2227 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3165: oid 50 version 2227 is already newer than 2226 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 2227 (ObjNum 1077 snap 340 seq_num 1077) dirty exists 2026-02-12T17:42:09.190 INFO:tasks.rados.rados.0.trial082.stdout:3165: left oid 50 (ObjNum 1077 snap 340 seq_num 1077) 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3166: finishing write tid 1 to trial08226312-13 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3166: finishing write tid 2 to trial08226312-13 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3166: finishing write tid 3 to trial08226312-13 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3166: finishing write tid 4 to trial08226312-13 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3166: oid 13 updating version 0 to 2212 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3166: oid 13 updating version 2212 to 2213 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3166: oid 13 version 2213 is already newer than 2211 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2213 (ObjNum 1078 snap 340 seq_num 1078) dirty exists 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3166: left oid 13 (ObjNum 1078 snap 340 seq_num 1078) 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3168: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3168: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2365 (ObjNum 257 snap 0 seq_num 27748368) dirty dne 2026-02-12T17:42:09.191 INFO:tasks.rados.rados.0.trial082.stdout:3169: finishing write tid 1 to trial08226312-19 2026-02-12T17:42:09.192 INFO:tasks.rados.rados.0.trial082.stdout:3163: done (6 left) 2026-02-12T17:42:09.192 INFO:tasks.rados.rados.0.trial082.stdout:3164: done (5 left) 2026-02-12T17:42:09.193 INFO:tasks.rados.rados.0.trial082.stdout:3165: done (4 left) 2026-02-12T17:42:09.193 INFO:tasks.rados.rados.0.trial082.stdout:3166: done (3 left) 2026-02-12T17:42:09.193 INFO:tasks.rados.rados.0.trial082.stdout:3168: done (2 left) 2026-02-12T17:42:09.193 INFO:tasks.rados.rados.0.trial082.stdout:3170: done (1 left) 2026-02-12T17:42:09.193 INFO:tasks.rados.rados.0.trial082.stdout:3171: copy_from oid 50 from oid 31 current snap is 340 2026-02-12T17:42:09.193 INFO:tasks.rados.rados.0.trial082.stdout:3172: rollback oid 9 current snap is 340 2026-02-12T17:42:09.193 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 9 to 326 2026-02-12T17:42:09.193 INFO:tasks.rados.rados.0.trial082.stdout:3173: snap_remove snap 312 2026-02-12T17:42:10.150 INFO:tasks.rados.rados.0.trial082.stdout:3173: done (3 left) 2026-02-12T17:42:10.150 INFO:tasks.rados.rados.0.trial082.stdout:3174: read oid 39 snap -1 2026-02-12T17:42:10.150 INFO:tasks.rados.rados.0.trial082.stdout:3174: expect deleted 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3175: delete oid 23 current snap is 340 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3169: finishing write tid 2 to trial08226312-19 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3169: finishing write tid 3 to trial08226312-19 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3169: finishing write tid 4 to trial08226312-19 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3169: oid 19 updating version 0 to 2389 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3169: oid 19 version 2389 is already newer than 2387 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3169: oid 19 version 2389 is already newer than 2388 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 2389 (ObjNum 1079 snap 340 seq_num 1079) dirty exists 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3169: left oid 19 (ObjNum 1079 snap 340 seq_num 1079) 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3172: finishing rollback tid 1 to trial08226312-9 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:3172: finishing rollback tid 2 to trial08226312-9 2026-02-12T17:42:10.151 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 2367 (ObjNum 1028 snap 322 seq_num 1028) dirty exists 2026-02-12T17:42:10.152 INFO:tasks.rados.rados.0.trial082.stdout:3171: finishing copy_from racing read to trial08226312-50 2026-02-12T17:42:10.152 INFO:tasks.rados.rados.0.trial082.stdout:3171: finishing copy_from to trial08226312-50 2026-02-12T17:42:10.152 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 1900 (ObjNum 1049 snap 330 seq_num 1049) dirty exists 2026-02-12T17:42:10.155 INFO:tasks.rados.rados.0.trial082.stdout:3169: done (4 left) 2026-02-12T17:42:10.155 INFO:tasks.rados.rados.0.trial082.stdout:3171: done (3 left) 2026-02-12T17:42:10.155 INFO:tasks.rados.rados.0.trial082.stdout:3172: done (2 left) 2026-02-12T17:42:10.155 INFO:tasks.rados.rados.0.trial082.stdout:3174: done (1 left) 2026-02-12T17:42:10.155 INFO:tasks.rados.rados.0.trial082.stdout:3175: done (0 left) 2026-02-12T17:42:10.155 INFO:tasks.rados.rados.0.trial082.stdout:3176: rollback oid 2 current snap is 340 2026-02-12T17:42:10.155 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 328 2026-02-12T17:42:10.155 INFO:tasks.rados.rados.0.trial082.stdout:3177: snap_create 2026-02-12T17:42:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3176: finishing rollback tid 0 to trial08226312-2 2026-02-12T17:42:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3176: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:42:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3176: finishing rollback tid 2 to trial08226312-2 2026-02-12T17:42:10.167 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 2248 (ObjNum 955 snap 297 seq_num 955) dirty exists 2026-02-12T17:42:12.181 INFO:tasks.rados.rados.0.trial082.stdout:3176: done (1 left) 2026-02-12T17:42:12.181 INFO:tasks.rados.rados.0.trial082.stdout:3177: done (0 left) 2026-02-12T17:42:12.181 INFO:tasks.rados.rados.0.trial082.stdout:3178: write (excl) oid 3 current snap is 341 2026-02-12T17:42:12.182 INFO:tasks.rados.rados.0.trial082.stdout:3178: seq_num 1082 ranges {585174=741544,1766105=419069} 2026-02-12T17:42:12.187 INFO:tasks.rados.rados.0.trial082.stdout:3178: writing trial08226312-3 from 585174 to 1326718 tid 1 2026-02-12T17:42:12.190 INFO:tasks.rados.rados.0.trial082.stdout:3178: writing trial08226312-3 from 1766105 to 2185174 tid 2 2026-02-12T17:42:12.190 INFO:tasks.rados.rados.0.trial082.stdout:3179: delete oid 35 current snap is 341 2026-02-12T17:42:12.192 INFO:tasks.rados.rados.0.trial082.stdout:3178: finishing write tid 1 to trial08226312-3 2026-02-12T17:42:12.193 INFO:tasks.rados.rados.0.trial082.stdout:3179: done (1 left) 2026-02-12T17:42:12.193 INFO:tasks.rados.rados.0.trial082.stdout:3180: write oid 22 current snap is 341 2026-02-12T17:42:12.193 INFO:tasks.rados.rados.0.trial082.stdout:3180: seq_num 1084 ranges {618788=492042,1883069=335719} 2026-02-12T17:42:12.197 INFO:tasks.rados.rados.0.trial082.stdout:3180: writing trial08226312-22 from 618788 to 1110830 tid 1 2026-02-12T17:42:12.202 INFO:tasks.rados.rados.0.trial082.stdout:3180: writing trial08226312-22 from 1883069 to 2218788 tid 2 2026-02-12T17:42:12.202 INFO:tasks.rados.rados.0.trial082.stdout:3181: snap_create 2026-02-12T17:42:12.202 INFO:tasks.rados.rados.0.trial082.stdout:3178: finishing write tid 2 to trial08226312-3 2026-02-12T17:42:12.202 INFO:tasks.rados.rados.0.trial082.stdout:3178: finishing write tid 3 to trial08226312-3 2026-02-12T17:42:12.202 INFO:tasks.rados.rados.0.trial082.stdout:3178: finishing write tid 4 to trial08226312-3 2026-02-12T17:42:12.202 INFO:tasks.rados.rados.0.trial082.stdout:3178: oid 3 updating version 0 to 2244 2026-02-12T17:42:12.202 INFO:tasks.rados.rados.0.trial082.stdout:3178: oid 3 version 2244 is already newer than 2243 2026-02-12T17:42:12.202 INFO:tasks.rados.rados.0.trial082.stdout:3178: oid 3 version 2244 is already newer than 2242 2026-02-12T17:42:12.202 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 2244 (ObjNum 1082 snap 341 seq_num 1082) dirty exists 2026-02-12T17:42:12.203 INFO:tasks.rados.rados.0.trial082.stdout:3178: left oid 3 (ObjNum 1082 snap 341 seq_num 1082) 2026-02-12T17:42:12.203 INFO:tasks.rados.rados.0.trial082.stdout:3180: finishing write tid 1 to trial08226312-22 2026-02-12T17:42:12.203 INFO:tasks.rados.rados.0.trial082.stdout:3180: finishing write tid 2 to trial08226312-22 2026-02-12T17:42:12.204 INFO:tasks.rados.rados.0.trial082.stdout:3180: finishing write tid 3 to trial08226312-22 2026-02-12T17:42:12.204 INFO:tasks.rados.rados.0.trial082.stdout:3180: finishing write tid 4 to trial08226312-22 2026-02-12T17:42:12.204 INFO:tasks.rados.rados.0.trial082.stdout:3180: oid 22 updating version 0 to 2250 2026-02-12T17:42:12.204 INFO:tasks.rados.rados.0.trial082.stdout:3180: oid 22 updating version 2250 to 2251 2026-02-12T17:42:12.204 INFO:tasks.rados.rados.0.trial082.stdout:3180: oid 22 updating version 2251 to 2252 2026-02-12T17:42:12.204 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2252 (ObjNum 1084 snap 341 seq_num 1084) dirty exists 2026-02-12T17:42:12.204 INFO:tasks.rados.rados.0.trial082.stdout:3180: left oid 22 (ObjNum 1084 snap 341 seq_num 1084) 2026-02-12T17:42:12.381 INFO:tasks.rados.rados.0.trial082.stdout:3178: done (2 left) 2026-02-12T17:42:12.382 INFO:tasks.rados.rados.0.trial082.stdout:3180: done (1 left) 2026-02-12T17:42:12.382 INFO:tasks.rados.rados.0.trial082.stdout:3181: done (0 left) 2026-02-12T17:42:12.382 INFO:tasks.rados.rados.0.trial082.stdout:3182: delete oid 45 current snap is 342 2026-02-12T17:42:12.384 INFO:tasks.rados.rados.0.trial082.stdout:3182: done (0 left) 2026-02-12T17:42:12.384 INFO:tasks.rados.rados.0.trial082.stdout:3183: write (excl) oid 31 current snap is 342 2026-02-12T17:42:12.384 INFO:tasks.rados.rados.0.trial082.stdout:3183: seq_num 1086 ranges {652402=642540,1883680=368722} 2026-02-12T17:42:12.388 INFO:tasks.rados.rados.0.trial082.stdout:3183: writing trial08226312-31 from 652402 to 1294942 tid 1 2026-02-12T17:42:12.392 INFO:tasks.rados.rados.0.trial082.stdout:3183: writing trial08226312-31 from 1883680 to 2252402 tid 2 2026-02-12T17:42:12.392 INFO:tasks.rados.rados.0.trial082.stdout:3184: rollback oid 37 current snap is 342 2026-02-12T17:42:12.392 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 37 to 324 2026-02-12T17:42:12.393 INFO:tasks.rados.rados.0.trial082.stdout:3183: finishing write tid 1 to trial08226312-31 2026-02-12T17:42:12.393 INFO:tasks.rados.rados.0.trial082.stdout:3185: write oid 1 current snap is 342 2026-02-12T17:42:12.393 INFO:tasks.rados.rados.0.trial082.stdout:3185: seq_num 1087 ranges {669209=717789,1942162=327047} 2026-02-12T17:42:12.398 INFO:tasks.rados.rados.0.trial082.stdout:3185: writing trial08226312-1 from 669209 to 1386998 tid 1 2026-02-12T17:42:12.402 INFO:tasks.rados.rados.0.trial082.stdout:3185: writing trial08226312-1 from 1942162 to 2269209 tid 2 2026-02-12T17:42:12.403 INFO:tasks.rados.rados.0.trial082.stdout:3186: write oid 26 current snap is 342 2026-02-12T17:42:12.403 INFO:tasks.rados.rados.0.trial082.stdout:3186: seq_num 1088 ranges {686016=509391,1716997=569019} 2026-02-12T17:42:12.407 INFO:tasks.rados.rados.0.trial082.stdout:3186: writing trial08226312-26 from 686016 to 1195407 tid 1 2026-02-12T17:42:12.413 INFO:tasks.rados.rados.0.trial082.stdout:3186: writing trial08226312-26 from 1716997 to 2286016 tid 2 2026-02-12T17:42:12.413 INFO:tasks.rados.rados.0.trial082.stdout:3187: delete oid 15 current snap is 342 2026-02-12T17:42:12.413 INFO:tasks.rados.rados.0.trial082.stdout:3183: finishing write tid 2 to trial08226312-31 2026-02-12T17:42:12.413 INFO:tasks.rados.rados.0.trial082.stdout:3183: finishing write tid 3 to trial08226312-31 2026-02-12T17:42:12.413 INFO:tasks.rados.rados.0.trial082.stdout:3183: finishing write tid 4 to trial08226312-31 2026-02-12T17:42:12.413 INFO:tasks.rados.rados.0.trial082.stdout:3183: oid 31 updating version 0 to 2249 2026-02-12T17:42:12.413 INFO:tasks.rados.rados.0.trial082.stdout:3183: oid 31 updating version 2249 to 2250 2026-02-12T17:42:12.413 INFO:tasks.rados.rados.0.trial082.stdout:3183: oid 31 updating version 2250 to 2251 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 2251 (ObjNum 1086 snap 342 seq_num 1086) dirty exists 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3183: left oid 31 (ObjNum 1086 snap 342 seq_num 1086) 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3184: finishing rollback tid 1 to trial08226312-37 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3184: finishing rollback tid 2 to trial08226312-37 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 2001 (ObjNum 970 snap 301 seq_num 970) dirty exists 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3185: finishing write tid 1 to trial08226312-1 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3185: finishing write tid 2 to trial08226312-1 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3185: finishing write tid 3 to trial08226312-1 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3185: finishing write tid 4 to trial08226312-1 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3185: oid 1 updating version 0 to 2143 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3185: oid 1 version 2143 is already newer than 2142 2026-02-12T17:42:12.414 INFO:tasks.rados.rados.0.trial082.stdout:3185: oid 1 version 2143 is already newer than 2141 2026-02-12T17:42:12.415 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2143 (ObjNum 1087 snap 342 seq_num 1087) dirty exists 2026-02-12T17:42:12.415 INFO:tasks.rados.rados.0.trial082.stdout:3185: left oid 1 (ObjNum 1087 snap 342 seq_num 1087) 2026-02-12T17:42:12.415 INFO:tasks.rados.rados.0.trial082.stdout:3186: finishing write tid 1 to trial08226312-26 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3183: done (4 left) 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3184: done (3 left) 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3185: done (2 left) 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3187: done (1 left) 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3188: snap_create 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3186: finishing write tid 2 to trial08226312-26 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3186: finishing write tid 3 to trial08226312-26 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3186: finishing write tid 4 to trial08226312-26 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3186: oid 26 updating version 0 to 1950 2026-02-12T17:42:12.416 INFO:tasks.rados.rados.0.trial082.stdout:3186: oid 26 updating version 1950 to 1952 2026-02-12T17:42:12.417 INFO:tasks.rados.rados.0.trial082.stdout:3186: oid 26 version 1952 is already newer than 1951 2026-02-12T17:42:12.417 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 1952 (ObjNum 1088 snap 342 seq_num 1088) dirty exists 2026-02-12T17:42:12.417 INFO:tasks.rados.rados.0.trial082.stdout:3186: left oid 26 (ObjNum 1088 snap 342 seq_num 1088) 2026-02-12T17:42:13.107 INFO:tasks.rados.rados.0.trial082.stdout:3186: done (1 left) 2026-02-12T17:42:13.107 INFO:tasks.rados.rados.0.trial082.stdout:3188: done (0 left) 2026-02-12T17:42:13.107 INFO:tasks.rados.rados.0.trial082.stdout:3189: write oid 28 current snap is 343 2026-02-12T17:42:13.107 INFO:tasks.rados.rados.0.trial082.stdout:3189: seq_num 1090 ranges {719630=659889,2117608=202022} 2026-02-12T17:42:13.111 INFO:tasks.rados.rados.0.trial082.stdout:3189: writing trial08226312-28 from 719630 to 1379519 tid 1 2026-02-12T17:42:13.115 INFO:tasks.rados.rados.0.trial082.stdout:3189: writing trial08226312-28 from 2117608 to 2319630 tid 2 2026-02-12T17:42:13.116 INFO:tasks.rados.rados.0.trial082.stdout:3190: rollback oid 43 current snap is 343 2026-02-12T17:42:13.116 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 43 to 334 2026-02-12T17:42:13.116 INFO:tasks.rados.rados.0.trial082.stdout:3189: finishing write tid 1 to trial08226312-28 2026-02-12T17:42:13.116 INFO:tasks.rados.rados.0.trial082.stdout:3191: copy_from oid 27 from oid 31 current snap is 343 2026-02-12T17:42:13.116 INFO:tasks.rados.rados.0.trial082.stdout:3192: snap_create 2026-02-12T17:42:13.117 INFO:tasks.rados.rados.0.trial082.stdout:3189: finishing write tid 2 to trial08226312-28 2026-02-12T17:42:13.117 INFO:tasks.rados.rados.0.trial082.stdout:3189: finishing write tid 3 to trial08226312-28 2026-02-12T17:42:13.117 INFO:tasks.rados.rados.0.trial082.stdout:3189: finishing write tid 4 to trial08226312-28 2026-02-12T17:42:13.117 INFO:tasks.rados.rados.0.trial082.stdout:3189: oid 28 updating version 0 to 2370 2026-02-12T17:42:13.117 INFO:tasks.rados.rados.0.trial082.stdout:3189: oid 28 version 2370 is already newer than 2368 2026-02-12T17:42:13.117 INFO:tasks.rados.rados.0.trial082.stdout:3189: oid 28 version 2370 is already newer than 2369 2026-02-12T17:42:13.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2370 (ObjNum 1090 snap 343 seq_num 1090) dirty exists 2026-02-12T17:42:13.118 INFO:tasks.rados.rados.0.trial082.stdout:3189: left oid 28 (ObjNum 1090 snap 343 seq_num 1090) 2026-02-12T17:42:13.118 INFO:tasks.rados.rados.0.trial082.stdout:3190: finishing rollback tid 0 to trial08226312-43 2026-02-12T17:42:13.118 INFO:tasks.rados.rados.0.trial082.stdout:3190: finishing rollback tid 1 to trial08226312-43 2026-02-12T17:42:13.118 INFO:tasks.rados.rados.0.trial082.stdout:3190: finishing rollback tid 2 to trial08226312-43 2026-02-12T17:42:13.118 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2255 (ObjNum 994 snap 307 seq_num 994) dirty exists 2026-02-12T17:42:13.121 INFO:tasks.rados.rados.0.trial082.stdout:3191: finishing copy_from racing read to trial08226312-27 2026-02-12T17:42:13.122 INFO:tasks.rados.rados.0.trial082.stdout:3191: finishing copy_from to trial08226312-27 2026-02-12T17:42:13.122 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2251 (ObjNum 1086 snap 342 seq_num 1086) dirty exists 2026-02-12T17:42:14.110 INFO:tasks.rados.rados.0.trial082.stdout:3189: done (3 left) 2026-02-12T17:42:14.110 INFO:tasks.rados.rados.0.trial082.stdout:3190: done (2 left) 2026-02-12T17:42:14.110 INFO:tasks.rados.rados.0.trial082.stdout:3191: done (1 left) 2026-02-12T17:42:14.110 INFO:tasks.rados.rados.0.trial082.stdout:3192: done (0 left) 2026-02-12T17:42:14.110 INFO:tasks.rados.rados.0.trial082.stdout:3193: snap_create 2026-02-12T17:42:15.111 INFO:tasks.rados.rados.0.trial082.stdout:3193: done (0 left) 2026-02-12T17:42:15.112 INFO:tasks.rados.rados.0.trial082.stdout:3194: write (excl) oid 47 current snap is 345 2026-02-12T17:42:15.112 INFO:tasks.rados.rados.0.trial082.stdout:3194: seq_num 1091 ranges {736437=735138,2176090=160347} 2026-02-12T17:42:15.117 INFO:tasks.rados.rados.0.trial082.stdout:3194: writing trial08226312-47 from 736437 to 1471575 tid 1 2026-02-12T17:42:15.120 INFO:tasks.rados.rados.0.trial082.stdout:3194: writing trial08226312-47 from 2176090 to 2336437 tid 2 2026-02-12T17:42:15.121 INFO:tasks.rados.rados.0.trial082.stdout:3195: delete oid 48 current snap is 345 2026-02-12T17:42:15.121 INFO:tasks.rados.rados.0.trial082.stdout:3194: finishing write tid 1 to trial08226312-47 2026-02-12T17:42:15.122 INFO:tasks.rados.rados.0.trial082.stdout:3194: finishing write tid 2 to trial08226312-47 2026-02-12T17:42:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3194: finishing write tid 3 to trial08226312-47 2026-02-12T17:42:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3194: finishing write tid 4 to trial08226312-47 2026-02-12T17:42:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3194: oid 47 updating version 0 to 2398 2026-02-12T17:42:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3194: oid 47 updating version 2398 to 2399 2026-02-12T17:42:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3194: oid 47 version 2399 is already newer than 2397 2026-02-12T17:42:15.123 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 47 v 2399 (ObjNum 1091 snap 345 seq_num 1091) dirty exists 2026-02-12T17:42:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3194: left oid 47 (ObjNum 1091 snap 345 seq_num 1091) 2026-02-12T17:42:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3194: done (1 left) 2026-02-12T17:42:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3195: done (0 left) 2026-02-12T17:42:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3196: write (excl) oid 35 current snap is 345 2026-02-12T17:42:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3196: seq_num 1093 ranges {770051=485636,1776701=511047} 2026-02-12T17:42:15.128 INFO:tasks.rados.rados.0.trial082.stdout:3196: writing trial08226312-35 from 770051 to 1255687 tid 1 2026-02-12T17:42:15.132 INFO:tasks.rados.rados.0.trial082.stdout:3196: writing trial08226312-35 from 1776701 to 2287748 tid 2 2026-02-12T17:42:15.132 INFO:tasks.rados.rados.0.trial082.stdout:3196: finishing write tid 1 to trial08226312-35 2026-02-12T17:42:15.132 INFO:tasks.rados.rados.0.trial082.stdout:3197: read oid 15 snap -1 2026-02-12T17:42:15.132 INFO:tasks.rados.rados.0.trial082.stdout:3197: expect deleted 2026-02-12T17:42:15.132 INFO:tasks.rados.rados.0.trial082.stdout:3198: delete oid 31 current snap is 345 2026-02-12T17:42:15.133 INFO:tasks.rados.rados.0.trial082.stdout:3197: done (2 left) 2026-02-12T17:42:15.134 INFO:tasks.rados.rados.0.trial082.stdout:3198: done (1 left) 2026-02-12T17:42:15.134 INFO:tasks.rados.rados.0.trial082.stdout:3199: write oid 48 current snap is 345 2026-02-12T17:42:15.134 INFO:tasks.rados.rados.0.trial082.stdout:3199: seq_num 1095 ranges {403665=752487,1610018=514716} 2026-02-12T17:42:15.138 INFO:tasks.rados.rados.0.trial082.stdout:3199: writing trial08226312-48 from 403665 to 1156152 tid 1 2026-02-12T17:42:15.142 INFO:tasks.rados.rados.0.trial082.stdout:3199: writing trial08226312-48 from 1610018 to 2124734 tid 2 2026-02-12T17:42:15.142 INFO:tasks.rados.rados.0.trial082.stdout:3200: copy_from oid 15 from oid 22 current snap is 345 2026-02-12T17:42:15.142 INFO:tasks.rados.rados.0.trial082.stdout:3196: finishing write tid 2 to trial08226312-35 2026-02-12T17:42:15.142 INFO:tasks.rados.rados.0.trial082.stdout:3196: finishing write tid 3 to trial08226312-35 2026-02-12T17:42:15.142 INFO:tasks.rados.rados.0.trial082.stdout:3196: finishing write tid 4 to trial08226312-35 2026-02-12T17:42:15.142 INFO:tasks.rados.rados.0.trial082.stdout:3196: oid 35 updating version 0 to 1955 2026-02-12T17:42:15.142 INFO:tasks.rados.rados.0.trial082.stdout:3196: oid 35 version 1955 is already newer than 1953 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:3196: oid 35 version 1955 is already newer than 1954 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1955 (ObjNum 1093 snap 345 seq_num 1093) dirty exists 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:3196: left oid 35 (ObjNum 1093 snap 345 seq_num 1093) 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:3199: finishing write tid 1 to trial08226312-48 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:3196: done (2 left) 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:3201: rollback oid 41 current snap is 345 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 340 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:3202: read oid 38 snap -1 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:3202: expect deleted 2026-02-12T17:42:15.143 INFO:tasks.rados.rados.0.trial082.stdout:3203: snap_remove snap 310 2026-02-12T17:42:16.114 INFO:tasks.rados.rados.0.trial082.stdout:3203: done (4 left) 2026-02-12T17:42:16.115 INFO:tasks.rados.rados.0.trial082.stdout:3204: write oid 13 current snap is 345 2026-02-12T17:42:16.115 INFO:tasks.rados.rados.0.trial082.stdout:3204: seq_num 1096 ranges {420472=427736,1268500=658374,2347953=72519} 2026-02-12T17:42:16.117 INFO:tasks.rados.rados.0.trial082.stdout:3204: writing trial08226312-13 from 420472 to 848208 tid 1 2026-02-12T17:42:16.121 INFO:tasks.rados.rados.0.trial082.stdout:3204: writing trial08226312-13 from 1268500 to 1926874 tid 2 2026-02-12T17:42:16.123 INFO:tasks.rados.rados.0.trial082.stdout:3204: writing trial08226312-13 from 2347953 to 2420472 tid 3 2026-02-12T17:42:16.123 INFO:tasks.rados.rados.0.trial082.stdout:3205: snap_remove snap 326 2026-02-12T17:42:17.117 INFO:tasks.rados.rados.0.trial082.stdout:3205: done (5 left) 2026-02-12T17:42:17.118 INFO:tasks.rados.rados.0.trial082.stdout:3206: snap_remove snap 335 2026-02-12T17:42:18.106 INFO:tasks.rados.rados.0.trial082.stdout:3206: done (5 left) 2026-02-12T17:42:18.107 INFO:tasks.rados.rados.0.trial082.stdout:3207: write (excl) oid 1 current snap is 345 2026-02-12T17:42:18.107 INFO:tasks.rados.rados.0.trial082.stdout:3207: seq_num 1097 ranges {437279=502985,1610629=518385} 2026-02-12T17:42:18.110 INFO:tasks.rados.rados.0.trial082.stdout:3207: writing trial08226312-1 from 437279 to 940264 tid 1 2026-02-12T17:42:18.116 INFO:tasks.rados.rados.0.trial082.stdout:3207: writing trial08226312-1 from 1610629 to 2129014 tid 2 2026-02-12T17:42:18.116 INFO:tasks.rados.rados.0.trial082.stdout:3208: write (excl) oid 7 current snap is 345 2026-02-12T17:42:18.116 INFO:tasks.rados.rados.0.trial082.stdout:3208: seq_num 1098 ranges {454086=578234,1669111=662043} 2026-02-12T17:42:18.120 INFO:tasks.rados.rados.0.trial082.stdout:3208: writing trial08226312-7 from 454086 to 1032320 tid 1 2026-02-12T17:42:18.125 INFO:tasks.rados.rados.0.trial082.stdout:3208: writing trial08226312-7 from 1669111 to 2331154 tid 2 2026-02-12T17:42:18.125 INFO:tasks.rados.rados.0.trial082.stdout:3209: write (excl) oid 35 current snap is 345 2026-02-12T17:42:18.125 INFO:tasks.rados.rados.0.trial082.stdout:3209: seq_num 1099 ranges {470893=653483,1727593=522054} 2026-02-12T17:42:18.129 INFO:tasks.rados.rados.0.trial082.stdout:3209: writing trial08226312-35 from 470893 to 1124376 tid 1 2026-02-12T17:42:18.135 INFO:tasks.rados.rados.0.trial082.stdout:3209: writing trial08226312-35 from 1727593 to 2249647 tid 2 2026-02-12T17:42:18.135 INFO:tasks.rados.rados.0.trial082.stdout:3210: snap_create 2026-02-12T17:42:18.135 INFO:tasks.rados.rados.0.trial082.stdout:3199: finishing write tid 2 to trial08226312-48 2026-02-12T17:42:18.135 INFO:tasks.rados.rados.0.trial082.stdout:3199: finishing write tid 3 to trial08226312-48 2026-02-12T17:42:18.135 INFO:tasks.rados.rados.0.trial082.stdout:3199: finishing write tid 4 to trial08226312-48 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:3199: oid 48 updating version 0 to 1620 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:3199: oid 48 version 1620 is already newer than 1619 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:3199: oid 48 version 1620 is already newer than 1618 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1620 (ObjNum 1095 snap 345 seq_num 1095) dirty exists 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:3199: left oid 48 (ObjNum 1095 snap 345 seq_num 1095) 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:3201: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:3201: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:3201: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 2004 (ObjNum 1060 snap 334 seq_num 1060) dirty exists 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:3200: finishing copy_from racing read to trial08226312-15 2026-02-12T17:42:18.136 INFO:tasks.rados.rados.0.trial082.stdout:3200: finishing copy_from to trial08226312-15 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 2252 (ObjNum 1084 snap 341 seq_num 1084) dirty exists 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: finishing write tid 1 to trial08226312-13 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: finishing write tid 2 to trial08226312-13 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: finishing write tid 3 to trial08226312-13 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: finishing write tid 4 to trial08226312-13 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: finishing write tid 5 to trial08226312-13 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: oid 13 updating version 0 to 2216 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: oid 13 updating version 2216 to 2217 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: oid 13 version 2217 is already newer than 2215 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: oid 13 version 2217 is already newer than 2214 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2217 (ObjNum 1096 snap 345 seq_num 1096) dirty exists 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3204: left oid 13 (ObjNum 1096 snap 345 seq_num 1096) 2026-02-12T17:42:18.137 INFO:tasks.rados.rados.0.trial082.stdout:3207: finishing write tid 1 to trial08226312-1 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3207: finishing write tid 2 to trial08226312-1 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3207: finishing write tid 3 to trial08226312-1 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3207: finishing write tid 4 to trial08226312-1 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3207: oid 1 updating version 0 to 2144 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3207: oid 1 updating version 2144 to 2146 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3207: oid 1 version 2146 is already newer than 2145 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2146 (ObjNum 1097 snap 345 seq_num 1097) dirty exists 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3207: left oid 1 (ObjNum 1097 snap 345 seq_num 1097) 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3208: finishing write tid 1 to trial08226312-7 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3208: finishing write tid 2 to trial08226312-7 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3208: finishing write tid 3 to trial08226312-7 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3208: finishing write tid 4 to trial08226312-7 2026-02-12T17:42:18.138 INFO:tasks.rados.rados.0.trial082.stdout:3208: oid 7 updating version 0 to 2373 2026-02-12T17:42:18.139 INFO:tasks.rados.rados.0.trial082.stdout:3208: oid 7 version 2373 is already newer than 2372 2026-02-12T17:42:18.139 INFO:tasks.rados.rados.0.trial082.stdout:3208: oid 7 version 2373 is already newer than 2371 2026-02-12T17:42:18.139 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 2373 (ObjNum 1098 snap 345 seq_num 1098) dirty exists 2026-02-12T17:42:18.139 INFO:tasks.rados.rados.0.trial082.stdout:3208: left oid 7 (ObjNum 1098 snap 345 seq_num 1098) 2026-02-12T17:42:18.139 INFO:tasks.rados.rados.0.trial082.stdout:3209: finishing write tid 1 to trial08226312-35 2026-02-12T17:42:18.140 INFO:tasks.rados.rados.0.trial082.stdout:3209: finishing write tid 2 to trial08226312-35 2026-02-12T17:42:18.140 INFO:tasks.rados.rados.0.trial082.stdout:3209: finishing write tid 3 to trial08226312-35 2026-02-12T17:42:18.140 INFO:tasks.rados.rados.0.trial082.stdout:3209: finishing write tid 4 to trial08226312-35 2026-02-12T17:42:18.140 INFO:tasks.rados.rados.0.trial082.stdout:3209: oid 35 updating version 0 to 1959 2026-02-12T17:42:18.140 INFO:tasks.rados.rados.0.trial082.stdout:3209: oid 35 version 1959 is already newer than 1958 2026-02-12T17:42:18.140 INFO:tasks.rados.rados.0.trial082.stdout:3209: oid 35 version 1959 is already newer than 1956 2026-02-12T17:42:18.140 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 1959 (ObjNum 1099 snap 345 seq_num 1099) dirty exists 2026-02-12T17:42:18.140 INFO:tasks.rados.rados.0.trial082.stdout:3209: left oid 35 (ObjNum 1099 snap 345 seq_num 1099) 2026-02-12T17:42:19.123 INFO:tasks.rados.rados.0.trial082.stdout:3199: done (8 left) 2026-02-12T17:42:19.123 INFO:tasks.rados.rados.0.trial082.stdout:3200: done (7 left) 2026-02-12T17:42:19.123 INFO:tasks.rados.rados.0.trial082.stdout:3201: done (6 left) 2026-02-12T17:42:19.123 INFO:tasks.rados.rados.0.trial082.stdout:3202: done (5 left) 2026-02-12T17:42:19.123 INFO:tasks.rados.rados.0.trial082.stdout:3204: done (4 left) 2026-02-12T17:42:19.123 INFO:tasks.rados.rados.0.trial082.stdout:3207: done (3 left) 2026-02-12T17:42:19.123 INFO:tasks.rados.rados.0.trial082.stdout:3208: done (2 left) 2026-02-12T17:42:19.123 INFO:tasks.rados.rados.0.trial082.stdout:3209: done (1 left) 2026-02-12T17:42:19.124 INFO:tasks.rados.rados.0.trial082.stdout:3210: done (0 left) 2026-02-12T17:42:19.124 INFO:tasks.rados.rados.0.trial082.stdout:3211: snap_remove snap 283 2026-02-12T17:42:20.126 INFO:tasks.rados.rados.0.trial082.stdout:3211: done (0 left) 2026-02-12T17:42:20.127 INFO:tasks.rados.rados.0.trial082.stdout:3212: read oid 46 snap -1 2026-02-12T17:42:20.127 INFO:tasks.rados.rados.0.trial082.stdout:3212: expect (ObjNum 1028 snap 322 seq_num 1028) 2026-02-12T17:42:20.127 INFO:tasks.rados.rados.0.trial082.stdout:3213: write oid 27 current snap is 346 2026-02-12T17:42:20.127 INFO:tasks.rados.rados.0.trial082.stdout:3213: seq_num 1100 ranges {487700=728732,1786075=665712} 2026-02-12T17:42:20.131 INFO:tasks.rados.rados.0.trial082.stdout:3213: writing trial08226312-27 from 487700 to 1216432 tid 1 2026-02-12T17:42:20.135 INFO:tasks.rados.rados.0.trial082.stdout:3213: writing trial08226312-27 from 1786075 to 2451787 tid 2 2026-02-12T17:42:20.136 INFO:tasks.rados.rados.0.trial082.stdout:3214: write oid 34 current snap is 346 2026-02-12T17:42:20.136 INFO:tasks.rados.rados.0.trial082.stdout:3214: seq_num 1101 ranges {504507=403981,1328204=409370,2252362=252145} 2026-02-12T17:42:20.139 INFO:tasks.rados.rados.0.trial082.stdout:3214: writing trial08226312-34 from 504507 to 908488 tid 1 2026-02-12T17:42:20.142 INFO:tasks.rados.rados.0.trial082.stdout:3214: writing trial08226312-34 from 1328204 to 1737574 tid 2 2026-02-12T17:42:20.145 INFO:tasks.rados.rados.0.trial082.stdout:3214: writing trial08226312-34 from 2252362 to 2504507 tid 3 2026-02-12T17:42:20.146 INFO:tasks.rados.rados.0.trial082.stdout:3215: snap_remove snap 336 2026-02-12T17:42:21.129 INFO:tasks.rados.rados.0.trial082.stdout:3215: done (3 left) 2026-02-12T17:42:21.129 INFO:tasks.rados.rados.0.trial082.stdout:3216: delete oid 26 current snap is 346 2026-02-12T17:42:21.129 INFO:tasks.rados.rados.0.trial082.stdout:3212: expect (ObjNum 1028 snap 322 seq_num 1028) 2026-02-12T17:42:21.133 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 627509 2026-02-12T17:42:21.229 INFO:tasks.rados.rados.0.trial082.stdout:3213: finishing write tid 1 to trial08226312-27 2026-02-12T17:42:21.229 INFO:tasks.rados.rados.0.trial082.stdout:3213: finishing write tid 2 to trial08226312-27 2026-02-12T17:42:21.229 INFO:tasks.rados.rados.0.trial082.stdout:3213: finishing write tid 3 to trial08226312-27 2026-02-12T17:42:21.229 INFO:tasks.rados.rados.0.trial082.stdout:3213: finishing write tid 4 to trial08226312-27 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3213: oid 27 updating version 0 to 2255 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3213: oid 27 version 2255 is already newer than 2253 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3213: oid 27 version 2255 is already newer than 2254 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2255 (ObjNum 1100 snap 346 seq_num 1100) dirty exists 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3213: left oid 27 (ObjNum 1100 snap 346 seq_num 1100) 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3214: finishing write tid 1 to trial08226312-34 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3214: finishing write tid 2 to trial08226312-34 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3212: done (3 left) 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3213: done (2 left) 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3216: done (1 left) 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3217: write oid 17 current snap is 346 2026-02-12T17:42:21.230 INFO:tasks.rados.rados.0.trial082.stdout:3217: seq_num 1103 ranges {538121=670832,1961521=413039} 2026-02-12T17:42:21.233 INFO:tasks.rados.rados.0.trial082.stdout:3217: writing trial08226312-17 from 538121 to 1208953 tid 1 2026-02-12T17:42:21.238 INFO:tasks.rados.rados.0.trial082.stdout:3217: writing trial08226312-17 from 1961521 to 2374560 tid 2 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3218: read oid 11 snap -1 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3218: expect deleted 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3219: read oid 14 snap -1 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3219: expect (ObjNum 1046 snap 326 seq_num 1046) 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3220: delete oid 1 current snap is 346 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3214: finishing write tid 3 to trial08226312-34 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3214: finishing write tid 4 to trial08226312-34 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3214: finishing write tid 5 to trial08226312-34 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3214: oid 34 updating version 0 to 1584 2026-02-12T17:42:21.239 INFO:tasks.rados.rados.0.trial082.stdout:3214: oid 34 version 1584 is already newer than 1582 2026-02-12T17:42:21.240 INFO:tasks.rados.rados.0.trial082.stdout:3214: oid 34 version 1584 is already newer than 1581 2026-02-12T17:42:21.240 INFO:tasks.rados.rados.0.trial082.stdout:3214: oid 34 version 1584 is already newer than 1583 2026-02-12T17:42:21.240 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 1584 (ObjNum 1101 snap 346 seq_num 1101) dirty exists 2026-02-12T17:42:21.240 INFO:tasks.rados.rados.0.trial082.stdout:3214: left oid 34 (ObjNum 1101 snap 346 seq_num 1101) 2026-02-12T17:42:21.240 INFO:tasks.rados.rados.0.trial082.stdout:3217: finishing write tid 1 to trial08226312-17 2026-02-12T17:42:21.240 INFO:tasks.rados.rados.0.trial082.stdout:3214: done (4 left) 2026-02-12T17:42:21.241 INFO:tasks.rados.rados.0.trial082.stdout:3218: done (3 left) 2026-02-12T17:42:21.241 INFO:tasks.rados.rados.0.trial082.stdout:3220: done (2 left) 2026-02-12T17:42:21.241 INFO:tasks.rados.rados.0.trial082.stdout:3221: write oid 7 current snap is 346 2026-02-12T17:42:21.241 INFO:tasks.rados.rados.0.trial082.stdout:3221: seq_num 1105 ranges {571735=421330,1562132=416708} 2026-02-12T17:42:21.243 INFO:tasks.rados.rados.0.trial082.stdout:3221: writing trial08226312-7 from 571735 to 993065 tid 1 2026-02-12T17:42:21.247 INFO:tasks.rados.rados.0.trial082.stdout:3221: writing trial08226312-7 from 1562132 to 1978840 tid 2 2026-02-12T17:42:21.247 INFO:tasks.rados.rados.0.trial082.stdout:3222: write oid 27 current snap is 346 2026-02-12T17:42:21.247 INFO:tasks.rados.rados.0.trial082.stdout:3222: seq_num 1106 ranges {588542=496579,1620614=676719} 2026-02-12T17:42:21.251 INFO:tasks.rados.rados.0.trial082.stdout:3222: writing trial08226312-27 from 588542 to 1085121 tid 1 2026-02-12T17:42:21.256 INFO:tasks.rados.rados.0.trial082.stdout:3222: writing trial08226312-27 from 1620614 to 2297333 tid 2 2026-02-12T17:42:21.256 INFO:tasks.rados.rados.0.trial082.stdout:3223: copy_from oid 8 from oid 23 current snap is 346 2026-02-12T17:42:21.256 INFO:tasks.rados.rados.0.trial082.stdout:3217: finishing write tid 2 to trial08226312-17 2026-02-12T17:42:21.256 INFO:tasks.rados.rados.0.trial082.stdout:3217: finishing write tid 3 to trial08226312-17 2026-02-12T17:42:21.256 INFO:tasks.rados.rados.0.trial082.stdout:3217: finishing write tid 4 to trial08226312-17 2026-02-12T17:42:21.256 INFO:tasks.rados.rados.0.trial082.stdout:3217: oid 17 updating version 0 to 2421 2026-02-12T17:42:21.256 INFO:tasks.rados.rados.0.trial082.stdout:3217: oid 17 version 2421 is already newer than 2420 2026-02-12T17:42:21.257 INFO:tasks.rados.rados.0.trial082.stdout:3217: oid 17 updating version 2421 to 2422 2026-02-12T17:42:21.257 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2422 (ObjNum 1103 snap 346 seq_num 1103) dirty exists 2026-02-12T17:42:21.257 INFO:tasks.rados.rados.0.trial082.stdout:3217: left oid 17 (ObjNum 1103 snap 346 seq_num 1103) 2026-02-12T17:42:21.257 INFO:tasks.rados.rados.0.trial082.stdout:3219: expect (ObjNum 1046 snap 326 seq_num 1046) 2026-02-12T17:42:21.297 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:21.324 INFO:tasks.rados.rados.0.trial082.stdout:3221: finishing write tid 1 to trial08226312-7 2026-02-12T17:42:21.324 INFO:tasks.rados.rados.0.trial082.stdout:3221: finishing write tid 2 to trial08226312-7 2026-02-12T17:42:21.324 INFO:tasks.rados.rados.0.trial082.stdout:3221: finishing write tid 3 to trial08226312-7 2026-02-12T17:42:21.324 INFO:tasks.rados.rados.0.trial082.stdout:3221: finishing write tid 4 to trial08226312-7 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3221: oid 7 updating version 0 to 2374 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3221: oid 7 updating version 2374 to 2375 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3221: oid 7 updating version 2375 to 2376 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 2376 (ObjNum 1105 snap 346 seq_num 1105) dirty exists 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3221: left oid 7 (ObjNum 1105 snap 346 seq_num 1105) 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3222: finishing write tid 1 to trial08226312-27 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3217: done (4 left) 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3219: done (3 left) 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3221: done (2 left) 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3224: delete oid 46 current snap is 346 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3223: finishing copy_from to trial08226312-8 2026-02-12T17:42:21.325 INFO:tasks.rados.rados.0.trial082.stdout:3223: got expected ENOENT (src dne) 2026-02-12T17:42:21.326 INFO:tasks.rados.rados.0.trial082.stdout:3223: finishing copy_from racing read to trial08226312-8 2026-02-12T17:42:21.326 INFO:tasks.rados.rados.0.trial082.stdout:3222: finishing write tid 2 to trial08226312-27 2026-02-12T17:42:21.326 INFO:tasks.rados.rados.0.trial082.stdout:3222: finishing write tid 3 to trial08226312-27 2026-02-12T17:42:21.326 INFO:tasks.rados.rados.0.trial082.stdout:3222: finishing write tid 4 to trial08226312-27 2026-02-12T17:42:21.326 INFO:tasks.rados.rados.0.trial082.stdout:3222: oid 27 updating version 0 to 2256 2026-02-12T17:42:21.326 INFO:tasks.rados.rados.0.trial082.stdout:3222: oid 27 updating version 2256 to 2257 2026-02-12T17:42:21.326 INFO:tasks.rados.rados.0.trial082.stdout:3222: oid 27 updating version 2257 to 2258 2026-02-12T17:42:21.326 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2258 (ObjNum 1106 snap 346 seq_num 1106) dirty exists 2026-02-12T17:42:21.326 INFO:tasks.rados.rados.0.trial082.stdout:3222: left oid 27 (ObjNum 1106 snap 346 seq_num 1106) 2026-02-12T17:42:21.327 INFO:tasks.rados.rados.0.trial082.stdout:3222: done (2 left) 2026-02-12T17:42:21.327 INFO:tasks.rados.rados.0.trial082.stdout:3223: done (1 left) 2026-02-12T17:42:21.327 INFO:tasks.rados.rados.0.trial082.stdout:3224: done (0 left) 2026-02-12T17:42:21.327 INFO:tasks.rados.rados.0.trial082.stdout:3225: snap_remove snap 345 2026-02-12T17:42:22.131 INFO:tasks.rados.rados.0.trial082.stdout:3225: done (0 left) 2026-02-12T17:42:22.132 INFO:tasks.rados.rados.0.trial082.stdout:3226: snap_create 2026-02-12T17:42:23.108 INFO:tasks.rados.rados.0.trial082.stdout:3226: done (0 left) 2026-02-12T17:42:23.108 INFO:tasks.rados.rados.0.trial082.stdout:3227: write (excl) oid 31 current snap is 347 2026-02-12T17:42:23.108 INFO:tasks.rados.rados.0.trial082.stdout:3227: seq_num 1108 ranges {622156=647077,1737578=680388} 2026-02-12T17:42:23.112 INFO:tasks.rados.rados.0.trial082.stdout:3227: writing trial08226312-31 from 622156 to 1269233 tid 1 2026-02-12T17:42:23.117 INFO:tasks.rados.rados.0.trial082.stdout:3227: writing trial08226312-31 from 1737578 to 2417966 tid 2 2026-02-12T17:42:23.117 INFO:tasks.rados.rados.0.trial082.stdout:3228: read oid 48 snap -1 2026-02-12T17:42:23.117 INFO:tasks.rados.rados.0.trial082.stdout:3228: expect (ObjNum 1095 snap 345 seq_num 1095) 2026-02-12T17:42:23.117 INFO:tasks.rados.rados.0.trial082.stdout:3229: delete oid 38 current snap is 347 2026-02-12T17:42:23.117 INFO:tasks.rados.rados.0.trial082.stdout:3227: finishing write tid 1 to trial08226312-31 2026-02-12T17:42:23.119 INFO:tasks.rados.rados.0.trial082.stdout:3229: done (2 left) 2026-02-12T17:42:23.119 INFO:tasks.rados.rados.0.trial082.stdout:3230: write (excl) oid 43 current snap is 347 2026-02-12T17:42:23.119 INFO:tasks.rados.rados.0.trial082.stdout:3230: seq_num 1110 ranges {655770=513928,1854542=684057} 2026-02-12T17:42:23.123 INFO:tasks.rados.rados.0.trial082.stdout:3230: writing trial08226312-43 from 655770 to 1169698 tid 1 2026-02-12T17:42:23.128 INFO:tasks.rados.rados.0.trial082.stdout:3230: writing trial08226312-43 from 1854542 to 2538599 tid 2 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:3231: read oid 16 snap -1 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:3231: expect (ObjNum 1053 snap 331 seq_num 1053) 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:3232: snap_create 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:3227: finishing write tid 2 to trial08226312-31 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:3227: finishing write tid 3 to trial08226312-31 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:3227: finishing write tid 4 to trial08226312-31 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:3227: oid 31 updating version 0 to 2259 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:3227: oid 31 updating version 2259 to 2260 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:3227: oid 31 updating version 2260 to 2261 2026-02-12T17:42:23.129 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 2261 (ObjNum 1108 snap 347 seq_num 1108) dirty exists 2026-02-12T17:42:23.130 INFO:tasks.rados.rados.0.trial082.stdout:3227: left oid 31 (ObjNum 1108 snap 347 seq_num 1108) 2026-02-12T17:42:23.130 INFO:tasks.rados.rados.0.trial082.stdout:3228: expect (ObjNum 1095 snap 345 seq_num 1095) 2026-02-12T17:42:23.165 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1832700 2026-02-12T17:42:23.169 INFO:tasks.rados.rados.0.trial082.stdout:3230: finishing write tid 1 to trial08226312-43 2026-02-12T17:42:23.169 INFO:tasks.rados.rados.0.trial082.stdout:3230: finishing write tid 2 to trial08226312-43 2026-02-12T17:42:23.169 INFO:tasks.rados.rados.0.trial082.stdout:3230: finishing write tid 3 to trial08226312-43 2026-02-12T17:42:23.169 INFO:tasks.rados.rados.0.trial082.stdout:3230: finishing write tid 4 to trial08226312-43 2026-02-12T17:42:23.169 INFO:tasks.rados.rados.0.trial082.stdout:3230: oid 43 updating version 0 to 2256 2026-02-12T17:42:23.170 INFO:tasks.rados.rados.0.trial082.stdout:3230: oid 43 updating version 2256 to 2257 2026-02-12T17:42:23.170 INFO:tasks.rados.rados.0.trial082.stdout:3230: oid 43 updating version 2257 to 2258 2026-02-12T17:42:23.170 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2258 (ObjNum 1110 snap 347 seq_num 1110) dirty exists 2026-02-12T17:42:23.170 INFO:tasks.rados.rados.0.trial082.stdout:3230: left oid 43 (ObjNum 1110 snap 347 seq_num 1110) 2026-02-12T17:42:23.170 INFO:tasks.rados.rados.0.trial082.stdout:3231: expect (ObjNum 1053 snap 331 seq_num 1053) 2026-02-12T17:42:24.109 INFO:tasks.rados.rados.0.trial082.stdout:3227: done (4 left) 2026-02-12T17:42:24.109 INFO:tasks.rados.rados.0.trial082.stdout:3228: done (3 left) 2026-02-12T17:42:24.109 INFO:tasks.rados.rados.0.trial082.stdout:3230: done (2 left) 2026-02-12T17:42:24.109 INFO:tasks.rados.rados.0.trial082.stdout:3231: done (1 left) 2026-02-12T17:42:24.109 INFO:tasks.rados.rados.0.trial082.stdout:3232: done (0 left) 2026-02-12T17:42:24.109 INFO:tasks.rados.rados.0.trial082.stdout:3233: write (excl) oid 8 current snap is 348 2026-02-12T17:42:24.110 INFO:tasks.rados.rados.0.trial082.stdout:3233: seq_num 1111 ranges {672577=589177,1913024=427715} 2026-02-12T17:42:24.113 INFO:tasks.rados.rados.0.trial082.stdout:3233: writing trial08226312-8 from 672577 to 1261754 tid 1 2026-02-12T17:42:24.117 INFO:tasks.rados.rados.0.trial082.stdout:3233: writing trial08226312-8 from 1913024 to 2340739 tid 2 2026-02-12T17:42:24.118 INFO:tasks.rados.rados.0.trial082.stdout:3234: write oid 43 current snap is 348 2026-02-12T17:42:24.118 INFO:tasks.rados.rados.0.trial082.stdout:3234: seq_num 1112 ranges {689384=664426,1971506=687726} 2026-02-12T17:42:24.122 INFO:tasks.rados.rados.0.trial082.stdout:3234: writing trial08226312-43 from 689384 to 1353810 tid 1 2026-02-12T17:42:24.127 INFO:tasks.rados.rados.0.trial082.stdout:3234: writing trial08226312-43 from 1971506 to 2659232 tid 2 2026-02-12T17:42:24.128 INFO:tasks.rados.rados.0.trial082.stdout:3235: read oid 28 snap 340 2026-02-12T17:42:24.128 INFO:tasks.rados.rados.0.trial082.stdout:3235: expect deleted 2026-02-12T17:42:24.128 INFO:tasks.rados.rados.0.trial082.stdout:3233: finishing write tid 1 to trial08226312-8 2026-02-12T17:42:24.128 INFO:tasks.rados.rados.0.trial082.stdout:3236: read oid 20 snap 329 2026-02-12T17:42:24.128 INFO:tasks.rados.rados.0.trial082.stdout:3236: expect deleted 2026-02-12T17:42:24.128 INFO:tasks.rados.rados.0.trial082.stdout:3237: snap_remove snap 309 2026-02-12T17:42:25.110 INFO:tasks.rados.rados.0.trial082.stdout:3237: done (4 left) 2026-02-12T17:42:25.110 INFO:tasks.rados.rados.0.trial082.stdout:3238: snap_remove snap 328 2026-02-12T17:42:26.113 INFO:tasks.rados.rados.0.trial082.stdout:3238: done (4 left) 2026-02-12T17:42:26.113 INFO:tasks.rados.rados.0.trial082.stdout:3239: snap_create 2026-02-12T17:42:26.113 INFO:tasks.rados.rados.0.trial082.stdout:3233: finishing write tid 2 to trial08226312-8 2026-02-12T17:42:26.113 INFO:tasks.rados.rados.0.trial082.stdout:3233: finishing write tid 3 to trial08226312-8 2026-02-12T17:42:26.113 INFO:tasks.rados.rados.0.trial082.stdout:3233: finishing write tid 4 to trial08226312-8 2026-02-12T17:42:26.113 INFO:tasks.rados.rados.0.trial082.stdout:3233: oid 8 updating version 0 to 2425 2026-02-12T17:42:26.113 INFO:tasks.rados.rados.0.trial082.stdout:3233: oid 8 updating version 2425 to 2426 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:3233: oid 8 version 2426 is already newer than 2424 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 2426 (ObjNum 1111 snap 348 seq_num 1111) dirty exists 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:3233: left oid 8 (ObjNum 1111 snap 348 seq_num 1111) 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:3234: finishing write tid 1 to trial08226312-43 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:3234: finishing write tid 2 to trial08226312-43 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:3234: finishing write tid 3 to trial08226312-43 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:3234: finishing write tid 4 to trial08226312-43 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:3234: oid 43 updating version 0 to 2260 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:3234: oid 43 version 2260 is already newer than 2259 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:3234: oid 43 updating version 2260 to 2261 2026-02-12T17:42:26.114 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2261 (ObjNum 1112 snap 348 seq_num 1112) dirty exists 2026-02-12T17:42:26.115 INFO:tasks.rados.rados.0.trial082.stdout:3234: left oid 43 (ObjNum 1112 snap 348 seq_num 1112) 2026-02-12T17:42:27.113 INFO:tasks.rados.rados.0.trial082.stdout:3233: done (4 left) 2026-02-12T17:42:27.114 INFO:tasks.rados.rados.0.trial082.stdout:3234: done (3 left) 2026-02-12T17:42:27.114 INFO:tasks.rados.rados.0.trial082.stdout:3235: done (2 left) 2026-02-12T17:42:27.114 INFO:tasks.rados.rados.0.trial082.stdout:3236: done (1 left) 2026-02-12T17:42:27.114 INFO:tasks.rados.rados.0.trial082.stdout:3239: done (0 left) 2026-02-12T17:42:27.114 INFO:tasks.rados.rados.0.trial082.stdout:3240: snap_create 2026-02-12T17:42:28.108 INFO:tasks.rados.rados.0.trial082.stdout:3240: done (0 left) 2026-02-12T17:42:28.108 INFO:tasks.rados.rados.0.trial082.stdout:3241: copy_from oid 25 from oid 11 current snap is 350 2026-02-12T17:42:28.108 INFO:tasks.rados.rados.0.trial082.stdout:3242: write (excl) oid 23 current snap is 350 2026-02-12T17:42:28.108 INFO:tasks.rados.rados.0.trial082.stdout:3242: seq_num 1113 ranges {706191=739675,1913635=431384} 2026-02-12T17:42:28.114 INFO:tasks.rados.rados.0.trial082.stdout:3242: writing trial08226312-23 from 706191 to 1445866 tid 1 2026-02-12T17:42:28.118 INFO:tasks.rados.rados.0.trial082.stdout:3242: writing trial08226312-23 from 1913635 to 2345019 tid 2 2026-02-12T17:42:28.118 INFO:tasks.rados.rados.0.trial082.stdout:3243: rollback oid 17 current snap is 350 2026-02-12T17:42:28.118 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 349 2026-02-12T17:42:28.118 INFO:tasks.rados.rados.0.trial082.stdout:3241: finishing copy_from to trial08226312-25 2026-02-12T17:42:28.118 INFO:tasks.rados.rados.0.trial082.stdout:3241: got expected ENOENT (src dne) 2026-02-12T17:42:28.118 INFO:tasks.rados.rados.0.trial082.stdout:3241: finishing copy_from racing read to trial08226312-25 2026-02-12T17:42:28.118 INFO:tasks.rados.rados.0.trial082.stdout:3241: done (2 left) 2026-02-12T17:42:28.118 INFO:tasks.rados.rados.0.trial082.stdout:3244: write oid 15 current snap is 350 2026-02-12T17:42:28.118 INFO:tasks.rados.rados.0.trial082.stdout:3244: seq_num 1114 ranges {722998=414924,1572117=575042} 2026-02-12T17:42:28.122 INFO:tasks.rados.rados.0.trial082.stdout:3244: writing trial08226312-15 from 722998 to 1137922 tid 1 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3244: writing trial08226312-15 from 1572117 to 2147159 tid 2 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3245: read oid 32 snap -1 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3245: expect deleted 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3246: copy_from oid 40 from oid 6 current snap is 350 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3242: finishing write tid 1 to trial08226312-23 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3242: finishing write tid 2 to trial08226312-23 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3243: finishing rollback tid 0 to trial08226312-17 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3242: finishing write tid 3 to trial08226312-23 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3242: finishing write tid 4 to trial08226312-23 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3242: oid 23 updating version 0 to 1998 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3242: oid 23 updating version 1998 to 1999 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3242: oid 23 updating version 1999 to 2000 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 2000 (ObjNum 1113 snap 350 seq_num 1113) dirty exists 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3242: left oid 23 (ObjNum 1113 snap 350 seq_num 1113) 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3243: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:3243: finishing rollback tid 2 to trial08226312-17 2026-02-12T17:42:28.127 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2440 (ObjNum 1103 snap 346 seq_num 1103) dirty exists 2026-02-12T17:42:28.128 INFO:tasks.rados.rados.0.trial082.stdout:3244: finishing write tid 1 to trial08226312-15 2026-02-12T17:42:28.128 INFO:tasks.rados.rados.0.trial082.stdout:3242: done (4 left) 2026-02-12T17:42:28.128 INFO:tasks.rados.rados.0.trial082.stdout:3243: done (3 left) 2026-02-12T17:42:28.128 INFO:tasks.rados.rados.0.trial082.stdout:3247: write oid 43 current snap is 350 2026-02-12T17:42:28.128 INFO:tasks.rados.rados.0.trial082.stdout:3247: seq_num 1115 ranges {739805=490173,1630599=435053,2636284=103521} 2026-02-12T17:42:28.131 INFO:tasks.rados.rados.0.trial082.stdout:3247: writing trial08226312-43 from 739805 to 1229978 tid 1 2026-02-12T17:42:28.135 INFO:tasks.rados.rados.0.trial082.stdout:3247: writing trial08226312-43 from 1630599 to 2065652 tid 2 2026-02-12T17:42:28.137 INFO:tasks.rados.rados.0.trial082.stdout:3247: writing trial08226312-43 from 2636284 to 2739805 tid 3 2026-02-12T17:42:28.137 INFO:tasks.rados.rados.0.trial082.stdout:3248: snap_create 2026-02-12T17:42:28.137 INFO:tasks.rados.rados.0.trial082.stdout:3244: finishing write tid 2 to trial08226312-15 2026-02-12T17:42:28.137 INFO:tasks.rados.rados.0.trial082.stdout:3244: finishing write tid 3 to trial08226312-15 2026-02-12T17:42:28.137 INFO:tasks.rados.rados.0.trial082.stdout:3244: finishing write tid 4 to trial08226312-15 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:3244: oid 15 updating version 0 to 2253 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:3244: oid 15 updating version 2253 to 2255 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:3244: oid 15 version 2255 is already newer than 2254 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 2255 (ObjNum 1114 snap 350 seq_num 1114) dirty exists 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:3244: left oid 15 (ObjNum 1114 snap 350 seq_num 1114) 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:3246: finishing copy_from racing read to trial08226312-40 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:3246: finishing copy_from to trial08226312-40 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 2221 (ObjNum 1040 snap 325 seq_num 1040) dirty exists 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:3247: finishing write tid 1 to trial08226312-43 2026-02-12T17:42:28.138 INFO:tasks.rados.rados.0.trial082.stdout:3247: finishing write tid 2 to trial08226312-43 2026-02-12T17:42:28.139 INFO:tasks.rados.rados.0.trial082.stdout:3247: finishing write tid 3 to trial08226312-43 2026-02-12T17:42:28.139 INFO:tasks.rados.rados.0.trial082.stdout:3247: finishing write tid 4 to trial08226312-43 2026-02-12T17:42:28.139 INFO:tasks.rados.rados.0.trial082.stdout:3247: finishing write tid 5 to trial08226312-43 2026-02-12T17:42:28.139 INFO:tasks.rados.rados.0.trial082.stdout:3247: oid 43 updating version 0 to 2263 2026-02-12T17:42:28.139 INFO:tasks.rados.rados.0.trial082.stdout:3247: oid 43 updating version 2263 to 2264 2026-02-12T17:42:28.139 INFO:tasks.rados.rados.0.trial082.stdout:3247: oid 43 version 2264 is already newer than 2262 2026-02-12T17:42:28.139 INFO:tasks.rados.rados.0.trial082.stdout:3247: oid 43 updating version 2264 to 2265 2026-02-12T17:42:28.139 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2265 (ObjNum 1115 snap 350 seq_num 1115) dirty exists 2026-02-12T17:42:28.139 INFO:tasks.rados.rados.0.trial082.stdout:3247: left oid 43 (ObjNum 1115 snap 350 seq_num 1115) 2026-02-12T17:42:29.121 INFO:tasks.rados.rados.0.trial082.stdout:3244: done (4 left) 2026-02-12T17:42:29.121 INFO:tasks.rados.rados.0.trial082.stdout:3245: done (3 left) 2026-02-12T17:42:29.121 INFO:tasks.rados.rados.0.trial082.stdout:3246: done (2 left) 2026-02-12T17:42:29.121 INFO:tasks.rados.rados.0.trial082.stdout:3247: done (1 left) 2026-02-12T17:42:29.121 INFO:tasks.rados.rados.0.trial082.stdout:3248: done (0 left) 2026-02-12T17:42:29.121 INFO:tasks.rados.rados.0.trial082.stdout:3249: copy_from oid 16 from oid 33 current snap is 351 2026-02-12T17:42:29.121 INFO:tasks.rados.rados.0.trial082.stdout:3250: snap_remove snap 346 2026-02-12T17:42:30.122 INFO:tasks.rados.rados.0.trial082.stdout:3250: done (1 left) 2026-02-12T17:42:30.122 INFO:tasks.rados.rados.0.trial082.stdout:3251: read oid 26 snap -1 2026-02-12T17:42:30.122 INFO:tasks.rados.rados.0.trial082.stdout:3251: expect deleted 2026-02-12T17:42:30.122 INFO:tasks.rados.rados.0.trial082.stdout:3252: write oid 15 current snap is 351 2026-02-12T17:42:30.122 INFO:tasks.rados.rados.0.trial082.stdout:3252: seq_num 1116 ranges {756612=565422,2089081=578711} 2026-02-12T17:42:30.127 INFO:tasks.rados.rados.0.trial082.stdout:3252: writing trial08226312-15 from 756612 to 1322034 tid 1 2026-02-12T17:42:30.132 INFO:tasks.rados.rados.0.trial082.stdout:3252: writing trial08226312-15 from 2089081 to 2667792 tid 2 2026-02-12T17:42:30.132 INFO:tasks.rados.rados.0.trial082.stdout:3253: write oid 45 current snap is 351 2026-02-12T17:42:30.132 INFO:tasks.rados.rados.0.trial082.stdout:3253: seq_num 1117 ranges {773419=640671,2147563=438722} 2026-02-12T17:42:30.137 INFO:tasks.rados.rados.0.trial082.stdout:3253: writing trial08226312-45 from 773419 to 1414090 tid 1 2026-02-12T17:42:30.142 INFO:tasks.rados.rados.0.trial082.stdout:3253: writing trial08226312-45 from 2147563 to 2586285 tid 2 2026-02-12T17:42:30.142 INFO:tasks.rados.rados.0.trial082.stdout:3254: write oid 4 current snap is 351 2026-02-12T17:42:30.142 INFO:tasks.rados.rados.0.trial082.stdout:3254: seq_num 1118 ranges {790226=432273,1806045=582380} 2026-02-12T17:42:30.147 INFO:tasks.rados.rados.0.trial082.stdout:3254: writing trial08226312-4 from 790226 to 1222499 tid 1 2026-02-12T17:42:30.151 INFO:tasks.rados.rados.0.trial082.stdout:3254: writing trial08226312-4 from 1806045 to 2388425 tid 2 2026-02-12T17:42:30.151 INFO:tasks.rados.rados.0.trial082.stdout:3255: read oid 21 snap -1 2026-02-12T17:42:30.151 INFO:tasks.rados.rados.0.trial082.stdout:3255: expect (ObjNum 916 snap 288 seq_num 916) 2026-02-12T17:42:30.151 INFO:tasks.rados.rados.0.trial082.stdout:3256: copy_from oid 31 from oid 37 current snap is 351 2026-02-12T17:42:30.151 INFO:tasks.rados.rados.0.trial082.stdout:3249: finishing copy_from racing read to trial08226312-16 2026-02-12T17:42:30.151 INFO:tasks.rados.rados.0.trial082.stdout:3249: finishing copy_from to trial08226312-16 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1943 (ObjNum 916 snap 288 seq_num 916) dirty exists 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3252: finishing write tid 1 to trial08226312-15 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3252: finishing write tid 2 to trial08226312-15 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3252: finishing write tid 3 to trial08226312-15 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3252: finishing write tid 4 to trial08226312-15 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3252: oid 15 updating version 0 to 2257 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3252: oid 15 updating version 2257 to 2258 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3252: oid 15 version 2258 is already newer than 2256 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 2258 (ObjNum 1116 snap 351 seq_num 1116) dirty exists 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3252: left oid 15 (ObjNum 1116 snap 351 seq_num 1116) 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3253: finishing write tid 1 to trial08226312-45 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3253: finishing write tid 2 to trial08226312-45 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3253: finishing write tid 3 to trial08226312-45 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3253: finishing write tid 4 to trial08226312-45 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3253: oid 45 updating version 0 to 2003 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3253: oid 45 version 2003 is already newer than 2001 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3253: oid 45 version 2003 is already newer than 2002 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2003 (ObjNum 1117 snap 351 seq_num 1117) dirty exists 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3253: left oid 45 (ObjNum 1117 snap 351 seq_num 1117) 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3249: done (6 left) 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3251: done (5 left) 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3252: done (4 left) 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3253: done (3 left) 2026-02-12T17:42:30.152 INFO:tasks.rados.rados.0.trial082.stdout:3257: delete oid 15 current snap is 351 2026-02-12T17:42:30.153 INFO:tasks.rados.rados.0.trial082.stdout:3257: done (3 left) 2026-02-12T17:42:30.153 INFO:tasks.rados.rados.0.trial082.stdout:3258: snap_create 2026-02-12T17:42:30.155 INFO:tasks.rados.rados.0.trial082.stdout:3255: expect (ObjNum 916 snap 288 seq_num 916) 2026-02-12T17:42:30.190 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:30.257 INFO:tasks.rados.rados.0.trial082.stdout:3256: finishing copy_from racing read to trial08226312-31 2026-02-12T17:42:30.257 INFO:tasks.rados.rados.0.trial082.stdout:3256: finishing copy_from to trial08226312-31 2026-02-12T17:42:30.257 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 2001 (ObjNum 970 snap 301 seq_num 970) dirty exists 2026-02-12T17:42:30.345 INFO:tasks.rados.rados.0.trial082.stdout:3254: finishing write tid 1 to trial08226312-4 2026-02-12T17:42:30.345 INFO:tasks.rados.rados.0.trial082.stdout:3254: finishing write tid 2 to trial08226312-4 2026-02-12T17:42:30.345 INFO:tasks.rados.rados.0.trial082.stdout:3254: finishing write tid 3 to trial08226312-4 2026-02-12T17:42:30.345 INFO:tasks.rados.rados.0.trial082.stdout:3254: finishing write tid 4 to trial08226312-4 2026-02-12T17:42:30.345 INFO:tasks.rados.rados.0.trial082.stdout:3254: oid 4 updating version 0 to 2448 2026-02-12T17:42:30.345 INFO:tasks.rados.rados.0.trial082.stdout:3254: oid 4 version 2448 is already newer than 2446 2026-02-12T17:42:30.345 INFO:tasks.rados.rados.0.trial082.stdout:3254: oid 4 version 2448 is already newer than 2447 2026-02-12T17:42:30.345 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 2448 (ObjNum 1118 snap 351 seq_num 1118) dirty exists 2026-02-12T17:42:30.345 INFO:tasks.rados.rados.0.trial082.stdout:3254: left oid 4 (ObjNum 1118 snap 351 seq_num 1118) 2026-02-12T17:42:31.129 INFO:tasks.rados.rados.0.trial082.stdout:3254: done (3 left) 2026-02-12T17:42:31.129 INFO:tasks.rados.rados.0.trial082.stdout:3255: done (2 left) 2026-02-12T17:42:31.129 INFO:tasks.rados.rados.0.trial082.stdout:3256: done (1 left) 2026-02-12T17:42:31.129 INFO:tasks.rados.rados.0.trial082.stdout:3258: done (0 left) 2026-02-12T17:42:31.129 INFO:tasks.rados.rados.0.trial082.stdout:3259: snap_create 2026-02-12T17:42:32.130 INFO:tasks.rados.rados.0.trial082.stdout:3259: done (0 left) 2026-02-12T17:42:32.130 INFO:tasks.rados.rados.0.trial082.stdout:3260: delete oid 9 current snap is 353 2026-02-12T17:42:32.133 INFO:tasks.rados.rados.0.trial082.stdout:3260: done (0 left) 2026-02-12T17:42:32.133 INFO:tasks.rados.rados.0.trial082.stdout:3261: read oid 39 snap -1 2026-02-12T17:42:32.133 INFO:tasks.rados.rados.0.trial082.stdout:3261: expect deleted 2026-02-12T17:42:32.133 INFO:tasks.rados.rados.0.trial082.stdout:3262: read oid 8 snap 303 2026-02-12T17:42:32.133 INFO:tasks.rados.rados.0.trial082.stdout:3262: expect (ObjNum 930 snap 291 seq_num 930) 2026-02-12T17:42:32.133 INFO:tasks.rados.rados.0.trial082.stdout:3263: read oid 3 snap 351 2026-02-12T17:42:32.133 INFO:tasks.rados.rados.0.trial082.stdout:3263: expect (ObjNum 1082 snap 341 seq_num 1082) 2026-02-12T17:42:32.133 INFO:tasks.rados.rados.0.trial082.stdout:3264: read oid 31 snap -1 2026-02-12T17:42:32.133 INFO:tasks.rados.rados.0.trial082.stdout:3264: expect (ObjNum 970 snap 301 seq_num 970) 2026-02-12T17:42:32.134 INFO:tasks.rados.rados.0.trial082.stdout:3265: write oid 4 current snap is 353 2026-02-12T17:42:32.134 INFO:tasks.rados.rados.0.trial082.stdout:3265: seq_num 1121 ranges {440647=658020,1581491=446060,2800822=39825} 2026-02-12T17:42:32.137 INFO:tasks.rados.rados.0.trial082.stdout:3265: writing trial08226312-4 from 440647 to 1098667 tid 1 2026-02-12T17:42:32.140 INFO:tasks.rados.rados.0.trial082.stdout:3265: writing trial08226312-4 from 1581491 to 2027551 tid 2 2026-02-12T17:42:32.144 INFO:tasks.rados.rados.0.trial082.stdout:3265: writing trial08226312-4 from 2800822 to 2840647 tid 3 2026-02-12T17:42:32.144 INFO:tasks.rados.rados.0.trial082.stdout:3266: read oid 11 snap 330 2026-02-12T17:42:32.144 INFO:tasks.rados.rados.0.trial082.stdout:3266: expect (ObjNum 923 snap 290 seq_num 923) 2026-02-12T17:42:32.144 INFO:tasks.rados.rados.0.trial082.stdout:3267: rollback oid 19 current snap is 353 2026-02-12T17:42:32.144 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 349 2026-02-12T17:42:32.144 INFO:tasks.rados.rados.0.trial082.stdout:3264: expect (ObjNum 970 snap 301 seq_num 970) 2026-02-12T17:42:32.144 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:32.208 INFO:tasks.rados.rados.0.trial082.stdout:3263: expect (ObjNum 1082 snap 341 seq_num 1082) 2026-02-12T17:42:32.223 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:32.243 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1301203 2026-02-12T17:42:32.248 INFO:tasks.rados.rados.0.trial082.stdout:3262: expect (ObjNum 930 snap 291 seq_num 930) 2026-02-12T17:42:32.249 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:32.288 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:32.369 INFO:tasks.rados.rados.0.trial082.stdout:3265: finishing write tid 1 to trial08226312-4 2026-02-12T17:42:32.369 INFO:tasks.rados.rados.0.trial082.stdout:3265: finishing write tid 2 to trial08226312-4 2026-02-12T17:42:32.369 INFO:tasks.rados.rados.0.trial082.stdout:3261: done (6 left) 2026-02-12T17:42:32.370 INFO:tasks.rados.rados.0.trial082.stdout:3262: done (5 left) 2026-02-12T17:42:32.370 INFO:tasks.rados.rados.0.trial082.stdout:3263: done (4 left) 2026-02-12T17:42:32.370 INFO:tasks.rados.rados.0.trial082.stdout:3264: done (3 left) 2026-02-12T17:42:32.370 INFO:tasks.rados.rados.0.trial082.stdout:3268: copy_from oid 49 from oid 6 current snap is 353 2026-02-12T17:42:32.370 INFO:tasks.rados.rados.0.trial082.stdout:3265: finishing write tid 3 to trial08226312-4 2026-02-12T17:42:32.370 INFO:tasks.rados.rados.0.trial082.stdout:3265: finishing write tid 4 to trial08226312-4 2026-02-12T17:42:32.370 INFO:tasks.rados.rados.0.trial082.stdout:3266: expect (ObjNum 923 snap 290 seq_num 923) 2026-02-12T17:42:32.381 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3375367 2026-02-12T17:42:32.412 INFO:tasks.rados.rados.0.trial082.stdout:3265: finishing write tid 5 to trial08226312-4 2026-02-12T17:42:32.412 INFO:tasks.rados.rados.0.trial082.stdout:3265: oid 4 updating version 0 to 2452 2026-02-12T17:42:32.412 INFO:tasks.rados.rados.0.trial082.stdout:3265: oid 4 version 2452 is already newer than 2451 2026-02-12T17:42:32.412 INFO:tasks.rados.rados.0.trial082.stdout:3265: oid 4 version 2452 is already newer than 2450 2026-02-12T17:42:32.412 INFO:tasks.rados.rados.0.trial082.stdout:3265: oid 4 updating version 2452 to 2453 2026-02-12T17:42:32.412 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 2453 (ObjNum 1121 snap 353 seq_num 1121) dirty exists 2026-02-12T17:42:32.412 INFO:tasks.rados.rados.0.trial082.stdout:3265: left oid 4 (ObjNum 1121 snap 353 seq_num 1121) 2026-02-12T17:42:32.412 INFO:tasks.rados.rados.0.trial082.stdout:3267: finishing rollback tid 0 to trial08226312-19 2026-02-12T17:42:32.412 INFO:tasks.rados.rados.0.trial082.stdout:3265: done (3 left) 2026-02-12T17:42:32.413 INFO:tasks.rados.rados.0.trial082.stdout:3266: done (2 left) 2026-02-12T17:42:32.413 INFO:tasks.rados.rados.0.trial082.stdout:3269: write oid 35 current snap is 353 2026-02-12T17:42:32.413 INFO:tasks.rados.rados.0.trial082.stdout:3267: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:42:32.413 INFO:tasks.rados.rados.0.trial082.stdout:3269: seq_num 1122 ranges {457454=733269,1923620=589718} 2026-02-12T17:42:32.416 INFO:tasks.rados.rados.0.trial082.stdout:3269: writing trial08226312-35 from 457454 to 1190723 tid 1 2026-02-12T17:42:32.421 INFO:tasks.rados.rados.0.trial082.stdout:3269: writing trial08226312-35 from 1923620 to 2513338 tid 2 2026-02-12T17:42:32.421 INFO:tasks.rados.rados.0.trial082.stdout:3270: write oid 41 current snap is 353 2026-02-12T17:42:32.421 INFO:tasks.rados.rados.0.trial082.stdout:3270: seq_num 1123 ranges {474261=408518,1582102=449729,2739315=134946} 2026-02-12T17:42:32.424 INFO:tasks.rados.rados.0.trial082.stdout:3270: writing trial08226312-41 from 474261 to 882779 tid 1 2026-02-12T17:42:32.428 INFO:tasks.rados.rados.0.trial082.stdout:3270: writing trial08226312-41 from 1582102 to 2031831 tid 2 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:3270: writing trial08226312-41 from 2739315 to 2874261 tid 3 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:3271: snap_create 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:3267: finishing rollback tid 2 to trial08226312-19 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 2457 (ObjNum 1079 snap 340 seq_num 1079) dirty exists 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:3268: finishing copy_from racing read to trial08226312-49 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:3268: finishing copy_from to trial08226312-49 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 2221 (ObjNum 1040 snap 325 seq_num 1040) dirty exists 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:3269: finishing write tid 1 to trial08226312-35 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:3269: finishing write tid 2 to trial08226312-35 2026-02-12T17:42:32.432 INFO:tasks.rados.rados.0.trial082.stdout:3269: finishing write tid 3 to trial08226312-35 2026-02-12T17:42:32.433 INFO:tasks.rados.rados.0.trial082.stdout:3269: finishing write tid 4 to trial08226312-35 2026-02-12T17:42:32.433 INFO:tasks.rados.rados.0.trial082.stdout:3269: oid 35 updating version 0 to 2007 2026-02-12T17:42:32.433 INFO:tasks.rados.rados.0.trial082.stdout:3269: oid 35 version 2007 is already newer than 2006 2026-02-12T17:42:32.433 INFO:tasks.rados.rados.0.trial082.stdout:3269: oid 35 version 2007 is already newer than 2005 2026-02-12T17:42:32.433 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 2007 (ObjNum 1122 snap 353 seq_num 1122) dirty exists 2026-02-12T17:42:32.433 INFO:tasks.rados.rados.0.trial082.stdout:3269: left oid 35 (ObjNum 1122 snap 353 seq_num 1122) 2026-02-12T17:42:32.433 INFO:tasks.rados.rados.0.trial082.stdout:3270: finishing write tid 1 to trial08226312-41 2026-02-12T17:42:32.433 INFO:tasks.rados.rados.0.trial082.stdout:3270: finishing write tid 2 to trial08226312-41 2026-02-12T17:42:32.434 INFO:tasks.rados.rados.0.trial082.stdout:3270: finishing write tid 3 to trial08226312-41 2026-02-12T17:42:32.434 INFO:tasks.rados.rados.0.trial082.stdout:3270: finishing write tid 4 to trial08226312-41 2026-02-12T17:42:32.434 INFO:tasks.rados.rados.0.trial082.stdout:3270: finishing write tid 5 to trial08226312-41 2026-02-12T17:42:32.434 INFO:tasks.rados.rados.0.trial082.stdout:3270: oid 41 updating version 0 to 2005 2026-02-12T17:42:32.434 INFO:tasks.rados.rados.0.trial082.stdout:3270: oid 41 updating version 2005 to 2006 2026-02-12T17:42:32.434 INFO:tasks.rados.rados.0.trial082.stdout:3270: oid 41 updating version 2006 to 2007 2026-02-12T17:42:32.434 INFO:tasks.rados.rados.0.trial082.stdout:3270: oid 41 updating version 2007 to 2008 2026-02-12T17:42:32.435 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 2008 (ObjNum 1123 snap 353 seq_num 1123) dirty exists 2026-02-12T17:42:32.435 INFO:tasks.rados.rados.0.trial082.stdout:3270: left oid 41 (ObjNum 1123 snap 353 seq_num 1123) 2026-02-12T17:42:33.110 INFO:tasks.rados.rados.0.trial082.stdout:3267: done (4 left) 2026-02-12T17:42:33.110 INFO:tasks.rados.rados.0.trial082.stdout:3268: done (3 left) 2026-02-12T17:42:33.110 INFO:tasks.rados.rados.0.trial082.stdout:3269: done (2 left) 2026-02-12T17:42:33.110 INFO:tasks.rados.rados.0.trial082.stdout:3270: done (1 left) 2026-02-12T17:42:33.111 INFO:tasks.rados.rados.0.trial082.stdout:3271: done (0 left) 2026-02-12T17:42:33.111 INFO:tasks.rados.rados.0.trial082.stdout:3272: read oid 26 snap 329 2026-02-12T17:42:33.111 INFO:tasks.rados.rados.0.trial082.stdout:3272: expect deleted 2026-02-12T17:42:33.111 INFO:tasks.rados.rados.0.trial082.stdout:3273: rollback oid 30 current snap is 354 2026-02-12T17:42:33.111 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 324 2026-02-12T17:42:33.111 INFO:tasks.rados.rados.0.trial082.stdout:3274: read oid 8 snap 331 2026-02-12T17:42:33.111 INFO:tasks.rados.rados.0.trial082.stdout:3274: expect (ObjNum 978 snap 303 seq_num 978) 2026-02-12T17:42:33.111 INFO:tasks.rados.rados.0.trial082.stdout:3275: write oid 43 current snap is 354 2026-02-12T17:42:33.111 INFO:tasks.rados.rados.0.trial082.stdout:3275: seq_num 1124 ranges {491068=483767,1640584=593387,2650385=240683} 2026-02-12T17:42:33.113 INFO:tasks.rados.rados.0.trial082.stdout:3275: writing trial08226312-43 from 491068 to 974835 tid 1 2026-02-12T17:42:33.118 INFO:tasks.rados.rados.0.trial082.stdout:3275: writing trial08226312-43 from 1640584 to 2233971 tid 2 2026-02-12T17:42:33.121 INFO:tasks.rados.rados.0.trial082.stdout:3275: writing trial08226312-43 from 2650385 to 2891068 tid 3 2026-02-12T17:42:33.121 INFO:tasks.rados.rados.0.trial082.stdout:3276: rollback oid 29 current snap is 354 2026-02-12T17:42:33.121 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 29 to 343 2026-02-12T17:42:33.121 INFO:tasks.rados.rados.0.trial082.stdout:3274: expect (ObjNum 978 snap 303 seq_num 978) 2026-02-12T17:42:33.121 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:33.182 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:33.214 INFO:tasks.rados.rados.0.trial082.stdout:3273: finishing rollback tid 0 to trial08226312-30 2026-02-12T17:42:33.214 INFO:tasks.rados.rados.0.trial082.stdout:3272: done (4 left) 2026-02-12T17:42:33.214 INFO:tasks.rados.rados.0.trial082.stdout:3274: done (3 left) 2026-02-12T17:42:33.214 INFO:tasks.rados.rados.0.trial082.stdout:3277: read oid 24 snap -1 2026-02-12T17:42:33.214 INFO:tasks.rados.rados.0.trial082.stdout:3277: expect (ObjNum 1044 snap 325 seq_num 1044) 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3278: snap_create 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3273: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3273: finishing rollback tid 2 to trial08226312-30 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2268 (ObjNum 987 snap 304 seq_num 987) dirty exists 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3275: finishing write tid 1 to trial08226312-43 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3275: finishing write tid 2 to trial08226312-43 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3276: finishing rollback tid 1 to trial08226312-29 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2217 (ObjNum 33 snap 0 seq_num 27080480) dirty dne 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3275: finishing write tid 3 to trial08226312-43 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3275: finishing write tid 4 to trial08226312-43 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3275: finishing write tid 5 to trial08226312-43 2026-02-12T17:42:33.215 INFO:tasks.rados.rados.0.trial082.stdout:3275: oid 43 updating version 0 to 2272 2026-02-12T17:42:33.216 INFO:tasks.rados.rados.0.trial082.stdout:3275: oid 43 version 2272 is already newer than 2269 2026-02-12T17:42:33.216 INFO:tasks.rados.rados.0.trial082.stdout:3275: oid 43 version 2272 is already newer than 2271 2026-02-12T17:42:33.216 INFO:tasks.rados.rados.0.trial082.stdout:3275: oid 43 version 2272 is already newer than 2270 2026-02-12T17:42:33.216 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2272 (ObjNum 1124 snap 354 seq_num 1124) dirty exists 2026-02-12T17:42:33.216 INFO:tasks.rados.rados.0.trial082.stdout:3275: left oid 43 (ObjNum 1124 snap 354 seq_num 1124) 2026-02-12T17:42:33.217 INFO:tasks.rados.rados.0.trial082.stdout:3277: expect (ObjNum 1044 snap 325 seq_num 1044) 2026-02-12T17:42:33.217 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:33.259 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2170424 2026-02-12T17:42:33.275 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1887671 2026-02-12T17:42:34.138 INFO:tasks.rados.rados.0.trial082.stdout:3273: done (4 left) 2026-02-12T17:42:34.138 INFO:tasks.rados.rados.0.trial082.stdout:3275: done (3 left) 2026-02-12T17:42:34.138 INFO:tasks.rados.rados.0.trial082.stdout:3276: done (2 left) 2026-02-12T17:42:34.138 INFO:tasks.rados.rados.0.trial082.stdout:3277: done (1 left) 2026-02-12T17:42:34.138 INFO:tasks.rados.rados.0.trial082.stdout:3278: done (0 left) 2026-02-12T17:42:34.138 INFO:tasks.rados.rados.0.trial082.stdout:3279: copy_from oid 34 from oid 20 current snap is 355 2026-02-12T17:42:34.138 INFO:tasks.rados.rados.0.trial082.stdout:3280: read oid 42 snap -1 2026-02-12T17:42:34.138 INFO:tasks.rados.rados.0.trial082.stdout:3280: expect deleted 2026-02-12T17:42:34.138 INFO:tasks.rados.rados.0.trial082.stdout:3281: write oid 25 current snap is 355 2026-02-12T17:42:34.139 INFO:tasks.rados.rados.0.trial082.stdout:3281: seq_num 1125 ranges {507875=559016,1699066=737045} 2026-02-12T17:42:34.141 INFO:tasks.rados.rados.0.trial082.stdout:3281: writing trial08226312-25 from 507875 to 1066891 tid 1 2026-02-12T17:42:34.147 INFO:tasks.rados.rados.0.trial082.stdout:3281: writing trial08226312-25 from 1699066 to 2436111 tid 2 2026-02-12T17:42:34.147 INFO:tasks.rados.rados.0.trial082.stdout:3282: copy_from oid 39 from oid 13 current snap is 355 2026-02-12T17:42:34.147 INFO:tasks.rados.rados.0.trial082.stdout:3279: finishing copy_from to trial08226312-34 2026-02-12T17:42:34.147 INFO:tasks.rados.rados.0.trial082.stdout:3279: got expected ENOENT (src dne) 2026-02-12T17:42:34.147 INFO:tasks.rados.rados.0.trial082.stdout:3279: finishing copy_from racing read to trial08226312-34 2026-02-12T17:42:34.147 INFO:tasks.rados.rados.0.trial082.stdout:3281: finishing write tid 1 to trial08226312-25 2026-02-12T17:42:34.147 INFO:tasks.rados.rados.0.trial082.stdout:3279: done (3 left) 2026-02-12T17:42:34.147 INFO:tasks.rados.rados.0.trial082.stdout:3280: done (2 left) 2026-02-12T17:42:34.148 INFO:tasks.rados.rados.0.trial082.stdout:3283: rollback oid 11 current snap is 355 2026-02-12T17:42:34.148 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 354 2026-02-12T17:42:34.148 INFO:tasks.rados.rados.0.trial082.stdout:3284: write (excl) oid 1 current snap is 355 2026-02-12T17:42:34.148 INFO:tasks.rados.rados.0.trial082.stdout:3284: seq_num 1126 ranges {524682=750618,1757548=597056} 2026-02-12T17:42:34.151 INFO:tasks.rados.rados.0.trial082.stdout:3284: writing trial08226312-1 from 524682 to 1275300 tid 1 2026-02-12T17:42:34.156 INFO:tasks.rados.rados.0.trial082.stdout:3284: writing trial08226312-1 from 1757548 to 2354604 tid 2 2026-02-12T17:42:34.156 INFO:tasks.rados.rados.0.trial082.stdout:3285: rollback oid 21 current snap is 355 2026-02-12T17:42:34.156 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 324 2026-02-12T17:42:34.156 INFO:tasks.rados.rados.0.trial082.stdout:3283: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:42:34.156 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 2340 (ObjNum 257 snap 0 seq_num 26669808) dirty dne 2026-02-12T17:42:34.156 INFO:tasks.rados.rados.0.trial082.stdout:3281: finishing write tid 2 to trial08226312-25 2026-02-12T17:42:34.156 INFO:tasks.rados.rados.0.trial082.stdout:3281: finishing write tid 3 to trial08226312-25 2026-02-12T17:42:34.156 INFO:tasks.rados.rados.0.trial082.stdout:3281: finishing write tid 4 to trial08226312-25 2026-02-12T17:42:34.156 INFO:tasks.rados.rados.0.trial082.stdout:3281: oid 25 updating version 0 to 2219 2026-02-12T17:42:34.157 INFO:tasks.rados.rados.0.trial082.stdout:3281: oid 25 version 2219 is already newer than 2218 2026-02-12T17:42:34.157 INFO:tasks.rados.rados.0.trial082.stdout:3281: oid 25 updating version 2219 to 2220 2026-02-12T17:42:34.157 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 2220 (ObjNum 1125 snap 355 seq_num 1125) dirty exists 2026-02-12T17:42:34.157 INFO:tasks.rados.rados.0.trial082.stdout:3281: left oid 25 (ObjNum 1125 snap 355 seq_num 1125) 2026-02-12T17:42:34.157 INFO:tasks.rados.rados.0.trial082.stdout:3281: done (4 left) 2026-02-12T17:42:34.157 INFO:tasks.rados.rados.0.trial082.stdout:3283: done (3 left) 2026-02-12T17:42:34.157 INFO:tasks.rados.rados.0.trial082.stdout:3286: write (excl) oid 40 current snap is 355 2026-02-12T17:42:34.157 INFO:tasks.rados.rados.0.trial082.stdout:3286: seq_num 1127 ranges {541489=425867,1416030=740714,2732654=208835} 2026-02-12T17:42:34.159 INFO:tasks.rados.rados.0.trial082.stdout:3286: writing trial08226312-40 from 541489 to 967356 tid 1 2026-02-12T17:42:34.163 INFO:tasks.rados.rados.0.trial082.stdout:3286: writing trial08226312-40 from 1416030 to 2156744 tid 2 2026-02-12T17:42:34.167 INFO:tasks.rados.rados.0.trial082.stdout:3286: writing trial08226312-40 from 2732654 to 2941489 tid 3 2026-02-12T17:42:34.167 INFO:tasks.rados.rados.0.trial082.stdout:3287: copy_from oid 14 from oid 30 current snap is 355 2026-02-12T17:42:34.167 INFO:tasks.rados.rados.0.trial082.stdout:3284: finishing write tid 1 to trial08226312-1 2026-02-12T17:42:34.167 INFO:tasks.rados.rados.0.trial082.stdout:3282: finishing copy_from racing read to trial08226312-39 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:3282: finishing copy_from to trial08226312-39 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 2217 (ObjNum 1096 snap 345 seq_num 1096) dirty exists 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:3284: finishing write tid 2 to trial08226312-1 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:3284: finishing write tid 3 to trial08226312-1 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:3284: finishing write tid 4 to trial08226312-1 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:3284: oid 1 updating version 0 to 2149 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:3284: oid 1 updating version 2149 to 2150 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:3284: oid 1 version 2150 is already newer than 2148 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2150 (ObjNum 1126 snap 355 seq_num 1126) dirty exists 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:3284: left oid 1 (ObjNum 1126 snap 355 seq_num 1126) 2026-02-12T17:42:34.168 INFO:tasks.rados.rados.0.trial082.stdout:3285: finishing rollback tid 0 to trial08226312-21 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3285: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3285: finishing rollback tid 2 to trial08226312-21 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 2275 (ObjNum 987 snap 304 seq_num 987) dirty exists 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3286: finishing write tid 1 to trial08226312-40 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3282: done (4 left) 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3284: done (3 left) 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3285: done (2 left) 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3288: copy_from oid 16 from oid 18 current snap is 355 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3286: finishing write tid 2 to trial08226312-40 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3289: read oid 33 snap 348 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3289: expect (ObjNum 916 snap 288 seq_num 916) 2026-02-12T17:42:34.169 INFO:tasks.rados.rados.0.trial082.stdout:3290: write (excl) oid 21 current snap is 355 2026-02-12T17:42:34.170 INFO:tasks.rados.rados.0.trial082.stdout:3290: seq_num 1128 ranges {558296=501116,1474512=600725,2760077=198219} 2026-02-12T17:42:34.170 INFO:tasks.rados.rados.0.trial082.stdout:3290: writing trial08226312-21 from 558296 to 1059412 tid 1 2026-02-12T17:42:34.174 INFO:tasks.rados.rados.0.trial082.stdout:3290: writing trial08226312-21 from 1474512 to 2075237 tid 2 2026-02-12T17:42:34.178 INFO:tasks.rados.rados.0.trial082.stdout:3290: writing trial08226312-21 from 2760077 to 2958296 tid 3 2026-02-12T17:42:34.178 INFO:tasks.rados.rados.0.trial082.stdout:3291: copy_from oid 44 from oid 24 current snap is 355 2026-02-12T17:42:34.178 INFO:tasks.rados.rados.0.trial082.stdout:3286: finishing write tid 3 to trial08226312-40 2026-02-12T17:42:34.178 INFO:tasks.rados.rados.0.trial082.stdout:3286: finishing write tid 4 to trial08226312-40 2026-02-12T17:42:34.178 INFO:tasks.rados.rados.0.trial082.stdout:3286: finishing write tid 5 to trial08226312-40 2026-02-12T17:42:34.178 INFO:tasks.rados.rados.0.trial082.stdout:3286: oid 40 updating version 0 to 2381 2026-02-12T17:42:34.178 INFO:tasks.rados.rados.0.trial082.stdout:3286: oid 40 version 2381 is already newer than 2380 2026-02-12T17:42:34.179 INFO:tasks.rados.rados.0.trial082.stdout:3286: oid 40 version 2381 is already newer than 2378 2026-02-12T17:42:34.179 INFO:tasks.rados.rados.0.trial082.stdout:3286: oid 40 version 2381 is already newer than 2379 2026-02-12T17:42:34.179 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 2381 (ObjNum 1127 snap 355 seq_num 1127) dirty exists 2026-02-12T17:42:34.179 INFO:tasks.rados.rados.0.trial082.stdout:3286: left oid 40 (ObjNum 1127 snap 355 seq_num 1127) 2026-02-12T17:42:34.179 INFO:tasks.rados.rados.0.trial082.stdout:3289: expect (ObjNum 916 snap 288 seq_num 916) 2026-02-12T17:42:34.182 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 810062 2026-02-12T17:42:34.208 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:34.267 INFO:tasks.rados.rados.0.trial082.stdout:3288: finishing copy_from racing read to trial08226312-16 2026-02-12T17:42:34.267 INFO:tasks.rados.rados.0.trial082.stdout:3290: finishing write tid 1 to trial08226312-21 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:3287: finishing copy_from racing read to trial08226312-14 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:3287: finishing copy_from to trial08226312-14 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 2268 (ObjNum 987 snap 304 seq_num 987) dirty exists 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:3288: finishing copy_from to trial08226312-16 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 1574 (ObjNum 1007 snap 314 seq_num 1007) dirty exists 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:3290: finishing write tid 2 to trial08226312-21 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:3290: finishing write tid 3 to trial08226312-21 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:3290: finishing write tid 4 to trial08226312-21 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:3290: finishing write tid 5 to trial08226312-21 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:3290: oid 21 updating version 0 to 2279 2026-02-12T17:42:34.268 INFO:tasks.rados.rados.0.trial082.stdout:3290: oid 21 version 2279 is already newer than 2278 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3290: oid 21 version 2279 is already newer than 2277 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3290: oid 21 version 2279 is already newer than 2276 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 2279 (ObjNum 1128 snap 355 seq_num 1128) dirty exists 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3290: left oid 21 (ObjNum 1128 snap 355 seq_num 1128) 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3286: done (5 left) 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3287: done (4 left) 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3288: done (3 left) 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3289: done (2 left) 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3290: done (1 left) 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3292: write oid 45 current snap is 355 2026-02-12T17:42:34.269 INFO:tasks.rados.rados.0.trial082.stdout:3292: seq_num 1129 ranges {575103=576365,1932994=744383} 2026-02-12T17:42:34.271 INFO:tasks.rados.rados.0.trial082.stdout:3292: writing trial08226312-45 from 575103 to 1151468 tid 1 2026-02-12T17:42:34.277 INFO:tasks.rados.rados.0.trial082.stdout:3292: writing trial08226312-45 from 1932994 to 2677377 tid 2 2026-02-12T17:42:34.277 INFO:tasks.rados.rados.0.trial082.stdout:3293: snap_remove snap 339 2026-02-12T17:42:35.382 INFO:tasks.rados.rados.0.trial082.stdout:3293: done (2 left) 2026-02-12T17:42:35.382 INFO:tasks.rados.rados.0.trial082.stdout:3294: read oid 43 snap -1 2026-02-12T17:42:35.382 INFO:tasks.rados.rados.0.trial082.stdout:3294: expect (ObjNum 1124 snap 354 seq_num 1124) 2026-02-12T17:42:35.382 INFO:tasks.rados.rados.0.trial082.stdout:3295: copy_from oid 8 from oid 5 current snap is 355 2026-02-12T17:42:35.382 INFO:tasks.rados.rados.0.trial082.stdout:3291: finishing copy_from racing read to trial08226312-44 2026-02-12T17:42:35.382 INFO:tasks.rados.rados.0.trial082.stdout:3291: finishing copy_from to trial08226312-44 2026-02-12T17:42:35.382 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2361 (ObjNum 1044 snap 325 seq_num 1044) dirty exists 2026-02-12T17:42:35.382 INFO:tasks.rados.rados.0.trial082.stdout:3292: finishing write tid 1 to trial08226312-45 2026-02-12T17:42:35.382 INFO:tasks.rados.rados.0.trial082.stdout:3292: finishing write tid 2 to trial08226312-45 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3292: finishing write tid 3 to trial08226312-45 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3292: finishing write tid 4 to trial08226312-45 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3292: oid 45 updating version 0 to 2363 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3292: oid 45 version 2363 is already newer than 2362 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3292: oid 45 updating version 2363 to 2364 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2364 (ObjNum 1129 snap 355 seq_num 1129) dirty exists 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3292: left oid 45 (ObjNum 1129 snap 355 seq_num 1129) 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3291: done (3 left) 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3292: done (2 left) 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3296: read oid 2 snap -1 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3296: expect (ObjNum 955 snap 297 seq_num 955) 2026-02-12T17:42:35.383 INFO:tasks.rados.rados.0.trial082.stdout:3297: write oid 50 current snap is 355 2026-02-12T17:42:35.384 INFO:tasks.rados.rados.0.trial082.stdout:3297: seq_num 1130 ranges {591910=651614,1875123=604394} 2026-02-12T17:42:35.385 INFO:tasks.rados.rados.0.trial082.stdout:3297: writing trial08226312-50 from 591910 to 1243524 tid 1 2026-02-12T17:42:35.390 INFO:tasks.rados.rados.0.trial082.stdout:3297: writing trial08226312-50 from 1875123 to 2479517 tid 2 2026-02-12T17:42:35.390 INFO:tasks.rados.rados.0.trial082.stdout:3298: write (excl) oid 20 current snap is 355 2026-02-12T17:42:35.390 INFO:tasks.rados.rados.0.trial082.stdout:3298: seq_num 1131 ranges {608717=726863,1933605=748052} 2026-02-12T17:42:35.395 INFO:tasks.rados.rados.0.trial082.stdout:3298: writing trial08226312-20 from 608717 to 1335580 tid 1 2026-02-12T17:42:35.400 INFO:tasks.rados.rados.0.trial082.stdout:3298: writing trial08226312-20 from 1933605 to 2681657 tid 2 2026-02-12T17:42:35.400 INFO:tasks.rados.rados.0.trial082.stdout:3299: copy_from oid 1 from oid 17 current snap is 355 2026-02-12T17:42:35.400 INFO:tasks.rados.rados.0.trial082.stdout:3296: expect (ObjNum 955 snap 297 seq_num 955) 2026-02-12T17:42:35.489 INFO:tasks.rados.rados.0.trial082.stdout:3294: expect (ObjNum 1124 snap 354 seq_num 1124) 2026-02-12T17:42:35.489 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:35.544 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:35.655 INFO:tasks.rados.rados.0.trial082.stdout:3297: finishing write tid 1 to trial08226312-50 2026-02-12T17:42:35.655 INFO:tasks.rados.rados.0.trial082.stdout:3295: finishing copy_from racing read to trial08226312-8 2026-02-12T17:42:35.655 INFO:tasks.rados.rados.0.trial082.stdout:3295: finishing copy_from to trial08226312-8 2026-02-12T17:42:35.655 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 1389 (ObjNum 1071 snap 338 seq_num 1071) dirty exists 2026-02-12T17:42:35.655 INFO:tasks.rados.rados.0.trial082.stdout:3297: finishing write tid 2 to trial08226312-50 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3294: done (5 left) 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3295: done (4 left) 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3296: done (3 left) 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3300: read oid 25 snap -1 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3300: expect (ObjNum 1125 snap 355 seq_num 1125) 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3301: snap_create 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3297: finishing write tid 3 to trial08226312-50 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3297: finishing write tid 4 to trial08226312-50 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3297: oid 50 updating version 0 to 2230 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3297: oid 50 version 2230 is already newer than 2228 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:3297: oid 50 version 2230 is already newer than 2229 2026-02-12T17:42:35.656 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 2230 (ObjNum 1130 snap 355 seq_num 1130) dirty exists 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3297: left oid 50 (ObjNum 1130 snap 355 seq_num 1130) 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3298: finishing write tid 1 to trial08226312-20 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3298: finishing write tid 2 to trial08226312-20 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3298: finishing write tid 3 to trial08226312-20 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3298: finishing write tid 4 to trial08226312-20 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3298: oid 20 updating version 0 to 2468 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3298: oid 20 version 2468 is already newer than 2467 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3298: oid 20 version 2468 is already newer than 2466 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 2468 (ObjNum 1131 snap 355 seq_num 1131) dirty exists 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3298: left oid 20 (ObjNum 1131 snap 355 seq_num 1131) 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3299: finishing copy_from racing read to trial08226312-1 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:3299: finishing copy_from to trial08226312-1 2026-02-12T17:42:35.657 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2440 (ObjNum 1103 snap 346 seq_num 1103) dirty exists 2026-02-12T17:42:35.659 INFO:tasks.rados.rados.0.trial082.stdout:3300: expect (ObjNum 1125 snap 355 seq_num 1125) 2026-02-12T17:42:35.702 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:35.744 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:36.575 INFO:tasks.rados.rados.0.trial082.stdout:3297: done (4 left) 2026-02-12T17:42:36.575 INFO:tasks.rados.rados.0.trial082.stdout:3298: done (3 left) 2026-02-12T17:42:36.575 INFO:tasks.rados.rados.0.trial082.stdout:3299: done (2 left) 2026-02-12T17:42:36.575 INFO:tasks.rados.rados.0.trial082.stdout:3300: done (1 left) 2026-02-12T17:42:36.575 INFO:tasks.rados.rados.0.trial082.stdout:3301: done (0 left) 2026-02-12T17:42:36.575 INFO:tasks.rados.rados.0.trial082.stdout:3302: read oid 32 snap 340 2026-02-12T17:42:36.575 INFO:tasks.rados.rados.0.trial082.stdout:3302: expect deleted 2026-02-12T17:42:36.576 INFO:tasks.rados.rados.0.trial082.stdout:3303: snap_remove snap 350 2026-02-12T17:42:37.576 INFO:tasks.rados.rados.0.trial082.stdout:3303: done (1 left) 2026-02-12T17:42:37.577 INFO:tasks.rados.rados.0.trial082.stdout:3304: read oid 38 snap -1 2026-02-12T17:42:37.577 INFO:tasks.rados.rados.0.trial082.stdout:3304: expect deleted 2026-02-12T17:42:37.577 INFO:tasks.rados.rados.0.trial082.stdout:3305: read oid 22 snap -1 2026-02-12T17:42:37.577 INFO:tasks.rados.rados.0.trial082.stdout:3305: expect (ObjNum 1084 snap 341 seq_num 1084) 2026-02-12T17:42:37.577 INFO:tasks.rados.rados.0.trial082.stdout:3306: rollback oid 12 current snap is 356 2026-02-12T17:42:37.577 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 344 2026-02-12T17:42:37.577 INFO:tasks.rados.rados.0.trial082.stdout:3302: done (3 left) 2026-02-12T17:42:37.577 INFO:tasks.rados.rados.0.trial082.stdout:3307: copy_from oid 40 from oid 50 current snap is 356 2026-02-12T17:42:37.577 INFO:tasks.rados.rados.0.trial082.stdout:3308: copy_from oid 6 from oid 31 current snap is 356 2026-02-12T17:42:37.578 INFO:tasks.rados.rados.0.trial082.stdout:3309: delete oid 19 current snap is 356 2026-02-12T17:42:37.580 INFO:tasks.rados.rados.0.trial082.stdout:3305: expect (ObjNum 1084 snap 341 seq_num 1084) 2026-02-12T17:42:37.691 INFO:tasks.rados.rados.0.trial082.stdout:3306: finishing rollback tid 0 to trial08226312-12 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:3306: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:3306: finishing rollback tid 2 to trial08226312-12 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 2011 (ObjNum 1074 snap 340 seq_num 1074) dirty exists 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:3308: finishing copy_from racing read to trial08226312-6 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:3308: finishing copy_from to trial08226312-6 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 2001 (ObjNum 970 snap 301 seq_num 970) dirty exists 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:3307: finishing copy_from racing read to trial08226312-40 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:3307: finishing copy_from to trial08226312-40 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 2230 (ObjNum 1130 snap 355 seq_num 1130) dirty exists 2026-02-12T17:42:37.692 INFO:tasks.rados.rados.0.trial082.stdout:3304: done (5 left) 2026-02-12T17:42:37.693 INFO:tasks.rados.rados.0.trial082.stdout:3305: done (4 left) 2026-02-12T17:42:37.693 INFO:tasks.rados.rados.0.trial082.stdout:3306: done (3 left) 2026-02-12T17:42:37.693 INFO:tasks.rados.rados.0.trial082.stdout:3307: done (2 left) 2026-02-12T17:42:37.693 INFO:tasks.rados.rados.0.trial082.stdout:3308: done (1 left) 2026-02-12T17:42:37.693 INFO:tasks.rados.rados.0.trial082.stdout:3309: done (0 left) 2026-02-12T17:42:37.693 INFO:tasks.rados.rados.0.trial082.stdout:3310: write (excl) oid 46 current snap is 356 2026-02-12T17:42:37.693 INFO:tasks.rados.rados.0.trial082.stdout:3310: seq_num 1133 ranges {642331=593714,1766922=751721} 2026-02-12T17:42:37.696 INFO:tasks.rados.rados.0.trial082.stdout:3310: writing trial08226312-46 from 642331 to 1236045 tid 1 2026-02-12T17:42:37.701 INFO:tasks.rados.rados.0.trial082.stdout:3310: writing trial08226312-46 from 1766922 to 2518643 tid 2 2026-02-12T17:42:37.701 INFO:tasks.rados.rados.0.trial082.stdout:3311: delete oid 11 current snap is 356 2026-02-12T17:42:37.701 INFO:tasks.rados.rados.0.trial082.stdout:3310: finishing write tid 1 to trial08226312-46 2026-02-12T17:42:37.703 INFO:tasks.rados.rados.0.trial082.stdout:3310: finishing write tid 2 to trial08226312-46 2026-02-12T17:42:37.703 INFO:tasks.rados.rados.0.trial082.stdout:3310: finishing write tid 3 to trial08226312-46 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:3310: finishing write tid 4 to trial08226312-46 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:3310: oid 46 updating version 0 to 2342 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:3310: oid 46 updating version 2342 to 2344 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:3310: oid 46 version 2344 is already newer than 2343 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 2344 (ObjNum 1133 snap 356 seq_num 1133) dirty exists 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:3310: left oid 46 (ObjNum 1133 snap 356 seq_num 1133) 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:3310: done (1 left) 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:3311: done (0 left) 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:3312: write oid 13 current snap is 356 2026-02-12T17:42:37.704 INFO:tasks.rados.rados.0.trial082.stdout:3312: seq_num 1135 ranges {675945=744212,2167533=755390} 2026-02-12T17:42:37.708 INFO:tasks.rados.rados.0.trial082.stdout:3312: writing trial08226312-13 from 675945 to 1420157 tid 1 2026-02-12T17:42:37.714 INFO:tasks.rados.rados.0.trial082.stdout:3312: writing trial08226312-13 from 2167533 to 2922923 tid 2 2026-02-12T17:42:37.714 INFO:tasks.rados.rados.0.trial082.stdout:3313: write (excl) oid 20 current snap is 356 2026-02-12T17:42:37.714 INFO:tasks.rados.rados.0.trial082.stdout:3313: seq_num 1136 ranges {692752=419461,1826015=615401,2979461=113291} 2026-02-12T17:42:37.718 INFO:tasks.rados.rados.0.trial082.stdout:3313: writing trial08226312-20 from 692752 to 1112213 tid 1 2026-02-12T17:42:37.723 INFO:tasks.rados.rados.0.trial082.stdout:3313: writing trial08226312-20 from 1826015 to 2441416 tid 2 2026-02-12T17:42:37.726 INFO:tasks.rados.rados.0.trial082.stdout:3313: writing trial08226312-20 from 2979461 to 3092752 tid 3 2026-02-12T17:42:37.726 INFO:tasks.rados.rados.0.trial082.stdout:3314: write oid 32 current snap is 356 2026-02-12T17:42:37.726 INFO:tasks.rados.rados.0.trial082.stdout:3314: seq_num 1137 ranges {709559=494710,1884497=759059} 2026-02-12T17:42:37.730 INFO:tasks.rados.rados.0.trial082.stdout:3314: writing trial08226312-32 from 709559 to 1204269 tid 1 2026-02-12T17:42:37.735 INFO:tasks.rados.rados.0.trial082.stdout:3314: writing trial08226312-32 from 1884497 to 2643556 tid 2 2026-02-12T17:42:37.736 INFO:tasks.rados.rados.0.trial082.stdout:3315: read oid 26 snap 344 2026-02-12T17:42:37.736 INFO:tasks.rados.rados.0.trial082.stdout:3315: expect (ObjNum 1088 snap 342 seq_num 1088) 2026-02-12T17:42:37.736 INFO:tasks.rados.rados.0.trial082.stdout:3316: write (excl) oid 28 current snap is 356 2026-02-12T17:42:37.736 INFO:tasks.rados.rados.0.trial082.stdout:3316: seq_num 1138 ranges {726366=569959,1826626=502717,2801601=324765} 2026-02-12T17:42:37.740 INFO:tasks.rados.rados.0.trial082.stdout:3316: writing trial08226312-28 from 726366 to 1296325 tid 1 2026-02-12T17:42:37.744 INFO:tasks.rados.rados.0.trial082.stdout:3316: writing trial08226312-28 from 1826626 to 2329343 tid 2 2026-02-12T17:42:37.747 INFO:tasks.rados.rados.0.trial082.stdout:3316: writing trial08226312-28 from 2801601 to 3126366 tid 3 2026-02-12T17:42:37.747 INFO:tasks.rados.rados.0.trial082.stdout:3317: snap_remove snap 340 2026-02-12T17:42:38.112 INFO:tasks.rados.rados.0.trial082.stdout:3317: done (5 left) 2026-02-12T17:42:38.112 INFO:tasks.rados.rados.0.trial082.stdout:3318: write (excl) oid 8 current snap is 356 2026-02-12T17:42:38.112 INFO:tasks.rados.rados.0.trial082.stdout:3318: seq_num 1139 ranges {743173=645208,1885108=762728} 2026-02-12T17:42:38.117 INFO:tasks.rados.rados.0.trial082.stdout:3318: writing trial08226312-8 from 743173 to 1388381 tid 1 2026-02-12T17:42:38.123 INFO:tasks.rados.rados.0.trial082.stdout:3318: writing trial08226312-8 from 1885108 to 2647836 tid 2 2026-02-12T17:42:38.123 INFO:tasks.rados.rados.0.trial082.stdout:3319: snap_create 2026-02-12T17:42:38.123 INFO:tasks.rados.rados.0.trial082.stdout:3312: finishing write tid 1 to trial08226312-13 2026-02-12T17:42:38.123 INFO:tasks.rados.rados.0.trial082.stdout:3312: finishing write tid 2 to trial08226312-13 2026-02-12T17:42:38.123 INFO:tasks.rados.rados.0.trial082.stdout:3312: finishing write tid 3 to trial08226312-13 2026-02-12T17:42:38.123 INFO:tasks.rados.rados.0.trial082.stdout:3312: finishing write tid 4 to trial08226312-13 2026-02-12T17:42:38.123 INFO:tasks.rados.rados.0.trial082.stdout:3312: oid 13 updating version 0 to 2223 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3312: oid 13 version 2223 is already newer than 2222 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3312: oid 13 version 2223 is already newer than 2221 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2223 (ObjNum 1135 snap 356 seq_num 1135) dirty exists 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3312: left oid 13 (ObjNum 1135 snap 356 seq_num 1135) 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3313: finishing write tid 1 to trial08226312-20 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3313: finishing write tid 2 to trial08226312-20 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3313: finishing write tid 3 to trial08226312-20 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3313: finishing write tid 4 to trial08226312-20 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3313: finishing write tid 5 to trial08226312-20 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3313: oid 20 updating version 0 to 2479 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3313: oid 20 updating version 2479 to 2480 2026-02-12T17:42:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3313: oid 20 updating version 2480 to 2481 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3313: oid 20 version 2481 is already newer than 2478 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 2481 (ObjNum 1136 snap 356 seq_num 1136) dirty exists 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3313: left oid 20 (ObjNum 1136 snap 356 seq_num 1136) 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3314: finishing write tid 1 to trial08226312-32 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3314: finishing write tid 2 to trial08226312-32 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3314: finishing write tid 3 to trial08226312-32 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3314: finishing write tid 4 to trial08226312-32 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3314: oid 32 updating version 0 to 1889 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3314: oid 32 version 1889 is already newer than 1887 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3314: oid 32 version 1889 is already newer than 1888 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 1889 (ObjNum 1137 snap 356 seq_num 1137) dirty exists 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3314: left oid 32 (ObjNum 1137 snap 356 seq_num 1137) 2026-02-12T17:42:38.125 INFO:tasks.rados.rados.0.trial082.stdout:3315: expect (ObjNum 1088 snap 342 seq_num 1088) 2026-02-12T17:42:38.126 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:38.145 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:38.168 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:38.191 INFO:tasks.rados.rados.0.trial082.stdout:3316: finishing write tid 1 to trial08226312-28 2026-02-12T17:42:38.191 INFO:tasks.rados.rados.0.trial082.stdout:3316: finishing write tid 2 to trial08226312-28 2026-02-12T17:42:38.191 INFO:tasks.rados.rados.0.trial082.stdout:3316: finishing write tid 3 to trial08226312-28 2026-02-12T17:42:38.191 INFO:tasks.rados.rados.0.trial082.stdout:3316: finishing write tid 4 to trial08226312-28 2026-02-12T17:42:38.191 INFO:tasks.rados.rados.0.trial082.stdout:3316: finishing write tid 5 to trial08226312-28 2026-02-12T17:42:38.191 INFO:tasks.rados.rados.0.trial082.stdout:3316: oid 28 updating version 0 to 2382 2026-02-12T17:42:38.191 INFO:tasks.rados.rados.0.trial082.stdout:3316: oid 28 updating version 2382 to 2383 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3316: oid 28 updating version 2383 to 2385 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3316: oid 28 version 2385 is already newer than 2384 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2385 (ObjNum 1138 snap 356 seq_num 1138) dirty exists 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3316: left oid 28 (ObjNum 1138 snap 356 seq_num 1138) 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3318: finishing write tid 1 to trial08226312-8 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3318: finishing write tid 2 to trial08226312-8 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3318: finishing write tid 3 to trial08226312-8 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3318: finishing write tid 4 to trial08226312-8 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3318: oid 8 updating version 0 to 2491 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3318: oid 8 updating version 2491 to 2493 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:3318: oid 8 version 2493 is already newer than 2492 2026-02-12T17:42:38.192 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 2493 (ObjNum 1139 snap 356 seq_num 1139) dirty exists 2026-02-12T17:42:38.193 INFO:tasks.rados.rados.0.trial082.stdout:3318: left oid 8 (ObjNum 1139 snap 356 seq_num 1139) 2026-02-12T17:42:39.115 INFO:tasks.rados.rados.0.trial082.stdout:3312: done (6 left) 2026-02-12T17:42:39.115 INFO:tasks.rados.rados.0.trial082.stdout:3313: done (5 left) 2026-02-12T17:42:39.115 INFO:tasks.rados.rados.0.trial082.stdout:3314: done (4 left) 2026-02-12T17:42:39.115 INFO:tasks.rados.rados.0.trial082.stdout:3315: done (3 left) 2026-02-12T17:42:39.116 INFO:tasks.rados.rados.0.trial082.stdout:3316: done (2 left) 2026-02-12T17:42:39.116 INFO:tasks.rados.rados.0.trial082.stdout:3318: done (1 left) 2026-02-12T17:42:39.116 INFO:tasks.rados.rados.0.trial082.stdout:3319: done (0 left) 2026-02-12T17:42:39.116 INFO:tasks.rados.rados.0.trial082.stdout:3320: snap_create 2026-02-12T17:42:40.116 INFO:tasks.rados.rados.0.trial082.stdout:3320: done (0 left) 2026-02-12T17:42:40.116 INFO:tasks.rados.rados.0.trial082.stdout:3321: rollback oid 13 current snap is 358 2026-02-12T17:42:40.116 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 352 2026-02-12T17:42:40.116 INFO:tasks.rados.rados.0.trial082.stdout:3322: rollback oid 14 current snap is 358 2026-02-12T17:42:40.116 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 14 to 303 2026-02-12T17:42:40.116 INFO:tasks.rados.rados.0.trial082.stdout:3323: snap_create 2026-02-12T17:42:40.119 INFO:tasks.rados.rados.0.trial082.stdout:3321: finishing rollback tid 0 to trial08226312-13 2026-02-12T17:42:40.119 INFO:tasks.rados.rados.0.trial082.stdout:3321: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:42:40.119 INFO:tasks.rados.rados.0.trial082.stdout:3321: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:42:40.120 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2226 (ObjNum 1096 snap 345 seq_num 1096) dirty exists 2026-02-12T17:42:40.120 INFO:tasks.rados.rados.0.trial082.stdout:3322: finishing rollback tid 0 to trial08226312-14 2026-02-12T17:42:40.120 INFO:tasks.rados.rados.0.trial082.stdout:3322: finishing rollback tid 1 to trial08226312-14 2026-02-12T17:42:40.120 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 2270 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-12T17:42:41.116 INFO:tasks.rados.rados.0.trial082.stdout:3321: done (2 left) 2026-02-12T17:42:41.116 INFO:tasks.rados.rados.0.trial082.stdout:3322: done (1 left) 2026-02-12T17:42:41.116 INFO:tasks.rados.rados.0.trial082.stdout:3323: done (0 left) 2026-02-12T17:42:41.117 INFO:tasks.rados.rados.0.trial082.stdout:3324: snap_remove snap 356 2026-02-12T17:42:42.117 INFO:tasks.rados.rados.0.trial082.stdout:3324: done (0 left) 2026-02-12T17:42:42.117 INFO:tasks.rados.rados.0.trial082.stdout:3325: write oid 42 current snap is 359 2026-02-12T17:42:42.118 INFO:tasks.rados.rados.0.trial082.stdout:3325: seq_num 1140 ranges {759980=720457,1943590=506386,2856447=303533} 2026-02-12T17:42:42.123 INFO:tasks.rados.rados.0.trial082.stdout:3325: writing trial08226312-42 from 759980 to 1480437 tid 1 2026-02-12T17:42:42.127 INFO:tasks.rados.rados.0.trial082.stdout:3325: writing trial08226312-42 from 1943590 to 2449976 tid 2 2026-02-12T17:42:42.131 INFO:tasks.rados.rados.0.trial082.stdout:3325: writing trial08226312-42 from 2856447 to 3159980 tid 3 2026-02-12T17:42:42.131 INFO:tasks.rados.rados.0.trial082.stdout:3326: copy_from oid 12 from oid 7 current snap is 359 2026-02-12T17:42:42.131 INFO:tasks.rados.rados.0.trial082.stdout:3325: finishing write tid 1 to trial08226312-42 2026-02-12T17:42:42.131 INFO:tasks.rados.rados.0.trial082.stdout:3325: finishing write tid 2 to trial08226312-42 2026-02-12T17:42:42.131 INFO:tasks.rados.rados.0.trial082.stdout:3327: rollback oid 48 current snap is 359 2026-02-12T17:42:42.131 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 353 2026-02-12T17:42:42.131 INFO:tasks.rados.rados.0.trial082.stdout:3328: copy_from oid 43 from oid 11 current snap is 359 2026-02-12T17:42:42.131 INFO:tasks.rados.rados.0.trial082.stdout:3329: write (excl) oid 9 current snap is 359 2026-02-12T17:42:42.132 INFO:tasks.rados.rados.0.trial082.stdout:3329: seq_num 1141 ranges {776787=512059,1718425=766397,3000223=176564} 2026-02-12T17:42:42.135 INFO:tasks.rados.rados.0.trial082.stdout:3329: writing trial08226312-9 from 776787 to 1288846 tid 1 2026-02-12T17:42:42.139 INFO:tasks.rados.rados.0.trial082.stdout:3329: writing trial08226312-9 from 1718425 to 2484822 tid 2 2026-02-12T17:42:42.142 INFO:tasks.rados.rados.0.trial082.stdout:3329: writing trial08226312-9 from 3000223 to 3176787 tid 3 2026-02-12T17:42:42.142 INFO:tasks.rados.rados.0.trial082.stdout:3330: write (excl) oid 20 current snap is 359 2026-02-12T17:42:42.143 INFO:tasks.rados.rados.0.trial082.stdout:3328: finishing copy_from to trial08226312-43 2026-02-12T17:42:42.143 INFO:tasks.rados.rados.0.trial082.stdout:3328: got expected ENOENT (src dne) 2026-02-12T17:42:42.143 INFO:tasks.rados.rados.0.trial082.stdout:3328: finishing copy_from racing read to trial08226312-43 2026-02-12T17:42:42.143 INFO:tasks.rados.rados.0.trial082.stdout:3327: finishing rollback tid 0 to trial08226312-48 2026-02-12T17:42:42.143 INFO:tasks.rados.rados.0.trial082.stdout:3327: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:42:42.143 INFO:tasks.rados.rados.0.trial082.stdout:3330: seq_num 1142 ranges {793594=587308,2060554=510055} 2026-02-12T17:42:42.147 INFO:tasks.rados.rados.0.trial082.stdout:3330: writing trial08226312-20 from 793594 to 1380902 tid 1 2026-02-12T17:42:42.152 INFO:tasks.rados.rados.0.trial082.stdout:3330: writing trial08226312-20 from 2060554 to 2570609 tid 2 2026-02-12T17:42:42.152 INFO:tasks.rados.rados.0.trial082.stdout:3328: done (5 left) 2026-02-12T17:42:42.152 INFO:tasks.rados.rados.0.trial082.stdout:3331: read oid 4 snap 341 2026-02-12T17:42:42.152 INFO:tasks.rados.rados.0.trial082.stdout:3331: expect (ObjNum 1022 snap 321 seq_num 1022) 2026-02-12T17:42:42.152 INFO:tasks.rados.rados.0.trial082.stdout:3332: snap_remove snap 343 2026-02-12T17:42:43.114 INFO:tasks.rados.rados.0.trial082.stdout:3332: done (6 left) 2026-02-12T17:42:43.114 INFO:tasks.rados.rados.0.trial082.stdout:3333: snap_create 2026-02-12T17:42:43.114 INFO:tasks.rados.rados.0.trial082.stdout:3327: finishing rollback tid 2 to trial08226312-48 2026-02-12T17:42:43.114 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 1623 (ObjNum 1095 snap 345 seq_num 1095) dirty exists 2026-02-12T17:42:43.114 INFO:tasks.rados.rados.0.trial082.stdout:3325: finishing write tid 3 to trial08226312-42 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3325: finishing write tid 4 to trial08226312-42 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3325: finishing write tid 5 to trial08226312-42 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3325: oid 42 updating version 0 to 2388 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3325: oid 42 version 2388 is already newer than 2387 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3325: oid 42 version 2388 is already newer than 2386 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3325: oid 42 updating version 2388 to 2389 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 2389 (ObjNum 1140 snap 359 seq_num 1140) dirty exists 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3325: left oid 42 (ObjNum 1140 snap 359 seq_num 1140) 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3329: finishing write tid 1 to trial08226312-9 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3326: finishing copy_from racing read to trial08226312-12 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3326: finishing copy_from to trial08226312-12 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 2376 (ObjNum 1105 snap 346 seq_num 1105) dirty exists 2026-02-12T17:42:43.115 INFO:tasks.rados.rados.0.trial082.stdout:3329: finishing write tid 2 to trial08226312-9 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3329: finishing write tid 3 to trial08226312-9 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3329: finishing write tid 4 to trial08226312-9 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3329: finishing write tid 5 to trial08226312-9 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3329: oid 9 updating version 0 to 2393 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3329: oid 9 version 2393 is already newer than 2390 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3329: oid 9 version 2393 is already newer than 2392 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3329: oid 9 version 2393 is already newer than 2391 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 2393 (ObjNum 1141 snap 359 seq_num 1141) dirty exists 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3329: left oid 9 (ObjNum 1141 snap 359 seq_num 1141) 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3330: finishing write tid 1 to trial08226312-20 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3330: finishing write tid 2 to trial08226312-20 2026-02-12T17:42:43.116 INFO:tasks.rados.rados.0.trial082.stdout:3330: finishing write tid 3 to trial08226312-20 2026-02-12T17:42:43.117 INFO:tasks.rados.rados.0.trial082.stdout:3330: finishing write tid 4 to trial08226312-20 2026-02-12T17:42:43.117 INFO:tasks.rados.rados.0.trial082.stdout:3330: oid 20 updating version 0 to 2495 2026-02-12T17:42:43.117 INFO:tasks.rados.rados.0.trial082.stdout:3330: oid 20 updating version 2495 to 2496 2026-02-12T17:42:43.117 INFO:tasks.rados.rados.0.trial082.stdout:3330: oid 20 updating version 2496 to 2497 2026-02-12T17:42:43.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 2497 (ObjNum 1142 snap 359 seq_num 1142) dirty exists 2026-02-12T17:42:43.117 INFO:tasks.rados.rados.0.trial082.stdout:3330: left oid 20 (ObjNum 1142 snap 359 seq_num 1142) 2026-02-12T17:42:43.117 INFO:tasks.rados.rados.0.trial082.stdout:3331: expect (ObjNum 1022 snap 321 seq_num 1022) 2026-02-12T17:42:43.137 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:43.165 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1147150 2026-02-12T17:42:44.113 INFO:tasks.rados.rados.0.trial082.stdout:3325: done (6 left) 2026-02-12T17:42:44.113 INFO:tasks.rados.rados.0.trial082.stdout:3326: done (5 left) 2026-02-12T17:42:44.113 INFO:tasks.rados.rados.0.trial082.stdout:3327: done (4 left) 2026-02-12T17:42:44.113 INFO:tasks.rados.rados.0.trial082.stdout:3329: done (3 left) 2026-02-12T17:42:44.113 INFO:tasks.rados.rados.0.trial082.stdout:3330: done (2 left) 2026-02-12T17:42:44.114 INFO:tasks.rados.rados.0.trial082.stdout:3331: done (1 left) 2026-02-12T17:42:44.114 INFO:tasks.rados.rados.0.trial082.stdout:3333: done (0 left) 2026-02-12T17:42:44.114 INFO:tasks.rados.rados.0.trial082.stdout:3334: write (excl) oid 40 current snap is 360 2026-02-12T17:42:44.114 INFO:tasks.rados.rados.0.trial082.stdout:3334: seq_num 1143 ranges {410401=662557,1719036=770066,2938716=271685} 2026-02-12T17:42:44.117 INFO:tasks.rados.rados.0.trial082.stdout:3334: writing trial08226312-40 from 410401 to 1072958 tid 1 2026-02-12T17:42:44.123 INFO:tasks.rados.rados.0.trial082.stdout:3334: writing trial08226312-40 from 1719036 to 2489102 tid 2 2026-02-12T17:42:44.126 INFO:tasks.rados.rados.0.trial082.stdout:3334: writing trial08226312-40 from 2938716 to 3210401 tid 3 2026-02-12T17:42:44.126 INFO:tasks.rados.rados.0.trial082.stdout:3335: snap_remove snap 357 2026-02-12T17:42:45.125 INFO:tasks.rados.rados.0.trial082.stdout:3335: done (1 left) 2026-02-12T17:42:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3336: copy_from oid 45 from oid 17 current snap is 360 2026-02-12T17:42:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3334: finishing write tid 1 to trial08226312-40 2026-02-12T17:42:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3334: finishing write tid 2 to trial08226312-40 2026-02-12T17:42:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3334: finishing write tid 3 to trial08226312-40 2026-02-12T17:42:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3334: finishing write tid 4 to trial08226312-40 2026-02-12T17:42:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3334: finishing write tid 5 to trial08226312-40 2026-02-12T17:42:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3334: oid 40 updating version 0 to 2397 2026-02-12T17:42:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3334: oid 40 version 2397 is already newer than 2396 2026-02-12T17:42:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3334: oid 40 version 2397 is already newer than 2395 2026-02-12T17:42:45.127 INFO:tasks.rados.rados.0.trial082.stdout:3334: oid 40 version 2397 is already newer than 2394 2026-02-12T17:42:45.127 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 2397 (ObjNum 1143 snap 360 seq_num 1143) dirty exists 2026-02-12T17:42:45.127 INFO:tasks.rados.rados.0.trial082.stdout:3334: left oid 40 (ObjNum 1143 snap 360 seq_num 1143) 2026-02-12T17:42:45.127 INFO:tasks.rados.rados.0.trial082.stdout:3334: done (1 left) 2026-02-12T17:42:45.127 INFO:tasks.rados.rados.0.trial082.stdout:3337: read oid 1 snap -1 2026-02-12T17:42:45.127 INFO:tasks.rados.rados.0.trial082.stdout:3337: expect (ObjNum 1103 snap 346 seq_num 1103) 2026-02-12T17:42:45.127 INFO:tasks.rados.rados.0.trial082.stdout:3338: snap_remove snap 352 2026-02-12T17:42:46.138 INFO:tasks.rados.rados.0.trial082.stdout:3338: done (2 left) 2026-02-12T17:42:46.138 INFO:tasks.rados.rados.0.trial082.stdout:3339: read oid 47 snap -1 2026-02-12T17:42:46.138 INFO:tasks.rados.rados.0.trial082.stdout:3339: expect (ObjNum 1091 snap 345 seq_num 1091) 2026-02-12T17:42:46.138 INFO:tasks.rados.rados.0.trial082.stdout:3340: read oid 31 snap -1 2026-02-12T17:42:46.138 INFO:tasks.rados.rados.0.trial082.stdout:3340: expect (ObjNum 970 snap 301 seq_num 970) 2026-02-12T17:42:46.139 INFO:tasks.rados.rados.0.trial082.stdout:3341: copy_from oid 25 from oid 29 current snap is 360 2026-02-12T17:42:46.139 INFO:tasks.rados.rados.0.trial082.stdout:3337: expect (ObjNum 1103 snap 346 seq_num 1103) 2026-02-12T17:42:46.146 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2248269 2026-02-12T17:42:46.173 INFO:tasks.rados.rados.0.trial082.stdout:3336: finishing copy_from racing read to trial08226312-45 2026-02-12T17:42:46.174 INFO:tasks.rados.rados.0.trial082.stdout:3336: finishing copy_from to trial08226312-45 2026-02-12T17:42:46.174 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2440 (ObjNum 1103 snap 346 seq_num 1103) dirty exists 2026-02-12T17:42:46.174 INFO:tasks.rados.rados.0.trial082.stdout:3340: expect (ObjNum 970 snap 301 seq_num 970) 2026-02-12T17:42:46.181 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1084020 2026-02-12T17:42:46.234 INFO:tasks.rados.rados.0.trial082.stdout:3341: finishing copy_from to trial08226312-25 2026-02-12T17:42:46.234 INFO:tasks.rados.rados.0.trial082.stdout:3341: got expected ENOENT (src dne) 2026-02-12T17:42:46.234 INFO:tasks.rados.rados.0.trial082.stdout:3336: done (4 left) 2026-02-12T17:42:46.234 INFO:tasks.rados.rados.0.trial082.stdout:3337: done (3 left) 2026-02-12T17:42:46.234 INFO:tasks.rados.rados.0.trial082.stdout:3340: done (2 left) 2026-02-12T17:42:46.235 INFO:tasks.rados.rados.0.trial082.stdout:3342: rollback oid 19 current snap is 360 2026-02-12T17:42:46.235 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 329 2026-02-12T17:42:46.235 INFO:tasks.rados.rados.0.trial082.stdout:3341: finishing copy_from racing read to trial08226312-25 2026-02-12T17:42:46.235 INFO:tasks.rados.rados.0.trial082.stdout:3339: expect (ObjNum 1091 snap 345 seq_num 1091) 2026-02-12T17:42:46.235 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 176181 2026-02-12T17:42:46.317 INFO:tasks.rados.rados.0.trial082.stdout:3342: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:42:46.317 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 2470 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:42:46.317 INFO:tasks.rados.rados.0.trial082.stdout:3339: done (2 left) 2026-02-12T17:42:46.317 INFO:tasks.rados.rados.0.trial082.stdout:3341: done (1 left) 2026-02-12T17:42:46.317 INFO:tasks.rados.rados.0.trial082.stdout:3342: done (0 left) 2026-02-12T17:42:46.317 INFO:tasks.rados.rados.0.trial082.stdout:3343: snap_create 2026-02-12T17:42:47.144 INFO:tasks.rados.rados.0.trial082.stdout:3343: done (0 left) 2026-02-12T17:42:47.144 INFO:tasks.rados.rados.0.trial082.stdout:3344: read oid 35 snap 360 2026-02-12T17:42:47.144 INFO:tasks.rados.rados.0.trial082.stdout:3344: expect (ObjNum 1122 snap 353 seq_num 1122) 2026-02-12T17:42:47.144 INFO:tasks.rados.rados.0.trial082.stdout:3345: read oid 32 snap 353 2026-02-12T17:42:47.144 INFO:tasks.rados.rados.0.trial082.stdout:3345: expect deleted 2026-02-12T17:42:47.145 INFO:tasks.rados.rados.0.trial082.stdout:3346: copy_from oid 14 from oid 9 current snap is 361 2026-02-12T17:42:47.145 INFO:tasks.rados.rados.0.trial082.stdout:3347: read oid 42 snap -1 2026-02-12T17:42:47.145 INFO:tasks.rados.rados.0.trial082.stdout:3347: expect (ObjNum 1140 snap 359 seq_num 1140) 2026-02-12T17:42:47.145 INFO:tasks.rados.rados.0.trial082.stdout:3348: snap_create 2026-02-12T17:42:47.148 INFO:tasks.rados.rados.0.trial082.stdout:3344: expect (ObjNum 1122 snap 353 seq_num 1122) 2026-02-12T17:42:47.181 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 538644 2026-02-12T17:42:47.243 INFO:tasks.rados.rados.0.trial082.stdout:3347: expect (ObjNum 1140 snap 359 seq_num 1140) 2026-02-12T17:42:47.257 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:47.294 INFO:tasks.rados.rados.0.trial082.stdout:3346: finishing copy_from racing read to trial08226312-14 2026-02-12T17:42:47.294 INFO:tasks.rados.rados.0.trial082.stdout:3346: finishing copy_from to trial08226312-14 2026-02-12T17:42:47.294 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 2393 (ObjNum 1141 snap 359 seq_num 1141) dirty exists 2026-02-12T17:42:48.145 INFO:tasks.rados.rados.0.trial082.stdout:3344: done (4 left) 2026-02-12T17:42:48.145 INFO:tasks.rados.rados.0.trial082.stdout:3345: done (3 left) 2026-02-12T17:42:48.145 INFO:tasks.rados.rados.0.trial082.stdout:3346: done (2 left) 2026-02-12T17:42:48.145 INFO:tasks.rados.rados.0.trial082.stdout:3347: done (1 left) 2026-02-12T17:42:48.145 INFO:tasks.rados.rados.0.trial082.stdout:3348: done (0 left) 2026-02-12T17:42:48.145 INFO:tasks.rados.rados.0.trial082.stdout:3349: snap_create 2026-02-12T17:42:49.146 INFO:tasks.rados.rados.0.trial082.stdout:3349: done (0 left) 2026-02-12T17:42:49.146 INFO:tasks.rados.rados.0.trial082.stdout:3350: rollback oid 15 current snap is 363 2026-02-12T17:42:49.146 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 15 to 351 2026-02-12T17:42:49.146 INFO:tasks.rados.rados.0.trial082.stdout:3351: write (excl) oid 3 current snap is 363 2026-02-12T17:42:49.147 INFO:tasks.rados.rados.0.trial082.stdout:3351: seq_num 1144 ranges {427208=737806,1777518=513724,2966139=261069} 2026-02-12T17:42:49.150 INFO:tasks.rados.rados.0.trial082.stdout:3351: writing trial08226312-3 from 427208 to 1165014 tid 1 2026-02-12T17:42:49.154 INFO:tasks.rados.rados.0.trial082.stdout:3351: writing trial08226312-3 from 1777518 to 2291242 tid 2 2026-02-12T17:42:49.158 INFO:tasks.rados.rados.0.trial082.stdout:3351: writing trial08226312-3 from 2966139 to 3227208 tid 3 2026-02-12T17:42:49.158 INFO:tasks.rados.rados.0.trial082.stdout:3352: write oid 35 current snap is 363 2026-02-12T17:42:49.158 INFO:tasks.rados.rados.0.trial082.stdout:3352: seq_num 1145 ranges {444015=413055,1436000=773735,2709915=534100} 2026-02-12T17:42:49.161 INFO:tasks.rados.rados.0.trial082.stdout:3352: writing trial08226312-35 from 444015 to 857070 tid 1 2026-02-12T17:42:49.166 INFO:tasks.rados.rados.0.trial082.stdout:3352: writing trial08226312-35 from 1436000 to 2209735 tid 2 2026-02-12T17:42:49.171 INFO:tasks.rados.rados.0.trial082.stdout:3352: writing trial08226312-35 from 2709915 to 3244015 tid 3 2026-02-12T17:42:49.171 INFO:tasks.rados.rados.0.trial082.stdout:3353: read oid 36 snap -1 2026-02-12T17:42:49.171 INFO:tasks.rados.rados.0.trial082.stdout:3353: expect (ObjNum 998 snap 309 seq_num 998) 2026-02-12T17:42:49.171 INFO:tasks.rados.rados.0.trial082.stdout:3354: snap_create 2026-02-12T17:42:49.171 INFO:tasks.rados.rados.0.trial082.stdout:3350: finishing rollback tid 1 to trial08226312-15 2026-02-12T17:42:49.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 2259 (ObjNum 129 snap 0 seq_num 27739568) dirty dne 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: finishing write tid 1 to trial08226312-3 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: finishing write tid 2 to trial08226312-3 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: finishing write tid 3 to trial08226312-3 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: finishing write tid 4 to trial08226312-3 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: finishing write tid 5 to trial08226312-3 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: oid 3 updating version 0 to 2396 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: oid 3 version 2396 is already newer than 2395 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: oid 3 updating version 2396 to 2397 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: oid 3 version 2397 is already newer than 2394 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 2397 (ObjNum 1144 snap 363 seq_num 1144) dirty exists 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3351: left oid 3 (ObjNum 1144 snap 363 seq_num 1144) 2026-02-12T17:42:49.172 INFO:tasks.rados.rados.0.trial082.stdout:3352: finishing write tid 1 to trial08226312-35 2026-02-12T17:42:49.173 INFO:tasks.rados.rados.0.trial082.stdout:3352: finishing write tid 2 to trial08226312-35 2026-02-12T17:42:49.178 INFO:tasks.rados.rados.0.trial082.stdout:3352: finishing write tid 3 to trial08226312-35 2026-02-12T17:42:49.178 INFO:tasks.rados.rados.0.trial082.stdout:3352: finishing write tid 4 to trial08226312-35 2026-02-12T17:42:49.179 INFO:tasks.rados.rados.0.trial082.stdout:3352: finishing write tid 5 to trial08226312-35 2026-02-12T17:42:49.179 INFO:tasks.rados.rados.0.trial082.stdout:3352: oid 35 updating version 0 to 2444 2026-02-12T17:42:49.179 INFO:tasks.rados.rados.0.trial082.stdout:3352: oid 35 version 2444 is already newer than 2443 2026-02-12T17:42:49.179 INFO:tasks.rados.rados.0.trial082.stdout:3352: oid 35 version 2444 is already newer than 2442 2026-02-12T17:42:49.179 INFO:tasks.rados.rados.0.trial082.stdout:3352: oid 35 version 2444 is already newer than 2441 2026-02-12T17:42:49.179 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 2444 (ObjNum 1145 snap 363 seq_num 1145) dirty exists 2026-02-12T17:42:49.179 INFO:tasks.rados.rados.0.trial082.stdout:3352: left oid 35 (ObjNum 1145 snap 363 seq_num 1145) 2026-02-12T17:42:49.179 INFO:tasks.rados.rados.0.trial082.stdout:3353: expect (ObjNum 998 snap 309 seq_num 998) 2026-02-12T17:42:49.186 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 972669 2026-02-12T17:42:50.151 INFO:tasks.rados.rados.0.trial082.stdout:3350: done (4 left) 2026-02-12T17:42:50.151 INFO:tasks.rados.rados.0.trial082.stdout:3351: done (3 left) 2026-02-12T17:42:50.151 INFO:tasks.rados.rados.0.trial082.stdout:3352: done (2 left) 2026-02-12T17:42:50.151 INFO:tasks.rados.rados.0.trial082.stdout:3353: done (1 left) 2026-02-12T17:42:50.151 INFO:tasks.rados.rados.0.trial082.stdout:3354: done (0 left) 2026-02-12T17:42:50.151 INFO:tasks.rados.rados.0.trial082.stdout:3355: rollback oid 13 current snap is 364 2026-02-12T17:42:50.151 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 324 2026-02-12T17:42:50.152 INFO:tasks.rados.rados.0.trial082.stdout:3356: write (excl) oid 4 current snap is 364 2026-02-12T17:42:50.152 INFO:tasks.rados.rados.0.trial082.stdout:3356: seq_num 1146 ranges {460822=488304,1378129=517393,2504632=405962} 2026-02-12T17:42:50.154 INFO:tasks.rados.rados.0.trial082.stdout:3356: writing trial08226312-4 from 460822 to 949126 tid 1 2026-02-12T17:42:50.158 INFO:tasks.rados.rados.0.trial082.stdout:3356: writing trial08226312-4 from 1378129 to 1895522 tid 2 2026-02-12T17:42:50.162 INFO:tasks.rados.rados.0.trial082.stdout:3356: writing trial08226312-4 from 2504632 to 2910594 tid 3 2026-02-12T17:42:50.162 INFO:tasks.rados.rados.0.trial082.stdout:3357: snap_create 2026-02-12T17:42:50.162 INFO:tasks.rados.rados.0.trial082.stdout:3355: finishing rollback tid 0 to trial08226312-13 2026-02-12T17:42:50.163 INFO:tasks.rados.rados.0.trial082.stdout:3355: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:42:50.163 INFO:tasks.rados.rados.0.trial082.stdout:3355: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:42:50.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2229 (ObjNum 977 snap 303 seq_num 977) dirty exists 2026-02-12T17:42:50.163 INFO:tasks.rados.rados.0.trial082.stdout:3356: finishing write tid 1 to trial08226312-4 2026-02-12T17:42:50.163 INFO:tasks.rados.rados.0.trial082.stdout:3356: finishing write tid 2 to trial08226312-4 2026-02-12T17:42:50.164 INFO:tasks.rados.rados.0.trial082.stdout:3356: finishing write tid 3 to trial08226312-4 2026-02-12T17:42:50.164 INFO:tasks.rados.rados.0.trial082.stdout:3356: finishing write tid 4 to trial08226312-4 2026-02-12T17:42:50.165 INFO:tasks.rados.rados.0.trial082.stdout:3356: finishing write tid 5 to trial08226312-4 2026-02-12T17:42:50.165 INFO:tasks.rados.rados.0.trial082.stdout:3356: oid 4 updating version 0 to 2517 2026-02-12T17:42:50.165 INFO:tasks.rados.rados.0.trial082.stdout:3356: oid 4 version 2517 is already newer than 2516 2026-02-12T17:42:50.165 INFO:tasks.rados.rados.0.trial082.stdout:3356: oid 4 updating version 2517 to 2518 2026-02-12T17:42:50.165 INFO:tasks.rados.rados.0.trial082.stdout:3356: oid 4 updating version 2518 to 2519 2026-02-12T17:42:50.165 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 2519 (ObjNum 1146 snap 364 seq_num 1146) dirty exists 2026-02-12T17:42:50.165 INFO:tasks.rados.rados.0.trial082.stdout:3356: left oid 4 (ObjNum 1146 snap 364 seq_num 1146) 2026-02-12T17:42:51.151 INFO:tasks.rados.rados.0.trial082.stdout:3355: done (2 left) 2026-02-12T17:42:51.152 INFO:tasks.rados.rados.0.trial082.stdout:3356: done (1 left) 2026-02-12T17:42:51.152 INFO:tasks.rados.rados.0.trial082.stdout:3357: done (0 left) 2026-02-12T17:42:51.152 INFO:tasks.rados.rados.0.trial082.stdout:3358: write oid 46 current snap is 365 2026-02-12T17:42:51.152 INFO:tasks.rados.rados.0.trial082.stdout:3358: seq_num 1147 ranges {477629=563553,1836611=777404,3048408=229221} 2026-02-12T17:42:51.156 INFO:tasks.rados.rados.0.trial082.stdout:3358: writing trial08226312-46 from 477629 to 1041182 tid 1 2026-02-12T17:42:51.162 INFO:tasks.rados.rados.0.trial082.stdout:3358: writing trial08226312-46 from 1836611 to 2614015 tid 2 2026-02-12T17:42:51.164 INFO:tasks.rados.rados.0.trial082.stdout:3358: writing trial08226312-46 from 3048408 to 3277629 tid 3 2026-02-12T17:42:51.164 INFO:tasks.rados.rados.0.trial082.stdout:3359: read oid 27 snap 362 2026-02-12T17:42:51.164 INFO:tasks.rados.rados.0.trial082.stdout:3359: expect (ObjNum 1106 snap 346 seq_num 1106) 2026-02-12T17:42:51.165 INFO:tasks.rados.rados.0.trial082.stdout:3360: rollback oid 18 current snap is 365 2026-02-12T17:42:51.165 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 334 2026-02-12T17:42:51.165 INFO:tasks.rados.rados.0.trial082.stdout:3358: finishing write tid 1 to trial08226312-46 2026-02-12T17:42:51.165 INFO:tasks.rados.rados.0.trial082.stdout:3361: snap_create 2026-02-12T17:42:51.165 INFO:tasks.rados.rados.0.trial082.stdout:3358: finishing write tid 2 to trial08226312-46 2026-02-12T17:42:51.166 INFO:tasks.rados.rados.0.trial082.stdout:3358: finishing write tid 3 to trial08226312-46 2026-02-12T17:42:51.166 INFO:tasks.rados.rados.0.trial082.stdout:3358: finishing write tid 4 to trial08226312-46 2026-02-12T17:42:51.166 INFO:tasks.rados.rados.0.trial082.stdout:3358: finishing write tid 5 to trial08226312-46 2026-02-12T17:42:51.166 INFO:tasks.rados.rados.0.trial082.stdout:3358: oid 46 updating version 0 to 2348 2026-02-12T17:42:51.166 INFO:tasks.rados.rados.0.trial082.stdout:3358: oid 46 version 2348 is already newer than 2347 2026-02-12T17:42:51.166 INFO:tasks.rados.rados.0.trial082.stdout:3358: oid 46 version 2348 is already newer than 2346 2026-02-12T17:42:51.166 INFO:tasks.rados.rados.0.trial082.stdout:3358: oid 46 version 2348 is already newer than 2345 2026-02-12T17:42:51.166 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 2348 (ObjNum 1147 snap 365 seq_num 1147) dirty exists 2026-02-12T17:42:51.166 INFO:tasks.rados.rados.0.trial082.stdout:3358: left oid 46 (ObjNum 1147 snap 365 seq_num 1147) 2026-02-12T17:42:51.167 INFO:tasks.rados.rados.0.trial082.stdout:3360: finishing rollback tid 0 to trial08226312-18 2026-02-12T17:42:51.167 INFO:tasks.rados.rados.0.trial082.stdout:3360: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:42:51.167 INFO:tasks.rados.rados.0.trial082.stdout:3360: finishing rollback tid 2 to trial08226312-18 2026-02-12T17:42:51.167 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 2224 (ObjNum 1007 snap 314 seq_num 1007) dirty exists 2026-02-12T17:42:51.168 INFO:tasks.rados.rados.0.trial082.stdout:3359: expect (ObjNum 1106 snap 346 seq_num 1106) 2026-02-12T17:42:51.191 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2286438 2026-02-12T17:42:51.219 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1484558 2026-02-12T17:42:52.156 INFO:tasks.rados.rados.0.trial082.stdout:3358: done (3 left) 2026-02-12T17:42:52.156 INFO:tasks.rados.rados.0.trial082.stdout:3359: done (2 left) 2026-02-12T17:42:52.156 INFO:tasks.rados.rados.0.trial082.stdout:3360: done (1 left) 2026-02-12T17:42:52.156 INFO:tasks.rados.rados.0.trial082.stdout:3361: done (0 left) 2026-02-12T17:42:52.156 INFO:tasks.rados.rados.0.trial082.stdout:3362: read oid 12 snap -1 2026-02-12T17:42:52.157 INFO:tasks.rados.rados.0.trial082.stdout:3362: expect (ObjNum 1105 snap 346 seq_num 1105) 2026-02-12T17:42:52.157 INFO:tasks.rados.rados.0.trial082.stdout:3363: read oid 5 snap 329 2026-02-12T17:42:52.157 INFO:tasks.rados.rados.0.trial082.stdout:3363: expect deleted 2026-02-12T17:42:52.157 INFO:tasks.rados.rados.0.trial082.stdout:3364: copy_from oid 26 from oid 30 current snap is 366 2026-02-12T17:42:52.157 INFO:tasks.rados.rados.0.trial082.stdout:3365: write (excl) oid 29 current snap is 366 2026-02-12T17:42:52.157 INFO:tasks.rados.rados.0.trial082.stdout:3365: seq_num 1148 ranges {494436=755155,2011446=521062,3075831=218605} 2026-02-12T17:42:52.161 INFO:tasks.rados.rados.0.trial082.stdout:3365: writing trial08226312-29 from 494436 to 1249591 tid 1 2026-02-12T17:42:52.165 INFO:tasks.rados.rados.0.trial082.stdout:3365: writing trial08226312-29 from 2011446 to 2532508 tid 2 2026-02-12T17:42:52.168 INFO:tasks.rados.rados.0.trial082.stdout:3365: writing trial08226312-29 from 3075831 to 3294436 tid 3 2026-02-12T17:42:52.168 INFO:tasks.rados.rados.0.trial082.stdout:3366: snap_remove snap 361 2026-02-12T17:42:53.113 INFO:tasks.rados.rados.0.trial082.stdout:3366: done (4 left) 2026-02-12T17:42:53.113 INFO:tasks.rados.rados.0.trial082.stdout:3367: write (excl) oid 11 current snap is 366 2026-02-12T17:42:53.113 INFO:tasks.rados.rados.0.trial082.stdout:3367: seq_num 1149 ranges {511243=430404,1669928=664720,3103254=207989} 2026-02-12T17:42:53.117 INFO:tasks.rados.rados.0.trial082.stdout:3367: writing trial08226312-11 from 511243 to 941647 tid 1 2026-02-12T17:42:53.123 INFO:tasks.rados.rados.0.trial082.stdout:3367: writing trial08226312-11 from 1669928 to 2334648 tid 2 2026-02-12T17:42:53.127 INFO:tasks.rados.rados.0.trial082.stdout:3367: writing trial08226312-11 from 3103254 to 3311243 tid 3 2026-02-12T17:42:53.127 INFO:tasks.rados.rados.0.trial082.stdout:3368: delete oid 6 current snap is 366 2026-02-12T17:42:53.127 INFO:tasks.rados.rados.0.trial082.stdout:3362: expect (ObjNum 1105 snap 346 seq_num 1105) 2026-02-12T17:42:53.133 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1407699 2026-02-12T17:42:53.197 INFO:tasks.rados.rados.0.trial082.stdout:3364: finishing copy_from racing read to trial08226312-26 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:3365: finishing write tid 1 to trial08226312-29 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:3364: finishing copy_from to trial08226312-26 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 2268 (ObjNum 987 snap 304 seq_num 987) dirty exists 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:3365: finishing write tid 2 to trial08226312-29 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:3362: done (5 left) 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:3363: done (4 left) 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:3364: done (3 left) 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:3368: done (2 left) 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:3369: read oid 13 snap 331 2026-02-12T17:42:53.198 INFO:tasks.rados.rados.0.trial082.stdout:3369: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3370: copy_from oid 10 from oid 21 current snap is 366 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3365: finishing write tid 3 to trial08226312-29 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3365: finishing write tid 4 to trial08226312-29 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3365: finishing write tid 5 to trial08226312-29 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3365: oid 29 updating version 0 to 2231 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3365: oid 29 updating version 2231 to 2234 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3365: oid 29 version 2234 is already newer than 2233 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3365: oid 29 version 2234 is already newer than 2232 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2234 (ObjNum 1148 snap 366 seq_num 1148) dirty exists 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3365: left oid 29 (ObjNum 1148 snap 366 seq_num 1148) 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3367: finishing write tid 1 to trial08226312-11 2026-02-12T17:42:53.199 INFO:tasks.rados.rados.0.trial082.stdout:3365: done (3 left) 2026-02-12T17:42:53.200 INFO:tasks.rados.rados.0.trial082.stdout:3371: write (excl) oid 29 current snap is 366 2026-02-12T17:42:53.200 INFO:tasks.rados.rados.0.trial082.stdout:3371: seq_num 1151 ranges {544857=580902,1670539=668389,3041747=303110} 2026-02-12T17:42:53.201 INFO:tasks.rados.rados.0.trial082.stdout:3371: writing trial08226312-29 from 544857 to 1125759 tid 1 2026-02-12T17:42:53.205 INFO:tasks.rados.rados.0.trial082.stdout:3371: writing trial08226312-29 from 1670539 to 2338928 tid 2 2026-02-12T17:42:53.209 INFO:tasks.rados.rados.0.trial082.stdout:3371: writing trial08226312-29 from 3041747 to 3344857 tid 3 2026-02-12T17:42:53.209 INFO:tasks.rados.rados.0.trial082.stdout:3372: read oid 18 snap 353 2026-02-12T17:42:53.210 INFO:tasks.rados.rados.0.trial082.stdout:3372: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:42:53.210 INFO:tasks.rados.rados.0.trial082.stdout:3373: write (excl) oid 42 current snap is 366 2026-02-12T17:42:53.210 INFO:tasks.rados.rados.0.trial082.stdout:3373: seq_num 1152 ranges {561664=656151,1729021=528400,2669170=692494} 2026-02-12T17:42:53.213 INFO:tasks.rados.rados.0.trial082.stdout:3373: writing trial08226312-42 from 561664 to 1217815 tid 1 2026-02-12T17:42:53.217 INFO:tasks.rados.rados.0.trial082.stdout:3373: writing trial08226312-42 from 1729021 to 2257421 tid 2 2026-02-12T17:42:53.222 INFO:tasks.rados.rados.0.trial082.stdout:3373: writing trial08226312-42 from 2669170 to 3361664 tid 3 2026-02-12T17:42:53.222 INFO:tasks.rados.rados.0.trial082.stdout:3374: snap_create 2026-02-12T17:42:53.222 INFO:tasks.rados.rados.0.trial082.stdout:3367: finishing write tid 2 to trial08226312-11 2026-02-12T17:42:53.222 INFO:tasks.rados.rados.0.trial082.stdout:3367: finishing write tid 3 to trial08226312-11 2026-02-12T17:42:53.222 INFO:tasks.rados.rados.0.trial082.stdout:3367: finishing write tid 4 to trial08226312-11 2026-02-12T17:42:53.222 INFO:tasks.rados.rados.0.trial082.stdout:3367: finishing write tid 5 to trial08226312-11 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:3367: oid 11 updating version 0 to 2351 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:3367: oid 11 updating version 2351 to 2352 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:3367: oid 11 version 2352 is already newer than 2350 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:3367: oid 11 version 2352 is already newer than 2349 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 2352 (ObjNum 1149 snap 366 seq_num 1149) dirty exists 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:3367: left oid 11 (ObjNum 1149 snap 366 seq_num 1149) 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:3371: finishing write tid 1 to trial08226312-29 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:3370: finishing copy_from racing read to trial08226312-10 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:3369: expect (ObjNum 977 snap 303 seq_num 977) 2026-02-12T17:42:53.223 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:53.268 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2343282 2026-02-12T17:42:53.296 INFO:tasks.rados.rados.0.trial082.stdout:3371: finishing write tid 2 to trial08226312-29 2026-02-12T17:42:53.296 INFO:tasks.rados.rados.0.trial082.stdout:3370: finishing copy_from to trial08226312-10 2026-02-12T17:42:53.296 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2279 (ObjNum 1128 snap 355 seq_num 1128) dirty exists 2026-02-12T17:42:53.296 INFO:tasks.rados.rados.0.trial082.stdout:3371: finishing write tid 3 to trial08226312-29 2026-02-12T17:42:53.296 INFO:tasks.rados.rados.0.trial082.stdout:3371: finishing write tid 4 to trial08226312-29 2026-02-12T17:42:53.296 INFO:tasks.rados.rados.0.trial082.stdout:3371: finishing write tid 5 to trial08226312-29 2026-02-12T17:42:53.297 INFO:tasks.rados.rados.0.trial082.stdout:3371: oid 29 updating version 0 to 2239 2026-02-12T17:42:53.297 INFO:tasks.rados.rados.0.trial082.stdout:3371: oid 29 version 2239 is already newer than 2238 2026-02-12T17:42:53.297 INFO:tasks.rados.rados.0.trial082.stdout:3371: oid 29 version 2239 is already newer than 2237 2026-02-12T17:42:53.297 INFO:tasks.rados.rados.0.trial082.stdout:3371: oid 29 version 2239 is already newer than 2236 2026-02-12T17:42:53.297 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2239 (ObjNum 1151 snap 366 seq_num 1151) dirty exists 2026-02-12T17:42:53.297 INFO:tasks.rados.rados.0.trial082.stdout:3371: left oid 29 (ObjNum 1151 snap 366 seq_num 1151) 2026-02-12T17:42:53.297 INFO:tasks.rados.rados.0.trial082.stdout:3372: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:42:53.298 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1267208 2026-02-12T17:42:53.325 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 945293 2026-02-12T17:42:53.378 INFO:tasks.rados.rados.0.trial082.stdout:3373: finishing write tid 1 to trial08226312-42 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:3373: finishing write tid 2 to trial08226312-42 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:3373: finishing write tid 3 to trial08226312-42 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:3373: finishing write tid 4 to trial08226312-42 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:3373: finishing write tid 5 to trial08226312-42 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:3373: oid 42 updating version 0 to 2400 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:3373: oid 42 version 2400 is already newer than 2399 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:3373: oid 42 version 2400 is already newer than 2398 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:3373: oid 42 updating version 2400 to 2401 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 2401 (ObjNum 1152 snap 366 seq_num 1152) dirty exists 2026-02-12T17:42:53.379 INFO:tasks.rados.rados.0.trial082.stdout:3373: left oid 42 (ObjNum 1152 snap 366 seq_num 1152) 2026-02-12T17:42:54.160 INFO:tasks.rados.rados.0.trial082.stdout:3367: done (6 left) 2026-02-12T17:42:54.160 INFO:tasks.rados.rados.0.trial082.stdout:3369: done (5 left) 2026-02-12T17:42:54.160 INFO:tasks.rados.rados.0.trial082.stdout:3370: done (4 left) 2026-02-12T17:42:54.160 INFO:tasks.rados.rados.0.trial082.stdout:3371: done (3 left) 2026-02-12T17:42:54.160 INFO:tasks.rados.rados.0.trial082.stdout:3372: done (2 left) 2026-02-12T17:42:54.160 INFO:tasks.rados.rados.0.trial082.stdout:3373: done (1 left) 2026-02-12T17:42:54.160 INFO:tasks.rados.rados.0.trial082.stdout:3374: done (0 left) 2026-02-12T17:42:54.161 INFO:tasks.rados.rados.0.trial082.stdout:3375: delete oid 24 current snap is 367 2026-02-12T17:42:54.162 INFO:tasks.rados.rados.0.trial082.stdout:3375: done (0 left) 2026-02-12T17:42:54.162 INFO:tasks.rados.rados.0.trial082.stdout:3376: delete oid 21 current snap is 367 2026-02-12T17:42:54.164 INFO:tasks.rados.rados.0.trial082.stdout:3376: done (0 left) 2026-02-12T17:42:54.165 INFO:tasks.rados.rados.0.trial082.stdout:3377: snap_remove snap 351 2026-02-12T17:42:55.162 INFO:tasks.rados.rados.0.trial082.stdout:3377: done (0 left) 2026-02-12T17:42:55.163 INFO:tasks.rados.rados.0.trial082.stdout:3378: copy_from oid 6 from oid 16 current snap is 367 2026-02-12T17:42:55.163 INFO:tasks.rados.rados.0.trial082.stdout:3379: snap_remove snap 353 2026-02-12T17:42:56.165 INFO:tasks.rados.rados.0.trial082.stdout:3379: done (1 left) 2026-02-12T17:42:56.165 INFO:tasks.rados.rados.0.trial082.stdout:3380: write (excl) oid 25 current snap is 367 2026-02-12T17:42:56.165 INFO:tasks.rados.rados.0.trial082.stdout:3380: seq_num 1155 ranges {612085=481898,1788114=675727,3035086=376999} 2026-02-12T17:42:56.169 INFO:tasks.rados.rados.0.trial082.stdout:3380: writing trial08226312-25 from 612085 to 1093983 tid 1 2026-02-12T17:42:56.174 INFO:tasks.rados.rados.0.trial082.stdout:3380: writing trial08226312-25 from 1788114 to 2463841 tid 2 2026-02-12T17:42:56.179 INFO:tasks.rados.rados.0.trial082.stdout:3380: writing trial08226312-25 from 3035086 to 3412085 tid 3 2026-02-12T17:42:56.179 INFO:tasks.rados.rados.0.trial082.stdout:3381: rollback oid 44 current snap is 367 2026-02-12T17:42:56.179 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 303 2026-02-12T17:42:56.180 INFO:tasks.rados.rados.0.trial082.stdout:3378: finishing copy_from racing read to trial08226312-6 2026-02-12T17:42:56.180 INFO:tasks.rados.rados.0.trial082.stdout:3378: finishing copy_from to trial08226312-6 2026-02-12T17:42:56.180 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 1574 (ObjNum 1007 snap 314 seq_num 1007) dirty exists 2026-02-12T17:42:56.180 INFO:tasks.rados.rados.0.trial082.stdout:3380: finishing write tid 1 to trial08226312-25 2026-02-12T17:42:56.180 INFO:tasks.rados.rados.0.trial082.stdout:3380: finishing write tid 2 to trial08226312-25 2026-02-12T17:42:56.180 INFO:tasks.rados.rados.0.trial082.stdout:3378: done (2 left) 2026-02-12T17:42:56.180 INFO:tasks.rados.rados.0.trial082.stdout:3382: snap_remove snap 355 2026-02-12T17:42:57.166 INFO:tasks.rados.rados.0.trial082.stdout:3382: done (2 left) 2026-02-12T17:42:57.166 INFO:tasks.rados.rados.0.trial082.stdout:3383: copy_from oid 41 from oid 5 current snap is 367 2026-02-12T17:42:57.166 INFO:tasks.rados.rados.0.trial082.stdout:3380: finishing write tid 3 to trial08226312-25 2026-02-12T17:42:57.166 INFO:tasks.rados.rados.0.trial082.stdout:3380: finishing write tid 4 to trial08226312-25 2026-02-12T17:42:57.166 INFO:tasks.rados.rados.0.trial082.stdout:3380: finishing write tid 5 to trial08226312-25 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3380: oid 25 updating version 0 to 2230 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3380: oid 25 updating version 2230 to 2233 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3380: oid 25 version 2233 is already newer than 2232 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3380: oid 25 version 2233 is already newer than 2231 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 2233 (ObjNum 1155 snap 367 seq_num 1155) dirty exists 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3380: left oid 25 (ObjNum 1155 snap 367 seq_num 1155) 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3381: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3381: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3380: done (2 left) 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3384: snap_create 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:3381: finishing rollback tid 2 to trial08226312-44 2026-02-12T17:42:57.167 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2447 (ObjNum 851 snap 268 seq_num 851) dirty exists 2026-02-12T17:42:57.172 INFO:tasks.rados.rados.0.trial082.stdout:3383: finishing copy_from racing read to trial08226312-41 2026-02-12T17:42:57.175 INFO:tasks.rados.rados.0.trial082.stdout:3383: finishing copy_from to trial08226312-41 2026-02-12T17:42:57.175 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 1389 (ObjNum 1071 snap 338 seq_num 1071) dirty exists 2026-02-12T17:42:58.167 INFO:tasks.rados.rados.0.trial082.stdout:3381: done (2 left) 2026-02-12T17:42:58.167 INFO:tasks.rados.rados.0.trial082.stdout:3383: done (1 left) 2026-02-12T17:42:58.167 INFO:tasks.rados.rados.0.trial082.stdout:3384: done (0 left) 2026-02-12T17:42:58.168 INFO:tasks.rados.rados.0.trial082.stdout:3385: read oid 15 snap 331 2026-02-12T17:42:58.168 INFO:tasks.rados.rados.0.trial082.stdout:3385: expect (ObjNum 1039 snap 325 seq_num 1039) 2026-02-12T17:42:58.168 INFO:tasks.rados.rados.0.trial082.stdout:3386: read oid 16 snap -1 2026-02-12T17:42:58.168 INFO:tasks.rados.rados.0.trial082.stdout:3386: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:42:58.168 INFO:tasks.rados.rados.0.trial082.stdout:3387: snap_create 2026-02-12T17:42:58.169 INFO:tasks.rados.rados.0.trial082.stdout:3386: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:42:58.188 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2815564 2026-02-12T17:42:58.209 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2761362 2026-02-12T17:42:58.244 INFO:tasks.rados.rados.0.trial082.stdout:3385: expect (ObjNum 1039 snap 325 seq_num 1039) 2026-02-12T17:42:58.285 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:42:59.168 INFO:tasks.rados.rados.0.trial082.stdout:3385: done (2 left) 2026-02-12T17:42:59.168 INFO:tasks.rados.rados.0.trial082.stdout:3386: done (1 left) 2026-02-12T17:42:59.168 INFO:tasks.rados.rados.0.trial082.stdout:3387: done (0 left) 2026-02-12T17:42:59.168 INFO:tasks.rados.rados.0.trial082.stdout:3388: snap_create 2026-02-12T17:43:00.168 INFO:tasks.rados.rados.0.trial082.stdout:3388: done (0 left) 2026-02-12T17:43:00.168 INFO:tasks.rados.rados.0.trial082.stdout:3389: snap_create 2026-02-12T17:43:01.169 INFO:tasks.rados.rados.0.trial082.stdout:3389: done (0 left) 2026-02-12T17:43:01.169 INFO:tasks.rados.rados.0.trial082.stdout:3390: copy_from oid 37 from oid 36 current snap is 371 2026-02-12T17:43:01.169 INFO:tasks.rados.rados.0.trial082.stdout:3391: snap_create 2026-02-12T17:43:01.179 INFO:tasks.rados.rados.0.trial082.stdout:3390: finishing copy_from racing read to trial08226312-37 2026-02-12T17:43:01.179 INFO:tasks.rados.rados.0.trial082.stdout:3390: finishing copy_from to trial08226312-37 2026-02-12T17:43:01.179 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 1912 (ObjNum 998 snap 309 seq_num 998) dirty exists 2026-02-12T17:43:02.170 INFO:tasks.rados.rados.0.trial082.stdout:3390: done (1 left) 2026-02-12T17:43:02.171 INFO:tasks.rados.rados.0.trial082.stdout:3391: done (0 left) 2026-02-12T17:43:02.171 INFO:tasks.rados.rados.0.trial082.stdout:3392: copy_from oid 43 from oid 21 current snap is 372 2026-02-12T17:43:02.171 INFO:tasks.rados.rados.0.trial082.stdout:3393: snap_remove snap 358 2026-02-12T17:43:03.114 INFO:tasks.rados.rados.0.trial082.stdout:3393: done (1 left) 2026-02-12T17:43:03.114 INFO:tasks.rados.rados.0.trial082.stdout:3394: write oid 22 current snap is 372 2026-02-12T17:43:03.114 INFO:tasks.rados.rados.0.trial082.stdout:3394: seq_num 1156 ranges {628892=673500,1962949=535738,3178862=250030} 2026-02-12T17:43:03.119 INFO:tasks.rados.rados.0.trial082.stdout:3394: writing trial08226312-22 from 628892 to 1302392 tid 1 2026-02-12T17:43:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3394: writing trial08226312-22 from 1962949 to 2498687 tid 2 2026-02-12T17:43:03.128 INFO:tasks.rados.rados.0.trial082.stdout:3394: writing trial08226312-22 from 3178862 to 3428892 tid 3 2026-02-12T17:43:03.128 INFO:tasks.rados.rados.0.trial082.stdout:3395: write oid 50 current snap is 372 2026-02-12T17:43:03.128 INFO:tasks.rados.rados.0.trial082.stdout:3395: seq_num 1157 ranges {645699=748749,2021431=679396,3206285=239414} 2026-02-12T17:43:03.133 INFO:tasks.rados.rados.0.trial082.stdout:3395: writing trial08226312-50 from 645699 to 1394448 tid 1 2026-02-12T17:43:03.138 INFO:tasks.rados.rados.0.trial082.stdout:3395: writing trial08226312-50 from 2021431 to 2700827 tid 2 2026-02-12T17:43:03.142 INFO:tasks.rados.rados.0.trial082.stdout:3395: writing trial08226312-50 from 3206285 to 3445699 tid 3 2026-02-12T17:43:03.142 INFO:tasks.rados.rados.0.trial082.stdout:3396: write oid 28 current snap is 372 2026-02-12T17:43:03.142 INFO:tasks.rados.rados.0.trial082.stdout:3392: finishing copy_from to trial08226312-43 2026-02-12T17:43:03.142 INFO:tasks.rados.rados.0.trial082.stdout:3392: got expected ENOENT (src dne) 2026-02-12T17:43:03.142 INFO:tasks.rados.rados.0.trial082.stdout:3396: seq_num 1158 ranges {662506=423998,1563560=539407,2717355=490285} 2026-02-12T17:43:03.145 INFO:tasks.rados.rados.0.trial082.stdout:3396: writing trial08226312-28 from 662506 to 1086504 tid 1 2026-02-12T17:43:03.149 INFO:tasks.rados.rados.0.trial082.stdout:3396: writing trial08226312-28 from 1563560 to 2102967 tid 2 2026-02-12T17:43:03.154 INFO:tasks.rados.rados.0.trial082.stdout:3396: writing trial08226312-28 from 2717355 to 3207640 tid 3 2026-02-12T17:43:03.154 INFO:tasks.rados.rados.0.trial082.stdout:3397: delete oid 34 current snap is 372 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3392: finishing copy_from racing read to trial08226312-43 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: finishing write tid 1 to trial08226312-22 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: finishing write tid 2 to trial08226312-22 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: finishing write tid 3 to trial08226312-22 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: finishing write tid 4 to trial08226312-22 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: finishing write tid 5 to trial08226312-22 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: oid 22 updating version 0 to 2282 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: oid 22 version 2282 is already newer than 2281 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: oid 22 updating version 2282 to 2283 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: oid 22 updating version 2283 to 2284 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2284 (ObjNum 1156 snap 372 seq_num 1156) dirty exists 2026-02-12T17:43:03.155 INFO:tasks.rados.rados.0.trial082.stdout:3394: left oid 22 (ObjNum 1156 snap 372 seq_num 1156) 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: finishing write tid 1 to trial08226312-50 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: finishing write tid 2 to trial08226312-50 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: finishing write tid 3 to trial08226312-50 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: finishing write tid 4 to trial08226312-50 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: finishing write tid 5 to trial08226312-50 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: oid 50 updating version 0 to 2243 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: oid 50 version 2243 is already newer than 2240 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: oid 50 version 2243 is already newer than 2241 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: oid 50 version 2243 is already newer than 2242 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 2243 (ObjNum 1157 snap 372 seq_num 1157) dirty exists 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3395: left oid 50 (ObjNum 1157 snap 372 seq_num 1157) 2026-02-12T17:43:03.156 INFO:tasks.rados.rados.0.trial082.stdout:3396: finishing write tid 1 to trial08226312-28 2026-02-12T17:43:03.157 INFO:tasks.rados.rados.0.trial082.stdout:3396: finishing write tid 2 to trial08226312-28 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:3396: finishing write tid 3 to trial08226312-28 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:3396: finishing write tid 4 to trial08226312-28 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:3396: finishing write tid 5 to trial08226312-28 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:3396: oid 28 updating version 0 to 2403 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:3396: oid 28 updating version 2403 to 2404 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:3396: oid 28 updating version 2404 to 2405 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:3396: oid 28 version 2405 is already newer than 2402 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2405 (ObjNum 1158 snap 372 seq_num 1158) dirty exists 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:3396: left oid 28 (ObjNum 1158 snap 372 seq_num 1158) 2026-02-12T17:43:03.158 INFO:tasks.rados.rados.0.trial082.stdout:3392: done (4 left) 2026-02-12T17:43:03.159 INFO:tasks.rados.rados.0.trial082.stdout:3394: done (3 left) 2026-02-12T17:43:03.159 INFO:tasks.rados.rados.0.trial082.stdout:3395: done (2 left) 2026-02-12T17:43:03.159 INFO:tasks.rados.rados.0.trial082.stdout:3396: done (1 left) 2026-02-12T17:43:03.159 INFO:tasks.rados.rados.0.trial082.stdout:3397: done (0 left) 2026-02-12T17:43:03.159 INFO:tasks.rados.rados.0.trial082.stdout:3398: write oid 42 current snap is 372 2026-02-12T17:43:03.159 INFO:tasks.rados.rados.0.trial082.stdout:3398: seq_num 1160 ranges {696120=574496,1680524=543076,2888554=512829} 2026-02-12T17:43:03.161 INFO:tasks.rados.rados.0.trial082.stdout:3398: writing trial08226312-42 from 696120 to 1270616 tid 1 2026-02-12T17:43:03.165 INFO:tasks.rados.rados.0.trial082.stdout:3398: writing trial08226312-42 from 1680524 to 2223600 tid 2 2026-02-12T17:43:03.170 INFO:tasks.rados.rados.0.trial082.stdout:3398: writing trial08226312-42 from 2888554 to 3401383 tid 3 2026-02-12T17:43:03.170 INFO:tasks.rados.rados.0.trial082.stdout:3399: snap_create 2026-02-12T17:43:03.170 INFO:tasks.rados.rados.0.trial082.stdout:3398: finishing write tid 1 to trial08226312-42 2026-02-12T17:43:03.170 INFO:tasks.rados.rados.0.trial082.stdout:3398: finishing write tid 2 to trial08226312-42 2026-02-12T17:43:03.178 INFO:tasks.rados.rados.0.trial082.stdout:3398: finishing write tid 3 to trial08226312-42 2026-02-12T17:43:03.178 INFO:tasks.rados.rados.0.trial082.stdout:3398: finishing write tid 4 to trial08226312-42 2026-02-12T17:43:03.178 INFO:tasks.rados.rados.0.trial082.stdout:3398: finishing write tid 5 to trial08226312-42 2026-02-12T17:43:03.179 INFO:tasks.rados.rados.0.trial082.stdout:3398: oid 42 updating version 0 to 2409 2026-02-12T17:43:03.179 INFO:tasks.rados.rados.0.trial082.stdout:3398: oid 42 version 2409 is already newer than 2406 2026-02-12T17:43:03.179 INFO:tasks.rados.rados.0.trial082.stdout:3398: oid 42 version 2409 is already newer than 2407 2026-02-12T17:43:03.179 INFO:tasks.rados.rados.0.trial082.stdout:3398: oid 42 version 2409 is already newer than 2408 2026-02-12T17:43:03.179 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 2409 (ObjNum 1160 snap 372 seq_num 1160) dirty exists 2026-02-12T17:43:03.179 INFO:tasks.rados.rados.0.trial082.stdout:3398: left oid 42 (ObjNum 1160 snap 372 seq_num 1160) 2026-02-12T17:43:04.117 INFO:tasks.rados.rados.0.trial082.stdout:3398: done (1 left) 2026-02-12T17:43:04.118 INFO:tasks.rados.rados.0.trial082.stdout:3399: done (0 left) 2026-02-12T17:43:04.118 INFO:tasks.rados.rados.0.trial082.stdout:3400: snap_create 2026-02-12T17:43:05.117 INFO:tasks.rados.rados.0.trial082.stdout:3400: done (0 left) 2026-02-12T17:43:05.118 INFO:tasks.rados.rados.0.trial082.stdout:3401: write oid 17 current snap is 374 2026-02-12T17:43:05.118 INFO:tasks.rados.rados.0.trial082.stdout:3401: seq_num 1161 ranges {712927=649745,2139006=686734} 2026-02-12T17:43:05.123 INFO:tasks.rados.rados.0.trial082.stdout:3401: writing trial08226312-17 from 712927 to 1362672 tid 1 2026-02-12T17:43:05.129 INFO:tasks.rados.rados.0.trial082.stdout:3401: writing trial08226312-17 from 2139006 to 2825740 tid 2 2026-02-12T17:43:05.129 INFO:tasks.rados.rados.0.trial082.stdout:3402: snap_create 2026-02-12T17:43:05.129 INFO:tasks.rados.rados.0.trial082.stdout:3401: finishing write tid 1 to trial08226312-17 2026-02-12T17:43:05.131 INFO:tasks.rados.rados.0.trial082.stdout:3401: finishing write tid 2 to trial08226312-17 2026-02-12T17:43:05.131 INFO:tasks.rados.rados.0.trial082.stdout:3401: finishing write tid 3 to trial08226312-17 2026-02-12T17:43:05.131 INFO:tasks.rados.rados.0.trial082.stdout:3401: finishing write tid 4 to trial08226312-17 2026-02-12T17:43:05.131 INFO:tasks.rados.rados.0.trial082.stdout:3401: oid 17 updating version 0 to 2558 2026-02-12T17:43:05.132 INFO:tasks.rados.rados.0.trial082.stdout:3401: oid 17 version 2558 is already newer than 2557 2026-02-12T17:43:05.132 INFO:tasks.rados.rados.0.trial082.stdout:3401: oid 17 updating version 2558 to 2559 2026-02-12T17:43:05.132 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2559 (ObjNum 1161 snap 374 seq_num 1161) dirty exists 2026-02-12T17:43:05.132 INFO:tasks.rados.rados.0.trial082.stdout:3401: left oid 17 (ObjNum 1161 snap 374 seq_num 1161) 2026-02-12T17:43:06.125 INFO:tasks.rados.rados.0.trial082.stdout:3401: done (1 left) 2026-02-12T17:43:06.125 INFO:tasks.rados.rados.0.trial082.stdout:3402: done (0 left) 2026-02-12T17:43:06.125 INFO:tasks.rados.rados.0.trial082.stdout:3403: write (excl) oid 24 current snap is 375 2026-02-12T17:43:06.125 INFO:tasks.rados.rados.0.trial082.stdout:3403: seq_num 1162 ranges {729734=724994,2197488=430392,3227047=302687} 2026-02-12T17:43:06.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: writing trial08226312-24 from 729734 to 1454728 tid 1 2026-02-12T17:43:06.134 INFO:tasks.rados.rados.0.trial082.stdout:3403: writing trial08226312-24 from 2197488 to 2627880 tid 2 2026-02-12T17:43:06.138 INFO:tasks.rados.rados.0.trial082.stdout:3403: writing trial08226312-24 from 3227047 to 3529734 tid 3 2026-02-12T17:43:06.138 INFO:tasks.rados.rados.0.trial082.stdout:3404: snap_remove snap 368 2026-02-12T17:43:07.129 INFO:tasks.rados.rados.0.trial082.stdout:3404: done (1 left) 2026-02-12T17:43:07.129 INFO:tasks.rados.rados.0.trial082.stdout:3405: read oid 33 snap 344 2026-02-12T17:43:07.129 INFO:tasks.rados.rados.0.trial082.stdout:3405: expect (ObjNum 916 snap 288 seq_num 916) 2026-02-12T17:43:07.129 INFO:tasks.rados.rados.0.trial082.stdout:3406: read oid 47 snap -1 2026-02-12T17:43:07.129 INFO:tasks.rados.rados.0.trial082.stdout:3406: expect (ObjNum 1091 snap 345 seq_num 1091) 2026-02-12T17:43:07.129 INFO:tasks.rados.rados.0.trial082.stdout:3407: snap_create 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: finishing write tid 1 to trial08226312-24 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: finishing write tid 2 to trial08226312-24 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: finishing write tid 3 to trial08226312-24 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: finishing write tid 4 to trial08226312-24 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: finishing write tid 5 to trial08226312-24 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: oid 24 updating version 0 to 2562 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: oid 24 version 2562 is already newer than 2560 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: oid 24 updating version 2562 to 2563 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: oid 24 version 2563 is already newer than 2561 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 2563 (ObjNum 1162 snap 375 seq_num 1162) dirty exists 2026-02-12T17:43:07.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: left oid 24 (ObjNum 1162 snap 375 seq_num 1162) 2026-02-12T17:43:07.131 INFO:tasks.rados.rados.0.trial082.stdout:3406: expect (ObjNum 1091 snap 345 seq_num 1091) 2026-02-12T17:43:07.160 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:07.212 INFO:tasks.rados.rados.0.trial082.stdout:3405: expect (ObjNum 916 snap 288 seq_num 916) 2026-02-12T17:43:07.212 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:07.245 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:08.130 INFO:tasks.rados.rados.0.trial082.stdout:3403: done (3 left) 2026-02-12T17:43:08.131 INFO:tasks.rados.rados.0.trial082.stdout:3405: done (2 left) 2026-02-12T17:43:08.131 INFO:tasks.rados.rados.0.trial082.stdout:3406: done (1 left) 2026-02-12T17:43:08.131 INFO:tasks.rados.rados.0.trial082.stdout:3407: done (0 left) 2026-02-12T17:43:08.131 INFO:tasks.rados.rados.0.trial082.stdout:3408: copy_from oid 29 from oid 14 current snap is 376 2026-02-12T17:43:08.131 INFO:tasks.rados.rados.0.trial082.stdout:3409: write (excl) oid 43 current snap is 376 2026-02-12T17:43:08.131 INFO:tasks.rados.rados.0.trial082.stdout:3409: seq_num 1163 ranges {746541=400243,1739617=690403,3138117=408424} 2026-02-12T17:43:08.134 INFO:tasks.rados.rados.0.trial082.stdout:3409: writing trial08226312-43 from 746541 to 1146784 tid 1 2026-02-12T17:43:08.139 INFO:tasks.rados.rados.0.trial082.stdout:3409: writing trial08226312-43 from 1739617 to 2430020 tid 2 2026-02-12T17:43:08.144 INFO:tasks.rados.rados.0.trial082.stdout:3409: writing trial08226312-43 from 3138117 to 3546541 tid 3 2026-02-12T17:43:08.145 INFO:tasks.rados.rados.0.trial082.stdout:3410: rollback oid 22 current snap is 376 2026-02-12T17:43:08.145 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 347 2026-02-12T17:43:08.145 INFO:tasks.rados.rados.0.trial082.stdout:3408: finishing copy_from racing read to trial08226312-29 2026-02-12T17:43:08.145 INFO:tasks.rados.rados.0.trial082.stdout:3408: finishing copy_from to trial08226312-29 2026-02-12T17:43:08.145 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2393 (ObjNum 1141 snap 359 seq_num 1141) dirty exists 2026-02-12T17:43:08.145 INFO:tasks.rados.rados.0.trial082.stdout:3409: finishing write tid 1 to trial08226312-43 2026-02-12T17:43:08.145 INFO:tasks.rados.rados.0.trial082.stdout:3409: finishing write tid 2 to trial08226312-43 2026-02-12T17:43:08.145 INFO:tasks.rados.rados.0.trial082.stdout:3408: done (2 left) 2026-02-12T17:43:08.146 INFO:tasks.rados.rados.0.trial082.stdout:3411: copy_from oid 30 from oid 44 current snap is 376 2026-02-12T17:43:08.146 INFO:tasks.rados.rados.0.trial082.stdout:3412: read oid 41 snap -1 2026-02-12T17:43:08.146 INFO:tasks.rados.rados.0.trial082.stdout:3412: expect (ObjNum 1071 snap 338 seq_num 1071) 2026-02-12T17:43:08.146 INFO:tasks.rados.rados.0.trial082.stdout:3413: copy_from oid 17 from oid 15 current snap is 376 2026-02-12T17:43:08.146 INFO:tasks.rados.rados.0.trial082.stdout:3414: copy_from oid 38 from oid 46 current snap is 376 2026-02-12T17:43:08.146 INFO:tasks.rados.rados.0.trial082.stdout:3415: snap_remove snap 370 2026-02-12T17:43:09.164 INFO:tasks.rados.rados.0.trial082.stdout:3415: done (6 left) 2026-02-12T17:43:09.165 INFO:tasks.rados.rados.0.trial082.stdout:3416: delete oid 49 current snap is 376 2026-02-12T17:43:09.165 INFO:tasks.rados.rados.0.trial082.stdout:3409: finishing write tid 3 to trial08226312-43 2026-02-12T17:43:09.165 INFO:tasks.rados.rados.0.trial082.stdout:3413: finishing copy_from to trial08226312-17 2026-02-12T17:43:09.165 INFO:tasks.rados.rados.0.trial082.stdout:3413: got expected ENOENT (src dne) 2026-02-12T17:43:09.165 INFO:tasks.rados.rados.0.trial082.stdout:3413: finishing copy_from racing read to trial08226312-17 2026-02-12T17:43:09.165 INFO:tasks.rados.rados.0.trial082.stdout:3412: expect (ObjNum 1071 snap 338 seq_num 1071) 2026-02-12T17:43:09.203 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1865766 2026-02-12T17:43:09.205 INFO:tasks.rados.rados.0.trial082.stdout:3409: finishing write tid 4 to trial08226312-43 2026-02-12T17:43:09.205 INFO:tasks.rados.rados.0.trial082.stdout:3409: finishing write tid 5 to trial08226312-43 2026-02-12T17:43:09.205 INFO:tasks.rados.rados.0.trial082.stdout:3409: oid 43 updating version 0 to 2287 2026-02-12T17:43:09.205 INFO:tasks.rados.rados.0.trial082.stdout:3409: oid 43 version 2287 is already newer than 2285 2026-02-12T17:43:09.205 INFO:tasks.rados.rados.0.trial082.stdout:3409: oid 43 version 2287 is already newer than 2286 2026-02-12T17:43:09.205 INFO:tasks.rados.rados.0.trial082.stdout:3409: oid 43 updating version 2287 to 2288 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2288 (ObjNum 1163 snap 376 seq_num 1163) dirty exists 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:3409: left oid 43 (ObjNum 1163 snap 376 seq_num 1163) 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:3410: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:3409: done (6 left) 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:3412: done (5 left) 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:3413: done (4 left) 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:3416: done (3 left) 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:3417: copy_from oid 19 from oid 24 current snap is 376 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:3410: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:3410: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:43:09.206 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2291 (ObjNum 1084 snap 341 seq_num 1084) dirty exists 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:3414: finishing copy_from racing read to trial08226312-38 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:3414: finishing copy_from to trial08226312-38 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 2348 (ObjNum 1147 snap 365 seq_num 1147) dirty exists 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:3411: finishing copy_from racing read to trial08226312-30 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:3411: finishing copy_from to trial08226312-30 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2447 (ObjNum 851 snap 268 seq_num 851) dirty exists 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:3410: done (3 left) 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:3411: done (2 left) 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:3414: done (1 left) 2026-02-12T17:43:09.207 INFO:tasks.rados.rados.0.trial082.stdout:3418: write (excl) oid 23 current snap is 376 2026-02-12T17:43:09.208 INFO:tasks.rados.rados.0.trial082.stdout:3418: seq_num 1165 ranges {780155=667094,1972934=694072,3309316=270839} 2026-02-12T17:43:09.209 INFO:tasks.rados.rados.0.trial082.stdout:3418: writing trial08226312-23 from 780155 to 1447249 tid 1 2026-02-12T17:43:09.214 INFO:tasks.rados.rados.0.trial082.stdout:3418: writing trial08226312-23 from 1972934 to 2667006 tid 2 2026-02-12T17:43:09.218 INFO:tasks.rados.rados.0.trial082.stdout:3418: writing trial08226312-23 from 3309316 to 3580155 tid 3 2026-02-12T17:43:09.218 INFO:tasks.rados.rados.0.trial082.stdout:3419: copy_from oid 22 from oid 1 current snap is 376 2026-02-12T17:43:09.218 INFO:tasks.rados.rados.0.trial082.stdout:3417: finishing copy_from racing read to trial08226312-19 2026-02-12T17:43:09.218 INFO:tasks.rados.rados.0.trial082.stdout:3417: finishing copy_from to trial08226312-19 2026-02-12T17:43:09.218 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 2563 (ObjNum 1162 snap 375 seq_num 1162) dirty exists 2026-02-12T17:43:09.218 INFO:tasks.rados.rados.0.trial082.stdout:3418: finishing write tid 1 to trial08226312-23 2026-02-12T17:43:09.219 INFO:tasks.rados.rados.0.trial082.stdout:3418: finishing write tid 2 to trial08226312-23 2026-02-12T17:43:09.219 INFO:tasks.rados.rados.0.trial082.stdout:3417: done (2 left) 2026-02-12T17:43:09.219 INFO:tasks.rados.rados.0.trial082.stdout:3420: write oid 35 current snap is 376 2026-02-12T17:43:09.219 INFO:tasks.rados.rados.0.trial082.stdout:3420: seq_num 1166 ranges {796962=742343,2031416=437730,2936739=413167} 2026-02-12T17:43:09.223 INFO:tasks.rados.rados.0.trial082.stdout:3420: writing trial08226312-35 from 796962 to 1539305 tid 1 2026-02-12T17:43:09.226 INFO:tasks.rados.rados.0.trial082.stdout:3420: writing trial08226312-35 from 2031416 to 2469146 tid 2 2026-02-12T17:43:09.230 INFO:tasks.rados.rados.0.trial082.stdout:3420: writing trial08226312-35 from 2936739 to 3349906 tid 3 2026-02-12T17:43:09.230 INFO:tasks.rados.rados.0.trial082.stdout:3421: snap_create 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:3418: finishing write tid 3 to trial08226312-23 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:3418: finishing write tid 4 to trial08226312-23 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:3418: finishing write tid 5 to trial08226312-23 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:3418: oid 23 updating version 0 to 2448 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:3418: oid 23 updating version 2448 to 2451 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:3418: oid 23 version 2451 is already newer than 2450 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:3418: oid 23 version 2451 is already newer than 2449 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 2451 (ObjNum 1165 snap 376 seq_num 1165) dirty exists 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:3418: left oid 23 (ObjNum 1165 snap 376 seq_num 1165) 2026-02-12T17:43:09.231 INFO:tasks.rados.rados.0.trial082.stdout:3419: finishing copy_from racing read to trial08226312-22 2026-02-12T17:43:09.232 INFO:tasks.rados.rados.0.trial082.stdout:3419: finishing copy_from to trial08226312-22 2026-02-12T17:43:09.232 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2440 (ObjNum 1103 snap 346 seq_num 1103) dirty exists 2026-02-12T17:43:09.232 INFO:tasks.rados.rados.0.trial082.stdout:3420: finishing write tid 1 to trial08226312-35 2026-02-12T17:43:09.232 INFO:tasks.rados.rados.0.trial082.stdout:3420: finishing write tid 2 to trial08226312-35 2026-02-12T17:43:09.233 INFO:tasks.rados.rados.0.trial082.stdout:3420: finishing write tid 3 to trial08226312-35 2026-02-12T17:43:09.233 INFO:tasks.rados.rados.0.trial082.stdout:3420: finishing write tid 4 to trial08226312-35 2026-02-12T17:43:09.233 INFO:tasks.rados.rados.0.trial082.stdout:3420: finishing write tid 5 to trial08226312-35 2026-02-12T17:43:09.233 INFO:tasks.rados.rados.0.trial082.stdout:3420: oid 35 updating version 0 to 2455 2026-02-12T17:43:09.233 INFO:tasks.rados.rados.0.trial082.stdout:3420: oid 35 version 2455 is already newer than 2453 2026-02-12T17:43:09.233 INFO:tasks.rados.rados.0.trial082.stdout:3420: oid 35 version 2455 is already newer than 2454 2026-02-12T17:43:09.233 INFO:tasks.rados.rados.0.trial082.stdout:3420: oid 35 version 2455 is already newer than 2452 2026-02-12T17:43:09.234 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 2455 (ObjNum 1166 snap 376 seq_num 1166) dirty exists 2026-02-12T17:43:09.234 INFO:tasks.rados.rados.0.trial082.stdout:3420: left oid 35 (ObjNum 1166 snap 376 seq_num 1166) 2026-02-12T17:43:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3418: done (3 left) 2026-02-12T17:43:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3419: done (2 left) 2026-02-12T17:43:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3420: done (1 left) 2026-02-12T17:43:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3421: done (0 left) 2026-02-12T17:43:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3422: read oid 43 snap -1 2026-02-12T17:43:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3422: expect (ObjNum 1163 snap 376 seq_num 1163) 2026-02-12T17:43:10.167 INFO:tasks.rados.rados.0.trial082.stdout:3423: delete oid 8 current snap is 377 2026-02-12T17:43:10.170 INFO:tasks.rados.rados.0.trial082.stdout:3423: done (1 left) 2026-02-12T17:43:10.170 INFO:tasks.rados.rados.0.trial082.stdout:3424: snap_remove snap 366 2026-02-12T17:43:11.168 INFO:tasks.rados.rados.0.trial082.stdout:3424: done (1 left) 2026-02-12T17:43:11.168 INFO:tasks.rados.rados.0.trial082.stdout:3425: rollback oid 13 current snap is 377 2026-02-12T17:43:11.169 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 349 2026-02-12T17:43:11.169 INFO:tasks.rados.rados.0.trial082.stdout:3422: expect (ObjNum 1163 snap 376 seq_num 1163) 2026-02-12T17:43:11.169 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:11.280 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2037518 2026-02-12T17:43:11.374 INFO:tasks.rados.rados.0.trial082.stdout:3425: finishing rollback tid 0 to trial08226312-13 2026-02-12T17:43:11.374 INFO:tasks.rados.rados.0.trial082.stdout:3425: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:43:11.374 INFO:tasks.rados.rados.0.trial082.stdout:3425: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:43:11.374 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2236 (ObjNum 1096 snap 345 seq_num 1096) dirty exists 2026-02-12T17:43:11.374 INFO:tasks.rados.rados.0.trial082.stdout:3422: done (1 left) 2026-02-12T17:43:11.375 INFO:tasks.rados.rados.0.trial082.stdout:3425: done (0 left) 2026-02-12T17:43:11.375 INFO:tasks.rados.rados.0.trial082.stdout:3426: read oid 19 snap -1 2026-02-12T17:43:11.375 INFO:tasks.rados.rados.0.trial082.stdout:3426: expect (ObjNum 1162 snap 375 seq_num 1162) 2026-02-12T17:43:11.375 INFO:tasks.rados.rados.0.trial082.stdout:3427: copy_from oid 43 from oid 47 current snap is 377 2026-02-12T17:43:11.375 INFO:tasks.rados.rados.0.trial082.stdout:3428: read oid 26 snap -1 2026-02-12T17:43:11.375 INFO:tasks.rados.rados.0.trial082.stdout:3428: expect (ObjNum 987 snap 304 seq_num 987) 2026-02-12T17:43:11.375 INFO:tasks.rados.rados.0.trial082.stdout:3429: write (excl) oid 49 current snap is 377 2026-02-12T17:43:11.375 INFO:tasks.rados.rados.0.trial082.stdout:3429: seq_num 1168 ranges {430576=492841,1632027=441399,2475232=435711,3365397=265179} 2026-02-12T17:43:11.376 INFO:tasks.rados.rados.0.trial082.stdout:3429: writing trial08226312-49 from 430576 to 923417 tid 1 2026-02-12T17:43:11.381 INFO:tasks.rados.rados.0.trial082.stdout:3429: writing trial08226312-49 from 1632027 to 2073426 tid 2 2026-02-12T17:43:11.384 INFO:tasks.rados.rados.0.trial082.stdout:3429: writing trial08226312-49 from 2475232 to 2910943 tid 3 2026-02-12T17:43:11.386 INFO:tasks.rados.rados.0.trial082.stdout:3429: writing trial08226312-49 from 3365397 to 3630576 tid 4 2026-02-12T17:43:11.387 INFO:tasks.rados.rados.0.trial082.stdout:3430: snap_remove snap 329 2026-02-12T17:43:12.173 INFO:tasks.rados.rados.0.trial082.stdout:3430: done (4 left) 2026-02-12T17:43:12.173 INFO:tasks.rados.rados.0.trial082.stdout:3431: delete oid 20 current snap is 377 2026-02-12T17:43:12.173 INFO:tasks.rados.rados.0.trial082.stdout:3428: expect (ObjNum 987 snap 304 seq_num 987) 2026-02-12T17:43:12.288 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1740821 2026-02-12T17:43:12.305 INFO:tasks.rados.rados.0.trial082.stdout:3426: expect (ObjNum 1162 snap 375 seq_num 1162) 2026-02-12T17:43:12.313 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3011821 2026-02-12T17:43:12.320 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:12.355 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2574632 2026-02-12T17:43:12.363 INFO:tasks.rados.rados.0.trial082.stdout:3429: finishing write tid 1 to trial08226312-49 2026-02-12T17:43:12.363 INFO:tasks.rados.rados.0.trial082.stdout:3426: done (4 left) 2026-02-12T17:43:12.363 INFO:tasks.rados.rados.0.trial082.stdout:3428: done (3 left) 2026-02-12T17:43:12.363 INFO:tasks.rados.rados.0.trial082.stdout:3431: done (2 left) 2026-02-12T17:43:12.363 INFO:tasks.rados.rados.0.trial082.stdout:3432: copy_from oid 10 from oid 13 current snap is 377 2026-02-12T17:43:12.363 INFO:tasks.rados.rados.0.trial082.stdout:3427: finishing copy_from racing read to trial08226312-43 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:3429: finishing write tid 2 to trial08226312-49 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:3427: finishing copy_from to trial08226312-43 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2399 (ObjNum 1091 snap 345 seq_num 1091) dirty exists 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:3429: finishing write tid 3 to trial08226312-49 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:3429: finishing write tid 4 to trial08226312-49 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:3429: finishing write tid 5 to trial08226312-49 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:3429: finishing write tid 6 to trial08226312-49 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:3429: oid 49 updating version 0 to 2227 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:3429: oid 49 updating version 2227 to 2229 2026-02-12T17:43:12.364 INFO:tasks.rados.rados.0.trial082.stdout:3429: oid 49 updating version 2229 to 2230 2026-02-12T17:43:12.365 INFO:tasks.rados.rados.0.trial082.stdout:3429: oid 49 version 2230 is already newer than 2228 2026-02-12T17:43:12.365 INFO:tasks.rados.rados.0.trial082.stdout:3429: oid 49 updating version 2230 to 2231 2026-02-12T17:43:12.365 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 2231 (ObjNum 1168 snap 377 seq_num 1168) dirty exists 2026-02-12T17:43:12.365 INFO:tasks.rados.rados.0.trial082.stdout:3429: left oid 49 (ObjNum 1168 snap 377 seq_num 1168) 2026-02-12T17:43:12.365 INFO:tasks.rados.rados.0.trial082.stdout:3427: done (2 left) 2026-02-12T17:43:12.365 INFO:tasks.rados.rados.0.trial082.stdout:3429: done (1 left) 2026-02-12T17:43:12.365 INFO:tasks.rados.rados.0.trial082.stdout:3433: delete oid 18 current snap is 377 2026-02-12T17:43:12.366 INFO:tasks.rados.rados.0.trial082.stdout:3433: done (1 left) 2026-02-12T17:43:12.366 INFO:tasks.rados.rados.0.trial082.stdout:3434: write oid 21 current snap is 377 2026-02-12T17:43:12.366 INFO:tasks.rados.rados.0.trial082.stdout:3434: seq_num 1171 ranges {480997=434941,1407473=705079,2557501=785880} 2026-02-12T17:43:12.367 INFO:tasks.rados.rados.0.trial082.stdout:3434: writing trial08226312-21 from 480997 to 915938 tid 1 2026-02-12T17:43:12.372 INFO:tasks.rados.rados.0.trial082.stdout:3434: writing trial08226312-21 from 1407473 to 2112552 tid 2 2026-02-12T17:43:12.377 INFO:tasks.rados.rados.0.trial082.stdout:3434: writing trial08226312-21 from 2557501 to 3343381 tid 3 2026-02-12T17:43:12.377 INFO:tasks.rados.rados.0.trial082.stdout:3435: rollback oid 39 current snap is 377 2026-02-12T17:43:12.377 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 39 to 344 2026-02-12T17:43:12.378 INFO:tasks.rados.rados.0.trial082.stdout:3432: finishing copy_from racing read to trial08226312-10 2026-02-12T17:43:12.378 INFO:tasks.rados.rados.0.trial082.stdout:3434: finishing write tid 1 to trial08226312-21 2026-02-12T17:43:12.378 INFO:tasks.rados.rados.0.trial082.stdout:3432: finishing copy_from to trial08226312-10 2026-02-12T17:43:12.378 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2236 (ObjNum 1096 snap 345 seq_num 1096) dirty exists 2026-02-12T17:43:12.378 INFO:tasks.rados.rados.0.trial082.stdout:3434: finishing write tid 2 to trial08226312-21 2026-02-12T17:43:12.378 INFO:tasks.rados.rados.0.trial082.stdout:3432: done (2 left) 2026-02-12T17:43:12.378 INFO:tasks.rados.rados.0.trial082.stdout:3436: delete oid 5 current snap is 377 2026-02-12T17:43:12.379 INFO:tasks.rados.rados.0.trial082.stdout:3434: finishing write tid 3 to trial08226312-21 2026-02-12T17:43:12.379 INFO:tasks.rados.rados.0.trial082.stdout:3436: done (2 left) 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:3437: snap_create 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:3435: finishing rollback tid 0 to trial08226312-39 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:3434: finishing write tid 4 to trial08226312-21 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:3434: finishing write tid 5 to trial08226312-21 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:3434: oid 21 updating version 0 to 2449 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:3434: oid 21 updating version 2449 to 2450 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:3434: oid 21 updating version 2450 to 2451 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:3434: oid 21 version 2451 is already newer than 2448 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 2451 (ObjNum 1171 snap 377 seq_num 1171) dirty exists 2026-02-12T17:43:12.380 INFO:tasks.rados.rados.0.trial082.stdout:3434: left oid 21 (ObjNum 1171 snap 377 seq_num 1171) 2026-02-12T17:43:12.381 INFO:tasks.rados.rados.0.trial082.stdout:3435: finishing rollback tid 1 to trial08226312-39 2026-02-12T17:43:12.381 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 2250 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:43:13.116 INFO:tasks.rados.rados.0.trial082.stdout:3434: done (2 left) 2026-02-12T17:43:13.117 INFO:tasks.rados.rados.0.trial082.stdout:3435: done (1 left) 2026-02-12T17:43:13.117 INFO:tasks.rados.rados.0.trial082.stdout:3437: done (0 left) 2026-02-12T17:43:13.117 INFO:tasks.rados.rados.0.trial082.stdout:3438: delete oid 22 current snap is 378 2026-02-12T17:43:13.119 INFO:tasks.rados.rados.0.trial082.stdout:3438: done (0 left) 2026-02-12T17:43:13.119 INFO:tasks.rados.rados.0.trial082.stdout:3439: snap_remove snap 348 2026-02-12T17:43:14.119 INFO:tasks.rados.rados.0.trial082.stdout:3439: done (0 left) 2026-02-12T17:43:14.120 INFO:tasks.rados.rados.0.trial082.stdout:3440: rollback oid 41 current snap is 378 2026-02-12T17:43:14.120 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 376 2026-02-12T17:43:14.120 INFO:tasks.rados.rados.0.trial082.stdout:3441: write oid 29 current snap is 378 2026-02-12T17:43:14.120 INFO:tasks.rados.rados.0.trial082.stdout:3441: seq_num 1174 ranges {531418=660688,1982919=452406,3039770=691648} 2026-02-12T17:43:14.124 INFO:tasks.rados.rados.0.trial082.stdout:3441: writing trial08226312-29 from 531418 to 1192106 tid 1 2026-02-12T17:43:14.129 INFO:tasks.rados.rados.0.trial082.stdout:3441: writing trial08226312-29 from 1982919 to 2435325 tid 2 2026-02-12T17:43:14.133 INFO:tasks.rados.rados.0.trial082.stdout:3441: writing trial08226312-29 from 3039770 to 3731418 tid 3 2026-02-12T17:43:14.133 INFO:tasks.rados.rados.0.trial082.stdout:3442: write (excl) oid 14 current snap is 378 2026-02-12T17:43:14.134 INFO:tasks.rados.rados.0.trial082.stdout:3440: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:43:14.134 INFO:tasks.rados.rados.0.trial082.stdout:3442: seq_num 1175 ranges {548225=735937,1925048=596064,2950840=547321} 2026-02-12T17:43:14.138 INFO:tasks.rados.rados.0.trial082.stdout:3442: writing trial08226312-14 from 548225 to 1284162 tid 1 2026-02-12T17:43:14.142 INFO:tasks.rados.rados.0.trial082.stdout:3442: writing trial08226312-14 from 1925048 to 2521112 tid 2 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3442: writing trial08226312-14 from 2950840 to 3498161 tid 3 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3443: rollback oid 44 current snap is 378 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 369 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3440: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3440: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 2379 (ObjNum 1071 snap 338 seq_num 1071) dirty exists 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3441: finishing write tid 1 to trial08226312-29 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3441: finishing write tid 2 to trial08226312-29 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3441: finishing write tid 3 to trial08226312-29 2026-02-12T17:43:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3441: finishing write tid 4 to trial08226312-29 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3441: finishing write tid 5 to trial08226312-29 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3441: oid 29 updating version 0 to 2396 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3441: oid 29 version 2396 is already newer than 2395 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3441: oid 29 updating version 2396 to 2397 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3441: oid 29 version 2397 is already newer than 2394 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2397 (ObjNum 1174 snap 378 seq_num 1174) dirty exists 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3441: left oid 29 (ObjNum 1174 snap 378 seq_num 1174) 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3442: finishing write tid 1 to trial08226312-14 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3442: finishing write tid 2 to trial08226312-14 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3440: done (3 left) 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3441: done (2 left) 2026-02-12T17:43:14.148 INFO:tasks.rados.rados.0.trial082.stdout:3444: snap_remove snap 365 2026-02-12T17:43:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3444: done (2 left) 2026-02-12T17:43:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3445: copy_from oid 8 from oid 47 current snap is 378 2026-02-12T17:43:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3442: finishing write tid 3 to trial08226312-14 2026-02-12T17:43:15.123 INFO:tasks.rados.rados.0.trial082.stdout:3442: finishing write tid 4 to trial08226312-14 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3442: finishing write tid 5 to trial08226312-14 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3442: oid 14 updating version 0 to 2402 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3442: oid 14 version 2402 is already newer than 2400 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3442: oid 14 version 2402 is already newer than 2399 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3442: oid 14 version 2402 is already newer than 2401 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 2402 (ObjNum 1175 snap 378 seq_num 1175) dirty exists 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3442: left oid 14 (ObjNum 1175 snap 378 seq_num 1175) 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3443: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3443: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:3443: finishing rollback tid 2 to trial08226312-44 2026-02-12T17:43:15.124 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2458 (ObjNum 851 snap 268 seq_num 851) dirty exists 2026-02-12T17:43:15.125 INFO:tasks.rados.rados.0.trial082.stdout:3442: done (2 left) 2026-02-12T17:43:15.125 INFO:tasks.rados.rados.0.trial082.stdout:3443: done (1 left) 2026-02-12T17:43:15.125 INFO:tasks.rados.rados.0.trial082.stdout:3446: delete oid 25 current snap is 378 2026-02-12T17:43:15.125 INFO:tasks.rados.rados.0.trial082.stdout:3446: done (1 left) 2026-02-12T17:43:15.126 INFO:tasks.rados.rados.0.trial082.stdout:3447: read oid 46 snap 354 2026-02-12T17:43:15.126 INFO:tasks.rados.rados.0.trial082.stdout:3447: expect deleted 2026-02-12T17:43:15.126 INFO:tasks.rados.rados.0.trial082.stdout:3448: delete oid 50 current snap is 378 2026-02-12T17:43:15.128 INFO:tasks.rados.rados.0.trial082.stdout:3445: finishing copy_from racing read to trial08226312-8 2026-02-12T17:43:15.128 INFO:tasks.rados.rados.0.trial082.stdout:3447: done (2 left) 2026-02-12T17:43:15.129 INFO:tasks.rados.rados.0.trial082.stdout:3448: done (1 left) 2026-02-12T17:43:15.129 INFO:tasks.rados.rados.0.trial082.stdout:3449: copy_from oid 30 from oid 46 current snap is 378 2026-02-12T17:43:15.129 INFO:tasks.rados.rados.0.trial082.stdout:3450: snap_create 2026-02-12T17:43:15.129 INFO:tasks.rados.rados.0.trial082.stdout:3445: finishing copy_from to trial08226312-8 2026-02-12T17:43:15.129 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 2399 (ObjNum 1091 snap 345 seq_num 1091) dirty exists 2026-02-12T17:43:15.135 INFO:tasks.rados.rados.0.trial082.stdout:3449: finishing copy_from racing read to trial08226312-30 2026-02-12T17:43:15.137 INFO:tasks.rados.rados.0.trial082.stdout:3449: finishing copy_from to trial08226312-30 2026-02-12T17:43:15.137 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2348 (ObjNum 1147 snap 365 seq_num 1147) dirty exists 2026-02-12T17:43:16.127 INFO:tasks.rados.rados.0.trial082.stdout:3445: done (2 left) 2026-02-12T17:43:16.127 INFO:tasks.rados.rados.0.trial082.stdout:3449: done (1 left) 2026-02-12T17:43:16.127 INFO:tasks.rados.rados.0.trial082.stdout:3450: done (0 left) 2026-02-12T17:43:16.127 INFO:tasks.rados.rados.0.trial082.stdout:3451: delete oid 39 current snap is 379 2026-02-12T17:43:16.129 INFO:tasks.rados.rados.0.trial082.stdout:3451: done (0 left) 2026-02-12T17:43:16.129 INFO:tasks.rados.rados.0.trial082.stdout:3452: write oid 49 current snap is 379 2026-02-12T17:43:16.129 INFO:tasks.rados.rados.0.trial082.stdout:3452: seq_num 1179 ranges {615453=753286,2158976=603402,3460532=354921} 2026-02-12T17:43:16.134 INFO:tasks.rados.rados.0.trial082.stdout:3452: writing trial08226312-49 from 615453 to 1368739 tid 1 2026-02-12T17:43:16.139 INFO:tasks.rados.rados.0.trial082.stdout:3452: writing trial08226312-49 from 2158976 to 2762378 tid 2 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:3452: writing trial08226312-49 from 3460532 to 3815453 tid 3 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:3453: rollback oid 9 current snap is 379 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 9 to 360 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:3452: finishing write tid 1 to trial08226312-49 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:3452: finishing write tid 2 to trial08226312-49 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:3454: read oid 19 snap -1 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:3454: expect (ObjNum 1162 snap 375 seq_num 1162) 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:3455: read oid 39 snap -1 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:3455: expect deleted 2026-02-12T17:43:16.144 INFO:tasks.rados.rados.0.trial082.stdout:3456: read oid 12 snap 354 2026-02-12T17:43:16.145 INFO:tasks.rados.rados.0.trial082.stdout:3456: expect (ObjNum 1074 snap 340 seq_num 1074) 2026-02-12T17:43:16.145 INFO:tasks.rados.rados.0.trial082.stdout:3457: snap_remove snap 362 2026-02-12T17:43:17.128 INFO:tasks.rados.rados.0.trial082.stdout:3457: done (5 left) 2026-02-12T17:43:17.129 INFO:tasks.rados.rados.0.trial082.stdout:3458: read oid 34 snap 341 2026-02-12T17:43:17.129 INFO:tasks.rados.rados.0.trial082.stdout:3458: expect (ObjNum 842 snap 265 seq_num 842) 2026-02-12T17:43:17.129 INFO:tasks.rados.rados.0.trial082.stdout:3459: snap_remove snap 334 2026-02-12T17:43:17.552 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:43:17.553 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:43:17.553 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T17:43:17.553 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T17:43:17.562 INFO:tasks.ceph.mon.c:Started 2026-02-12T17:43:17.562 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:43:17.563 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:43:17.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.630+0000 7f530941b640 10 monclient: get_monmap_and_config 2026-02-12T17:43:17.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.630+0000 7f530941b640 10 monclient: build_initial_monmap 2026-02-12T17:43:17.627 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.630+0000 7f530941b640 10 monclient: monmap: 2026-02-12T17:43:17.627 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:17.627 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.627 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:17.631368+0000 2026-02-12T17:43:17.628 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:17.631368+0000 2026-02-12T17:43:17.628 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:17.628 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.628 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:17.628 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:17.628 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:17.628 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.629 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.630+0000 7f530941b640 1 Processor -- start 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.630+0000 7f530941b640 1 -- start start 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.630+0000 7f530941b640 10 monclient: init 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 10 monclient(hunting): picked mon.noname-c con 0x7f5304088b20 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 10 monclient(hunting): picked mon.noname-b con 0x7f530408a960 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 10 monclient(hunting): picked mon.noname-a con 0x7f5304089600 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530408a0d0 con 0x7f5304089600 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530408ba10 con 0x7f5304088b20 2026-02-12T17:43:17.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530408b170 con 0x7f530408a960 2026-02-12T17:43:17.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:17.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f530941b640 10 monclient(hunting): authenticate will time out at 1477.450288s 2026-02-12T17:43:17.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f53037fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f5304089600 0x7f53041a20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46758/0 (socket says 10.20.193.57:46758) 2026-02-12T17:43:17.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.631+0000 7f53037fe640 1 -- 10.20.193.57:0/1405533328 learned_addr learned my addr 10.20.193.57:0/1405533328 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:17.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f53037fe640 1 -- 10.20.193.57:0/1405533328 >> v1:10.20.193.57:6789/0 conn(0x7f5304089600 legacy=0x7f53041a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 1 -- 10.20.193.57:0/1405533328 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669767179 0 0) 0x7f530408a0d0 con 0x7f5304089600 2026-02-12T17:43:17.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient(hunting): my global_id is 74349 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 1 -- 10.20.193.57:0/1405533328 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52f00035e0 con 0x7f5304089600 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5302ffd640 1 -- 10.20.193.57:0/1405533328 >> v1:10.20.193.82:6789/0 conn(0x7f5304088b20 legacy=0x7f5304088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 1 -- 10.20.193.57:0/1405533328 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2006862160 0 0) 0x7f52f00035e0 con 0x7f5304089600 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 1 -- 10.20.193.57:0/1405533328 >> v1:10.20.193.57:6790/0 conn(0x7f530408a960 legacy=0x7f53041809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 1 -- 10.20.193.57:0/1405533328 >> v1:10.20.193.82:6789/0 conn(0x7f5304088b20 legacy=0x7f5304088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 1 monclient: found mon.noname-a 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 1 -- 10.20.193.57:0/1405533328 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53040574f0 con 0x7f5304089600 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient: _finish_auth 0 2026-02-12T17:43:17.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 1 -- 10.20.193.57:0/1405533328 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52f4004230 con 0x7f5304089600 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f530941b640 5 monclient: authenticate success, global_id 74349 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f530941b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f5301ffb640 10 monclient: dump: 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.637 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.633+0000 7f530941b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f5301ffb640 1 -- 10.20.193.57:0/1405533328 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52f40044f0 con 0x7f5304089600 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f5301ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f5301ffb640 1 -- 10.20.193.57:0/1405533328 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52f4005bf0 con 0x7f5304089600 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:17.638 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 4 set_mon_vals no callback set 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f5301ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f5301ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f5301ffb640 10 monclient: dump: 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.639 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 10 monclient: shutdown 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 1 -- 10.20.193.57:0/1405533328 >> v1:10.20.193.57:6789/0 conn(0x7f5304089600 legacy=0x7f53041a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 1 -- 10.20.193.57:0/1405533328 shutdown_connections 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 1 -- 10.20.193.57:0/1405533328 >> 10.20.193.57:0/1405533328 conn(0x7f5304091620 msgr2=0x7f5304091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 1 -- 10.20.193.57:0/1405533328 shutdown_connections 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 1 -- 10.20.193.57:0/1405533328 wait complete. 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 10 monclient: build_initial_monmap 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.634+0000 7f530941b640 10 monclient: monmap: 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:17.640 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 1 Processor -- start 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 1 -- start start 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 10 monclient: init 2026-02-12T17:43:17.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 10 monclient(hunting): picked mon.noname-b con 0x7f5304088b20 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 10 monclient(hunting): picked mon.noname-c con 0x7f5304089600 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 10 monclient(hunting): picked mon.noname-a con 0x7f530408a960 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530411c2f0 con 0x7f530408a960 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530405cc10 con 0x7f5304088b20 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f530411d810 con 0x7f5304089600 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f530941b640 10 monclient(hunting): authenticate will time out at 1477.454404s 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f53037fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f530408a960 0x7f53040596e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46762/0 (socket says 10.20.193.57:46762) 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.635+0000 7f53037fe640 1 -- 10.20.193.57:0/3919624711 learned_addr learned my addr 10.20.193.57:0/3919624711 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:17.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.637+0000 7f53037fe640 1 -- 10.20.193.57:0/3919624711 >> v1:10.20.193.57:6789/0 conn(0x7f530408a960 legacy=0x7f53040596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.637+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:43:17.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.637+0000 7f5302ffd640 1 -- 10.20.193.57:0/3919624711 >> v1:10.20.193.82:6789/0 conn(0x7f5304088b20 legacy=0x7f53040588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.637+0000 7f53027fc640 1 -- 10.20.193.57:0/3919624711 >> v1:10.20.193.57:6790/0 conn(0x7f5304089600 legacy=0x7f5304058fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955820751 0 0) 0x7f530411c2f0 con 0x7f530408a960 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): my global_id is 74352 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52d00035e0 con 0x7f530408a960 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146137860 0 0) 0x7f530405cc10 con 0x7f5304088b20 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.647 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): my global_id is 5113 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f530411c2f0 con 0x7f5304088b20 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f53037fe640 1 --1- 10.20.193.57:0/3919624711 >> v1:10.20.193.57:6789/0 conn(0x7f530408a960 0x7f53040596e0 :-1 s=OPENED pgs=534 gs=3 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f52f4004230 mon_map magic: 0 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 903355746 0 0) 0x7f52d00035e0 con 0x7f530408a960 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f530405cc10 con 0x7f530408a960 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1871594091 0 0) 0x7f530411c2f0 con 0x7f5304088b20 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52d00035e0 con 0x7f5304088b20 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52f8003340 con 0x7f5304088b20 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): dump: 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.648 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52f4004230 con 0x7f530408a960 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:17.649 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 10 monclient(hunting): dump: 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.639+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3393538180 0 0) 0x7f52d00035e0 con 0x7f5304088b20 2026-02-12T17:43:17.650 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 >> v1:10.20.193.57:6790/0 conn(0x7f5304089600 legacy=0x7f5304058fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 >> v1:10.20.193.57:6789/0 conn(0x7f530408a960 legacy=0x7f53040596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 10 monclient: _finish_hunting 0 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 1 monclient: found mon.b 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530411daf0 con 0x7f5304088b20 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 10 monclient: _finish_auth 0 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 10 monclient: _check_auth_tickets 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 601381185 0 0) 0x7f530405cc10 con 0x7f530408a960 2026-02-12T17:43:17.651 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 5 monclient: authenticate success, global_id 5113 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 10 monclient: _renew_subs 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f530405aff0 con 0x7f5304088b20 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 10 monclient: _renew_subs 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f530411d530 con 0x7f5304088b20 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52f8003980 con 0x7f5304088b20 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f52f8003d10 con 0x7f5304088b20 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.652 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 10 monclient: dump: 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f53017fa640 4 set_mon_vals no callback set 2026-02-12T17:43:17.653 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:17.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:17.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:17.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53040008d0 con 0x7f5304088b20 2026-02-12T17:43:17.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.640+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f52f8003fa0 con 0x7f5304088b20 2026-02-12T17:43:17.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.641+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(761..761 src has 508..761) ==== 3975+0+0 (unknown 2951960395 0 0) 0x7f52f804ec30 con 0x7f5304088b20 2026-02-12T17:43:17.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.641+0000 7f53027fc640 10 monclient: get_auth_request con 0x7f52d003fab0 auth_method 0 2026-02-12T17:43:17.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.643+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f52f8016cb0 con 0x7f5304088b20 2026-02-12T17:43:17.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.643+0000 7f52e37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:17.654 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.643+0000 7f52e37fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:17.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.789+0000 7f530941b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:43:17.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.789+0000 7f530941b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:17.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.789+0000 7f530941b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:17.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.789+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f530408f520 con 0x7f5304088b20 2026-02-12T17:43:17.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.789+0000 7f52e37fe640 1 -- 10.20.193.57:0/3919624711 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 3327568228) 0x7f52f8016ad0 con 0x7f5304088b20 2026-02-12T17:43:17.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.789+0000 7f52e37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:17.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.789+0000 7f52e37fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:17.787 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:43:17.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.791+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 >> v1:10.20.193.82:6800/2441377515 conn(0x7f52d003fab0 legacy=0x7f52d005ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.791+0000 7f530941b640 10 monclient: shutdown 2026-02-12T17:43:17.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.791+0000 7f530941b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:17.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.791+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 >> v1:10.20.193.82:6789/0 conn(0x7f5304088b20 legacy=0x7f53040588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.791+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 shutdown_connections 2026-02-12T17:43:17.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.791+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 >> 10.20.193.57:0/3919624711 conn(0x7f5304091620 msgr2=0x7f530408c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:17.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.791+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 shutdown_connections 2026-02-12T17:43:17.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.791+0000 7f530941b640 1 -- 10.20.193.57:0/3919624711 wait complete. 2026-02-12T17:43:17.796 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:43:17.796 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:43:17.796 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:43:17.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.866+0000 7f89c79c2640 10 monclient: get_monmap_and_config 2026-02-12T17:43:17.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.866+0000 7f89c79c2640 10 monclient: build_initial_monmap 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.866+0000 7f89c79c2640 10 monclient: monmap: 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:17.867800+0000 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:17.867800+0000 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:17.864 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 1 Processor -- start 2026-02-12T17:43:17.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 1 -- start start 2026-02-12T17:43:17.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 10 monclient: init 2026-02-12T17:43:17.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:17.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:43:17.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 10 monclient(hunting): picked mon.noname-b con 0x7f89c008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:17.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 10 monclient(hunting): picked mon.noname-c con 0x7f89c008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:17.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 10 monclient(hunting): picked mon.noname-a con 0x7f89c0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:17.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c008a820 con 0x7f89c0182cc0 2026-02-12T17:43:17.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c0089450 con 0x7f89c008c620 2026-02-12T17:43:17.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c0089730 con 0x7f89c008c250 2026-02-12T17:43:17.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:17.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c79c2640 10 monclient(hunting): authenticate will time out at 1477.686675s 2026-02-12T17:43:17.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c5f38640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f89c0182cc0 0x7f89c01a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46790/0 (socket says 10.20.193.57:46790) 2026-02-12T17:43:17.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c5f38640 1 -- 10.20.193.57:0/3275811021 learned_addr learned my addr 10.20.193.57:0/3275811021 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:17.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.867+0000 7f89c5737640 1 --1- 10.20.193.57:0/3275811021 >> v1:10.20.193.57:6790/0 conn(0x7f89c008c250 0x7f89c008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45568/0 (socket says 10.20.193.57:45568) 2026-02-12T17:43:17.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.869+0000 7f89c5737640 1 -- 10.20.193.57:0/3275811021 >> v1:10.20.193.57:6790/0 conn(0x7f89c008c250 legacy=0x7f89c008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.869+0000 7f89c5f38640 1 -- 10.20.193.57:0/3275811021 >> v1:10.20.193.57:6789/0 conn(0x7f89c0182cc0 legacy=0x7f89c01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 -- 10.20.193.57:0/3275811021 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440432706 0 0) 0x7f89bc003c30 con 0x7f89c0182cc0 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient(hunting): my global_id is 74355 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 -- 10.20.193.57:0/3275811021 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a80035e0 con 0x7f89c0182cc0 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89c4f36640 1 -- 10.20.193.57:0/3275811021 >> v1:10.20.193.82:6789/0 conn(0x7f89c008c620 legacy=0x7f89c008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 -- 10.20.193.57:0/3275811021 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 94630276 0 0) 0x7f89a80035e0 con 0x7f89c0182cc0 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 -- 10.20.193.57:0/3275811021 >> v1:10.20.193.57:6790/0 conn(0x7f89c008c250 legacy=0x7f89c008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 -- 10.20.193.57:0/3275811021 >> v1:10.20.193.82:6789/0 conn(0x7f89c008c620 legacy=0x7f89c008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: _finish_hunting 0 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 monclient: found mon.noname-a 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 -- 10.20.193.57:0/3275811021 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c0089a10 con 0x7f89c0182cc0 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: _finish_auth 0 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: _check_auth_tickets 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 -- 10.20.193.57:0/3275811021 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89bc004270 con 0x7f89c0182cc0 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89c79c2640 5 monclient: authenticate success, global_id 74355 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89c79c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:17.877 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: dump: 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.878 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89c79c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 -- 10.20.193.57:0/3275811021 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89bc004570 con 0x7f89c0182cc0 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 1 -- 10.20.193.57:0/3275811021 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89bc005bf0 con 0x7f89c0182cc0 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89affff640 10 monclient: dump: 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.879 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89c79c2640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89c79c2640 4 set_mon_vals no callback set 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89c79c2640 10 monclient: shutdown 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89c79c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.870+0000 7f89c79c2640 1 -- 10.20.193.57:0/3275811021 >> v1:10.20.193.57:6789/0 conn(0x7f89c0182cc0 legacy=0x7f89c01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.871+0000 7f89c79c2640 1 -- 10.20.193.57:0/3275811021 shutdown_connections 2026-02-12T17:43:17.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.871+0000 7f89c79c2640 1 -- 10.20.193.57:0/3275811021 >> 10.20.193.57:0/3275811021 conn(0x7f89c00916b0 msgr2=0x7f89c0091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.871+0000 7f89c79c2640 1 -- 10.20.193.57:0/3275811021 shutdown_connections 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.871+0000 7f89c79c2640 1 -- 10.20.193.57:0/3275811021 wait complete. 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.871+0000 7f89c79c2640 10 monclient: build_initial_monmap 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.871+0000 7f89c79c2640 10 monclient: monmap: 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:17.881 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.871+0000 7f89c79c2640 1 Processor -- start 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.871+0000 7f89c79c2640 1 -- start start 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.871+0000 7f89c79c2640 10 monclient: init 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 10 monclient(hunting): picked mon.noname-c con 0x7f89c008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 10 monclient(hunting): picked mon.noname-a con 0x7f89c008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 10 monclient(hunting): picked mon.noname-b con 0x7f89c0182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c013e640 con 0x7f89c008c620 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c013bfc0 con 0x7f89c0182cc0 2026-02-12T17:43:17.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c013eb90 con 0x7f89c008c250 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c79c2640 10 monclient(hunting): authenticate will time out at 1477.691074s 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c4f36640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f89c008c620 0x7f89c0085e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46794/0 (socket says 10.20.193.57:46794) 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.872+0000 7f89c4f36640 1 -- 10.20.193.57:0/2323722995 learned_addr learned my addr 10.20.193.57:0/2323722995 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c4f36640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6789/0 conn(0x7f89c008c620 legacy=0x7f89c0085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c5737640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6790/0 conn(0x7f89c008c250 legacy=0x7f89c0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c5f38640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.82:6789/0 conn(0x7f89c0182cc0 legacy=0x7f89c0086540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836018778 0 0) 0x7f89c0089450 con 0x7f89c008c620 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): my global_id is 74358 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89900035e0 con 0x7f89c008c620 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008954456 0 0) 0x7f89c013eb90 con 0x7f89c008c250 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): my global_id is 104099 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c0089450 con 0x7f89c008c250 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 171718259 0 0) 0x7f89c013bfc0 con 0x7f89c0182cc0 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): my global_id is 5119 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c013eb90 con 0x7f89c0182cc0 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 247340774 0 0) 0x7f89900035e0 con 0x7f89c008c620 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c013bfc0 con 0x7f89c008c620 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89b40033e0 con 0x7f89c008c620 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): dump: 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.885 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 604267080 0 0) 0x7f89c0089450 con 0x7f89c008c250 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89900035e0 con 0x7f89c008c250 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89b0003370 con 0x7f89c008c250 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:17.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): dump: 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1379820222 0 0) 0x7f89c013eb90 con 0x7f89c0182cc0 2026-02-12T17:43:17.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c0089450 con 0x7f89c0182cc0 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89bc004410 con 0x7f89c0182cc0 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient(hunting): dump: 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.888 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1131176376 0 0) 0x7f89c013bfc0 con 0x7f89c008c620 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6790/0 conn(0x7f89c008c250 legacy=0x7f89c0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.82:6789/0 conn(0x7f89c0182cc0 legacy=0x7f89c0086540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient: _finish_hunting 0 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 monclient: found mon.a 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c00888a0 con 0x7f89c008c620 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient: _finish_auth 0 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 10 monclient: _check_auth_tickets 2026-02-12T17:43:17.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c79c2640 5 monclient: authenticate success, global_id 74358 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c79c2640 10 monclient: _renew_subs 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c79c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89c00871c0 con 0x7f89c008c620 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c79c2640 10 monclient: _renew_subs 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c79c2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.874+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f89c013c910 con 0x7f89c008c620 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89b4003980 con 0x7f89c008c620 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89adffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89b4003cd0 con 0x7f89c008c620 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89adffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89af7fe640 4 set_mon_vals no callback set 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89adffb640 10 monclient: dump: 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.891 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89c79c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f89c0090810 con 0x7f89c018d340 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f89b4003ee0 con 0x7f89c008c620 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(761..761 src has 508..761) ==== 3975+0+0 (unknown 2951960395 0 0) 0x7f89b404eb20 con 0x7f89c008c620 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.875+0000 7f89c5f38640 10 monclient: get_auth_request con 0x7f899003fea0 auth_method 0 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89c5737640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6789/0 conn(0x7f89c018d340 legacy=0x7f89c018d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677084036 0 0) 0x7f89c0090810 con 0x7f89c018d340 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 10 monclient(hunting): my global_id is 74361 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c013bfc0 con 0x7f89c018d340 2026-02-12T17:43:17.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2124986266 0 0) 0x7f89c013bfc0 con 0x7f89c018d340 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c0090810 con 0x7f89c018d340 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89b0004fe0 con 0x7f89c018d340 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.877+0000 7f89adffb640 10 monclient: dump: 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.893 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.878+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1436020556 0 0) 0x7f89c0090810 con 0x7f89c018d340 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.878+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89c013b320 con 0x7f89c018d340 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.878+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f89b0005460 con 0x7f89c018d340 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.878+0000 7f89adffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.878+0000 7f89adffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.878+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6789/0 conn(0x7f89c018d340 legacy=0x7f89c018d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.878+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6789/0 conn(0x7f89c018d340 legacy=0x7f89c018d710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:17.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.881+0000 7f89c79c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:43:17.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.881+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f89c008f580 con 0x7f89c018de20 2026-02-12T17:43:17.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89c5737640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6789/0 conn(0x7f89c018de20 legacy=0x7f89c0197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292005784 0 0) 0x7f89c008f580 con 0x7f89c018de20 2026-02-12T17:43:17.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 10 monclient(hunting): my global_id is 74364 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c0090810 con 0x7f89c018de20 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2962886816 0 0) 0x7f89c0090810 con 0x7f89c018de20 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c008f580 con 0x7f89c018de20 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f89b0005a80 con 0x7f89c018de20 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.883+0000 7f89adffb640 10 monclient: dump: 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.897 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1652794302 0 0) 0x7f89c008f580 con 0x7f89c018de20 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f89c0055340 con 0x7f89c018de20 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 874779907) 0x7f89b0005e20 con 0x7f89c018de20 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89adffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:43:17.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89adffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:17.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6789/0 conn(0x7f89c018de20 legacy=0x7f89c0197600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89adffb640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6789/0 conn(0x7f89c018de20 legacy=0x7f89c0197600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:17.899 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:43:17.899 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:17.899 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:17.899 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:43:17.899 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 58, 2026-02-12T17:43:17.899 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 324348, 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:17.900 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:17.901 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:43:17.902 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:43:17.903 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:43:17.904 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:17.905 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:43:17.906 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:17.907 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:17.908 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:43:17.909 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:43:17.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.82:6800/2441377515 conn(0x7f899003fea0 legacy=0x7f8990060350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89c79c2640 10 monclient: shutdown 2026-02-12T17:43:17.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89c79c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:17.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 >> v1:10.20.193.57:6789/0 conn(0x7f89c008c620 legacy=0x7f89c0085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89c5f38640 1 -- 10.20.193.57:0/2323722995 reap_dead start 2026-02-12T17:43:17.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 shutdown_connections 2026-02-12T17:43:17.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 >> 10.20.193.57:0/2323722995 conn(0x7f89c00916b0 msgr2=0x7f89c008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:17.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 shutdown_connections 2026-02-12T17:43:17.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.884+0000 7f89c79c2640 1 -- 10.20.193.57:0/2323722995 wait complete. 2026-02-12T17:43:17.911 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:43:17.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:43:17.912 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:43:17.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.978+0000 7fc1bc21b640 10 monclient: get_monmap_and_config 2026-02-12T17:43:17.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.978+0000 7fc1bc21b640 10 monclient: build_initial_monmap 2026-02-12T17:43:17.975 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.978+0000 7fc1bc21b640 10 monclient: monmap: 2026-02-12T17:43:17.975 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:17.975 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.975 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:17.979662+0000 2026-02-12T17:43:17.975 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:17.979662+0000 2026-02-12T17:43:17.976 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:17.976 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.976 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:17.976 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:17.976 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:17.976 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 1 Processor -- start 2026-02-12T17:43:17.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 1 -- start start 2026-02-12T17:43:17.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 10 monclient: init 2026-02-12T17:43:17.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:17.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:43:17.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 10 monclient(hunting): picked mon.noname-b con 0x7fc1b408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:17.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 10 monclient(hunting): picked mon.noname-a con 0x7fc1b408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:17.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 10 monclient(hunting): picked mon.noname-c con 0x7fc1b4182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:17.977 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b408a820 con 0x7fc1b408c620 2026-02-12T17:43:17.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b4089450 con 0x7fc1b4182cc0 2026-02-12T17:43:17.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b4089730 con 0x7fc1b408c250 2026-02-12T17:43:17.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:17.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1bc21b640 10 monclient(hunting): authenticate will time out at 1477.798553s 2026-02-12T17:43:17.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1b978f640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fc1b408c620 0x7fc1b408caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46820/0 (socket says 10.20.193.57:46820) 2026-02-12T17:43:17.978 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.979+0000 7fc1b978f640 1 -- 10.20.193.57:0/3416212327 learned_addr learned my addr 10.20.193.57:0/3416212327 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:17.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b978f640 1 -- 10.20.193.57:0/3416212327 >> v1:10.20.193.57:6789/0 conn(0x7fc1b408c620 legacy=0x7fc1b408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b9f90640 1 -- 10.20.193.57:0/3416212327 >> v1:10.20.193.57:6790/0 conn(0x7fc1b408c250 legacy=0x7fc1b408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1975784682 0 0) 0x7fc1a8002c20 con 0x7fc1b408c620 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 10 monclient(hunting): my global_id is 74367 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1ba791640 1 -- 10.20.193.57:0/3416212327 >> v1:10.20.193.82:6789/0 conn(0x7fc1b4182cc0 legacy=0x7fc1b41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc19c0035e0 con 0x7fc1b408c620 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188434748 0 0) 0x7fc1b4089730 con 0x7fc1b408c250 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 10 monclient(hunting): my global_id is 104102 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.981+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1a8002c20 con 0x7fc1b408c250 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3261114626 0 0) 0x7fc19c0035e0 con 0x7fc1b408c620 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 >> v1:10.20.193.57:6790/0 conn(0x7fc1b408c250 legacy=0x7fc1b408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 >> v1:10.20.193.82:6789/0 conn(0x7fc1b4182cc0 legacy=0x7fc1b41a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: _finish_hunting 0 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 1 monclient: found mon.noname-a 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:17.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b4089a10 con 0x7fc1b408c620 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: _finish_auth 0 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: _check_auth_tickets 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1a80032e0 con 0x7fc1b408c620 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 5 monclient: authenticate success, global_id 74367 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: dump: 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.987 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1a8004960 con 0x7fc1b408c620 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 1 -- 10.20.193.57:0/3416212327 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1a8004cf0 con 0x7fc1b408c620 2026-02-12T17:43:17.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 4 set_mon_vals no callback set 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1b8f8e640 10 monclient: dump: 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.989 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 10 monclient: shutdown 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3416212327 >> v1:10.20.193.57:6789/0 conn(0x7fc1b408c620 legacy=0x7fc1b408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3416212327 shutdown_connections 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3416212327 >> 10.20.193.57:0/3416212327 conn(0x7fc1b40916b0 msgr2=0x7fc1b4091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3416212327 shutdown_connections 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3416212327 wait complete. 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 10 monclient: build_initial_monmap 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.982+0000 7fc1bc21b640 10 monclient: monmap: 2026-02-12T17:43:17.990 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 1 Processor -- start 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 1 -- start start 2026-02-12T17:43:17.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 10 monclient: init 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 10 monclient(hunting): picked mon.noname-b con 0x7fc1b408c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 10 monclient(hunting): picked mon.noname-c con 0x7fc1b408c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 10 monclient(hunting): picked mon.noname-a con 0x7fc1b4182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b418e5e0 con 0x7fc1b4182cc0 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b413af80 con 0x7fc1b408c250 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b413b4b0 con 0x7fc1b408c620 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1bc21b640 10 monclient(hunting): authenticate will time out at 1477.802354s 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1b978f640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fc1b408c620 0x7fc1b4137da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45594/0 (socket says 10.20.193.57:45594) 2026-02-12T17:43:17.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1ba791640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fc1b4182cc0 0x7fc1b41384b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46836/0 (socket says 10.20.193.57:46836) 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.983+0000 7fc1b978f640 1 -- 10.20.193.57:0/3164158219 learned_addr learned my addr 10.20.193.57:0/3164158219 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1ba791640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6789/0 conn(0x7fc1b4182cc0 legacy=0x7fc1b41384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1b978f640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6790/0 conn(0x7fc1b408c620 legacy=0x7fc1b4137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182477122 0 0) 0x7fc1b413b4b0 con 0x7fc1b408c620 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): my global_id is 104105 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1840035e0 con 0x7fc1b408c620 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720777554 0 0) 0x7fc1b418e5e0 con 0x7fc1b4182cc0 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): my global_id is 74370 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1b413b4b0 con 0x7fc1b4182cc0 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1b9f90640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.82:6789/0 conn(0x7fc1b408c250 legacy=0x7fc1b4137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 287949516 0 0) 0x7fc1840035e0 con 0x7fc1b408c620 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1b418e5e0 con 0x7fc1b408c620 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1a80032e0 con 0x7fc1b408c620 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): dump: 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.994 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2116514802 0 0) 0x7fc1b413b4b0 con 0x7fc1b4182cc0 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1840035e0 con 0x7fc1b4182cc0 2026-02-12T17:43:17.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1b0004420 con 0x7fc1b4182cc0 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): dump: 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:17.996 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587828366 0 0) 0x7fc1b413af80 con 0x7fc1b408c250 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 10 monclient(hunting): my global_id is 5125 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.985+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1b413b4b0 con 0x7fc1b408c250 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3635058297 0 0) 0x7fc1b418e5e0 con 0x7fc1b408c620 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.82:6789/0 conn(0x7fc1b408c250 legacy=0x7fc1b4137690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6789/0 conn(0x7fc1b4182cc0 legacy=0x7fc1b41384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 10 monclient: _finish_hunting 0 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 1 monclient: found mon.c 2026-02-12T17:43:17.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b4139150 con 0x7fc1b408c620 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 10 monclient: _finish_auth 0 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 10 monclient: _check_auth_tickets 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1bc21b640 5 monclient: authenticate success, global_id 104105 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1bc21b640 10 monclient: _renew_subs 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1bc21b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b413a060 con 0x7fc1b408c620 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1bc21b640 10 monclient: _renew_subs 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1bc21b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1b4139cb0 con 0x7fc1b408c620 2026-02-12T17:43:17.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1a8003510 con 0x7fc1b408c620 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1a8005480 con 0x7fc1b408c620 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a3fff640 4 set_mon_vals no callback set 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 10 monclient: dump: 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:17.999 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.000 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.000 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.000 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.000 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1bc21b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:18.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc1b408f0d0 con 0x7fc1b4086730 2026-02-12T17:43:18.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fc1a80120f0 con 0x7fc1b408c620 2026-02-12T17:43:18.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.986+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(761..761 src has 508..761) ==== 3975+0+0 (unknown 2951960395 0 0) 0x7fc1a804edb0 con 0x7fc1b408c620 2026-02-12T17:43:18.000 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.987+0000 7fc1ba791640 10 monclient: get_auth_request con 0x7fc18403fde0 auth_method 0 2026-02-12T17:43:18.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.988+0000 7fc1b9f90640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6790/0 conn(0x7fc1b4086730 legacy=0x7fc1b4086b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.988+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1916619038 0 0) 0x7fc1b408f0d0 con 0x7fc1b4086730 2026-02-12T17:43:18.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.988+0000 7fc1a27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.988+0000 7fc1a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.988+0000 7fc1a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.988+0000 7fc1a27fc640 10 monclient(hunting): my global_id is 104108 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.988+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1b418e5e0 con 0x7fc1b4086730 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3405536158 0 0) 0x7fc1b418e5e0 con 0x7fc1b4086730 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1b408f0d0 con 0x7fc1b4086730 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1a4003240 con 0x7fc1b4086730 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 10 monclient: dump: 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.004 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 578106408 0 0) 0x7fc1b408f0d0 con 0x7fc1b4086730 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1b413ad20 con 0x7fc1b4086730 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fc1a4005880 con 0x7fc1b4086730 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:18.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6790/0 conn(0x7fc1b4086730 legacy=0x7fc1b4086b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.989+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6790/0 conn(0x7fc1b4086730 legacy=0x7fc1b4086b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.993+0000 7fc1bc21b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.993+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc1b4090810 con 0x7fc1b4087210 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1b9f90640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6790/0 conn(0x7fc1b4087210 legacy=0x7fc1b41974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034446295 0 0) 0x7fc1b4090810 con 0x7fc1b4087210 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 10 monclient(hunting): my global_id is 104111 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1b408f0d0 con 0x7fc1b4087210 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2920330518 0 0) 0x7fc1b408f0d0 con 0x7fc1b4087210 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1b4090810 con 0x7fc1b4087210 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1a4003bc0 con 0x7fc1b4087210 2026-02-12T17:43:18.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 10 monclient: dump: 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1237829452 0 0) 0x7fc1b4090810 con 0x7fc1b4087210 2026-02-12T17:43:18.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.995+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc1b408f580 con 0x7fc1b4087210 2026-02-12T17:43:18.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4335 (unknown 0 0 471525026) 0x7fc1a4005ac0 con 0x7fc1b4087210 2026-02-12T17:43:18.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1a27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:43:18.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1a27fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:18.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6790/0 conn(0x7fc1b4087210 legacy=0x7fc1b41974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.008 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1a27fc640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6790/0 conn(0x7fc1b4087210 legacy=0x7fc1b41974f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:18.008 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:43:18.008 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:18.008 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 58, 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 366, 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:18.009 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:18.010 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.011 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:18.012 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.013 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:18.014 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:18.015 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:18.016 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:18.017 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:43:18.018 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.018 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.018 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.018 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:43:18.018 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.82:6800/2441377515 conn(0x7fc18403fde0 legacy=0x7fc184060290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1bc21b640 10 monclient: shutdown 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1bc21b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 >> v1:10.20.193.57:6790/0 conn(0x7fc1b408c620 legacy=0x7fc1b4137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1ba791640 1 -- 10.20.193.57:0/3164158219 reap_dead start 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1ba791640 1 -- 10.20.193.57:0/3164158219 reap_dead start 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 shutdown_connections 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 >> 10.20.193.57:0/3164158219 conn(0x7fc1b40916b0 msgr2=0x7fc1b408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 shutdown_connections 2026-02-12T17:43:18.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:17.996+0000 7fc1bc21b640 1 -- 10.20.193.57:0/3164158219 wait complete. 2026-02-12T17:43:18.020 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:43:18.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:43:18.020 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:43:18.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.087+0000 7f548d207640 10 monclient: get_monmap_and_config 2026-02-12T17:43:18.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.087+0000 7f548d207640 10 monclient: build_initial_monmap 2026-02-12T17:43:18.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.087+0000 7f548d207640 10 monclient: monmap: 2026-02-12T17:43:18.084 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:18.084 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.084 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:18.088242+0000 2026-02-12T17:43:18.084 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:18.088242+0000 2026-02-12T17:43:18.084 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:18.084 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.085 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:18.085 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:18.085 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:18.085 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.087+0000 7f548d207640 1 Processor -- start 2026-02-12T17:43:18.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.087+0000 7f548d207640 1 -- start start 2026-02-12T17:43:18.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.087+0000 7f548d207640 10 monclient: init 2026-02-12T17:43:18.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:18.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 10 monclient(hunting): picked mon.noname-b con 0x7f548808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 10 monclient(hunting): picked mon.noname-c con 0x7f548808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 10 monclient(hunting): picked mon.noname-a con 0x7f5488182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548808a820 con 0x7f5488182cc0 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5488089450 con 0x7f548808c620 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5488089730 con 0x7f548808c250 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f548d207640 10 monclient(hunting): authenticate will time out at 1477.907113s 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f5486d76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f548808c250 0x7f548808a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45622/0 (socket says 10.20.193.57:45622) 2026-02-12T17:43:18.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.088+0000 7f5486d76640 1 -- 10.20.193.57:0/510825672 learned_addr learned my addr 10.20.193.57:0/510825672 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:18.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5486d76640 1 -- 10.20.193.57:0/510825672 >> v1:10.20.193.57:6790/0 conn(0x7f548808c250 legacy=0x7f548808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5487577640 1 -- 10.20.193.57:0/510825672 >> v1:10.20.193.57:6789/0 conn(0x7f5488182cc0 legacy=0x7f54881a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659595912 0 0) 0x7f5488089730 con 0x7f548808c250 2026-02-12T17:43:18.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient(hunting): my global_id is 104114 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54740035e0 con 0x7f548808c250 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77614267 0 0) 0x7f5478003d50 con 0x7f5488182cc0 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient(hunting): my global_id is 74373 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5488089730 con 0x7f5488182cc0 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5486575640 1 -- 10.20.193.57:0/510825672 >> v1:10.20.193.82:6789/0 conn(0x7f548808c620 legacy=0x7f548808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 680561788 0 0) 0x7f5488089730 con 0x7f5488182cc0 2026-02-12T17:43:18.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 >> v1:10.20.193.57:6790/0 conn(0x7f548808c250 legacy=0x7f548808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 >> v1:10.20.193.82:6789/0 conn(0x7f548808c620 legacy=0x7f548808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: _finish_hunting 0 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 monclient: found mon.noname-a 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5488089a10 con 0x7f5488182cc0 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: _finish_auth 0 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: _check_auth_tickets 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5478004390 con 0x7f5488182cc0 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:18.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: dump: 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f548d207640 5 monclient: authenticate success, global_id 74373 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f548d207640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54780045d0 con 0x7f5488182cc0 2026-02-12T17:43:18.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 1 -- 10.20.193.57:0/510825672 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f54780049e0 con 0x7f5488182cc0 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f5485d74640 10 monclient: dump: 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.099 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f548d207640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.090+0000 7f548d207640 4 set_mon_vals no callback set 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 10 monclient: shutdown 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 1 -- 10.20.193.57:0/510825672 >> v1:10.20.193.57:6789/0 conn(0x7f5488182cc0 legacy=0x7f54881a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 1 -- 10.20.193.57:0/510825672 shutdown_connections 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 1 -- 10.20.193.57:0/510825672 >> 10.20.193.57:0/510825672 conn(0x7f54880916b0 msgr2=0x7f5488091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 1 -- 10.20.193.57:0/510825672 shutdown_connections 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 1 -- 10.20.193.57:0/510825672 wait complete. 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 10 monclient: build_initial_monmap 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 10 monclient: monmap: 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:18.100 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 1 Processor -- start 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 1 -- start start 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.091+0000 7f548d207640 10 monclient: init 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:43:18.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 10 monclient(hunting): picked mon.noname-a con 0x7f548808c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 10 monclient(hunting): picked mon.noname-b con 0x7f548808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 10 monclient(hunting): picked mon.noname-c con 0x7f5488182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548807b8e0 con 0x7f548808c250 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548807c880 con 0x7f548808c620 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548807bea0 con 0x7f5488182cc0 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f548d207640 10 monclient(hunting): authenticate will time out at 1477.911187s 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f5486d76640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f548808c250 0x7f548805c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46854/0 (socket says 10.20.193.57:46854) 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.092+0000 7f5486d76640 1 -- 10.20.193.57:0/2074133603 learned_addr learned my addr 10.20.193.57:0/2074133603 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f5486d76640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.57:6789/0 conn(0x7f548808c250 legacy=0x7f548805c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f5487577640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.57:6790/0 conn(0x7f5488182cc0 legacy=0x7f548805d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f5486575640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.82:6789/0 conn(0x7f548808c620 legacy=0x7f548805ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128180109 0 0) 0x7f548807b8e0 con 0x7f548808c250 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): my global_id is 74376 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54540035e0 con 0x7f548808c250 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151403219 0 0) 0x7f548807bea0 con 0x7f5488182cc0 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): my global_id is 104117 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f548807b8e0 con 0x7f5488182cc0 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876558543 0 0) 0x7f548807c880 con 0x7f548808c620 2026-02-12T17:43:18.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): my global_id is 5131 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f548807bea0 con 0x7f548808c620 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3595799592 0 0) 0x7f548807b8e0 con 0x7f5488182cc0 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f548807c880 con 0x7f5488182cc0 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2029242454 0 0) 0x7f54540035e0 con 0x7f548808c250 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f548807b8e0 con 0x7f548808c250 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f54780047b0 con 0x7f5488182cc0 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): dump: 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.104 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f547c0032c0 con 0x7f548808c250 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): dump: 2026-02-12T17:43:18.105 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3200278254 0 0) 0x7f548807bea0 con 0x7f548808c620 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54540035e0 con 0x7f548808c620 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5470003300 con 0x7f548808c620 2026-02-12T17:43:18.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient(hunting): dump: 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3183841817 0 0) 0x7f548807c880 con 0x7f5488182cc0 2026-02-12T17:43:18.107 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.82:6789/0 conn(0x7f548808c620 legacy=0x7f548805ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.57:6789/0 conn(0x7f548808c250 legacy=0x7f548805c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient: _finish_hunting 0 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 monclient: found mon.c 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548805dd10 con 0x7f5488182cc0 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient: _finish_auth 0 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 10 monclient: _check_auth_tickets 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f54677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f548d207640 5 monclient: authenticate success, global_id 104117 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f548d207640 10 monclient: _renew_subs 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f548d207640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:43:18.108 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f548807b600 con 0x7f5488182cc0 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f548d207640 10 monclient: _renew_subs 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f548d207640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.094+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f548807a890 con 0x7f5488182cc0 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5478004a60 con 0x7f5488182cc0 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f54677fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f54780050f0 con 0x7f5488182cc0 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f54677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f54677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f5485573640 4 set_mon_vals no callback set 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f54677fe640 10 monclient: dump: 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.109 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f548d207640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5488090810 con 0x7f54881a47c0 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5478005250 con 0x7f5488182cc0 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(761..761 src has 508..761) ==== 3975+0+0 (unknown 2951960395 0 0) 0x7f547804fac0 con 0x7f5488182cc0 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.095+0000 7f5486575640 10 monclient: get_auth_request con 0x7f545403ffd0 auth_method 0 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.097+0000 7f5486d76640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.82:6789/0 conn(0x7f54881a47c0 legacy=0x7f5488058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.097+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093031214 0 0) 0x7f5488090810 con 0x7f54881a47c0 2026-02-12T17:43:18.110 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.097+0000 7f54677fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.097+0000 7f54677fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.097+0000 7f54677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.097+0000 7f54677fe640 10 monclient(hunting): my global_id is 5134 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.097+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f548807c880 con 0x7f54881a47c0 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.097+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4117887553 0 0) 0x7f548807c880 con 0x7f54881a47c0 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5488090810 con 0x7f54881a47c0 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f547c003560 con 0x7f54881a47c0 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 10 monclient: dump: 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.111 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3599689683 0 0) 0x7f5488090810 con 0x7f54881a47c0 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f548805d820 con 0x7f54881a47c0 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f547c0071a0 con 0x7f54881a47c0 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.82:6789/0 conn(0x7f54881a47c0 legacy=0x7f5488058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.112 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.098+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.82:6789/0 conn(0x7f54881a47c0 legacy=0x7f5488058410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.101+0000 7f548d207640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:43:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.101+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f548808f580 con 0x7f548813e480 2026-02-12T17:43:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f5486d76640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.82:6789/0 conn(0x7f548813e480 legacy=0x7f548804d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4006915077 0 0) 0x7f548808f580 con 0x7f548813e480 2026-02-12T17:43:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.114 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 10 monclient(hunting): my global_id is 5137 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5488090810 con 0x7f548813e480 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 293943706 0 0) 0x7f5488090810 con 0x7f548813e480 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f548808f580 con 0x7f548813e480 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f547c0056c0 con 0x7f548813e480 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 10 monclient: dump: 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.115 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2414426564 0 0) 0x7f548808f580 con 0x7f548813e480 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5488055340 con 0x7f548813e480 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 3659707974) 0x7f547c006cc0 con 0x7f548813e480 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.82:6789/0 conn(0x7f548813e480 legacy=0x7f548804d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.104+0000 7f54677fe640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.82:6789/0 conn(0x7f548813e480 legacy=0x7f548804d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:43:18.116 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 58, 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 919599, 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:18.117 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:18.118 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:43:18.119 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:18.120 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.121 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:18.122 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.123 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:18.124 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:18.125 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:18.126 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:18.126 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:18.126 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:18.126 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:18.126 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:43:18.126 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.82:6800/2441377515 conn(0x7f545403ffd0 legacy=0x7f5454060480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f548d207640 10 monclient: shutdown 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f548d207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 >> v1:10.20.193.57:6790/0 conn(0x7f5488182cc0 legacy=0x7f548805d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f5487577640 1 -- 10.20.193.57:0/2074133603 reap_dead start 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f5487577640 1 -- 10.20.193.57:0/2074133603 reap_dead start 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 shutdown_connections 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 >> 10.20.193.57:0/2074133603 conn(0x7f54880916b0 msgr2=0x7f548808b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 shutdown_connections 2026-02-12T17:43:18.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.105+0000 7f548d207640 1 -- 10.20.193.57:0/2074133603 wait complete. 2026-02-12T17:43:18.128 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:43:18.128 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:43:18.128 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:43:18.132 INFO:tasks.rados.rados.0.trial082.stdout:3459: done (6 left) 2026-02-12T17:43:18.132 INFO:tasks.rados.rados.0.trial082.stdout:3460: copy_from oid 13 from oid 44 current snap is 379 2026-02-12T17:43:18.132 INFO:tasks.rados.rados.0.trial082.stdout:3452: finishing write tid 3 to trial08226312-49 2026-02-12T17:43:18.132 INFO:tasks.rados.rados.0.trial082.stdout:3452: finishing write tid 4 to trial08226312-49 2026-02-12T17:43:18.132 INFO:tasks.rados.rados.0.trial082.stdout:3452: finishing write tid 5 to trial08226312-49 2026-02-12T17:43:18.132 INFO:tasks.rados.rados.0.trial082.stdout:3452: oid 49 updating version 0 to 2234 2026-02-12T17:43:18.132 INFO:tasks.rados.rados.0.trial082.stdout:3452: oid 49 version 2234 is already newer than 2233 2026-02-12T17:43:18.132 INFO:tasks.rados.rados.0.trial082.stdout:3452: oid 49 updating version 2234 to 2236 2026-02-12T17:43:18.132 INFO:tasks.rados.rados.0.trial082.stdout:3452: oid 49 version 2236 is already newer than 2235 2026-02-12T17:43:18.133 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 2236 (ObjNum 1179 snap 379 seq_num 1179) dirty exists 2026-02-12T17:43:18.133 INFO:tasks.rados.rados.0.trial082.stdout:3452: left oid 49 (ObjNum 1179 snap 379 seq_num 1179) 2026-02-12T17:43:18.133 INFO:tasks.rados.rados.0.trial082.stdout:3454: expect (ObjNum 1162 snap 375 seq_num 1162) 2026-02-12T17:43:18.133 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:18.193 INFO:tasks.rados.rados.0.trial082.stdout:3453: finishing rollback tid 0 to trial08226312-9 2026-02-12T17:43:18.194 INFO:tasks.rados.rados.0.trial082.stdout:3453: finishing rollback tid 1 to trial08226312-9 2026-02-12T17:43:18.194 INFO:tasks.rados.rados.0.trial082.stdout:3453: finishing rollback tid 2 to trial08226312-9 2026-02-12T17:43:18.194 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 2412 (ObjNum 1141 snap 359 seq_num 1141) dirty exists 2026-02-12T17:43:18.194 INFO:tasks.rados.rados.0.trial082.stdout:3456: expect (ObjNum 1074 snap 340 seq_num 1074) 2026-02-12T17:43:18.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient: get_monmap_and_config 2026-02-12T17:43:18.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient: build_initial_monmap 2026-02-12T17:43:18.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient: monmap: 2026-02-12T17:43:18.195 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:18.198062+0000 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:18.198062+0000 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 1 Processor -- start 2026-02-12T17:43:18.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 1 -- start start 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient: init 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient(hunting): picked mon.noname-c con 0x7f56d808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient(hunting): picked mon.noname-b con 0x7f56d808c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient(hunting): picked mon.noname-a con 0x7f56d808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d808d600 con 0x7f56d808cb30 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d808b1f0 con 0x7f56d808ae20 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d808d1f0 con 0x7f56d808c730 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.197+0000 7f56dfb94640 10 monclient(hunting): authenticate will time out at 1478.016930s 2026-02-12T17:43:18.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.198+0000 7f56dd108640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f56d808c730 0x7f56d8181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45638/0 (socket says 10.20.193.57:45638) 2026-02-12T17:43:18.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.198+0000 7f56dd108640 1 -- 10.20.193.57:0/2182386604 learned_addr learned my addr 10.20.193.57:0/2182386604 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:18.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.198+0000 7f56de10a640 1 --1- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6789/0 conn(0x7f56d808cb30 0x7f56d81a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46868/0 (socket says 10.20.193.57:46868) 2026-02-12T17:43:18.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dd108640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6790/0 conn(0x7f56d808c730 legacy=0x7f56d8181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56de10a640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6789/0 conn(0x7f56d808cb30 legacy=0x7f56d81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533489018 0 0) 0x7f56d808d1f0 con 0x7f56d808c730 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): my global_id is 104120 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56c00035e0 con 0x7f56d808c730 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145247415 0 0) 0x7f56d808d600 con 0x7f56d808cb30 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): my global_id is 74379 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d808d1f0 con 0x7f56d808cb30 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dd909640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.82:6789/0 conn(0x7f56d808ae20 legacy=0x7f56d808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3667087717 0 0) 0x7f56c00035e0 con 0x7f56d808c730 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.82:6789/0 conn(0x7f56d808ae20 legacy=0x7f56d808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6789/0 conn(0x7f56d808cb30 legacy=0x7f56d81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: _finish_hunting 0 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 monclient: found mon.noname-b 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d8057320 con 0x7f56d808c730 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: _finish_auth 0 2026-02-12T17:43:18.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: _check_auth_tickets 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f56cc003140 con 0x7f56d808c730 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: dump: 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.210 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dfb94640 5 monclient: authenticate success, global_id 104120 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dfb94640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dd108640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6790/0 conn(0x7f56d808c730 legacy=0x7f56d8181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dd108640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6790/0 conn(0x7f56d808c730 legacy=0x7f56d8181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dd108640 1 --1- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6790/0 conn(0x7f56d808c730 0x7f56d8181be0 :-1 s=OPENED pgs=270 gs=2 cs=1 l=1).handle_message read tag failed 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dd108640 1 --1- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6790/0 conn(0x7f56d808c730 0x7f56d8181be0 :-1 s=OPENED pgs=270 gs=2 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: ms_handle_reset current mon v1:10.20.193.57:6790/0 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6790/0 conn(0x7f56d808c730 legacy=0x7f56d8181be0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:18.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): picked mon.b con 0x7f56d808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): picked mon.a con 0x7f56d808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): picked mon.c con 0x7f56c0047120 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56c00035e0 con 0x7f56d808cb30 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56d808d1f0 con 0x7f56d808ae20 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56d808d600 con 0x7f56c0047120 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.200+0000 7f56dc907640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.57:6790/0 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.202+0000 7f56dd108640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6789/0 conn(0x7f56d808cb30 legacy=0x7f56c0045a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.202+0000 7f56de10a640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6790/0 conn(0x7f56c0047120 legacy=0x7f56c0067500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041199628 0 0) 0x7f56c00035e0 con 0x7f56d808cb30 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dd909640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.82:6789/0 conn(0x7f56d808ae20 legacy=0x7f56c0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.212 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.57:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f56c006ae90 con 0x7f56d808cb30 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1504103565 0 0) 0x7f56d808d600 con 0x7f56c0047120 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.57:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f56c00035e0 con 0x7f56c0047120 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974039704 0 0) 0x7f56d808d1f0 con 0x7f56d808ae20 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.213 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.82:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f56d808d600 con 0x7f56d808ae20 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1086371418 0 0) 0x7f56c006ae90 con 0x7f56d808cb30 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6790/0 conn(0x7f56c0047120 legacy=0x7f56c0067500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.82:6789/0 conn(0x7f56d808ae20 legacy=0x7f56c0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient: _finish_hunting 0 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 monclient: found mon.a 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=2+}) -- 0x7f56c006c020 con 0x7f56d808cb30 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient: _finish_auth 0 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient: _check_auth_tickets 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:18.214 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f56cc004c60 con 0x7f56d808cb30 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient: dump: 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.215 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 1 -- 10.20.193.57:0/2182386604 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56cc004dc0 con 0x7f56d808cb30 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dc907640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 4 set_mon_vals no callback set 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 10 monclient: shutdown 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 1 -- 10.20.193.57:0/2182386604 >> v1:10.20.193.57:6789/0 conn(0x7f56d808cb30 legacy=0x7f56c0045a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 1 -- 10.20.193.57:0/2182386604 shutdown_connections 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 1 -- 10.20.193.57:0/2182386604 >> 10.20.193.57:0/2182386604 conn(0x7f56d8091620 msgr2=0x7f56d8091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:18.216 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 1 -- 10.20.193.57:0/2182386604 shutdown_connections 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.203+0000 7f56dfb94640 1 -- 10.20.193.57:0/2182386604 wait complete. 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient: build_initial_monmap 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient: monmap: 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:18.217 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 1 Processor -- start 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 1 -- start start 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient: init 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient(hunting): picked mon.noname-c con 0x7f56c0047120 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient(hunting): picked mon.noname-b con 0x7f56d808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient(hunting): picked mon.noname-a con 0x7f56d808cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d808d9c0 con 0x7f56d808cb30 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d811ec30 con 0x7f56d808ae20 2026-02-12T17:43:18.218 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d811bdf0 con 0x7f56c0047120 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dfb94640 10 monclient(hunting): authenticate will time out at 1478.023708s 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dd909640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f56c0047120 0x7f56d811afd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45644/0 (socket says 10.20.193.57:45644) 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56dd909640 1 -- 10.20.193.57:0/2119345553 learned_addr learned my addr 10.20.193.57:0/2119345553 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.204+0000 7f56de10a640 1 --1- 10.20.193.57:0/2119345553 >> v1:10.20.193.57:6789/0 conn(0x7f56d808cb30 0x7f56d8134f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46878/0 (socket says 10.20.193.57:46878) 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.206+0000 7f56de10a640 1 -- 10.20.193.57:0/2119345553 >> v1:10.20.193.57:6789/0 conn(0x7f56d808cb30 legacy=0x7f56d8134f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.206+0000 7f56dd909640 1 -- 10.20.193.57:0/2119345553 >> v1:10.20.193.57:6790/0 conn(0x7f56c0047120 legacy=0x7f56d811afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.206+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018678860 0 0) 0x7f56d808d9c0 con 0x7f56d808cb30 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.219 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): my global_id is 74382 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dd108640 1 -- 10.20.193.57:0/2119345553 >> v1:10.20.193.82:6789/0 conn(0x7f56d808ae20 legacy=0x7f56d811b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a80035e0 con 0x7f56d808cb30 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872132248 0 0) 0x7f56d811bdf0 con 0x7f56c0047120 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): my global_id is 104123 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d808d9c0 con 0x7f56c0047120 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3568563090 0 0) 0x7f56a80035e0 con 0x7f56d808cb30 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56d811bdf0 con 0x7f56d808cb30 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f56d40044e0 con 0x7f56d808cb30 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:18.220 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): dump: 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577450785 0 0) 0x7f56d811ec30 con 0x7f56d808ae20 2026-02-12T17:43:18.221 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): my global_id is 5143 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a80035e0 con 0x7f56d808ae20 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2586352262 0 0) 0x7f56d808d9c0 con 0x7f56c0047120 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56d811ec30 con 0x7f56c0047120 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f56c8003380 con 0x7f56c0047120 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient(hunting): dump: 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.222 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 989672666 0 0) 0x7f56d811bdf0 con 0x7f56d808cb30 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 >> v1:10.20.193.57:6790/0 conn(0x7f56c0047120 legacy=0x7f56d811afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 >> v1:10.20.193.82:6789/0 conn(0x7f56d808ae20 legacy=0x7f56d811b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient: _finish_hunting 0 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 monclient: found mon.a 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:18.223 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d805ac10 con 0x7f56d808cb30 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient: _finish_auth 0 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient: _check_auth_tickets 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 5 monclient: authenticate success, global_id 74382 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 10 monclient: _renew_subs 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56d8088810 con 0x7f56d808cb30 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 10 monclient: _renew_subs 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56d811c8d0 con 0x7f56d808cb30 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56d4005c30 con 0x7f56d808cb30 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f56d4005f50 con 0x7f56d808cb30 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:18.224 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c7fff640 4 set_mon_vals no callback set 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56c67fc640 10 monclient: dump: 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:18.225 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:18.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.207+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d811ea10 con 0x7f56d808cb30 2026-02-12T17:43:18.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.208+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f56d4012bc0 con 0x7f56d808cb30 2026-02-12T17:43:18.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.208+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(762..762 src has 508..762) ==== 3991+0+0 (unknown 1182484860 0 0) 0x7f56d404fb90 con 0x7f56d808cb30 2026-02-12T17:43:18.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.208+0000 7f56dd909640 10 monclient: get_auth_request con 0x7f56a803fd10 auth_method 0 2026-02-12T17:43:18.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.210+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f56d4018320 con 0x7f56d808cb30 2026-02-12T17:43:18.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.210+0000 7f56c67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:18.226 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.210+0000 7f56c67fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:18.226 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 264475 2026-02-12T17:43:18.256 INFO:tasks.rados.rados.0.trial082.stdout:3458: expect (ObjNum 842 snap 265 seq_num 842) 2026-02-12T17:43:18.281 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:18.323 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1667670 2026-02-12T17:43:18.331 INFO:tasks.rados.rados.0.trial082.stdout:3460: finishing copy_from racing read to trial08226312-13 2026-02-12T17:43:18.331 INFO:tasks.rados.rados.0.trial082.stdout:3460: finishing copy_from to trial08226312-13 2026-02-12T17:43:18.331 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2458 (ObjNum 851 snap 268 seq_num 851) dirty exists 2026-02-12T17:43:18.331 INFO:tasks.rados.rados.0.trial082.stdout:3452: done (6 left) 2026-02-12T17:43:18.331 INFO:tasks.rados.rados.0.trial082.stdout:3453: done (5 left) 2026-02-12T17:43:18.331 INFO:tasks.rados.rados.0.trial082.stdout:3454: done (4 left) 2026-02-12T17:43:18.331 INFO:tasks.rados.rados.0.trial082.stdout:3455: done (3 left) 2026-02-12T17:43:18.331 INFO:tasks.rados.rados.0.trial082.stdout:3456: done (2 left) 2026-02-12T17:43:18.331 INFO:tasks.rados.rados.0.trial082.stdout:3458: done (1 left) 2026-02-12T17:43:18.332 INFO:tasks.rados.rados.0.trial082.stdout:3460: done (0 left) 2026-02-12T17:43:18.332 INFO:tasks.rados.rados.0.trial082.stdout:3461: read oid 49 snap 371 2026-02-12T17:43:18.332 INFO:tasks.rados.rados.0.trial082.stdout:3461: expect (ObjNum 1040 snap 325 seq_num 1040) 2026-02-12T17:43:18.332 INFO:tasks.rados.rados.0.trial082.stdout:3462: delete oid 11 current snap is 379 2026-02-12T17:43:18.333 INFO:tasks.rados.rados.0.trial082.stdout:3462: done (1 left) 2026-02-12T17:43:18.333 INFO:tasks.rados.rados.0.trial082.stdout:3463: rollback oid 39 current snap is 379 2026-02-12T17:43:18.333 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 39 to 377 2026-02-12T17:43:18.333 INFO:tasks.rados.rados.0.trial082.stdout:3464: write oid 11 current snap is 379 2026-02-12T17:43:18.333 INFO:tasks.rados.rados.0.trial082.stdout:3464: seq_num 1181 ranges {649067=503784,1875940=607071,3115378=731306} 2026-02-12T17:43:18.336 INFO:tasks.rados.rados.0.trial082.stdout:3464: writing trial08226312-11 from 649067 to 1152851 tid 1 2026-02-12T17:43:18.341 INFO:tasks.rados.rados.0.trial082.stdout:3464: writing trial08226312-11 from 1875940 to 2483011 tid 2 2026-02-12T17:43:18.347 INFO:tasks.rados.rados.0.trial082.stdout:3464: writing trial08226312-11 from 3115378 to 3846684 tid 3 2026-02-12T17:43:18.347 INFO:tasks.rados.rados.0.trial082.stdout:3465: read oid 5 snap -1 2026-02-12T17:43:18.347 INFO:tasks.rados.rados.0.trial082.stdout:3465: expect deleted 2026-02-12T17:43:18.347 INFO:tasks.rados.rados.0.trial082.stdout:3466: read oid 12 snap -1 2026-02-12T17:43:18.347 INFO:tasks.rados.rados.0.trial082.stdout:3466: expect (ObjNum 1105 snap 346 seq_num 1105) 2026-02-12T17:43:18.347 INFO:tasks.rados.rados.0.trial082.stdout:3467: copy_from oid 18 from oid 29 current snap is 379 2026-02-12T17:43:18.347 INFO:tasks.rados.rados.0.trial082.stdout:3463: finishing rollback tid 1 to trial08226312-39 2026-02-12T17:43:18.348 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 2250 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:43:18.348 INFO:tasks.rados.rados.0.trial082.stdout:3463: done (5 left) 2026-02-12T17:43:18.348 INFO:tasks.rados.rados.0.trial082.stdout:3468: rollback oid 19 current snap is 379 2026-02-12T17:43:18.348 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 19 to 342 2026-02-12T17:43:18.348 INFO:tasks.rados.rados.0.trial082.stdout:3461: expect (ObjNum 1040 snap 325 seq_num 1040) 2026-02-12T17:43:18.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.352+0000 7f56dfb94640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:43:18.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.352+0000 7f56dfb94640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:43:18.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.352+0000 7f56dfb94640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:18.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.352+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f56d805c180 con 0x7f56d808cb30 2026-02-12T17:43:18.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.353+0000 7f56c67fc640 1 -- 10.20.193.57:0/2119345553 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f56d4017ad0 con 0x7f56d808cb30 2026-02-12T17:43:18.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.353+0000 7f56c67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:43:18.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.353+0000 7f56c67fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:18.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.354+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 >> v1:10.20.193.82:6800/2441377515 conn(0x7f56a803fd10 legacy=0x7f56a80601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.354+0000 7f56dfb94640 10 monclient: shutdown 2026-02-12T17:43:18.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.354+0000 7f56dfb94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:18.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.354+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 >> v1:10.20.193.57:6789/0 conn(0x7f56d808cb30 legacy=0x7f56d8134f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:18.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.354+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 shutdown_connections 2026-02-12T17:43:18.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.354+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 >> 10.20.193.57:0/2119345553 conn(0x7f56d8091620 msgr2=0x7f56d80596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:18.356 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.354+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 shutdown_connections 2026-02-12T17:43:18.357 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:18.354+0000 7f56dfb94640 1 -- 10.20.193.57:0/2119345553 wait complete. 2026-02-12T17:43:18.362 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:43:18.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.348+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.348+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=873854974,config=1618278320,health=329381808,kv=1466688342,logm=4083768240}) 2026-02-12T17:43:18.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.348+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=12,kv=11,logm=57} crc {auth=2419465186,config=1618278320,health=3897484431,kv=1466688342,logm=3116666221}) 2026-02-12T17:43:18.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.348+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.348+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=873854974,config=1618278320,health=329381808,kv=1466688342,logm=4083768240}) 2026-02-12T17:43:18.367 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.348+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=18,config=2,health=12,kv=10,logm=58} crc {auth=2649062759,config=1618278320,health=1341661959,kv=372569586,logm=2864702762}) 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3543829659}) 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1151028240}) 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3543829659}) 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2068228690}) 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3790417578}) 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2300860372}) 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3790417578}) 2026-02-12T17:43:18.368 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.349+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3215683096}) 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3561123178}) 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3695767091}) 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3561123178}) 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3419576046}) 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1481045381}) 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4077432094}) 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1481045381}) 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.350+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2261245161}) 2026-02-12T17:43:18.369 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=908500550}) 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3893003353}) 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=908500550}) 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=381299147}) 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3833791510}) 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=785293798}) 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3833791510}) 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.351+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3059426074}) 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.352+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.370 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.352+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2813841068}) 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.352+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1471186810}) 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.352+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.352+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2813841068}) 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.352+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2247891344}) 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3245027619}) 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3754835335}) 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3245027619}) 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2373856688}) 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2427643018}) 2026-02-12T17:43:18.371 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2777244099}) 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2427643018}) 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.353+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1132285968}) 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1516830564}) 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1284578151}) 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1516830564}) 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3775009349}) 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.372 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3568103061}) 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1705360583}) 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3568103061}) 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.354+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1927249936}) 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.355+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.355+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3555834709}) 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.355+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957042850}) 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.355+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.355+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3555834709}) 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.355+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1780857505}) 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1388245375}) 2026-02-12T17:43:18.373 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2483738940}) 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1388245375}) 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1772452066}) 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1998852804}) 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2548952421}) 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1998852804}) 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.356+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1090940890}) 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1291991525}) 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2304139476}) 2026-02-12T17:43:18.374 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1291991525}) 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1886941347}) 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2857513328}) 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371984617}) 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2857513328}) 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.357+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1567986459}) 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2683067901}) 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2719981267}) 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.375 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2683067901}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=93772467}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=853739737}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1198808174}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.358+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=853739737}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3148710170}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=961250728}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3021240745}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=961250728}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.359+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=716265211}) 2026-02-12T17:43:18.376 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1406004231}) 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=415872547}) 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1406004231}) 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4294044980}) 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1691406189}) 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=141108446}) 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1691406189}) 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.360+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=958786929}) 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=39239950}) 2026-02-12T17:43:18.377 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=8073584}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=39239950}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.361+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1716240909}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=84241542}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3560642166}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=84241542}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2482613912}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=110016559}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2607380189}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=110016559}) 2026-02-12T17:43:18.378 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.362+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1640932256}) 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1332398362}) 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026669414}) 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1332398362}) 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.363+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1805073220}) 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1815132427}) 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=976901514}) 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1815132427}) 2026-02-12T17:43:18.379 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.364+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2709807658}) 2026-02-12T17:43:18.384 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3299784 2026-02-12T17:43:18.392 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2706247 2026-02-12T17:43:18.401 INFO:tasks.rados.rados.0.trial082.stdout:3464: finishing write tid 1 to trial08226312-11 2026-02-12T17:43:18.401 INFO:tasks.rados.rados.0.trial082.stdout:3461: done (5 left) 2026-02-12T17:43:18.401 INFO:tasks.rados.rados.0.trial082.stdout:3469: snap_create 2026-02-12T17:43:18.401 INFO:tasks.rados.rados.0.trial082.stdout:3464: finishing write tid 2 to trial08226312-11 2026-02-12T17:43:18.401 INFO:tasks.rados.rados.0.trial082.stdout:3466: expect (ObjNum 1105 snap 346 seq_num 1105) 2026-02-12T17:43:18.441 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1994392 2026-02-12T17:43:18.468 INFO:tasks.rados.rados.0.trial082.stdout:3464: finishing write tid 3 to trial08226312-11 2026-02-12T17:43:18.468 INFO:tasks.rados.rados.0.trial082.stdout:3464: finishing write tid 4 to trial08226312-11 2026-02-12T17:43:18.468 INFO:tasks.rados.rados.0.trial082.stdout:3464: finishing write tid 5 to trial08226312-11 2026-02-12T17:43:18.468 INFO:tasks.rados.rados.0.trial082.stdout:3464: oid 11 updating version 0 to 2356 2026-02-12T17:43:18.468 INFO:tasks.rados.rados.0.trial082.stdout:3464: oid 11 version 2356 is already newer than 2354 2026-02-12T17:43:18.468 INFO:tasks.rados.rados.0.trial082.stdout:3464: oid 11 updating version 2356 to 2357 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:3464: oid 11 version 2357 is already newer than 2355 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 2357 (ObjNum 1181 snap 379 seq_num 1181) dirty exists 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:3464: left oid 11 (ObjNum 1181 snap 379 seq_num 1181) 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:3468: finishing rollback tid 0 to trial08226312-19 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:3468: finishing rollback tid 1 to trial08226312-19 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:3468: finishing rollback tid 2 to trial08226312-19 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 2627 (ObjNum 1079 snap 340 seq_num 1079) dirty exists 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:3467: finishing copy_from racing read to trial08226312-18 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:3467: finishing copy_from to trial08226312-18 2026-02-12T17:43:18.469 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 2397 (ObjNum 1174 snap 378 seq_num 1174) dirty exists 2026-02-12T17:43:18.642 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.640+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.643 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.640+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2269272458}) 2026-02-12T17:43:18.643 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.640+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125662318}) 2026-02-12T17:43:18.643 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.640+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.643 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.640+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2269272458}) 2026-02-12T17:43:18.643 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.640+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=416124930}) 2026-02-12T17:43:18.672 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.672 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=157973147}) 2026-02-12T17:43:18.673 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=87127969}) 2026-02-12T17:43:18.673 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.673 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=157973147}) 2026-02-12T17:43:18.673 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.671+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1708647453}) 2026-02-12T17:43:18.869 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.867+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.869 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.867+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1225063698}) 2026-02-12T17:43:18.869 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.867+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6976494}) 2026-02-12T17:43:18.869 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.867+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.869 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.867+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1225063698}) 2026-02-12T17:43:18.869 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.867+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2885656191}) 2026-02-12T17:43:18.872 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.870+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.872 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.870+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3730269224}) 2026-02-12T17:43:18.872 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.870+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1530851520}) 2026-02-12T17:43:18.872 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.870+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:18.873 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.870+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3730269224}) 2026-02-12T17:43:18.873 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:18.870+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=714172827}) 2026-02-12T17:43:19.046 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.046 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3009853836}) 2026-02-12T17:43:19.046 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1752300258}) 2026-02-12T17:43:19.046 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.046 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3009853836}) 2026-02-12T17:43:19.046 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1643993895}) 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3614911558}) 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1416118240}) 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3614911558}) 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.044+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4288082382}) 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.045+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.045+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=9,mon_config_key=8} crc {logm=1532502229,mdsmap=2204869053,mgr=1606979397,mgr_metadata=283970154,mgrstat=175484544,mon_config_key=1005603049}) 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.045+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=67,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=8,monmap=3,nvmeofgw=1} crc {logm=1878557270,mdsmap=2204869053,mgr=385151586,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=2124932976,mon_config_key=1501728497,monmap=2728086219,nvmeofgw=708365199}) 2026-02-12T17:43:19.050 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.045+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.045+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=9,mon_config_key=8} crc {logm=1532502229,mdsmap=2204869053,mgr=1606979397,mgr_metadata=283970154,mgrstat=175484544,mon_config_key=1005603049}) 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.045+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=69,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9} crc {logm=3306348994,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=175484544,mon_config_key=2771891197}) 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=2,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=85} crc {mon_config_key=3900022608,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2605589328,osd_snap=4140862972}) 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=2,monmap=3,nvmeofgw=3,osd_metadata=6,osd_snap=86} crc {mon_config_key=3900022608,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_snap=1901174183}) 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=2,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=85} crc {mon_config_key=3900022608,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2605589328,osd_snap=4140862972}) 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=1,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=86} crc {mon_config_key=915724868,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=2605589328,osd_snap=2846223632}) 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=54,osdmap=46} crc {osd_snap=491910733,osdmap=1737310152}) 2026-02-12T17:43:19.051 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=56,osdmap=44} crc {osd_snap=1194658788,osdmap=2547971633}) 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=54,osdmap=46} crc {osd_snap=491910733,osdmap=1737310152}) 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.046+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=53,osdmap=47} crc {osd_snap=1653084731,osdmap=2944362205}) 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=332487277}) 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3619374989}) 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=332487277}) 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2292343184}) 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2072940200}) 2026-02-12T17:43:19.052 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2565371239}) 2026-02-12T17:43:19.053 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.053 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2072940200}) 2026-02-12T17:43:19.053 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.047+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=226985419}) 2026-02-12T17:43:19.054 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.054 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3981735160}) 2026-02-12T17:43:19.054 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=334415808}) 2026-02-12T17:43:19.054 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.055 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3981735160}) 2026-02-12T17:43:19.055 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1809758399}) 2026-02-12T17:43:19.055 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.055 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=34} crc {osdmap=2291816531}) 2026-02-12T17:43:19.055 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=35} crc {osdmap=230185039}) 2026-02-12T17:43:19.055 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:43:19.055 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=34} crc {osdmap=2291816531}) 2026-02-12T17:43:19.055 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:43:19.049+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=37} crc {osdmap=2626691214}) 2026-02-12T17:43:19.136 INFO:tasks.rados.rados.0.trial082.stdout:3464: done (5 left) 2026-02-12T17:43:19.136 INFO:tasks.rados.rados.0.trial082.stdout:3465: done (4 left) 2026-02-12T17:43:19.136 INFO:tasks.rados.rados.0.trial082.stdout:3466: done (3 left) 2026-02-12T17:43:19.137 INFO:tasks.rados.rados.0.trial082.stdout:3467: done (2 left) 2026-02-12T17:43:19.137 INFO:tasks.rados.rados.0.trial082.stdout:3468: done (1 left) 2026-02-12T17:43:19.137 INFO:tasks.rados.rados.0.trial082.stdout:3469: done (0 left) 2026-02-12T17:43:19.137 INFO:tasks.rados.rados.0.trial082.stdout:3470: snap_remove snap 354 2026-02-12T17:43:19.363 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:43:19.364 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:43:19.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient: get_monmap_and_config 2026-02-12T17:43:19.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient: build_initial_monmap 2026-02-12T17:43:19.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient: monmap: 2026-02-12T17:43:19.430 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:19.430 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.430 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:19.432993+0000 2026-02-12T17:43:19.430 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:19.432993+0000 2026-02-12T17:43:19.430 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 1 Processor -- start 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 1 -- start start 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient: init 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f2ff008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:19.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f2ff008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:19.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f2ff008cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:19.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff008d600 con 0x7f2ff008cb30 2026-02-12T17:43:19.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff008b1f0 con 0x7f2ff008c730 2026-02-12T17:43:19.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff008d1f0 con 0x7f2ff008ae20 2026-02-12T17:43:19.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:19.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.432+0000 7f2ff7f0c640 10 monclient(hunting): authenticate will time out at 1479.251910s 2026-02-12T17:43:19.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.433+0000 7f2ff5c81640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f2ff008ae20 0x7f2ff008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45650/0 (socket says 10.20.193.57:45650) 2026-02-12T17:43:19.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.433+0000 7f2ff5c81640 1 -- 10.20.193.57:0/2375574423 learned_addr learned my addr 10.20.193.57:0/2375574423 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:19.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff5c81640 1 -- 10.20.193.57:0/2375574423 >> v1:10.20.193.57:6790/0 conn(0x7f2ff008ae20 legacy=0x7f2ff008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff6482640 1 -- 10.20.193.57:0/2375574423 >> v1:10.20.193.57:6789/0 conn(0x7f2ff008cb30 legacy=0x7f2ff01a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff5480640 1 -- 10.20.193.57:0/2375574423 >> v1:10.20.193.82:6789/0 conn(0x7f2ff008c730 legacy=0x7f2ff0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2194273156 0 0) 0x7f2ff008d1f0 con 0x7f2ff008ae20 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): my global_id is 104126 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd80035e0 con 0x7f2ff008ae20 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593597732 0 0) 0x7f2ff008d600 con 0x7f2ff008cb30 2026-02-12T17:43:19.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): my global_id is 74385 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff008d1f0 con 0x7f2ff008cb30 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112625697 0 0) 0x7f2ff008b1f0 con 0x7f2ff008c730 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient(hunting): my global_id is 5146 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff008d600 con 0x7f2ff008c730 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3398635733 0 0) 0x7f2ff008d1f0 con 0x7f2ff008cb30 2026-02-12T17:43:19.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 >> v1:10.20.193.57:6790/0 conn(0x7f2ff008ae20 legacy=0x7f2ff008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 >> v1:10.20.193.82:6789/0 conn(0x7f2ff008c730 legacy=0x7f2ff0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: _finish_hunting 0 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 monclient: found mon.noname-a 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff0057320 con 0x7f2ff008cb30 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: _finish_auth 0 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: _check_auth_tickets 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2fec0040b0 con 0x7f2ff008cb30 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff7f0c640 5 monclient: authenticate success, global_id 74385 2026-02-12T17:43:19.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff7f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: dump: 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.444 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff7f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fec004340 con 0x7f2ff008cb30 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 1 -- 10.20.193.57:0/2375574423 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2fec0047b0 con 0x7f2ff008cb30 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff7f0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff7f0c640 4 set_mon_vals no callback set 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.435+0000 7f2ff4c7f640 10 monclient: dump: 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.445 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient: shutdown 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/2375574423 >> v1:10.20.193.57:6789/0 conn(0x7f2ff008cb30 legacy=0x7f2ff01a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/2375574423 shutdown_connections 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/2375574423 >> 10.20.193.57:0/2375574423 conn(0x7f2ff0091620 msgr2=0x7f2ff0091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/2375574423 shutdown_connections 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/2375574423 wait complete. 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient: build_initial_monmap 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient: monmap: 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:19.447 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 Processor -- start 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 -- start start 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient: init 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f2ff008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f2ff008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f2ff008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:19.448 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff008d9c0 con 0x7f2ff008c730 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff005b020 con 0x7f2ff008cb30 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff0088810 con 0x7f2ff008ae20 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.436+0000 7f2ff7f0c640 10 monclient(hunting): authenticate will time out at 1479.255967s 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.437+0000 7f2ff5c81640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f2ff008ae20 0x7f2ff0118e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45660/0 (socket says 10.20.193.57:45660) 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.437+0000 7f2ff5c81640 1 -- 10.20.193.57:0/4035867497 learned_addr learned my addr 10.20.193.57:0/4035867497 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.437+0000 7f2ff5480640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f2ff008c730 0x7f2ff0119550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46904/0 (socket says 10.20.193.57:46904) 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff5480640 1 -- 10.20.193.57:0/4035867497 >> v1:10.20.193.57:6789/0 conn(0x7f2ff008c730 legacy=0x7f2ff0119550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff5c81640 1 -- 10.20.193.57:0/4035867497 >> v1:10.20.193.57:6790/0 conn(0x7f2ff008ae20 legacy=0x7f2ff0118e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530647944 0 0) 0x7f2ff008d9c0 con 0x7f2ff008c730 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff6482640 1 -- 10.20.193.57:0/4035867497 >> v1:10.20.193.82:6789/0 conn(0x7f2ff008cb30 legacy=0x7f2ff01a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): my global_id is 74388 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc00035e0 con 0x7f2ff008c730 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223962352 0 0) 0x7f2ff0088810 con 0x7f2ff008ae20 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): my global_id is 104129 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff008d9c0 con 0x7f2ff008ae20 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996270722 0 0) 0x7f2ff005b020 con 0x7f2ff008cb30 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): my global_id is 5149 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ff0088810 con 0x7f2ff008cb30 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4142264567 0 0) 0x7f2fc00035e0 con 0x7f2ff008c730 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ff005b020 con 0x7f2ff008c730 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2fe4003380 con 0x7f2ff008c730 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): dump: 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.451 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3631580834 0 0) 0x7f2ff008d9c0 con 0x7f2ff008ae20 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fc00035e0 con 0x7f2ff008ae20 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2fe0002f20 con 0x7f2ff008ae20 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:19.452 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient(hunting): dump: 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.453 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 121210522 0 0) 0x7f2ff005b020 con 0x7f2ff008c730 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 >> v1:10.20.193.57:6790/0 conn(0x7f2ff008ae20 legacy=0x7f2ff0118e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 >> v1:10.20.193.82:6789/0 conn(0x7f2ff008cb30 legacy=0x7f2ff01a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 monclient: found mon.a 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff0123460 con 0x7f2ff008c730 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient: _finish_auth 0 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2fde7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff7f0c640 5 monclient: authenticate success, global_id 74388 2026-02-12T17:43:19.454 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff7f0c640 10 monclient: _renew_subs 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff7f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff011c830 con 0x7f2ff008c730 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff7f0c640 10 monclient: _renew_subs 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff7f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.439+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ff011bca0 con 0x7f2ff008c730 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fe4003980 con 0x7f2ff008c730 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2fde7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2fe4003cd0 con 0x7f2ff008c730 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2fde7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2fde7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2fdffff640 4 set_mon_vals no callback set 2026-02-12T17:43:19.455 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2fde7fc640 10 monclient: dump: 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f2fe4003ea0 con 0x7f2ff008c730 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2ff7f0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:19.456 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(763..763 src has 508..763) ==== 3963+0+0 (unknown 3142021234 0 0) 0x7f2fe404ec30 con 0x7f2ff008c730 2026-02-12T17:43:19.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2ff7f0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:19.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2ff7f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff011c4b0 con 0x7f2ff008c730 2026-02-12T17:43:19.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.440+0000 7f2ff5c81640 10 monclient: get_auth_request con 0x7f2fc003fc40 auth_method 0 2026-02-12T17:43:19.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.443+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f2fe40173a0 con 0x7f2ff008c730 2026-02-12T17:43:19.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.443+0000 7f2fde7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:19.457 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.443+0000 7f2fde7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:19.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.587+0000 7f2ff7f0c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:43:19.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.587+0000 7f2ff7f0c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:19.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.587+0000 7f2ff7f0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.587+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2ff0055340 con 0x7f2ff008c730 2026-02-12T17:43:19.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.587+0000 7f2fde7fc640 1 -- 10.20.193.57:0/4035867497 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 345326718) 0x7f2fe4016b50 con 0x7f2ff008c730 2026-02-12T17:43:19.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.587+0000 7f2fde7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:19.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.587+0000 7f2fde7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:19.585 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:43:19.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.588+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 >> v1:10.20.193.82:6800/2441377515 conn(0x7f2fc003fc40 legacy=0x7f2fc00600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.588+0000 7f2ff7f0c640 10 monclient: shutdown 2026-02-12T17:43:19.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.588+0000 7f2ff7f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:19.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.588+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 >> v1:10.20.193.57:6789/0 conn(0x7f2ff008c730 legacy=0x7f2ff0119550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.588+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 shutdown_connections 2026-02-12T17:43:19.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.588+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 >> 10.20.193.57:0/4035867497 conn(0x7f2ff0091620 msgr2=0x7f2ff00597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:19.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.588+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 shutdown_connections 2026-02-12T17:43:19.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.588+0000 7f2ff7f0c640 1 -- 10.20.193.57:0/4035867497 wait complete. 2026-02-12T17:43:19.593 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:43:19.593 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:43:19.593 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:43:19.593 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:43:19.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.662+0000 7f12da2af640 10 monclient: get_monmap_and_config 2026-02-12T17:43:19.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.662+0000 7f12da2af640 10 monclient: build_initial_monmap 2026-02-12T17:43:19.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.662+0000 7f12da2af640 10 monclient: monmap: 2026-02-12T17:43:19.659 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:19.659 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.659 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:19.663114+0000 2026-02-12T17:43:19.659 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:19.663114+0000 2026-02-12T17:43:19.659 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:19.659 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.660 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:19.660 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:19.660 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:19.660 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.662+0000 7f12da2af640 1 Processor -- start 2026-02-12T17:43:19.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.662+0000 7f12da2af640 1 -- start start 2026-02-12T17:43:19.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.662+0000 7f12da2af640 10 monclient: init 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.662+0000 7f12da2af640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.662+0000 7f12da2af640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12da2af640 10 monclient(hunting): picked mon.noname-c con 0x7f12d4087e30 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12da2af640 10 monclient(hunting): picked mon.noname-a con 0x7f12d4085920 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12da2af640 10 monclient(hunting): picked mon.noname-b con 0x7f12d4088200 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12da2af640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d405ed40 con 0x7f12d4085920 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12da2af640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d4085da0 con 0x7f12d4087e30 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12da2af640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d4087400 con 0x7f12d4088200 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12da2af640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12da2af640 10 monclient(hunting): authenticate will time out at 1479.482055s 2026-02-12T17:43:19.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12d37fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f12d4085920 0x7f12d4183a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46914/0 (socket says 10.20.193.57:46914) 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.663+0000 7f12d37fe640 1 -- 10.20.193.57:0/2938809719 learned_addr learned my addr 10.20.193.57:0/2938809719 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d37fe640 1 -- 10.20.193.57:0/2938809719 >> v1:10.20.193.57:6789/0 conn(0x7f12d4085920 legacy=0x7f12d4183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d8825640 1 -- 10.20.193.57:0/2938809719 >> v1:10.20.193.57:6790/0 conn(0x7f12d4088200 legacy=0x7f12d41a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4031784840 0 0) 0x7f12d405ed40 con 0x7f12d4085920 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): my global_id is 74391 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12b80035e0 con 0x7f12d4085920 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2108599070 0 0) 0x7f12d4087400 con 0x7f12d4088200 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): my global_id is 104132 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12d405ed40 con 0x7f12d4088200 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d3fff640 1 -- 10.20.193.57:0/2938809719 >> v1:10.20.193.82:6789/0 conn(0x7f12d4087e30 legacy=0x7f12d4142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198728466 0 0) 0x7f12d4085da0 con 0x7f12d4087e30 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient(hunting): my global_id is 5152 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12d4087400 con 0x7f12d4087e30 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 462717161 0 0) 0x7f12b80035e0 con 0x7f12d4085920 2026-02-12T17:43:19.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 >> v1:10.20.193.57:6790/0 conn(0x7f12d4088200 legacy=0x7f12d41a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 >> v1:10.20.193.82:6789/0 conn(0x7f12d4087e30 legacy=0x7f12d4142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 monclient: found mon.noname-a 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d41434a0 con 0x7f12d4085920 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: _finish_auth 0 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f12c40030d0 con 0x7f12d4085920 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: dump: 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12da2af640 5 monclient: authenticate success, global_id 74391 2026-02-12T17:43:19.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12da2af640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12c40032e0 con 0x7f12d4085920 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12da2af640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12da2af640 4 set_mon_vals no callback set 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 1 -- 10.20.193.57:0/2938809719 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f12c4004960 con 0x7f12d4085920 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.665+0000 7f12d2ffd640 10 monclient: dump: 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.671 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 10 monclient: shutdown 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 1 -- 10.20.193.57:0/2938809719 >> v1:10.20.193.57:6789/0 conn(0x7f12d4085920 legacy=0x7f12d4183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 1 -- 10.20.193.57:0/2938809719 shutdown_connections 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 1 -- 10.20.193.57:0/2938809719 >> 10.20.193.57:0/2938809719 conn(0x7f12d40916b0 msgr2=0x7f12d4091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:19.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 1 -- 10.20.193.57:0/2938809719 shutdown_connections 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 1 -- 10.20.193.57:0/2938809719 wait complete. 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 10 monclient: build_initial_monmap 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 10 monclient: monmap: 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:19.673 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 1 Processor -- start 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 1 -- start start 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.666+0000 7f12da2af640 10 monclient: init 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 10 monclient(hunting): picked mon.noname-a con 0x7f12d4085920 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 10 monclient(hunting): picked mon.noname-b con 0x7f12d4087e30 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 10 monclient(hunting): picked mon.noname-c con 0x7f12d4088200 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d405e2c0 con 0x7f12d4085920 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d40888a0 con 0x7f12d4087e30 2026-02-12T17:43:19.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d4139ea0 con 0x7f12d4088200 2026-02-12T17:43:19.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:19.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12da2af640 10 monclient(hunting): authenticate will time out at 1479.486135s 2026-02-12T17:43:19.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12d3fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f12d4085920 0x7f12d4152b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46920/0 (socket says 10.20.193.57:46920) 2026-02-12T17:43:19.675 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.667+0000 7f12d3fff640 1 -- 10.20.193.57:0/83401484 learned_addr learned my addr 10.20.193.57:0/83401484 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:19.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d8825640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6790/0 conn(0x7f12d4088200 legacy=0x7f12d41954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d3fff640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6789/0 conn(0x7f12d4085920 legacy=0x7f12d4152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180921680 0 0) 0x7f12d405e2c0 con 0x7f12d4085920 2026-02-12T17:43:19.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): my global_id is 74394 2026-02-12T17:43:19.681 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a40035e0 con 0x7f12d4085920 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d37fe640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.82:6789/0 conn(0x7f12d4087e30 legacy=0x7f12d4193d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2312828425 0 0) 0x7f12a40035e0 con 0x7f12d4085920 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12d405e2c0 con 0x7f12d4085920 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f12c00033c0 con 0x7f12d4085920 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): dump: 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.682 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537832888 0 0) 0x7f12d40888a0 con 0x7f12d4087e30 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient(hunting): my global_id is 5155 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12a40035e0 con 0x7f12d4087e30 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1681417247 0 0) 0x7f12d405e2c0 con 0x7f12d4085920 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6790/0 conn(0x7f12d4088200 legacy=0x7f12d41954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.82:6789/0 conn(0x7f12d4087e30 legacy=0x7f12d4193d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 monclient: found mon.a 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d413c200 con 0x7f12d4085920 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient: _finish_auth 0 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:43:19.684 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12da2af640 5 monclient: authenticate success, global_id 74394 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12da2af640 10 monclient: _renew_subs 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12da2af640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f12d4140610 con 0x7f12d4085920 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12da2af640 10 monclient: _renew_subs 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12da2af640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f12d41394d0 con 0x7f12d4085920 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12c0003980 con 0x7f12d4085920 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f12c0003ce0 con 0x7f12d4085920 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:19.685 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d0ff9640 10 monclient: dump: 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.669+0000 7f12d27fc640 4 set_mon_vals no callback set 2026-02-12T17:43:19.686 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.670+0000 7f12da2af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.670+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f12d4090810 con 0x7f12d41a6ae0 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.670+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f12c0003f70 con 0x7f12d4085920 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.670+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(763..763 src has 508..763) ==== 3963+0+0 (unknown 3142021234 0 0) 0x7f12c004ec30 con 0x7f12d4085920 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.670+0000 7f12d8825640 10 monclient: get_auth_request con 0x7f12a403f880 auth_method 0 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d37fe640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6789/0 conn(0x7f12d41a6ae0 legacy=0x7f12d4089ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820524152 0 0) 0x7f12d4090810 con 0x7f12d41a6ae0 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 10 monclient(hunting): my global_id is 74397 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12d405e2c0 con 0x7f12d41a6ae0 2026-02-12T17:43:19.687 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1569279859 0 0) 0x7f12d405e2c0 con 0x7f12d41a6ae0 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12d4090810 con 0x7f12d41a6ae0 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f12c4002d70 con 0x7f12d41a6ae0 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 10 monclient: dump: 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.688 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2320388069 0 0) 0x7f12d4090810 con 0x7f12d41a6ae0 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12d413b960 con 0x7f12d41a6ae0 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f12c4007a20 con 0x7f12d41a6ae0 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6789/0 conn(0x7f12d41a6ae0 legacy=0x7f12d4089ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.672+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6789/0 conn(0x7f12d41a6ae0 legacy=0x7f12d4089ac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.676+0000 7f12da2af640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:43:19.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.676+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f12d413bdd0 con 0x7f12d4153260 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d37fe640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6789/0 conn(0x7f12d4153260 legacy=0x7f12d408a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473151439 0 0) 0x7f12d413bdd0 con 0x7f12d4153260 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 10 monclient(hunting): my global_id is 74400 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12d4090810 con 0x7f12d4153260 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3410911354 0 0) 0x7f12d4090810 con 0x7f12d4153260 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12d413bdd0 con 0x7f12d4153260 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f12c40053e0 con 0x7f12d4153260 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:19.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 10 monclient: dump: 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3093247667 0 0) 0x7f12d413bdd0 con 0x7f12d4153260 2026-02-12T17:43:19.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f12d408f5b0 con 0x7f12d4153260 2026-02-12T17:43:19.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 415420692) 0x7f12c4007b90 con 0x7f12d4153260 2026-02-12T17:43:19.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:43:19.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:19.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6789/0 conn(0x7f12d4153260 legacy=0x7f12d408a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.678+0000 7f12d0ff9640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6789/0 conn(0x7f12d4153260 legacy=0x7f12d408a1d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:19.692 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:43:19.692 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:19.692 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 58, 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 326142, 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:43:19.693 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.694 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:19.695 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:43:19.696 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:19.697 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:43:19.698 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.699 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:19.700 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:43:19.701 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:19.702 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:43:19.703 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.703 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.703 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.703 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:43:19.703 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.82:6800/2441377515 conn(0x7f12a403f880 legacy=0x7f12a405fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12da2af640 10 monclient: shutdown 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12da2af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 >> v1:10.20.193.57:6789/0 conn(0x7f12d4085920 legacy=0x7f12d4152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12d8825640 1 -- 10.20.193.57:0/83401484 reap_dead start 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12d8825640 1 -- 10.20.193.57:0/83401484 reap_dead start 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 shutdown_connections 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 >> 10.20.193.57:0/83401484 conn(0x7f12d40916b0 msgr2=0x7f12d405c600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 shutdown_connections 2026-02-12T17:43:19.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.679+0000 7f12da2af640 1 -- 10.20.193.57:0/83401484 wait complete. 2026-02-12T17:43:19.705 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:43:19.705 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:43:19.705 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:43:19.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient: get_monmap_and_config 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient: build_initial_monmap 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient: monmap: 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:19.775863+0000 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:19.775863+0000 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:19.772 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:19.773 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 1 Processor -- start 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 1 -- start start 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient: init 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient(hunting): picked mon.noname-b con 0x7f4c1008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient(hunting): picked mon.noname-c con 0x7f4c1008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient(hunting): picked mon.noname-a con 0x7f4c10182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c1008a820 con 0x7f4c10182cc0 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c10089450 con 0x7f4c1008c620 2026-02-12T17:43:19.774 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c10089730 con 0x7f4c1008c250 2026-02-12T17:43:19.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:19.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c14dae640 10 monclient(hunting): authenticate will time out at 1479.594771s 2026-02-12T17:43:19.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c0e575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f4c1008c250 0x7f4c1008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45684/0 (socket says 10.20.193.57:45684) 2026-02-12T17:43:19.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c0e575640 1 -- 10.20.193.57:0/2240309939 learned_addr learned my addr 10.20.193.57:0/2240309939 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:19.775 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.775+0000 7f4c0ed76640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f4c10182cc0 0x7f4c101a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46958/0 (socket says 10.20.193.57:46958) 2026-02-12T17:43:19.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.777+0000 7f4c0ed76640 1 -- 10.20.193.57:0/2240309939 >> v1:10.20.193.57:6789/0 conn(0x7f4c10182cc0 legacy=0x7f4c101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.777+0000 7f4c0e575640 1 -- 10.20.193.57:0/2240309939 >> v1:10.20.193.57:6790/0 conn(0x7f4c1008c250 legacy=0x7f4c1008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0dd74640 1 -- 10.20.193.57:0/2240309939 >> v1:10.20.193.82:6789/0 conn(0x7f4c1008c620 legacy=0x7f4c1008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0dd74640 1 -- 10.20.193.57:0/2240309939 >> v1:10.20.193.82:6789/0 conn(0x7f4c1008c620 legacy=0x7f4c1008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0dd74640 1 --1- 10.20.193.57:0/2240309939 >> v1:10.20.193.82:6789/0 conn(0x7f4c1008c620 0x7f4c1008caa0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=2 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973889683 0 0) 0x7f4c10089730 con 0x7f4c1008c250 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient(hunting): my global_id is 104135 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bfc0035e0 con 0x7f4c1008c250 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215062726 0 0) 0x7f4c00003d00 con 0x7f4c10182cc0 2026-02-12T17:43:19.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient(hunting): my global_id is 74403 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c10089730 con 0x7f4c10182cc0 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1332368890 0 0) 0x7f4bfc0035e0 con 0x7f4c1008c250 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 >> v1:10.20.193.82:6789/0 conn(0x7f4c1008c620 legacy=0x7f4c1008caa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 >> v1:10.20.193.57:6789/0 conn(0x7f4c10182cc0 legacy=0x7f4c101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: _finish_hunting 0 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 monclient: found mon.noname-b 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c10089a10 con 0x7f4c1008c250 2026-02-12T17:43:19.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: _finish_auth 0 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: _check_auth_tickets 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4c04003080 con 0x7f4c1008c250 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 5 monclient: authenticate success, global_id 104135 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: dump: 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.785 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c040032c0 con 0x7f4c1008c250 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 1 -- 10.20.193.57:0/2240309939 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4c04004960 con 0x7f4c1008c250 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c0d573640 10 monclient: dump: 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.786 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 4 set_mon_vals no callback set 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 10 monclient: shutdown 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:19.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 1 -- 10.20.193.57:0/2240309939 >> v1:10.20.193.57:6790/0 conn(0x7f4c1008c250 legacy=0x7f4c1008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 1 -- 10.20.193.57:0/2240309939 shutdown_connections 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 1 -- 10.20.193.57:0/2240309939 >> 10.20.193.57:0/2240309939 conn(0x7f4c100916b0 msgr2=0x7f4c10091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 1 -- 10.20.193.57:0/2240309939 shutdown_connections 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.778+0000 7f4c14dae640 1 -- 10.20.193.57:0/2240309939 wait complete. 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient: build_initial_monmap 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient: monmap: 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:19.788 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 1 Processor -- start 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 1 -- start start 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient: init 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient(hunting): picked mon.noname-c con 0x7f4c1008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient(hunting): picked mon.noname-a con 0x7f4c1008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient(hunting): picked mon.noname-b con 0x7f4c10182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c10139bc0 con 0x7f4c1008c620 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c100888a0 con 0x7f4c10182cc0 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c1013b0b0 con 0x7f4c1008c250 2026-02-12T17:43:19.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c14dae640 10 monclient(hunting): authenticate will time out at 1479.598724s 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c0e575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f4c1008c250 0x7f4c10138210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:45696/0 (socket says 10.20.193.57:45696) 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.779+0000 7f4c0e575640 1 -- 10.20.193.57:0/1480290592 learned_addr learned my addr 10.20.193.57:0/1480290592 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.781+0000 7f4c0dd74640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6789/0 conn(0x7f4c1008c620 legacy=0x7f4c10138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.781+0000 7f4c0e575640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6790/0 conn(0x7f4c1008c250 legacy=0x7f4c10138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.781+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078644546 0 0) 0x7f4c10139bc0 con 0x7f4c1008c620 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): my global_id is 74406 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bdc0035e0 con 0x7f4c1008c620 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180920478 0 0) 0x7f4c1013b0b0 con 0x7f4c1008c250 2026-02-12T17:43:19.790 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): my global_id is 104138 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c10139bc0 con 0x7f4c1008c250 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c0ed76640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.82:6789/0 conn(0x7f4c10182cc0 legacy=0x7f4c10139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2298254742 0 0) 0x7f4bdc0035e0 con 0x7f4c1008c620 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c1013b0b0 con 0x7f4c1008c620 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4bf8004310 con 0x7f4c1008c620 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): dump: 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.791 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2127431281 0 0) 0x7f4c10139bc0 con 0x7f4c1008c250 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4bdc0035e0 con 0x7f4c1008c250 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2606341442 0 0) 0x7f4c100888a0 con 0x7f4c10182cc0 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): my global_id is 5158 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c10139bc0 con 0x7f4c10182cc0 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4c04003430 con 0x7f4c1008c250 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient(hunting): dump: 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.793 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3883604898 0 0) 0x7f4c1013b0b0 con 0x7f4c1008c620 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6790/0 conn(0x7f4c1008c250 legacy=0x7f4c10138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.82:6789/0 conn(0x7f4c10182cc0 legacy=0x7f4c10139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 monclient: found mon.a 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1013bf20 con 0x7f4c1008c620 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient: _finish_auth 0 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:43:19.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c14dae640 5 monclient: authenticate success, global_id 74406 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c14dae640 10 monclient: _renew_subs 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c14dae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1013b680 con 0x7f4c1008c620 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c14dae640 10 monclient: _renew_subs 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c14dae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c101961c0 con 0x7f4c1008c620 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4bf8002950 con 0x7f4c1008c620 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4bf8002c70 con 0x7f4c1008c620 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:19.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4bf6ffd640 10 monclient: dump: 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c0cd72640 4 set_mon_vals no callback set 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c14dae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.782+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4c10090810 con 0x7f4c1005b7c0 2026-02-12T17:43:19.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.783+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f4bf8002f00 con 0x7f4c1008c620 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.783+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(763..763 src has 508..763) ==== 3963+0+0 (unknown 3142021234 0 0) 0x7f4bf804ebf0 con 0x7f4c1008c620 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.783+0000 7f4c0ed76640 10 monclient: get_auth_request con 0x7f4bdc03fd10 auth_method 0 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4c0e575640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6790/0 conn(0x7f4c1005b7c0 legacy=0x7f4c1005bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3154045255 0 0) 0x7f4c10090810 con 0x7f4c1005b7c0 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 10 monclient(hunting): my global_id is 104141 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c1013b0b0 con 0x7f4c1005b7c0 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1818081046 0 0) 0x7f4c1013b0b0 con 0x7f4c1005b7c0 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c10090810 con 0x7f4c1005b7c0 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4c04005030 con 0x7f4c1005b7c0 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 10 monclient: dump: 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3654866702 0 0) 0x7f4c10090810 con 0x7f4c1005b7c0 2026-02-12T17:43:19.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c1013f430 con 0x7f4c1005b7c0 2026-02-12T17:43:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f4c040052c0 con 0x7f4c1005b7c0 2026-02-12T17:43:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6790/0 conn(0x7f4c1005b7c0 legacy=0x7f4c1005bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.799 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.785+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6790/0 conn(0x7f4c1005b7c0 legacy=0x7f4c1005bb90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:19.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.788+0000 7f4c14dae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:43:19.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.788+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4c1008f580 con 0x7f4c1005c2a0 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4c0e575640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6790/0 conn(0x7f4c1005c2a0 legacy=0x7f4c10197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068019044 0 0) 0x7f4c1008f580 con 0x7f4c1005c2a0 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 10 monclient(hunting): my global_id is 104144 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c10090810 con 0x7f4c1005c2a0 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1406705627 0 0) 0x7f4c10090810 con 0x7f4c1005c2a0 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c1008f580 con 0x7f4c1005c2a0 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4c040058a0 con 0x7f4c1005c2a0 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 10 monclient: dump: 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.801 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4169503230 0 0) 0x7f4c1008f580 con 0x7f4c1005c2a0 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4c10055340 con 0x7f4c1005c2a0 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4336 (unknown 0 0 3050530361) 0x7f4c04007de0 con 0x7f4c1005c2a0 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6790/0 conn(0x7f4c1005c2a0 legacy=0x7f4c10197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.791+0000 7f4bf6ffd640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6790/0 conn(0x7f4c1005c2a0 legacy=0x7f4c10197520 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 58, 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 2162, 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:43:19.803 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:19.804 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:19.805 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:43:19.806 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:19.807 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:19.808 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:43:19.809 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:43:19.810 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:19.811 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:43:19.812 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:43:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.82:6800/2441377515 conn(0x7f4bdc03fd10 legacy=0x7f4bdc0601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c14dae640 10 monclient: shutdown 2026-02-12T17:43:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c14dae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 >> v1:10.20.193.57:6789/0 conn(0x7f4c1008c620 legacy=0x7f4c10138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c0ed76640 1 -- 10.20.193.57:0/1480290592 reap_dead start 2026-02-12T17:43:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c0ed76640 1 -- 10.20.193.57:0/1480290592 reap_dead start 2026-02-12T17:43:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 shutdown_connections 2026-02-12T17:43:19.813 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 >> 10.20.193.57:0/1480290592 conn(0x7f4c100916b0 msgr2=0x7f4c1008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:19.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 shutdown_connections 2026-02-12T17:43:19.814 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.792+0000 7f4c14dae640 1 -- 10.20.193.57:0/1480290592 wait complete. 2026-02-12T17:43:19.814 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:43:19.814 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:43:19.814 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:43:19.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient: get_monmap_and_config 2026-02-12T17:43:19.879 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient: build_initial_monmap 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient: monmap: 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:19.883885+0000 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:19.883885+0000 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:19.880 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 1 Processor -- start 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 1 -- start start 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient: init 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient(hunting): picked mon.noname-a con 0x7f5948087e30 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient(hunting): picked mon.noname-b con 0x7f5948085920 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient(hunting): picked mon.noname-c con 0x7f5948088200 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594805ed40 con 0x7f5948087e30 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5948085da0 con 0x7f5948088200 2026-02-12T17:43:19.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5948087400 con 0x7f5948085920 2026-02-12T17:43:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f594d70c640 10 monclient(hunting): authenticate will time out at 1479.702795s 2026-02-12T17:43:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f5946ffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f5948087e30 0x7f5948142d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46966/0 (socket says 10.20.193.57:46966) 2026-02-12T17:43:19.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.883+0000 7f5946ffd640 1 -- 10.20.193.57:0/3355945607 learned_addr learned my addr 10.20.193.57:0/3355945607 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:19.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5946ffd640 1 -- 10.20.193.57:0/3355945607 >> v1:10.20.193.57:6789/0 conn(0x7f5948087e30 legacy=0x7f5948142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f59467fc640 1 -- 10.20.193.57:0/3355945607 >> v1:10.20.193.57:6790/0 conn(0x7f5948085920 legacy=0x7f5948183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253238683 0 0) 0x7f594805ed40 con 0x7f5948087e30 2026-02-12T17:43:19.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient(hunting): my global_id is 74409 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59340035e0 con 0x7f5948087e30 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f59477fe640 1 -- 10.20.193.57:0/3355945607 >> v1:10.20.193.82:6789/0 conn(0x7f5948088200 legacy=0x7f59481a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396915558 0 0) 0x7f5948087400 con 0x7f5948085920 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient(hunting): my global_id is 104147 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f594805ed40 con 0x7f5948085920 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 107595661 0 0) 0x7f59340035e0 con 0x7f5948087e30 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 >> v1:10.20.193.57:6790/0 conn(0x7f5948085920 legacy=0x7f5948183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 >> v1:10.20.193.82:6789/0 conn(0x7f5948088200 legacy=0x7f59481a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 monclient: found mon.noname-a 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59481434a0 con 0x7f5948087e30 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: _finish_auth 0 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f593c0030d0 con 0x7f5948087e30 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 5 monclient: authenticate success, global_id 74409 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: dump: 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f593c0033d0 con 0x7f5948087e30 2026-02-12T17:43:19.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 1 -- 10.20.193.57:0/3355945607 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f593c004b10 con 0x7f5948087e30 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 4 set_mon_vals no callback set 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f5945ffb640 10 monclient: dump: 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.893 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 10 monclient: shutdown 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 1 -- 10.20.193.57:0/3355945607 >> v1:10.20.193.57:6789/0 conn(0x7f5948087e30 legacy=0x7f5948142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 1 -- 10.20.193.57:0/3355945607 shutdown_connections 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 1 -- 10.20.193.57:0/3355945607 >> 10.20.193.57:0/3355945607 conn(0x7f59480916b0 msgr2=0x7f5948091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 1 -- 10.20.193.57:0/3355945607 shutdown_connections 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.886+0000 7f594d70c640 1 -- 10.20.193.57:0/3355945607 wait complete. 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient: build_initial_monmap 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient: monmap: 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:19.894 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 1 Processor -- start 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 1 -- start start 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient: init 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:43:19.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient(hunting): picked mon.noname-b con 0x7f5948085920 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient(hunting): picked mon.noname-a con 0x7f5948087e30 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient(hunting): picked mon.noname-c con 0x7f5948088200 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594805e310 con 0x7f5948087e30 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59480888a0 con 0x7f5948085920 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5948139ed0 con 0x7f5948088200 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f594d70c640 10 monclient(hunting): authenticate will time out at 1479.706799s 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f59467fc640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f5948087e30 0x7f5948193d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46972/0 (socket says 10.20.193.57:46972) 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.887+0000 7f59467fc640 1 -- 10.20.193.57:0/2865994771 learned_addr learned my addr 10.20.193.57:0/2865994771 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.889+0000 7f59467fc640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.57:6789/0 conn(0x7f5948087e30 legacy=0x7f5948193d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.889+0000 7f59477fe640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.57:6790/0 conn(0x7f5948088200 legacy=0x7f59481954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729188505 0 0) 0x7f594805e310 con 0x7f5948087e30 2026-02-12T17:43:19.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): my global_id is 74412 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59140035e0 con 0x7f5948087e30 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026976536 0 0) 0x7f5948139ed0 con 0x7f5948088200 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): my global_id is 104150 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f594805e310 con 0x7f5948088200 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f5946ffd640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.82:6789/0 conn(0x7f5948085920 legacy=0x7f5948152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3504110477 0 0) 0x7f59140035e0 con 0x7f5948087e30 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5948139ed0 con 0x7f5948087e30 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5930002e80 con 0x7f5948087e30 2026-02-12T17:43:19.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): dump: 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 897197759 0 0) 0x7f594805e310 con 0x7f5948088200 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59140035e0 con 0x7f5948088200 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5938004420 con 0x7f5948088200 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient(hunting): dump: 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.899 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1986550447 0 0) 0x7f5948139ed0 con 0x7f5948087e30 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.57:6790/0 conn(0x7f5948088200 legacy=0x7f59481954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.82:6789/0 conn(0x7f5948085920 legacy=0x7f5948152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient: _finish_hunting 0 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 monclient: found mon.a 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594813c230 con 0x7f5948087e30 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient: _finish_auth 0 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient: _check_auth_tickets 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:19.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f594d70c640 5 monclient: authenticate success, global_id 74412 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f594d70c640 10 monclient: _renew_subs 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f594d70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f594813aa30 con 0x7f5948087e30 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f594d70c640 10 monclient: _renew_subs 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f594d70c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5948139420 con 0x7f5948087e30 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5930003980 con 0x7f5948087e30 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5930003d10 con 0x7f5948087e30 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59457fa640 4 set_mon_vals no callback set 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f59277fe640 10 monclient: dump: 2026-02-12T17:43:19.901 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f594d70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.890+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5948090810 con 0x7f5948139670 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.891+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5930003fa0 con 0x7f5948087e30 2026-02-12T17:43:19.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.891+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(763..763 src has 508..763) ==== 3963+0+0 (unknown 3142021234 0 0) 0x7f593004eca0 con 0x7f5948087e30 2026-02-12T17:43:19.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.891+0000 7f59477fe640 10 monclient: get_auth_request con 0x7f591403fae0 auth_method 0 2026-02-12T17:43:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f5946ffd640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.82:6789/0 conn(0x7f5948139670 legacy=0x7f5948089c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 794492101 0 0) 0x7f5948090810 con 0x7f5948139670 2026-02-12T17:43:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 10 monclient(hunting): my global_id is 5167 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5948139ed0 con 0x7f5948139670 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 892778657 0 0) 0x7f5948139ed0 con 0x7f5948139670 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5948090810 con 0x7f5948139670 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f593c002af0 con 0x7f5948139670 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 10 monclient: dump: 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.906 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1671822987 0 0) 0x7f5948090810 con 0x7f5948139670 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f594808f5b0 con 0x7f5948139670 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f593c002fa0 con 0x7f5948139670 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.82:6789/0 conn(0x7f5948139670 legacy=0x7f5948089c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.893+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.82:6789/0 conn(0x7f5948139670 legacy=0x7f5948089c00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.897+0000 7f594d70c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.897+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5948055340 con 0x7f59481a6ae0 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.899+0000 7f5946ffd640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.82:6789/0 conn(0x7f59481a6ae0 legacy=0x7f594804d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:19.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.899+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 666231639 0 0) 0x7f5948055340 con 0x7f59481a6ae0 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.899+0000 7f59277fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.899+0000 7f59277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.899+0000 7f59277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.899+0000 7f59277fe640 10 monclient(hunting): my global_id is 5170 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.899+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5948090810 con 0x7f59481a6ae0 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2467466903 0 0) 0x7f5948090810 con 0x7f59481a6ae0 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5948055340 con 0x7f59481a6ae0 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f593c0053a0 con 0x7f59481a6ae0 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 10 monclient: dump: 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.908 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3650608995 0 0) 0x7f5948055340 con 0x7f59481a6ae0 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f594804d8d0 con 0x7f59481a6ae0 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4674 (unknown 0 0 3908813535) 0x7f593c007600 con 0x7f59481a6ae0 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.82:6789/0 conn(0x7f59481a6ae0 legacy=0x7f594804d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59277fe640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.82:6789/0 conn(0x7f59481a6ae0 legacy=0x7f594804d1c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 58, 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 921395, 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:43:19.910 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:19.911 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:19.912 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:43:19.913 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:19.914 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.915 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:19.916 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:43:19.917 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:19.918 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:19.919 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:19.920 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:19.920 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:19.920 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:19.920 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:19.920 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:19.920 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:43:19.920 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.82:6800/2441377515 conn(0x7f591403fae0 legacy=0x7f591405ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f594d70c640 10 monclient: shutdown 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f594d70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 >> v1:10.20.193.57:6789/0 conn(0x7f5948087e30 legacy=0x7f5948193d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59477fe640 1 -- 10.20.193.57:0/2865994771 reap_dead start 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f59477fe640 1 -- 10.20.193.57:0/2865994771 reap_dead start 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 shutdown_connections 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 >> 10.20.193.57:0/2865994771 conn(0x7f59480916b0 msgr2=0x7f594805d800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 shutdown_connections 2026-02-12T17:43:19.921 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:19.900+0000 7f594d70c640 1 -- 10.20.193.57:0/2865994771 wait complete. 2026-02-12T17:43:19.922 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:43:19.922 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-12T17:43:19.922 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T17:43:19.922 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-12T17:43:19.922 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-12T17:43:19.922 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T17:43:19.922 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:43:19.930 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T17:43:19.930 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:43:19.931 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:43:20.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient: get_monmap_and_config 2026-02-12T17:43:20.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient: build_initial_monmap 2026-02-12T17:43:20.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient: monmap: 2026-02-12T17:43:20.036 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:20.036 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:20.036 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:20.038945+0000 2026-02-12T17:43:20.036 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:20.038945+0000 2026-02-12T17:43:20.036 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 1 Processor -- start 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 1 -- start start 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient: init 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient(hunting): picked mon.noname-a con 0x7fad3408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:20.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient(hunting): picked mon.noname-c con 0x7fad3408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:20.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient(hunting): picked mon.noname-b con 0x7fad3408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:20.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3408d600 con 0x7fad3408ae20 2026-02-12T17:43:20.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3408b1f0 con 0x7fad3408c730 2026-02-12T17:43:20.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3408d1f0 con 0x7fad3408cb30 2026-02-12T17:43:20.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:20.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad3a594640 10 monclient(hunting): authenticate will time out at 1479.857795s 2026-02-12T17:43:20.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad38b0a640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fad3408cb30 legacy=0x7fad341a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:20.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad33fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fad3408ae20 0x7fad3408c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46984/0 (socket says 10.20.193.57:46984) 2026-02-12T17:43:20.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.038+0000 7fad33fff640 1 -- 10.20.193.57:0/1081352742 learned_addr learned my addr 10.20.193.57:0/1081352742 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:20.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad33fff640 1 -- 10.20.193.57:0/1081352742 >> v1:10.20.193.57:6789/0 conn(0x7fad3408ae20 legacy=0x7fad3408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:20.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261676233 0 0) 0x7fad3408d600 con 0x7fad3408ae20 2026-02-12T17:43:20.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:20.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:20.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient(hunting): my global_id is 74415 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad337fe640 1 -- 10.20.193.57:0/1081352742 >> v1:10.20.193.82:6789/0 conn(0x7fad3408c730 legacy=0x7fad34181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad180035e0 con 0x7fad3408ae20 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859055310 0 0) 0x7fad3408b1f0 con 0x7fad3408c730 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient(hunting): my global_id is 5173 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad3408d600 con 0x7fad3408c730 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4118432021 0 0) 0x7fad180035e0 con 0x7fad3408ae20 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 >> v1:10.20.193.57:6790/0 conn(0x7fad3408cb30 legacy=0x7fad341a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:43:20.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 >> v1:10.20.193.82:6789/0 conn(0x7fad3408c730 legacy=0x7fad34181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 monclient: found mon.noname-a 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad34057320 con 0x7fad3408ae20 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: _finish_auth 0 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fad200030d0 con 0x7fad3408ae20 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:20.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: dump: 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 5 monclient: authenticate success, global_id 74415 2026-02-12T17:43:20.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad20003360 con 0x7fad3408ae20 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 4 set_mon_vals no callback set 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 1 -- 10.20.193.57:0/1081352742 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fad20004b10 con 0x7fad3408ae20 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad32ffd640 10 monclient: dump: 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:20.049 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 10 monclient: shutdown 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 1 -- 10.20.193.57:0/1081352742 >> v1:10.20.193.57:6789/0 conn(0x7fad3408ae20 legacy=0x7fad3408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 1 -- 10.20.193.57:0/1081352742 shutdown_connections 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 1 -- 10.20.193.57:0/1081352742 >> 10.20.193.57:0/1081352742 conn(0x7fad34091620 msgr2=0x7fad34091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:20.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 1 -- 10.20.193.57:0/1081352742 shutdown_connections 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.041+0000 7fad3a594640 1 -- 10.20.193.57:0/1081352742 wait complete. 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient: build_initial_monmap 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient: monmap: 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:20.051 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 1 Processor -- start 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 1 -- start start 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient: init 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient(hunting): picked mon.noname-c con 0x7fad3408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient(hunting): picked mon.noname-a con 0x7fad3408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient(hunting): picked mon.noname-b con 0x7fad3408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3408d9c0 con 0x7fad3408c730 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad34088810 con 0x7fad3408cb30 2026-02-12T17:43:20.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad3405cc50 con 0x7fad3408ae20 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad3a594640 10 monclient(hunting): authenticate will time out at 1479.861775s 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad33fff640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7fad3408ae20 legacy=0x7fad34088b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad337fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fad3408c730 0x7fad34089230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46990/0 (socket says 10.20.193.57:46990) 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.042+0000 7fad337fe640 1 -- 10.20.193.57:0/3155382384 learned_addr learned my addr 10.20.193.57:0/3155382384 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.044+0000 7fad337fe640 1 -- 10.20.193.57:0/3155382384 >> v1:10.20.193.57:6789/0 conn(0x7fad3408c730 legacy=0x7fad34089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725644086 0 0) 0x7fad3408d9c0 con 0x7fad3408c730 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient(hunting): my global_id is 74418 2026-02-12T17:43:20.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad040035e0 con 0x7fad3408c730 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2383832724 0 0) 0x7fad040035e0 con 0x7fad3408c730 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad3408d9c0 con 0x7fad3408c730 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fad24003450 con 0x7fad3408c730 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient(hunting): dump: 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:20.054 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3175661 0 0) 0x7fad3408d9c0 con 0x7fad3408c730 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad38b0a640 1 -- 10.20.193.57:0/3155382384 >> v1:10.20.193.82:6789/0 conn(0x7fad3408cb30 legacy=0x7fad341a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 >> v1:10.20.193.57:6790/0 conn(0x7fad3408ae20 legacy=0x7fad34088b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 >> v1:10.20.193.82:6789/0 conn(0x7fad3408cb30 legacy=0x7fad341a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 monclient: found mon.a 2026-02-12T17:43:20.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad34089940 con 0x7fad3408c730 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient: _finish_auth 0 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 5 monclient: authenticate success, global_id 74418 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 10 monclient: _renew_subs 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad341204f0 con 0x7fad3408c730 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 10 monclient: _renew_subs 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fad3411ae00 con 0x7fad3408c730 2026-02-12T17:43:20.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad24003b80 con 0x7fad3408c730 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fad24003750 con 0x7fad3408c730 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad327fc640 4 set_mon_vals no callback set 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad30ff9640 10 monclient: dump: 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:20.057 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.045+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad3405a6a0 con 0x7fad3408c730 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.046+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fad24004000 con 0x7fad3408c730 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.046+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(763..763 src has 508..763) ==== 3963+0+0 (unknown 3142021234 0 0) 0x7fad2404eda0 con 0x7fad3408c730 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.046+0000 7fad33fff640 10 monclient: get_auth_request con 0x7fad0403f510 auth_method 0 2026-02-12T17:43:20.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.048+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fad240174a0 con 0x7fad3408c730 2026-02-12T17:43:20.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.048+0000 7fad30ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:20.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.048+0000 7fad30ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:20.191 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.194+0000 7fad3a594640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:43:20.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.194+0000 7fad3a594640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:20.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.194+0000 7fad3a594640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:20.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.194+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fad34055340 con 0x7fad3408c730 2026-02-12T17:43:20.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.194+0000 7fad30ff9640 1 -- 10.20.193.57:0/3155382384 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 1715275169) 0x7fad24016c50 con 0x7fad3408c730 2026-02-12T17:43:20.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.194+0000 7fad30ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:20.192 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.194+0000 7fad30ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:20.192 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:43:20.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.196+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 >> v1:10.20.193.82:6800/2441377515 conn(0x7fad0403f510 legacy=0x7fad0405f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:20.193 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.196+0000 7fad3a594640 10 monclient: shutdown 2026-02-12T17:43:20.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.196+0000 7fad3a594640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:20.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.196+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 >> v1:10.20.193.57:6789/0 conn(0x7fad3408c730 legacy=0x7fad34089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:20.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.196+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 shutdown_connections 2026-02-12T17:43:20.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.196+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 >> 10.20.193.57:0/3155382384 conn(0x7fad34091620 msgr2=0x7fad340597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:20.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.196+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 shutdown_connections 2026-02-12T17:43:20.194 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:20.196+0000 7fad3a594640 1 -- 10.20.193.57:0/3155382384 wait complete. 2026-02-12T17:43:23.202 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:43:23.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.271+0000 7ff00a4cc640 10 monclient: get_monmap_and_config 2026-02-12T17:43:23.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.271+0000 7ff00a4cc640 10 monclient: build_initial_monmap 2026-02-12T17:43:23.269 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.271+0000 7ff00a4cc640 10 monclient: monmap: 2026-02-12T17:43:23.269 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:23.269 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:23.272203+0000 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:23.272203+0000 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.271+0000 7ff00a4cc640 1 Processor -- start 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.271+0000 7ff00a4cc640 1 -- start start 2026-02-12T17:43:23.270 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.271+0000 7ff00a4cc640 10 monclient: init 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff00408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff00408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff00408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00408d600 con 0x7ff00408c730 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00408b1f0 con 0x7ff00408ae20 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00408d1f0 con 0x7ff00408cb30 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff00a4cc640 10 monclient(hunting): authenticate will time out at 1483.091083s 2026-02-12T17:43:23.271 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff008a42640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7ff00408cb30 legacy=0x7ff0041a3310 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:23.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff0037fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff00408c730 0x7ff004181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34892/0 (socket says 10.20.193.57:34892) 2026-02-12T17:43:23.272 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.272+0000 7ff0037fe640 1 -- 10.20.193.57:0/111602898 learned_addr learned my addr 10.20.193.57:0/111602898 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:23.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.274+0000 7ff0037fe640 1 -- 10.20.193.57:0/111602898 >> v1:10.20.193.57:6789/0 conn(0x7ff00408c730 legacy=0x7ff004181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:23.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.274+0000 7ff003fff640 1 -- 10.20.193.57:0/111602898 >> v1:10.20.193.82:6789/0 conn(0x7ff00408ae20 legacy=0x7ff00408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:23.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.274+0000 7ff002ffd640 1 -- 10.20.193.57:0/111602898 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4235788733 0 0) 0x7ff00408b1f0 con 0x7ff00408ae20 2026-02-12T17:43:23.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.274+0000 7ff002ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:23.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.274+0000 7ff002ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:23.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.274+0000 7ff002ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:23.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.274+0000 7ff002ffd640 10 monclient(hunting): my global_id is 5179 2026-02-12T17:43:23.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.274+0000 7ff002ffd640 1 -- 10.20.193.57:0/111602898 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefe80035e0 con 0x7ff00408ae20 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 1 -- 10.20.193.57:0/111602898 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2420734396 0 0) 0x7fefe80035e0 con 0x7ff00408ae20 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 1 -- 10.20.193.57:0/111602898 >> v1:10.20.193.57:6790/0 conn(0x7ff00408cb30 legacy=0x7ff0041a3310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 1 -- 10.20.193.57:0/111602898 >> v1:10.20.193.57:6789/0 conn(0x7ff00408c730 legacy=0x7ff004181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 1 monclient: found mon.noname-c 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 1 -- 10.20.193.57:0/111602898 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff004057320 con 0x7ff00408ae20 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: _finish_auth 0 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 1 -- 10.20.193.57:0/111602898 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feff0003120 con 0x7ff00408ae20 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 5 monclient: authenticate success, global_id 5179 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: dump: 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:23.281 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 1 -- 10.20.193.57:0/111602898 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feff00033b0 con 0x7ff00408ae20 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 4 set_mon_vals no callback set 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 1 -- 10.20.193.57:0/111602898 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feff0003880 con 0x7ff00408ae20 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff002ffd640 10 monclient: dump: 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 10 monclient: shutdown 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 1 -- 10.20.193.57:0/111602898 >> v1:10.20.193.82:6789/0 conn(0x7ff00408ae20 legacy=0x7ff00408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 1 -- 10.20.193.57:0/111602898 shutdown_connections 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 1 -- 10.20.193.57:0/111602898 >> 10.20.193.57:0/111602898 conn(0x7ff004091620 msgr2=0x7ff004091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 1 -- 10.20.193.57:0/111602898 shutdown_connections 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 1 -- 10.20.193.57:0/111602898 wait complete. 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 10 monclient: build_initial_monmap 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.275+0000 7ff00a4cc640 10 monclient: monmap: 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:23.284 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 1 Processor -- start 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 1 -- start start 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 10 monclient: init 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 10 monclient(hunting): picked mon.noname-a con 0x7ff00408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 10 monclient(hunting): picked mon.noname-c con 0x7ff00408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff00408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00408d9c0 con 0x7ff00408ae20 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0040832d0 con 0x7ff00408cb30 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff004088810 con 0x7ff00408c730 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff00a4cc640 10 monclient(hunting): authenticate will time out at 1483.095437s 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff0037fe640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7ff00408c730 legacy=0x7ff004194030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff003fff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff00408ae20 0x7ff004153350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34898/0 (socket says 10.20.193.57:34898) 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.276+0000 7ff003fff640 1 -- 10.20.193.57:0/1265120492 learned_addr learned my addr 10.20.193.57:0/1265120492 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.278+0000 7ff003fff640 1 -- 10.20.193.57:0/1265120492 >> v1:10.20.193.57:6789/0 conn(0x7ff00408ae20 legacy=0x7ff004153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.278+0000 7ff008a42640 1 -- 10.20.193.57:0/1265120492 >> v1:10.20.193.82:6789/0 conn(0x7ff00408cb30 legacy=0x7ff004195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.278+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297878636 0 0) 0x7ff0040832d0 con 0x7ff00408cb30 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.278+0000 7ff000ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.278+0000 7ff000ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.278+0000 7ff000ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient(hunting): my global_id is 5182 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefd40035e0 con 0x7ff00408cb30 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3502046192 0 0) 0x7fefd40035e0 con 0x7ff00408cb30 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0040832d0 con 0x7ff00408cb30 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feff8005400 con 0x7ff00408cb30 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient(hunting): dump: 2026-02-12T17:43:23.287 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4219984596 0 0) 0x7ff0040832d0 con 0x7ff00408cb30 2026-02-12T17:43:23.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 >> v1:10.20.193.57:6790/0 conn(0x7ff00408c730 legacy=0x7ff004194030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 >> v1:10.20.193.57:6789/0 conn(0x7ff00408ae20 legacy=0x7ff004153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 monclient: found mon.b 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff004084d90 con 0x7ff00408cb30 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient: _finish_auth 0 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff00a4cc640 5 monclient: authenticate success, global_id 5182 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff00a4cc640 10 monclient: _renew_subs 2026-02-12T17:43:23.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff00a4cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff004085070 con 0x7ff00408cb30 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff00a4cc640 10 monclient: _renew_subs 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff00a4cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff004083e30 con 0x7ff00408cb30 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feff8005700 con 0x7ff00408cb30 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feff8005a60 con 0x7ff00408cb30 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff000ff9640 10 monclient: dump: 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:23.290 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.279+0000 7ff0027fc640 4 set_mon_vals no callback set 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.280+0000 7ff00a4cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.280+0000 7ff00a4cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.280+0000 7ff00a4cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:23.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.280+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0040008d0 con 0x7ff00408cb30 2026-02-12T17:43:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.280+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7feff8005cf0 con 0x7ff00408cb30 2026-02-12T17:43:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.280+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(763..763 src has 508..763) ==== 3963+0+0 (unknown 3142021234 0 0) 0x7feff804fb20 con 0x7ff00408cb30 2026-02-12T17:43:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.280+0000 7ff003fff640 10 monclient: get_auth_request con 0x7fefd403f680 auth_method 0 2026-02-12T17:43:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.283+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7feff80182d0 con 0x7ff00408cb30 2026-02-12T17:43:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.283+0000 7ff000ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.283+0000 7ff000ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:23.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.426+0000 7ff00a4cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:43:23.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.426+0000 7ff00a4cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:23.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.426+0000 7ff00a4cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:43:23.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.426+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff00408f500 con 0x7ff00408cb30 2026-02-12T17:43:23.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.427+0000 7ff000ff9640 1 -- 10.20.193.57:0/1265120492 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 1370385157) 0x7feff8017a80 con 0x7ff00408cb30 2026-02-12T17:43:23.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.427+0000 7ff000ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:23.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.427+0000 7ff000ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:23.425 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":58,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:43:23.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.428+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 >> v1:10.20.193.82:6800/2441377515 conn(0x7fefd403f680 legacy=0x7fefd405fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:23.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.428+0000 7ff00a4cc640 10 monclient: shutdown 2026-02-12T17:43:23.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.428+0000 7ff00a4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:23.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.428+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 >> v1:10.20.193.82:6789/0 conn(0x7ff00408cb30 legacy=0x7ff004195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:23.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.428+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 shutdown_connections 2026-02-12T17:43:23.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.428+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 >> 10.20.193.57:0/1265120492 conn(0x7ff004091620 msgr2=0x7ff004089310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:23.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.428+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 shutdown_connections 2026-02-12T17:43:23.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:23.428+0000 7ff00a4cc640 1 -- 10.20.193.57:0/1265120492 wait complete. 2026-02-12T17:43:26.433 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:43:26.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.503+0000 7ff17885b640 10 monclient: get_monmap_and_config 2026-02-12T17:43:26.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.503+0000 7ff17885b640 10 monclient: build_initial_monmap 2026-02-12T17:43:26.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.503+0000 7ff17885b640 10 monclient: monmap: 2026-02-12T17:43:26.500 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:26.500 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:26.500 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:26.504295+0000 2026-02-12T17:43:26.501 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:26.504295+0000 2026-02-12T17:43:26.501 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:26.501 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:26.501 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:26.501 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:26.501 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:26.501 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:26.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.503+0000 7ff17885b640 1 Processor -- start 2026-02-12T17:43:26.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.503+0000 7ff17885b640 1 -- start start 2026-02-12T17:43:26.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.503+0000 7ff17885b640 10 monclient: init 2026-02-12T17:43:26.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:26.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:43:26.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 10 monclient(hunting): picked mon.noname-b con 0x7ff17008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:26.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 10 monclient(hunting): picked mon.noname-a con 0x7ff17008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:26.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 10 monclient(hunting): picked mon.noname-c con 0x7ff17008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17008d600 con 0x7ff17008c730 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17008b1f0 con 0x7ff17008cb30 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17008d1f0 con 0x7ff17008ae20 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff17885b640 10 monclient(hunting): authenticate will time out at 1486.323160s 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff1765d0640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff17008c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff175dcf640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff17008c730 0x7ff170181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:34904/0 (socket says 10.20.193.57:34904) 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.504+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 learned_addr learned my addr 10.20.193.57:0/2564926628 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.506+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6789/0 conn(0x7ff17008c730 legacy=0x7ff170181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:26.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.506+0000 7ff176dd1640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.82:6789/0 conn(0x7ff17008cb30 legacy=0x7ff1701a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:26.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:26.705+0000 7ff1765d0640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff17008c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:27.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:27.107+0000 7ff1765d0640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff17008c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:27.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:27.908+0000 7ff1765d0640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff17008c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:29.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 10 monclient(hunting): tick 2026-02-12T17:43:29.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:43:29.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 1 monclient(hunting): continuing hunt 2026-02-12T17:43:29.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff17008c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.82:6789/0 conn(0x7ff17008cb30 legacy=0x7ff1701a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6789/0 conn(0x7ff17008c730 legacy=0x7ff170181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 10 monclient(hunting): picked mon.noname-a con 0x7ff17008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 10 monclient(hunting): picked mon.noname-b con 0x7ff17008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 10 monclient(hunting): picked mon.noname-c con 0x7ff17008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff170057320 con 0x7ff17008c730 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17008d1f0 con 0x7ff17008cb30 2026-02-12T17:43:29.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:29.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff15006a0a0 con 0x7ff17008ae20 2026-02-12T17:43:29.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.504+0000 7ff15bfff640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:29.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.506+0000 7ff1765d0640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6789/0 conn(0x7ff17008c730 legacy=0x7ff150023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:29.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.506+0000 7ff176dd1640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.82:6789/0 conn(0x7ff17008cb30 legacy=0x7ff150066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:29.702 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:29.705+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:30.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:30.106+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:30.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:30.907+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:32.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 10 monclient(hunting): tick 2026-02-12T17:43:32.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:43:32.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 1 monclient(hunting): continuing hunt 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.82:6789/0 conn(0x7ff17008cb30 legacy=0x7ff150066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6789/0 conn(0x7ff17008c730 legacy=0x7ff150023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 10 monclient(hunting): picked mon.noname-c con 0x7ff17008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 10 monclient(hunting): picked mon.noname-b con 0x7ff17008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 10 monclient(hunting): picked mon.noname-a con 0x7ff17008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff15006b3c0 con 0x7ff17008c730 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff15006a0a0 con 0x7ff17008cb30 2026-02-12T17:43:32.503 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 1 -- 10.20.193.57:0/2564926628 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff15006a460 con 0x7ff17008ae20 2026-02-12T17:43:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.504+0000 7ff15bfff640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.506+0000 7ff176dd1640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6789/0 conn(0x7ff17008c730 legacy=0x7ff150023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:32.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.506+0000 7ff1765d0640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.82:6789/0 conn(0x7ff17008cb30 legacy=0x7ff150066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:32.701 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:32.705+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:33.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:33.106+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:33.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:33.907+0000 7ff175dcf640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:34.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 1 -- 10.20.193.57:0/2564926628 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160024774 0 0) 0x7ff15006b3c0 con 0x7ff17008c730 2026-02-12T17:43:34.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient(hunting): my global_id is 74421 2026-02-12T17:43:34.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 1 -- 10.20.193.57:0/2564926628 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1600035e0 con 0x7ff17008c730 2026-02-12T17:43:34.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 1 -- 10.20.193.57:0/2564926628 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1069231011 0 0) 0x7ff1600035e0 con 0x7ff17008c730 2026-02-12T17:43:34.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff150045080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:43:34.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.82:6789/0 conn(0x7ff17008cb30 legacy=0x7ff150066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient: _finish_hunting 0 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 1 monclient: found mon.noname-a 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 1 -- 10.20.193.57:0/2564926628 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15006a6b0 con 0x7ff17008c730 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient: _finish_auth 0 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient: _check_auth_tickets 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 1 -- 10.20.193.57:0/2564926628 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff1640041c0 con 0x7ff17008c730 2026-02-12T17:43:34.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff1755ce640 10 monclient: dump: 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.151 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.152 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff17885b640 5 monclient: authenticate success, global_id 74421 2026-02-12T17:43:34.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.151+0000 7ff17885b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:34.154 INFO:tasks.rados.rados.0.trial082.stdout:3470: done (0 left) 2026-02-12T17:43:34.154 INFO:tasks.rados.rados.0.trial082.stdout:3471: read oid 1 snap -1 2026-02-12T17:43:34.155 INFO:tasks.rados.rados.0.trial082.stdout:3471: expect (ObjNum 1103 snap 346 seq_num 1103) 2026-02-12T17:43:34.155 INFO:tasks.rados.rados.0.trial082.stdout:3472: read oid 49 snap -1 2026-02-12T17:43:34.155 INFO:tasks.rados.rados.0.trial082.stdout:3472: expect (ObjNum 1179 snap 379 seq_num 1179) 2026-02-12T17:43:34.155 INFO:tasks.rados.rados.0.trial082.stdout:3473: read oid 48 snap -1 2026-02-12T17:43:34.155 INFO:tasks.rados.rados.0.trial082.stdout:3473: expect (ObjNum 1095 snap 345 seq_num 1095) 2026-02-12T17:43:34.155 INFO:tasks.rados.rados.0.trial082.stdout:3474: write oid 37 current snap is 380 2026-02-12T17:43:34.155 INFO:tasks.rados.rados.0.trial082.stdout:3474: seq_num 1182 ranges {665874=579033,1934422=467082,3142801=542578} 2026-02-12T17:43:34.155 INFO:tasks.rados.rados.0.trial082.stdout:3474: writing trial08226312-37 from 665874 to 1244907 tid 1 2026-02-12T17:43:34.160 INFO:tasks.rados.rados.0.trial082.stdout:3474: writing trial08226312-37 from 1934422 to 2401504 tid 2 2026-02-12T17:43:34.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff1755ce640 1 -- 10.20.193.57:0/2564926628 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1640043d0 con 0x7ff17008c730 2026-02-12T17:43:34.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff1755ce640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:34.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff1755ce640 1 -- 10.20.193.57:0/2564926628 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff1640047b0 con 0x7ff17008c730 2026-02-12T17:43:34.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff1755ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff1755ce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:34.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff1755ce640 10 monclient: dump: 2026-02-12T17:43:34.162 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.162 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.162 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff17885b640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff17885b640 4 set_mon_vals no callback set 2026-02-12T17:43:34.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff17885b640 10 monclient: shutdown 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff17885b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff17885b640 1 -- 10.20.193.57:0/2564926628 >> v1:10.20.193.57:6789/0 conn(0x7ff17008c730 legacy=0x7ff150023880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff17885b640 1 -- 10.20.193.57:0/2564926628 shutdown_connections 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff17885b640 1 -- 10.20.193.57:0/2564926628 >> 10.20.193.57:0/2564926628 conn(0x7ff170091620 msgr2=0x7ff170091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff17885b640 1 -- 10.20.193.57:0/2564926628 shutdown_connections 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.152+0000 7ff17885b640 1 -- 10.20.193.57:0/2564926628 wait complete. 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.153+0000 7ff17885b640 10 monclient: build_initial_monmap 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.153+0000 7ff17885b640 10 monclient: monmap: 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:34.164 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.153+0000 7ff17885b640 1 Processor -- start 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.153+0000 7ff17885b640 1 -- start start 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.153+0000 7ff17885b640 10 monclient: init 2026-02-12T17:43:34.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 10 monclient(hunting): picked mon.noname-c con 0x7ff17008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 10 monclient(hunting): picked mon.noname-b con 0x7ff17008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 10 monclient(hunting): picked mon.noname-a con 0x7ff17008cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17008d9c0 con 0x7ff17008cb30 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17005cc20 con 0x7ff17008c730 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17011d990 con 0x7ff17008ae20 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff17885b640 10 monclient(hunting): authenticate will time out at 1493.973243s 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff1765d0640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff170088d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:34.166 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff176dd1640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff17008cb30 0x7ff1701351b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:33642/0 (socket says 10.20.193.57:33642) 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.154+0000 7ff176dd1640 1 -- 10.20.193.57:0/3437062435 learned_addr learned my addr 10.20.193.57:0/3437062435 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff176dd1640 1 -- 10.20.193.57:0/3437062435 >> v1:10.20.193.57:6789/0 conn(0x7ff17008cb30 legacy=0x7ff1701351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597003150 0 0) 0x7ff17008d9c0 con 0x7ff17008cb30 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): my global_id is 74424 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1400035e0 con 0x7ff17008cb30 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff175dcf640 1 -- 10.20.193.57:0/3437062435 >> v1:10.20.193.82:6789/0 conn(0x7ff17008c730 legacy=0x7ff170089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.167 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2129172603 0 0) 0x7ff1400035e0 con 0x7ff17008cb30 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff17008d9c0 con 0x7ff17008cb30 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff164004d00 con 0x7ff17008cb30 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): dump: 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.168 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3980761570 0 0) 0x7ff17005cc20 con 0x7ff17008c730 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient(hunting): my global_id is 5185 2026-02-12T17:43:34.169 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1400035e0 con 0x7ff17008c730 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 219688446 0 0) 0x7ff17008d9c0 con 0x7ff17008cb30 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 >> v1:10.20.193.57:6790/0 conn(0x7ff17008ae20 legacy=0x7ff170088d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 >> v1:10.20.193.82:6789/0 conn(0x7ff17008c730 legacy=0x7ff170089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient: _finish_hunting 0 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 monclient: found mon.a 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17011dc70 con 0x7ff17008cb30 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient: _finish_auth 0 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 10 monclient: _check_auth_tickets 2026-02-12T17:43:34.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff15affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff17885b640 5 monclient: authenticate success, global_id 74424 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff17885b640 10 monclient: _renew_subs 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff17885b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.156+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff17008a8d0 con 0x7ff17008cb30 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff17885b640 10 monclient: _renew_subs 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff17885b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff170088810 con 0x7ff17008cb30 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff17885b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff17885b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff17885b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.171 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff17011d560 con 0x7ff17008cb30 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1640045e0 con 0x7ff17008cb30 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff15affd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff164005090 con 0x7ff17008cb30 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff15affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff15affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff174dcd640 4 set_mon_vals no callback set 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff15affd640 10 monclient: dump: 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.172 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.157+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff1640052a0 con 0x7ff17008cb30 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.158+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(764..764 src has 508..764) ==== 4007+0+0 (unknown 4069116419 0 0) 0x7ff16404fd00 con 0x7ff17008cb30 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.158+0000 7ff1765d0640 10 monclient: get_auth_request con 0x7ff14003f810 auth_method 0 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.160+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff1640184e0 con 0x7ff17008cb30 2026-02-12T17:43:34.173 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.160+0000 7ff15affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:34.174 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.160+0000 7ff15affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:34.175 INFO:tasks.rados.rados.0.trial082.stdout:3474: writing trial08226312-37 from 3142801 to 3685379 tid 3 2026-02-12T17:43:34.175 INFO:tasks.rados.rados.0.trial082.stdout:3475: write oid 44 current snap is 380 2026-02-12T17:43:34.175 INFO:tasks.rados.rados.0.trial082.stdout:3475: seq_num 1183 ranges {682681=654282,1876551=610740,3053871=470203} 2026-02-12T17:43:34.175 INFO:tasks.rados.rados.0.trial082.stdout:3475: writing trial08226312-44 from 682681 to 1336963 tid 1 2026-02-12T17:43:34.175 INFO:tasks.rados.rados.0.trial082.stdout:3475: writing trial08226312-44 from 1876551 to 2487291 tid 2 2026-02-12T17:43:34.176 INFO:tasks.rados.rados.0.trial082.stdout:3475: writing trial08226312-44 from 3053871 to 3524074 tid 3 2026-02-12T17:43:34.176 INFO:tasks.rados.rados.0.trial082.stdout:3476: write oid 17 current snap is 380 2026-02-12T17:43:34.176 INFO:tasks.rados.rados.0.trial082.stdout:3471: expect (ObjNum 1103 snap 346 seq_num 1103) 2026-02-12T17:43:34.194 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:34.228 INFO:tasks.rados.rados.0.trial082.stdout:3473: expect (ObjNum 1095 snap 345 seq_num 1095) 2026-02-12T17:43:34.228 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:34.276 INFO:tasks.rados.rados.0.trial082.stdout:3472: expect (ObjNum 1179 snap 379 seq_num 1179) 2026-02-12T17:43:34.277 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:34.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.303+0000 7ff17885b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:43:34.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.303+0000 7ff17885b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:34.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.303+0000 7ff17885b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.303+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff170055340 con 0x7ff17008cb30 2026-02-12T17:43:34.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.303+0000 7ff15affd640 1 -- 10.20.193.57:0/3437062435 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 3549416468) 0x7ff164016470 con 0x7ff17008cb30 2026-02-12T17:43:34.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.303+0000 7ff15affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:43:34.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.303+0000 7ff15affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:34.301 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":62,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:43:34.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.304+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff14003f810 legacy=0x7ff14005fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.304+0000 7ff17885b640 10 monclient: shutdown 2026-02-12T17:43:34.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.304+0000 7ff17885b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:34.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.304+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 >> v1:10.20.193.57:6789/0 conn(0x7ff17008cb30 legacy=0x7ff1701351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.304+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 shutdown_connections 2026-02-12T17:43:34.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.304+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 >> 10.20.193.57:0/3437062435 conn(0x7ff170091620 msgr2=0x7ff170059590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:34.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.304+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 shutdown_connections 2026-02-12T17:43:34.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.304+0000 7ff17885b640 1 -- 10.20.193.57:0/3437062435 wait complete. 2026-02-12T17:43:34.309 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:43:34.310 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-12T17:43:34.310 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:43:34.350 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.380+0000 7f7aa301b640 10 monclient: get_monmap_and_config 2026-02-12T17:43:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.380+0000 7f7aa301b640 10 monclient: build_initial_monmap 2026-02-12T17:43:34.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.380+0000 7f7aa301b640 10 monclient: monmap: 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:34.381508+0000 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:34.381508+0000 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:34.378 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 1 Processor -- start 2026-02-12T17:43:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 1 -- start start 2026-02-12T17:43:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 10 monclient: init 2026-02-12T17:43:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:43:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 10 monclient(hunting): picked mon.noname-b con 0x7f7a9c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 10 monclient(hunting): picked mon.noname-c con 0x7f7a9c08c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:34.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 10 monclient(hunting): picked mon.noname-a con 0x7f7a9c182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c08a820 con 0x7f7a9c182cc0 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c089450 con 0x7f7a9c08c620 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c089730 con 0x7f7a9c08c250 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa301b640 10 monclient(hunting): authenticate will time out at 1494.200485s 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa0d90640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f7a9c08c250 legacy=0x7f7a9c08a110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa1591640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f7a9c182cc0 0x7f7a9c1a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:33654/0 (socket says 10.20.193.57:33654) 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.381+0000 7f7aa1591640 1 -- 10.20.193.57:0/979560027 learned_addr learned my addr 10.20.193.57:0/979560027 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.383+0000 7f7aa1591640 1 -- 10.20.193.57:0/979560027 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c182cc0 legacy=0x7f7a9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.383+0000 7f7a93fff640 1 -- 10.20.193.57:0/979560027 >> v1:10.20.193.82:6789/0 conn(0x7f7a9c08c620 legacy=0x7f7a9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.391 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.383+0000 7f7a937fe640 1 -- 10.20.193.57:0/979560027 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1939389514 0 0) 0x7f7a98003d00 con 0x7f7a9c182cc0 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.383+0000 7f7a937fe640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.383+0000 7f7a937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.383+0000 7f7a937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.383+0000 7f7a937fe640 10 monclient(hunting): my global_id is 74427 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.383+0000 7f7a937fe640 1 -- 10.20.193.57:0/979560027 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a880035e0 con 0x7f7a9c182cc0 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 1 -- 10.20.193.57:0/979560027 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 860073490 0 0) 0x7f7a880035e0 con 0x7f7a9c182cc0 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 1 -- 10.20.193.57:0/979560027 >> v1:10.20.193.57:6790/0 conn(0x7f7a9c08c250 legacy=0x7f7a9c08a110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 1 -- 10.20.193.57:0/979560027 >> v1:10.20.193.82:6789/0 conn(0x7f7a9c08c620 legacy=0x7f7a9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: _finish_hunting 0 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 1 monclient: found mon.noname-a 2026-02-12T17:43:34.392 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:34.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 1 -- 10.20.193.57:0/979560027 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c089a10 con 0x7f7a9c182cc0 2026-02-12T17:43:34.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: _finish_auth 0 2026-02-12T17:43:34.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: _check_auth_tickets 2026-02-12T17:43:34.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:34.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 1 -- 10.20.193.57:0/979560027 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a98004340 con 0x7f7a9c182cc0 2026-02-12T17:43:34.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 5 monclient: authenticate success, global_id 74427 2026-02-12T17:43:34.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:34.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: dump: 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.394 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 1 -- 10.20.193.57:0/979560027 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a98005a40 con 0x7f7a9c182cc0 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 1 -- 10.20.193.57:0/979560027 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a98005d90 con 0x7f7a9c182cc0 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 4 set_mon_vals no callback set 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:34.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7a937fe640 10 monclient: dump: 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.396 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 10 monclient: shutdown 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 1 -- 10.20.193.57:0/979560027 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c182cc0 legacy=0x7f7a9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 1 -- 10.20.193.57:0/979560027 shutdown_connections 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 1 -- 10.20.193.57:0/979560027 >> 10.20.193.57:0/979560027 conn(0x7f7a9c0916b0 msgr2=0x7f7a9c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 1 -- 10.20.193.57:0/979560027 shutdown_connections 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.384+0000 7f7aa301b640 1 -- 10.20.193.57:0/979560027 wait complete. 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient: build_initial_monmap 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient: monmap: 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:34.397 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 1 Processor -- start 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 1 -- start start 2026-02-12T17:43:34.398 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient: init 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient(hunting): picked mon.noname-a con 0x7f7a9c08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient(hunting): picked mon.noname-c con 0x7f7a9c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient(hunting): picked mon.noname-b con 0x7f7a9c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c05dc10 con 0x7f7a9c08c250 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c13edc0 con 0x7f7a9c182cc0 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9c086540 con 0x7f7a9c08c620 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa301b640 10 monclient(hunting): authenticate will time out at 1494.204511s 2026-02-12T17:43:34.399 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7a93fff640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7f7a9c08c620 legacy=0x7f7a9c085e30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa0d90640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f7a9c08c250 0x7f7a9c085720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:33664/0 (socket says 10.20.193.57:33664) 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.385+0000 7f7aa0d90640 1 -- 10.20.193.57:0/2790654578 learned_addr learned my addr 10.20.193.57:0/2790654578 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7aa0d90640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c08c250 legacy=0x7f7a9c085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7aa1591640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.82:6789/0 conn(0x7f7a9c182cc0 legacy=0x7f7a9c1954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640298443 0 0) 0x7f7a9c05dc10 con 0x7f7a9c08c250 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 10 monclient(hunting): my global_id is 74430 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a6c0035e0 con 0x7f7a9c08c250 2026-02-12T17:43:34.400 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481367855 0 0) 0x7f7a9c13edc0 con 0x7f7a9c182cc0 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 10 monclient(hunting): my global_id is 5191 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.387+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a9c05dc10 con 0x7f7a9c182cc0 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3296642368 0 0) 0x7f7a6c0035e0 con 0x7f7a9c08c250 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a9c13edc0 con 0x7f7a9c08c250 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a8c004500 con 0x7f7a9c08c250 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:34.401 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient(hunting): dump: 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.402 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2897341546 0 0) 0x7f7a9c05dc10 con 0x7f7a9c182cc0 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a6c0035e0 con 0x7f7a9c182cc0 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a98005bb0 con 0x7f7a9c182cc0 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient(hunting): dump: 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.403 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 29192411 0 0) 0x7f7a9c13edc0 con 0x7f7a9c08c250 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.57:6790/0 conn(0x7f7a9c08c620 legacy=0x7f7a9c085e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.82:6789/0 conn(0x7f7a9c182cc0 legacy=0x7f7a9c1954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient: _finish_hunting 0 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 monclient: found mon.a 2026-02-12T17:43:34.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9c086970 con 0x7f7a9c08c250 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient: _finish_auth 0 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient: _check_auth_tickets 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7aa301b640 5 monclient: authenticate success, global_id 74430 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7aa301b640 10 monclient: _renew_subs 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7aa301b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9c0888a0 con 0x7f7a9c08c250 2026-02-12T17:43:34.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7aa301b640 10 monclient: _renew_subs 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7aa301b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a9c13b8c0 con 0x7f7a9c08c250 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a8c004790 con 0x7f7a9c08c250 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a8c004ab0 con 0x7f7a9c08c250 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a92ffd640 4 set_mon_vals no callback set 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7a917fa640 10 monclient: dump: 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.406 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7aa301b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.388+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a9c13aff0 con 0x7f7a9c05d1b0 2026-02-12T17:43:34.407 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.389+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f7a8c004d40 con 0x7f7a9c08c250 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.389+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(764..764 src has 508..764) ==== 4007+0+0 (unknown 4069116419 0 0) 0x7f7a8c04ec50 con 0x7f7a9c08c250 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.389+0000 7f7aa1591640 10 monclient: get_auth_request con 0x7f7a6c03fa80 auth_method 0 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.390+0000 7f7a93fff640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c05d1b0 legacy=0x7f7a9c0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478325992 0 0) 0x7f7a9c13aff0 con 0x7f7a9c05d1b0 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 10 monclient(hunting): my global_id is 74433 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a9c13edc0 con 0x7f7a9c05d1b0 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1024781328 0 0) 0x7f7a9c13edc0 con 0x7f7a9c05d1b0 2026-02-12T17:43:34.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a9c13aff0 con 0x7f7a9c05d1b0 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a840030f0 con 0x7f7a9c05d1b0 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 10 monclient: dump: 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.409 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2503259907 0 0) 0x7f7a9c13aff0 con 0x7f7a9c05d1b0 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a9c05d580 con 0x7f7a9c05d1b0 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f7a84005880 con 0x7f7a9c05d1b0 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c05d1b0 legacy=0x7f7a9c0582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.391+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c05d1b0 legacy=0x7f7a9c0582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:34.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.394+0000 7f7aa301b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:43:34.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.394+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a9c090810 con 0x7f7a9c0589d0 2026-02-12T17:43:34.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.396+0000 7f7a93fff640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c0589d0 legacy=0x7f7a9c197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.396+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147732803 0 0) 0x7f7a9c090810 con 0x7f7a9c0589d0 2026-02-12T17:43:34.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.396+0000 7f7a917fa640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.396+0000 7f7a917fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.396+0000 7f7a917fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.396+0000 7f7a917fa640 10 monclient(hunting): my global_id is 74436 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.396+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a9c13aff0 con 0x7f7a9c0589d0 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2453858802 0 0) 0x7f7a9c13aff0 con 0x7f7a9c0589d0 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a9c090810 con 0x7f7a9c0589d0 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f7a84003b40 con 0x7f7a9c0589d0 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 10 monclient: dump: 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.415 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 233731653 0 0) 0x7f7a9c090810 con 0x7f7a9c0589d0 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a9c08f580 con 0x7f7a9c0589d0 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4494 (unknown 0 0 2322927483) 0x7f7a84005ae0 con 0x7f7a9c0589d0 2026-02-12T17:43:34.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:43:34.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:34.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c0589d0 legacy=0x7f7a9c197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7a917fa640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c0589d0 legacy=0x7f7a9c197c00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:34.417 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:43:34.417 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:34.417 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:34.417 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 62, 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 340860, 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:34.418 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:43:34.419 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.420 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:43:34.421 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:34.422 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.423 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:34.424 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:34.425 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.426 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:43:34.427 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.428 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:34.428 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:34.428 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:43:34.428 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.428 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.428 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.428 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:43:34.428 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:43:34.428 INFO:tasks.rados.rados.0.trial082.stdout:3474: finishing write tid 1 to trial08226312-37 2026-02-12T17:43:34.428 INFO:tasks.rados.rados.0.trial082.stdout:3476: seq_num 1184 ranges {699488=729531,1935033=470751,3081294=681475} 2026-02-12T17:43:34.428 INFO:tasks.rados.rados.0.trial082.stdout:3476: writing trial08226312-17 from 699488 to 1429019 tid 1 2026-02-12T17:43:34.428 INFO:tasks.rados.rados.0.trial082.stdout:3476: writing trial08226312-17 from 1935033 to 2405784 tid 2 2026-02-12T17:43:34.428 INFO:tasks.rados.rados.0.trial082.stdout:3476: writing trial08226312-17 from 3081294 to 3762769 tid 3 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3471: done (5 left) 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3472: done (4 left) 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3473: done (3 left) 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3477: snap_create 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3474: finishing write tid 2 to trial08226312-37 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3474: finishing write tid 3 to trial08226312-37 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3474: finishing write tid 4 to trial08226312-37 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3474: finishing write tid 5 to trial08226312-37 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3474: oid 37 updating version 0 to 2381 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3474: oid 37 version 2381 is already newer than 2380 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3474: oid 37 updating version 2381 to 2382 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3474: oid 37 updating version 2382 to 2383 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 2383 (ObjNum 1182 snap 380 seq_num 1182) dirty exists 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3474: left oid 37 (ObjNum 1182 snap 380 seq_num 1182) 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3475: finishing write tid 1 to trial08226312-44 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3475: finishing write tid 2 to trial08226312-44 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3475: finishing write tid 3 to trial08226312-44 2026-02-12T17:43:34.429 INFO:tasks.rados.rados.0.trial082.stdout:3475: finishing write tid 4 to trial08226312-44 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3475: finishing write tid 5 to trial08226312-44 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3475: oid 44 updating version 0 to 2461 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3475: oid 44 version 2461 is already newer than 2460 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3475: oid 44 updating version 2461 to 2462 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3475: oid 44 version 2462 is already newer than 2459 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2462 (ObjNum 1183 snap 380 seq_num 1183) dirty exists 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3475: left oid 44 (ObjNum 1183 snap 380 seq_num 1183) 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: finishing write tid 1 to trial08226312-17 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: finishing write tid 2 to trial08226312-17 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: finishing write tid 3 to trial08226312-17 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: finishing write tid 4 to trial08226312-17 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: finishing write tid 5 to trial08226312-17 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: oid 17 updating version 0 to 2642 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: oid 17 version 2642 is already newer than 2639 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: oid 17 version 2642 is already newer than 2640 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: oid 17 version 2642 is already newer than 2641 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2642 (ObjNum 1184 snap 380 seq_num 1184) dirty exists 2026-02-12T17:43:34.430 INFO:tasks.rados.rados.0.trial082.stdout:3476: left oid 17 (ObjNum 1184 snap 380 seq_num 1184) 2026-02-12T17:43:34.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.82:6800/2441377515 conn(0x7f7a6c03fa80 legacy=0x7f7a6c05ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7aa301b640 10 monclient: shutdown 2026-02-12T17:43:34.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7aa301b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:34.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 >> v1:10.20.193.57:6789/0 conn(0x7f7a9c08c250 legacy=0x7f7a9c085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7aa1591640 1 -- 10.20.193.57:0/2790654578 reap_dead start 2026-02-12T17:43:34.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 shutdown_connections 2026-02-12T17:43:34.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 >> 10.20.193.57:0/2790654578 conn(0x7f7a9c0916b0 msgr2=0x7f7a9c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:34.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 shutdown_connections 2026-02-12T17:43:34.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.397+0000 7f7aa301b640 1 -- 10.20.193.57:0/2790654578 wait complete. 2026-02-12T17:43:34.432 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:43:34.432 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:43:34.432 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:43:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient: get_monmap_and_config 2026-02-12T17:43:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient: build_initial_monmap 2026-02-12T17:43:34.498 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient: monmap: 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:43:34.502848+0000 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:43:34.502848+0000 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:43:34.499 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 1 Processor -- start 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 1 -- start start 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient: init 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient(hunting): picked mon.noname-b con 0x7ff35008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient(hunting): picked mon.noname-a con 0x7ff35008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient(hunting): picked mon.noname-c con 0x7ff350182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35008a820 con 0x7ff35008c620 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff350089450 con 0x7ff350182cc0 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff350089730 con 0x7ff35008c250 2026-02-12T17:43:34.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:34.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff3567b9640 10 monclient(hunting): authenticate will time out at 1494.321746s 2026-02-12T17:43:34.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff34ffff640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7ff35008c250 legacy=0x7ff35008a110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:34.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff34f7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff35008c620 0x7ff35008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:33692/0 (socket says 10.20.193.57:33692) 2026-02-12T17:43:34.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.502+0000 7ff34f7fe640 1 -- 10.20.193.57:0/2147505438 learned_addr learned my addr 10.20.193.57:0/2147505438 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:34.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.504+0000 7ff34f7fe640 1 -- 10.20.193.57:0/2147505438 >> v1:10.20.193.57:6789/0 conn(0x7ff35008c620 legacy=0x7ff35008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 -- 10.20.193.57:0/2147505438 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869505436 0 0) 0x7ff340002c20 con 0x7ff35008c620 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient(hunting): my global_id is 74439 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 -- 10.20.193.57:0/2147505438 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3340035e0 con 0x7ff35008c620 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff354d2f640 1 -- 10.20.193.57:0/2147505438 >> v1:10.20.193.82:6789/0 conn(0x7ff350182cc0 legacy=0x7ff3501a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 -- 10.20.193.57:0/2147505438 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1421251323 0 0) 0x7ff3340035e0 con 0x7ff35008c620 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 -- 10.20.193.57:0/2147505438 >> v1:10.20.193.57:6790/0 conn(0x7ff35008c250 legacy=0x7ff35008a110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 -- 10.20.193.57:0/2147505438 >> v1:10.20.193.82:6789/0 conn(0x7ff350182cc0 legacy=0x7ff3501a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.504 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: _finish_hunting 0 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 monclient: found mon.noname-a 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 -- 10.20.193.57:0/2147505438 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff350089a10 con 0x7ff35008c620 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: _finish_auth 0 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: _check_auth_tickets 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 -- 10.20.193.57:0/2147505438 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff340003260 con 0x7ff35008c620 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 5 monclient: authenticate success, global_id 74439 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: dump: 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.505 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 -- 10.20.193.57:0/2147505438 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff340004960 con 0x7ff35008c620 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 10 monclient: get_monmap_and_config success 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 1 -- 10.20.193.57:0/2147505438 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff340004cb0 con 0x7ff35008c620 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 4 set_mon_vals no callback set 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:34.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff34effd640 10 monclient: dump: 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 10 monclient: shutdown 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 1 -- 10.20.193.57:0/2147505438 >> v1:10.20.193.57:6789/0 conn(0x7ff35008c620 legacy=0x7ff35008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 1 -- 10.20.193.57:0/2147505438 shutdown_connections 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 1 -- 10.20.193.57:0/2147505438 >> 10.20.193.57:0/2147505438 conn(0x7ff3500916b0 msgr2=0x7ff350091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 1 -- 10.20.193.57:0/2147505438 shutdown_connections 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.505+0000 7ff3567b9640 1 -- 10.20.193.57:0/2147505438 wait complete. 2026-02-12T17:43:34.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient: build_initial_monmap 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient: monmap: 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 1 Processor -- start 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 1 -- start start 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient: init 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient: _reopen_session rank -1 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:43:34.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient(hunting): picked mon.noname-b con 0x7ff35008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient(hunting): picked mon.noname-a con 0x7ff35008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient(hunting): picked mon.noname-c con 0x7ff350182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35005e220 con 0x7ff35008c620 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff350136780 con 0x7ff35008c250 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff35005b500 con 0x7ff350182cc0 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient(hunting): _renew_subs 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff3567b9640 10 monclient(hunting): authenticate will time out at 1494.325676s 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff354d2f640 1 -- >> v1:10.20.193.57:6790/0 conn(0x7ff350182cc0 legacy=0x7ff350192c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6790/0 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff34f7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff35008c620 0x7ff35005adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:33698/0 (socket says 10.20.193.57:33698) 2026-02-12T17:43:34.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.506+0000 7ff34f7fe640 1 -- 10.20.193.57:0/132061915 learned_addr learned my addr 10.20.193.57:0/132061915 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:43:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.508+0000 7ff34f7fe640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.57:6789/0 conn(0x7ff35008c620 legacy=0x7ff35005adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.508+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472848825 0 0) 0x7ff35005e220 con 0x7ff35008c620 2026-02-12T17:43:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.508+0000 7ff34cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.508+0000 7ff34cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.508+0000 7ff34cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.508+0000 7ff34cff9640 10 monclient(hunting): my global_id is 74442 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3200035e0 con 0x7ff35008c620 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1076568184 0 0) 0x7ff3200035e0 con 0x7ff35008c620 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff35005e220 con 0x7ff35008c620 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff340004ad0 con 0x7ff35008c620 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient(hunting): dump: 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.513 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3502231500 0 0) 0x7ff35005e220 con 0x7ff35008c620 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.57:6790/0 conn(0x7ff350182cc0 legacy=0x7ff350192c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.82:6789/0 conn(0x7ff35008c250 legacy=0x7ff35005a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient: _finish_hunting 0 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 monclient: found mon.a 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3500888a0 con 0x7ff35008c620 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient: _finish_auth 0 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient: _check_auth_tickets 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff3567b9640 5 monclient: authenticate success, global_id 74442 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff3567b9640 10 monclient: _renew_subs 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff3567b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff35005c1a0 con 0x7ff35008c620 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff3567b9640 10 monclient: _renew_subs 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff3567b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff35005cd00 con 0x7ff35008c620 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff340002f00 con 0x7ff35008c620 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff340005190 con 0x7ff35008c620 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34e7fc640 4 set_mon_vals no callback set 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff34cff9640 10 monclient: dump: 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.515 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff3567b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.509+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff35005dfd0 con 0x7ff35018d340 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.510+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff340011e80 con 0x7ff35008c620 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.510+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(764..764 src has 508..764) ==== 4007+0+0 (unknown 4069116419 0 0) 0x7ff34004ecf0 con 0x7ff35008c620 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.510+0000 7ff354d2f640 10 monclient: get_auth_request con 0x7ff32003f610 auth_method 0 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34ffff640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.82:6789/0 conn(0x7ff35018d340 legacy=0x7ff35018d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256015581 0 0) 0x7ff35005dfd0 con 0x7ff35018d340 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 10 monclient(hunting): my global_id is 5197 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff35005e220 con 0x7ff35018d340 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1225060607 0 0) 0x7ff35005e220 con 0x7ff35018d340 2026-02-12T17:43:34.516 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff35005dfd0 con 0x7ff35018d340 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff33c0041d0 con 0x7ff35018d340 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.512+0000 7ff34cff9640 10 monclient: dump: 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.513+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3582013418 0 0) 0x7ff35005dfd0 con 0x7ff35018d340 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.513+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff350090810 con 0x7ff35018d340 2026-02-12T17:43:34.517 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.513+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff33c0057d0 con 0x7ff35018d340 2026-02-12T17:43:34.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.513+0000 7ff34cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:43:34.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.513+0000 7ff34cff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:43:34.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.513+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.82:6789/0 conn(0x7ff35018d340 legacy=0x7ff35018d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.513+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.82:6789/0 conn(0x7ff35018d340 legacy=0x7ff35018d710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:34.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.516+0000 7ff3567b9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:43:34.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.516+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff35005ddb0 con 0x7ff35018de20 2026-02-12T17:43:34.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34ffff640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.82:6789/0 conn(0x7ff35018de20 legacy=0x7ff350195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:43:34.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810650196 0 0) 0x7ff35005ddb0 con 0x7ff35018de20 2026-02-12T17:43:34.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:43:34.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:43:34.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 10 monclient(hunting): my global_id is 5200 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff35005dfd0 con 0x7ff35018de20 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3451081256 0 0) 0x7ff35005dfd0 con 0x7ff35018de20 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff35005ddb0 con 0x7ff35018de20 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff33c004910 con 0x7ff35018de20 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 10 monclient: dump: 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:43:34.520 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3368970729 0 0) 0x7ff35005ddb0 con 0x7ff35018de20 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.519+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff35008f580 con 0x7ff35018de20 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4663 (unknown 0 0 4096899617) 0x7ff33c0059f0 con 0x7ff35018de20 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff34cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff34cff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.82:6789/0 conn(0x7ff35018de20 legacy=0x7ff350195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff34cff9640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.82:6789/0 conn(0x7ff35018de20 legacy=0x7ff350195340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:43:34.521 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 62, 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 936016, 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: 1 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:34.522 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:34.523 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:43:34.524 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:43:34.525 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:43:34.526 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:43:34.527 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:43:34.528 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:43:34.529 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:43:34.530 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff32003f610 legacy=0x7ff32005fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff3567b9640 10 monclient: shutdown 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff3567b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 >> v1:10.20.193.57:6789/0 conn(0x7ff35008c620 legacy=0x7ff35005adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff354d2f640 1 -- 10.20.193.57:0/132061915 reap_dead start 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff354d2f640 1 -- 10.20.193.57:0/132061915 reap_dead start 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 shutdown_connections 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 >> 10.20.193.57:0/132061915 conn(0x7ff3500916b0 msgr2=0x7ff35008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 shutdown_connections 2026-02-12T17:43:34.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:43:34.520+0000 7ff3567b9640 1 -- 10.20.193.57:0/132061915 wait complete. 2026-02-12T17:43:34.532 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:43:34.532 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:43:35.152 INFO:tasks.rados.rados.0.trial082.stdout:3474: done (3 left) 2026-02-12T17:43:35.152 INFO:tasks.rados.rados.0.trial082.stdout:3475: done (2 left) 2026-02-12T17:43:35.152 INFO:tasks.rados.rados.0.trial082.stdout:3476: done (1 left) 2026-02-12T17:43:35.152 INFO:tasks.rados.rados.0.trial082.stdout:3477: done (0 left) 2026-02-12T17:43:35.153 INFO:tasks.rados.rados.0.trial082.stdout:3478: write (excl) oid 46 current snap is 381 2026-02-12T17:43:35.153 INFO:tasks.rados.rados.0.trial082.stdout:3478: seq_num 1185 ranges {716295=404780,1593515=614409,2708717=492747,3640519=275776} 2026-02-12T17:43:35.156 INFO:tasks.rados.rados.0.trial082.stdout:3478: writing trial08226312-46 from 716295 to 1121075 tid 1 2026-02-12T17:43:35.160 INFO:tasks.rados.rados.0.trial082.stdout:3478: writing trial08226312-46 from 1593515 to 2207924 tid 2 2026-02-12T17:43:35.164 INFO:tasks.rados.rados.0.trial082.stdout:3478: writing trial08226312-46 from 2708717 to 3201464 tid 3 2026-02-12T17:43:35.167 INFO:tasks.rados.rados.0.trial082.stdout:3478: writing trial08226312-46 from 3640519 to 3916295 tid 4 2026-02-12T17:43:35.167 INFO:tasks.rados.rados.0.trial082.stdout:3479: write (excl) oid 19 current snap is 381 2026-02-12T17:43:35.167 INFO:tasks.rados.rados.0.trial082.stdout:3479: seq_num 1186 ranges {733102=596382,1768350=758067,3136140=704019} 2026-02-12T17:43:35.172 INFO:tasks.rados.rados.0.trial082.stdout:3479: writing trial08226312-19 from 733102 to 1329484 tid 1 2026-02-12T17:43:35.176 INFO:tasks.rados.rados.0.trial082.stdout:3479: writing trial08226312-19 from 1768350 to 2526417 tid 2 2026-02-12T17:43:35.181 INFO:tasks.rados.rados.0.trial082.stdout:3479: writing trial08226312-19 from 3136140 to 3840159 tid 3 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3480: snap_create 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: finishing write tid 1 to trial08226312-46 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: finishing write tid 2 to trial08226312-46 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: finishing write tid 3 to trial08226312-46 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: finishing write tid 4 to trial08226312-46 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: finishing write tid 5 to trial08226312-46 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: finishing write tid 6 to trial08226312-46 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: oid 46 updating version 0 to 2358 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: oid 46 updating version 2358 to 2362 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: oid 46 version 2362 is already newer than 2360 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: oid 46 version 2362 is already newer than 2361 2026-02-12T17:43:35.182 INFO:tasks.rados.rados.0.trial082.stdout:3478: oid 46 version 2362 is already newer than 2359 2026-02-12T17:43:35.183 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 2362 (ObjNum 1185 snap 381 seq_num 1185) dirty exists 2026-02-12T17:43:35.183 INFO:tasks.rados.rados.0.trial082.stdout:3478: left oid 46 (ObjNum 1185 snap 381 seq_num 1185) 2026-02-12T17:43:35.183 INFO:tasks.rados.rados.0.trial082.stdout:3479: finishing write tid 1 to trial08226312-19 2026-02-12T17:43:35.183 INFO:tasks.rados.rados.0.trial082.stdout:3479: finishing write tid 2 to trial08226312-19 2026-02-12T17:43:35.183 INFO:tasks.rados.rados.0.trial082.stdout:3479: finishing write tid 3 to trial08226312-19 2026-02-12T17:43:35.184 INFO:tasks.rados.rados.0.trial082.stdout:3479: finishing write tid 4 to trial08226312-19 2026-02-12T17:43:35.184 INFO:tasks.rados.rados.0.trial082.stdout:3479: finishing write tid 5 to trial08226312-19 2026-02-12T17:43:35.184 INFO:tasks.rados.rados.0.trial082.stdout:3479: oid 19 updating version 0 to 2647 2026-02-12T17:43:35.184 INFO:tasks.rados.rados.0.trial082.stdout:3479: oid 19 version 2647 is already newer than 2646 2026-02-12T17:43:35.184 INFO:tasks.rados.rados.0.trial082.stdout:3479: oid 19 version 2647 is already newer than 2644 2026-02-12T17:43:35.185 INFO:tasks.rados.rados.0.trial082.stdout:3479: oid 19 version 2647 is already newer than 2645 2026-02-12T17:43:35.185 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 2647 (ObjNum 1186 snap 381 seq_num 1186) dirty exists 2026-02-12T17:43:35.185 INFO:tasks.rados.rados.0.trial082.stdout:3479: left oid 19 (ObjNum 1186 snap 381 seq_num 1186) 2026-02-12T17:43:36.156 INFO:tasks.rados.rados.0.trial082.stdout:3478: done (2 left) 2026-02-12T17:43:36.157 INFO:tasks.rados.rados.0.trial082.stdout:3479: done (1 left) 2026-02-12T17:43:36.157 INFO:tasks.rados.rados.0.trial082.stdout:3480: done (0 left) 2026-02-12T17:43:36.157 INFO:tasks.rados.rados.0.trial082.stdout:3481: copy_from oid 14 from oid 11 current snap is 382 2026-02-12T17:43:36.157 INFO:tasks.rados.rados.0.trial082.stdout:3482: write (excl) oid 31 current snap is 382 2026-02-12T17:43:36.157 INFO:tasks.rados.rados.0.trial082.stdout:3482: seq_num 1187 ranges {749909=671631,2110479=618078,3163563=515291} 2026-02-12T17:43:36.161 INFO:tasks.rados.rados.0.trial082.stdout:3482: writing trial08226312-31 from 749909 to 1421540 tid 1 2026-02-12T17:43:36.167 INFO:tasks.rados.rados.0.trial082.stdout:3482: writing trial08226312-31 from 2110479 to 2728557 tid 2 2026-02-12T17:43:36.170 INFO:tasks.rados.rados.0.trial082.stdout:3482: writing trial08226312-31 from 3163563 to 3678854 tid 3 2026-02-12T17:43:36.170 INFO:tasks.rados.rados.0.trial082.stdout:3483: snap_remove snap 377 2026-02-12T17:43:37.159 INFO:tasks.rados.rados.0.trial082.stdout:3483: done (2 left) 2026-02-12T17:43:37.160 INFO:tasks.rados.rados.0.trial082.stdout:3484: read oid 25 snap -1 2026-02-12T17:43:37.160 INFO:tasks.rados.rados.0.trial082.stdout:3484: expect deleted 2026-02-12T17:43:37.160 INFO:tasks.rados.rados.0.trial082.stdout:3485: copy_from oid 48 from oid 23 current snap is 382 2026-02-12T17:43:37.160 INFO:tasks.rados.rados.0.trial082.stdout:3482: finishing write tid 1 to trial08226312-31 2026-02-12T17:43:37.160 INFO:tasks.rados.rados.0.trial082.stdout:3481: finishing copy_from racing read to trial08226312-14 2026-02-12T17:43:37.160 INFO:tasks.rados.rados.0.trial082.stdout:3481: finishing copy_from to trial08226312-14 2026-02-12T17:43:37.160 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 2357 (ObjNum 1181 snap 379 seq_num 1181) dirty exists 2026-02-12T17:43:37.160 INFO:tasks.rados.rados.0.trial082.stdout:3482: finishing write tid 2 to trial08226312-31 2026-02-12T17:43:37.160 INFO:tasks.rados.rados.0.trial082.stdout:3482: finishing write tid 3 to trial08226312-31 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3482: finishing write tid 4 to trial08226312-31 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3482: finishing write tid 5 to trial08226312-31 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3482: oid 31 updating version 0 to 2263 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3482: oid 31 version 2263 is already newer than 2262 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3482: oid 31 updating version 2263 to 2264 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3482: oid 31 updating version 2264 to 2265 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 2265 (ObjNum 1187 snap 382 seq_num 1187) dirty exists 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3482: left oid 31 (ObjNum 1187 snap 382 seq_num 1187) 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3481: done (3 left) 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3482: done (2 left) 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3486: read oid 20 snap -1 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3486: expect deleted 2026-02-12T17:43:37.161 INFO:tasks.rados.rados.0.trial082.stdout:3487: write (excl) oid 10 current snap is 382 2026-02-12T17:43:37.162 INFO:tasks.rados.rados.0.trial082.stdout:3487: seq_num 1188 ranges {766716=746880,2168961=761736,3474633=442916} 2026-02-12T17:43:37.164 INFO:tasks.rados.rados.0.trial082.stdout:3487: writing trial08226312-10 from 766716 to 1513596 tid 1 2026-02-12T17:43:37.169 INFO:tasks.rados.rados.0.trial082.stdout:3487: writing trial08226312-10 from 2168961 to 2930697 tid 2 2026-02-12T17:43:37.174 INFO:tasks.rados.rados.0.trial082.stdout:3487: writing trial08226312-10 from 3474633 to 3917549 tid 3 2026-02-12T17:43:37.174 INFO:tasks.rados.rados.0.trial082.stdout:3488: read oid 5 snap 359 2026-02-12T17:43:37.174 INFO:tasks.rados.rados.0.trial082.stdout:3488: expect (ObjNum 1071 snap 338 seq_num 1071) 2026-02-12T17:43:37.174 INFO:tasks.rados.rados.0.trial082.stdout:3489: write (excl) oid 1 current snap is 382 2026-02-12T17:43:37.174 INFO:tasks.rados.rados.0.trial082.stdout:3489: seq_num 1189 ranges {783523=422129,1827443=621747,3218409=654188} 2026-02-12T17:43:37.178 INFO:tasks.rados.rados.0.trial082.stdout:3489: writing trial08226312-1 from 783523 to 1205652 tid 1 2026-02-12T17:43:37.182 INFO:tasks.rados.rados.0.trial082.stdout:3489: writing trial08226312-1 from 1827443 to 2449190 tid 2 2026-02-12T17:43:37.188 INFO:tasks.rados.rados.0.trial082.stdout:3489: writing trial08226312-1 from 3218409 to 3872597 tid 3 2026-02-12T17:43:37.188 INFO:tasks.rados.rados.0.trial082.stdout:3490: write (excl) oid 37 current snap is 382 2026-02-12T17:43:37.188 INFO:tasks.rados.rados.0.trial082.stdout:3490: seq_num 1190 ranges {400330=497378,1485925=514405} 2026-02-12T17:43:37.191 INFO:tasks.rados.rados.0.trial082.stdout:3490: writing trial08226312-37 from 400330 to 897708 tid 1 2026-02-12T17:43:37.195 INFO:tasks.rados.rados.0.trial082.stdout:3490: writing trial08226312-37 from 1485925 to 2000330 tid 2 2026-02-12T17:43:37.195 INFO:tasks.rados.rados.0.trial082.stdout:3491: write oid 12 current snap is 382 2026-02-12T17:43:37.195 INFO:tasks.rados.rados.0.trial082.stdout:3491: seq_num 1191 ranges {417137=572627,1428054=589083} 2026-02-12T17:43:37.199 INFO:tasks.rados.rados.0.trial082.stdout:3491: writing trial08226312-12 from 417137 to 989764 tid 1 2026-02-12T17:43:37.203 INFO:tasks.rados.rados.0.trial082.stdout:3491: writing trial08226312-12 from 1428054 to 2017137 tid 2 2026-02-12T17:43:37.203 INFO:tasks.rados.rados.0.trial082.stdout:3492: read oid 27 snap -1 2026-02-12T17:43:37.203 INFO:tasks.rados.rados.0.trial082.stdout:3492: expect (ObjNum 1106 snap 346 seq_num 1106) 2026-02-12T17:43:37.203 INFO:tasks.rados.rados.0.trial082.stdout:3493: snap_remove snap 360 2026-02-12T17:43:38.120 INFO:tasks.rados.rados.0.trial082.stdout:3493: done (9 left) 2026-02-12T17:43:38.120 INFO:tasks.rados.rados.0.trial082.stdout:3494: write (excl) oid 36 current snap is 382 2026-02-12T17:43:38.120 INFO:tasks.rados.rados.0.trial082.stdout:3494: seq_num 1192 ranges {433944=647876,1486536=547408} 2026-02-12T17:43:38.124 INFO:tasks.rados.rados.0.trial082.stdout:3494: writing trial08226312-36 from 433944 to 1081820 tid 1 2026-02-12T17:43:38.128 INFO:tasks.rados.rados.0.trial082.stdout:3494: writing trial08226312-36 from 1486536 to 2033944 tid 2 2026-02-12T17:43:38.128 INFO:tasks.rados.rados.0.trial082.stdout:3495: write oid 18 current snap is 382 2026-02-12T17:43:38.128 INFO:tasks.rados.rados.0.trial082.stdout:3487: finishing write tid 1 to trial08226312-10 2026-02-12T17:43:38.128 INFO:tasks.rados.rados.0.trial082.stdout:3485: finishing copy_from racing read to trial08226312-48 2026-02-12T17:43:38.128 INFO:tasks.rados.rados.0.trial082.stdout:3485: finishing copy_from to trial08226312-48 2026-02-12T17:43:38.128 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 2451 (ObjNum 1165 snap 376 seq_num 1165) dirty exists 2026-02-12T17:43:38.128 INFO:tasks.rados.rados.0.trial082.stdout:3487: finishing write tid 2 to trial08226312-10 2026-02-12T17:43:38.128 INFO:tasks.rados.rados.0.trial082.stdout:3495: seq_num 1193 ranges {450751=723125,1945018=105733} 2026-02-12T17:43:38.132 INFO:tasks.rados.rados.0.trial082.stdout:3495: writing trial08226312-18 from 450751 to 1173876 tid 1 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3495: writing trial08226312-18 from 1945018 to 2050751 tid 2 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3484: done (10 left) 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3485: done (9 left) 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3486: done (8 left) 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3496: copy_from oid 44 from oid 9 current snap is 382 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3487: finishing write tid 3 to trial08226312-10 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3487: finishing write tid 4 to trial08226312-10 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3487: finishing write tid 5 to trial08226312-10 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3487: oid 10 updating version 0 to 2454 2026-02-12T17:43:38.136 INFO:tasks.rados.rados.0.trial082.stdout:3487: oid 10 updating version 2454 to 2456 2026-02-12T17:43:38.137 INFO:tasks.rados.rados.0.trial082.stdout:3487: oid 10 version 2456 is already newer than 2453 2026-02-12T17:43:38.137 INFO:tasks.rados.rados.0.trial082.stdout:3487: oid 10 version 2456 is already newer than 2455 2026-02-12T17:43:38.137 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2456 (ObjNum 1188 snap 382 seq_num 1188) dirty exists 2026-02-12T17:43:38.137 INFO:tasks.rados.rados.0.trial082.stdout:3487: left oid 10 (ObjNum 1188 snap 382 seq_num 1188) 2026-02-12T17:43:38.137 INFO:tasks.rados.rados.0.trial082.stdout:3488: expect (ObjNum 1071 snap 338 seq_num 1071) 2026-02-12T17:43:38.187 INFO:tasks.rados.rados.0.trial082.stdout:3489: finishing write tid 1 to trial08226312-1 2026-02-12T17:43:38.188 INFO:tasks.rados.rados.0.trial082.stdout:3487: done (8 left) 2026-02-12T17:43:38.188 INFO:tasks.rados.rados.0.trial082.stdout:3488: done (7 left) 2026-02-12T17:43:38.188 INFO:tasks.rados.rados.0.trial082.stdout:3497: read oid 45 snap -1 2026-02-12T17:43:38.188 INFO:tasks.rados.rados.0.trial082.stdout:3497: expect (ObjNum 1103 snap 346 seq_num 1103) 2026-02-12T17:43:38.188 INFO:tasks.rados.rados.0.trial082.stdout:3498: rollback oid 30 current snap is 382 2026-02-12T17:43:38.188 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 347 2026-02-12T17:43:38.188 INFO:tasks.rados.rados.0.trial082.stdout:3489: finishing write tid 2 to trial08226312-1 2026-02-12T17:43:38.188 INFO:tasks.rados.rados.0.trial082.stdout:3489: finishing write tid 3 to trial08226312-1 2026-02-12T17:43:38.188 INFO:tasks.rados.rados.0.trial082.stdout:3489: finishing write tid 4 to trial08226312-1 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3489: finishing write tid 5 to trial08226312-1 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3489: oid 1 updating version 0 to 2443 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3489: oid 1 version 2443 is already newer than 2442 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3489: oid 1 version 2443 is already newer than 2441 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3489: oid 1 updating version 2443 to 2444 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2444 (ObjNum 1189 snap 382 seq_num 1189) dirty exists 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3489: left oid 1 (ObjNum 1189 snap 382 seq_num 1189) 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3490: finishing write tid 1 to trial08226312-37 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3490: finishing write tid 2 to trial08226312-37 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3490: finishing write tid 3 to trial08226312-37 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3490: finishing write tid 4 to trial08226312-37 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3490: oid 37 updating version 0 to 2386 2026-02-12T17:43:38.189 INFO:tasks.rados.rados.0.trial082.stdout:3490: oid 37 version 2386 is already newer than 2384 2026-02-12T17:43:38.190 INFO:tasks.rados.rados.0.trial082.stdout:3490: oid 37 version 2386 is already newer than 2385 2026-02-12T17:43:38.190 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 2386 (ObjNum 1190 snap 382 seq_num 1190) dirty exists 2026-02-12T17:43:38.190 INFO:tasks.rados.rados.0.trial082.stdout:3490: left oid 37 (ObjNum 1190 snap 382 seq_num 1190) 2026-02-12T17:43:38.190 INFO:tasks.rados.rados.0.trial082.stdout:3491: finishing write tid 1 to trial08226312-12 2026-02-12T17:43:38.190 INFO:tasks.rados.rados.0.trial082.stdout:3492: expect (ObjNum 1106 snap 346 seq_num 1106) 2026-02-12T17:43:38.301 INFO:tasks.rados.rados.0.trial082.stdout:3491: finishing write tid 2 to trial08226312-12 2026-02-12T17:43:38.301 INFO:tasks.rados.rados.0.trial082.stdout:3491: finishing write tid 3 to trial08226312-12 2026-02-12T17:43:38.301 INFO:tasks.rados.rados.0.trial082.stdout:3491: finishing write tid 4 to trial08226312-12 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3491: oid 12 updating version 0 to 2389 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3491: oid 12 version 2389 is already newer than 2388 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3491: oid 12 version 2389 is already newer than 2387 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 2389 (ObjNum 1191 snap 382 seq_num 1191) dirty exists 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3491: left oid 12 (ObjNum 1191 snap 382 seq_num 1191) 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3494: finishing write tid 1 to trial08226312-36 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3489: done (8 left) 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3490: done (7 left) 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3491: done (6 left) 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3492: done (5 left) 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3499: write (excl) oid 24 current snap is 382 2026-02-12T17:43:38.302 INFO:tasks.rados.rados.0.trial082.stdout:3494: finishing write tid 2 to trial08226312-36 2026-02-12T17:43:38.303 INFO:tasks.rados.rados.0.trial082.stdout:3499: seq_num 1194 ranges {467558=514727,1719853=347705} 2026-02-12T17:43:38.305 INFO:tasks.rados.rados.0.trial082.stdout:3499: writing trial08226312-24 from 467558 to 982285 tid 1 2026-02-12T17:43:38.309 INFO:tasks.rados.rados.0.trial082.stdout:3499: writing trial08226312-24 from 1719853 to 2067558 tid 2 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:3500: snap_create 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:3494: finishing write tid 3 to trial08226312-36 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:3494: finishing write tid 4 to trial08226312-36 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:3494: oid 36 updating version 0 to 2463 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:3494: oid 36 updating version 2463 to 2465 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:3494: oid 36 version 2465 is already newer than 2464 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 2465 (ObjNum 1192 snap 382 seq_num 1192) dirty exists 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:3494: left oid 36 (ObjNum 1192 snap 382 seq_num 1192) 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:3495: finishing write tid 1 to trial08226312-18 2026-02-12T17:43:38.310 INFO:tasks.rados.rados.0.trial082.stdout:3495: finishing write tid 2 to trial08226312-18 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:3495: finishing write tid 3 to trial08226312-18 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:3495: finishing write tid 4 to trial08226312-18 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:3495: oid 18 updating version 0 to 2400 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:3495: oid 18 version 2400 is already newer than 2399 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:3495: oid 18 version 2400 is already newer than 2398 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 2400 (ObjNum 1193 snap 382 seq_num 1193) dirty exists 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:3495: left oid 18 (ObjNum 1193 snap 382 seq_num 1193) 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:3496: finishing copy_from racing read to trial08226312-44 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:3496: finishing copy_from to trial08226312-44 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2412 (ObjNum 1141 snap 359 seq_num 1141) dirty exists 2026-02-12T17:43:38.311 INFO:tasks.rados.rados.0.trial082.stdout:3497: expect (ObjNum 1103 snap 346 seq_num 1103) 2026-02-12T17:43:38.333 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2073153 2026-02-12T17:43:38.336 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:38.354 INFO:tasks.rados.rados.0.trial082.stdout:3498: finishing rollback tid 0 to trial08226312-30 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3498: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3498: finishing rollback tid 2 to trial08226312-30 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2459 (ObjNum 1051 snap 330 seq_num 1051) dirty exists 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3499: finishing write tid 1 to trial08226312-24 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3499: finishing write tid 2 to trial08226312-24 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3499: finishing write tid 3 to trial08226312-24 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3499: finishing write tid 4 to trial08226312-24 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3499: oid 24 updating version 0 to 2665 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3499: oid 24 version 2665 is already newer than 2663 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3499: oid 24 version 2665 is already newer than 2664 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 2665 (ObjNum 1194 snap 382 seq_num 1194) dirty exists 2026-02-12T17:43:38.355 INFO:tasks.rados.rados.0.trial082.stdout:3499: left oid 24 (ObjNum 1194 snap 382 seq_num 1194) 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3494: done (6 left) 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3495: done (5 left) 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3496: done (4 left) 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3497: done (3 left) 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3498: done (2 left) 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3499: done (1 left) 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3500: done (0 left) 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3501: read oid 15 snap -1 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3501: expect deleted 2026-02-12T17:43:39.174 INFO:tasks.rados.rados.0.trial082.stdout:3502: snap_create 2026-02-12T17:43:40.173 INFO:tasks.rados.rados.0.trial082.stdout:3501: done (1 left) 2026-02-12T17:43:40.174 INFO:tasks.rados.rados.0.trial082.stdout:3502: done (0 left) 2026-02-12T17:43:40.174 INFO:tasks.rados.rados.0.trial082.stdout:3503: write (excl) oid 13 current snap is 384 2026-02-12T17:43:40.174 INFO:tasks.rados.rados.0.trial082.stdout:3503: seq_num 1195 ranges {484365=589976,1661982=422383} 2026-02-12T17:43:40.178 INFO:tasks.rados.rados.0.trial082.stdout:3503: writing trial08226312-13 from 484365 to 1074341 tid 1 2026-02-12T17:43:40.182 INFO:tasks.rados.rados.0.trial082.stdout:3503: writing trial08226312-13 from 1661982 to 2084365 tid 2 2026-02-12T17:43:40.182 INFO:tasks.rados.rados.0.trial082.stdout:3504: read oid 45 snap 367 2026-02-12T17:43:40.182 INFO:tasks.rados.rados.0.trial082.stdout:3504: expect (ObjNum 1103 snap 346 seq_num 1103) 2026-02-12T17:43:40.182 INFO:tasks.rados.rados.0.trial082.stdout:3505: copy_from oid 10 from oid 36 current snap is 384 2026-02-12T17:43:40.183 INFO:tasks.rados.rados.0.trial082.stdout:3503: finishing write tid 1 to trial08226312-13 2026-02-12T17:43:40.183 INFO:tasks.rados.rados.0.trial082.stdout:3506: read oid 32 snap 303 2026-02-12T17:43:40.183 INFO:tasks.rados.rados.0.trial082.stdout:3506: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:43:40.183 INFO:tasks.rados.rados.0.trial082.stdout:3507: snap_remove snap 331 2026-02-12T17:43:41.179 INFO:tasks.rados.rados.0.trial082.stdout:3507: done (4 left) 2026-02-12T17:43:41.179 INFO:tasks.rados.rados.0.trial082.stdout:3508: snap_remove snap 374 2026-02-12T17:43:42.179 INFO:tasks.rados.rados.0.trial082.stdout:3508: done (4 left) 2026-02-12T17:43:42.179 INFO:tasks.rados.rados.0.trial082.stdout:3509: read oid 1 snap -1 2026-02-12T17:43:42.179 INFO:tasks.rados.rados.0.trial082.stdout:3509: expect (ObjNum 1189 snap 382 seq_num 1189) 2026-02-12T17:43:42.180 INFO:tasks.rados.rados.0.trial082.stdout:3510: snap_remove snap 380 2026-02-12T17:43:43.120 INFO:tasks.rados.rados.0.trial082.stdout:3510: done (5 left) 2026-02-12T17:43:43.120 INFO:tasks.rados.rados.0.trial082.stdout:3511: write oid 5 current snap is 384 2026-02-12T17:43:43.120 INFO:tasks.rados.rados.0.trial082.stdout:3503: finishing write tid 2 to trial08226312-13 2026-02-12T17:43:43.120 INFO:tasks.rados.rados.0.trial082.stdout:3511: seq_num 1196 ranges {501172=665225,1720464=380708} 2026-02-12T17:43:43.125 INFO:tasks.rados.rados.0.trial082.stdout:3511: writing trial08226312-5 from 501172 to 1166397 tid 1 2026-02-12T17:43:43.129 INFO:tasks.rados.rados.0.trial082.stdout:3511: writing trial08226312-5 from 1720464 to 2101172 tid 2 2026-02-12T17:43:43.129 INFO:tasks.rados.rados.0.trial082.stdout:3512: delete oid 23 current snap is 384 2026-02-12T17:43:43.129 INFO:tasks.rados.rados.0.trial082.stdout:3503: finishing write tid 3 to trial08226312-13 2026-02-12T17:43:43.129 INFO:tasks.rados.rados.0.trial082.stdout:3503: finishing write tid 4 to trial08226312-13 2026-02-12T17:43:43.129 INFO:tasks.rados.rados.0.trial082.stdout:3503: oid 13 updating version 0 to 2460 2026-02-12T17:43:43.129 INFO:tasks.rados.rados.0.trial082.stdout:3503: oid 13 version 2460 is already newer than 2459 2026-02-12T17:43:43.129 INFO:tasks.rados.rados.0.trial082.stdout:3503: oid 13 updating version 2460 to 2461 2026-02-12T17:43:43.129 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2461 (ObjNum 1195 snap 384 seq_num 1195) dirty exists 2026-02-12T17:43:43.130 INFO:tasks.rados.rados.0.trial082.stdout:3503: left oid 13 (ObjNum 1195 snap 384 seq_num 1195) 2026-02-12T17:43:43.130 INFO:tasks.rados.rados.0.trial082.stdout:3504: expect (ObjNum 1103 snap 346 seq_num 1103) 2026-02-12T17:43:43.130 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:43.170 INFO:tasks.rados.rados.0.trial082.stdout:3506: expect (ObjNum 925 snap 290 seq_num 925) 2026-02-12T17:43:43.170 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 308362 2026-02-12T17:43:43.209 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:43.250 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:43.291 INFO:tasks.rados.rados.0.trial082.stdout:3505: finishing copy_from racing read to trial08226312-10 2026-02-12T17:43:43.291 INFO:tasks.rados.rados.0.trial082.stdout:3503: done (6 left) 2026-02-12T17:43:43.291 INFO:tasks.rados.rados.0.trial082.stdout:3504: done (5 left) 2026-02-12T17:43:43.291 INFO:tasks.rados.rados.0.trial082.stdout:3506: done (4 left) 2026-02-12T17:43:43.291 INFO:tasks.rados.rados.0.trial082.stdout:3512: done (3 left) 2026-02-12T17:43:43.291 INFO:tasks.rados.rados.0.trial082.stdout:3513: snap_remove snap 371 2026-02-12T17:43:44.187 INFO:tasks.rados.rados.0.trial082.stdout:3513: done (3 left) 2026-02-12T17:43:44.187 INFO:tasks.rados.rados.0.trial082.stdout:3514: snap_create 2026-02-12T17:43:44.188 INFO:tasks.rados.rados.0.trial082.stdout:3505: finishing copy_from to trial08226312-10 2026-02-12T17:43:44.188 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2465 (ObjNum 1192 snap 382 seq_num 1192) dirty exists 2026-02-12T17:43:44.188 INFO:tasks.rados.rados.0.trial082.stdout:3509: expect (ObjNum 1189 snap 382 seq_num 1189) 2026-02-12T17:43:44.188 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:44.230 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:44.315 INFO:tasks.rados.rados.0.trial082.stdout:3511: finishing write tid 1 to trial08226312-5 2026-02-12T17:43:44.315 INFO:tasks.rados.rados.0.trial082.stdout:3511: finishing write tid 2 to trial08226312-5 2026-02-12T17:43:44.315 INFO:tasks.rados.rados.0.trial082.stdout:3511: finishing write tid 3 to trial08226312-5 2026-02-12T17:43:44.316 INFO:tasks.rados.rados.0.trial082.stdout:3511: finishing write tid 4 to trial08226312-5 2026-02-12T17:43:44.316 INFO:tasks.rados.rados.0.trial082.stdout:3511: oid 5 updating version 0 to 2404 2026-02-12T17:43:44.316 INFO:tasks.rados.rados.0.trial082.stdout:3511: oid 5 version 2404 is already newer than 2403 2026-02-12T17:43:44.316 INFO:tasks.rados.rados.0.trial082.stdout:3511: oid 5 updating version 2404 to 2405 2026-02-12T17:43:44.316 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 2405 (ObjNum 1196 snap 384 seq_num 1196) dirty exists 2026-02-12T17:43:44.316 INFO:tasks.rados.rados.0.trial082.stdout:3511: left oid 5 (ObjNum 1196 snap 384 seq_num 1196) 2026-02-12T17:43:45.189 INFO:tasks.rados.rados.0.trial082.stdout:3505: done (3 left) 2026-02-12T17:43:45.189 INFO:tasks.rados.rados.0.trial082.stdout:3509: done (2 left) 2026-02-12T17:43:45.189 INFO:tasks.rados.rados.0.trial082.stdout:3511: done (1 left) 2026-02-12T17:43:45.189 INFO:tasks.rados.rados.0.trial082.stdout:3514: done (0 left) 2026-02-12T17:43:45.189 INFO:tasks.rados.rados.0.trial082.stdout:3515: write (excl) oid 20 current snap is 385 2026-02-12T17:43:45.190 INFO:tasks.rados.rados.0.trial082.stdout:3515: seq_num 1198 ranges {534786=415723,1437428=697358} 2026-02-12T17:43:45.193 INFO:tasks.rados.rados.0.trial082.stdout:3515: writing trial08226312-20 from 534786 to 950509 tid 1 2026-02-12T17:43:45.197 INFO:tasks.rados.rados.0.trial082.stdout:3515: writing trial08226312-20 from 1437428 to 2134786 tid 2 2026-02-12T17:43:45.198 INFO:tasks.rados.rados.0.trial082.stdout:3516: delete oid 48 current snap is 385 2026-02-12T17:43:45.198 INFO:tasks.rados.rados.0.trial082.stdout:3515: finishing write tid 1 to trial08226312-20 2026-02-12T17:43:45.200 INFO:tasks.rados.rados.0.trial082.stdout:3515: finishing write tid 2 to trial08226312-20 2026-02-12T17:43:45.200 INFO:tasks.rados.rados.0.trial082.stdout:3515: finishing write tid 3 to trial08226312-20 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:3515: finishing write tid 4 to trial08226312-20 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:3515: oid 20 updating version 0 to 2690 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:3515: oid 20 updating version 2690 to 2691 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:3515: oid 20 updating version 2691 to 2692 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 2692 (ObjNum 1198 snap 385 seq_num 1198) dirty exists 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:3515: left oid 20 (ObjNum 1198 snap 385 seq_num 1198) 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:3515: done (1 left) 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:3516: done (0 left) 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:3517: write (excl) oid 17 current snap is 385 2026-02-12T17:43:45.201 INFO:tasks.rados.rados.0.trial082.stdout:3517: seq_num 1200 ranges {568400=566221,1838039=330361} 2026-02-12T17:43:45.205 INFO:tasks.rados.rados.0.trial082.stdout:3517: writing trial08226312-17 from 568400 to 1134621 tid 1 2026-02-12T17:43:45.209 INFO:tasks.rados.rados.0.trial082.stdout:3517: writing trial08226312-17 from 1838039 to 2168400 tid 2 2026-02-12T17:43:45.209 INFO:tasks.rados.rados.0.trial082.stdout:3517: finishing write tid 1 to trial08226312-17 2026-02-12T17:43:45.209 INFO:tasks.rados.rados.0.trial082.stdout:3518: read oid 18 snap -1 2026-02-12T17:43:45.209 INFO:tasks.rados.rados.0.trial082.stdout:3518: expect (ObjNum 1193 snap 382 seq_num 1193) 2026-02-12T17:43:45.209 INFO:tasks.rados.rados.0.trial082.stdout:3519: rollback oid 12 current snap is 385 2026-02-12T17:43:45.209 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 373 2026-02-12T17:43:45.209 INFO:tasks.rados.rados.0.trial082.stdout:3520: snap_create 2026-02-12T17:43:45.210 INFO:tasks.rados.rados.0.trial082.stdout:3517: finishing write tid 2 to trial08226312-17 2026-02-12T17:43:45.211 INFO:tasks.rados.rados.0.trial082.stdout:3517: finishing write tid 3 to trial08226312-17 2026-02-12T17:43:45.211 INFO:tasks.rados.rados.0.trial082.stdout:3517: finishing write tid 4 to trial08226312-17 2026-02-12T17:43:45.212 INFO:tasks.rados.rados.0.trial082.stdout:3517: oid 17 updating version 0 to 2695 2026-02-12T17:43:45.212 INFO:tasks.rados.rados.0.trial082.stdout:3517: oid 17 updating version 2695 to 2696 2026-02-12T17:43:45.212 INFO:tasks.rados.rados.0.trial082.stdout:3517: oid 17 version 2696 is already newer than 2694 2026-02-12T17:43:45.212 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2696 (ObjNum 1200 snap 385 seq_num 1200) dirty exists 2026-02-12T17:43:45.212 INFO:tasks.rados.rados.0.trial082.stdout:3517: left oid 17 (ObjNum 1200 snap 385 seq_num 1200) 2026-02-12T17:43:45.212 INFO:tasks.rados.rados.0.trial082.stdout:3519: finishing rollback tid 0 to trial08226312-12 2026-02-12T17:43:45.212 INFO:tasks.rados.rados.0.trial082.stdout:3519: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:43:45.212 INFO:tasks.rados.rados.0.trial082.stdout:3519: finishing rollback tid 2 to trial08226312-12 2026-02-12T17:43:45.212 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 2392 (ObjNum 1105 snap 346 seq_num 1105) dirty exists 2026-02-12T17:43:45.213 INFO:tasks.rados.rados.0.trial082.stdout:3518: expect (ObjNum 1193 snap 382 seq_num 1193) 2026-02-12T17:43:45.261 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 699060 2026-02-12T17:43:46.194 INFO:tasks.rados.rados.0.trial082.stdout:3517: done (3 left) 2026-02-12T17:43:46.194 INFO:tasks.rados.rados.0.trial082.stdout:3518: done (2 left) 2026-02-12T17:43:46.194 INFO:tasks.rados.rados.0.trial082.stdout:3519: done (1 left) 2026-02-12T17:43:46.194 INFO:tasks.rados.rados.0.trial082.stdout:3520: done (0 left) 2026-02-12T17:43:46.194 INFO:tasks.rados.rados.0.trial082.stdout:3521: write oid 49 current snap is 386 2026-02-12T17:43:46.194 INFO:tasks.rados.rados.0.trial082.stdout:3521: seq_num 1201 ranges {585207=641470,1896521=288686} 2026-02-12T17:43:46.198 INFO:tasks.rados.rados.0.trial082.stdout:3521: writing trial08226312-49 from 585207 to 1226677 tid 1 2026-02-12T17:43:46.202 INFO:tasks.rados.rados.0.trial082.stdout:3521: writing trial08226312-49 from 1896521 to 2185207 tid 2 2026-02-12T17:43:46.202 INFO:tasks.rados.rados.0.trial082.stdout:3522: write oid 12 current snap is 386 2026-02-12T17:43:46.202 INFO:tasks.rados.rados.0.trial082.stdout:3522: seq_num 1202 ranges {602014=433072,1671356=530658} 2026-02-12T17:43:46.206 INFO:tasks.rados.rados.0.trial082.stdout:3522: writing trial08226312-12 from 602014 to 1035086 tid 1 2026-02-12T17:43:46.211 INFO:tasks.rados.rados.0.trial082.stdout:3522: writing trial08226312-12 from 1671356 to 2202014 tid 2 2026-02-12T17:43:46.211 INFO:tasks.rados.rados.0.trial082.stdout:3523: read oid 10 snap -1 2026-02-12T17:43:46.211 INFO:tasks.rados.rados.0.trial082.stdout:3523: expect (ObjNum 1192 snap 382 seq_num 1192) 2026-02-12T17:43:46.211 INFO:tasks.rados.rados.0.trial082.stdout:3524: read oid 16 snap -1 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3524: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3525: copy_from oid 38 from oid 30 current snap is 386 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3521: finishing write tid 1 to trial08226312-49 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3521: finishing write tid 2 to trial08226312-49 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3521: finishing write tid 3 to trial08226312-49 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3521: finishing write tid 4 to trial08226312-49 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3521: oid 49 updating version 0 to 2402 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3521: oid 49 updating version 2402 to 2403 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3521: oid 49 version 2403 is already newer than 2401 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 2403 (ObjNum 1201 snap 386 seq_num 1201) dirty exists 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3521: left oid 49 (ObjNum 1201 snap 386 seq_num 1201) 2026-02-12T17:43:46.212 INFO:tasks.rados.rados.0.trial082.stdout:3522: finishing write tid 1 to trial08226312-12 2026-02-12T17:43:46.213 INFO:tasks.rados.rados.0.trial082.stdout:3521: done (4 left) 2026-02-12T17:43:46.213 INFO:tasks.rados.rados.0.trial082.stdout:3526: delete oid 31 current snap is 386 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:3522: finishing write tid 2 to trial08226312-12 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:3522: finishing write tid 3 to trial08226312-12 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:3522: finishing write tid 4 to trial08226312-12 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:3522: oid 12 updating version 0 to 2394 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:3522: oid 12 updating version 2394 to 2395 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:3522: oid 12 version 2395 is already newer than 2393 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 2395 (ObjNum 1202 snap 386 seq_num 1202) dirty exists 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:3522: left oid 12 (ObjNum 1202 snap 386 seq_num 1202) 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:3522: done (4 left) 2026-02-12T17:43:46.214 INFO:tasks.rados.rados.0.trial082.stdout:3526: done (3 left) 2026-02-12T17:43:46.215 INFO:tasks.rados.rados.0.trial082.stdout:3527: copy_from oid 40 from oid 22 current snap is 386 2026-02-12T17:43:46.215 INFO:tasks.rados.rados.0.trial082.stdout:3528: write oid 31 current snap is 386 2026-02-12T17:43:46.215 INFO:tasks.rados.rados.0.trial082.stdout:3528: seq_num 1204 ranges {635628=583570,1671967=563661} 2026-02-12T17:43:46.218 INFO:tasks.rados.rados.0.trial082.stdout:3528: writing trial08226312-31 from 635628 to 1219198 tid 1 2026-02-12T17:43:46.222 INFO:tasks.rados.rados.0.trial082.stdout:3528: writing trial08226312-31 from 1671967 to 2235628 tid 2 2026-02-12T17:43:46.222 INFO:tasks.rados.rados.0.trial082.stdout:3529: write oid 27 current snap is 386 2026-02-12T17:43:46.222 INFO:tasks.rados.rados.0.trial082.stdout:3529: seq_num 1205 ranges {652435=658819,1730449=521986} 2026-02-12T17:43:46.227 INFO:tasks.rados.rados.0.trial082.stdout:3529: writing trial08226312-27 from 652435 to 1311254 tid 1 2026-02-12T17:43:46.231 INFO:tasks.rados.rados.0.trial082.stdout:3529: writing trial08226312-27 from 1730449 to 2252435 tid 2 2026-02-12T17:43:46.231 INFO:tasks.rados.rados.0.trial082.stdout:3530: read oid 6 snap -1 2026-02-12T17:43:46.231 INFO:tasks.rados.rados.0.trial082.stdout:3530: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:43:46.231 INFO:tasks.rados.rados.0.trial082.stdout:3531: snap_create 2026-02-12T17:43:46.231 INFO:tasks.rados.rados.0.trial082.stdout:3524: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:43:46.257 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:46.287 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:46.317 INFO:tasks.rados.rados.0.trial082.stdout:3527: finishing copy_from to trial08226312-40 2026-02-12T17:43:46.317 INFO:tasks.rados.rados.0.trial082.stdout:3527: got expected ENOENT (src dne) 2026-02-12T17:43:46.318 INFO:tasks.rados.rados.0.trial082.stdout:3527: finishing copy_from racing read to trial08226312-40 2026-02-12T17:43:46.318 INFO:tasks.rados.rados.0.trial082.stdout:3523: expect (ObjNum 1192 snap 382 seq_num 1192) 2026-02-12T17:43:46.318 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:46.352 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:46.370 INFO:tasks.rados.rados.0.trial082.stdout:3528: finishing write tid 1 to trial08226312-31 2026-02-12T17:43:46.370 INFO:tasks.rados.rados.0.trial082.stdout:3525: finishing copy_from racing read to trial08226312-38 2026-02-12T17:43:46.370 INFO:tasks.rados.rados.0.trial082.stdout:3528: finishing write tid 2 to trial08226312-31 2026-02-12T17:43:46.370 INFO:tasks.rados.rados.0.trial082.stdout:3525: finishing copy_from to trial08226312-38 2026-02-12T17:43:46.370 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 2459 (ObjNum 1051 snap 330 seq_num 1051) dirty exists 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3528: finishing write tid 3 to trial08226312-31 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3528: finishing write tid 4 to trial08226312-31 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3528: oid 31 updating version 0 to 2267 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3528: oid 31 updating version 2267 to 2269 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3528: oid 31 version 2269 is already newer than 2268 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 2269 (ObjNum 1204 snap 386 seq_num 1204) dirty exists 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3528: left oid 31 (ObjNum 1204 snap 386 seq_num 1204) 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3529: finishing write tid 1 to trial08226312-27 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3529: finishing write tid 2 to trial08226312-27 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3529: finishing write tid 3 to trial08226312-27 2026-02-12T17:43:46.371 INFO:tasks.rados.rados.0.trial082.stdout:3529: finishing write tid 4 to trial08226312-27 2026-02-12T17:43:46.372 INFO:tasks.rados.rados.0.trial082.stdout:3529: oid 27 updating version 0 to 2271 2026-02-12T17:43:46.372 INFO:tasks.rados.rados.0.trial082.stdout:3529: oid 27 updating version 2271 to 2272 2026-02-12T17:43:46.372 INFO:tasks.rados.rados.0.trial082.stdout:3529: oid 27 version 2272 is already newer than 2270 2026-02-12T17:43:46.372 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2272 (ObjNum 1205 snap 386 seq_num 1205) dirty exists 2026-02-12T17:43:46.372 INFO:tasks.rados.rados.0.trial082.stdout:3529: left oid 27 (ObjNum 1205 snap 386 seq_num 1205) 2026-02-12T17:43:46.372 INFO:tasks.rados.rados.0.trial082.stdout:3530: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:43:46.385 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2244658 2026-02-12T17:43:46.421 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:47.198 INFO:tasks.rados.rados.0.trial082.stdout:3523: done (7 left) 2026-02-12T17:43:47.198 INFO:tasks.rados.rados.0.trial082.stdout:3524: done (6 left) 2026-02-12T17:43:47.198 INFO:tasks.rados.rados.0.trial082.stdout:3525: done (5 left) 2026-02-12T17:43:47.198 INFO:tasks.rados.rados.0.trial082.stdout:3527: done (4 left) 2026-02-12T17:43:47.198 INFO:tasks.rados.rados.0.trial082.stdout:3528: done (3 left) 2026-02-12T17:43:47.198 INFO:tasks.rados.rados.0.trial082.stdout:3529: done (2 left) 2026-02-12T17:43:47.198 INFO:tasks.rados.rados.0.trial082.stdout:3530: done (1 left) 2026-02-12T17:43:47.198 INFO:tasks.rados.rados.0.trial082.stdout:3531: done (0 left) 2026-02-12T17:43:47.198 INFO:tasks.rados.rados.0.trial082.stdout:3532: write oid 8 current snap is 387 2026-02-12T17:43:47.199 INFO:tasks.rados.rados.0.trial082.stdout:3532: seq_num 1206 ranges {669242=734068,2188931=80311} 2026-02-12T17:43:47.203 INFO:tasks.rados.rados.0.trial082.stdout:3532: writing trial08226312-8 from 669242 to 1403310 tid 1 2026-02-12T17:43:47.206 INFO:tasks.rados.rados.0.trial082.stdout:3532: writing trial08226312-8 from 2188931 to 2269242 tid 2 2026-02-12T17:43:47.206 INFO:tasks.rados.rados.0.trial082.stdout:3533: snap_remove snap 383 2026-02-12T17:43:48.468 INFO:tasks.rados.rados.0.trial082.stdout:3533: done (1 left) 2026-02-12T17:43:48.468 INFO:tasks.rados.rados.0.trial082.stdout:3534: snap_create 2026-02-12T17:43:48.468 INFO:tasks.rados.rados.0.trial082.stdout:3532: finishing write tid 1 to trial08226312-8 2026-02-12T17:43:48.468 INFO:tasks.rados.rados.0.trial082.stdout:3532: finishing write tid 2 to trial08226312-8 2026-02-12T17:43:48.469 INFO:tasks.rados.rados.0.trial082.stdout:3532: finishing write tid 3 to trial08226312-8 2026-02-12T17:43:48.469 INFO:tasks.rados.rados.0.trial082.stdout:3532: finishing write tid 4 to trial08226312-8 2026-02-12T17:43:48.469 INFO:tasks.rados.rados.0.trial082.stdout:3532: oid 8 updating version 0 to 2700 2026-02-12T17:43:48.469 INFO:tasks.rados.rados.0.trial082.stdout:3532: oid 8 version 2700 is already newer than 2699 2026-02-12T17:43:48.469 INFO:tasks.rados.rados.0.trial082.stdout:3532: oid 8 version 2700 is already newer than 2698 2026-02-12T17:43:48.469 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 2700 (ObjNum 1206 snap 387 seq_num 1206) dirty exists 2026-02-12T17:43:48.469 INFO:tasks.rados.rados.0.trial082.stdout:3532: left oid 8 (ObjNum 1206 snap 387 seq_num 1206) 2026-02-12T17:43:49.470 INFO:tasks.rados.rados.0.trial082.stdout:3532: done (1 left) 2026-02-12T17:43:49.470 INFO:tasks.rados.rados.0.trial082.stdout:3534: done (0 left) 2026-02-12T17:43:49.470 INFO:tasks.rados.rados.0.trial082.stdout:3535: read oid 21 snap -1 2026-02-12T17:43:49.470 INFO:tasks.rados.rados.0.trial082.stdout:3535: expect (ObjNum 1171 snap 377 seq_num 1171) 2026-02-12T17:43:49.470 INFO:tasks.rados.rados.0.trial082.stdout:3536: read oid 49 snap -1 2026-02-12T17:43:49.470 INFO:tasks.rados.rados.0.trial082.stdout:3536: expect (ObjNum 1201 snap 386 seq_num 1201) 2026-02-12T17:43:49.470 INFO:tasks.rados.rados.0.trial082.stdout:3537: write (excl) oid 33 current snap is 388 2026-02-12T17:43:49.471 INFO:tasks.rados.rados.0.trial082.stdout:3537: seq_num 1207 ranges {686049=409317,1847413=438636} 2026-02-12T17:43:49.474 INFO:tasks.rados.rados.0.trial082.stdout:3537: writing trial08226312-33 from 686049 to 1095366 tid 1 2026-02-12T17:43:49.479 INFO:tasks.rados.rados.0.trial082.stdout:3537: writing trial08226312-33 from 1847413 to 2286049 tid 2 2026-02-12T17:43:49.479 INFO:tasks.rados.rados.0.trial082.stdout:3538: snap_create 2026-02-12T17:43:49.479 INFO:tasks.rados.rados.0.trial082.stdout:3536: expect (ObjNum 1201 snap 386 seq_num 1201) 2026-02-12T17:43:49.479 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:49.504 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:49.538 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1555398 2026-02-12T17:43:49.551 INFO:tasks.rados.rados.0.trial082.stdout:3535: expect (ObjNum 1171 snap 377 seq_num 1171) 2026-02-12T17:43:49.578 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1233926 2026-02-12T17:43:49.608 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3037140 2026-02-12T17:43:49.613 INFO:tasks.rados.rados.0.trial082.stdout:3537: finishing write tid 1 to trial08226312-33 2026-02-12T17:43:49.613 INFO:tasks.rados.rados.0.trial082.stdout:3537: finishing write tid 2 to trial08226312-33 2026-02-12T17:43:49.613 INFO:tasks.rados.rados.0.trial082.stdout:3537: finishing write tid 3 to trial08226312-33 2026-02-12T17:43:49.613 INFO:tasks.rados.rados.0.trial082.stdout:3537: finishing write tid 4 to trial08226312-33 2026-02-12T17:43:49.613 INFO:tasks.rados.rados.0.trial082.stdout:3537: oid 33 updating version 0 to 2397 2026-02-12T17:43:49.613 INFO:tasks.rados.rados.0.trial082.stdout:3537: oid 33 updating version 2397 to 2398 2026-02-12T17:43:49.613 INFO:tasks.rados.rados.0.trial082.stdout:3537: oid 33 version 2398 is already newer than 2396 2026-02-12T17:43:49.613 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 2398 (ObjNum 1207 snap 388 seq_num 1207) dirty exists 2026-02-12T17:43:49.613 INFO:tasks.rados.rados.0.trial082.stdout:3537: left oid 33 (ObjNum 1207 snap 388 seq_num 1207) 2026-02-12T17:43:50.482 INFO:tasks.rados.rados.0.trial082.stdout:3535: done (3 left) 2026-02-12T17:43:50.483 INFO:tasks.rados.rados.0.trial082.stdout:3536: done (2 left) 2026-02-12T17:43:50.483 INFO:tasks.rados.rados.0.trial082.stdout:3537: done (1 left) 2026-02-12T17:43:50.483 INFO:tasks.rados.rados.0.trial082.stdout:3538: done (0 left) 2026-02-12T17:43:50.483 INFO:tasks.rados.rados.0.trial082.stdout:3539: rollback oid 36 current snap is 389 2026-02-12T17:43:50.483 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 36 to 376 2026-02-12T17:43:50.483 INFO:tasks.rados.rados.0.trial082.stdout:3540: rollback oid 38 current snap is 389 2026-02-12T17:43:50.483 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 373 2026-02-12T17:43:50.483 INFO:tasks.rados.rados.0.trial082.stdout:3541: snap_create 2026-02-12T17:43:50.485 INFO:tasks.rados.rados.0.trial082.stdout:3540: finishing rollback tid 0 to trial08226312-38 2026-02-12T17:43:50.485 INFO:tasks.rados.rados.0.trial082.stdout:3540: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:43:50.485 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 2461 (ObjNum 225 snap 0 seq_num 27560560) dirty dne 2026-02-12T17:43:50.486 INFO:tasks.rados.rados.0.trial082.stdout:3539: finishing rollback tid 0 to trial08226312-36 2026-02-12T17:43:50.486 INFO:tasks.rados.rados.0.trial082.stdout:3539: finishing rollback tid 1 to trial08226312-36 2026-02-12T17:43:50.486 INFO:tasks.rados.rados.0.trial082.stdout:3539: finishing rollback tid 2 to trial08226312-36 2026-02-12T17:43:50.486 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 2469 (ObjNum 998 snap 309 seq_num 998) dirty exists 2026-02-12T17:43:51.483 INFO:tasks.rados.rados.0.trial082.stdout:3539: done (2 left) 2026-02-12T17:43:51.483 INFO:tasks.rados.rados.0.trial082.stdout:3540: done (1 left) 2026-02-12T17:43:51.483 INFO:tasks.rados.rados.0.trial082.stdout:3541: done (0 left) 2026-02-12T17:43:51.483 INFO:tasks.rados.rados.0.trial082.stdout:3542: write (excl) oid 25 current snap is 390 2026-02-12T17:43:51.483 INFO:tasks.rados.rados.0.trial082.stdout:3542: seq_num 1208 ranges {702856=484566,1789542=513314} 2026-02-12T17:43:51.488 INFO:tasks.rados.rados.0.trial082.stdout:3542: writing trial08226312-25 from 702856 to 1187422 tid 1 2026-02-12T17:43:51.492 INFO:tasks.rados.rados.0.trial082.stdout:3542: writing trial08226312-25 from 1789542 to 2302856 tid 2 2026-02-12T17:43:51.492 INFO:tasks.rados.rados.0.trial082.stdout:3543: write oid 42 current snap is 390 2026-02-12T17:43:51.492 INFO:tasks.rados.rados.0.trial082.stdout:3543: seq_num 1209 ranges {719663=676168,1964377=355286} 2026-02-12T17:43:51.497 INFO:tasks.rados.rados.0.trial082.stdout:3543: writing trial08226312-42 from 719663 to 1395831 tid 1 2026-02-12T17:43:51.501 INFO:tasks.rados.rados.0.trial082.stdout:3543: writing trial08226312-42 from 1964377 to 2319663 tid 2 2026-02-12T17:43:51.501 INFO:tasks.rados.rados.0.trial082.stdout:3544: rollback oid 15 current snap is 390 2026-02-12T17:43:51.501 INFO:tasks.rados.rados.0.trial082.stdout:3542: finishing write tid 1 to trial08226312-25 2026-02-12T17:43:51.501 INFO:tasks.rados.rados.0.trial082.stdout:3542: finishing write tid 2 to trial08226312-25 2026-02-12T17:43:51.501 INFO:tasks.rados.rados.0.trial082.stdout:3542: finishing write tid 3 to trial08226312-25 2026-02-12T17:43:51.501 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 15 to 330 2026-02-12T17:43:51.502 INFO:tasks.rados.rados.0.trial082.stdout:3542: finishing write tid 4 to trial08226312-25 2026-02-12T17:43:51.502 INFO:tasks.rados.rados.0.trial082.stdout:3542: oid 25 updating version 0 to 2463 2026-02-12T17:43:51.502 INFO:tasks.rados.rados.0.trial082.stdout:3542: oid 25 version 2463 is already newer than 2462 2026-02-12T17:43:51.502 INFO:tasks.rados.rados.0.trial082.stdout:3542: oid 25 updating version 2463 to 2464 2026-02-12T17:43:51.502 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 25 v 2464 (ObjNum 1208 snap 390 seq_num 1208) dirty exists 2026-02-12T17:43:51.502 INFO:tasks.rados.rados.0.trial082.stdout:3542: left oid 25 (ObjNum 1208 snap 390 seq_num 1208) 2026-02-12T17:43:51.502 INFO:tasks.rados.rados.0.trial082.stdout:3542: done (2 left) 2026-02-12T17:43:51.502 INFO:tasks.rados.rados.0.trial082.stdout:3545: write (excl) oid 6 current snap is 390 2026-02-12T17:43:51.502 INFO:tasks.rados.rados.0.trial082.stdout:3545: seq_num 1210 ranges {736470=751417,2022859=313611} 2026-02-12T17:43:51.506 INFO:tasks.rados.rados.0.trial082.stdout:3545: writing trial08226312-6 from 736470 to 1487887 tid 1 2026-02-12T17:43:51.509 INFO:tasks.rados.rados.0.trial082.stdout:3545: writing trial08226312-6 from 2022859 to 2336470 tid 2 2026-02-12T17:43:51.509 INFO:tasks.rados.rados.0.trial082.stdout:3546: write (excl) oid 2 current snap is 390 2026-02-12T17:43:51.509 INFO:tasks.rados.rados.0.trial082.stdout:3546: seq_num 1211 ranges {753277=426666,1681341=545753} 2026-02-12T17:43:51.513 INFO:tasks.rados.rados.0.trial082.stdout:3546: writing trial08226312-2 from 753277 to 1179943 tid 1 2026-02-12T17:43:51.518 INFO:tasks.rados.rados.0.trial082.stdout:3546: writing trial08226312-2 from 1681341 to 2227094 tid 2 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3547: read oid 46 snap 338 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3547: expect (ObjNum 1028 snap 322 seq_num 1028) 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3548: rollback oid 35 current snap is 390 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3543: finishing write tid 1 to trial08226312-42 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3543: finishing write tid 2 to trial08226312-42 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3543: finishing write tid 3 to trial08226312-42 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3543: finishing write tid 4 to trial08226312-42 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3543: oid 42 updating version 0 to 2414 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3543: oid 42 updating version 2414 to 2415 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3543: oid 42 version 2415 is already newer than 2413 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 2415 (ObjNum 1209 snap 390 seq_num 1209) dirty exists 2026-02-12T17:43:51.519 INFO:tasks.rados.rados.0.trial082.stdout:3543: left oid 42 (ObjNum 1209 snap 390 seq_num 1209) 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3544: finishing rollback tid 1 to trial08226312-15 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 35 to 373 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3544: finishing rollback tid 2 to trial08226312-15 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 2407 (ObjNum 1039 snap 325 seq_num 1039) dirty exists 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3545: finishing write tid 1 to trial08226312-6 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3545: finishing write tid 2 to trial08226312-6 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3545: finishing write tid 3 to trial08226312-6 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3545: finishing write tid 4 to trial08226312-6 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3545: oid 6 updating version 0 to 2401 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3545: oid 6 version 2401 is already newer than 2400 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3545: oid 6 version 2401 is already newer than 2399 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 2401 (ObjNum 1210 snap 390 seq_num 1210) dirty exists 2026-02-12T17:43:51.520 INFO:tasks.rados.rados.0.trial082.stdout:3545: left oid 6 (ObjNum 1210 snap 390 seq_num 1210) 2026-02-12T17:43:51.521 INFO:tasks.rados.rados.0.trial082.stdout:3546: finishing write tid 1 to trial08226312-2 2026-02-12T17:43:51.521 INFO:tasks.rados.rados.0.trial082.stdout:3543: done (5 left) 2026-02-12T17:43:51.521 INFO:tasks.rados.rados.0.trial082.stdout:3544: done (4 left) 2026-02-12T17:43:51.521 INFO:tasks.rados.rados.0.trial082.stdout:3545: done (3 left) 2026-02-12T17:43:51.521 INFO:tasks.rados.rados.0.trial082.stdout:3549: snap_create 2026-02-12T17:43:51.522 INFO:tasks.rados.rados.0.trial082.stdout:3546: finishing write tid 2 to trial08226312-2 2026-02-12T17:43:51.522 INFO:tasks.rados.rados.0.trial082.stdout:3546: finishing write tid 3 to trial08226312-2 2026-02-12T17:43:51.522 INFO:tasks.rados.rados.0.trial082.stdout:3546: finishing write tid 4 to trial08226312-2 2026-02-12T17:43:51.522 INFO:tasks.rados.rados.0.trial082.stdout:3546: oid 2 updating version 0 to 2251 2026-02-12T17:43:51.522 INFO:tasks.rados.rados.0.trial082.stdout:3546: oid 2 updating version 2251 to 2252 2026-02-12T17:43:51.523 INFO:tasks.rados.rados.0.trial082.stdout:3546: oid 2 updating version 2252 to 2253 2026-02-12T17:43:51.523 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 2253 (ObjNum 1211 snap 390 seq_num 1211) dirty exists 2026-02-12T17:43:51.523 INFO:tasks.rados.rados.0.trial082.stdout:3546: left oid 2 (ObjNum 1211 snap 390 seq_num 1211) 2026-02-12T17:43:51.523 INFO:tasks.rados.rados.0.trial082.stdout:3548: finishing rollback tid 0 to trial08226312-35 2026-02-12T17:43:51.523 INFO:tasks.rados.rados.0.trial082.stdout:3548: finishing rollback tid 1 to trial08226312-35 2026-02-12T17:43:51.523 INFO:tasks.rados.rados.0.trial082.stdout:3548: finishing rollback tid 2 to trial08226312-35 2026-02-12T17:43:51.523 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 2472 (ObjNum 1145 snap 363 seq_num 1145) dirty exists 2026-02-12T17:43:51.523 INFO:tasks.rados.rados.0.trial082.stdout:3547: expect (ObjNum 1028 snap 322 seq_num 1028) 2026-02-12T17:43:52.489 INFO:tasks.rados.rados.0.trial082.stdout:3546: done (3 left) 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3547: done (2 left) 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3548: done (1 left) 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3549: done (0 left) 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3550: read oid 17 snap 390 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3550: expect (ObjNum 1200 snap 385 seq_num 1200) 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3551: read oid 42 snap -1 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3551: expect (ObjNum 1209 snap 390 seq_num 1209) 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3552: read oid 12 snap 347 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3552: expect (ObjNum 1074 snap 340 seq_num 1074) 2026-02-12T17:43:52.490 INFO:tasks.rados.rados.0.trial082.stdout:3553: delete oid 21 current snap is 391 2026-02-12T17:43:52.493 INFO:tasks.rados.rados.0.trial082.stdout:3550: expect (ObjNum 1200 snap 385 seq_num 1200) 2026-02-12T17:43:52.493 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:52.542 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 940160 2026-02-12T17:43:52.555 INFO:tasks.rados.rados.0.trial082.stdout:3552: expect (ObjNum 1074 snap 340 seq_num 1074) 2026-02-12T17:43:52.618 INFO:tasks.rados.rados.0.trial082.stdout:3551: expect (ObjNum 1209 snap 390 seq_num 1209) 2026-02-12T17:43:52.670 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2224323 2026-02-12T17:43:52.670 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:52.700 INFO:tasks.rados.rados.0.trial082.stdout:3550: done (3 left) 2026-02-12T17:43:52.701 INFO:tasks.rados.rados.0.trial082.stdout:3551: done (2 left) 2026-02-12T17:43:52.701 INFO:tasks.rados.rados.0.trial082.stdout:3552: done (1 left) 2026-02-12T17:43:52.701 INFO:tasks.rados.rados.0.trial082.stdout:3553: done (0 left) 2026-02-12T17:43:52.701 INFO:tasks.rados.rados.0.trial082.stdout:3554: delete oid 39 current snap is 391 2026-02-12T17:43:52.701 INFO:tasks.rados.rados.0.trial082.stdout:3554: done (0 left) 2026-02-12T17:43:52.702 INFO:tasks.rados.rados.0.trial082.stdout:3555: write (excl) oid 43 current snap is 391 2026-02-12T17:43:52.702 INFO:tasks.rados.rados.0.trial082.stdout:3555: seq_num 1214 ranges {403698=652413,1740434=663264} 2026-02-12T17:43:52.705 INFO:tasks.rados.rados.0.trial082.stdout:3555: writing trial08226312-43 from 403698 to 1056111 tid 1 2026-02-12T17:43:52.711 INFO:tasks.rados.rados.0.trial082.stdout:3555: writing trial08226312-43 from 1740434 to 2403698 tid 2 2026-02-12T17:43:52.711 INFO:tasks.rados.rados.0.trial082.stdout:3556: delete oid 42 current snap is 391 2026-02-12T17:43:52.711 INFO:tasks.rados.rados.0.trial082.stdout:3555: finishing write tid 1 to trial08226312-43 2026-02-12T17:43:52.713 INFO:tasks.rados.rados.0.trial082.stdout:3555: finishing write tid 2 to trial08226312-43 2026-02-12T17:43:52.713 INFO:tasks.rados.rados.0.trial082.stdout:3556: done (1 left) 2026-02-12T17:43:52.713 INFO:tasks.rados.rados.0.trial082.stdout:3557: read oid 26 snap -1 2026-02-12T17:43:52.713 INFO:tasks.rados.rados.0.trial082.stdout:3557: expect (ObjNum 987 snap 304 seq_num 987) 2026-02-12T17:43:52.713 INFO:tasks.rados.rados.0.trial082.stdout:3558: read oid 34 snap -1 2026-02-12T17:43:52.713 INFO:tasks.rados.rados.0.trial082.stdout:3558: expect deleted 2026-02-12T17:43:52.714 INFO:tasks.rados.rados.0.trial082.stdout:3559: delete oid 22 current snap is 391 2026-02-12T17:43:52.714 INFO:tasks.rados.rados.0.trial082.stdout:3555: finishing write tid 3 to trial08226312-43 2026-02-12T17:43:52.714 INFO:tasks.rados.rados.0.trial082.stdout:3555: finishing write tid 4 to trial08226312-43 2026-02-12T17:43:52.714 INFO:tasks.rados.rados.0.trial082.stdout:3555: oid 43 updating version 0 to 2469 2026-02-12T17:43:52.714 INFO:tasks.rados.rados.0.trial082.stdout:3555: oid 43 version 2469 is already newer than 2467 2026-02-12T17:43:52.714 INFO:tasks.rados.rados.0.trial082.stdout:3555: oid 43 version 2469 is already newer than 2468 2026-02-12T17:43:52.714 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2469 (ObjNum 1214 snap 391 seq_num 1214) dirty exists 2026-02-12T17:43:52.714 INFO:tasks.rados.rados.0.trial082.stdout:3555: left oid 43 (ObjNum 1214 snap 391 seq_num 1214) 2026-02-12T17:43:52.715 INFO:tasks.rados.rados.0.trial082.stdout:3555: done (3 left) 2026-02-12T17:43:52.715 INFO:tasks.rados.rados.0.trial082.stdout:3558: done (2 left) 2026-02-12T17:43:52.715 INFO:tasks.rados.rados.0.trial082.stdout:3559: done (1 left) 2026-02-12T17:43:52.715 INFO:tasks.rados.rados.0.trial082.stdout:3560: snap_remove snap 375 2026-02-12T17:43:53.122 INFO:tasks.rados.rados.0.trial082.stdout:3560: done (1 left) 2026-02-12T17:43:53.122 INFO:tasks.rados.rados.0.trial082.stdout:3561: snap_create 2026-02-12T17:43:53.122 INFO:tasks.rados.rados.0.trial082.stdout:3557: expect (ObjNum 987 snap 304 seq_num 987) 2026-02-12T17:43:53.210 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:54.122 INFO:tasks.rados.rados.0.trial082.stdout:3557: done (1 left) 2026-02-12T17:43:54.122 INFO:tasks.rados.rados.0.trial082.stdout:3561: done (0 left) 2026-02-12T17:43:54.122 INFO:tasks.rados.rados.0.trial082.stdout:3562: write (excl) oid 12 current snap is 392 2026-02-12T17:43:54.122 INFO:tasks.rados.rados.0.trial082.stdout:3562: seq_num 1217 ranges {454119=594513,1515880=556760} 2026-02-12T17:43:54.126 INFO:tasks.rados.rados.0.trial082.stdout:3562: writing trial08226312-12 from 454119 to 1048632 tid 1 2026-02-12T17:43:54.130 INFO:tasks.rados.rados.0.trial082.stdout:3562: writing trial08226312-12 from 1515880 to 2072640 tid 2 2026-02-12T17:43:54.130 INFO:tasks.rados.rados.0.trial082.stdout:3563: snap_create 2026-02-12T17:43:54.130 INFO:tasks.rados.rados.0.trial082.stdout:3562: finishing write tid 1 to trial08226312-12 2026-02-12T17:43:54.132 INFO:tasks.rados.rados.0.trial082.stdout:3562: finishing write tid 2 to trial08226312-12 2026-02-12T17:43:54.132 INFO:tasks.rados.rados.0.trial082.stdout:3562: finishing write tid 3 to trial08226312-12 2026-02-12T17:43:54.132 INFO:tasks.rados.rados.0.trial082.stdout:3562: finishing write tid 4 to trial08226312-12 2026-02-12T17:43:54.132 INFO:tasks.rados.rados.0.trial082.stdout:3562: oid 12 updating version 0 to 2399 2026-02-12T17:43:54.132 INFO:tasks.rados.rados.0.trial082.stdout:3562: oid 12 updating version 2399 to 2400 2026-02-12T17:43:54.132 INFO:tasks.rados.rados.0.trial082.stdout:3562: oid 12 updating version 2400 to 2401 2026-02-12T17:43:54.132 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 2401 (ObjNum 1217 snap 392 seq_num 1217) dirty exists 2026-02-12T17:43:54.132 INFO:tasks.rados.rados.0.trial082.stdout:3562: left oid 12 (ObjNum 1217 snap 392 seq_num 1217) 2026-02-12T17:43:55.122 INFO:tasks.rados.rados.0.trial082.stdout:3562: done (1 left) 2026-02-12T17:43:55.122 INFO:tasks.rados.rados.0.trial082.stdout:3563: done (0 left) 2026-02-12T17:43:55.123 INFO:tasks.rados.rados.0.trial082.stdout:3564: write oid 10 current snap is 393 2026-02-12T17:43:55.123 INFO:tasks.rados.rados.0.trial082.stdout:3564: seq_num 1218 ranges {470926=669762,1574362=700418} 2026-02-12T17:43:55.126 INFO:tasks.rados.rados.0.trial082.stdout:3564: writing trial08226312-10 from 470926 to 1140688 tid 1 2026-02-12T17:43:55.131 INFO:tasks.rados.rados.0.trial082.stdout:3564: writing trial08226312-10 from 1574362 to 2274780 tid 2 2026-02-12T17:43:55.131 INFO:tasks.rados.rados.0.trial082.stdout:3565: write (excl) oid 18 current snap is 393 2026-02-12T17:43:55.131 INFO:tasks.rados.rados.0.trial082.stdout:3565: seq_num 1219 ranges {487733=745011,1632844=560429} 2026-02-12T17:43:55.135 INFO:tasks.rados.rados.0.trial082.stdout:3565: writing trial08226312-18 from 487733 to 1232744 tid 1 2026-02-12T17:43:55.139 INFO:tasks.rados.rados.0.trial082.stdout:3565: writing trial08226312-18 from 1632844 to 2193273 tid 2 2026-02-12T17:43:55.139 INFO:tasks.rados.rados.0.trial082.stdout:3566: read oid 19 snap 392 2026-02-12T17:43:55.139 INFO:tasks.rados.rados.0.trial082.stdout:3566: expect (ObjNum 1186 snap 381 seq_num 1186) 2026-02-12T17:43:55.139 INFO:tasks.rados.rados.0.trial082.stdout:3567: write oid 37 current snap is 393 2026-02-12T17:43:55.140 INFO:tasks.rados.rados.0.trial082.stdout:3567: seq_num 1220 ranges {504540=420260,1574973=704087} 2026-02-12T17:43:55.142 INFO:tasks.rados.rados.0.trial082.stdout:3567: writing trial08226312-37 from 504540 to 924800 tid 1 2026-02-12T17:43:55.148 INFO:tasks.rados.rados.0.trial082.stdout:3567: writing trial08226312-37 from 1574973 to 2279060 tid 2 2026-02-12T17:43:55.148 INFO:tasks.rados.rados.0.trial082.stdout:3568: delete oid 39 current snap is 393 2026-02-12T17:43:55.148 INFO:tasks.rados.rados.0.trial082.stdout:3564: finishing write tid 1 to trial08226312-10 2026-02-12T17:43:55.148 INFO:tasks.rados.rados.0.trial082.stdout:3564: finishing write tid 2 to trial08226312-10 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3564: finishing write tid 3 to trial08226312-10 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3564: finishing write tid 4 to trial08226312-10 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3564: oid 10 updating version 0 to 2470 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3564: oid 10 updating version 2470 to 2472 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3564: oid 10 version 2472 is already newer than 2471 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2472 (ObjNum 1218 snap 393 seq_num 1218) dirty exists 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3564: left oid 10 (ObjNum 1218 snap 393 seq_num 1218) 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3565: finishing write tid 1 to trial08226312-18 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3565: finishing write tid 2 to trial08226312-18 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3565: finishing write tid 3 to trial08226312-18 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3565: finishing write tid 4 to trial08226312-18 2026-02-12T17:43:55.149 INFO:tasks.rados.rados.0.trial082.stdout:3565: oid 18 updating version 0 to 2405 2026-02-12T17:43:55.150 INFO:tasks.rados.rados.0.trial082.stdout:3565: oid 18 version 2405 is already newer than 2404 2026-02-12T17:43:55.150 INFO:tasks.rados.rados.0.trial082.stdout:3565: oid 18 updating version 2405 to 2406 2026-02-12T17:43:55.150 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 2406 (ObjNum 1219 snap 393 seq_num 1219) dirty exists 2026-02-12T17:43:55.150 INFO:tasks.rados.rados.0.trial082.stdout:3565: left oid 18 (ObjNum 1219 snap 393 seq_num 1219) 2026-02-12T17:43:55.150 INFO:tasks.rados.rados.0.trial082.stdout:3566: expect (ObjNum 1186 snap 381 seq_num 1186) 2026-02-12T17:43:55.150 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:55.251 INFO:tasks.rados.rados.0.trial082.stdout:3567: finishing write tid 1 to trial08226312-37 2026-02-12T17:43:55.251 INFO:tasks.rados.rados.0.trial082.stdout:3564: done (4 left) 2026-02-12T17:43:55.252 INFO:tasks.rados.rados.0.trial082.stdout:3565: done (3 left) 2026-02-12T17:43:55.252 INFO:tasks.rados.rados.0.trial082.stdout:3566: done (2 left) 2026-02-12T17:43:55.252 INFO:tasks.rados.rados.0.trial082.stdout:3568: done (1 left) 2026-02-12T17:43:55.252 INFO:tasks.rados.rados.0.trial082.stdout:3569: read oid 24 snap -1 2026-02-12T17:43:55.252 INFO:tasks.rados.rados.0.trial082.stdout:3569: expect (ObjNum 1194 snap 382 seq_num 1194) 2026-02-12T17:43:55.252 INFO:tasks.rados.rados.0.trial082.stdout:3570: snap_remove snap 392 2026-02-12T17:43:56.127 INFO:tasks.rados.rados.0.trial082.stdout:3570: done (2 left) 2026-02-12T17:43:56.128 INFO:tasks.rados.rados.0.trial082.stdout:3571: write (excl) oid 7 current snap is 393 2026-02-12T17:43:56.128 INFO:tasks.rados.rados.0.trial082.stdout:3567: finishing write tid 2 to trial08226312-37 2026-02-12T17:43:56.128 INFO:tasks.rados.rados.0.trial082.stdout:3571: seq_num 1222 ranges {538154=570758,1691937=707756} 2026-02-12T17:43:56.132 INFO:tasks.rados.rados.0.trial082.stdout:3571: writing trial08226312-7 from 538154 to 1108912 tid 1 2026-02-12T17:43:56.137 INFO:tasks.rados.rados.0.trial082.stdout:3571: writing trial08226312-7 from 1691937 to 2399693 tid 2 2026-02-12T17:43:56.137 INFO:tasks.rados.rados.0.trial082.stdout:3572: write oid 2 current snap is 393 2026-02-12T17:43:56.137 INFO:tasks.rados.rados.0.trial082.stdout:3572: seq_num 1223 ranges {554961=646007,1750419=451414} 2026-02-12T17:43:56.141 INFO:tasks.rados.rados.0.trial082.stdout:3572: writing trial08226312-2 from 554961 to 1200968 tid 1 2026-02-12T17:43:56.145 INFO:tasks.rados.rados.0.trial082.stdout:3572: writing trial08226312-2 from 1750419 to 2201833 tid 2 2026-02-12T17:43:56.145 INFO:tasks.rados.rados.0.trial082.stdout:3573: copy_from oid 45 from oid 49 current snap is 393 2026-02-12T17:43:56.145 INFO:tasks.rados.rados.0.trial082.stdout:3567: finishing write tid 3 to trial08226312-37 2026-02-12T17:43:56.145 INFO:tasks.rados.rados.0.trial082.stdout:3567: finishing write tid 4 to trial08226312-37 2026-02-12T17:43:56.145 INFO:tasks.rados.rados.0.trial082.stdout:3567: oid 37 updating version 0 to 2403 2026-02-12T17:43:56.145 INFO:tasks.rados.rados.0.trial082.stdout:3567: oid 37 version 2403 is already newer than 2402 2026-02-12T17:43:56.145 INFO:tasks.rados.rados.0.trial082.stdout:3567: oid 37 updating version 2403 to 2404 2026-02-12T17:43:56.146 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 2404 (ObjNum 1220 snap 393 seq_num 1220) dirty exists 2026-02-12T17:43:56.146 INFO:tasks.rados.rados.0.trial082.stdout:3567: left oid 37 (ObjNum 1220 snap 393 seq_num 1220) 2026-02-12T17:43:56.146 INFO:tasks.rados.rados.0.trial082.stdout:3569: expect (ObjNum 1194 snap 382 seq_num 1194) 2026-02-12T17:43:56.146 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:56.163 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:56.198 INFO:tasks.rados.rados.0.trial082.stdout:3571: finishing write tid 1 to trial08226312-7 2026-02-12T17:43:56.198 INFO:tasks.rados.rados.0.trial082.stdout:3567: done (4 left) 2026-02-12T17:43:56.198 INFO:tasks.rados.rados.0.trial082.stdout:3569: done (3 left) 2026-02-12T17:43:56.198 INFO:tasks.rados.rados.0.trial082.stdout:3574: snap_remove snap 376 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3574: done (3 left) 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3575: read oid 20 snap -1 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3575: expect (ObjNum 1198 snap 385 seq_num 1198) 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3576: copy_from oid 23 from oid 22 current snap is 393 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3571: finishing write tid 2 to trial08226312-7 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3571: finishing write tid 3 to trial08226312-7 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3571: finishing write tid 4 to trial08226312-7 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3571: oid 7 updating version 0 to 2418 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3571: oid 7 updating version 2418 to 2419 2026-02-12T17:43:57.133 INFO:tasks.rados.rados.0.trial082.stdout:3571: oid 7 version 2419 is already newer than 2417 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 2419 (ObjNum 1222 snap 393 seq_num 1222) dirty exists 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3571: left oid 7 (ObjNum 1222 snap 393 seq_num 1222) 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3572: finishing write tid 1 to trial08226312-2 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3571: done (4 left) 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3577: snap_create 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3572: finishing write tid 2 to trial08226312-2 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3572: finishing write tid 3 to trial08226312-2 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3572: finishing write tid 4 to trial08226312-2 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3572: oid 2 updating version 0 to 2256 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3572: oid 2 version 2256 is already newer than 2254 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3572: oid 2 version 2256 is already newer than 2255 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 2256 (ObjNum 1223 snap 393 seq_num 1223) dirty exists 2026-02-12T17:43:57.134 INFO:tasks.rados.rados.0.trial082.stdout:3572: left oid 2 (ObjNum 1223 snap 393 seq_num 1223) 2026-02-12T17:43:57.135 INFO:tasks.rados.rados.0.trial082.stdout:3573: finishing copy_from racing read to trial08226312-45 2026-02-12T17:43:57.135 INFO:tasks.rados.rados.0.trial082.stdout:3573: finishing copy_from to trial08226312-45 2026-02-12T17:43:57.135 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2403 (ObjNum 1201 snap 386 seq_num 1201) dirty exists 2026-02-12T17:43:57.135 INFO:tasks.rados.rados.0.trial082.stdout:3576: finishing copy_from to trial08226312-23 2026-02-12T17:43:57.136 INFO:tasks.rados.rados.0.trial082.stdout:3576: got expected ENOENT (src dne) 2026-02-12T17:43:57.136 INFO:tasks.rados.rados.0.trial082.stdout:3576: finishing copy_from racing read to trial08226312-23 2026-02-12T17:43:57.136 INFO:tasks.rados.rados.0.trial082.stdout:3575: expect (ObjNum 1198 snap 385 seq_num 1198) 2026-02-12T17:43:57.136 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:57.157 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1987388 2026-02-12T17:43:58.134 INFO:tasks.rados.rados.0.trial082.stdout:3572: done (4 left) 2026-02-12T17:43:58.134 INFO:tasks.rados.rados.0.trial082.stdout:3573: done (3 left) 2026-02-12T17:43:58.134 INFO:tasks.rados.rados.0.trial082.stdout:3575: done (2 left) 2026-02-12T17:43:58.135 INFO:tasks.rados.rados.0.trial082.stdout:3576: done (1 left) 2026-02-12T17:43:58.135 INFO:tasks.rados.rados.0.trial082.stdout:3577: done (0 left) 2026-02-12T17:43:58.135 INFO:tasks.rados.rados.0.trial082.stdout:3578: read oid 1 snap -1 2026-02-12T17:43:58.135 INFO:tasks.rados.rados.0.trial082.stdout:3578: expect (ObjNum 1189 snap 382 seq_num 1189) 2026-02-12T17:43:58.135 INFO:tasks.rados.rados.0.trial082.stdout:3579: write oid 44 current snap is 394 2026-02-12T17:43:58.135 INFO:tasks.rados.rados.0.trial082.stdout:3579: seq_num 1224 ranges {571768=437609,1808901=711425} 2026-02-12T17:43:58.137 INFO:tasks.rados.rados.0.trial082.stdout:3579: writing trial08226312-44 from 571768 to 1009377 tid 1 2026-02-12T17:43:58.143 INFO:tasks.rados.rados.0.trial082.stdout:3579: writing trial08226312-44 from 1808901 to 2520326 tid 2 2026-02-12T17:43:58.144 INFO:tasks.rados.rados.0.trial082.stdout:3580: read oid 5 snap -1 2026-02-12T17:43:58.144 INFO:tasks.rados.rados.0.trial082.stdout:3580: expect (ObjNum 1196 snap 384 seq_num 1196) 2026-02-12T17:43:58.144 INFO:tasks.rados.rados.0.trial082.stdout:3581: read oid 30 snap -1 2026-02-12T17:43:58.144 INFO:tasks.rados.rados.0.trial082.stdout:3581: expect (ObjNum 1051 snap 330 seq_num 1051) 2026-02-12T17:43:58.144 INFO:tasks.rados.rados.0.trial082.stdout:3582: write oid 3 current snap is 394 2026-02-12T17:43:58.144 INFO:tasks.rados.rados.0.trial082.stdout:3582: seq_num 1225 ranges {588575=512858,1867383=455083} 2026-02-12T17:43:58.147 INFO:tasks.rados.rados.0.trial082.stdout:3582: writing trial08226312-3 from 588575 to 1101433 tid 1 2026-02-12T17:43:58.152 INFO:tasks.rados.rados.0.trial082.stdout:3582: writing trial08226312-3 from 1867383 to 2322466 tid 2 2026-02-12T17:43:58.152 INFO:tasks.rados.rados.0.trial082.stdout:3583: write oid 10 current snap is 394 2026-02-12T17:43:58.152 INFO:tasks.rados.rados.0.trial082.stdout:3583: seq_num 1226 ranges {605382=588107,1925865=679517} 2026-02-12T17:43:58.156 INFO:tasks.rados.rados.0.trial082.stdout:3583: writing trial08226312-10 from 605382 to 1193489 tid 1 2026-02-12T17:43:58.162 INFO:tasks.rados.rados.0.trial082.stdout:3583: writing trial08226312-10 from 1925865 to 2605382 tid 2 2026-02-12T17:43:58.162 INFO:tasks.rados.rados.0.trial082.stdout:3584: read oid 6 snap -1 2026-02-12T17:43:58.162 INFO:tasks.rados.rados.0.trial082.stdout:3584: expect (ObjNum 1210 snap 390 seq_num 1210) 2026-02-12T17:43:58.162 INFO:tasks.rados.rados.0.trial082.stdout:3585: write (excl) oid 45 current snap is 394 2026-02-12T17:43:58.162 INFO:tasks.rados.rados.0.trial082.stdout:3585: seq_num 1227 ranges {622189=663356,1984347=458752} 2026-02-12T17:43:58.166 INFO:tasks.rados.rados.0.trial082.stdout:3585: writing trial08226312-45 from 622189 to 1285545 tid 1 2026-02-12T17:43:58.171 INFO:tasks.rados.rados.0.trial082.stdout:3585: writing trial08226312-45 from 1984347 to 2443099 tid 2 2026-02-12T17:43:58.171 INFO:tasks.rados.rados.0.trial082.stdout:3586: write (excl) oid 35 current snap is 394 2026-02-12T17:43:58.171 INFO:tasks.rados.rados.0.trial082.stdout:3586: seq_num 1228 ranges {638996=738605,1926476=712520} 2026-02-12T17:43:58.176 INFO:tasks.rados.rados.0.trial082.stdout:3586: writing trial08226312-35 from 638996 to 1377601 tid 1 2026-02-12T17:43:58.181 INFO:tasks.rados.rados.0.trial082.stdout:3586: writing trial08226312-35 from 1926476 to 2638996 tid 2 2026-02-12T17:43:58.181 INFO:tasks.rados.rados.0.trial082.stdout:3587: rollback oid 43 current snap is 394 2026-02-12T17:43:58.181 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 43 to 338 2026-02-12T17:43:58.181 INFO:tasks.rados.rados.0.trial082.stdout:3578: expect (ObjNum 1189 snap 382 seq_num 1189) 2026-02-12T17:43:58.270 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1532324 2026-02-12T17:43:58.300 INFO:tasks.rados.rados.0.trial082.stdout:3579: finishing write tid 1 to trial08226312-44 2026-02-12T17:43:58.300 INFO:tasks.rados.rados.0.trial082.stdout:3578: done (9 left) 2026-02-12T17:43:58.300 INFO:tasks.rados.rados.0.trial082.stdout:3588: delete oid 7 current snap is 394 2026-02-12T17:43:58.300 INFO:tasks.rados.rados.0.trial082.stdout:3579: finishing write tid 2 to trial08226312-44 2026-02-12T17:43:58.300 INFO:tasks.rados.rados.0.trial082.stdout:3579: finishing write tid 3 to trial08226312-44 2026-02-12T17:43:58.300 INFO:tasks.rados.rados.0.trial082.stdout:3581: expect (ObjNum 1051 snap 330 seq_num 1051) 2026-02-12T17:43:58.384 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2330048 2026-02-12T17:43:58.470 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 3255946 2026-02-12T17:43:58.476 INFO:tasks.rados.rados.0.trial082.stdout:3579: finishing write tid 4 to trial08226312-44 2026-02-12T17:43:58.476 INFO:tasks.rados.rados.0.trial082.stdout:3579: oid 44 updating version 0 to 2475 2026-02-12T17:43:58.476 INFO:tasks.rados.rados.0.trial082.stdout:3579: oid 44 version 2475 is already newer than 2473 2026-02-12T17:43:58.476 INFO:tasks.rados.rados.0.trial082.stdout:3579: oid 44 version 2475 is already newer than 2474 2026-02-12T17:43:58.476 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2475 (ObjNum 1224 snap 394 seq_num 1224) dirty exists 2026-02-12T17:43:58.476 INFO:tasks.rados.rados.0.trial082.stdout:3579: left oid 44 (ObjNum 1224 snap 394 seq_num 1224) 2026-02-12T17:43:58.477 INFO:tasks.rados.rados.0.trial082.stdout:3580: expect (ObjNum 1196 snap 384 seq_num 1196) 2026-02-12T17:43:58.517 INFO:tasks.rados.rados.0.trial082.stdout:3582: finishing write tid 1 to trial08226312-3 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3579: done (9 left) 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3580: done (8 left) 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3581: done (7 left) 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3588: done (6 left) 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3589: read oid 25 snap -1 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3589: expect (ObjNum 1208 snap 390 seq_num 1208) 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3590: rollback oid 4 current snap is 394 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 4 to 384 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3582: finishing write tid 2 to trial08226312-3 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3582: finishing write tid 3 to trial08226312-3 2026-02-12T17:43:58.518 INFO:tasks.rados.rados.0.trial082.stdout:3582: finishing write tid 4 to trial08226312-3 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3582: oid 3 updating version 0 to 2408 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3582: oid 3 updating version 2408 to 2409 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3582: oid 3 updating version 2409 to 2410 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 2410 (ObjNum 1225 snap 394 seq_num 1225) dirty exists 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3582: left oid 3 (ObjNum 1225 snap 394 seq_num 1225) 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3583: finishing write tid 1 to trial08226312-10 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3583: finishing write tid 2 to trial08226312-10 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3583: finishing write tid 3 to trial08226312-10 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3583: finishing write tid 4 to trial08226312-10 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3583: oid 10 updating version 0 to 2473 2026-02-12T17:43:58.519 INFO:tasks.rados.rados.0.trial082.stdout:3583: oid 10 updating version 2473 to 2475 2026-02-12T17:43:58.520 INFO:tasks.rados.rados.0.trial082.stdout:3583: oid 10 version 2475 is already newer than 2474 2026-02-12T17:43:58.520 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2475 (ObjNum 1226 snap 394 seq_num 1226) dirty exists 2026-02-12T17:43:58.520 INFO:tasks.rados.rados.0.trial082.stdout:3583: left oid 10 (ObjNum 1226 snap 394 seq_num 1226) 2026-02-12T17:43:58.520 INFO:tasks.rados.rados.0.trial082.stdout:3584: expect (ObjNum 1210 snap 390 seq_num 1210) 2026-02-12T17:43:58.520 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:58.548 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 98329 2026-02-12T17:43:58.604 INFO:tasks.rados.rados.0.trial082.stdout:3585: finishing write tid 1 to trial08226312-45 2026-02-12T17:43:58.604 INFO:tasks.rados.rados.0.trial082.stdout:3585: finishing write tid 2 to trial08226312-45 2026-02-12T17:43:58.604 INFO:tasks.rados.rados.0.trial082.stdout:3585: finishing write tid 3 to trial08226312-45 2026-02-12T17:43:58.604 INFO:tasks.rados.rados.0.trial082.stdout:3585: finishing write tid 4 to trial08226312-45 2026-02-12T17:43:58.604 INFO:tasks.rados.rados.0.trial082.stdout:3585: oid 45 updating version 0 to 2476 2026-02-12T17:43:58.604 INFO:tasks.rados.rados.0.trial082.stdout:3585: oid 45 updating version 2476 to 2478 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3585: oid 45 version 2478 is already newer than 2477 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2478 (ObjNum 1227 snap 394 seq_num 1227) dirty exists 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3585: left oid 45 (ObjNum 1227 snap 394 seq_num 1227) 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3586: finishing write tid 1 to trial08226312-35 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3586: finishing write tid 2 to trial08226312-35 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3586: finishing write tid 3 to trial08226312-35 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3582: done (7 left) 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3583: done (6 left) 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3584: done (5 left) 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3585: done (4 left) 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3591: copy_from oid 30 from oid 16 current snap is 394 2026-02-12T17:43:58.605 INFO:tasks.rados.rados.0.trial082.stdout:3586: finishing write tid 4 to trial08226312-35 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3586: oid 35 updating version 0 to 2479 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3586: oid 35 updating version 2479 to 2480 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3586: oid 35 updating version 2480 to 2481 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 2481 (ObjNum 1228 snap 394 seq_num 1228) dirty exists 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3586: left oid 35 (ObjNum 1228 snap 394 seq_num 1228) 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3587: finishing rollback tid 0 to trial08226312-43 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3587: finishing rollback tid 1 to trial08226312-43 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3587: finishing rollback tid 2 to trial08226312-43 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2478 (ObjNum 994 snap 307 seq_num 994) dirty exists 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3590: finishing rollback tid 0 to trial08226312-4 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3590: finishing rollback tid 1 to trial08226312-4 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:3590: finishing rollback tid 2 to trial08226312-4 2026-02-12T17:43:58.606 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 2726 (ObjNum 1146 snap 364 seq_num 1146) dirty exists 2026-02-12T17:43:58.607 INFO:tasks.rados.rados.0.trial082.stdout:3589: expect (ObjNum 1208 snap 390 seq_num 1208) 2026-02-12T17:43:58.607 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:58.620 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:43:58.639 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1678862 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3591: finishing copy_from racing read to trial08226312-30 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3591: finishing copy_from to trial08226312-30 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 1574 (ObjNum 1007 snap 314 seq_num 1007) dirty exists 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3586: done (4 left) 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3587: done (3 left) 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3589: done (2 left) 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3590: done (1 left) 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3591: done (0 left) 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3592: read oid 7 snap 387 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3592: expect (ObjNum 1105 snap 346 seq_num 1105) 2026-02-12T17:43:58.647 INFO:tasks.rados.rados.0.trial082.stdout:3593: write oid 23 current snap is 394 2026-02-12T17:43:58.648 INFO:tasks.rados.rados.0.trial082.stdout:3593: seq_num 1230 ranges {672610=489103,1643440=722432} 2026-02-12T17:43:58.651 INFO:tasks.rados.rados.0.trial082.stdout:3593: writing trial08226312-23 from 672610 to 1161713 tid 1 2026-02-12T17:43:58.656 INFO:tasks.rados.rados.0.trial082.stdout:3593: writing trial08226312-23 from 1643440 to 2365872 tid 2 2026-02-12T17:43:58.656 INFO:tasks.rados.rados.0.trial082.stdout:3594: read oid 28 snap -1 2026-02-12T17:43:58.656 INFO:tasks.rados.rados.0.trial082.stdout:3594: expect (ObjNum 1158 snap 372 seq_num 1158) 2026-02-12T17:43:58.656 INFO:tasks.rados.rados.0.trial082.stdout:3595: copy_from oid 26 from oid 18 current snap is 394 2026-02-12T17:43:58.656 INFO:tasks.rados.rados.0.trial082.stdout:3592: expect (ObjNum 1105 snap 346 seq_num 1105) 2026-02-12T17:43:58.656 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 303050 2026-02-12T17:43:58.729 INFO:tasks.rados.rados.0.trial082.stdout:3593: finishing write tid 1 to trial08226312-23 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:3592: done (3 left) 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:3596: write (excl) oid 17 current snap is 394 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:3593: finishing write tid 2 to trial08226312-23 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:3593: finishing write tid 3 to trial08226312-23 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:3593: finishing write tid 4 to trial08226312-23 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:3593: oid 23 updating version 0 to 2482 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:3593: oid 23 updating version 2482 to 2483 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:3593: oid 23 updating version 2483 to 2484 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 2484 (ObjNum 1230 snap 394 seq_num 1230) dirty exists 2026-02-12T17:43:58.730 INFO:tasks.rados.rados.0.trial082.stdout:3593: left oid 23 (ObjNum 1230 snap 394 seq_num 1230) 2026-02-12T17:43:58.731 INFO:tasks.rados.rados.0.trial082.stdout:3594: expect (ObjNum 1158 snap 372 seq_num 1158) 2026-02-12T17:43:58.839 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2513063 2026-02-12T17:43:58.853 INFO:tasks.rados.rados.0.trial082.stdout:3595: finishing copy_from racing read to trial08226312-26 2026-02-12T17:43:58.853 INFO:tasks.rados.rados.0.trial082.stdout:3595: finishing copy_from to trial08226312-26 2026-02-12T17:43:58.853 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 2406 (ObjNum 1219 snap 393 seq_num 1219) dirty exists 2026-02-12T17:43:58.853 INFO:tasks.rados.rados.0.trial082.stdout:3596: seq_num 1231 ranges {689417=564352,1701922=466090} 2026-02-12T17:43:58.858 INFO:tasks.rados.rados.0.trial082.stdout:3596: writing trial08226312-17 from 689417 to 1253769 tid 1 2026-02-12T17:43:58.862 INFO:tasks.rados.rados.0.trial082.stdout:3596: writing trial08226312-17 from 1701922 to 2168012 tid 2 2026-02-12T17:43:58.862 INFO:tasks.rados.rados.0.trial082.stdout:3593: done (3 left) 2026-02-12T17:43:58.862 INFO:tasks.rados.rados.0.trial082.stdout:3594: done (2 left) 2026-02-12T17:43:58.862 INFO:tasks.rados.rados.0.trial082.stdout:3595: done (1 left) 2026-02-12T17:43:58.862 INFO:tasks.rados.rados.0.trial082.stdout:3597: snap_remove snap 364 2026-02-12T17:43:59.138 INFO:tasks.rados.rados.0.trial082.stdout:3597: done (1 left) 2026-02-12T17:43:59.138 INFO:tasks.rados.rados.0.trial082.stdout:3598: snap_remove snap 341 2026-02-12T17:44:00.141 INFO:tasks.rados.rados.0.trial082.stdout:3598: done (1 left) 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:3599: rollback oid 22 current snap is 394 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 303 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:3596: finishing write tid 1 to trial08226312-17 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:3596: finishing write tid 2 to trial08226312-17 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:3596: finishing write tid 3 to trial08226312-17 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:3596: finishing write tid 4 to trial08226312-17 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:3596: oid 17 updating version 0 to 2728 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:3596: oid 17 updating version 2728 to 2729 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:3596: oid 17 updating version 2729 to 2730 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2730 (ObjNum 1231 snap 394 seq_num 1231) dirty exists 2026-02-12T17:44:00.142 INFO:tasks.rados.rados.0.trial082.stdout:3596: left oid 17 (ObjNum 1231 snap 394 seq_num 1231) 2026-02-12T17:44:00.143 INFO:tasks.rados.rados.0.trial082.stdout:3596: done (1 left) 2026-02-12T17:44:00.143 INFO:tasks.rados.rados.0.trial082.stdout:3600: write oid 34 current snap is 394 2026-02-12T17:44:00.143 INFO:tasks.rados.rados.0.trial082.stdout:3600: seq_num 1232 ranges {706224=755954,2160404=545820} 2026-02-12T17:44:00.146 INFO:tasks.rados.rados.0.trial082.stdout:3600: writing trial08226312-34 from 706224 to 1462178 tid 1 2026-02-12T17:44:00.151 INFO:tasks.rados.rados.0.trial082.stdout:3600: writing trial08226312-34 from 2160404 to 2706224 tid 2 2026-02-12T17:44:00.151 INFO:tasks.rados.rados.0.trial082.stdout:3601: snap_create 2026-02-12T17:44:00.151 INFO:tasks.rados.rados.0.trial082.stdout:3599: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:44:00.151 INFO:tasks.rados.rados.0.trial082.stdout:3599: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:44:00.152 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2480 (ObjNum 693 snap 208 seq_num 693) dirty exists 2026-02-12T17:44:00.152 INFO:tasks.rados.rados.0.trial082.stdout:3600: finishing write tid 1 to trial08226312-34 2026-02-12T17:44:00.153 INFO:tasks.rados.rados.0.trial082.stdout:3600: finishing write tid 2 to trial08226312-34 2026-02-12T17:44:00.153 INFO:tasks.rados.rados.0.trial082.stdout:3600: finishing write tid 3 to trial08226312-34 2026-02-12T17:44:00.153 INFO:tasks.rados.rados.0.trial082.stdout:3600: finishing write tid 4 to trial08226312-34 2026-02-12T17:44:00.153 INFO:tasks.rados.rados.0.trial082.stdout:3600: oid 34 updating version 0 to 2409 2026-02-12T17:44:00.153 INFO:tasks.rados.rados.0.trial082.stdout:3600: oid 34 version 2409 is already newer than 2407 2026-02-12T17:44:00.153 INFO:tasks.rados.rados.0.trial082.stdout:3600: oid 34 version 2409 is already newer than 2408 2026-02-12T17:44:00.153 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 2409 (ObjNum 1232 snap 394 seq_num 1232) dirty exists 2026-02-12T17:44:00.154 INFO:tasks.rados.rados.0.trial082.stdout:3600: left oid 34 (ObjNum 1232 snap 394 seq_num 1232) 2026-02-12T17:44:01.142 INFO:tasks.rados.rados.0.trial082.stdout:3599: done (2 left) 2026-02-12T17:44:01.142 INFO:tasks.rados.rados.0.trial082.stdout:3600: done (1 left) 2026-02-12T17:44:01.142 INFO:tasks.rados.rados.0.trial082.stdout:3601: done (0 left) 2026-02-12T17:44:01.142 INFO:tasks.rados.rados.0.trial082.stdout:3602: snap_create 2026-02-12T17:44:02.142 INFO:tasks.rados.rados.0.trial082.stdout:3602: done (0 left) 2026-02-12T17:44:02.142 INFO:tasks.rados.rados.0.trial082.stdout:3603: write oid 43 current snap is 396 2026-02-12T17:44:02.143 INFO:tasks.rados.rados.0.trial082.stdout:3603: seq_num 1233 ranges {723031=431203,1818886=469759} 2026-02-12T17:44:02.147 INFO:tasks.rados.rados.0.trial082.stdout:3603: writing trial08226312-43 from 723031 to 1154234 tid 1 2026-02-12T17:44:02.151 INFO:tasks.rados.rados.0.trial082.stdout:3603: writing trial08226312-43 from 1818886 to 2288645 tid 2 2026-02-12T17:44:02.151 INFO:tasks.rados.rados.0.trial082.stdout:3604: snap_remove snap 373 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3604: done (1 left) 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3605: rollback oid 28 current snap is 396 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 359 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3603: finishing write tid 1 to trial08226312-43 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3603: finishing write tid 2 to trial08226312-43 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3603: finishing write tid 3 to trial08226312-43 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3603: finishing write tid 4 to trial08226312-43 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3603: oid 43 updating version 0 to 2482 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3603: oid 43 updating version 2482 to 2483 2026-02-12T17:44:03.124 INFO:tasks.rados.rados.0.trial082.stdout:3603: oid 43 version 2483 is already newer than 2481 2026-02-12T17:44:03.125 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2483 (ObjNum 1233 snap 396 seq_num 1233) dirty exists 2026-02-12T17:44:03.125 INFO:tasks.rados.rados.0.trial082.stdout:3603: left oid 43 (ObjNum 1233 snap 396 seq_num 1233) 2026-02-12T17:44:03.125 INFO:tasks.rados.rados.0.trial082.stdout:3603: done (1 left) 2026-02-12T17:44:03.125 INFO:tasks.rados.rados.0.trial082.stdout:3606: delete oid 40 current snap is 396 2026-02-12T17:44:03.129 INFO:tasks.rados.rados.0.trial082.stdout:3605: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:44:03.131 INFO:tasks.rados.rados.0.trial082.stdout:3605: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:44:03.131 INFO:tasks.rados.rados.0.trial082.stdout:3605: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:44:03.132 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2423 (ObjNum 1138 snap 356 seq_num 1138) dirty exists 2026-02-12T17:44:03.132 INFO:tasks.rados.rados.0.trial082.stdout:3605: done (1 left) 2026-02-12T17:44:03.132 INFO:tasks.rados.rados.0.trial082.stdout:3606: done (0 left) 2026-02-12T17:44:03.132 INFO:tasks.rados.rados.0.trial082.stdout:3607: delete oid 27 current snap is 396 2026-02-12T17:44:03.133 INFO:tasks.rados.rados.0.trial082.stdout:3607: done (0 left) 2026-02-12T17:44:03.133 INFO:tasks.rados.rados.0.trial082.stdout:3608: delete oid 9 current snap is 396 2026-02-12T17:44:03.135 INFO:tasks.rados.rados.0.trial082.stdout:3608: done (0 left) 2026-02-12T17:44:03.135 INFO:tasks.rados.rados.0.trial082.stdout:3609: snap_create 2026-02-12T17:44:04.128 INFO:tasks.rados.rados.0.trial082.stdout:3609: done (0 left) 2026-02-12T17:44:04.128 INFO:tasks.rados.rados.0.trial082.stdout:3610: rollback oid 1 current snap is 397 2026-02-12T17:44:04.128 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 1 to 303 2026-02-12T17:44:04.128 INFO:tasks.rados.rados.0.trial082.stdout:3611: rollback oid 45 current snap is 397 2026-02-12T17:44:04.129 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 385 2026-02-12T17:44:04.129 INFO:tasks.rados.rados.0.trial082.stdout:3612: read oid 48 snap -1 2026-02-12T17:44:04.129 INFO:tasks.rados.rados.0.trial082.stdout:3612: expect deleted 2026-02-12T17:44:04.129 INFO:tasks.rados.rados.0.trial082.stdout:3613: write (excl) oid 27 current snap is 397 2026-02-12T17:44:04.129 INFO:tasks.rados.rados.0.trial082.stdout:3613: seq_num 1237 ranges {790259=732199,1936461=477097} 2026-02-12T17:44:04.134 INFO:tasks.rados.rados.0.trial082.stdout:3613: writing trial08226312-27 from 790259 to 1522458 tid 1 2026-02-12T17:44:04.137 INFO:tasks.rados.rados.0.trial082.stdout:3613: writing trial08226312-27 from 1936461 to 2413558 tid 2 2026-02-12T17:44:04.137 INFO:tasks.rados.rados.0.trial082.stdout:3614: delete oid 7 current snap is 397 2026-02-12T17:44:04.138 INFO:tasks.rados.rados.0.trial082.stdout:3611: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:44:04.138 INFO:tasks.rados.rados.0.trial082.stdout:3611: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:44:04.138 INFO:tasks.rados.rados.0.trial082.stdout:3611: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:44:04.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2487 (ObjNum 1103 snap 346 seq_num 1103) dirty exists 2026-02-12T17:44:04.138 INFO:tasks.rados.rados.0.trial082.stdout:3610: finishing rollback tid 0 to trial08226312-1 2026-02-12T17:44:04.138 INFO:tasks.rados.rados.0.trial082.stdout:3610: finishing rollback tid 1 to trial08226312-1 2026-02-12T17:44:04.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2446 (ObjNum 129 snap 0 seq_num 27561728) dirty dne 2026-02-12T17:44:04.138 INFO:tasks.rados.rados.0.trial082.stdout:3613: finishing write tid 1 to trial08226312-27 2026-02-12T17:44:04.139 INFO:tasks.rados.rados.0.trial082.stdout:3610: done (4 left) 2026-02-12T17:44:04.139 INFO:tasks.rados.rados.0.trial082.stdout:3611: done (3 left) 2026-02-12T17:44:04.139 INFO:tasks.rados.rados.0.trial082.stdout:3614: done (2 left) 2026-02-12T17:44:04.139 INFO:tasks.rados.rados.0.trial082.stdout:3615: snap_create 2026-02-12T17:44:04.140 INFO:tasks.rados.rados.0.trial082.stdout:3613: finishing write tid 2 to trial08226312-27 2026-02-12T17:44:04.140 INFO:tasks.rados.rados.0.trial082.stdout:3613: finishing write tid 3 to trial08226312-27 2026-02-12T17:44:04.140 INFO:tasks.rados.rados.0.trial082.stdout:3613: finishing write tid 4 to trial08226312-27 2026-02-12T17:44:04.140 INFO:tasks.rados.rados.0.trial082.stdout:3613: oid 27 updating version 0 to 2275 2026-02-12T17:44:04.140 INFO:tasks.rados.rados.0.trial082.stdout:3613: oid 27 version 2275 is already newer than 2274 2026-02-12T17:44:04.140 INFO:tasks.rados.rados.0.trial082.stdout:3613: oid 27 updating version 2275 to 2276 2026-02-12T17:44:04.140 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2276 (ObjNum 1237 snap 397 seq_num 1237) dirty exists 2026-02-12T17:44:04.140 INFO:tasks.rados.rados.0.trial082.stdout:3613: left oid 27 (ObjNum 1237 snap 397 seq_num 1237) 2026-02-12T17:44:05.128 INFO:tasks.rados.rados.0.trial082.stdout:3612: done (2 left) 2026-02-12T17:44:05.129 INFO:tasks.rados.rados.0.trial082.stdout:3613: done (1 left) 2026-02-12T17:44:05.129 INFO:tasks.rados.rados.0.trial082.stdout:3615: done (0 left) 2026-02-12T17:44:05.129 INFO:tasks.rados.rados.0.trial082.stdout:3616: read oid 19 snap -1 2026-02-12T17:44:05.129 INFO:tasks.rados.rados.0.trial082.stdout:3616: expect (ObjNum 1186 snap 381 seq_num 1186) 2026-02-12T17:44:05.129 INFO:tasks.rados.rados.0.trial082.stdout:3617: snap_remove snap 378 2026-02-12T17:44:06.129 INFO:tasks.rados.rados.0.trial082.stdout:3617: done (1 left) 2026-02-12T17:44:06.129 INFO:tasks.rados.rados.0.trial082.stdout:3618: snap_create 2026-02-12T17:44:06.129 INFO:tasks.rados.rados.0.trial082.stdout:3616: expect (ObjNum 1186 snap 381 seq_num 1186) 2026-02-12T17:44:06.170 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:06.211 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:07.132 INFO:tasks.rados.rados.0.trial082.stdout:3616: done (1 left) 2026-02-12T17:44:07.133 INFO:tasks.rados.rados.0.trial082.stdout:3618: done (0 left) 2026-02-12T17:44:07.133 INFO:tasks.rados.rados.0.trial082.stdout:3619: read oid 35 snap -1 2026-02-12T17:44:07.133 INFO:tasks.rados.rados.0.trial082.stdout:3619: expect (ObjNum 1228 snap 394 seq_num 1228) 2026-02-12T17:44:07.133 INFO:tasks.rados.rados.0.trial082.stdout:3620: rollback oid 49 current snap is 399 2026-02-12T17:44:07.133 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 344 2026-02-12T17:44:07.133 INFO:tasks.rados.rados.0.trial082.stdout:3621: read oid 19 snap -1 2026-02-12T17:44:07.133 INFO:tasks.rados.rados.0.trial082.stdout:3621: expect (ObjNum 1186 snap 381 seq_num 1186) 2026-02-12T17:44:07.133 INFO:tasks.rados.rados.0.trial082.stdout:3622: read oid 13 snap -1 2026-02-12T17:44:07.133 INFO:tasks.rados.rados.0.trial082.stdout:3622: expect (ObjNum 1195 snap 384 seq_num 1195) 2026-02-12T17:44:07.134 INFO:tasks.rados.rados.0.trial082.stdout:3623: read oid 26 snap -1 2026-02-12T17:44:07.134 INFO:tasks.rados.rados.0.trial082.stdout:3623: expect (ObjNum 1219 snap 393 seq_num 1219) 2026-02-12T17:44:07.134 INFO:tasks.rados.rados.0.trial082.stdout:3624: rollback oid 44 current snap is 399 2026-02-12T17:44:07.134 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 388 2026-02-12T17:44:07.134 INFO:tasks.rados.rados.0.trial082.stdout:3625: snap_create 2026-02-12T17:44:07.135 INFO:tasks.rados.rados.0.trial082.stdout:3620: finishing rollback tid 0 to trial08226312-49 2026-02-12T17:44:07.135 INFO:tasks.rados.rados.0.trial082.stdout:3620: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:44:07.135 INFO:tasks.rados.rados.0.trial082.stdout:3620: finishing rollback tid 2 to trial08226312-49 2026-02-12T17:44:07.135 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 2412 (ObjNum 1069 snap 337 seq_num 1069) dirty exists 2026-02-12T17:44:07.137 INFO:tasks.rados.rados.0.trial082.stdout:3622: expect (ObjNum 1195 snap 384 seq_num 1195) 2026-02-12T17:44:07.137 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:07.187 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:07.212 INFO:tasks.rados.rados.0.trial082.stdout:3621: expect (ObjNum 1186 snap 381 seq_num 1186) 2026-02-12T17:44:07.212 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:07.333 INFO:tasks.rados.rados.0.trial082.stdout:3619: expect (ObjNum 1228 snap 394 seq_num 1228) 2026-02-12T17:44:07.347 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2354698 2026-02-12T17:44:07.391 INFO:tasks.rados.rados.0.trial082.stdout:3623: expect (ObjNum 1219 snap 393 seq_num 1219) 2026-02-12T17:44:07.472 INFO:tasks.rados.rados.0.trial082.stdout:3624: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:44:07.472 INFO:tasks.rados.rados.0.trial082.stdout:3624: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:44:07.472 INFO:tasks.rados.rados.0.trial082.stdout:3624: finishing rollback tid 2 to trial08226312-44 2026-02-12T17:44:07.472 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2490 (ObjNum 1141 snap 359 seq_num 1141) dirty exists 2026-02-12T17:44:08.126 INFO:tasks.rados.rados.0.trial082.stdout:3619: done (6 left) 2026-02-12T17:44:08.126 INFO:tasks.rados.rados.0.trial082.stdout:3620: done (5 left) 2026-02-12T17:44:08.127 INFO:tasks.rados.rados.0.trial082.stdout:3621: done (4 left) 2026-02-12T17:44:08.127 INFO:tasks.rados.rados.0.trial082.stdout:3622: done (3 left) 2026-02-12T17:44:08.127 INFO:tasks.rados.rados.0.trial082.stdout:3623: done (2 left) 2026-02-12T17:44:08.127 INFO:tasks.rados.rados.0.trial082.stdout:3624: done (1 left) 2026-02-12T17:44:08.127 INFO:tasks.rados.rados.0.trial082.stdout:3625: done (0 left) 2026-02-12T17:44:08.127 INFO:tasks.rados.rados.0.trial082.stdout:3626: delete oid 1 current snap is 400 2026-02-12T17:44:08.130 INFO:tasks.rados.rados.0.trial082.stdout:3626: done (0 left) 2026-02-12T17:44:08.130 INFO:tasks.rados.rados.0.trial082.stdout:3627: read oid 1 snap -1 2026-02-12T17:44:08.130 INFO:tasks.rados.rados.0.trial082.stdout:3627: expect deleted 2026-02-12T17:44:08.130 INFO:tasks.rados.rados.0.trial082.stdout:3628: copy_from oid 13 from oid 17 current snap is 400 2026-02-12T17:44:08.130 INFO:tasks.rados.rados.0.trial082.stdout:3629: write (excl) oid 21 current snap is 400 2026-02-12T17:44:08.130 INFO:tasks.rados.rados.0.trial082.stdout:3629: seq_num 1240 ranges {440680=674299,1711907=624424} 2026-02-12T17:44:08.134 INFO:tasks.rados.rados.0.trial082.stdout:3629: writing trial08226312-21 from 440680 to 1114979 tid 1 2026-02-12T17:44:08.138 INFO:tasks.rados.rados.0.trial082.stdout:3629: writing trial08226312-21 from 1711907 to 2336331 tid 2 2026-02-12T17:44:08.139 INFO:tasks.rados.rados.0.trial082.stdout:3630: snap_remove snap 382 2026-02-12T17:44:09.138 INFO:tasks.rados.rados.0.trial082.stdout:3630: done (3 left) 2026-02-12T17:44:09.144 INFO:tasks.rados.rados.0.trial082.stdout:3631: rollback oid 7 current snap is 400 2026-02-12T17:44:09.144 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 7 to 342 2026-02-12T17:44:09.144 INFO:tasks.rados.rados.0.trial082.stdout:3629: finishing write tid 1 to trial08226312-21 2026-02-12T17:44:09.144 INFO:tasks.rados.rados.0.trial082.stdout:3628: finishing copy_from racing read to trial08226312-13 2026-02-12T17:44:09.144 INFO:tasks.rados.rados.0.trial082.stdout:3628: finishing copy_from to trial08226312-13 2026-02-12T17:44:09.144 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2730 (ObjNum 1231 snap 394 seq_num 1231) dirty exists 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3629: finishing write tid 2 to trial08226312-21 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3629: finishing write tid 3 to trial08226312-21 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3629: finishing write tid 4 to trial08226312-21 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3629: oid 21 updating version 0 to 2484 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3629: oid 21 updating version 2484 to 2486 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3629: oid 21 version 2486 is already newer than 2485 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 2486 (ObjNum 1240 snap 400 seq_num 1240) dirty exists 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3629: left oid 21 (ObjNum 1240 snap 400 seq_num 1240) 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3627: done (3 left) 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3628: done (2 left) 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3629: done (1 left) 2026-02-12T17:44:09.145 INFO:tasks.rados.rados.0.trial082.stdout:3632: copy_from oid 26 from oid 23 current snap is 400 2026-02-12T17:44:09.146 INFO:tasks.rados.rados.0.trial082.stdout:3633: snap_remove snap 347 2026-02-12T17:44:10.138 INFO:tasks.rados.rados.0.trial082.stdout:3633: done (2 left) 2026-02-12T17:44:10.138 INFO:tasks.rados.rados.0.trial082.stdout:3634: write oid 49 current snap is 400 2026-02-12T17:44:10.138 INFO:tasks.rados.rados.0.trial082.stdout:3634: seq_num 1241 ranges {457487=749548,1770389=484435,2746287=111200} 2026-02-12T17:44:10.142 INFO:tasks.rados.rados.0.trial082.stdout:3634: writing trial08226312-49 from 457487 to 1207035 tid 1 2026-02-12T17:44:10.146 INFO:tasks.rados.rados.0.trial082.stdout:3634: writing trial08226312-49 from 1770389 to 2254824 tid 2 2026-02-12T17:44:10.148 INFO:tasks.rados.rados.0.trial082.stdout:3634: writing trial08226312-49 from 2746287 to 2857487 tid 3 2026-02-12T17:44:10.149 INFO:tasks.rados.rados.0.trial082.stdout:3635: write (excl) oid 40 current snap is 400 2026-02-12T17:44:10.149 INFO:tasks.rados.rados.0.trial082.stdout:3635: seq_num 1242 ranges {474294=424797,1428871=628093,2657357=216937} 2026-02-12T17:44:10.152 INFO:tasks.rados.rados.0.trial082.stdout:3635: writing trial08226312-40 from 474294 to 899091 tid 1 2026-02-12T17:44:10.156 INFO:tasks.rados.rados.0.trial082.stdout:3635: writing trial08226312-40 from 1428871 to 2056964 tid 2 2026-02-12T17:44:10.160 INFO:tasks.rados.rados.0.trial082.stdout:3635: writing trial08226312-40 from 2657357 to 2874294 tid 3 2026-02-12T17:44:10.160 INFO:tasks.rados.rados.0.trial082.stdout:3636: read oid 42 snap 397 2026-02-12T17:44:10.160 INFO:tasks.rados.rados.0.trial082.stdout:3636: expect deleted 2026-02-12T17:44:10.160 INFO:tasks.rados.rados.0.trial082.stdout:3637: snap_create 2026-02-12T17:44:10.160 INFO:tasks.rados.rados.0.trial082.stdout:3631: finishing rollback tid 1 to trial08226312-7 2026-02-12T17:44:10.160 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 2420 (ObjNum 49 snap 0 seq_num 4556848) dirty dne 2026-02-12T17:44:10.160 INFO:tasks.rados.rados.0.trial082.stdout:3632: finishing copy_from racing read to trial08226312-26 2026-02-12T17:44:10.160 INFO:tasks.rados.rados.0.trial082.stdout:3632: finishing copy_from to trial08226312-26 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 2484 (ObjNum 1230 snap 394 seq_num 1230) dirty exists 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: finishing write tid 1 to trial08226312-49 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: finishing write tid 2 to trial08226312-49 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: finishing write tid 3 to trial08226312-49 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: finishing write tid 4 to trial08226312-49 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: finishing write tid 5 to trial08226312-49 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: oid 49 updating version 0 to 2415 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: oid 49 version 2415 is already newer than 2414 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: oid 49 version 2415 is already newer than 2413 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: oid 49 updating version 2415 to 2416 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 2416 (ObjNum 1241 snap 400 seq_num 1241) dirty exists 2026-02-12T17:44:10.161 INFO:tasks.rados.rados.0.trial082.stdout:3634: left oid 49 (ObjNum 1241 snap 400 seq_num 1241) 2026-02-12T17:44:10.162 INFO:tasks.rados.rados.0.trial082.stdout:3635: finishing write tid 1 to trial08226312-40 2026-02-12T17:44:10.162 INFO:tasks.rados.rados.0.trial082.stdout:3635: finishing write tid 2 to trial08226312-40 2026-02-12T17:44:10.163 INFO:tasks.rados.rados.0.trial082.stdout:3635: finishing write tid 3 to trial08226312-40 2026-02-12T17:44:10.163 INFO:tasks.rados.rados.0.trial082.stdout:3635: finishing write tid 4 to trial08226312-40 2026-02-12T17:44:10.163 INFO:tasks.rados.rados.0.trial082.stdout:3635: finishing write tid 5 to trial08226312-40 2026-02-12T17:44:10.163 INFO:tasks.rados.rados.0.trial082.stdout:3635: oid 40 updating version 0 to 2426 2026-02-12T17:44:10.163 INFO:tasks.rados.rados.0.trial082.stdout:3635: oid 40 updating version 2426 to 2428 2026-02-12T17:44:10.163 INFO:tasks.rados.rados.0.trial082.stdout:3635: oid 40 version 2428 is already newer than 2427 2026-02-12T17:44:10.163 INFO:tasks.rados.rados.0.trial082.stdout:3635: oid 40 updating version 2428 to 2429 2026-02-12T17:44:10.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 2429 (ObjNum 1242 snap 400 seq_num 1242) dirty exists 2026-02-12T17:44:10.163 INFO:tasks.rados.rados.0.trial082.stdout:3635: left oid 40 (ObjNum 1242 snap 400 seq_num 1242) 2026-02-12T17:44:11.579 INFO:tasks.rados.rados.0.trial082.stdout:3631: done (5 left) 2026-02-12T17:44:11.580 INFO:tasks.rados.rados.0.trial082.stdout:3632: done (4 left) 2026-02-12T17:44:11.580 INFO:tasks.rados.rados.0.trial082.stdout:3634: done (3 left) 2026-02-12T17:44:11.580 INFO:tasks.rados.rados.0.trial082.stdout:3635: done (2 left) 2026-02-12T17:44:11.580 INFO:tasks.rados.rados.0.trial082.stdout:3636: done (1 left) 2026-02-12T17:44:11.580 INFO:tasks.rados.rados.0.trial082.stdout:3637: done (0 left) 2026-02-12T17:44:11.580 INFO:tasks.rados.rados.0.trial082.stdout:3638: snap_create 2026-02-12T17:44:12.580 INFO:tasks.rados.rados.0.trial082.stdout:3638: done (0 left) 2026-02-12T17:44:12.580 INFO:tasks.rados.rados.0.trial082.stdout:3639: read oid 5 snap -1 2026-02-12T17:44:12.580 INFO:tasks.rados.rados.0.trial082.stdout:3639: expect (ObjNum 1196 snap 384 seq_num 1196) 2026-02-12T17:44:12.581 INFO:tasks.rados.rados.0.trial082.stdout:3640: snap_create 2026-02-12T17:44:12.586 INFO:tasks.rados.rados.0.trial082.stdout:3639: expect (ObjNum 1196 snap 384 seq_num 1196) 2026-02-12T17:44:12.586 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 113890 2026-02-12T17:44:12.600 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:12.614 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:13.125 INFO:tasks.rados.rados.0.trial082.stdout:3639: done (1 left) 2026-02-12T17:44:13.125 INFO:tasks.rados.rados.0.trial082.stdout:3640: done (0 left) 2026-02-12T17:44:13.126 INFO:tasks.rados.rados.0.trial082.stdout:3641: snap_create 2026-02-12T17:44:14.136 INFO:tasks.rados.rados.0.trial082.stdout:3641: done (0 left) 2026-02-12T17:44:14.136 INFO:tasks.rados.rados.0.trial082.stdout:3642: read oid 25 snap -1 2026-02-12T17:44:14.136 INFO:tasks.rados.rados.0.trial082.stdout:3642: expect (ObjNum 1208 snap 390 seq_num 1208) 2026-02-12T17:44:14.137 INFO:tasks.rados.rados.0.trial082.stdout:3643: write (excl) oid 8 current snap is 404 2026-02-12T17:44:14.137 INFO:tasks.rados.rados.0.trial082.stdout:3643: seq_num 1243 ranges {491101=500046,1487353=488104,2401133=489968} 2026-02-12T17:44:14.140 INFO:tasks.rados.rados.0.trial082.stdout:3643: writing trial08226312-8 from 491101 to 991147 tid 1 2026-02-12T17:44:14.143 INFO:tasks.rados.rados.0.trial082.stdout:3643: writing trial08226312-8 from 1487353 to 1975457 tid 2 2026-02-12T17:44:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3643: writing trial08226312-8 from 2401133 to 2891101 tid 3 2026-02-12T17:44:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3644: rollback oid 35 current snap is 404 2026-02-12T17:44:14.147 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 35 to 344 2026-02-12T17:44:14.147 INFO:tasks.rados.rados.0.trial082.stdout:3642: expect (ObjNum 1208 snap 390 seq_num 1208) 2026-02-12T17:44:14.180 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1824773 2026-02-12T17:44:14.183 INFO:tasks.rados.rados.0.trial082.stdout:3643: finishing write tid 1 to trial08226312-8 2026-02-12T17:44:14.183 INFO:tasks.rados.rados.0.trial082.stdout:3643: finishing write tid 2 to trial08226312-8 2026-02-12T17:44:14.183 INFO:tasks.rados.rados.0.trial082.stdout:3643: finishing write tid 3 to trial08226312-8 2026-02-12T17:44:14.184 INFO:tasks.rados.rados.0.trial082.stdout:3642: done (2 left) 2026-02-12T17:44:14.184 INFO:tasks.rados.rados.0.trial082.stdout:3645: read oid 3 snap 372 2026-02-12T17:44:14.184 INFO:tasks.rados.rados.0.trial082.stdout:3645: expect (ObjNum 1144 snap 363 seq_num 1144) 2026-02-12T17:44:14.184 INFO:tasks.rados.rados.0.trial082.stdout:3646: snap_remove snap 363 2026-02-12T17:44:15.138 INFO:tasks.rados.rados.0.trial082.stdout:3646: done (3 left) 2026-02-12T17:44:15.138 INFO:tasks.rados.rados.0.trial082.stdout:3647: rollback oid 6 current snap is 404 2026-02-12T17:44:15.138 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 6 to 303 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3643: finishing write tid 4 to trial08226312-8 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3643: finishing write tid 5 to trial08226312-8 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3643: oid 8 updating version 0 to 2786 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3643: oid 8 updating version 2786 to 2787 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3643: oid 8 updating version 2787 to 2788 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3643: oid 8 updating version 2788 to 2789 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 8 v 2789 (ObjNum 1243 snap 404 seq_num 1243) dirty exists 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3643: left oid 8 (ObjNum 1243 snap 404 seq_num 1243) 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3644: finishing rollback tid 0 to trial08226312-35 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3644: finishing rollback tid 1 to trial08226312-35 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 2492 (ObjNum 321 snap 0 seq_num 1344919401) dirty dne 2026-02-12T17:44:15.139 INFO:tasks.rados.rados.0.trial082.stdout:3645: expect (ObjNum 1144 snap 363 seq_num 1144) 2026-02-12T17:44:15.140 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:15.170 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:15.201 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:15.232 INFO:tasks.rados.rados.0.trial082.stdout:3647: finishing rollback tid 0 to trial08226312-6 2026-02-12T17:44:15.232 INFO:tasks.rados.rados.0.trial082.stdout:3647: finishing rollback tid 1 to trial08226312-6 2026-02-12T17:44:15.232 INFO:tasks.rados.rados.0.trial082.stdout:3647: finishing rollback tid 2 to trial08226312-6 2026-02-12T17:44:15.232 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 2404 (ObjNum 835 snap 260 seq_num 835) dirty exists 2026-02-12T17:44:15.232 INFO:tasks.rados.rados.0.trial082.stdout:3643: done (3 left) 2026-02-12T17:44:15.232 INFO:tasks.rados.rados.0.trial082.stdout:3644: done (2 left) 2026-02-12T17:44:15.232 INFO:tasks.rados.rados.0.trial082.stdout:3645: done (1 left) 2026-02-12T17:44:15.232 INFO:tasks.rados.rados.0.trial082.stdout:3647: done (0 left) 2026-02-12T17:44:15.232 INFO:tasks.rados.rados.0.trial082.stdout:3648: read oid 32 snap -1 2026-02-12T17:44:15.233 INFO:tasks.rados.rados.0.trial082.stdout:3648: expect (ObjNum 1137 snap 356 seq_num 1137) 2026-02-12T17:44:15.233 INFO:tasks.rados.rados.0.trial082.stdout:3649: delete oid 47 current snap is 404 2026-02-12T17:44:15.233 INFO:tasks.rados.rados.0.trial082.stdout:3649: done (1 left) 2026-02-12T17:44:15.233 INFO:tasks.rados.rados.0.trial082.stdout:3650: snap_remove snap 393 2026-02-12T17:44:16.142 INFO:tasks.rados.rados.0.trial082.stdout:3650: done (1 left) 2026-02-12T17:44:16.142 INFO:tasks.rados.rados.0.trial082.stdout:3651: read oid 2 snap -1 2026-02-12T17:44:16.142 INFO:tasks.rados.rados.0.trial082.stdout:3651: expect (ObjNum 1223 snap 393 seq_num 1223) 2026-02-12T17:44:16.142 INFO:tasks.rados.rados.0.trial082.stdout:3652: read oid 38 snap -1 2026-02-12T17:44:16.142 INFO:tasks.rados.rados.0.trial082.stdout:3652: expect deleted 2026-02-12T17:44:16.143 INFO:tasks.rados.rados.0.trial082.stdout:3653: copy_from oid 16 from oid 49 current snap is 404 2026-02-12T17:44:16.143 INFO:tasks.rados.rados.0.trial082.stdout:3648: expect (ObjNum 1137 snap 356 seq_num 1137) 2026-02-12T17:44:16.150 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2285872 2026-02-12T17:44:16.194 INFO:tasks.rados.rados.0.trial082.stdout:3651: expect (ObjNum 1223 snap 393 seq_num 1223) 2026-02-12T17:44:16.230 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1977086 2026-02-12T17:44:16.304 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1325411 2026-02-12T17:44:16.337 INFO:tasks.rados.rados.0.trial082.stdout:3653: finishing copy_from racing read to trial08226312-16 2026-02-12T17:44:16.337 INFO:tasks.rados.rados.0.trial082.stdout:3653: finishing copy_from to trial08226312-16 2026-02-12T17:44:16.337 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 2416 (ObjNum 1241 snap 400 seq_num 1241) dirty exists 2026-02-12T17:44:16.337 INFO:tasks.rados.rados.0.trial082.stdout:3648: done (3 left) 2026-02-12T17:44:16.337 INFO:tasks.rados.rados.0.trial082.stdout:3651: done (2 left) 2026-02-12T17:44:16.337 INFO:tasks.rados.rados.0.trial082.stdout:3652: done (1 left) 2026-02-12T17:44:16.337 INFO:tasks.rados.rados.0.trial082.stdout:3653: done (0 left) 2026-02-12T17:44:16.338 INFO:tasks.rados.rados.0.trial082.stdout:3654: write (excl) oid 22 current snap is 404 2026-02-12T17:44:16.338 INFO:tasks.rados.rados.0.trial082.stdout:3654: seq_num 1245 ranges {524715=650544,1887964=491773} 2026-02-12T17:44:16.341 INFO:tasks.rados.rados.0.trial082.stdout:3654: writing trial08226312-22 from 524715 to 1175259 tid 1 2026-02-12T17:44:16.345 INFO:tasks.rados.rados.0.trial082.stdout:3654: writing trial08226312-22 from 1887964 to 2379737 tid 2 2026-02-12T17:44:16.345 INFO:tasks.rados.rados.0.trial082.stdout:3655: snap_create 2026-02-12T17:44:16.345 INFO:tasks.rados.rados.0.trial082.stdout:3654: finishing write tid 1 to trial08226312-22 2026-02-12T17:44:16.347 INFO:tasks.rados.rados.0.trial082.stdout:3654: finishing write tid 2 to trial08226312-22 2026-02-12T17:44:16.348 INFO:tasks.rados.rados.0.trial082.stdout:3654: finishing write tid 3 to trial08226312-22 2026-02-12T17:44:16.348 INFO:tasks.rados.rados.0.trial082.stdout:3654: finishing write tid 4 to trial08226312-22 2026-02-12T17:44:16.348 INFO:tasks.rados.rados.0.trial082.stdout:3654: oid 22 updating version 0 to 2488 2026-02-12T17:44:16.348 INFO:tasks.rados.rados.0.trial082.stdout:3654: oid 22 updating version 2488 to 2489 2026-02-12T17:44:16.348 INFO:tasks.rados.rados.0.trial082.stdout:3654: oid 22 version 2489 is already newer than 2487 2026-02-12T17:44:16.348 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2489 (ObjNum 1245 snap 404 seq_num 1245) dirty exists 2026-02-12T17:44:16.348 INFO:tasks.rados.rados.0.trial082.stdout:3654: left oid 22 (ObjNum 1245 snap 404 seq_num 1245) 2026-02-12T17:44:17.145 INFO:tasks.rados.rados.0.trial082.stdout:3654: done (1 left) 2026-02-12T17:44:17.145 INFO:tasks.rados.rados.0.trial082.stdout:3655: done (0 left) 2026-02-12T17:44:17.145 INFO:tasks.rados.rados.0.trial082.stdout:3656: read oid 6 snap -1 2026-02-12T17:44:17.145 INFO:tasks.rados.rados.0.trial082.stdout:3656: expect (ObjNum 835 snap 260 seq_num 835) 2026-02-12T17:44:17.145 INFO:tasks.rados.rados.0.trial082.stdout:3657: read oid 7 snap -1 2026-02-12T17:44:17.145 INFO:tasks.rados.rados.0.trial082.stdout:3657: expect deleted 2026-02-12T17:44:17.146 INFO:tasks.rados.rados.0.trial082.stdout:3658: rollback oid 44 current snap is 405 2026-02-12T17:44:17.146 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 399 2026-02-12T17:44:17.146 INFO:tasks.rados.rados.0.trial082.stdout:3659: write (excl) oid 36 current snap is 405 2026-02-12T17:44:17.146 INFO:tasks.rados.rados.0.trial082.stdout:3659: seq_num 1246 ranges {541522=725793,1946446=635431} 2026-02-12T17:44:17.149 INFO:tasks.rados.rados.0.trial082.stdout:3659: writing trial08226312-36 from 541522 to 1267315 tid 1 2026-02-12T17:44:17.154 INFO:tasks.rados.rados.0.trial082.stdout:3659: writing trial08226312-36 from 1946446 to 2581877 tid 2 2026-02-12T17:44:17.155 INFO:tasks.rados.rados.0.trial082.stdout:3660: rollback oid 3 current snap is 405 2026-02-12T17:44:17.155 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 390 2026-02-12T17:44:17.155 INFO:tasks.rados.rados.0.trial082.stdout:3658: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:44:17.155 INFO:tasks.rados.rados.0.trial082.stdout:3658: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:44:17.155 INFO:tasks.rados.rados.0.trial082.stdout:3658: finishing rollback tid 2 to trial08226312-44 2026-02-12T17:44:17.155 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2495 (ObjNum 1141 snap 359 seq_num 1141) dirty exists 2026-02-12T17:44:17.155 INFO:tasks.rados.rados.0.trial082.stdout:3656: expect (ObjNum 835 snap 260 seq_num 835) 2026-02-12T17:44:17.196 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 110612 2026-02-12T17:44:17.218 INFO:tasks.rados.rados.0.trial082.stdout:3659: finishing write tid 1 to trial08226312-36 2026-02-12T17:44:17.218 INFO:tasks.rados.rados.0.trial082.stdout:3656: done (4 left) 2026-02-12T17:44:17.218 INFO:tasks.rados.rados.0.trial082.stdout:3657: done (3 left) 2026-02-12T17:44:17.218 INFO:tasks.rados.rados.0.trial082.stdout:3658: done (2 left) 2026-02-12T17:44:17.218 INFO:tasks.rados.rados.0.trial082.stdout:3661: snap_remove snap 396 2026-02-12T17:44:18.127 INFO:tasks.rados.rados.0.trial082.stdout:3661: done (2 left) 2026-02-12T17:44:18.127 INFO:tasks.rados.rados.0.trial082.stdout:3662: copy_from oid 9 from oid 50 current snap is 405 2026-02-12T17:44:18.127 INFO:tasks.rados.rados.0.trial082.stdout:3659: finishing write tid 2 to trial08226312-36 2026-02-12T17:44:18.127 INFO:tasks.rados.rados.0.trial082.stdout:3659: finishing write tid 3 to trial08226312-36 2026-02-12T17:44:18.127 INFO:tasks.rados.rados.0.trial082.stdout:3659: finishing write tid 4 to trial08226312-36 2026-02-12T17:44:18.127 INFO:tasks.rados.rados.0.trial082.stdout:3659: oid 36 updating version 0 to 2498 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:3659: oid 36 version 2498 is already newer than 2497 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:3659: oid 36 version 2498 is already newer than 2496 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 2498 (ObjNum 1246 snap 405 seq_num 1246) dirty exists 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:3659: left oid 36 (ObjNum 1246 snap 405 seq_num 1246) 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:3660: finishing rollback tid 0 to trial08226312-3 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:3660: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:3660: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 2413 (ObjNum 1144 snap 363 seq_num 1144) dirty exists 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:3659: done (2 left) 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:3660: done (1 left) 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:3663: rollback oid 21 current snap is 405 2026-02-12T17:44:18.128 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 21 to 381 2026-02-12T17:44:18.129 INFO:tasks.rados.rados.0.trial082.stdout:3664: read oid 17 snap -1 2026-02-12T17:44:18.129 INFO:tasks.rados.rados.0.trial082.stdout:3664: expect (ObjNum 1231 snap 394 seq_num 1231) 2026-02-12T17:44:18.129 INFO:tasks.rados.rados.0.trial082.stdout:3665: snap_create 2026-02-12T17:44:18.129 INFO:tasks.rados.rados.0.trial082.stdout:3664: expect (ObjNum 1231 snap 394 seq_num 1231) 2026-02-12T17:44:18.217 INFO:tasks.rados.rados.0.trial082.stdout:3662: finishing copy_from to trial08226312-9 2026-02-12T17:44:18.217 INFO:tasks.rados.rados.0.trial082.stdout:3662: got expected ENOENT (src dne) 2026-02-12T17:44:18.217 INFO:tasks.rados.rados.0.trial082.stdout:3662: finishing copy_from racing read to trial08226312-9 2026-02-12T17:44:18.217 INFO:tasks.rados.rados.0.trial082.stdout:3663: finishing rollback tid 0 to trial08226312-21 2026-02-12T17:44:18.217 INFO:tasks.rados.rados.0.trial082.stdout:3663: finishing rollback tid 1 to trial08226312-21 2026-02-12T17:44:18.218 INFO:tasks.rados.rados.0.trial082.stdout:3663: finishing rollback tid 2 to trial08226312-21 2026-02-12T17:44:18.218 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 2492 (ObjNum 1171 snap 377 seq_num 1171) dirty exists 2026-02-12T17:44:19.128 INFO:tasks.rados.rados.0.trial082.stdout:3662: done (3 left) 2026-02-12T17:44:19.128 INFO:tasks.rados.rados.0.trial082.stdout:3663: done (2 left) 2026-02-12T17:44:19.128 INFO:tasks.rados.rados.0.trial082.stdout:3664: done (1 left) 2026-02-12T17:44:19.128 INFO:tasks.rados.rados.0.trial082.stdout:3665: done (0 left) 2026-02-12T17:44:19.128 INFO:tasks.rados.rados.0.trial082.stdout:3666: copy_from oid 26 from oid 13 current snap is 406 2026-02-12T17:44:19.128 INFO:tasks.rados.rados.0.trial082.stdout:3667: snap_create 2026-02-12T17:44:19.137 INFO:tasks.rados.rados.0.trial082.stdout:3666: finishing copy_from racing read to trial08226312-26 2026-02-12T17:44:19.138 INFO:tasks.rados.rados.0.trial082.stdout:3666: finishing copy_from to trial08226312-26 2026-02-12T17:44:19.138 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 26 v 2730 (ObjNum 1231 snap 394 seq_num 1231) dirty exists 2026-02-12T17:44:20.128 INFO:tasks.rados.rados.0.trial082.stdout:3666: done (1 left) 2026-02-12T17:44:20.128 INFO:tasks.rados.rados.0.trial082.stdout:3667: done (0 left) 2026-02-12T17:44:20.129 INFO:tasks.rados.rados.0.trial082.stdout:3668: write oid 48 current snap is 407 2026-02-12T17:44:20.129 INFO:tasks.rados.rados.0.trial082.stdout:3668: seq_num 1247 ranges {558329=517395,1721281=779089} 2026-02-12T17:44:20.133 INFO:tasks.rados.rados.0.trial082.stdout:3668: writing trial08226312-48 from 558329 to 1075724 tid 1 2026-02-12T17:44:20.138 INFO:tasks.rados.rados.0.trial082.stdout:3668: writing trial08226312-48 from 1721281 to 2500370 tid 2 2026-02-12T17:44:20.138 INFO:tasks.rados.rados.0.trial082.stdout:3669: read oid 19 snap -1 2026-02-12T17:44:20.138 INFO:tasks.rados.rados.0.trial082.stdout:3669: expect (ObjNum 1186 snap 381 seq_num 1186) 2026-02-12T17:44:20.139 INFO:tasks.rados.rados.0.trial082.stdout:3670: snap_create 2026-02-12T17:44:20.139 INFO:tasks.rados.rados.0.trial082.stdout:3668: finishing write tid 1 to trial08226312-48 2026-02-12T17:44:20.141 INFO:tasks.rados.rados.0.trial082.stdout:3668: finishing write tid 2 to trial08226312-48 2026-02-12T17:44:20.141 INFO:tasks.rados.rados.0.trial082.stdout:3668: finishing write tid 3 to trial08226312-48 2026-02-12T17:44:20.141 INFO:tasks.rados.rados.0.trial082.stdout:3668: finishing write tid 4 to trial08226312-48 2026-02-12T17:44:20.141 INFO:tasks.rados.rados.0.trial082.stdout:3668: oid 48 updating version 0 to 2454 2026-02-12T17:44:20.141 INFO:tasks.rados.rados.0.trial082.stdout:3668: oid 48 version 2454 is already newer than 2453 2026-02-12T17:44:20.142 INFO:tasks.rados.rados.0.trial082.stdout:3668: oid 48 updating version 2454 to 2455 2026-02-12T17:44:20.142 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 2455 (ObjNum 1247 snap 407 seq_num 1247) dirty exists 2026-02-12T17:44:20.142 INFO:tasks.rados.rados.0.trial082.stdout:3668: left oid 48 (ObjNum 1247 snap 407 seq_num 1247) 2026-02-12T17:44:20.142 INFO:tasks.rados.rados.0.trial082.stdout:3669: expect (ObjNum 1186 snap 381 seq_num 1186) 2026-02-12T17:44:20.196 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2232665 2026-02-12T17:44:20.216 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:21.131 INFO:tasks.rados.rados.0.trial082.stdout:3668: done (2 left) 2026-02-12T17:44:21.131 INFO:tasks.rados.rados.0.trial082.stdout:3669: done (1 left) 2026-02-12T17:44:21.131 INFO:tasks.rados.rados.0.trial082.stdout:3670: done (0 left) 2026-02-12T17:44:21.132 INFO:tasks.rados.rados.0.trial082.stdout:3671: snap_remove snap 303 2026-02-12T17:44:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3671: done (0 left) 2026-02-12T17:44:22.145 INFO:tasks.rados.rados.0.trial082.stdout:3672: read oid 30 snap -1 2026-02-12T17:44:22.146 INFO:tasks.rados.rados.0.trial082.stdout:3672: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:44:22.146 INFO:tasks.rados.rados.0.trial082.stdout:3673: read oid 10 snap -1 2026-02-12T17:44:22.146 INFO:tasks.rados.rados.0.trial082.stdout:3673: expect (ObjNum 1226 snap 394 seq_num 1226) 2026-02-12T17:44:22.146 INFO:tasks.rados.rados.0.trial082.stdout:3674: write (excl) oid 43 current snap is 408 2026-02-12T17:44:22.146 INFO:tasks.rados.rados.0.trial082.stdout:3674: seq_num 1248 ranges {575136=592644,1663410=639100,2705542=269594} 2026-02-12T17:44:22.151 INFO:tasks.rados.rados.0.trial082.stdout:3674: writing trial08226312-43 from 575136 to 1167780 tid 1 2026-02-12T17:44:22.155 INFO:tasks.rados.rados.0.trial082.stdout:3674: writing trial08226312-43 from 1663410 to 2302510 tid 2 2026-02-12T17:44:22.158 INFO:tasks.rados.rados.0.trial082.stdout:3674: writing trial08226312-43 from 2705542 to 2975136 tid 3 2026-02-12T17:44:22.158 INFO:tasks.rados.rados.0.trial082.stdout:3675: rollback oid 38 current snap is 408 2026-02-12T17:44:22.158 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 38 to 391 2026-02-12T17:44:22.159 INFO:tasks.rados.rados.0.trial082.stdout:3672: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:44:22.239 INFO:tasks.rados.rados.0.trial082.stdout:3673: expect (ObjNum 1226 snap 394 seq_num 1226) 2026-02-12T17:44:22.239 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:22.272 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:22.324 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1740740 2026-02-12T17:44:22.334 INFO:tasks.rados.rados.0.trial082.stdout:3674: finishing write tid 1 to trial08226312-43 2026-02-12T17:44:22.335 INFO:tasks.rados.rados.0.trial082.stdout:3675: finishing rollback tid 1 to trial08226312-38 2026-02-12T17:44:22.335 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 2461 (ObjNum 529 snap 0 seq_num 1728032512) dirty dne 2026-02-12T17:44:22.335 INFO:tasks.rados.rados.0.trial082.stdout:3674: finishing write tid 2 to trial08226312-43 2026-02-12T17:44:22.335 INFO:tasks.rados.rados.0.trial082.stdout:3674: finishing write tid 3 to trial08226312-43 2026-02-12T17:44:22.335 INFO:tasks.rados.rados.0.trial082.stdout:3672: done (3 left) 2026-02-12T17:44:22.335 INFO:tasks.rados.rados.0.trial082.stdout:3673: done (2 left) 2026-02-12T17:44:22.335 INFO:tasks.rados.rados.0.trial082.stdout:3675: done (1 left) 2026-02-12T17:44:22.335 INFO:tasks.rados.rados.0.trial082.stdout:3676: snap_remove snap 324 2026-02-12T17:44:23.128 INFO:tasks.rados.rados.0.trial082.stdout:3676: done (1 left) 2026-02-12T17:44:23.128 INFO:tasks.rados.rados.0.trial082.stdout:3677: snap_remove snap 397 2026-02-12T17:44:24.129 INFO:tasks.rados.rados.0.trial082.stdout:3677: done (1 left) 2026-02-12T17:44:24.129 INFO:tasks.rados.rados.0.trial082.stdout:3678: snap_remove snap 404 2026-02-12T17:44:25.131 INFO:tasks.rados.rados.0.trial082.stdout:3678: done (1 left) 2026-02-12T17:44:25.131 INFO:tasks.rados.rados.0.trial082.stdout:3679: copy_from oid 14 from oid 45 current snap is 408 2026-02-12T17:44:25.131 INFO:tasks.rados.rados.0.trial082.stdout:3674: finishing write tid 4 to trial08226312-43 2026-02-12T17:44:25.131 INFO:tasks.rados.rados.0.trial082.stdout:3674: finishing write tid 5 to trial08226312-43 2026-02-12T17:44:25.131 INFO:tasks.rados.rados.0.trial082.stdout:3674: oid 43 updating version 0 to 2496 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3674: oid 43 version 2496 is already newer than 2494 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3674: oid 43 version 2496 is already newer than 2493 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3674: oid 43 version 2496 is already newer than 2495 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2496 (ObjNum 1248 snap 408 seq_num 1248) dirty exists 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3674: left oid 43 (ObjNum 1248 snap 408 seq_num 1248) 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3674: done (1 left) 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3680: rollback oid 12 current snap is 408 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 12 to 395 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3681: write (excl) oid 9 current snap is 408 2026-02-12T17:44:25.132 INFO:tasks.rados.rados.0.trial082.stdout:3681: seq_num 1249 ranges {591943=667893,1721892=782758} 2026-02-12T17:44:25.135 INFO:tasks.rados.rados.0.trial082.stdout:3681: writing trial08226312-9 from 591943 to 1259836 tid 1 2026-02-12T17:44:25.141 INFO:tasks.rados.rados.0.trial082.stdout:3681: writing trial08226312-9 from 1721892 to 2504650 tid 2 2026-02-12T17:44:25.141 INFO:tasks.rados.rados.0.trial082.stdout:3682: delete oid 1 current snap is 408 2026-02-12T17:44:25.141 INFO:tasks.rados.rados.0.trial082.stdout:3680: finishing rollback tid 0 to trial08226312-12 2026-02-12T17:44:25.141 INFO:tasks.rados.rados.0.trial082.stdout:3680: finishing rollback tid 1 to trial08226312-12 2026-02-12T17:44:25.141 INFO:tasks.rados.rados.0.trial082.stdout:3680: finishing rollback tid 2 to trial08226312-12 2026-02-12T17:44:25.141 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 2407 (ObjNum 1217 snap 392 seq_num 1217) dirty exists 2026-02-12T17:44:25.141 INFO:tasks.rados.rados.0.trial082.stdout:3681: finishing write tid 1 to trial08226312-9 2026-02-12T17:44:25.142 INFO:tasks.rados.rados.0.trial082.stdout:3679: finishing copy_from racing read to trial08226312-14 2026-02-12T17:44:25.142 INFO:tasks.rados.rados.0.trial082.stdout:3679: finishing copy_from to trial08226312-14 2026-02-12T17:44:25.142 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 14 v 2487 (ObjNum 1103 snap 346 seq_num 1103) dirty exists 2026-02-12T17:44:25.142 INFO:tasks.rados.rados.0.trial082.stdout:3679: done (3 left) 2026-02-12T17:44:25.143 INFO:tasks.rados.rados.0.trial082.stdout:3680: done (2 left) 2026-02-12T17:44:25.143 INFO:tasks.rados.rados.0.trial082.stdout:3682: done (1 left) 2026-02-12T17:44:25.143 INFO:tasks.rados.rados.0.trial082.stdout:3683: read oid 10 snap 402 2026-02-12T17:44:25.143 INFO:tasks.rados.rados.0.trial082.stdout:3683: expect (ObjNum 1226 snap 394 seq_num 1226) 2026-02-12T17:44:25.143 INFO:tasks.rados.rados.0.trial082.stdout:3684: copy_from oid 40 from oid 16 current snap is 408 2026-02-12T17:44:25.143 INFO:tasks.rados.rados.0.trial082.stdout:3685: snap_remove snap 398 2026-02-12T17:44:26.135 INFO:tasks.rados.rados.0.trial082.stdout:3685: done (3 left) 2026-02-12T17:44:26.135 INFO:tasks.rados.rados.0.trial082.stdout:3686: read oid 12 snap -1 2026-02-12T17:44:26.135 INFO:tasks.rados.rados.0.trial082.stdout:3686: expect (ObjNum 1217 snap 392 seq_num 1217) 2026-02-12T17:44:26.135 INFO:tasks.rados.rados.0.trial082.stdout:3687: copy_from oid 22 from oid 46 current snap is 408 2026-02-12T17:44:26.135 INFO:tasks.rados.rados.0.trial082.stdout:3681: finishing write tid 2 to trial08226312-9 2026-02-12T17:44:26.135 INFO:tasks.rados.rados.0.trial082.stdout:3681: finishing write tid 3 to trial08226312-9 2026-02-12T17:44:26.136 INFO:tasks.rados.rados.0.trial082.stdout:3681: finishing write tid 4 to trial08226312-9 2026-02-12T17:44:26.136 INFO:tasks.rados.rados.0.trial082.stdout:3681: oid 9 updating version 0 to 2430 2026-02-12T17:44:26.136 INFO:tasks.rados.rados.0.trial082.stdout:3681: oid 9 updating version 2430 to 2431 2026-02-12T17:44:26.136 INFO:tasks.rados.rados.0.trial082.stdout:3681: oid 9 updating version 2431 to 2432 2026-02-12T17:44:26.136 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 2432 (ObjNum 1249 snap 408 seq_num 1249) dirty exists 2026-02-12T17:44:26.136 INFO:tasks.rados.rados.0.trial082.stdout:3681: left oid 9 (ObjNum 1249 snap 408 seq_num 1249) 2026-02-12T17:44:26.137 INFO:tasks.rados.rados.0.trial082.stdout:3683: expect (ObjNum 1226 snap 394 seq_num 1226) 2026-02-12T17:44:26.137 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:26.168 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 147088 2026-02-12T17:44:26.235 INFO:tasks.rados.rados.0.trial082.stdout:3684: finishing copy_from racing read to trial08226312-40 2026-02-12T17:44:26.235 INFO:tasks.rados.rados.0.trial082.stdout:3681: done (4 left) 2026-02-12T17:44:26.235 INFO:tasks.rados.rados.0.trial082.stdout:3683: done (3 left) 2026-02-12T17:44:26.235 INFO:tasks.rados.rados.0.trial082.stdout:3688: snap_remove snap 394 2026-02-12T17:44:27.137 INFO:tasks.rados.rados.0.trial082.stdout:3688: done (3 left) 2026-02-12T17:44:27.137 INFO:tasks.rados.rados.0.trial082.stdout:3689: write (excl) oid 1 current snap is 408 2026-02-12T17:44:27.138 INFO:tasks.rados.rados.0.trial082.stdout:3689: seq_num 1251 ranges {625557=418391,1838856=786427} 2026-02-12T17:44:27.141 INFO:tasks.rados.rados.0.trial082.stdout:3689: writing trial08226312-1 from 625557 to 1043948 tid 1 2026-02-12T17:44:27.148 INFO:tasks.rados.rados.0.trial082.stdout:3689: writing trial08226312-1 from 1838856 to 2625283 tid 2 2026-02-12T17:44:27.148 INFO:tasks.rados.rados.0.trial082.stdout:3690: snap_create 2026-02-12T17:44:27.148 INFO:tasks.rados.rados.0.trial082.stdout:3684: finishing copy_from to trial08226312-40 2026-02-12T17:44:27.148 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 2416 (ObjNum 1241 snap 400 seq_num 1241) dirty exists 2026-02-12T17:44:27.149 INFO:tasks.rados.rados.0.trial082.stdout:3686: expect (ObjNum 1217 snap 392 seq_num 1217) 2026-02-12T17:44:27.149 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:27.223 INFO:tasks.rados.rados.0.trial082.stdout:3687: finishing copy_from racing read to trial08226312-22 2026-02-12T17:44:27.224 INFO:tasks.rados.rados.0.trial082.stdout:3687: finishing copy_from to trial08226312-22 2026-02-12T17:44:27.224 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2362 (ObjNum 1185 snap 381 seq_num 1185) dirty exists 2026-02-12T17:44:27.224 INFO:tasks.rados.rados.0.trial082.stdout:3689: finishing write tid 1 to trial08226312-1 2026-02-12T17:44:27.224 INFO:tasks.rados.rados.0.trial082.stdout:3689: finishing write tid 2 to trial08226312-1 2026-02-12T17:44:27.224 INFO:tasks.rados.rados.0.trial082.stdout:3689: finishing write tid 3 to trial08226312-1 2026-02-12T17:44:27.224 INFO:tasks.rados.rados.0.trial082.stdout:3689: finishing write tid 4 to trial08226312-1 2026-02-12T17:44:27.224 INFO:tasks.rados.rados.0.trial082.stdout:3689: oid 1 updating version 0 to 2449 2026-02-12T17:44:27.224 INFO:tasks.rados.rados.0.trial082.stdout:3689: oid 1 version 2449 is already newer than 2448 2026-02-12T17:44:27.225 INFO:tasks.rados.rados.0.trial082.stdout:3689: oid 1 version 2449 is already newer than 2447 2026-02-12T17:44:27.225 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2449 (ObjNum 1251 snap 408 seq_num 1251) dirty exists 2026-02-12T17:44:27.225 INFO:tasks.rados.rados.0.trial082.stdout:3689: left oid 1 (ObjNum 1251 snap 408 seq_num 1251) 2026-02-12T17:44:28.139 INFO:tasks.rados.rados.0.trial082.stdout:3684: done (4 left) 2026-02-12T17:44:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3686: done (3 left) 2026-02-12T17:44:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3687: done (2 left) 2026-02-12T17:44:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3689: done (1 left) 2026-02-12T17:44:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3690: done (0 left) 2026-02-12T17:44:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3691: write oid 4 current snap is 409 2026-02-12T17:44:28.140 INFO:tasks.rados.rados.0.trial082.stdout:3691: seq_num 1252 ranges {642364=493640,1897338=646438} 2026-02-12T17:44:28.144 INFO:tasks.rados.rados.0.trial082.stdout:3691: writing trial08226312-4 from 642364 to 1136004 tid 1 2026-02-12T17:44:28.150 INFO:tasks.rados.rados.0.trial082.stdout:3691: writing trial08226312-4 from 1897338 to 2543776 tid 2 2026-02-12T17:44:28.150 INFO:tasks.rados.rados.0.trial082.stdout:3692: rollback oid 49 current snap is 409 2026-02-12T17:44:28.150 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 49 to 405 2026-02-12T17:44:28.151 INFO:tasks.rados.rados.0.trial082.stdout:3691: finishing write tid 1 to trial08226312-4 2026-02-12T17:44:28.151 INFO:tasks.rados.rados.0.trial082.stdout:3693: delete oid 2 current snap is 409 2026-02-12T17:44:28.153 INFO:tasks.rados.rados.0.trial082.stdout:3693: done (2 left) 2026-02-12T17:44:28.153 INFO:tasks.rados.rados.0.trial082.stdout:3694: rollback oid 17 current snap is 409 2026-02-12T17:44:28.153 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 17 to 330 2026-02-12T17:44:28.153 INFO:tasks.rados.rados.0.trial082.stdout:3695: snap_create 2026-02-12T17:44:28.154 INFO:tasks.rados.rados.0.trial082.stdout:3691: finishing write tid 2 to trial08226312-4 2026-02-12T17:44:28.154 INFO:tasks.rados.rados.0.trial082.stdout:3691: finishing write tid 3 to trial08226312-4 2026-02-12T17:44:28.154 INFO:tasks.rados.rados.0.trial082.stdout:3691: finishing write tid 4 to trial08226312-4 2026-02-12T17:44:28.154 INFO:tasks.rados.rados.0.trial082.stdout:3691: oid 4 updating version 0 to 2844 2026-02-12T17:44:28.154 INFO:tasks.rados.rados.0.trial082.stdout:3691: oid 4 updating version 2844 to 2845 2026-02-12T17:44:28.154 INFO:tasks.rados.rados.0.trial082.stdout:3691: oid 4 version 2845 is already newer than 2843 2026-02-12T17:44:28.154 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 2845 (ObjNum 1252 snap 409 seq_num 1252) dirty exists 2026-02-12T17:44:28.155 INFO:tasks.rados.rados.0.trial082.stdout:3691: left oid 4 (ObjNum 1252 snap 409 seq_num 1252) 2026-02-12T17:44:28.155 INFO:tasks.rados.rados.0.trial082.stdout:3694: finishing rollback tid 0 to trial08226312-17 2026-02-12T17:44:28.155 INFO:tasks.rados.rados.0.trial082.stdout:3694: finishing rollback tid 1 to trial08226312-17 2026-02-12T17:44:28.155 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 2848 (ObjNum 129 snap 0 seq_num 27002088) dirty dne 2026-02-12T17:44:28.155 INFO:tasks.rados.rados.0.trial082.stdout:3692: finishing rollback tid 0 to trial08226312-49 2026-02-12T17:44:28.155 INFO:tasks.rados.rados.0.trial082.stdout:3692: finishing rollback tid 1 to trial08226312-49 2026-02-12T17:44:28.155 INFO:tasks.rados.rados.0.trial082.stdout:3692: finishing rollback tid 2 to trial08226312-49 2026-02-12T17:44:28.155 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 2419 (ObjNum 1241 snap 400 seq_num 1241) dirty exists 2026-02-12T17:44:29.143 INFO:tasks.rados.rados.0.trial082.stdout:3691: done (3 left) 2026-02-12T17:44:29.143 INFO:tasks.rados.rados.0.trial082.stdout:3692: done (2 left) 2026-02-12T17:44:29.144 INFO:tasks.rados.rados.0.trial082.stdout:3694: done (1 left) 2026-02-12T17:44:29.144 INFO:tasks.rados.rados.0.trial082.stdout:3695: done (0 left) 2026-02-12T17:44:29.144 INFO:tasks.rados.rados.0.trial082.stdout:3696: rollback oid 45 current snap is 410 2026-02-12T17:44:29.144 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 381 2026-02-12T17:44:29.144 INFO:tasks.rados.rados.0.trial082.stdout:3697: write oid 21 current snap is 410 2026-02-12T17:44:29.144 INFO:tasks.rados.rados.0.trial082.stdout:3697: seq_num 1254 ranges {675978=644138,1897949=650107} 2026-02-12T17:44:29.148 INFO:tasks.rados.rados.0.trial082.stdout:3697: writing trial08226312-21 from 675978 to 1320116 tid 1 2026-02-12T17:44:29.154 INFO:tasks.rados.rados.0.trial082.stdout:3697: writing trial08226312-21 from 1897949 to 2548056 tid 2 2026-02-12T17:44:29.154 INFO:tasks.rados.rados.0.trial082.stdout:3698: write (excl) oid 29 current snap is 410 2026-02-12T17:44:29.154 INFO:tasks.rados.rados.0.trial082.stdout:3696: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:44:29.154 INFO:tasks.rados.rados.0.trial082.stdout:3698: seq_num 1255 ranges {692785=435740,1672784=793765,2897503=195282} 2026-02-12T17:44:29.158 INFO:tasks.rados.rados.0.trial082.stdout:3698: writing trial08226312-29 from 692785 to 1128525 tid 1 2026-02-12T17:44:29.163 INFO:tasks.rados.rados.0.trial082.stdout:3698: writing trial08226312-29 from 1672784 to 2466549 tid 2 2026-02-12T17:44:29.166 INFO:tasks.rados.rados.0.trial082.stdout:3698: writing trial08226312-29 from 2897503 to 3092785 tid 3 2026-02-12T17:44:29.166 INFO:tasks.rados.rados.0.trial082.stdout:3699: write (excl) oid 31 current snap is 410 2026-02-12T17:44:29.166 INFO:tasks.rados.rados.0.trial082.stdout:3696: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:44:29.166 INFO:tasks.rados.rados.0.trial082.stdout:3696: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:44:29.166 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2733 (ObjNum 1103 snap 346 seq_num 1103) dirty exists 2026-02-12T17:44:29.166 INFO:tasks.rados.rados.0.trial082.stdout:3697: finishing write tid 1 to trial08226312-21 2026-02-12T17:44:29.166 INFO:tasks.rados.rados.0.trial082.stdout:3697: finishing write tid 2 to trial08226312-21 2026-02-12T17:44:29.166 INFO:tasks.rados.rados.0.trial082.stdout:3697: finishing write tid 3 to trial08226312-21 2026-02-12T17:44:29.166 INFO:tasks.rados.rados.0.trial082.stdout:3697: finishing write tid 4 to trial08226312-21 2026-02-12T17:44:29.167 INFO:tasks.rados.rados.0.trial082.stdout:3697: oid 21 updating version 0 to 2499 2026-02-12T17:44:29.167 INFO:tasks.rados.rados.0.trial082.stdout:3697: oid 21 version 2499 is already newer than 2498 2026-02-12T17:44:29.167 INFO:tasks.rados.rados.0.trial082.stdout:3697: oid 21 version 2499 is already newer than 2497 2026-02-12T17:44:29.167 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 21 v 2499 (ObjNum 1254 snap 410 seq_num 1254) dirty exists 2026-02-12T17:44:29.167 INFO:tasks.rados.rados.0.trial082.stdout:3697: left oid 21 (ObjNum 1254 snap 410 seq_num 1254) 2026-02-12T17:44:29.167 INFO:tasks.rados.rados.0.trial082.stdout:3698: finishing write tid 1 to trial08226312-29 2026-02-12T17:44:29.167 INFO:tasks.rados.rados.0.trial082.stdout:3698: finishing write tid 2 to trial08226312-29 2026-02-12T17:44:29.167 INFO:tasks.rados.rados.0.trial082.stdout:3699: seq_num 1256 ranges {709592=510989,1731266=653776,3041279=68313} 2026-02-12T17:44:29.170 INFO:tasks.rados.rados.0.trial082.stdout:3699: writing trial08226312-31 from 709592 to 1220581 tid 1 2026-02-12T17:44:29.175 INFO:tasks.rados.rados.0.trial082.stdout:3699: writing trial08226312-31 from 1731266 to 2385042 tid 2 2026-02-12T17:44:29.178 INFO:tasks.rados.rados.0.trial082.stdout:3699: writing trial08226312-31 from 3041279 to 3109592 tid 3 2026-02-12T17:44:29.178 INFO:tasks.rados.rados.0.trial082.stdout:3696: done (3 left) 2026-02-12T17:44:29.178 INFO:tasks.rados.rados.0.trial082.stdout:3697: done (2 left) 2026-02-12T17:44:29.178 INFO:tasks.rados.rados.0.trial082.stdout:3700: delete oid 12 current snap is 410 2026-02-12T17:44:29.178 INFO:tasks.rados.rados.0.trial082.stdout:3698: finishing write tid 3 to trial08226312-29 2026-02-12T17:44:29.178 INFO:tasks.rados.rados.0.trial082.stdout:3698: finishing write tid 4 to trial08226312-29 2026-02-12T17:44:29.178 INFO:tasks.rados.rados.0.trial082.stdout:3698: finishing write tid 5 to trial08226312-29 2026-02-12T17:44:29.179 INFO:tasks.rados.rados.0.trial082.stdout:3698: oid 29 updating version 0 to 2408 2026-02-12T17:44:29.179 INFO:tasks.rados.rados.0.trial082.stdout:3698: oid 29 version 2408 is already newer than 2405 2026-02-12T17:44:29.179 INFO:tasks.rados.rados.0.trial082.stdout:3698: oid 29 version 2408 is already newer than 2407 2026-02-12T17:44:29.179 INFO:tasks.rados.rados.0.trial082.stdout:3698: oid 29 version 2408 is already newer than 2406 2026-02-12T17:44:29.179 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2408 (ObjNum 1255 snap 410 seq_num 1255) dirty exists 2026-02-12T17:44:29.179 INFO:tasks.rados.rados.0.trial082.stdout:3698: left oid 29 (ObjNum 1255 snap 410 seq_num 1255) 2026-02-12T17:44:29.179 INFO:tasks.rados.rados.0.trial082.stdout:3699: finishing write tid 1 to trial08226312-31 2026-02-12T17:44:29.179 INFO:tasks.rados.rados.0.trial082.stdout:3699: finishing write tid 2 to trial08226312-31 2026-02-12T17:44:29.180 INFO:tasks.rados.rados.0.trial082.stdout:3699: finishing write tid 3 to trial08226312-31 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3699: finishing write tid 4 to trial08226312-31 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3699: finishing write tid 5 to trial08226312-31 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3699: oid 31 updating version 0 to 2279 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3699: oid 31 updating version 2279 to 2280 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3699: oid 31 version 2280 is already newer than 2278 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3699: oid 31 version 2280 is already newer than 2277 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 2280 (ObjNum 1256 snap 410 seq_num 1256) dirty exists 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3699: left oid 31 (ObjNum 1256 snap 410 seq_num 1256) 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3698: done (2 left) 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3699: done (1 left) 2026-02-12T17:44:29.181 INFO:tasks.rados.rados.0.trial082.stdout:3700: done (0 left) 2026-02-12T17:44:29.182 INFO:tasks.rados.rados.0.trial082.stdout:3701: read oid 34 snap -1 2026-02-12T17:44:29.182 INFO:tasks.rados.rados.0.trial082.stdout:3701: expect (ObjNum 1232 snap 394 seq_num 1232) 2026-02-12T17:44:29.182 INFO:tasks.rados.rados.0.trial082.stdout:3702: delete oid 38 current snap is 410 2026-02-12T17:44:29.182 INFO:tasks.rados.rados.0.trial082.stdout:3702: done (1 left) 2026-02-12T17:44:29.182 INFO:tasks.rados.rados.0.trial082.stdout:3703: write oid 39 current snap is 410 2026-02-12T17:44:29.182 INFO:tasks.rados.rados.0.trial082.stdout:3703: seq_num 1259 ranges {760013=736736,2190359=401103} 2026-02-12T17:44:29.186 INFO:tasks.rados.rados.0.trial082.stdout:3703: writing trial08226312-39 from 760013 to 1496749 tid 1 2026-02-12T17:44:29.191 INFO:tasks.rados.rados.0.trial082.stdout:3703: writing trial08226312-39 from 2190359 to 2591462 tid 2 2026-02-12T17:44:29.191 INFO:tasks.rados.rados.0.trial082.stdout:3704: rollback oid 28 current snap is 410 2026-02-12T17:44:29.191 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 338 2026-02-12T17:44:29.191 INFO:tasks.rados.rados.0.trial082.stdout:3701: expect (ObjNum 1232 snap 394 seq_num 1232) 2026-02-12T17:44:29.205 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:29.239 INFO:tasks.rados.rados.0.trial082.stdout:3703: finishing write tid 1 to trial08226312-39 2026-02-12T17:44:29.239 INFO:tasks.rados.rados.0.trial082.stdout:3703: finishing write tid 2 to trial08226312-39 2026-02-12T17:44:29.239 INFO:tasks.rados.rados.0.trial082.stdout:3703: finishing write tid 3 to trial08226312-39 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:3703: finishing write tid 4 to trial08226312-39 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:3703: oid 39 updating version 0 to 2260 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:3703: oid 39 version 2260 is already newer than 2258 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:3703: oid 39 version 2260 is already newer than 2259 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 2260 (ObjNum 1259 snap 410 seq_num 1259) dirty exists 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:3703: left oid 39 (ObjNum 1259 snap 410 seq_num 1259) 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:3704: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:3704: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:3704: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2435 (ObjNum 1044 snap 325 seq_num 1044) dirty exists 2026-02-12T17:44:29.240 INFO:tasks.rados.rados.0.trial082.stdout:3701: done (2 left) 2026-02-12T17:44:29.241 INFO:tasks.rados.rados.0.trial082.stdout:3703: done (1 left) 2026-02-12T17:44:29.241 INFO:tasks.rados.rados.0.trial082.stdout:3704: done (0 left) 2026-02-12T17:44:29.241 INFO:tasks.rados.rados.0.trial082.stdout:3705: delete oid 35 current snap is 410 2026-02-12T17:44:29.241 INFO:tasks.rados.rados.0.trial082.stdout:3705: done (0 left) 2026-02-12T17:44:29.242 INFO:tasks.rados.rados.0.trial082.stdout:3706: read oid 13 snap 408 2026-02-12T17:44:29.242 INFO:tasks.rados.rados.0.trial082.stdout:3706: expect (ObjNum 1231 snap 394 seq_num 1231) 2026-02-12T17:44:29.242 INFO:tasks.rados.rados.0.trial082.stdout:3707: snap_remove snap 384 2026-02-12T17:44:30.160 INFO:tasks.rados.rados.0.trial082.stdout:3707: done (1 left) 2026-02-12T17:44:30.160 INFO:tasks.rados.rados.0.trial082.stdout:3708: rollback oid 45 current snap is 410 2026-02-12T17:44:30.160 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 395 2026-02-12T17:44:30.161 INFO:tasks.rados.rados.0.trial082.stdout:3706: expect (ObjNum 1231 snap 394 seq_num 1231) 2026-02-12T17:44:30.161 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:30.263 INFO:tasks.rados.rados.0.trial082.stdout:3708: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:44:30.264 INFO:tasks.rados.rados.0.trial082.stdout:3708: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:44:30.264 INFO:tasks.rados.rados.0.trial082.stdout:3708: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:44:30.264 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2736 (ObjNum 1227 snap 394 seq_num 1227) dirty exists 2026-02-12T17:44:30.264 INFO:tasks.rados.rados.0.trial082.stdout:3706: done (1 left) 2026-02-12T17:44:30.264 INFO:tasks.rados.rados.0.trial082.stdout:3708: done (0 left) 2026-02-12T17:44:30.264 INFO:tasks.rados.rados.0.trial082.stdout:3709: copy_from oid 25 from oid 38 current snap is 410 2026-02-12T17:44:30.264 INFO:tasks.rados.rados.0.trial082.stdout:3710: snap_remove snap 372 2026-02-12T17:44:31.162 INFO:tasks.rados.rados.0.trial082.stdout:3710: done (1 left) 2026-02-12T17:44:31.163 INFO:tasks.rados.rados.0.trial082.stdout:3711: delete oid 20 current snap is 410 2026-02-12T17:44:31.163 INFO:tasks.rados.rados.0.trial082.stdout:3709: finishing copy_from to trial08226312-25 2026-02-12T17:44:31.163 INFO:tasks.rados.rados.0.trial082.stdout:3709: got expected ENOENT (src dne) 2026-02-12T17:44:31.163 INFO:tasks.rados.rados.0.trial082.stdout:3709: finishing copy_from racing read to trial08226312-25 2026-02-12T17:44:31.167 INFO:tasks.rados.rados.0.trial082.stdout:3709: done (1 left) 2026-02-12T17:44:31.167 INFO:tasks.rados.rados.0.trial082.stdout:3711: done (0 left) 2026-02-12T17:44:31.167 INFO:tasks.rados.rados.0.trial082.stdout:3712: rollback oid 5 current snap is 410 2026-02-12T17:44:31.167 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 5 to 402 2026-02-12T17:44:31.167 INFO:tasks.rados.rados.0.trial082.stdout:3713: copy_from oid 49 from oid 31 current snap is 410 2026-02-12T17:44:31.167 INFO:tasks.rados.rados.0.trial082.stdout:3714: snap_remove snap 359 2026-02-12T17:44:32.165 INFO:tasks.rados.rados.0.trial082.stdout:3714: done (2 left) 2026-02-12T17:44:32.166 INFO:tasks.rados.rados.0.trial082.stdout:3715: read oid 3 snap -1 2026-02-12T17:44:32.166 INFO:tasks.rados.rados.0.trial082.stdout:3715: expect (ObjNum 1144 snap 363 seq_num 1144) 2026-02-12T17:44:32.166 INFO:tasks.rados.rados.0.trial082.stdout:3716: write oid 22 current snap is 410 2026-02-12T17:44:32.166 INFO:tasks.rados.rados.0.trial082.stdout:3712: finishing rollback tid 0 to trial08226312-5 2026-02-12T17:44:32.166 INFO:tasks.rados.rados.0.trial082.stdout:3716: seq_num 1262 ranges {410434=678836,1565805=548430,2573111=637323} 2026-02-12T17:44:32.169 INFO:tasks.rados.rados.0.trial082.stdout:3716: writing trial08226312-22 from 410434 to 1089270 tid 1 2026-02-12T17:44:32.173 INFO:tasks.rados.rados.0.trial082.stdout:3716: writing trial08226312-22 from 1565805 to 2114235 tid 2 2026-02-12T17:44:32.178 INFO:tasks.rados.rados.0.trial082.stdout:3716: writing trial08226312-22 from 2573111 to 3210434 tid 3 2026-02-12T17:44:32.178 INFO:tasks.rados.rados.0.trial082.stdout:3717: write oid 44 current snap is 410 2026-02-12T17:44:32.178 INFO:tasks.rados.rados.0.trial082.stdout:3717: seq_num 1263 ranges {427241=754085,1624287=408441,2600534=549964} 2026-02-12T17:44:32.182 INFO:tasks.rados.rados.0.trial082.stdout:3717: writing trial08226312-44 from 427241 to 1181326 tid 1 2026-02-12T17:44:32.185 INFO:tasks.rados.rados.0.trial082.stdout:3717: writing trial08226312-44 from 1624287 to 2032728 tid 2 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3717: writing trial08226312-44 from 2600534 to 3150498 tid 3 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3718: copy_from oid 50 from oid 27 current snap is 410 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3712: finishing rollback tid 1 to trial08226312-5 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3712: finishing rollback tid 2 to trial08226312-5 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 2490 (ObjNum 1196 snap 384 seq_num 1196) dirty exists 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3713: finishing copy_from racing read to trial08226312-49 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3713: finishing copy_from to trial08226312-49 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 49 v 2280 (ObjNum 1256 snap 410 seq_num 1256) dirty exists 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3712: done (5 left) 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3713: done (4 left) 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3719: read oid 16 snap -1 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3719: expect (ObjNum 1241 snap 400 seq_num 1241) 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3720: snap_create 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:3715: expect (ObjNum 1144 snap 363 seq_num 1144) 2026-02-12T17:44:32.190 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 76582 2026-02-12T17:44:32.222 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 486150 2026-02-12T17:44:32.272 INFO:tasks.rados.rados.0.trial082.stdout:3716: finishing write tid 1 to trial08226312-22 2026-02-12T17:44:32.272 INFO:tasks.rados.rados.0.trial082.stdout:3716: finishing write tid 2 to trial08226312-22 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3716: finishing write tid 3 to trial08226312-22 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3716: finishing write tid 4 to trial08226312-22 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3716: finishing write tid 5 to trial08226312-22 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3716: oid 22 updating version 0 to 2503 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3716: oid 22 version 2503 is already newer than 2502 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3716: oid 22 version 2503 is already newer than 2500 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3716: oid 22 version 2503 is already newer than 2501 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2503 (ObjNum 1262 snap 410 seq_num 1262) dirty exists 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3716: left oid 22 (ObjNum 1262 snap 410 seq_num 1262) 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: finishing write tid 1 to trial08226312-44 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: finishing write tid 2 to trial08226312-44 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: finishing write tid 3 to trial08226312-44 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: finishing write tid 4 to trial08226312-44 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: finishing write tid 5 to trial08226312-44 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: oid 44 updating version 0 to 2740 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: oid 44 version 2740 is already newer than 2737 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: oid 44 version 2740 is already newer than 2739 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: oid 44 version 2740 is already newer than 2738 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2740 (ObjNum 1263 snap 410 seq_num 1263) dirty exists 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3717: left oid 44 (ObjNum 1263 snap 410 seq_num 1263) 2026-02-12T17:44:32.273 INFO:tasks.rados.rados.0.trial082.stdout:3719: expect (ObjNum 1241 snap 400 seq_num 1241) 2026-02-12T17:44:32.285 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2229451 2026-02-12T17:44:32.303 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:32.344 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1143217 2026-02-12T17:44:32.373 INFO:tasks.rados.rados.0.trial082.stdout:3718: finishing copy_from racing read to trial08226312-50 2026-02-12T17:44:32.373 INFO:tasks.rados.rados.0.trial082.stdout:3718: finishing copy_from to trial08226312-50 2026-02-12T17:44:32.373 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 2276 (ObjNum 1237 snap 397 seq_num 1237) dirty exists 2026-02-12T17:44:33.130 INFO:tasks.rados.rados.0.trial082.stdout:3715: done (5 left) 2026-02-12T17:44:33.130 INFO:tasks.rados.rados.0.trial082.stdout:3716: done (4 left) 2026-02-12T17:44:33.131 INFO:tasks.rados.rados.0.trial082.stdout:3717: done (3 left) 2026-02-12T17:44:33.131 INFO:tasks.rados.rados.0.trial082.stdout:3718: done (2 left) 2026-02-12T17:44:33.131 INFO:tasks.rados.rados.0.trial082.stdout:3719: done (1 left) 2026-02-12T17:44:33.131 INFO:tasks.rados.rados.0.trial082.stdout:3720: done (0 left) 2026-02-12T17:44:33.131 INFO:tasks.rados.rados.0.trial082.stdout:3721: snap_create 2026-02-12T17:44:34.132 INFO:tasks.rados.rados.0.trial082.stdout:3721: done (0 left) 2026-02-12T17:44:34.132 INFO:tasks.rados.rados.0.trial082.stdout:3722: read oid 2 snap 381 2026-02-12T17:44:34.132 INFO:tasks.rados.rados.0.trial082.stdout:3722: expect (ObjNum 955 snap 297 seq_num 955) 2026-02-12T17:44:34.132 INFO:tasks.rados.rados.0.trial082.stdout:3723: snap_remove snap 330 2026-02-12T17:44:35.133 INFO:tasks.rados.rados.0.trial082.stdout:3723: done (1 left) 2026-02-12T17:44:35.133 INFO:tasks.rados.rados.0.trial082.stdout:3724: write (excl) oid 36 current snap is 412 2026-02-12T17:44:35.133 INFO:tasks.rados.rados.0.trial082.stdout:3724: seq_num 1264 ranges {444048=429334,1282769=552099,2627957=616091} 2026-02-12T17:44:35.137 INFO:tasks.rados.rados.0.trial082.stdout:3724: writing trial08226312-36 from 444048 to 873382 tid 1 2026-02-12T17:44:35.140 INFO:tasks.rados.rados.0.trial082.stdout:3724: writing trial08226312-36 from 1282769 to 1834868 tid 2 2026-02-12T17:44:35.146 INFO:tasks.rados.rados.0.trial082.stdout:3724: writing trial08226312-36 from 2627957 to 3244048 tid 3 2026-02-12T17:44:35.146 INFO:tasks.rados.rados.0.trial082.stdout:3725: snap_create 2026-02-12T17:44:35.146 INFO:tasks.rados.rados.0.trial082.stdout:3722: expect (ObjNum 955 snap 297 seq_num 955) 2026-02-12T17:44:35.177 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1153991 2026-02-12T17:44:35.223 INFO:tasks.rados.rados.0.trial082.stdout:3724: finishing write tid 1 to trial08226312-36 2026-02-12T17:44:35.223 INFO:tasks.rados.rados.0.trial082.stdout:3724: finishing write tid 2 to trial08226312-36 2026-02-12T17:44:35.223 INFO:tasks.rados.rados.0.trial082.stdout:3724: finishing write tid 3 to trial08226312-36 2026-02-12T17:44:35.223 INFO:tasks.rados.rados.0.trial082.stdout:3724: finishing write tid 4 to trial08226312-36 2026-02-12T17:44:35.223 INFO:tasks.rados.rados.0.trial082.stdout:3724: finishing write tid 5 to trial08226312-36 2026-02-12T17:44:35.223 INFO:tasks.rados.rados.0.trial082.stdout:3724: oid 36 updating version 0 to 2742 2026-02-12T17:44:35.223 INFO:tasks.rados.rados.0.trial082.stdout:3724: oid 36 updating version 2742 to 2743 2026-02-12T17:44:35.224 INFO:tasks.rados.rados.0.trial082.stdout:3724: oid 36 version 2743 is already newer than 2741 2026-02-12T17:44:35.224 INFO:tasks.rados.rados.0.trial082.stdout:3724: oid 36 updating version 2743 to 2744 2026-02-12T17:44:35.224 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 2744 (ObjNum 1264 snap 412 seq_num 1264) dirty exists 2026-02-12T17:44:35.224 INFO:tasks.rados.rados.0.trial082.stdout:3724: left oid 36 (ObjNum 1264 snap 412 seq_num 1264) 2026-02-12T17:44:36.138 INFO:tasks.rados.rados.0.trial082.stdout:3722: done (2 left) 2026-02-12T17:44:36.138 INFO:tasks.rados.rados.0.trial082.stdout:3724: done (1 left) 2026-02-12T17:44:36.138 INFO:tasks.rados.rados.0.trial082.stdout:3725: done (0 left) 2026-02-12T17:44:36.138 INFO:tasks.rados.rados.0.trial082.stdout:3726: snap_create 2026-02-12T17:44:37.138 INFO:tasks.rados.rados.0.trial082.stdout:3726: done (0 left) 2026-02-12T17:44:37.138 INFO:tasks.rados.rados.0.trial082.stdout:3727: delete oid 11 current snap is 414 2026-02-12T17:44:37.141 INFO:tasks.rados.rados.0.trial082.stdout:3727: done (0 left) 2026-02-12T17:44:37.142 INFO:tasks.rados.rados.0.trial082.stdout:3728: delete oid 48 current snap is 414 2026-02-12T17:44:37.143 INFO:tasks.rados.rados.0.trial082.stdout:3728: done (0 left) 2026-02-12T17:44:37.143 INFO:tasks.rados.rados.0.trial082.stdout:3729: snap_create 2026-02-12T17:44:38.129 INFO:tasks.rados.rados.0.trial082.stdout:3729: done (0 left) 2026-02-12T17:44:38.129 INFO:tasks.rados.rados.0.trial082.stdout:3730: delete oid 46 current snap is 415 2026-02-12T17:44:38.133 INFO:tasks.rados.rados.0.trial082.stdout:3730: done (0 left) 2026-02-12T17:44:38.133 INFO:tasks.rados.rados.0.trial082.stdout:3731: read oid 49 snap -1 2026-02-12T17:44:38.133 INFO:tasks.rados.rados.0.trial082.stdout:3731: expect (ObjNum 1256 snap 410 seq_num 1256) 2026-02-12T17:44:38.133 INFO:tasks.rados.rados.0.trial082.stdout:3732: read oid 40 snap -1 2026-02-12T17:44:38.133 INFO:tasks.rados.rados.0.trial082.stdout:3732: expect (ObjNum 1241 snap 400 seq_num 1241) 2026-02-12T17:44:38.133 INFO:tasks.rados.rados.0.trial082.stdout:3733: delete oid 14 current snap is 415 2026-02-12T17:44:38.134 INFO:tasks.rados.rados.0.trial082.stdout:3733: done (2 left) 2026-02-12T17:44:38.134 INFO:tasks.rados.rados.0.trial082.stdout:3734: snap_remove snap 405 2026-02-12T17:44:39.131 INFO:tasks.rados.rados.0.trial082.stdout:3734: done (2 left) 2026-02-12T17:44:39.132 INFO:tasks.rados.rados.0.trial082.stdout:3735: snap_create 2026-02-12T17:44:39.132 INFO:tasks.rados.rados.0.trial082.stdout:3731: expect (ObjNum 1256 snap 410 seq_num 1256) 2026-02-12T17:44:39.161 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1670204 2026-02-12T17:44:39.198 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2793488 2026-02-12T17:44:39.204 INFO:tasks.rados.rados.0.trial082.stdout:3732: expect (ObjNum 1241 snap 400 seq_num 1241) 2026-02-12T17:44:39.204 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:39.277 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 43187 2026-02-12T17:44:40.132 INFO:tasks.rados.rados.0.trial082.stdout:3731: done (2 left) 2026-02-12T17:44:40.132 INFO:tasks.rados.rados.0.trial082.stdout:3732: done (1 left) 2026-02-12T17:44:40.132 INFO:tasks.rados.rados.0.trial082.stdout:3735: done (0 left) 2026-02-12T17:44:40.133 INFO:tasks.rados.rados.0.trial082.stdout:3736: copy_from oid 9 from oid 18 current snap is 416 2026-02-12T17:44:40.133 INFO:tasks.rados.rados.0.trial082.stdout:3737: read oid 33 snap -1 2026-02-12T17:44:40.133 INFO:tasks.rados.rados.0.trial082.stdout:3737: expect (ObjNum 1207 snap 388 seq_num 1207) 2026-02-12T17:44:40.133 INFO:tasks.rados.rados.0.trial082.stdout:3738: copy_from oid 28 from oid 42 current snap is 416 2026-02-12T17:44:40.133 INFO:tasks.rados.rados.0.trial082.stdout:3739: write oid 50 current snap is 416 2026-02-12T17:44:40.133 INFO:tasks.rados.rados.0.trial082.stdout:3739: seq_num 1269 ranges {528083=405579,1342473=419448,2248719=733949} 2026-02-12T17:44:40.136 INFO:tasks.rados.rados.0.trial082.stdout:3739: writing trial08226312-50 from 528083 to 933662 tid 1 2026-02-12T17:44:40.139 INFO:tasks.rados.rados.0.trial082.stdout:3739: writing trial08226312-50 from 1342473 to 1761921 tid 2 2026-02-12T17:44:40.144 INFO:tasks.rados.rados.0.trial082.stdout:3739: writing trial08226312-50 from 2248719 to 2982668 tid 3 2026-02-12T17:44:40.144 INFO:tasks.rados.rados.0.trial082.stdout:3740: write (excl) oid 5 current snap is 416 2026-02-12T17:44:40.145 INFO:tasks.rados.rados.0.trial082.stdout:3740: seq_num 1270 ranges {544890=597181,1917308=563106,3076142=268748} 2026-02-12T17:44:40.148 INFO:tasks.rados.rados.0.trial082.stdout:3740: writing trial08226312-5 from 544890 to 1142071 tid 1 2026-02-12T17:44:40.153 INFO:tasks.rados.rados.0.trial082.stdout:3740: writing trial08226312-5 from 1917308 to 2480414 tid 2 2026-02-12T17:44:40.157 INFO:tasks.rados.rados.0.trial082.stdout:3740: writing trial08226312-5 from 3076142 to 3344890 tid 3 2026-02-12T17:44:40.157 INFO:tasks.rados.rados.0.trial082.stdout:3741: read oid 24 snap 407 2026-02-12T17:44:40.157 INFO:tasks.rados.rados.0.trial082.stdout:3741: expect (ObjNum 1194 snap 382 seq_num 1194) 2026-02-12T17:44:40.157 INFO:tasks.rados.rados.0.trial082.stdout:3742: rollback oid 37 current snap is 416 2026-02-12T17:44:40.158 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 37 to 410 2026-02-12T17:44:40.158 INFO:tasks.rados.rados.0.trial082.stdout:3738: finishing copy_from to trial08226312-28 2026-02-12T17:44:40.158 INFO:tasks.rados.rados.0.trial082.stdout:3738: got expected ENOENT (src dne) 2026-02-12T17:44:40.158 INFO:tasks.rados.rados.0.trial082.stdout:3738: finishing copy_from racing read to trial08226312-28 2026-02-12T17:44:40.158 INFO:tasks.rados.rados.0.trial082.stdout:3737: expect (ObjNum 1207 snap 388 seq_num 1207) 2026-02-12T17:44:40.218 INFO:tasks.rados.rados.0.trial082.stdout:3736: finishing copy_from racing read to trial08226312-9 2026-02-12T17:44:40.218 INFO:tasks.rados.rados.0.trial082.stdout:3739: finishing write tid 1 to trial08226312-50 2026-02-12T17:44:40.218 INFO:tasks.rados.rados.0.trial082.stdout:3736: finishing copy_from to trial08226312-9 2026-02-12T17:44:40.218 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 2406 (ObjNum 1219 snap 393 seq_num 1219) dirty exists 2026-02-12T17:44:40.218 INFO:tasks.rados.rados.0.trial082.stdout:3739: finishing write tid 2 to trial08226312-50 2026-02-12T17:44:40.218 INFO:tasks.rados.rados.0.trial082.stdout:3739: finishing write tid 3 to trial08226312-50 2026-02-12T17:44:40.218 INFO:tasks.rados.rados.0.trial082.stdout:3739: finishing write tid 4 to trial08226312-50 2026-02-12T17:44:40.218 INFO:tasks.rados.rados.0.trial082.stdout:3739: finishing write tid 5 to trial08226312-50 2026-02-12T17:44:40.218 INFO:tasks.rados.rados.0.trial082.stdout:3739: oid 50 updating version 0 to 2412 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3739: oid 50 version 2412 is already newer than 2410 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3739: oid 50 version 2412 is already newer than 2411 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3739: oid 50 version 2412 is already newer than 2409 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 2412 (ObjNum 1269 snap 416 seq_num 1269) dirty exists 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3739: left oid 50 (ObjNum 1269 snap 416 seq_num 1269) 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3740: finishing write tid 1 to trial08226312-5 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3740: finishing write tid 2 to trial08226312-5 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3740: finishing write tid 3 to trial08226312-5 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3740: finishing write tid 4 to trial08226312-5 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3740: finishing write tid 5 to trial08226312-5 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3740: oid 5 updating version 0 to 2495 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3740: oid 5 version 2495 is already newer than 2493 2026-02-12T17:44:40.219 INFO:tasks.rados.rados.0.trial082.stdout:3740: oid 5 version 2495 is already newer than 2492 2026-02-12T17:44:40.220 INFO:tasks.rados.rados.0.trial082.stdout:3740: oid 5 version 2495 is already newer than 2494 2026-02-12T17:44:40.220 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 2495 (ObjNum 1270 snap 416 seq_num 1270) dirty exists 2026-02-12T17:44:40.220 INFO:tasks.rados.rados.0.trial082.stdout:3740: left oid 5 (ObjNum 1270 snap 416 seq_num 1270) 2026-02-12T17:44:40.220 INFO:tasks.rados.rados.0.trial082.stdout:3741: expect (ObjNum 1194 snap 382 seq_num 1194) 2026-02-12T17:44:40.220 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:40.267 INFO:tasks.rados.rados.0.trial082.stdout:3742: finishing rollback tid 0 to trial08226312-37 2026-02-12T17:44:40.267 INFO:tasks.rados.rados.0.trial082.stdout:3742: finishing rollback tid 1 to trial08226312-37 2026-02-12T17:44:40.267 INFO:tasks.rados.rados.0.trial082.stdout:3736: done (6 left) 2026-02-12T17:44:40.267 INFO:tasks.rados.rados.0.trial082.stdout:3737: done (5 left) 2026-02-12T17:44:40.268 INFO:tasks.rados.rados.0.trial082.stdout:3738: done (4 left) 2026-02-12T17:44:40.268 INFO:tasks.rados.rados.0.trial082.stdout:3739: done (3 left) 2026-02-12T17:44:40.268 INFO:tasks.rados.rados.0.trial082.stdout:3740: done (2 left) 2026-02-12T17:44:40.268 INFO:tasks.rados.rados.0.trial082.stdout:3741: done (1 left) 2026-02-12T17:44:40.268 INFO:tasks.rados.rados.0.trial082.stdout:3743: write oid 27 current snap is 416 2026-02-12T17:44:40.268 INFO:tasks.rados.rados.0.trial082.stdout:3743: seq_num 1271 ranges {561697=672430,1975790=706764,3103565=258132} 2026-02-12T17:44:40.272 INFO:tasks.rados.rados.0.trial082.stdout:3743: writing trial08226312-27 from 561697 to 1234127 tid 1 2026-02-12T17:44:40.277 INFO:tasks.rados.rados.0.trial082.stdout:3743: writing trial08226312-27 from 1975790 to 2682554 tid 2 2026-02-12T17:44:40.280 INFO:tasks.rados.rados.0.trial082.stdout:3743: writing trial08226312-27 from 3103565 to 3361697 tid 3 2026-02-12T17:44:40.280 INFO:tasks.rados.rados.0.trial082.stdout:3744: read oid 15 snap -1 2026-02-12T17:44:40.280 INFO:tasks.rados.rados.0.trial082.stdout:3744: expect (ObjNum 1039 snap 325 seq_num 1039) 2026-02-12T17:44:40.280 INFO:tasks.rados.rados.0.trial082.stdout:3745: write oid 16 current snap is 416 2026-02-12T17:44:40.280 INFO:tasks.rados.rados.0.trial082.stdout:3742: finishing rollback tid 2 to trial08226312-37 2026-02-12T17:44:40.281 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 2411 (ObjNum 1220 snap 393 seq_num 1220) dirty exists 2026-02-12T17:44:40.281 INFO:tasks.rados.rados.0.trial082.stdout:3743: finishing write tid 1 to trial08226312-27 2026-02-12T17:44:40.281 INFO:tasks.rados.rados.0.trial082.stdout:3745: seq_num 1272 ranges {578504=747679,2034272=566775,3130988=247516} 2026-02-12T17:44:40.285 INFO:tasks.rados.rados.0.trial082.stdout:3745: writing trial08226312-16 from 578504 to 1326183 tid 1 2026-02-12T17:44:40.291 INFO:tasks.rados.rados.0.trial082.stdout:3745: writing trial08226312-16 from 2034272 to 2601047 tid 2 2026-02-12T17:44:40.294 INFO:tasks.rados.rados.0.trial082.stdout:3745: writing trial08226312-16 from 3130988 to 3378504 tid 3 2026-02-12T17:44:40.294 INFO:tasks.rados.rados.0.trial082.stdout:3742: done (3 left) 2026-02-12T17:44:40.294 INFO:tasks.rados.rados.0.trial082.stdout:3746: snap_remove snap 367 2026-02-12T17:44:41.144 INFO:tasks.rados.rados.0.trial082.stdout:3746: done (3 left) 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:3747: snap_create 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:3743: finishing write tid 2 to trial08226312-27 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:3743: finishing write tid 3 to trial08226312-27 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:3743: finishing write tid 4 to trial08226312-27 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:3743: finishing write tid 5 to trial08226312-27 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:3743: oid 27 updating version 0 to 2281 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:3743: oid 27 updating version 2281 to 2284 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:3743: oid 27 version 2284 is already newer than 2283 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:3743: oid 27 version 2284 is already newer than 2282 2026-02-12T17:44:41.145 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2284 (ObjNum 1271 snap 416 seq_num 1271) dirty exists 2026-02-12T17:44:41.146 INFO:tasks.rados.rados.0.trial082.stdout:3743: left oid 27 (ObjNum 1271 snap 416 seq_num 1271) 2026-02-12T17:44:41.146 INFO:tasks.rados.rados.0.trial082.stdout:3744: expect (ObjNum 1039 snap 325 seq_num 1039) 2026-02-12T17:44:41.146 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: finishing write tid 1 to trial08226312-16 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: finishing write tid 2 to trial08226312-16 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: finishing write tid 3 to trial08226312-16 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: finishing write tid 4 to trial08226312-16 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: finishing write tid 5 to trial08226312-16 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: oid 16 updating version 0 to 2439 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: oid 16 version 2439 is already newer than 2436 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: oid 16 version 2439 is already newer than 2437 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: oid 16 version 2439 is already newer than 2438 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 2439 (ObjNum 1272 snap 416 seq_num 1272) dirty exists 2026-02-12T17:44:41.277 INFO:tasks.rados.rados.0.trial082.stdout:3745: left oid 16 (ObjNum 1272 snap 416 seq_num 1272) 2026-02-12T17:44:42.570 INFO:tasks.rados.rados.0.trial082.stdout:3743: done (3 left) 2026-02-12T17:44:42.570 INFO:tasks.rados.rados.0.trial082.stdout:3744: done (2 left) 2026-02-12T17:44:42.570 INFO:tasks.rados.rados.0.trial082.stdout:3745: done (1 left) 2026-02-12T17:44:42.570 INFO:tasks.rados.rados.0.trial082.stdout:3747: done (0 left) 2026-02-12T17:44:42.570 INFO:tasks.rados.rados.0.trial082.stdout:3748: rollback oid 18 current snap is 417 2026-02-12T17:44:42.570 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 387 2026-02-12T17:44:42.571 INFO:tasks.rados.rados.0.trial082.stdout:3749: copy_from oid 10 from oid 5 current snap is 417 2026-02-12T17:44:42.571 INFO:tasks.rados.rados.0.trial082.stdout:3750: copy_from oid 6 from oid 16 current snap is 417 2026-02-12T17:44:42.571 INFO:tasks.rados.rados.0.trial082.stdout:3751: copy_from oid 22 from oid 35 current snap is 417 2026-02-12T17:44:42.571 INFO:tasks.rados.rados.0.trial082.stdout:3752: snap_remove snap 379 2026-02-12T17:44:43.131 INFO:tasks.rados.rados.0.trial082.stdout:3752: done (4 left) 2026-02-12T17:44:43.131 INFO:tasks.rados.rados.0.trial082.stdout:3753: write (excl) oid 19 current snap is 417 2026-02-12T17:44:43.131 INFO:tasks.rados.rados.0.trial082.stdout:3753: seq_num 1273 ranges {595311=422928,1576401=710433,3042058=353253} 2026-02-12T17:44:43.135 INFO:tasks.rados.rados.0.trial082.stdout:3753: writing trial08226312-19 from 595311 to 1018239 tid 1 2026-02-12T17:44:43.141 INFO:tasks.rados.rados.0.trial082.stdout:3753: writing trial08226312-19 from 1576401 to 2286834 tid 2 2026-02-12T17:44:43.145 INFO:tasks.rados.rados.0.trial082.stdout:3753: writing trial08226312-19 from 3042058 to 3395311 tid 3 2026-02-12T17:44:43.145 INFO:tasks.rados.rados.0.trial082.stdout:3754: write oid 1 current snap is 417 2026-02-12T17:44:43.146 INFO:tasks.rados.rados.0.trial082.stdout:3754: seq_num 1274 ranges {612118=498177,1634883=570444,2669481=706662} 2026-02-12T17:44:43.149 INFO:tasks.rados.rados.0.trial082.stdout:3754: writing trial08226312-1 from 612118 to 1110295 tid 1 2026-02-12T17:44:43.153 INFO:tasks.rados.rados.0.trial082.stdout:3754: writing trial08226312-1 from 1634883 to 2205327 tid 2 2026-02-12T17:44:43.159 INFO:tasks.rados.rados.0.trial082.stdout:3754: writing trial08226312-1 from 2669481 to 3376143 tid 3 2026-02-12T17:44:43.159 INFO:tasks.rados.rados.0.trial082.stdout:3755: snap_create 2026-02-12T17:44:43.159 INFO:tasks.rados.rados.0.trial082.stdout:3751: finishing copy_from to trial08226312-22 2026-02-12T17:44:43.159 INFO:tasks.rados.rados.0.trial082.stdout:3751: got expected ENOENT (src dne) 2026-02-12T17:44:43.159 INFO:tasks.rados.rados.0.trial082.stdout:3751: finishing copy_from racing read to trial08226312-22 2026-02-12T17:44:43.159 INFO:tasks.rados.rados.0.trial082.stdout:3748: finishing rollback tid 0 to trial08226312-18 2026-02-12T17:44:43.159 INFO:tasks.rados.rados.0.trial082.stdout:3748: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3748: finishing rollback tid 2 to trial08226312-18 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 2422 (ObjNum 1193 snap 382 seq_num 1193) dirty exists 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3750: finishing copy_from racing read to trial08226312-6 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3750: finishing copy_from to trial08226312-6 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 2439 (ObjNum 1272 snap 416 seq_num 1272) dirty exists 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3749: finishing copy_from racing read to trial08226312-10 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3749: finishing copy_from to trial08226312-10 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2495 (ObjNum 1270 snap 416 seq_num 1270) dirty exists 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3753: finishing write tid 1 to trial08226312-19 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3753: finishing write tid 2 to trial08226312-19 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3753: finishing write tid 3 to trial08226312-19 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3753: finishing write tid 4 to trial08226312-19 2026-02-12T17:44:43.160 INFO:tasks.rados.rados.0.trial082.stdout:3753: finishing write tid 5 to trial08226312-19 2026-02-12T17:44:43.161 INFO:tasks.rados.rados.0.trial082.stdout:3753: oid 19 updating version 0 to 2921 2026-02-12T17:44:43.161 INFO:tasks.rados.rados.0.trial082.stdout:3753: oid 19 version 2921 is already newer than 2919 2026-02-12T17:44:43.161 INFO:tasks.rados.rados.0.trial082.stdout:3753: oid 19 version 2921 is already newer than 2920 2026-02-12T17:44:43.161 INFO:tasks.rados.rados.0.trial082.stdout:3753: oid 19 version 2921 is already newer than 2906 2026-02-12T17:44:43.161 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 2921 (ObjNum 1273 snap 417 seq_num 1273) dirty exists 2026-02-12T17:44:43.161 INFO:tasks.rados.rados.0.trial082.stdout:3753: left oid 19 (ObjNum 1273 snap 417 seq_num 1273) 2026-02-12T17:44:43.161 INFO:tasks.rados.rados.0.trial082.stdout:3754: finishing write tid 1 to trial08226312-1 2026-02-12T17:44:43.161 INFO:tasks.rados.rados.0.trial082.stdout:3754: finishing write tid 2 to trial08226312-1 2026-02-12T17:44:43.162 INFO:tasks.rados.rados.0.trial082.stdout:3754: finishing write tid 3 to trial08226312-1 2026-02-12T17:44:43.162 INFO:tasks.rados.rados.0.trial082.stdout:3754: finishing write tid 4 to trial08226312-1 2026-02-12T17:44:43.162 INFO:tasks.rados.rados.0.trial082.stdout:3754: finishing write tid 5 to trial08226312-1 2026-02-12T17:44:43.162 INFO:tasks.rados.rados.0.trial082.stdout:3754: oid 1 updating version 0 to 2453 2026-02-12T17:44:43.162 INFO:tasks.rados.rados.0.trial082.stdout:3754: oid 1 version 2453 is already newer than 2451 2026-02-12T17:44:43.162 INFO:tasks.rados.rados.0.trial082.stdout:3754: oid 1 version 2453 is already newer than 2450 2026-02-12T17:44:43.162 INFO:tasks.rados.rados.0.trial082.stdout:3754: oid 1 version 2453 is already newer than 2452 2026-02-12T17:44:43.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2453 (ObjNum 1274 snap 417 seq_num 1274) dirty exists 2026-02-12T17:44:43.163 INFO:tasks.rados.rados.0.trial082.stdout:3754: left oid 1 (ObjNum 1274 snap 417 seq_num 1274) 2026-02-12T17:44:44.151 INFO:tasks.rados.rados.0.trial082.stdout:3748: done (6 left) 2026-02-12T17:44:44.151 INFO:tasks.rados.rados.0.trial082.stdout:3749: done (5 left) 2026-02-12T17:44:44.151 INFO:tasks.rados.rados.0.trial082.stdout:3750: done (4 left) 2026-02-12T17:44:44.151 INFO:tasks.rados.rados.0.trial082.stdout:3751: done (3 left) 2026-02-12T17:44:44.151 INFO:tasks.rados.rados.0.trial082.stdout:3753: done (2 left) 2026-02-12T17:44:44.151 INFO:tasks.rados.rados.0.trial082.stdout:3754: done (1 left) 2026-02-12T17:44:44.152 INFO:tasks.rados.rados.0.trial082.stdout:3755: done (0 left) 2026-02-12T17:44:44.152 INFO:tasks.rados.rados.0.trial082.stdout:3756: rollback oid 2 current snap is 418 2026-02-12T17:44:44.152 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 2 to 417 2026-02-12T17:44:44.152 INFO:tasks.rados.rados.0.trial082.stdout:3757: read oid 27 snap -1 2026-02-12T17:44:44.152 INFO:tasks.rados.rados.0.trial082.stdout:3757: expect (ObjNum 1271 snap 416 seq_num 1271) 2026-02-12T17:44:44.152 INFO:tasks.rados.rados.0.trial082.stdout:3758: rollback oid 16 current snap is 418 2026-02-12T17:44:44.152 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 16 to 390 2026-02-12T17:44:44.152 INFO:tasks.rados.rados.0.trial082.stdout:3759: copy_from oid 3 from oid 11 current snap is 418 2026-02-12T17:44:44.152 INFO:tasks.rados.rados.0.trial082.stdout:3760: delete oid 14 current snap is 418 2026-02-12T17:44:44.153 INFO:tasks.rados.rados.0.trial082.stdout:3759: finishing copy_from to trial08226312-3 2026-02-12T17:44:44.153 INFO:tasks.rados.rados.0.trial082.stdout:3759: got expected ENOENT (src dne) 2026-02-12T17:44:44.153 INFO:tasks.rados.rados.0.trial082.stdout:3759: finishing copy_from racing read to trial08226312-3 2026-02-12T17:44:44.153 INFO:tasks.rados.rados.0.trial082.stdout:3756: finishing rollback tid 1 to trial08226312-2 2026-02-12T17:44:44.153 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 2 v 2257 (ObjNum 289 snap 0 seq_num 25873739) dirty dne 2026-02-12T17:44:44.154 INFO:tasks.rados.rados.0.trial082.stdout:3756: done (4 left) 2026-02-12T17:44:44.154 INFO:tasks.rados.rados.0.trial082.stdout:3759: done (3 left) 2026-02-12T17:44:44.154 INFO:tasks.rados.rados.0.trial082.stdout:3760: done (2 left) 2026-02-12T17:44:44.154 INFO:tasks.rados.rados.0.trial082.stdout:3761: snap_remove snap 391 2026-02-12T17:44:45.151 INFO:tasks.rados.rados.0.trial082.stdout:3761: done (2 left) 2026-02-12T17:44:45.151 INFO:tasks.rados.rados.0.trial082.stdout:3762: copy_from oid 41 from oid 26 current snap is 418 2026-02-12T17:44:45.152 INFO:tasks.rados.rados.0.trial082.stdout:3757: expect (ObjNum 1271 snap 416 seq_num 1271) 2026-02-12T17:44:45.152 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:45.251 INFO:tasks.rados.rados.0.trial082.stdout:3758: finishing rollback tid 0 to trial08226312-16 2026-02-12T17:44:45.251 INFO:tasks.rados.rados.0.trial082.stdout:3758: finishing rollback tid 1 to trial08226312-16 2026-02-12T17:44:45.252 INFO:tasks.rados.rados.0.trial082.stdout:3758: finishing rollback tid 2 to trial08226312-16 2026-02-12T17:44:45.252 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 2442 (ObjNum 1007 snap 314 seq_num 1007) dirty exists 2026-02-12T17:44:45.252 INFO:tasks.rados.rados.0.trial082.stdout:3762: finishing copy_from racing read to trial08226312-41 2026-02-12T17:44:45.252 INFO:tasks.rados.rados.0.trial082.stdout:3757: done (2 left) 2026-02-12T17:44:45.252 INFO:tasks.rados.rados.0.trial082.stdout:3758: done (1 left) 2026-02-12T17:44:45.252 INFO:tasks.rados.rados.0.trial082.stdout:3763: delete oid 48 current snap is 418 2026-02-12T17:44:45.252 INFO:tasks.rados.rados.0.trial082.stdout:3762: finishing copy_from to trial08226312-41 2026-02-12T17:44:45.252 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 2730 (ObjNum 1231 snap 394 seq_num 1231) dirty exists 2026-02-12T17:44:45.253 INFO:tasks.rados.rados.0.trial082.stdout:3762: done (1 left) 2026-02-12T17:44:45.253 INFO:tasks.rados.rados.0.trial082.stdout:3763: done (0 left) 2026-02-12T17:44:45.253 INFO:tasks.rados.rados.0.trial082.stdout:3764: read oid 19 snap -1 2026-02-12T17:44:45.253 INFO:tasks.rados.rados.0.trial082.stdout:3764: expect (ObjNum 1273 snap 417 seq_num 1273) 2026-02-12T17:44:45.253 INFO:tasks.rados.rados.0.trial082.stdout:3765: snap_remove snap 408 2026-02-12T17:44:46.157 INFO:tasks.rados.rados.0.trial082.stdout:3765: done (1 left) 2026-02-12T17:44:46.157 INFO:tasks.rados.rados.0.trial082.stdout:3766: read oid 42 snap -1 2026-02-12T17:44:46.157 INFO:tasks.rados.rados.0.trial082.stdout:3766: expect deleted 2026-02-12T17:44:46.157 INFO:tasks.rados.rados.0.trial082.stdout:3767: write (excl) oid 16 current snap is 418 2026-02-12T17:44:46.158 INFO:tasks.rados.rados.0.trial082.stdout:3767: seq_num 1277 ranges {662539=723924,2093976=717771,3435397=27142} 2026-02-12T17:44:46.162 INFO:tasks.rados.rados.0.trial082.stdout:3767: writing trial08226312-16 from 662539 to 1386463 tid 1 2026-02-12T17:44:46.167 INFO:tasks.rados.rados.0.trial082.stdout:3767: writing trial08226312-16 from 2093976 to 2811747 tid 2 2026-02-12T17:44:46.170 INFO:tasks.rados.rados.0.trial082.stdout:3767: writing trial08226312-16 from 3435397 to 3462539 tid 3 2026-02-12T17:44:46.170 INFO:tasks.rados.rados.0.trial082.stdout:3768: rollback oid 13 current snap is 418 2026-02-12T17:44:46.170 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 13 to 402 2026-02-12T17:44:46.170 INFO:tasks.rados.rados.0.trial082.stdout:3764: expect (ObjNum 1273 snap 417 seq_num 1273) 2026-02-12T17:44:46.279 INFO:tasks.rados.rados.0.trial082.stdout:3767: finishing write tid 1 to trial08226312-16 2026-02-12T17:44:46.279 INFO:tasks.rados.rados.0.trial082.stdout:3767: finishing write tid 2 to trial08226312-16 2026-02-12T17:44:46.279 INFO:tasks.rados.rados.0.trial082.stdout:3767: finishing write tid 3 to trial08226312-16 2026-02-12T17:44:46.279 INFO:tasks.rados.rados.0.trial082.stdout:3764: done (3 left) 2026-02-12T17:44:46.279 INFO:tasks.rados.rados.0.trial082.stdout:3766: done (2 left) 2026-02-12T17:44:46.279 INFO:tasks.rados.rados.0.trial082.stdout:3769: read oid 45 snap -1 2026-02-12T17:44:46.279 INFO:tasks.rados.rados.0.trial082.stdout:3769: expect (ObjNum 1227 snap 394 seq_num 1227) 2026-02-12T17:44:46.279 INFO:tasks.rados.rados.0.trial082.stdout:3770: write oid 1 current snap is 418 2026-02-12T17:44:46.280 INFO:tasks.rados.rados.0.trial082.stdout:3770: seq_num 1278 ranges {679346=515526,1868811=577782,3179173=300173} 2026-02-12T17:44:46.284 INFO:tasks.rados.rados.0.trial082.stdout:3770: writing trial08226312-1 from 679346 to 1194872 tid 1 2026-02-12T17:44:46.288 INFO:tasks.rados.rados.0.trial082.stdout:3770: writing trial08226312-1 from 1868811 to 2446593 tid 2 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:3770: writing trial08226312-1 from 3179173 to 3479346 tid 3 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:3771: delete oid 5 current snap is 418 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:3767: finishing write tid 4 to trial08226312-16 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:3767: finishing write tid 5 to trial08226312-16 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:3767: oid 16 updating version 0 to 2443 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:3767: oid 16 updating version 2443 to 2446 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:3767: oid 16 version 2446 is already newer than 2445 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:3767: oid 16 version 2446 is already newer than 2444 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 16 v 2446 (ObjNum 1277 snap 418 seq_num 1277) dirty exists 2026-02-12T17:44:46.293 INFO:tasks.rados.rados.0.trial082.stdout:3767: left oid 16 (ObjNum 1277 snap 418 seq_num 1277) 2026-02-12T17:44:46.294 INFO:tasks.rados.rados.0.trial082.stdout:3768: finishing rollback tid 0 to trial08226312-13 2026-02-12T17:44:46.294 INFO:tasks.rados.rados.0.trial082.stdout:3768: finishing rollback tid 1 to trial08226312-13 2026-02-12T17:44:46.294 INFO:tasks.rados.rados.0.trial082.stdout:3768: finishing rollback tid 2 to trial08226312-13 2026-02-12T17:44:46.294 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 13 v 2733 (ObjNum 1231 snap 394 seq_num 1231) dirty exists 2026-02-12T17:44:46.294 INFO:tasks.rados.rados.0.trial082.stdout:3769: expect (ObjNum 1227 snap 394 seq_num 1227) 2026-02-12T17:44:46.330 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 187764 2026-02-12T17:44:46.373 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 623548 2026-02-12T17:44:46.403 INFO:tasks.rados.rados.0.trial082.stdout:3770: finishing write tid 1 to trial08226312-1 2026-02-12T17:44:46.403 INFO:tasks.rados.rados.0.trial082.stdout:3770: finishing write tid 2 to trial08226312-1 2026-02-12T17:44:46.403 INFO:tasks.rados.rados.0.trial082.stdout:3767: done (4 left) 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3768: done (3 left) 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3769: done (2 left) 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3771: done (1 left) 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3772: read oid 49 snap -1 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3772: expect (ObjNum 1256 snap 410 seq_num 1256) 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3773: snap_create 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3770: finishing write tid 3 to trial08226312-1 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3770: finishing write tid 4 to trial08226312-1 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3770: finishing write tid 5 to trial08226312-1 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3770: oid 1 updating version 0 to 2457 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3770: oid 1 version 2457 is already newer than 2456 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3770: oid 1 version 2457 is already newer than 2455 2026-02-12T17:44:46.404 INFO:tasks.rados.rados.0.trial082.stdout:3770: oid 1 version 2457 is already newer than 2454 2026-02-12T17:44:46.405 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2457 (ObjNum 1278 snap 418 seq_num 1278) dirty exists 2026-02-12T17:44:46.405 INFO:tasks.rados.rados.0.trial082.stdout:3770: left oid 1 (ObjNum 1278 snap 418 seq_num 1278) 2026-02-12T17:44:46.413 INFO:tasks.rados.rados.0.trial082.stdout:3772: expect (ObjNum 1256 snap 410 seq_num 1256) 2026-02-12T17:44:46.413 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:46.473 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 599480 2026-02-12T17:44:47.159 INFO:tasks.rados.rados.0.trial082.stdout:3770: done (2 left) 2026-02-12T17:44:47.159 INFO:tasks.rados.rados.0.trial082.stdout:3772: done (1 left) 2026-02-12T17:44:47.159 INFO:tasks.rados.rados.0.trial082.stdout:3773: done (0 left) 2026-02-12T17:44:47.160 INFO:tasks.rados.rados.0.trial082.stdout:3774: snap_remove snap 388 2026-02-12T17:44:48.159 INFO:tasks.rados.rados.0.trial082.stdout:3774: done (0 left) 2026-02-12T17:44:48.159 INFO:tasks.rados.rados.0.trial082.stdout:3775: delete oid 35 current snap is 419 2026-02-12T17:44:48.168 INFO:tasks.rados.rados.0.trial082.stdout:3775: done (0 left) 2026-02-12T17:44:48.168 INFO:tasks.rados.rados.0.trial082.stdout:3776: rollback oid 45 current snap is 419 2026-02-12T17:44:48.168 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 418 2026-02-12T17:44:48.168 INFO:tasks.rados.rados.0.trial082.stdout:3777: delete oid 18 current snap is 419 2026-02-12T17:44:48.170 INFO:tasks.rados.rados.0.trial082.stdout:3777: done (1 left) 2026-02-12T17:44:48.170 INFO:tasks.rados.rados.0.trial082.stdout:3778: rollback oid 37 current snap is 419 2026-02-12T17:44:48.170 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 37 to 385 2026-02-12T17:44:48.170 INFO:tasks.rados.rados.0.trial082.stdout:3779: snap_remove snap 401 2026-02-12T17:44:49.169 INFO:tasks.rados.rados.0.trial082.stdout:3779: done (2 left) 2026-02-12T17:44:49.169 INFO:tasks.rados.rados.0.trial082.stdout:3780: rollback oid 48 current snap is 419 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 48 to 417 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:3778: finishing rollback tid 0 to trial08226312-37 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:3778: finishing rollback tid 1 to trial08226312-37 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:3778: finishing rollback tid 2 to trial08226312-37 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 2733 (ObjNum 1190 snap 382 seq_num 1190) dirty exists 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:3776: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:3776: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:3776: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2747 (ObjNum 1227 snap 394 seq_num 1227) dirty exists 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:3776: done (2 left) 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:3778: done (1 left) 2026-02-12T17:44:49.170 INFO:tasks.rados.rados.0.trial082.stdout:3781: read oid 8 snap -1 2026-02-12T17:44:49.171 INFO:tasks.rados.rados.0.trial082.stdout:3781: expect (ObjNum 1243 snap 404 seq_num 1243) 2026-02-12T17:44:49.171 INFO:tasks.rados.rados.0.trial082.stdout:3782: snap_create 2026-02-12T17:44:49.171 INFO:tasks.rados.rados.0.trial082.stdout:3780: finishing rollback tid 1 to trial08226312-48 2026-02-12T17:44:49.171 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 2456 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:44:49.175 INFO:tasks.rados.rados.0.trial082.stdout:3781: expect (ObjNum 1243 snap 404 seq_num 1243) 2026-02-12T17:44:49.175 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:49.219 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:50.172 INFO:tasks.rados.rados.0.trial082.stdout:3780: done (2 left) 2026-02-12T17:44:50.173 INFO:tasks.rados.rados.0.trial082.stdout:3781: done (1 left) 2026-02-12T17:44:50.173 INFO:tasks.rados.rados.0.trial082.stdout:3782: done (0 left) 2026-02-12T17:44:50.173 INFO:tasks.rados.rados.0.trial082.stdout:3783: snap_create 2026-02-12T17:44:51.173 INFO:tasks.rados.rados.0.trial082.stdout:3783: done (0 left) 2026-02-12T17:44:51.173 INFO:tasks.rados.rados.0.trial082.stdout:3784: read oid 19 snap -1 2026-02-12T17:44:51.174 INFO:tasks.rados.rados.0.trial082.stdout:3784: expect (ObjNum 1273 snap 417 seq_num 1273) 2026-02-12T17:44:51.174 INFO:tasks.rados.rados.0.trial082.stdout:3785: write oid 50 current snap is 421 2026-02-12T17:44:51.174 INFO:tasks.rados.rados.0.trial082.stdout:3785: seq_num 1282 ranges {746574=416522,1586386=468767,2772512=629544} 2026-02-12T17:44:51.177 INFO:tasks.rados.rados.0.trial082.stdout:3785: writing trial08226312-50 from 746574 to 1163096 tid 1 2026-02-12T17:44:51.181 INFO:tasks.rados.rados.0.trial082.stdout:3785: writing trial08226312-50 from 1586386 to 2055153 tid 2 2026-02-12T17:44:51.186 INFO:tasks.rados.rados.0.trial082.stdout:3785: writing trial08226312-50 from 2772512 to 3402056 tid 3 2026-02-12T17:44:51.186 INFO:tasks.rados.rados.0.trial082.stdout:3786: read oid 47 snap -1 2026-02-12T17:44:51.186 INFO:tasks.rados.rados.0.trial082.stdout:3786: expect deleted 2026-02-12T17:44:51.186 INFO:tasks.rados.rados.0.trial082.stdout:3787: write (excl) oid 30 current snap is 421 2026-02-12T17:44:51.187 INFO:tasks.rados.rados.0.trial082.stdout:3787: seq_num 1283 ranges {763381=491771,2044868=728778,3199935=363446} 2026-02-12T17:44:51.190 INFO:tasks.rados.rados.0.trial082.stdout:3787: writing trial08226312-30 from 763381 to 1255152 tid 1 2026-02-12T17:44:51.196 INFO:tasks.rados.rados.0.trial082.stdout:3787: writing trial08226312-30 from 2044868 to 2773646 tid 2 2026-02-12T17:44:51.200 INFO:tasks.rados.rados.0.trial082.stdout:3787: writing trial08226312-30 from 3199935 to 3563381 tid 3 2026-02-12T17:44:51.200 INFO:tasks.rados.rados.0.trial082.stdout:3788: read oid 46 snap -1 2026-02-12T17:44:51.200 INFO:tasks.rados.rados.0.trial082.stdout:3788: expect deleted 2026-02-12T17:44:51.200 INFO:tasks.rados.rados.0.trial082.stdout:3789: read oid 43 snap -1 2026-02-12T17:44:51.200 INFO:tasks.rados.rados.0.trial082.stdout:3789: expect (ObjNum 1248 snap 408 seq_num 1248) 2026-02-12T17:44:51.201 INFO:tasks.rados.rados.0.trial082.stdout:3790: read oid 28 snap -1 2026-02-12T17:44:51.201 INFO:tasks.rados.rados.0.trial082.stdout:3790: expect (ObjNum 1044 snap 325 seq_num 1044) 2026-02-12T17:44:51.201 INFO:tasks.rados.rados.0.trial082.stdout:3791: rollback oid 18 current snap is 421 2026-02-12T17:44:51.201 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 18 to 338 2026-02-12T17:44:51.201 INFO:tasks.rados.rados.0.trial082.stdout:3785: finishing write tid 1 to trial08226312-50 2026-02-12T17:44:51.201 INFO:tasks.rados.rados.0.trial082.stdout:3784: expect (ObjNum 1273 snap 417 seq_num 1273) 2026-02-12T17:44:51.240 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:51.316 INFO:tasks.rados.rados.0.trial082.stdout:3785: finishing write tid 2 to trial08226312-50 2026-02-12T17:44:51.316 INFO:tasks.rados.rados.0.trial082.stdout:3784: done (7 left) 2026-02-12T17:44:51.316 INFO:tasks.rados.rados.0.trial082.stdout:3792: rollback oid 32 current snap is 421 2026-02-12T17:44:51.316 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 399 2026-02-12T17:44:51.316 INFO:tasks.rados.rados.0.trial082.stdout:3785: finishing write tid 3 to trial08226312-50 2026-02-12T17:44:51.316 INFO:tasks.rados.rados.0.trial082.stdout:3785: finishing write tid 4 to trial08226312-50 2026-02-12T17:44:51.316 INFO:tasks.rados.rados.0.trial082.stdout:3785: finishing write tid 5 to trial08226312-50 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:3785: oid 50 updating version 0 to 2442 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:3785: oid 50 version 2442 is already newer than 2440 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:3785: oid 50 version 2442 is already newer than 2441 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:3785: oid 50 updating version 2442 to 2443 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 2443 (ObjNum 1282 snap 421 seq_num 1282) dirty exists 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:3785: left oid 50 (ObjNum 1282 snap 421 seq_num 1282) 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:3787: finishing write tid 1 to trial08226312-30 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:3787: finishing write tid 2 to trial08226312-30 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:3791: finishing rollback tid 1 to trial08226312-18 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:3791: finishing rollback tid 2 to trial08226312-18 2026-02-12T17:44:51.317 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 2425 (ObjNum 1007 snap 314 seq_num 1007) dirty exists 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3787: finishing write tid 3 to trial08226312-30 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3787: finishing write tid 4 to trial08226312-30 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3787: finishing write tid 5 to trial08226312-30 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3787: oid 30 updating version 0 to 2507 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3787: oid 30 version 2507 is already newer than 2505 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3787: oid 30 version 2507 is already newer than 2504 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3787: oid 30 version 2507 is already newer than 2506 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2507 (ObjNum 1283 snap 421 seq_num 1283) dirty exists 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3787: left oid 30 (ObjNum 1283 snap 421 seq_num 1283) 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3785: done (7 left) 2026-02-12T17:44:51.318 INFO:tasks.rados.rados.0.trial082.stdout:3786: done (6 left) 2026-02-12T17:44:51.319 INFO:tasks.rados.rados.0.trial082.stdout:3787: done (5 left) 2026-02-12T17:44:51.319 INFO:tasks.rados.rados.0.trial082.stdout:3788: done (4 left) 2026-02-12T17:44:51.319 INFO:tasks.rados.rados.0.trial082.stdout:3791: done (3 left) 2026-02-12T17:44:51.319 INFO:tasks.rados.rados.0.trial082.stdout:3793: read oid 37 snap 410 2026-02-12T17:44:51.319 INFO:tasks.rados.rados.0.trial082.stdout:3793: expect (ObjNum 1220 snap 393 seq_num 1220) 2026-02-12T17:44:51.319 INFO:tasks.rados.rados.0.trial082.stdout:3794: delete oid 1 current snap is 421 2026-02-12T17:44:51.319 INFO:tasks.rados.rados.0.trial082.stdout:3789: expect (ObjNum 1248 snap 408 seq_num 1248) 2026-02-12T17:44:51.319 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:51.454 INFO:tasks.rados.rados.0.trial082.stdout:3789: done (4 left) 2026-02-12T17:44:51.454 INFO:tasks.rados.rados.0.trial082.stdout:3794: done (3 left) 2026-02-12T17:44:51.455 INFO:tasks.rados.rados.0.trial082.stdout:3795: snap_create 2026-02-12T17:44:51.455 INFO:tasks.rados.rados.0.trial082.stdout:3790: expect (ObjNum 1044 snap 325 seq_num 1044) 2026-02-12T17:44:51.497 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2321283 2026-02-12T17:44:51.505 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:51.535 INFO:tasks.rados.rados.0.trial082.stdout:3792: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:44:51.535 INFO:tasks.rados.rados.0.trial082.stdout:3792: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:44:51.535 INFO:tasks.rados.rados.0.trial082.stdout:3792: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:44:51.535 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 2464 (ObjNum 1137 snap 356 seq_num 1137) dirty exists 2026-02-12T17:44:51.535 INFO:tasks.rados.rados.0.trial082.stdout:3793: expect (ObjNum 1220 snap 393 seq_num 1220) 2026-02-12T17:44:51.594 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 335550 2026-02-12T17:44:52.179 INFO:tasks.rados.rados.0.trial082.stdout:3790: done (3 left) 2026-02-12T17:44:52.180 INFO:tasks.rados.rados.0.trial082.stdout:3792: done (2 left) 2026-02-12T17:44:52.180 INFO:tasks.rados.rados.0.trial082.stdout:3793: done (1 left) 2026-02-12T17:44:52.180 INFO:tasks.rados.rados.0.trial082.stdout:3795: done (0 left) 2026-02-12T17:44:52.180 INFO:tasks.rados.rados.0.trial082.stdout:3796: write oid 30 current snap is 422 2026-02-12T17:44:52.180 INFO:tasks.rados.rados.0.trial082.stdout:3796: seq_num 1285 ranges {796995=758622,2161832=732447} 2026-02-12T17:44:52.185 INFO:tasks.rados.rados.0.trial082.stdout:3796: writing trial08226312-30 from 796995 to 1555617 tid 1 2026-02-12T17:44:52.190 INFO:tasks.rados.rados.0.trial082.stdout:3796: writing trial08226312-30 from 2161832 to 2894279 tid 2 2026-02-12T17:44:52.190 INFO:tasks.rados.rados.0.trial082.stdout:3797: write oid 29 current snap is 422 2026-02-12T17:44:52.190 INFO:tasks.rados.rados.0.trial082.stdout:3797: seq_num 1286 ranges {413802=433871,1420314=476105,2482204=790985} 2026-02-12T17:44:52.193 INFO:tasks.rados.rados.0.trial082.stdout:3797: writing trial08226312-29 from 413802 to 847673 tid 1 2026-02-12T17:44:52.197 INFO:tasks.rados.rados.0.trial082.stdout:3797: writing trial08226312-29 from 1420314 to 1896419 tid 2 2026-02-12T17:44:52.203 INFO:tasks.rados.rados.0.trial082.stdout:3797: writing trial08226312-29 from 2482204 to 3273189 tid 3 2026-02-12T17:44:52.203 INFO:tasks.rados.rados.0.trial082.stdout:3798: snap_create 2026-02-12T17:44:52.203 INFO:tasks.rados.rados.0.trial082.stdout:3796: finishing write tid 1 to trial08226312-30 2026-02-12T17:44:52.203 INFO:tasks.rados.rados.0.trial082.stdout:3796: finishing write tid 2 to trial08226312-30 2026-02-12T17:44:52.203 INFO:tasks.rados.rados.0.trial082.stdout:3796: finishing write tid 3 to trial08226312-30 2026-02-12T17:44:52.203 INFO:tasks.rados.rados.0.trial082.stdout:3796: finishing write tid 4 to trial08226312-30 2026-02-12T17:44:52.203 INFO:tasks.rados.rados.0.trial082.stdout:3796: oid 30 updating version 0 to 2510 2026-02-12T17:44:52.204 INFO:tasks.rados.rados.0.trial082.stdout:3796: oid 30 version 2510 is already newer than 2509 2026-02-12T17:44:52.204 INFO:tasks.rados.rados.0.trial082.stdout:3796: oid 30 version 2510 is already newer than 2508 2026-02-12T17:44:52.204 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2510 (ObjNum 1285 snap 422 seq_num 1285) dirty exists 2026-02-12T17:44:52.204 INFO:tasks.rados.rados.0.trial082.stdout:3796: left oid 30 (ObjNum 1285 snap 422 seq_num 1285) 2026-02-12T17:44:52.204 INFO:tasks.rados.rados.0.trial082.stdout:3797: finishing write tid 1 to trial08226312-29 2026-02-12T17:44:52.204 INFO:tasks.rados.rados.0.trial082.stdout:3797: finishing write tid 2 to trial08226312-29 2026-02-12T17:44:52.205 INFO:tasks.rados.rados.0.trial082.stdout:3797: finishing write tid 3 to trial08226312-29 2026-02-12T17:44:52.205 INFO:tasks.rados.rados.0.trial082.stdout:3797: finishing write tid 4 to trial08226312-29 2026-02-12T17:44:52.205 INFO:tasks.rados.rados.0.trial082.stdout:3797: finishing write tid 5 to trial08226312-29 2026-02-12T17:44:52.205 INFO:tasks.rados.rados.0.trial082.stdout:3797: oid 29 updating version 0 to 2446 2026-02-12T17:44:52.205 INFO:tasks.rados.rados.0.trial082.stdout:3797: oid 29 version 2446 is already newer than 2444 2026-02-12T17:44:52.205 INFO:tasks.rados.rados.0.trial082.stdout:3797: oid 29 updating version 2446 to 2447 2026-02-12T17:44:52.205 INFO:tasks.rados.rados.0.trial082.stdout:3797: oid 29 version 2447 is already newer than 2445 2026-02-12T17:44:52.205 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2447 (ObjNum 1286 snap 422 seq_num 1286) dirty exists 2026-02-12T17:44:52.206 INFO:tasks.rados.rados.0.trial082.stdout:3797: left oid 29 (ObjNum 1286 snap 422 seq_num 1286) 2026-02-12T17:44:53.133 INFO:tasks.rados.rados.0.trial082.stdout:3796: done (2 left) 2026-02-12T17:44:53.133 INFO:tasks.rados.rados.0.trial082.stdout:3797: done (1 left) 2026-02-12T17:44:53.133 INFO:tasks.rados.rados.0.trial082.stdout:3798: done (0 left) 2026-02-12T17:44:53.133 INFO:tasks.rados.rados.0.trial082.stdout:3799: write oid 35 current snap is 423 2026-02-12T17:44:53.133 INFO:tasks.rados.rados.0.trial082.stdout:3799: seq_num 1287 ranges {430609=509120,1478796=736116,2909627=602257} 2026-02-12T17:44:53.136 INFO:tasks.rados.rados.0.trial082.stdout:3799: writing trial08226312-35 from 430609 to 939729 tid 1 2026-02-12T17:44:53.141 INFO:tasks.rados.rados.0.trial082.stdout:3799: writing trial08226312-35 from 1478796 to 2214912 tid 2 2026-02-12T17:44:53.147 INFO:tasks.rados.rados.0.trial082.stdout:3799: writing trial08226312-35 from 2909627 to 3511884 tid 3 2026-02-12T17:44:53.147 INFO:tasks.rados.rados.0.trial082.stdout:3800: rollback oid 44 current snap is 423 2026-02-12T17:44:53.147 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 369 2026-02-12T17:44:53.147 INFO:tasks.rados.rados.0.trial082.stdout:3799: finishing write tid 1 to trial08226312-35 2026-02-12T17:44:53.147 INFO:tasks.rados.rados.0.trial082.stdout:3799: finishing write tid 2 to trial08226312-35 2026-02-12T17:44:53.147 INFO:tasks.rados.rados.0.trial082.stdout:3801: read oid 50 snap 418 2026-02-12T17:44:53.147 INFO:tasks.rados.rados.0.trial082.stdout:3801: expect (ObjNum 1269 snap 416 seq_num 1269) 2026-02-12T17:44:53.147 INFO:tasks.rados.rados.0.trial082.stdout:3802: read oid 32 snap -1 2026-02-12T17:44:53.147 INFO:tasks.rados.rados.0.trial082.stdout:3802: expect (ObjNum 1137 snap 356 seq_num 1137) 2026-02-12T17:44:53.148 INFO:tasks.rados.rados.0.trial082.stdout:3803: snap_create 2026-02-12T17:44:53.150 INFO:tasks.rados.rados.0.trial082.stdout:3799: finishing write tid 3 to trial08226312-35 2026-02-12T17:44:53.150 INFO:tasks.rados.rados.0.trial082.stdout:3799: finishing write tid 4 to trial08226312-35 2026-02-12T17:44:53.150 INFO:tasks.rados.rados.0.trial082.stdout:3799: finishing write tid 5 to trial08226312-35 2026-02-12T17:44:53.150 INFO:tasks.rados.rados.0.trial082.stdout:3799: oid 35 updating version 0 to 2750 2026-02-12T17:44:53.150 INFO:tasks.rados.rados.0.trial082.stdout:3799: oid 35 updating version 2750 to 2751 2026-02-12T17:44:53.150 INFO:tasks.rados.rados.0.trial082.stdout:3799: oid 35 version 2751 is already newer than 2749 2026-02-12T17:44:53.150 INFO:tasks.rados.rados.0.trial082.stdout:3799: oid 35 version 2751 is already newer than 2748 2026-02-12T17:44:53.151 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 2751 (ObjNum 1287 snap 423 seq_num 1287) dirty exists 2026-02-12T17:44:53.151 INFO:tasks.rados.rados.0.trial082.stdout:3799: left oid 35 (ObjNum 1287 snap 423 seq_num 1287) 2026-02-12T17:44:53.151 INFO:tasks.rados.rados.0.trial082.stdout:3800: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:44:53.151 INFO:tasks.rados.rados.0.trial082.stdout:3800: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:44:53.151 INFO:tasks.rados.rados.0.trial082.stdout:3800: finishing rollback tid 2 to trial08226312-44 2026-02-12T17:44:53.151 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2754 (ObjNum 851 snap 268 seq_num 851) dirty exists 2026-02-12T17:44:53.151 INFO:tasks.rados.rados.0.trial082.stdout:3801: expect (ObjNum 1269 snap 416 seq_num 1269) 2026-02-12T17:44:53.239 INFO:tasks.rados.rados.0.trial082.stdout:3802: expect (ObjNum 1137 snap 356 seq_num 1137) 2026-02-12T17:44:53.241 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1593927 2026-02-12T17:44:53.278 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:54.136 INFO:tasks.rados.rados.0.trial082.stdout:3799: done (4 left) 2026-02-12T17:44:54.136 INFO:tasks.rados.rados.0.trial082.stdout:3800: done (3 left) 2026-02-12T17:44:54.136 INFO:tasks.rados.rados.0.trial082.stdout:3801: done (2 left) 2026-02-12T17:44:54.136 INFO:tasks.rados.rados.0.trial082.stdout:3802: done (1 left) 2026-02-12T17:44:54.136 INFO:tasks.rados.rados.0.trial082.stdout:3803: done (0 left) 2026-02-12T17:44:54.136 INFO:tasks.rados.rados.0.trial082.stdout:3804: write (excl) oid 31 current snap is 424 2026-02-12T17:44:54.136 INFO:tasks.rados.rados.0.trial082.stdout:3804: seq_num 1288 ranges {447416=584369,1537278=479774,2537050=529882,3524784=122632} 2026-02-12T17:44:54.140 INFO:tasks.rados.rados.0.trial082.stdout:3804: writing trial08226312-31 from 447416 to 1031785 tid 1 2026-02-12T17:44:54.144 INFO:tasks.rados.rados.0.trial082.stdout:3804: writing trial08226312-31 from 1537278 to 2017052 tid 2 2026-02-12T17:44:54.148 INFO:tasks.rados.rados.0.trial082.stdout:3804: writing trial08226312-31 from 2537050 to 3066932 tid 3 2026-02-12T17:44:54.150 INFO:tasks.rados.rados.0.trial082.stdout:3804: writing trial08226312-31 from 3524784 to 3647416 tid 4 2026-02-12T17:44:54.150 INFO:tasks.rados.rados.0.trial082.stdout:3805: snap_remove snap 389 2026-02-12T17:44:55.135 INFO:tasks.rados.rados.0.trial082.stdout:3805: done (1 left) 2026-02-12T17:44:55.136 INFO:tasks.rados.rados.0.trial082.stdout:3806: snap_remove snap 400 2026-02-12T17:44:56.137 INFO:tasks.rados.rados.0.trial082.stdout:3806: done (1 left) 2026-02-12T17:44:56.137 INFO:tasks.rados.rados.0.trial082.stdout:3807: write oid 23 current snap is 424 2026-02-12T17:44:56.137 INFO:tasks.rados.rados.0.trial082.stdout:3807: seq_num 1289 ranges {464223=659618,1879407=739785,3248120=416103} 2026-02-12T17:44:56.141 INFO:tasks.rados.rados.0.trial082.stdout:3807: writing trial08226312-23 from 464223 to 1123841 tid 1 2026-02-12T17:44:56.147 INFO:tasks.rados.rados.0.trial082.stdout:3807: writing trial08226312-23 from 1879407 to 2619192 tid 2 2026-02-12T17:44:56.151 INFO:tasks.rados.rados.0.trial082.stdout:3807: writing trial08226312-23 from 3248120 to 3664223 tid 3 2026-02-12T17:44:56.152 INFO:tasks.rados.rados.0.trial082.stdout:3808: write oid 50 current snap is 424 2026-02-12T17:44:56.152 INFO:tasks.rados.rados.0.trial082.stdout:3808: seq_num 1290 ranges {481030=734867,1937889=483443,2875543=552426} 2026-02-12T17:44:56.156 INFO:tasks.rados.rados.0.trial082.stdout:3808: writing trial08226312-50 from 481030 to 1215897 tid 1 2026-02-12T17:44:56.160 INFO:tasks.rados.rados.0.trial082.stdout:3808: writing trial08226312-50 from 1937889 to 2421332 tid 2 2026-02-12T17:44:56.164 INFO:tasks.rados.rados.0.trial082.stdout:3808: writing trial08226312-50 from 2875543 to 3427969 tid 3 2026-02-12T17:44:56.164 INFO:tasks.rados.rados.0.trial082.stdout:3809: write oid 46 current snap is 424 2026-02-12T17:44:56.164 INFO:tasks.rados.rados.0.trial082.stdout:3809: seq_num 1291 ranges {497837=410116,1596371=743454,2902966=763698} 2026-02-12T17:44:56.167 INFO:tasks.rados.rados.0.trial082.stdout:3809: writing trial08226312-46 from 497837 to 907953 tid 1 2026-02-12T17:44:56.173 INFO:tasks.rados.rados.0.trial082.stdout:3809: writing trial08226312-46 from 1596371 to 2339825 tid 2 2026-02-12T17:44:56.178 INFO:tasks.rados.rados.0.trial082.stdout:3809: writing trial08226312-46 from 2902966 to 3666664 tid 3 2026-02-12T17:44:56.178 INFO:tasks.rados.rados.0.trial082.stdout:3810: write (excl) oid 40 current snap is 424 2026-02-12T17:44:56.178 INFO:tasks.rados.rados.0.trial082.stdout:3810: seq_num 1292 ranges {514644=485365,1654853=487112,2930389=574970} 2026-02-12T17:44:56.181 INFO:tasks.rados.rados.0.trial082.stdout:3810: writing trial08226312-40 from 514644 to 1000009 tid 1 2026-02-12T17:44:56.186 INFO:tasks.rados.rados.0.trial082.stdout:3810: writing trial08226312-40 from 1654853 to 2141965 tid 2 2026-02-12T17:44:56.191 INFO:tasks.rados.rados.0.trial082.stdout:3810: writing trial08226312-40 from 2930389 to 3505359 tid 3 2026-02-12T17:44:56.191 INFO:tasks.rados.rados.0.trial082.stdout:3811: delete oid 30 current snap is 424 2026-02-12T17:44:56.191 INFO:tasks.rados.rados.0.trial082.stdout:3804: finishing write tid 1 to trial08226312-31 2026-02-12T17:44:56.191 INFO:tasks.rados.rados.0.trial082.stdout:3804: finishing write tid 2 to trial08226312-31 2026-02-12T17:44:56.191 INFO:tasks.rados.rados.0.trial082.stdout:3804: finishing write tid 3 to trial08226312-31 2026-02-12T17:44:56.191 INFO:tasks.rados.rados.0.trial082.stdout:3804: finishing write tid 4 to trial08226312-31 2026-02-12T17:44:56.191 INFO:tasks.rados.rados.0.trial082.stdout:3804: finishing write tid 5 to trial08226312-31 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3804: finishing write tid 6 to trial08226312-31 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3804: oid 31 updating version 0 to 2287 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3804: oid 31 updating version 2287 to 2288 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3804: oid 31 version 2288 is already newer than 2286 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3804: oid 31 updating version 2288 to 2289 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3804: oid 31 version 2289 is already newer than 2285 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 2289 (ObjNum 1288 snap 424 seq_num 1288) dirty exists 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3804: left oid 31 (ObjNum 1288 snap 424 seq_num 1288) 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: finishing write tid 1 to trial08226312-23 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: finishing write tid 2 to trial08226312-23 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: finishing write tid 3 to trial08226312-23 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: finishing write tid 4 to trial08226312-23 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: finishing write tid 5 to trial08226312-23 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: oid 23 updating version 0 to 2755 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: oid 23 updating version 2755 to 2757 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: oid 23 updating version 2757 to 2758 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: oid 23 version 2758 is already newer than 2756 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 2758 (ObjNum 1289 snap 424 seq_num 1289) dirty exists 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3807: left oid 23 (ObjNum 1289 snap 424 seq_num 1289) 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3808: finishing write tid 1 to trial08226312-50 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3808: finishing write tid 2 to trial08226312-50 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3808: finishing write tid 3 to trial08226312-50 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3808: finishing write tid 4 to trial08226312-50 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3808: finishing write tid 5 to trial08226312-50 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3808: oid 50 updating version 0 to 2450 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3808: oid 50 version 2450 is already newer than 2448 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3808: oid 50 updating version 2450 to 2451 2026-02-12T17:44:56.192 INFO:tasks.rados.rados.0.trial082.stdout:3808: oid 50 version 2451 is already newer than 2449 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 2451 (ObjNum 1290 snap 424 seq_num 1290) dirty exists 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3808: left oid 50 (ObjNum 1290 snap 424 seq_num 1290) 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: finishing write tid 1 to trial08226312-46 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: finishing write tid 2 to trial08226312-46 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: finishing write tid 3 to trial08226312-46 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: finishing write tid 4 to trial08226312-46 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: finishing write tid 5 to trial08226312-46 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: oid 46 updating version 0 to 2365 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: oid 46 updating version 2365 to 2367 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: oid 46 updating version 2367 to 2368 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: oid 46 version 2368 is already newer than 2366 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 2368 (ObjNum 1291 snap 424 seq_num 1291) dirty exists 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: left oid 46 (ObjNum 1291 snap 424 seq_num 1291) 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3810: finishing write tid 1 to trial08226312-40 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3810: finishing write tid 2 to trial08226312-40 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3804: done (5 left) 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3807: done (4 left) 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3808: done (3 left) 2026-02-12T17:44:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3809: done (2 left) 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3811: done (1 left) 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3812: snap_create 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3810: finishing write tid 3 to trial08226312-40 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3810: finishing write tid 4 to trial08226312-40 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3810: finishing write tid 5 to trial08226312-40 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3810: oid 40 updating version 0 to 2465 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3810: oid 40 updating version 2465 to 2468 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3810: oid 40 version 2468 is already newer than 2467 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3810: oid 40 version 2468 is already newer than 2466 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 2468 (ObjNum 1292 snap 424 seq_num 1292) dirty exists 2026-02-12T17:44:56.194 INFO:tasks.rados.rados.0.trial082.stdout:3810: left oid 40 (ObjNum 1292 snap 424 seq_num 1292) 2026-02-12T17:44:57.144 INFO:tasks.rados.rados.0.trial082.stdout:3810: done (1 left) 2026-02-12T17:44:57.144 INFO:tasks.rados.rados.0.trial082.stdout:3812: done (0 left) 2026-02-12T17:44:57.145 INFO:tasks.rados.rados.0.trial082.stdout:3813: copy_from oid 1 from oid 26 current snap is 425 2026-02-12T17:44:57.145 INFO:tasks.rados.rados.0.trial082.stdout:3814: rollback oid 24 current snap is 425 2026-02-12T17:44:57.145 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 24 to 420 2026-02-12T17:44:57.145 INFO:tasks.rados.rados.0.trial082.stdout:3815: read oid 45 snap -1 2026-02-12T17:44:57.145 INFO:tasks.rados.rados.0.trial082.stdout:3815: expect (ObjNum 1227 snap 394 seq_num 1227) 2026-02-12T17:44:57.145 INFO:tasks.rados.rados.0.trial082.stdout:3816: delete oid 21 current snap is 425 2026-02-12T17:44:57.146 INFO:tasks.rados.rados.0.trial082.stdout:3816: done (3 left) 2026-02-12T17:44:57.147 INFO:tasks.rados.rados.0.trial082.stdout:3817: snap_remove snap 369 2026-02-12T17:44:58.148 INFO:tasks.rados.rados.0.trial082.stdout:3817: done (3 left) 2026-02-12T17:44:58.148 INFO:tasks.rados.rados.0.trial082.stdout:3818: read oid 16 snap -1 2026-02-12T17:44:58.149 INFO:tasks.rados.rados.0.trial082.stdout:3818: expect (ObjNum 1277 snap 418 seq_num 1277) 2026-02-12T17:44:58.149 INFO:tasks.rados.rados.0.trial082.stdout:3819: rollback oid 44 current snap is 425 2026-02-12T17:44:58.149 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 386 2026-02-12T17:44:58.149 INFO:tasks.rados.rados.0.trial082.stdout:3815: expect (ObjNum 1227 snap 394 seq_num 1227) 2026-02-12T17:44:58.187 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:58.263 INFO:tasks.rados.rados.0.trial082.stdout:3814: finishing rollback tid 0 to trial08226312-24 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:3815: done (4 left) 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:3820: read oid 41 snap -1 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:3820: expect (ObjNum 1231 snap 394 seq_num 1231) 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:3821: snap_create 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:3814: finishing rollback tid 1 to trial08226312-24 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:3814: finishing rollback tid 2 to trial08226312-24 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 2993 (ObjNum 1194 snap 382 seq_num 1194) dirty exists 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:3813: finishing copy_from racing read to trial08226312-1 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:3813: finishing copy_from to trial08226312-1 2026-02-12T17:44:58.264 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2730 (ObjNum 1231 snap 394 seq_num 1231) dirty exists 2026-02-12T17:44:58.265 INFO:tasks.rados.rados.0.trial082.stdout:3819: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:44:58.265 INFO:tasks.rados.rados.0.trial082.stdout:3819: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:44:58.265 INFO:tasks.rados.rados.0.trial082.stdout:3819: finishing rollback tid 2 to trial08226312-44 2026-02-12T17:44:58.265 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2761 (ObjNum 1141 snap 359 seq_num 1141) dirty exists 2026-02-12T17:44:58.265 INFO:tasks.rados.rados.0.trial082.stdout:3818: expect (ObjNum 1277 snap 418 seq_num 1277) 2026-02-12T17:44:58.372 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2483647 2026-02-12T17:44:58.386 INFO:tasks.rados.rados.0.trial082.stdout:3820: expect (ObjNum 1231 snap 394 seq_num 1231) 2026-02-12T17:44:58.387 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:44:58.468 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1720089 2026-02-12T17:44:59.153 INFO:tasks.rados.rados.0.trial082.stdout:3813: done (5 left) 2026-02-12T17:44:59.153 INFO:tasks.rados.rados.0.trial082.stdout:3814: done (4 left) 2026-02-12T17:44:59.153 INFO:tasks.rados.rados.0.trial082.stdout:3818: done (3 left) 2026-02-12T17:44:59.153 INFO:tasks.rados.rados.0.trial082.stdout:3819: done (2 left) 2026-02-12T17:44:59.153 INFO:tasks.rados.rados.0.trial082.stdout:3820: done (1 left) 2026-02-12T17:44:59.153 INFO:tasks.rados.rados.0.trial082.stdout:3821: done (0 left) 2026-02-12T17:44:59.153 INFO:tasks.rados.rados.0.trial082.stdout:3822: write oid 29 current snap is 426 2026-02-12T17:44:59.153 INFO:tasks.rados.rados.0.trial082.stdout:3822: seq_num 1295 ranges {565065=427465,1430299=634439,2496305=525139,3472104=292961} 2026-02-12T17:44:59.156 INFO:tasks.rados.rados.0.trial082.stdout:3822: writing trial08226312-29 from 565065 to 992530 tid 1 2026-02-12T17:44:59.160 INFO:tasks.rados.rados.0.trial082.stdout:3822: writing trial08226312-29 from 1430299 to 2064738 tid 2 2026-02-12T17:44:59.163 INFO:tasks.rados.rados.0.trial082.stdout:3822: writing trial08226312-29 from 2496305 to 3021444 tid 3 2026-02-12T17:44:59.167 INFO:tasks.rados.rados.0.trial082.stdout:3822: writing trial08226312-29 from 3472104 to 3765065 tid 4 2026-02-12T17:44:59.167 INFO:tasks.rados.rados.0.trial082.stdout:3822: finishing write tid 1 to trial08226312-29 2026-02-12T17:44:59.167 INFO:tasks.rados.rados.0.trial082.stdout:3822: finishing write tid 2 to trial08226312-29 2026-02-12T17:44:59.167 INFO:tasks.rados.rados.0.trial082.stdout:3822: finishing write tid 3 to trial08226312-29 2026-02-12T17:44:59.167 INFO:tasks.rados.rados.0.trial082.stdout:3823: read oid 18 snap -1 2026-02-12T17:44:59.167 INFO:tasks.rados.rados.0.trial082.stdout:3823: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:44:59.167 INFO:tasks.rados.rados.0.trial082.stdout:3824: write oid 17 current snap is 426 2026-02-12T17:44:59.167 INFO:tasks.rados.rados.0.trial082.stdout:3824: seq_num 1296 ranges {581872=502714,1488781=494450,2640081=736411} 2026-02-12T17:44:59.170 INFO:tasks.rados.rados.0.trial082.stdout:3824: writing trial08226312-17 from 581872 to 1084586 tid 1 2026-02-12T17:44:59.174 INFO:tasks.rados.rados.0.trial082.stdout:3824: writing trial08226312-17 from 1488781 to 1983231 tid 2 2026-02-12T17:44:59.180 INFO:tasks.rados.rados.0.trial082.stdout:3824: writing trial08226312-17 from 2640081 to 3376492 tid 3 2026-02-12T17:44:59.180 INFO:tasks.rados.rados.0.trial082.stdout:3825: read oid 32 snap -1 2026-02-12T17:44:59.180 INFO:tasks.rados.rados.0.trial082.stdout:3825: expect (ObjNum 1137 snap 356 seq_num 1137) 2026-02-12T17:44:59.180 INFO:tasks.rados.rados.0.trial082.stdout:3826: delete oid 33 current snap is 426 2026-02-12T17:44:59.180 INFO:tasks.rados.rados.0.trial082.stdout:3822: finishing write tid 4 to trial08226312-29 2026-02-12T17:44:59.180 INFO:tasks.rados.rados.0.trial082.stdout:3822: finishing write tid 5 to trial08226312-29 2026-02-12T17:44:59.180 INFO:tasks.rados.rados.0.trial082.stdout:3822: finishing write tid 6 to trial08226312-29 2026-02-12T17:44:59.180 INFO:tasks.rados.rados.0.trial082.stdout:3822: oid 29 updating version 0 to 2454 2026-02-12T17:44:59.180 INFO:tasks.rados.rados.0.trial082.stdout:3822: oid 29 updating version 2454 to 2456 2026-02-12T17:44:59.181 INFO:tasks.rados.rados.0.trial082.stdout:3822: oid 29 version 2456 is already newer than 2452 2026-02-12T17:44:59.181 INFO:tasks.rados.rados.0.trial082.stdout:3822: oid 29 version 2456 is already newer than 2455 2026-02-12T17:44:59.181 INFO:tasks.rados.rados.0.trial082.stdout:3822: oid 29 version 2456 is already newer than 2453 2026-02-12T17:44:59.181 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 29 v 2456 (ObjNum 1295 snap 426 seq_num 1295) dirty exists 2026-02-12T17:44:59.181 INFO:tasks.rados.rados.0.trial082.stdout:3822: left oid 29 (ObjNum 1295 snap 426 seq_num 1295) 2026-02-12T17:44:59.181 INFO:tasks.rados.rados.0.trial082.stdout:3823: expect (ObjNum 1007 snap 314 seq_num 1007) 2026-02-12T17:44:59.211 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1577267 2026-02-12T17:44:59.250 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2680024 2026-02-12T17:44:59.256 INFO:tasks.rados.rados.0.trial082.stdout:3824: finishing write tid 1 to trial08226312-17 2026-02-12T17:44:59.256 INFO:tasks.rados.rados.0.trial082.stdout:3824: finishing write tid 2 to trial08226312-17 2026-02-12T17:44:59.256 INFO:tasks.rados.rados.0.trial082.stdout:3824: finishing write tid 3 to trial08226312-17 2026-02-12T17:44:59.256 INFO:tasks.rados.rados.0.trial082.stdout:3824: finishing write tid 4 to trial08226312-17 2026-02-12T17:44:59.256 INFO:tasks.rados.rados.0.trial082.stdout:3822: done (4 left) 2026-02-12T17:44:59.256 INFO:tasks.rados.rados.0.trial082.stdout:3823: done (3 left) 2026-02-12T17:44:59.256 INFO:tasks.rados.rados.0.trial082.stdout:3826: done (2 left) 2026-02-12T17:44:59.256 INFO:tasks.rados.rados.0.trial082.stdout:3827: snap_remove snap 417 2026-02-12T17:45:00.154 INFO:tasks.rados.rados.0.trial082.stdout:3827: done (2 left) 2026-02-12T17:45:00.154 INFO:tasks.rados.rados.0.trial082.stdout:3828: read oid 30 snap -1 2026-02-12T17:45:00.154 INFO:tasks.rados.rados.0.trial082.stdout:3828: expect deleted 2026-02-12T17:45:00.154 INFO:tasks.rados.rados.0.trial082.stdout:3829: snap_remove snap 422 2026-02-12T17:45:01.155 INFO:tasks.rados.rados.0.trial082.stdout:3829: done (3 left) 2026-02-12T17:45:01.155 INFO:tasks.rados.rados.0.trial082.stdout:3830: copy_from oid 12 from oid 43 current snap is 426 2026-02-12T17:45:01.156 INFO:tasks.rados.rados.0.trial082.stdout:3825: expect (ObjNum 1137 snap 356 seq_num 1137) 2026-02-12T17:45:01.164 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2269853 2026-02-12T17:45:01.175 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1165905 2026-02-12T17:45:01.204 INFO:tasks.rados.rados.0.trial082.stdout:3824: finishing write tid 5 to trial08226312-17 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3824: oid 17 updating version 0 to 3005 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3824: oid 17 version 3005 is already newer than 3004 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3824: oid 17 updating version 3005 to 3007 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3824: oid 17 version 3007 is already newer than 3006 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 3007 (ObjNum 1296 snap 426 seq_num 1296) dirty exists 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3824: left oid 17 (ObjNum 1296 snap 426 seq_num 1296) 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3824: done (3 left) 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3825: done (2 left) 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3828: done (1 left) 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3831: delete oid 27 current snap is 426 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3830: finishing copy_from racing read to trial08226312-12 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:3830: finishing copy_from to trial08226312-12 2026-02-12T17:45:01.205 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 12 v 2496 (ObjNum 1248 snap 408 seq_num 1248) dirty exists 2026-02-12T17:45:01.207 INFO:tasks.rados.rados.0.trial082.stdout:3830: done (1 left) 2026-02-12T17:45:01.207 INFO:tasks.rados.rados.0.trial082.stdout:3831: done (0 left) 2026-02-12T17:45:01.207 INFO:tasks.rados.rados.0.trial082.stdout:3832: write oid 46 current snap is 426 2026-02-12T17:45:01.207 INFO:tasks.rados.rados.0.trial082.stdout:3832: seq_num 1299 ranges {632293=728461,1947874=641777,3005997=686580} 2026-02-12T17:45:01.211 INFO:tasks.rados.rados.0.trial082.stdout:3832: writing trial08226312-46 from 632293 to 1360754 tid 1 2026-02-12T17:45:01.216 INFO:tasks.rados.rados.0.trial082.stdout:3832: writing trial08226312-46 from 1947874 to 2589651 tid 2 2026-02-12T17:45:01.221 INFO:tasks.rados.rados.0.trial082.stdout:3832: writing trial08226312-46 from 3005997 to 3692577 tid 3 2026-02-12T17:45:01.221 INFO:tasks.rados.rados.0.trial082.stdout:3833: read oid 20 snap 342 2026-02-12T17:45:01.222 INFO:tasks.rados.rados.0.trial082.stdout:3833: expect deleted 2026-02-12T17:45:01.222 INFO:tasks.rados.rados.0.trial082.stdout:3834: delete oid 15 current snap is 426 2026-02-12T17:45:01.222 INFO:tasks.rados.rados.0.trial082.stdout:3832: finishing write tid 1 to trial08226312-46 2026-02-12T17:45:01.222 INFO:tasks.rados.rados.0.trial082.stdout:3832: finishing write tid 2 to trial08226312-46 2026-02-12T17:45:01.223 INFO:tasks.rados.rados.0.trial082.stdout:3832: finishing write tid 3 to trial08226312-46 2026-02-12T17:45:01.223 INFO:tasks.rados.rados.0.trial082.stdout:3832: finishing write tid 4 to trial08226312-46 2026-02-12T17:45:01.223 INFO:tasks.rados.rados.0.trial082.stdout:3833: done (2 left) 2026-02-12T17:45:01.223 INFO:tasks.rados.rados.0.trial082.stdout:3834: done (1 left) 2026-02-12T17:45:01.223 INFO:tasks.rados.rados.0.trial082.stdout:3835: snap_remove snap 423 2026-02-12T17:45:02.162 INFO:tasks.rados.rados.0.trial082.stdout:3835: done (1 left) 2026-02-12T17:45:02.162 INFO:tasks.rados.rados.0.trial082.stdout:3836: delete oid 24 current snap is 426 2026-02-12T17:45:02.163 INFO:tasks.rados.rados.0.trial082.stdout:3832: finishing write tid 5 to trial08226312-46 2026-02-12T17:45:02.163 INFO:tasks.rados.rados.0.trial082.stdout:3832: oid 46 updating version 0 to 2372 2026-02-12T17:45:02.163 INFO:tasks.rados.rados.0.trial082.stdout:3832: oid 46 version 2372 is already newer than 2369 2026-02-12T17:45:02.163 INFO:tasks.rados.rados.0.trial082.stdout:3832: oid 46 version 2372 is already newer than 2371 2026-02-12T17:45:02.163 INFO:tasks.rados.rados.0.trial082.stdout:3832: oid 46 version 2372 is already newer than 2370 2026-02-12T17:45:02.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 46 v 2372 (ObjNum 1299 snap 426 seq_num 1299) dirty exists 2026-02-12T17:45:02.163 INFO:tasks.rados.rados.0.trial082.stdout:3832: left oid 46 (ObjNum 1299 snap 426 seq_num 1299) 2026-02-12T17:45:02.166 INFO:tasks.rados.rados.0.trial082.stdout:3832: done (1 left) 2026-02-12T17:45:02.166 INFO:tasks.rados.rados.0.trial082.stdout:3836: done (0 left) 2026-02-12T17:45:02.166 INFO:tasks.rados.rados.0.trial082.stdout:3837: copy_from oid 37 from oid 38 current snap is 426 2026-02-12T17:45:02.166 INFO:tasks.rados.rados.0.trial082.stdout:3838: delete oid 35 current snap is 426 2026-02-12T17:45:02.167 INFO:tasks.rados.rados.0.trial082.stdout:3837: finishing copy_from to trial08226312-37 2026-02-12T17:45:02.167 INFO:tasks.rados.rados.0.trial082.stdout:3837: got expected ENOENT (src dne) 2026-02-12T17:45:02.167 INFO:tasks.rados.rados.0.trial082.stdout:3837: finishing copy_from racing read to trial08226312-37 2026-02-12T17:45:02.167 INFO:tasks.rados.rados.0.trial082.stdout:3837: done (1 left) 2026-02-12T17:45:02.168 INFO:tasks.rados.rados.0.trial082.stdout:3838: done (0 left) 2026-02-12T17:45:02.168 INFO:tasks.rados.rados.0.trial082.stdout:3839: snap_remove snap 418 2026-02-12T17:45:03.133 INFO:tasks.rados.rados.0.trial082.stdout:3839: done (0 left) 2026-02-12T17:45:03.133 INFO:tasks.rados.rados.0.trial082.stdout:3840: rollback oid 43 current snap is 426 2026-02-12T17:45:03.133 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 43 to 390 2026-02-12T17:45:03.134 INFO:tasks.rados.rados.0.trial082.stdout:3841: snap_remove snap 424 2026-02-12T17:45:04.135 INFO:tasks.rados.rados.0.trial082.stdout:3841: done (1 left) 2026-02-12T17:45:04.136 INFO:tasks.rados.rados.0.trial082.stdout:3842: read oid 6 snap -1 2026-02-12T17:45:04.136 INFO:tasks.rados.rados.0.trial082.stdout:3842: expect (ObjNum 1272 snap 416 seq_num 1272) 2026-02-12T17:45:04.136 INFO:tasks.rados.rados.0.trial082.stdout:3843: read oid 33 snap -1 2026-02-12T17:45:04.136 INFO:tasks.rados.rados.0.trial082.stdout:3843: expect deleted 2026-02-12T17:45:04.136 INFO:tasks.rados.rados.0.trial082.stdout:3844: write oid 48 current snap is 426 2026-02-12T17:45:04.136 INFO:tasks.rados.rados.0.trial082.stdout:3844: seq_num 1303 ranges {699521=745810,2181802=649115,3515689=383832} 2026-02-12T17:45:04.141 INFO:tasks.rados.rados.0.trial082.stdout:3844: writing trial08226312-48 from 699521 to 1445331 tid 1 2026-02-12T17:45:04.146 INFO:tasks.rados.rados.0.trial082.stdout:3844: writing trial08226312-48 from 2181802 to 2830917 tid 2 2026-02-12T17:45:04.151 INFO:tasks.rados.rados.0.trial082.stdout:3844: writing trial08226312-48 from 3515689 to 3899521 tid 3 2026-02-12T17:45:04.151 INFO:tasks.rados.rados.0.trial082.stdout:3845: rollback oid 7 current snap is 426 2026-02-12T17:45:04.151 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 7 to 413 2026-02-12T17:45:04.151 INFO:tasks.rados.rados.0.trial082.stdout:3846: delete oid 2 current snap is 426 2026-02-12T17:45:04.152 INFO:tasks.rados.rados.0.trial082.stdout:3840: finishing rollback tid 0 to trial08226312-43 2026-02-12T17:45:04.152 INFO:tasks.rados.rados.0.trial082.stdout:3840: finishing rollback tid 1 to trial08226312-43 2026-02-12T17:45:04.152 INFO:tasks.rados.rados.0.trial082.stdout:3840: finishing rollback tid 2 to trial08226312-43 2026-02-12T17:45:04.152 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2515 (ObjNum 1091 snap 345 seq_num 1091) dirty exists 2026-02-12T17:45:04.152 INFO:tasks.rados.rados.0.trial082.stdout:3842: expect (ObjNum 1272 snap 416 seq_num 1272) 2026-02-12T17:45:04.206 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1281516 2026-02-12T17:45:04.292 INFO:tasks.rados.rados.0.trial082.stdout:3844: finishing write tid 1 to trial08226312-48 2026-02-12T17:45:04.292 INFO:tasks.rados.rados.0.trial082.stdout:3844: finishing write tid 2 to trial08226312-48 2026-02-12T17:45:04.292 INFO:tasks.rados.rados.0.trial082.stdout:3844: finishing write tid 3 to trial08226312-48 2026-02-12T17:45:04.292 INFO:tasks.rados.rados.0.trial082.stdout:3844: finishing write tid 4 to trial08226312-48 2026-02-12T17:45:04.292 INFO:tasks.rados.rados.0.trial082.stdout:3844: finishing write tid 5 to trial08226312-48 2026-02-12T17:45:04.292 INFO:tasks.rados.rados.0.trial082.stdout:3844: oid 48 updating version 0 to 2459 2026-02-12T17:45:04.292 INFO:tasks.rados.rados.0.trial082.stdout:3844: oid 48 version 2459 is already newer than 2458 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3844: oid 48 updating version 2459 to 2460 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3844: oid 48 version 2460 is already newer than 2457 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 2460 (ObjNum 1303 snap 426 seq_num 1303) dirty exists 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3844: left oid 48 (ObjNum 1303 snap 426 seq_num 1303) 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3845: finishing rollback tid 1 to trial08226312-7 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 7 v 2420 (ObjNum 81 snap 0 seq_num 25599648) dirty dne 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3840: done (5 left) 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3842: done (4 left) 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3843: done (3 left) 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3844: done (2 left) 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3845: done (1 left) 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3846: done (0 left) 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3847: read oid 24 snap 386 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3847: expect (ObjNum 1194 snap 382 seq_num 1194) 2026-02-12T17:45:04.293 INFO:tasks.rados.rados.0.trial082.stdout:3848: snap_remove snap 419 2026-02-12T17:45:04.533 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:45:04.534 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T17:45:04.534 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T17:45:04.534 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T17:45:04.555 INFO:tasks.ceph.mon.c:Started 2026-02-12T17:45:04.555 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:45:04.555 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:45:04.623 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.625+0000 7f8c3b25b640 10 monclient: get_monmap_and_config 2026-02-12T17:45:04.623 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.625+0000 7f8c3b25b640 10 monclient: build_initial_monmap 2026-02-12T17:45:04.623 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.625+0000 7f8c3b25b640 10 monclient: monmap: 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:04.626205+0000 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:04.626205+0000 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.625+0000 7f8c3b25b640 1 Processor -- start 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.625+0000 7f8c3b25b640 1 -- start start 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.625+0000 7f8c3b25b640 10 monclient: init 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 10 monclient(hunting): picked mon.noname-a con 0x7f8c3408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 10 monclient(hunting): picked mon.noname-b con 0x7f8c3408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 10 monclient(hunting): picked mon.noname-c con 0x7f8c3408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c3408d600 con 0x7f8c3408ae20 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c3408b1f0 con 0x7f8c3408cb30 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c3408d1f0 con 0x7f8c3408c730 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:04.625 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c3b25b640 10 monclient(hunting): authenticate will time out at 1584.445087s 2026-02-12T17:45:04.626 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c38fd0640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f8c3408ae20 0x7f8c3408c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46958/0 (socket says 10.20.193.57:46958) 2026-02-12T17:45:04.626 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.626+0000 7f8c38fd0640 1 -- 10.20.193.57:0/3448239320 learned_addr learned my addr 10.20.193.57:0/3448239320 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:04.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2bfff640 1 -- 10.20.193.57:0/3448239320 >> v1:10.20.193.57:6790/0 conn(0x7f8c3408c730 legacy=0x7f8c34181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c38fd0640 1 -- 10.20.193.57:0/3448239320 >> v1:10.20.193.57:6789/0 conn(0x7f8c3408ae20 legacy=0x7f8c3408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 -- 10.20.193.57:0/3448239320 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371531224 0 0) 0x7f8c3408d600 con 0x7f8c3408ae20 2026-02-12T17:45:04.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient(hunting): my global_id is 74445 2026-02-12T17:45:04.630 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 -- 10.20.193.57:0/3448239320 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c200035e0 con 0x7f8c3408ae20 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 -- 10.20.193.57:0/3448239320 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2521354505 0 0) 0x7f8c200035e0 con 0x7f8c3408ae20 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 -- 10.20.193.57:0/3448239320 >> v1:10.20.193.57:6790/0 conn(0x7f8c3408c730 legacy=0x7f8c34181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 -- 10.20.193.57:0/3448239320 >> v1:10.20.193.82:6789/0 conn(0x7f8c3408cb30 legacy=0x7f8c341a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 monclient: found mon.noname-a 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 -- 10.20.193.57:0/3448239320 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c34057320 con 0x7f8c3408ae20 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:04.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 -- 10.20.193.57:0/3448239320 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8c240030d0 con 0x7f8c3408ae20 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: dump: 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.632 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c3b25b640 5 monclient: authenticate success, global_id 74445 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c3b25b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 -- 10.20.193.57:0/3448239320 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c24003360 con 0x7f8c3408ae20 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 1 -- 10.20.193.57:0/3448239320 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8c24004960 con 0x7f8c3408ae20 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c2b7fe640 10 monclient: dump: 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.633 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c3b25b640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c3b25b640 4 set_mon_vals no callback set 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c3b25b640 10 monclient: shutdown 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c3b25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:04.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.628+0000 7f8c3b25b640 1 -- 10.20.193.57:0/3448239320 >> v1:10.20.193.57:6789/0 conn(0x7f8c3408ae20 legacy=0x7f8c3408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 1 -- 10.20.193.57:0/3448239320 shutdown_connections 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 1 -- 10.20.193.57:0/3448239320 >> 10.20.193.57:0/3448239320 conn(0x7f8c34091620 msgr2=0x7f8c34091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 1 -- 10.20.193.57:0/3448239320 shutdown_connections 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 1 -- 10.20.193.57:0/3448239320 wait complete. 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 10 monclient: build_initial_monmap 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 10 monclient: monmap: 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:04.635 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 1 Processor -- start 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 1 -- start start 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 10 monclient: init 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 10 monclient(hunting): picked mon.noname-b con 0x7f8c3408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 10 monclient(hunting): picked mon.noname-a con 0x7f8c3408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 10 monclient(hunting): picked mon.noname-c con 0x7f8c3408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:04.636 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.629+0000 7f8c3b25b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c3408d9c0 con 0x7f8c3408c730 2026-02-12T17:45:04.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.630+0000 7f8c3b25b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c3405cc20 con 0x7f8c3408ae20 2026-02-12T17:45:04.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.630+0000 7f8c3b25b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c3405afe0 con 0x7f8c3408cb30 2026-02-12T17:45:04.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.630+0000 7f8c3b25b640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:04.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.630+0000 7f8c3b25b640 10 monclient(hunting): authenticate will time out at 1584.449011s 2026-02-12T17:45:04.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.630+0000 7f8c2bfff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f8c3408c730 0x7f8c34191ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46972/0 (socket says 10.20.193.57:46972) 2026-02-12T17:45:04.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.630+0000 7f8c2bfff640 1 -- 10.20.193.57:0/1799868454 learned_addr learned my addr 10.20.193.57:0/1799868454 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:04.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.632+0000 7f8c2bfff640 1 -- 10.20.193.57:0/1799868454 >> v1:10.20.193.57:6789/0 conn(0x7f8c3408c730 legacy=0x7f8c34191ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.632+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:45:04.637 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.632+0000 7f8c397d1640 1 -- 10.20.193.57:0/1799868454 >> v1:10.20.193.57:6790/0 conn(0x7f8c3408cb30 legacy=0x7f8c34193610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3916205483 0 0) 0x7f8c3408d9c0 con 0x7f8c3408c730 2026-02-12T17:45:04.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient(hunting): my global_id is 74448 2026-02-12T17:45:04.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c040035e0 con 0x7f8c3408c730 2026-02-12T17:45:04.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1591561166 0 0) 0x7f8c040035e0 con 0x7f8c3408c730 2026-02-12T17:45:04.641 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c3408d9c0 con 0x7f8c3408c730 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8c1c0033f0 con 0x7f8c3408c730 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient(hunting): dump: 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.642 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1441863394 0 0) 0x7f8c3408d9c0 con 0x7f8c3408c730 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 >> v1:10.20.193.57:6790/0 conn(0x7f8c3408cb30 legacy=0x7f8c34193610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 >> v1:10.20.193.82:6789/0 conn(0x7f8c3408ae20 legacy=0x7f8c34151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient: _finish_hunting 0 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 monclient: found mon.a 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c34088810 con 0x7f8c3408c730 2026-02-12T17:45:04.643 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient: _finish_auth 0 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient: _check_auth_tickets 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c3b25b640 5 monclient: authenticate success, global_id 74448 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c3b25b640 10 monclient: _renew_subs 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c3b25b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3413f330 con 0x7f8c3408c730 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c3b25b640 10 monclient: _renew_subs 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c3b25b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8c3413de10 con 0x7f8c3408c730 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c1c0039f0 con 0x7f8c3408c730 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f8c1c003d10 con 0x7f8c3408c730 2026-02-12T17:45:04.644 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c297fa640 10 monclient: dump: 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.645 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.634+0000 7f8c2affd640 4 set_mon_vals no callback set 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.635+0000 7f8c3b25b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.635+0000 7f8c3b25b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.635+0000 7f8c3b25b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.635+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c3413ff80 con 0x7f8c3408c730 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.635+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f8c1c003f70 con 0x7f8c3408c730 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.635+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(854..854 src has 637..854) ==== 3943+0+0 (unknown 972051364 0 0) 0x7f8c1c04ed20 con 0x7f8c3408c730 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.635+0000 7f8c38fd0640 10 monclient: get_auth_request con 0x7f8c0403f700 auth_method 0 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.637+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f8c3413ff80 con 0x7f8c3408c730 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.637+0000 7f8c297fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:04.646 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.637+0000 7f8c297fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:04.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.787+0000 7f8c3b25b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:45:04.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.787+0000 7f8c3b25b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:45:04.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.787+0000 7f8c3b25b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.787+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8c3413ff80 con 0x7f8c3408c730 2026-02-12T17:45:04.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.788+0000 7f8c297fa640 1 -- 10.20.193.57:0/1799868454 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 851215054) 0x7f8c3413ff80 con 0x7f8c3408c730 2026-02-12T17:45:04.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.788+0000 7f8c297fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:45:04.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.788+0000 7f8c297fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:04.785 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:45:04.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.789+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 >> v1:10.20.193.82:6800/2441377515 conn(0x7f8c0403f700 legacy=0x7f8c0405fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.789+0000 7f8c3b25b640 10 monclient: shutdown 2026-02-12T17:45:04.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.789+0000 7f8c3b25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:04.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.789+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 >> v1:10.20.193.57:6789/0 conn(0x7f8c3408c730 legacy=0x7f8c34191ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.789+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 shutdown_connections 2026-02-12T17:45:04.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.789+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 >> 10.20.193.57:0/1799868454 conn(0x7f8c34091620 msgr2=0x7f8c34087f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:04.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.789+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 shutdown_connections 2026-02-12T17:45:04.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.789+0000 7f8c3b25b640 1 -- 10.20.193.57:0/1799868454 wait complete. 2026-02-12T17:45:04.794 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:45:04.794 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:45:04.795 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:45:04.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.864+0000 7f26ddc83640 10 monclient: get_monmap_and_config 2026-02-12T17:45:04.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.864+0000 7f26ddc83640 10 monclient: build_initial_monmap 2026-02-12T17:45:04.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.864+0000 7f26ddc83640 10 monclient: monmap: 2026-02-12T17:45:04.861 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:04.861 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.861 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:04.865310+0000 2026-02-12T17:45:04.861 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:04.865310+0000 2026-02-12T17:45:04.862 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:04.862 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.862 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:04.862 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:04.862 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:04.862 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.864+0000 7f26ddc83640 1 Processor -- start 2026-02-12T17:45:04.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.864+0000 7f26ddc83640 1 -- start start 2026-02-12T17:45:04.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.864+0000 7f26ddc83640 10 monclient: init 2026-02-12T17:45:04.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:04.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:45:04.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 10 monclient(hunting): picked mon.noname-a con 0x7f26d8091bb0 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:04.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 10 monclient(hunting): picked mon.noname-b con 0x7f26d808c5b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 10 monclient(hunting): picked mon.noname-c con 0x7f26d808c9f0 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d8087dd0 con 0x7f26d8091bb0 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d8091f80 con 0x7f26d808c9f0 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d808d420 con 0x7f26d808c5b0 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26ddc83640 10 monclient(hunting): authenticate will time out at 1584.684263s 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26dcc81640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f26d8091bb0 0x7f26d808bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:46974/0 (socket says 10.20.193.57:46974) 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.865+0000 7f26dcc81640 1 -- 10.20.193.57:0/2292095911 learned_addr learned my addr 10.20.193.57:0/2292095911 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26dcc81640 1 -- 10.20.193.57:0/2292095911 >> v1:10.20.193.57:6789/0 conn(0x7f26d8091bb0 legacy=0x7f26d808bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cffff640 1 -- 10.20.193.57:0/2292095911 >> v1:10.20.193.57:6790/0 conn(0x7f26d808c5b0 legacy=0x7f26d8181640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 1 -- 10.20.193.57:0/2292095911 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557381046 0 0) 0x7f26d8087dd0 con 0x7f26d8091bb0 2026-02-12T17:45:04.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient(hunting): my global_id is 74451 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 1 -- 10.20.193.57:0/2292095911 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26c40035e0 con 0x7f26d8091bb0 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26dd482640 1 -- 10.20.193.57:0/2292095911 >> v1:10.20.193.82:6789/0 conn(0x7f26d808c9f0 legacy=0x7f26d81a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 1 -- 10.20.193.57:0/2292095911 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1039993882 0 0) 0x7f26c40035e0 con 0x7f26d8091bb0 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 1 -- 10.20.193.57:0/2292095911 >> v1:10.20.193.57:6790/0 conn(0x7f26d808c5b0 legacy=0x7f26d8181640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 1 -- 10.20.193.57:0/2292095911 >> v1:10.20.193.82:6789/0 conn(0x7f26d808c9f0 legacy=0x7f26d81a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 1 monclient: found mon.noname-a 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:04.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 1 -- 10.20.193.57:0/2292095911 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d8088490 con 0x7f26d8091bb0 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient: _finish_auth 0 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 1 -- 10.20.193.57:0/2292095911 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f26c8003150 con 0x7f26d8091bb0 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26cf7fe640 10 monclient: dump: 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.870 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26ddc83640 5 monclient: authenticate success, global_id 74451 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.867+0000 7f26ddc83640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26cf7fe640 1 -- 10.20.193.57:0/2292095911 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26c80033a0 con 0x7f26d8091bb0 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26cf7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:04.871 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 4 set_mon_vals no callback set 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26cf7fe640 1 -- 10.20.193.57:0/2292095911 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f26c8004b10 con 0x7f26d8091bb0 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26cf7fe640 10 monclient: dump: 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.872 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 10 monclient: shutdown 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 1 -- 10.20.193.57:0/2292095911 >> v1:10.20.193.57:6789/0 conn(0x7f26d8091bb0 legacy=0x7f26d808bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 1 -- 10.20.193.57:0/2292095911 shutdown_connections 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 1 -- 10.20.193.57:0/2292095911 >> 10.20.193.57:0/2292095911 conn(0x7f26d8090410 msgr2=0x7f26d80914a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 1 -- 10.20.193.57:0/2292095911 shutdown_connections 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 1 -- 10.20.193.57:0/2292095911 wait complete. 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 10 monclient: build_initial_monmap 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.868+0000 7f26ddc83640 10 monclient: monmap: 2026-02-12T17:45:04.873 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 1 Processor -- start 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 1 -- start start 2026-02-12T17:45:04.874 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 10 monclient: init 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 10 monclient(hunting): picked mon.noname-c con 0x7f26d808c5b0 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 10 monclient(hunting): picked mon.noname-b con 0x7f26d808c9f0 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 10 monclient(hunting): picked mon.noname-a con 0x7f26d8091bb0 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d8085c10 con 0x7f26d8091bb0 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d80589f0 con 0x7f26d808c9f0 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d8088690 con 0x7f26d808c5b0 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26ddc83640 10 monclient(hunting): authenticate will time out at 1584.688446s 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26dcc81640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f26d808c5b0 0x7f26d81d9a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:60958/0 (socket says 10.20.193.57:60958) 2026-02-12T17:45:04.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.869+0000 7f26dcc81640 1 -- 10.20.193.57:0/1668637708 learned_addr learned my addr 10.20.193.57:0/1668637708 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:04.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.871+0000 7f26dcc81640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6790/0 conn(0x7f26d808c5b0 legacy=0x7f26d81d9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.871+0000 7f26dd482640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6789/0 conn(0x7f26d8091bb0 legacy=0x7f26d823bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.871+0000 7f26cffff640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.82:6789/0 conn(0x7f26d808c9f0 legacy=0x7f26d821a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.872+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714483333 0 0) 0x7f26d80589f0 con 0x7f26d808c9f0 2026-02-12T17:45:04.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.872+0000 7f26cd7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.872+0000 7f26cd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.872+0000 7f26cd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.881 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.872+0000 7f26cd7fa640 10 monclient(hunting): my global_id is 5203 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.872+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26a80035e0 con 0x7f26d808c9f0 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2607360730 0 0) 0x7f26a80035e0 con 0x7f26d808c9f0 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26d80589f0 con 0x7f26d808c9f0 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f26c0003340 con 0x7f26d808c9f0 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient(hunting): dump: 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.882 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 403257969 0 0) 0x7f26d80589f0 con 0x7f26d808c9f0 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6790/0 conn(0x7f26d808c5b0 legacy=0x7f26d81d9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6789/0 conn(0x7f26d8091bb0 legacy=0x7f26d823bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient: _finish_hunting 0 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 monclient: found mon.b 2026-02-12T17:45:04.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d8082ed0 con 0x7f26d808c9f0 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient: _finish_auth 0 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient: _check_auth_tickets 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26ddc83640 5 monclient: authenticate success, global_id 5203 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26ddc83640 10 monclient: _renew_subs 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26ddc83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f26d8085290 con 0x7f26d808c9f0 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26ddc83640 10 monclient: _renew_subs 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26ddc83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:45:04.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f26d8083a30 con 0x7f26d808c9f0 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26c0003980 con 0x7f26d808c9f0 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f26c0003ce0 con 0x7f26d808c9f0 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26ceffd640 4 set_mon_vals no callback set 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.873+0000 7f26cd7fa640 10 monclient: dump: 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.885 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.874+0000 7f26ddc83640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.874+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f26d80008d0 con 0x7f26d8082420 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.874+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f26c0003f40 con 0x7f26d808c9f0 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.875+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(854..854 src has 637..854) ==== 3943+0+0 (unknown 972051364 0 0) 0x7f26c004ecb0 con 0x7f26d808c9f0 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.875+0000 7f26dd482640 10 monclient: get_auth_request con 0x7f26a803f740 auth_method 0 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26dcc81640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6789/0 conn(0x7f26d8082420 legacy=0x7f26d807e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459766709 0 0) 0x7f26d80008d0 con 0x7f26d8082420 2026-02-12T17:45:04.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 10 monclient(hunting): my global_id is 74454 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26d80589f0 con 0x7f26d8082420 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 607332965 0 0) 0x7f26d80589f0 con 0x7f26d8082420 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26d80008d0 con 0x7f26d8082420 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f26c8002d50 con 0x7f26d8082420 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 10 monclient: dump: 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.887 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1192052956 0 0) 0x7f26d80008d0 con 0x7f26d8082420 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.876+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f26d808ce30 con 0x7f26d8082420 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.877+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f26c8004a60 con 0x7f26d8082420 2026-02-12T17:45:04.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.877+0000 7f26cd7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.877+0000 7f26cd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.877+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6789/0 conn(0x7f26d8082420 legacy=0x7f26d807e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.877+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6789/0 conn(0x7f26d8082420 legacy=0x7f26d807e870 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.880+0000 7f26ddc83640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.880+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f26d80827f0 con 0x7f26d807ef80 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.882+0000 7f26dcc81640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6789/0 conn(0x7f26d807ef80 legacy=0x7f26d825e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.882+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289998618 0 0) 0x7f26d80827f0 con 0x7f26d807ef80 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.882+0000 7f26cd7fa640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.882+0000 7f26cd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.882+0000 7f26cd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.882+0000 7f26cd7fa640 10 monclient(hunting): my global_id is 74457 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.882+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26d80008d0 con 0x7f26d807ef80 2026-02-12T17:45:04.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4172417365 0 0) 0x7f26d80008d0 con 0x7f26d807ef80 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26d80827f0 con 0x7f26d807ef80 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f26c8003230 con 0x7f26d807ef80 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 10 monclient: dump: 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.890 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2856028493 0 0) 0x7f26d80827f0 con 0x7f26d807ef80 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f26d808b720 con 0x7f26d807ef80 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 2476281859) 0x7f26c80075d0 con 0x7f26d807ef80 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6789/0 conn(0x7f26d807ef80 legacy=0x7f26d825e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26cd7fa640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.57:6789/0 conn(0x7f26d807ef80 legacy=0x7f26d825e530 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:04.892 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:45:04.892 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:04.892 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:04.892 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:45:04.892 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 64, 2026-02-12T17:45:04.892 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 431346, 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:04.893 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:04.894 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:04.895 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:45:04.896 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:04.897 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:04.898 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:04.899 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:45:04.900 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:45:04.901 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:04.902 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:45:04.903 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.82:6800/2441377515 conn(0x7f26a803f740 legacy=0x7f26a805fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26ddc83640 10 monclient: shutdown 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26ddc83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 >> v1:10.20.193.82:6789/0 conn(0x7f26d808c9f0 legacy=0x7f26d821a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26dd482640 1 -- 10.20.193.57:0/1668637708 reap_dead start 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26dd482640 1 -- 10.20.193.57:0/1668637708 reap_dead start 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 shutdown_connections 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 >> 10.20.193.57:0/1668637708 conn(0x7f26d8090410 msgr2=0x7f26d8059d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 shutdown_connections 2026-02-12T17:45:04.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.883+0000 7f26ddc83640 1 -- 10.20.193.57:0/1668637708 wait complete. 2026-02-12T17:45:04.906 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:45:04.906 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:45:04.906 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:45:04.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.973+0000 7f3ca20cc640 10 monclient: get_monmap_and_config 2026-02-12T17:45:04.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.973+0000 7f3ca20cc640 10 monclient: build_initial_monmap 2026-02-12T17:45:04.970 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.973+0000 7f3ca20cc640 10 monclient: monmap: 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:04.974643+0000 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:04.974643+0000 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:04.971 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 1 Processor -- start 2026-02-12T17:45:04.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 1 -- start start 2026-02-12T17:45:04.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 10 monclient: init 2026-02-12T17:45:04.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:04.983 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:45:04.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 10 monclient(hunting): picked mon.noname-b con 0x7f3c9c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:04.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 10 monclient(hunting): picked mon.noname-a con 0x7f3c9c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:04.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 10 monclient(hunting): picked mon.noname-c con 0x7f3c9c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:04.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c08a820 con 0x7f3c9c08c620 2026-02-12T17:45:04.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c089450 con 0x7f3c9c182cc0 2026-02-12T17:45:04.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c089730 con 0x7f3c9c08c250 2026-02-12T17:45:04.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:04.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3ca20cc640 10 monclient(hunting): authenticate will time out at 1584.793752s 2026-02-12T17:45:04.984 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3c9affd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f3c9c08c620 0x7f3c9c08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47008/0 (socket says 10.20.193.57:47008) 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.974+0000 7f3c9affd640 1 -- 10.20.193.57:0/1567338553 learned_addr learned my addr 10.20.193.57:0/1567338553 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.976+0000 7f3c9affd640 1 -- 10.20.193.57:0/1567338553 >> v1:10.20.193.57:6789/0 conn(0x7f3c9c08c620 legacy=0x7f3c9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.976+0000 7f3c9b7fe640 1 -- 10.20.193.57:0/1567338553 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c08c250 legacy=0x7f3c9c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261563173 0 0) 0x7f3c8c002c20 con 0x7f3c9c08c620 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient(hunting): my global_id is 74460 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c800035e0 con 0x7f3c9c08c620 2026-02-12T17:45:04.985 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330510897 0 0) 0x7f3c9c089730 con 0x7f3c9c08c250 2026-02-12T17:45:04.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient(hunting): my global_id is 114101 2026-02-12T17:45:04.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c8c002c20 con 0x7f3c9c08c250 2026-02-12T17:45:04.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9bfff640 1 -- 10.20.193.57:0/1567338553 >> v1:10.20.193.82:6789/0 conn(0x7f3c9c182cc0 legacy=0x7f3c9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 279834330 0 0) 0x7f3c800035e0 con 0x7f3c9c08c620 2026-02-12T17:45:04.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c08c250 legacy=0x7f3c9c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.986 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 >> v1:10.20.193.82:6789/0 conn(0x7f3c9c182cc0 legacy=0x7f3c9c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 monclient: found mon.noname-a 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c089a10 con 0x7f3c9c08c620 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: _finish_auth 0 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3c8c003260 con 0x7f3c9c08c620 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.987 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: dump: 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.988 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 5 monclient: authenticate success, global_id 74460 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c8c004960 con 0x7f3c9c08c620 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 1 -- 10.20.193.57:0/1567338553 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3c8c004cb0 con 0x7f3c9c08c620 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3c9a7fc640 10 monclient: dump: 2026-02-12T17:45:04.989 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:04.990 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 4 set_mon_vals no callback set 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 10 monclient: shutdown 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 1 -- 10.20.193.57:0/1567338553 >> v1:10.20.193.57:6789/0 conn(0x7f3c9c08c620 legacy=0x7f3c9c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 1 -- 10.20.193.57:0/1567338553 shutdown_connections 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 1 -- 10.20.193.57:0/1567338553 >> 10.20.193.57:0/1567338553 conn(0x7f3c9c0916b0 msgr2=0x7f3c9c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 1 -- 10.20.193.57:0/1567338553 shutdown_connections 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.977+0000 7f3ca20cc640 1 -- 10.20.193.57:0/1567338553 wait complete. 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient: build_initial_monmap 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient: monmap: 2026-02-12T17:45:04.991 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 1 Processor -- start 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 1 -- start start 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient: init 2026-02-12T17:45:04.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient(hunting): picked mon.noname-b con 0x7f3c9c08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient(hunting): picked mon.noname-c con 0x7f3c9c08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient(hunting): picked mon.noname-a con 0x7f3c9c182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c086570 con 0x7f3c9c182cc0 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c087210 con 0x7f3c9c08c250 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9c13bfc0 con 0x7f3c9c08c620 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3ca20cc640 10 monclient(hunting): authenticate will time out at 1584.797741s 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3c9affd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3c9c08c620 0x7f3c9c085e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:60986/0 (socket says 10.20.193.57:60986) 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.978+0000 7f3c9affd640 1 -- 10.20.193.57:0/3805789726 learned_addr learned my addr 10.20.193.57:0/3805789726 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.980+0000 7f3c9affd640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c08c620 legacy=0x7f3c9c085e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.980+0000 7f3c9bfff640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6789/0 conn(0x7f3c9c182cc0 legacy=0x7f3c9c195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221278558 0 0) 0x7f3c9c086570 con 0x7f3c9c182cc0 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): my global_id is 74463 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c6c0035e0 con 0x7f3c9c182cc0 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c9b7fe640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.82:6789/0 conn(0x7f3c9c08c250 legacy=0x7f3c9c085750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1893709656 0 0) 0x7f3c6c0035e0 con 0x7f3c9c182cc0 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c9c086570 con 0x7f3c9c182cc0 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3c90004420 con 0x7f3c9c182cc0 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): dump: 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.994 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3797780872 0 0) 0x7f3c9c087210 con 0x7f3c9c08c250 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient(hunting): my global_id is 5209 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c6c0035e0 con 0x7f3c9c08c250 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 631308660 0 0) 0x7f3c9c086570 con 0x7f3c9c182cc0 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c08c620 legacy=0x7f3c9c085e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.82:6789/0 conn(0x7f3c9c08c250 legacy=0x7f3c9c085750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient: _finish_hunting 0 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 monclient: found mon.a 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.995 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c13c2a0 con 0x7f3c9c182cc0 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient: _finish_auth 0 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient: _check_auth_tickets 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3ca20cc640 5 monclient: authenticate success, global_id 74463 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3ca20cc640 10 monclient: _renew_subs 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3ca20cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9c13c580 con 0x7f3c9c182cc0 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3ca20cc640 10 monclient: _renew_subs 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3ca20cc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3c9c13ce20 con 0x7f3c9c182cc0 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c90004600 con 0x7f3c9c182cc0 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3c90004c10 con 0x7f3c9c182cc0 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:04.996 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c77fff640 10 monclient: dump: 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3c99ffb640 4 set_mon_vals no callback set 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.981+0000 7f3ca20cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.982+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3c9c090810 con 0x7f3c9c13b060 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.982+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3c90004db0 con 0x7f3c9c182cc0 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.982+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(854..854 src has 637..854) ==== 3943+0+0 (unknown 972051364 0 0) 0x7f3c9004fc80 con 0x7f3c9c182cc0 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.982+0000 7f3c9affd640 10 monclient: get_auth_request con 0x7f3c6c03f880 auth_method 0 2026-02-12T17:45:04.997 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c9b7fe640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c13b060 legacy=0x7f3c9c18d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3952926448 0 0) 0x7f3c9c090810 con 0x7f3c9c13b060 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 10 monclient(hunting): _negotiate 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 10 monclient(hunting): my global_id is 114104 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c9c086570 con 0x7f3c9c13b060 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2544815234 0 0) 0x7f3c9c086570 con 0x7f3c9c13b060 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c9c090810 con 0x7f3c9c13b060 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3c88003330 con 0x7f3c9c13b060 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 10 monclient: dump: 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:04.998 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 240860353 0 0) 0x7f3c9c090810 con 0x7f3c9c13b060 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c9c08f5b0 con 0x7f3c9c13b060 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3c88005880 con 0x7f3c9c13b060 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c13b060 legacy=0x7f3c9c18d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:04.999 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.984+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c13b060 legacy=0x7f3c9c18d340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.988+0000 7f3ca20cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.988+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3c9c05e370 con 0x7f3c9c05df70 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c9b7fe640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c05df70 legacy=0x7f3c9c18da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647978661 0 0) 0x7f3c6c0035e0 con 0x7f3c9c05df70 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 10 monclient(hunting): my global_id is 114107 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c9c090810 con 0x7f3c9c05df70 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3931494417 0 0) 0x7f3c9c090810 con 0x7f3c9c05df70 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c6c0035e0 con 0x7f3c9c05df70 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3c88003ce0 con 0x7f3c9c05df70 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:05.001 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.990+0000 7f3c77fff640 10 monclient: dump: 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1052546444 0 0) 0x7f3c6c0035e0 con 0x7f3c9c05df70 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3c9c055340 con 0x7f3c9c05df70 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4335 (unknown 0 0 1168466098) 0x7f3c88005a90 con 0x7f3c9c05df70 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3c77fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3c77fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:05.002 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c05df70 legacy=0x7f3c9c18da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3c77fff640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6790/0 conn(0x7f3c9c05df70 legacy=0x7f3c9c18da50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 64, 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 373, 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:45:05.003 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:05.004 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:05.005 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:45:05.006 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:05.007 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:05.008 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:05.009 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.010 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:45:05.011 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:45:05.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.82:6800/2441377515 conn(0x7f3c6c03f880 legacy=0x7f3c6c05fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3ca20cc640 10 monclient: shutdown 2026-02-12T17:45:05.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3ca20cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:05.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 >> v1:10.20.193.57:6789/0 conn(0x7f3c9c182cc0 legacy=0x7f3c9c195570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3c9bfff640 1 -- 10.20.193.57:0/3805789726 reap_dead start 2026-02-12T17:45:05.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3c9bfff640 1 -- 10.20.193.57:0/3805789726 reap_dead start 2026-02-12T17:45:05.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 shutdown_connections 2026-02-12T17:45:05.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 >> 10.20.193.57:0/3805789726 conn(0x7f3c9c0916b0 msgr2=0x7f3c9c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:05.012 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 shutdown_connections 2026-02-12T17:45:05.013 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:04.991+0000 7f3ca20cc640 1 -- 10.20.193.57:0/3805789726 wait complete. 2026-02-12T17:45:05.013 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:45:05.013 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:45:05.013 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.083+0000 7ff30cdae640 10 monclient: get_monmap_and_config 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.083+0000 7ff30cdae640 10 monclient: build_initial_monmap 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.083+0000 7ff30cdae640 10 monclient: monmap: 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:05.084310+0000 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:05.084310+0000 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:05.080 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.083+0000 7ff30cdae640 1 Processor -- start 2026-02-12T17:45:05.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.083+0000 7ff30cdae640 1 -- start start 2026-02-12T17:45:05.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.083+0000 7ff30cdae640 10 monclient: init 2026-02-12T17:45:05.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 10 monclient(hunting): picked mon.noname-c con 0x7ff30808c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 10 monclient(hunting): picked mon.noname-a con 0x7ff30808c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 10 monclient(hunting): picked mon.noname-b con 0x7ff308182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30808a820 con 0x7ff30808c620 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff308089450 con 0x7ff30808c250 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff308089730 con 0x7ff308182cc0 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff30cdae640 10 monclient(hunting): authenticate will time out at 1584.903207s 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff305d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff30808c620 0x7ff30808caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47026/0 (socket says 10.20.193.57:47026) 2026-02-12T17:45:05.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.084+0000 7ff305d74640 1 -- 10.20.193.57:0/2384859728 learned_addr learned my addr 10.20.193.57:0/2384859728 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:05.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305d74640 1 -- 10.20.193.57:0/2384859728 >> v1:10.20.193.57:6789/0 conn(0x7ff30808c620 legacy=0x7ff30808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff306d76640 1 -- 10.20.193.57:0/2384859728 >> v1:10.20.193.57:6790/0 conn(0x7ff308182cc0 legacy=0x7ff3081a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff306575640 1 -- 10.20.193.57:0/2384859728 >> v1:10.20.193.82:6789/0 conn(0x7ff30808c250 legacy=0x7ff30808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3485592086 0 0) 0x7ff308089730 con 0x7ff308182cc0 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): my global_id is 114110 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f40035e0 con 0x7ff308182cc0 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193778051 0 0) 0x7ff2f0002c20 con 0x7ff30808c620 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): my global_id is 74466 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff308089730 con 0x7ff30808c620 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4030700877 0 0) 0x7ff308089450 con 0x7ff30808c250 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient(hunting): my global_id is 5212 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f0002c20 con 0x7ff30808c250 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 338867502 0 0) 0x7ff2f40035e0 con 0x7ff308182cc0 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 >> v1:10.20.193.82:6789/0 conn(0x7ff30808c250 legacy=0x7ff30808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 >> v1:10.20.193.57:6789/0 conn(0x7ff30808c620 legacy=0x7ff30808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: _finish_hunting 0 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 monclient: found mon.noname-b 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff308089a10 con 0x7ff308182cc0 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: _finish_auth 0 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: _check_auth_tickets 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff2f8004200 con 0x7ff308182cc0 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:05.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: dump: 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff30cdae640 5 monclient: authenticate success, global_id 114110 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff30cdae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2f8004500 con 0x7ff308182cc0 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 1 -- 10.20.193.57:0/2384859728 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff2f8004960 con 0x7ff308182cc0 2026-02-12T17:45:05.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff30cdae640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff30cdae640 4 set_mon_vals no callback set 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.086+0000 7ff305573640 10 monclient: dump: 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 10 monclient: shutdown 2026-02-12T17:45:05.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 1 -- 10.20.193.57:0/2384859728 >> v1:10.20.193.57:6790/0 conn(0x7ff308182cc0 legacy=0x7ff3081a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 1 -- 10.20.193.57:0/2384859728 shutdown_connections 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 1 -- 10.20.193.57:0/2384859728 >> 10.20.193.57:0/2384859728 conn(0x7ff3080916b0 msgr2=0x7ff308091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 1 -- 10.20.193.57:0/2384859728 shutdown_connections 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 1 -- 10.20.193.57:0/2384859728 wait complete. 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 10 monclient: build_initial_monmap 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 10 monclient: monmap: 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 1 Processor -- start 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 1 -- start start 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.087+0000 7ff30cdae640 10 monclient: init 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 10 monclient(hunting): picked mon.noname-c con 0x7ff30808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 10 monclient(hunting): picked mon.noname-b con 0x7ff30808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 10 monclient(hunting): picked mon.noname-a con 0x7ff308182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30813b5d0 con 0x7ff308182cc0 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30805dcd0 con 0x7ff30808c620 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30813e900 con 0x7ff30808c250 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff30cdae640 10 monclient(hunting): authenticate will time out at 1584.907091s 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff306575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ff30808c250 0x7ff308085720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32804/0 (socket says 10.20.193.57:32804) 2026-02-12T17:45:05.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.088+0000 7ff306575640 1 -- 10.20.193.57:0/89459239 learned_addr learned my addr 10.20.193.57:0/89459239 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:05.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff306575640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.57:6790/0 conn(0x7ff30808c250 legacy=0x7ff308085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff306d76640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.57:6789/0 conn(0x7ff308182cc0 legacy=0x7ff3081954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193628747 0 0) 0x7ff30813e900 con 0x7ff30808c250 2026-02-12T17:45:05.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): my global_id is 114113 2026-02-12T17:45:05.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2d40035e0 con 0x7ff30808c250 2026-02-12T17:45:05.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437994600 0 0) 0x7ff30813b5d0 con 0x7ff308182cc0 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): my global_id is 74469 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff30813e900 con 0x7ff308182cc0 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff305d74640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.82:6789/0 conn(0x7ff30808c620 legacy=0x7ff308085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1816659258 0 0) 0x7ff30813e900 con 0x7ff308182cc0 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff30813b5d0 con 0x7ff308182cc0 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff2f8004960 con 0x7ff308182cc0 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): dump: 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.096 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 932462812 0 0) 0x7ff2d40035e0 con 0x7ff30808c250 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff30813e900 con 0x7ff30808c250 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff2fc0033b0 con 0x7ff30808c250 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): dump: 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.097 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783401604 0 0) 0x7ff30805dcd0 con 0x7ff30808c620 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient(hunting): my global_id is 5215 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2d40035e0 con 0x7ff30808c620 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 588100540 0 0) 0x7ff30813b5d0 con 0x7ff308182cc0 2026-02-12T17:45:05.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.57:6790/0 conn(0x7ff30808c250 legacy=0x7ff308085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.82:6789/0 conn(0x7ff30808c620 legacy=0x7ff308085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient: _finish_hunting 0 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 monclient: found mon.a 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3080888a0 con 0x7ff308182cc0 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient: _finish_auth 0 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient: _check_auth_tickets 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff30cdae640 5 monclient: authenticate success, global_id 74469 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff30cdae640 10 monclient: _renew_subs 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff30cdae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff30813b2f0 con 0x7ff308182cc0 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff30cdae640 10 monclient: _renew_subs 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff30cdae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:05.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff30813b010 con 0x7ff308182cc0 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2f8003c40 con 0x7ff308182cc0 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff2f80050b0 con 0x7ff308182cc0 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff2eeffd640 10 monclient: dump: 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.100 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.090+0000 7ff304d72640 4 set_mon_vals no callback set 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.091+0000 7ff30cdae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.091+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff30818e9b0 con 0x7ff30818e5e0 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.091+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff2f8005340 con 0x7ff308182cc0 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.091+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(854..854 src has 637..854) ==== 3943+0+0 (unknown 972051364 0 0) 0x7ff2f804fd00 con 0x7ff308182cc0 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.091+0000 7ff305d74640 10 monclient: get_auth_request con 0x7ff2d403fc50 auth_method 0 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.093+0000 7ff306575640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.82:6789/0 conn(0x7ff30818e5e0 legacy=0x7ff3080582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.093+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424901455 0 0) 0x7ff30818e9b0 con 0x7ff30818e5e0 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.093+0000 7ff2eeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.093+0000 7ff2eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.093+0000 7ff2eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.093+0000 7ff2eeffd640 10 monclient(hunting): my global_id is 5218 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.093+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff30813b5d0 con 0x7ff30818e5e0 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3230358187 0 0) 0x7ff30813b5d0 con 0x7ff30818e5e0 2026-02-12T17:45:05.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff30818e9b0 con 0x7ff30818e5e0 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff2fc003d60 con 0x7ff30818e5e0 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 10 monclient: dump: 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4165533307 0 0) 0x7ff30818e9b0 con 0x7ff30818e5e0 2026-02-12T17:45:05.102 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff308090810 con 0x7ff30818e5e0 2026-02-12T17:45:05.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7ff2fc0041f0 con 0x7ff30818e5e0 2026-02-12T17:45:05.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:05.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:05.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.82:6789/0 conn(0x7ff30818e5e0 legacy=0x7ff3080582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.094+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.82:6789/0 conn(0x7ff30818e5e0 legacy=0x7ff3080582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:05.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.097+0000 7ff30cdae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:45:05.103 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.097+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff308086540 con 0x7ff3080589d0 2026-02-12T17:45:05.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff306575640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.82:6789/0 conn(0x7ff3080589d0 legacy=0x7ff308197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.104 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004500743 0 0) 0x7ff308086540 con 0x7ff3080589d0 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 10 monclient(hunting): my global_id is 5221 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff30818e9b0 con 0x7ff3080589d0 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 29110548 0 0) 0x7ff30818e9b0 con 0x7ff3080589d0 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff308086540 con 0x7ff3080589d0 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff2fc005a30 con 0x7ff3080589d0 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 10 monclient: dump: 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.105 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4076001901 0 0) 0x7ff308086540 con 0x7ff3080589d0 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.100+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff30808f580 con 0x7ff3080589d0 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 2209343423) 0x7ff2fc005db0 con 0x7ff3080589d0 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff2eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff2eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.82:6789/0 conn(0x7ff3080589d0 legacy=0x7ff308197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.106 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff2eeffd640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.82:6789/0 conn(0x7ff3080589d0 legacy=0x7ff308197c00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 64, 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 1026596, 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:45:05.107 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:05.108 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:05.109 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:45:05.110 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:05.111 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:45:05.112 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:45:05.113 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:45:05.114 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:45:05.115 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:45:05.116 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:45:05.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff2d403fc50 legacy=0x7ff2d4060100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff30cdae640 10 monclient: shutdown 2026-02-12T17:45:05.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff30cdae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:05.117 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 >> v1:10.20.193.57:6789/0 conn(0x7ff308182cc0 legacy=0x7ff3081954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff306d76640 1 -- 10.20.193.57:0/89459239 reap_dead start 2026-02-12T17:45:05.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 shutdown_connections 2026-02-12T17:45:05.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 >> 10.20.193.57:0/89459239 conn(0x7ff3080916b0 msgr2=0x7ff30808a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:05.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 shutdown_connections 2026-02-12T17:45:05.118 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.101+0000 7ff30cdae640 1 -- 10.20.193.57:0/89459239 wait complete. 2026-02-12T17:45:05.118 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:45:05.118 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:45:05.118 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:45:05.167 INFO:tasks.rados.rados.0.trial082.stdout:3848: done (1 left) 2026-02-12T17:45:05.167 INFO:tasks.rados.rados.0.trial082.stdout:3849: copy_from oid 28 from oid 48 current snap is 426 2026-02-12T17:45:05.167 INFO:tasks.rados.rados.0.trial082.stdout:3847: expect (ObjNum 1194 snap 382 seq_num 1194) 2026-02-12T17:45:05.184 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1599347 2026-02-12T17:45:05.184 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 10 monclient: get_monmap_and_config 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 10 monclient: build_initial_monmap 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 10 monclient: monmap: 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:05.189152+0000 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:05.189152+0000 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:05.185 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 1 Processor -- start 2026-02-12T17:45:05.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 1 -- start start 2026-02-12T17:45:05.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 10 monclient: init 2026-02-12T17:45:05.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:05.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:45:05.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 10 monclient(hunting): picked mon.noname-c con 0x7f581408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:05.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 10 monclient(hunting): picked mon.noname-b con 0x7f581408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:05.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.188+0000 7f581bba5640 10 monclient(hunting): picked mon.noname-a con 0x7f581408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:05.187 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.189+0000 7f581bba5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581408d600 con 0x7f581408cb30 2026-02-12T17:45:05.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.189+0000 7f581bba5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581408b1f0 con 0x7f581408ae20 2026-02-12T17:45:05.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.189+0000 7f581bba5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581408d1f0 con 0x7f581408c730 2026-02-12T17:45:05.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.189+0000 7f581bba5640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:05.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.189+0000 7f581bba5640 10 monclient(hunting): authenticate will time out at 1585.008038s 2026-02-12T17:45:05.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.189+0000 7f5819119640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f581408c730 0x7f5814181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32812/0 (socket says 10.20.193.57:32812) 2026-02-12T17:45:05.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.189+0000 7f5819119640 1 -- 10.20.193.57:0/4196274602 learned_addr learned my addr 10.20.193.57:0/4196274602 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:05.188 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.189+0000 7f581a11b640 1 --1- 10.20.193.57:0/4196274602 >> v1:10.20.193.57:6789/0 conn(0x7f581408cb30 0x7f58141a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47048/0 (socket says 10.20.193.57:47048) 2026-02-12T17:45:05.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5819119640 1 -- 10.20.193.57:0/4196274602 >> v1:10.20.193.57:6790/0 conn(0x7f581408c730 legacy=0x7f5814181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.195 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f581a11b640 1 -- 10.20.193.57:0/4196274602 >> v1:10.20.193.57:6789/0 conn(0x7f581408cb30 legacy=0x7f58141a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f581991a640 1 -- 10.20.193.57:0/4196274602 >> v1:10.20.193.82:6789/0 conn(0x7f581408ae20 legacy=0x7f581408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463103346 0 0) 0x7f581408d1f0 con 0x7f581408c730 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): my global_id is 114116 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57fc0035e0 con 0x7f581408c730 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979073050 0 0) 0x7f581408d600 con 0x7f581408cb30 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.196 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): my global_id is 74472 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f581408d1f0 con 0x7f581408cb30 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287530289 0 0) 0x7f581408b1f0 con 0x7f581408ae20 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient(hunting): my global_id is 5224 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f581408d600 con 0x7f581408ae20 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 295977205 0 0) 0x7f57fc0035e0 con 0x7f581408c730 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 >> v1:10.20.193.82:6789/0 conn(0x7f581408ae20 legacy=0x7f581408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 >> v1:10.20.193.57:6789/0 conn(0x7f581408cb30 legacy=0x7f58141a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: _finish_hunting 0 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 monclient: found mon.noname-b 2026-02-12T17:45:05.197 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5814057320 con 0x7f581408c730 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: _finish_auth 0 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: _check_auth_tickets 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5808003140 con 0x7f581408c730 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: dump: 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.198 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f581bba5640 5 monclient: authenticate success, global_id 114116 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f581bba5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5808003390 con 0x7f581408c730 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 1 -- 10.20.193.57:0/4196274602 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5808004b10 con 0x7f581408c730 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:05.199 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f5818918640 10 monclient: dump: 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f581bba5640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.191+0000 7f581bba5640 4 set_mon_vals no callback set 2026-02-12T17:45:05.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 10 monclient: shutdown 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 1 -- 10.20.193.57:0/4196274602 >> v1:10.20.193.57:6790/0 conn(0x7f581408c730 legacy=0x7f5814181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 1 -- 10.20.193.57:0/4196274602 shutdown_connections 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 1 -- 10.20.193.57:0/4196274602 >> 10.20.193.57:0/4196274602 conn(0x7f5814091620 msgr2=0x7f5814091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 1 -- 10.20.193.57:0/4196274602 shutdown_connections 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 1 -- 10.20.193.57:0/4196274602 wait complete. 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 10 monclient: build_initial_monmap 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 10 monclient: monmap: 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:05.201 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 1 Processor -- start 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 1 -- start start 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 10 monclient: init 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.192+0000 7f581bba5640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581bba5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581bba5640 10 monclient(hunting): picked mon.noname-c con 0x7f581408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581bba5640 10 monclient(hunting): picked mon.noname-a con 0x7f581408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581bba5640 10 monclient(hunting): picked mon.noname-b con 0x7f581408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:05.202 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581bba5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581408d9c0 con 0x7f581408c730 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581bba5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581405caf0 con 0x7f581408cb30 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581bba5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581408a5c0 con 0x7f581408ae20 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581bba5640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581bba5640 10 monclient(hunting): authenticate will time out at 1585.012042s 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581991a640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f581408ae20 0x7f5814088b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32820/0 (socket says 10.20.193.57:32820) 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.193+0000 7f581991a640 1 -- 10.20.193.57:0/850894989 learned_addr learned my addr 10.20.193.57:0/850894989 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f5819119640 1 -- 10.20.193.57:0/850894989 >> v1:10.20.193.57:6789/0 conn(0x7f581408c730 legacy=0x7f5814089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f581991a640 1 -- 10.20.193.57:0/850894989 >> v1:10.20.193.57:6790/0 conn(0x7f581408ae20 legacy=0x7f5814088b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f581a11b640 1 -- 10.20.193.57:0/850894989 >> v1:10.20.193.82:6789/0 conn(0x7f581408cb30 legacy=0x7f58141a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526467004 0 0) 0x7f581408d9c0 con 0x7f581408c730 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): my global_id is 74475 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57e40035e0 con 0x7f581408c730 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664180542 0 0) 0x7f581408a5c0 con 0x7f581408ae20 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): my global_id is 114119 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f581408d9c0 con 0x7f581408ae20 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015108638 0 0) 0x7f581405caf0 con 0x7f581408cb30 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): my global_id is 5227 2026-02-12T17:45:05.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f581408a5c0 con 0x7f581408cb30 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2445510451 0 0) 0x7f581408d9c0 con 0x7f581408ae20 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f581405caf0 con 0x7f581408ae20 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5804003310 con 0x7f581408ae20 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): dump: 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.205 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 617381932 0 0) 0x7f57e40035e0 con 0x7f581408c730 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f581408d9c0 con 0x7f581408c730 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5808002f90 con 0x7f581408c730 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): dump: 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.206 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2145540700 0 0) 0x7f581408a5c0 con 0x7f581408cb30 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57e40035e0 con 0x7f581408cb30 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5810005980 con 0x7f581408cb30 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient(hunting): dump: 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.207 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3759240743 0 0) 0x7f581405caf0 con 0x7f581408ae20 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 >> v1:10.20.193.82:6789/0 conn(0x7f581408cb30 legacy=0x7f58141a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 >> v1:10.20.193.57:6789/0 conn(0x7f581408c730 legacy=0x7f5814089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient: _finish_hunting 0 2026-02-12T17:45:05.208 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 monclient: found mon.c 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581411f090 con 0x7f581408ae20 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient: _finish_auth 0 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient: _check_auth_tickets 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f581bba5640 5 monclient: authenticate success, global_id 114119 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f581bba5640 10 monclient: _renew_subs 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f581bba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58140899a0 con 0x7f581408ae20 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f581bba5640 10 monclient: _renew_subs 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f581bba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:05.209 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5814088810 con 0x7f581408ae20 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5804003980 con 0x7f581408ae20 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5804003cd0 con 0x7f581408ae20 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f58027fc640 10 monclient: dump: 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:05.210 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.195+0000 7f5803fff640 4 set_mon_vals no callback set 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.196+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5804003f60 con 0x7f581408ae20 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.196+0000 7f581bba5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.196+0000 7f581bba5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.196+0000 7f581bba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.196+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58140008d0 con 0x7f581408ae20 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.196+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(855..855 src has 637..855) ==== 3943+0+0 (unknown 2315256519 0 0) 0x7f580404ebd0 con 0x7f581408ae20 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.196+0000 7f5819119640 10 monclient: get_auth_request con 0x7f57e403ffd0 auth_method 0 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.198+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f5804016c70 con 0x7f581408ae20 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.198+0000 7f58027fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:05.211 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.198+0000 7f58027fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:05.212 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 753265 2026-02-12T17:45:05.213 INFO:tasks.rados.rados.0.trial082.stdout:3849: finishing copy_from racing read to trial08226312-28 2026-02-12T17:45:05.213 INFO:tasks.rados.rados.0.trial082.stdout:3849: finishing copy_from to trial08226312-28 2026-02-12T17:45:05.213 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2460 (ObjNum 1303 snap 426 seq_num 1303) dirty exists 2026-02-12T17:45:05.213 INFO:tasks.rados.rados.0.trial082.stdout:3847: done (1 left) 2026-02-12T17:45:05.213 INFO:tasks.rados.rados.0.trial082.stdout:3849: done (0 left) 2026-02-12T17:45:05.213 INFO:tasks.rados.rados.0.trial082.stdout:3850: write oid 30 current snap is 426 2026-02-12T17:45:05.213 INFO:tasks.rados.rados.0.trial082.stdout:3850: seq_num 1305 ranges {733135=496308,1898766=652784,3170535=470565} 2026-02-12T17:45:05.213 INFO:tasks.rados.rados.0.trial082.stdout:3850: writing trial08226312-30 from 733135 to 1229443 tid 1 2026-02-12T17:45:05.217 INFO:tasks.rados.rados.0.trial082.stdout:3850: writing trial08226312-30 from 1898766 to 2551550 tid 2 2026-02-12T17:45:05.221 INFO:tasks.rados.rados.0.trial082.stdout:3850: writing trial08226312-30 from 3170535 to 3641100 tid 3 2026-02-12T17:45:05.221 INFO:tasks.rados.rados.0.trial082.stdout:3851: snap_create 2026-02-12T17:45:05.222 INFO:tasks.rados.rados.0.trial082.stdout:3850: finishing write tid 1 to trial08226312-30 2026-02-12T17:45:05.222 INFO:tasks.rados.rados.0.trial082.stdout:3850: finishing write tid 2 to trial08226312-30 2026-02-12T17:45:05.223 INFO:tasks.rados.rados.0.trial082.stdout:3850: finishing write tid 3 to trial08226312-30 2026-02-12T17:45:05.224 INFO:tasks.rados.rados.0.trial082.stdout:3850: finishing write tid 4 to trial08226312-30 2026-02-12T17:45:05.224 INFO:tasks.rados.rados.0.trial082.stdout:3850: finishing write tid 5 to trial08226312-30 2026-02-12T17:45:05.224 INFO:tasks.rados.rados.0.trial082.stdout:3850: oid 30 updating version 0 to 2516 2026-02-12T17:45:05.224 INFO:tasks.rados.rados.0.trial082.stdout:3850: oid 30 updating version 2516 to 2518 2026-02-12T17:45:05.224 INFO:tasks.rados.rados.0.trial082.stdout:3850: oid 30 version 2518 is already newer than 2517 2026-02-12T17:45:05.224 INFO:tasks.rados.rados.0.trial082.stdout:3850: oid 30 updating version 2518 to 2519 2026-02-12T17:45:05.224 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2519 (ObjNum 1305 snap 426 seq_num 1305) dirty exists 2026-02-12T17:45:05.224 INFO:tasks.rados.rados.0.trial082.stdout:3850: left oid 30 (ObjNum 1305 snap 426 seq_num 1305) 2026-02-12T17:45:05.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.345+0000 7f581bba5640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:45:05.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.345+0000 7f581bba5640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:45:05.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.345+0000 7f581bba5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:05.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.345+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f581408f500 con 0x7f581408ae20 2026-02-12T17:45:05.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.346+0000 7f58027fc640 1 -- 10.20.193.57:0/850894989 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f5804016a90 con 0x7f581408ae20 2026-02-12T17:45:05.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.346+0000 7f58027fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:45:05.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.346+0000 7f58027fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=2,health=11,kv=10,logm=57} crc {auth=1526063594,config=1618278320,health=2450858371,kv=1853958200,logm=1972843836}) 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=13,kv=9,logm=58} crc {auth=3361182983,config=1618278320,health=4095901992,kv=381909042,logm=77435846}) 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=2,health=11,kv=10,logm=57} crc {auth=1526063594,config=1618278320,health=2450858371,kv=1853958200,logm=1972843836}) 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=2,health=11,kv=10,logm=58} crc {auth=3644506969,config=1618278320,health=2245228695,kv=1466688342,logm=831261349}) 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3892868025}) 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2475638986}) 2026-02-12T17:45:05.349 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3892868025}) 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.342+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1751547847}) 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1618422309}) 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2666752852}) 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1618422309}) 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1921774034}) 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2127356096}) 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3841969534}) 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.350 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2127356096}) 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.343+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=895556639}) 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.344+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.344+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=471174030}) 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.344+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=895488395}) 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.344+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.344+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=471174030}) 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.344+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1970288879}) 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1967833019}) 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106362631}) 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1967833019}) 2026-02-12T17:45:05.351 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2078080130}) 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3587792629}) 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2896789794}) 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3587792629}) 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.345+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=347078652}) 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.346+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.346+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2608897719}) 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.346+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2673054902}) 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.346+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.346+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2608897719}) 2026-02-12T17:45:05.352 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.346+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4144888898}) 2026-02-12T17:45:05.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.348+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 >> v1:10.20.193.82:6800/2441377515 conn(0x7f57e403ffd0 legacy=0x7f57e4060480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.348+0000 7f581bba5640 10 monclient: shutdown 2026-02-12T17:45:05.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.348+0000 7f581bba5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:05.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.348+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 >> v1:10.20.193.57:6790/0 conn(0x7f581408ae20 legacy=0x7f5814088b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:05.354 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.348+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 shutdown_connections 2026-02-12T17:45:05.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.348+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 >> 10.20.193.57:0/850894989 conn(0x7f5814091620 msgr2=0x7f5814125be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:05.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.348+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 shutdown_connections 2026-02-12T17:45:05.355 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:05.348+0000 7f581bba5640 1 -- 10.20.193.57:0/850894989 wait complete. 2026-02-12T17:45:05.355 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:45:05.392 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.392 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2465946329}) 2026-02-12T17:45:05.393 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1879122352}) 2026-02-12T17:45:05.393 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.393 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2465946329}) 2026-02-12T17:45:05.393 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1942837867}) 2026-02-12T17:45:05.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3330051682}) 2026-02-12T17:45:05.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3163500565}) 2026-02-12T17:45:05.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:05.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3330051682}) 2026-02-12T17:45:05.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:05.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=298907791}) 2026-02-12T17:45:06.079 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.069+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.079 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.069+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2899386099}) 2026-02-12T17:45:06.079 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.069+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=219458778}) 2026-02-12T17:45:06.079 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.069+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.069+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2899386099}) 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.069+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3331350072}) 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1356715833}) 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1037039363}) 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1356715833}) 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1258562260}) 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.080 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2664346634}) 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3606428335}) 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2664346634}) 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2145594065}) 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.070+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3857371367}) 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=325434778}) 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3857371367}) 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2904690928}) 2026-02-12T17:45:06.081 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1218817649}) 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=547726861}) 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1218817649}) 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=368829402}) 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=977286684}) 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1168197364}) 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.082 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=977286684}) 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.071+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3233257179}) 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3949530682}) 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2437223479}) 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3949530682}) 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3615352818}) 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=10766970}) 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1677028547}) 2026-02-12T17:45:06.083 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=10766970}) 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.072+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1938861348}) 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.073+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.073+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=885973189}) 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.073+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4044766221}) 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.073+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.073+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=885973189}) 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.073+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2114659059}) 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.084 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2679198899}) 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1395191482}) 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2679198899}) 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1715959325}) 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2082294727}) 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2840065431}) 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2082294727}) 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.074+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2752322015}) 2026-02-12T17:45:06.085 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=519485075}) 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=466333455}) 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=519485075}) 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=754529383}) 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4184976075}) 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2045107488}) 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4184976075}) 2026-02-12T17:45:06.086 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.075+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2517023996}) 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3637649979}) 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=687193820}) 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3637649979}) 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3991218313}) 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3721225632}) 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503449288}) 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3721225632}) 2026-02-12T17:45:06.087 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.076+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=299235782}) 2026-02-12T17:45:06.088 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.077+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.088 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.077+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1102446726}) 2026-02-12T17:45:06.088 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.077+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2399987883}) 2026-02-12T17:45:06.088 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.077+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.088 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.077+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1102446726}) 2026-02-12T17:45:06.088 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.077+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2955985198}) 2026-02-12T17:45:06.093 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.088+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.088+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1829857398}) 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.088+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2257365956}) 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.088+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.088+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1829857398}) 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.088+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=608992481}) 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=423410712}) 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1439340323}) 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=423410712}) 2026-02-12T17:45:06.094 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=38908181}) 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1036762904}) 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=241297000}) 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1036762904}) 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.089+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3080312427}) 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3955119883}) 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3134683928}) 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.095 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3955119883}) 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3963449553}) 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4178778908}) 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=953863278}) 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4178778908}) 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.090+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=39754079}) 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=387155743}) 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=525580177}) 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=387155743}) 2026-02-12T17:45:06.096 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3603523365}) 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=371139214}) 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1535388719}) 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=371139214}) 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.091+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=178469169}) 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3453116812}) 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2008590264}) 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3453116812}) 2026-02-12T17:45:06.097 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=482089582}) 2026-02-12T17:45:06.099 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3743212569}) 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3946049134}) 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3743212569}) 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2989095956}) 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3977069044}) 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2992003763}) 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.092+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.093+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3977069044}) 2026-02-12T17:45:06.100 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.093+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1685747829}) 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.093+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.093+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3936050895}) 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.093+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294859309}) 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.093+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.093+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3936050895}) 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.093+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3767876712}) 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.094+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.094+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=76,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=3} crc {logm=3792180564,mdsmap=2130131172,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=1984229667,mon_config_key=3019726266}) 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.094+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=73,mdsmap=2,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8} crc {logm=1409817562,mdsmap=3140514009,mgr=3630777563,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=686872439,mon_config_key=1005603049}) 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.094+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.094+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=76,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=3} crc {logm=3792180564,mdsmap=2130131172,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=1984229667,mon_config_key=3019726266}) 2026-02-12T17:45:06.101 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.094+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=73,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=5} crc {logm=2872228320,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=1984229667,mon_config_key=3352982774}) 2026-02-12T17:45:06.167 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.165+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.167 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.165+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=82} crc {mon_config_key=3420202895,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=2104890475,osd_pg_creating=2225921335,osd_snap=4008037577}) 2026-02-12T17:45:06.167 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.165+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=6,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=82} crc {mon_config_key=3420202895,monmap=2728086219,nvmeofgw=935146538,osd_metadata=3332643379,osd_pg_creating=2225921335,osd_snap=1411179692}) 2026-02-12T17:45:06.167 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.165+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.167 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.165+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=82} crc {mon_config_key=3420202895,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=2104890475,osd_pg_creating=2225921335,osd_snap=4008037577}) 2026-02-12T17:45:06.167 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.165+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=82} crc {mon_config_key=3420202895,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3814064227,osd_pg_creating=2225921335,osd_snap=2982109365}) 2026-02-12T17:45:06.169 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.168+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.169 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.168+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=71,osdmap=29} crc {osd_snap=3110798054,osdmap=1795206241}) 2026-02-12T17:45:06.169 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.168+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=69,osdmap=31} crc {osd_snap=2842293154,osdmap=335035695}) 2026-02-12T17:45:06.169 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.168+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.169 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.168+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=71,osdmap=29} crc {osd_snap=3110798054,osdmap=1795206241}) 2026-02-12T17:45:06.169 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.168+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=71,osdmap=29} crc {osd_snap=3814677022,osdmap=1711786448}) 2026-02-12T17:45:06.175 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.173+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.175 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.173+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1542653705}) 2026-02-12T17:45:06.175 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.173+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1313863506}) 2026-02-12T17:45:06.175 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.173+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.175 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.173+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1542653705}) 2026-02-12T17:45:06.175 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.173+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=767463949}) 2026-02-12T17:45:06.176 INFO:tasks.rados.rados.0.trial082.stdout:3850: done (1 left) 2026-02-12T17:45:06.176 INFO:tasks.rados.rados.0.trial082.stdout:3851: done (0 left) 2026-02-12T17:45:06.176 INFO:tasks.rados.rados.0.trial082.stdout:3852: rollback oid 27 current snap is 427 2026-02-12T17:45:06.176 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 27 to 399 2026-02-12T17:45:06.176 INFO:tasks.rados.rados.0.trial082.stdout:3853: snap_remove snap 411 2026-02-12T17:45:06.356 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:45:06.356 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:45:06.392 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.392 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2062911925}) 2026-02-12T17:45:06.392 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3632295494}) 2026-02-12T17:45:06.392 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.392 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2062911925}) 2026-02-12T17:45:06.392 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.390+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1050149290}) 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.427+0000 7f61d5794640 10 monclient: get_monmap_and_config 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.427+0000 7f61d5794640 10 monclient: build_initial_monmap 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.427+0000 7f61d5794640 10 monclient: monmap: 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:06.428253+0000 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:06.428253+0000 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.427+0000 7f61d5794640 1 Processor -- start 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.427+0000 7f61d5794640 1 -- start start 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.427+0000 7f61d5794640 10 monclient: init 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 10 monclient(hunting): picked mon.noname-b con 0x7f61d008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:06.424 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 10 monclient(hunting): picked mon.noname-c con 0x7f61d008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:06.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 10 monclient(hunting): picked mon.noname-a con 0x7f61d008cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:06.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d008d600 con 0x7f61d008cb30 2026-02-12T17:45:06.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d008b1f0 con 0x7f61d008c730 2026-02-12T17:45:06.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d008d1f0 con 0x7f61d008ae20 2026-02-12T17:45:06.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:06.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61d5794640 10 monclient(hunting): authenticate will time out at 1586.247156s 2026-02-12T17:45:06.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61ceffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f61d008ae20 0x7f61d008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32828/0 (socket says 10.20.193.57:32828) 2026-02-12T17:45:06.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61cf7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f61d008cb30 0x7f61d01a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47062/0 (socket says 10.20.193.57:47062) 2026-02-12T17:45:06.425 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.428+0000 7f61ceffd640 1 -- 10.20.193.57:0/3768421100 learned_addr learned my addr 10.20.193.57:0/3768421100 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:06.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61ceffd640 1 -- 10.20.193.57:0/3768421100 >> v1:10.20.193.57:6790/0 conn(0x7f61d008ae20 legacy=0x7f61d008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.426 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cf7fe640 1 -- 10.20.193.57:0/3768421100 >> v1:10.20.193.57:6789/0 conn(0x7f61d008cb30 legacy=0x7f61d01a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61ce7fc640 1 -- 10.20.193.57:0/3768421100 >> v1:10.20.193.82:6789/0 conn(0x7f61d008c730 legacy=0x7f61d0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871974577 0 0) 0x7f61d008d1f0 con 0x7f61d008ae20 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient(hunting): my global_id is 114122 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61bc0035e0 con 0x7f61d008ae20 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242441813 0 0) 0x7f61d008d600 con 0x7f61d008cb30 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient(hunting): my global_id is 74478 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61d008d1f0 con 0x7f61d008cb30 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 670567016 0 0) 0x7f61bc0035e0 con 0x7f61d008ae20 2026-02-12T17:45:06.427 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 >> v1:10.20.193.82:6789/0 conn(0x7f61d008c730 legacy=0x7f61d0181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 >> v1:10.20.193.57:6789/0 conn(0x7f61d008cb30 legacy=0x7f61d01a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: _finish_hunting 0 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 monclient: found mon.noname-b 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d0057320 con 0x7f61d008ae20 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: _finish_auth 0 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: _check_auth_tickets 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f61c4003140 con 0x7f61d008ae20 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: dump: 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61d5794640 5 monclient: authenticate success, global_id 114122 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61d5794640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61c4003390 con 0x7f61d008ae20 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 1 -- 10.20.193.57:0/3768421100 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f61c4004b10 con 0x7f61d008ae20 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61d5794640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61d5794640 4 set_mon_vals no callback set 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.430+0000 7f61cdffb640 10 monclient: dump: 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient: shutdown 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 -- 10.20.193.57:0/3768421100 >> v1:10.20.193.57:6790/0 conn(0x7f61d008ae20 legacy=0x7f61d008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 -- 10.20.193.57:0/3768421100 shutdown_connections 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 -- 10.20.193.57:0/3768421100 >> 10.20.193.57:0/3768421100 conn(0x7f61d0091620 msgr2=0x7f61d0091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 -- 10.20.193.57:0/3768421100 shutdown_connections 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 -- 10.20.193.57:0/3768421100 wait complete. 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient: build_initial_monmap 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient: monmap: 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 Processor -- start 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 -- start start 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient: init 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:45:06.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient(hunting): picked mon.noname-a con 0x7f61d008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient(hunting): picked mon.noname-b con 0x7f61d008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient(hunting): picked mon.noname-c con 0x7f61d008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d008d9c0 con 0x7f61d008ae20 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d0085040 con 0x7f61d008c730 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d0085600 con 0x7f61d008cb30 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.431+0000 7f61d5794640 10 monclient(hunting): authenticate will time out at 1586.250991s 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.432+0000 7f61ceffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f61d008ae20 0x7f61d0153350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47066/0 (socket says 10.20.193.57:47066) 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.432+0000 7f61ceffd640 1 -- 10.20.193.57:0/2454196453 learned_addr learned my addr 10.20.193.57:0/2454196453 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61ceffd640 1 -- 10.20.193.57:0/2454196453 >> v1:10.20.193.57:6789/0 conn(0x7f61d008ae20 legacy=0x7f61d0153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61cf7fe640 1 -- 10.20.193.57:0/2454196453 >> v1:10.20.193.57:6790/0 conn(0x7f61d008cb30 legacy=0x7f61d01956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61ce7fc640 1 -- 10.20.193.57:0/2454196453 >> v1:10.20.193.82:6789/0 conn(0x7f61d008c730 legacy=0x7f61d0193fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61ceffd640 1 --1- 10.20.193.57:0/2454196453 >> v1:10.20.193.57:6789/0 conn(0x7f61d008ae20 0x7f61d0153350 :-1 s=OPENED pgs=606 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f61d008d9c0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649814304 0 0) 0x7f61d0085600 con 0x7f61d008cb30 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): my global_id is 114125 2026-02-12T17:45:06.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f619c0035e0 con 0x7f61d008cb30 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2398503473 0 0) 0x7f61d0085040 con 0x7f61d008c730 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): my global_id is 5233 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61d0085600 con 0x7f61d008c730 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3162631219 0 0) 0x7f619c0035e0 con 0x7f61d008cb30 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61d0085040 con 0x7f61d008cb30 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f61c0004440 con 0x7f61d008cb30 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:06.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): dump: 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4266068997 0 0) 0x7f61d0085040 con 0x7f61d008cb30 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 >> v1:10.20.193.82:6789/0 conn(0x7f61d008c730 legacy=0x7f61d0193fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 >> v1:10.20.193.57:6789/0 conn(0x7f61d008ae20 legacy=0x7f61d0153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 monclient: found mon.c 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d0088810 con 0x7f61d008cb30 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient: _finish_auth 0 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61d5794640 5 monclient: authenticate success, global_id 114125 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 721398685 0 0) 0x7f61d008d9c0 con 0x7f61d008ae20 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61d5794640 10 monclient: _renew_subs 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61d5794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61d0083300 con 0x7f61d008cb30 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61d5794640 10 monclient: _renew_subs 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61d5794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f61d0153a60 con 0x7f61d008cb30 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61c00045e0 con 0x7f61d008cb30 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f61c0005de0 con 0x7f61d008cb30 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61cd7fa640 4 set_mon_vals no callback set 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.434+0000 7f61af7fe640 10 monclient: dump: 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.432 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.435+0000 7f61d5794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.435+0000 7f61d5794640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.435+0000 7f61d5794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.435+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d0085280 con 0x7f61d008cb30 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.435+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f61c0006030 con 0x7f61d008cb30 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.435+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(856..856 src has 637..856) ==== 3915+0+0 (unknown 515848217 0 0) 0x7f61c004fb60 con 0x7f61d008cb30 2026-02-12T17:45:06.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.435+0000 7f61ceffd640 10 monclient: get_auth_request con 0x7f619c03f740 auth_method 0 2026-02-12T17:45:06.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.438+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f61c0018340 con 0x7f61d008cb30 2026-02-12T17:45:06.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.438+0000 7f61af7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:06.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.438+0000 7f61af7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:06.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3929941327}) 2026-02-12T17:45:06.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1034349554}) 2026-02-12T17:45:06.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:45:06.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3929941327}) 2026-02-12T17:45:06.583 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:45:06.581+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3470890368}) 2026-02-12T17:45:06.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.589+0000 7f61d5794640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:45:06.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.589+0000 7f61d5794640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:45:06.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.589+0000 7f61d5794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.589+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f61d0055340 con 0x7f61d008cb30 2026-02-12T17:45:06.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.589+0000 7f61af7fe640 1 -- 10.20.193.57:0/2454196453 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 3766448084) 0x7f61c0017af0 con 0x7f61d008cb30 2026-02-12T17:45:06.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.589+0000 7f61af7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:45:06.586 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.589+0000 7f61af7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:06.586 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":64,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:45:06.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.590+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 >> v1:10.20.193.82:6800/2441377515 conn(0x7f619c03f740 legacy=0x7f619c05fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.590+0000 7f61d5794640 10 monclient: shutdown 2026-02-12T17:45:06.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.590+0000 7f61d5794640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:06.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.590+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 >> v1:10.20.193.57:6790/0 conn(0x7f61d008cb30 legacy=0x7f61d01956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.590+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 shutdown_connections 2026-02-12T17:45:06.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.590+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 >> 10.20.193.57:0/2454196453 conn(0x7f61d0091620 msgr2=0x7f61d0088b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:06.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.590+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 shutdown_connections 2026-02-12T17:45:06.587 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.590+0000 7f61d5794640 1 -- 10.20.193.57:0/2454196453 wait complete. 2026-02-12T17:45:06.594 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:45:06.594 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T17:45:06.594 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:45:06.594 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient: get_monmap_and_config 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient: build_initial_monmap 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient: monmap: 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:06.664955+0000 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:06.664955+0000 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.660 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 1 Processor -- start 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 1 -- start start 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient: init 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient(hunting): picked mon.noname-c con 0x7f181008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient(hunting): picked mon.noname-a con 0x7f181008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient(hunting): picked mon.noname-b con 0x7f1810182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181008a820 con 0x7f181008c620 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1810089450 con 0x7f181008c250 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1810089730 con 0x7f1810182cc0 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f181730c640 10 monclient(hunting): authenticate will time out at 1586.483873s 2026-02-12T17:45:06.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f1815882640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f1810182cc0 0x7f18101a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32854/0 (socket says 10.20.193.57:32854) 2026-02-12T17:45:06.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f1814880640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f181008c620 0x7f181008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47074/0 (socket says 10.20.193.57:47074) 2026-02-12T17:45:06.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.664+0000 7f1815882640 1 -- 10.20.193.57:0/3749543814 learned_addr learned my addr 10.20.193.57:0/3749543814 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f1815882640 1 -- 10.20.193.57:0/3749543814 >> v1:10.20.193.57:6790/0 conn(0x7f1810182cc0 legacy=0x7f18101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f1814880640 1 -- 10.20.193.57:0/3749543814 >> v1:10.20.193.57:6789/0 conn(0x7f181008c620 legacy=0x7f181008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f1815081640 1 -- 10.20.193.57:0/3749543814 >> v1:10.20.193.82:6789/0 conn(0x7f181008c250 legacy=0x7f181008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 856610596 0 0) 0x7f1804002c20 con 0x7f181008c620 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient(hunting): my global_id is 74484 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17f80035e0 con 0x7f181008c620 2026-02-12T17:45:06.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374029648 0 0) 0x7f1810089730 con 0x7f1810182cc0 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient(hunting): my global_id is 114128 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1804002c20 con 0x7f1810182cc0 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 673755725 0 0) 0x7f1804002c20 con 0x7f1810182cc0 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 >> v1:10.20.193.82:6789/0 conn(0x7f181008c250 legacy=0x7f181008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 >> v1:10.20.193.57:6789/0 conn(0x7f181008c620 legacy=0x7f181008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: _finish_hunting 0 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 monclient: found mon.noname-b 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.664 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1810089a10 con 0x7f1810182cc0 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: _finish_auth 0 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: _check_auth_tickets 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f180c004230 con 0x7f1810182cc0 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: dump: 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f181730c640 5 monclient: authenticate success, global_id 114128 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f181730c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f180c004400 con 0x7f1810182cc0 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f181730c640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f181730c640 4 set_mon_vals no callback set 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 1 -- 10.20.193.57:0/3749543814 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f180c005bf0 con 0x7f1810182cc0 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f17fffff640 10 monclient: dump: 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.665 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f181730c640 10 monclient: shutdown 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f181730c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f181730c640 1 -- 10.20.193.57:0/3749543814 >> v1:10.20.193.57:6790/0 conn(0x7f1810182cc0 legacy=0x7f18101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f181730c640 1 -- 10.20.193.57:0/3749543814 shutdown_connections 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.667+0000 7f181730c640 1 -- 10.20.193.57:0/3749543814 >> 10.20.193.57:0/3749543814 conn(0x7f18100916b0 msgr2=0x7f1810091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 1 -- 10.20.193.57:0/3749543814 shutdown_connections 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 1 -- 10.20.193.57:0/3749543814 wait complete. 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient: build_initial_monmap 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient: monmap: 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 1 Processor -- start 2026-02-12T17:45:06.666 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 1 -- start start 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient: init 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient(hunting): picked mon.noname-b con 0x7f181008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient(hunting): picked mon.noname-c con 0x7f181008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient(hunting): picked mon.noname-a con 0x7f1810182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181013e830 con 0x7f1810182cc0 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1810087140 con 0x7f181008c250 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181005d580 con 0x7f181008c620 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f181730c640 10 monclient(hunting): authenticate will time out at 1586.487940s 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f1814880640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f181008c620 0x7f181005ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32870/0 (socket says 10.20.193.57:32870) 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.668+0000 7f1814880640 1 -- 10.20.193.57:0/752059938 learned_addr learned my addr 10.20.193.57:0/752059938 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f1814880640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6790/0 conn(0x7f181008c620 legacy=0x7f181005ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.667 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f1815882640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6789/0 conn(0x7f1810182cc0 legacy=0x7f18101953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838007766 0 0) 0x7f181005d580 con 0x7f181008c620 2026-02-12T17:45:06.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): my global_id is 114131 2026-02-12T17:45:06.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17e00035e0 con 0x7f181008c620 2026-02-12T17:45:06.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431511285 0 0) 0x7f181013e830 con 0x7f1810182cc0 2026-02-12T17:45:06.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.668 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): my global_id is 74487 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f181005d580 con 0x7f1810182cc0 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f1815081640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.82:6789/0 conn(0x7f181008c250 legacy=0x7f181005c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 152619403 0 0) 0x7f17e00035e0 con 0x7f181008c620 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f181013e830 con 0x7f181008c620 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f18040048a0 con 0x7f181008c620 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): dump: 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3182917738 0 0) 0x7f181005d580 con 0x7f1810182cc0 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f17e00035e0 con 0x7f1810182cc0 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f180c005980 con 0x7f1810182cc0 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): dump: 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.669 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840171668 0 0) 0x7f1810087140 con 0x7f181008c250 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient(hunting): my global_id is 5239 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f181005d580 con 0x7f181008c250 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1150347687 0 0) 0x7f181013e830 con 0x7f181008c620 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.82:6789/0 conn(0x7f181008c250 legacy=0x7f181005c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6789/0 conn(0x7f1810182cc0 legacy=0x7f18101953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient: _finish_hunting 0 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 monclient: found mon.c 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1810087420 con 0x7f181008c620 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient: _finish_auth 0 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient: _check_auth_tickets 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f181730c640 5 monclient: authenticate success, global_id 114131 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f181730c640 10 monclient: _renew_subs 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f181730c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f181008eef0 con 0x7f181008c620 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f181730c640 10 monclient: _renew_subs 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f181730c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1810086e60 con 0x7f181008c620 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1804004cb0 con 0x7f181008c620 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1804004fd0 con 0x7f181008c620 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17ff7fe640 4 set_mon_vals no callback set 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.671+0000 7f17fdffb640 10 monclient: dump: 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.670 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.672+0000 7f181730c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.672+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1810090810 con 0x7f181018dae0 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.672+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1804011c40 con 0x7f181008c620 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.672+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(856..856 src has 637..856) ==== 3915+0+0 (unknown 515848217 0 0) 0x7f180404ea90 con 0x7f181008c620 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.672+0000 7f1815882640 10 monclient: get_auth_request con 0x7f17e003fcb0 auth_method 0 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f1815081640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6789/0 conn(0x7f181018dae0 legacy=0x7f1810058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789140218 0 0) 0x7f1810090810 con 0x7f181018dae0 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 10 monclient(hunting): my global_id is 74490 2026-02-12T17:45:06.671 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f181013e830 con 0x7f181018dae0 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4004676061 0 0) 0x7f181013e830 con 0x7f181018dae0 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1810090810 con 0x7f181018dae0 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f18000031f0 con 0x7f181018dae0 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 10 monclient: dump: 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3677368092 0 0) 0x7f1810090810 con 0x7f181018dae0 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.674+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f181018deb0 con 0x7f181018dae0 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.675+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1800005880 con 0x7f181018dae0 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.675+0000 7f17fdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.675+0000 7f17fdffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.675+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6789/0 conn(0x7f181018dae0 legacy=0x7f1810058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.672 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.675+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6789/0 conn(0x7f181018dae0 legacy=0x7f1810058410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:06.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.678+0000 7f181730c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:45:06.674 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.678+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f181008f5b0 con 0x7f181004d1c0 2026-02-12T17:45:06.676 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f1815081640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6789/0 conn(0x7f181004d1c0 legacy=0x7f1810197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426020686 0 0) 0x7f181008f5b0 con 0x7f181004d1c0 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 10 monclient(hunting): my global_id is 74493 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1810090810 con 0x7f181004d1c0 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3796392372 0 0) 0x7f1810090810 con 0x7f181004d1c0 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f181008f5b0 con 0x7f181004d1c0 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1800003b00 con 0x7f181004d1c0 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 10 monclient: dump: 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1554387309 0 0) 0x7f181008f5b0 con 0x7f181004d1c0 2026-02-12T17:45:06.677 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.680+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1810055340 con 0x7f181004d1c0 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 3759837013) 0x7f1800005aa0 con 0x7f181004d1c0 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f17fdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f17fdffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6789/0 conn(0x7f181004d1c0 legacy=0x7f1810197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f17fdffb640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6789/0 conn(0x7f181004d1c0 legacy=0x7f1810197b00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 64, 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 433144, 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:45:06.678 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:45:06.679 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:06.680 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:45:06.681 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:45:06.682 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.82:6800/2441377515 conn(0x7f17e003fcb0 legacy=0x7f17e0060160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f181730c640 10 monclient: shutdown 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f181730c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 >> v1:10.20.193.57:6790/0 conn(0x7f181008c620 legacy=0x7f181005ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f1815882640 1 -- 10.20.193.57:0/752059938 reap_dead start 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f1815882640 1 -- 10.20.193.57:0/752059938 reap_dead start 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 shutdown_connections 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 >> 10.20.193.57:0/752059938 conn(0x7f18100916b0 msgr2=0x7f181018e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 shutdown_connections 2026-02-12T17:45:06.683 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.681+0000 7f181730c640 1 -- 10.20.193.57:0/752059938 wait complete. 2026-02-12T17:45:06.683 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:45:06.683 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:45:06.684 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:45:06.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient: get_monmap_and_config 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient: build_initial_monmap 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient: monmap: 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:06.752904+0000 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:06.752904+0000 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:06.749 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 1 Processor -- start 2026-02-12T17:45:06.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 1 -- start start 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient: init 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient(hunting): picked mon.noname-b con 0x7fb30808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient(hunting): picked mon.noname-a con 0x7fb30808c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient(hunting): picked mon.noname-c con 0x7fb308182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30808a820 con 0x7fb30808c620 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb308089450 con 0x7fb308182cc0 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb308089730 con 0x7fb30808c250 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb30e647640 10 monclient(hunting): authenticate will time out at 1586.571800s 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb307fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fb30808c250 0x7fb30808a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32886/0 (socket says 10.20.193.57:32886) 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb307fff640 1 -- 10.20.193.57:0/2845417509 learned_addr learned my addr 10.20.193.57:0/2845417509 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:06.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.752+0000 7fb3077fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fb30808c620 0x7fb30808caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47108/0 (socket says 10.20.193.57:47108) 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb3077fe640 1 -- 10.20.193.57:0/2845417509 >> v1:10.20.193.57:6789/0 conn(0x7fb30808c620 legacy=0x7fb30808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb307fff640 1 -- 10.20.193.57:0/2845417509 >> v1:10.20.193.57:6790/0 conn(0x7fb30808c250 legacy=0x7fb30808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30cbbd640 1 -- 10.20.193.57:0/2845417509 >> v1:10.20.193.82:6789/0 conn(0x7fb308182cc0 legacy=0x7fb3081a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506761048 0 0) 0x7fb2f8002c20 con 0x7fb30808c620 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): my global_id is 74496 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2ec0035e0 con 0x7fb30808c620 2026-02-12T17:45:06.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761651676 0 0) 0x7fb308089730 con 0x7fb30808c250 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): my global_id is 114134 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2f8002c20 con 0x7fb30808c250 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998477278 0 0) 0x7fb308089450 con 0x7fb308182cc0 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient(hunting): my global_id is 5242 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb308089730 con 0x7fb308182cc0 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2584616121 0 0) 0x7fb2ec0035e0 con 0x7fb30808c620 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 >> v1:10.20.193.57:6790/0 conn(0x7fb30808c250 legacy=0x7fb30808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 >> v1:10.20.193.82:6789/0 conn(0x7fb308182cc0 legacy=0x7fb3081a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 monclient: found mon.noname-a 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:06.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb308089a10 con 0x7fb30808c620 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: _finish_auth 0 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2f80032e0 con 0x7fb30808c620 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: dump: 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 5 monclient: authenticate success, global_id 74496 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2f80034b0 con 0x7fb30808c620 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 1 -- 10.20.193.57:0/2845417509 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2f8004a50 con 0x7fb30808c620 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb306ffd640 10 monclient: dump: 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 4 set_mon_vals no callback set 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 10 monclient: shutdown 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 1 -- 10.20.193.57:0/2845417509 >> v1:10.20.193.57:6789/0 conn(0x7fb30808c620 legacy=0x7fb30808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 1 -- 10.20.193.57:0/2845417509 shutdown_connections 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 1 -- 10.20.193.57:0/2845417509 >> 10.20.193.57:0/2845417509 conn(0x7fb3080916b0 msgr2=0x7fb308091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 1 -- 10.20.193.57:0/2845417509 shutdown_connections 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.755+0000 7fb30e647640 1 -- 10.20.193.57:0/2845417509 wait complete. 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient: build_initial_monmap 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient: monmap: 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:06.758 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 1 Processor -- start 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 1 -- start start 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient: init 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient(hunting): picked mon.noname-b con 0x7fb30808c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient(hunting): picked mon.noname-c con 0x7fb30808c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient(hunting): picked mon.noname-a con 0x7fb308182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30813b930 con 0x7fb308182cc0 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30813a240 con 0x7fb30808c250 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3080888a0 con 0x7fb30808c620 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb30e647640 10 monclient(hunting): authenticate will time out at 1586.575624s 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb3077fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fb30808c620 0x7fb308138730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32902/0 (socket says 10.20.193.57:32902) 2026-02-12T17:45:06.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.756+0000 7fb3077fe640 1 -- 10.20.193.57:0/3355738678 learned_addr learned my addr 10.20.193.57:0/3355738678 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb30cbbd640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6789/0 conn(0x7fb308182cc0 legacy=0x7fb3081954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb3077fe640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6790/0 conn(0x7fb30808c620 legacy=0x7fb308138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910354319 0 0) 0x7fb3080888a0 con 0x7fb30808c620 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 10 monclient(hunting): my global_id is 114137 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d80035e0 con 0x7fb30808c620 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698093187 0 0) 0x7fb30813b930 con 0x7fb308182cc0 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 10 monclient(hunting): my global_id is 74499 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.758+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3080888a0 con 0x7fb308182cc0 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb307fff640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.82:6789/0 conn(0x7fb30808c250 legacy=0x7fb308138020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 48214789 0 0) 0x7fb2d80035e0 con 0x7fb30808c620 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb30813b930 con 0x7fb30808c620 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2f80048a0 con 0x7fb30808c620 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): dump: 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.764 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3416051031 0 0) 0x7fb3080888a0 con 0x7fb308182cc0 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2d80035e0 con 0x7fb308182cc0 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2fc0044e0 con 0x7fb308182cc0 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): dump: 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.765 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2217088266 0 0) 0x7fb30813a240 con 0x7fb30808c250 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient(hunting): my global_id is 5245 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3080888a0 con 0x7fb30808c250 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1439644241 0 0) 0x7fb30813b930 con 0x7fb30808c620 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.82:6789/0 conn(0x7fb30808c250 legacy=0x7fb308138020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6789/0 conn(0x7fb308182cc0 legacy=0x7fb3081954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 monclient: found mon.c 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30813b650 con 0x7fb30808c620 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient: _finish_auth 0 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:06.766 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb30e647640 5 monclient: authenticate success, global_id 114137 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb30e647640 10 monclient: _renew_subs 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb30e647640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb308138e40 con 0x7fb30808c620 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb30e647640 10 monclient: _renew_subs 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb30e647640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb30813bc10 con 0x7fb30808c620 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2f8005030 con 0x7fb30808c620 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2f8005350 con 0x7fb30808c620 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb304ff9640 10 monclient: dump: 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.767 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb3067fc640 4 set_mon_vals no callback set 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb30e647640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.759+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb30813e6a0 con 0x7fb30813e2d0 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.760+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fb2f8011fc0 con 0x7fb30808c620 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.760+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(856..856 src has 637..856) ==== 3915+0+0 (unknown 515848217 0 0) 0x7fb2f804ecb0 con 0x7fb30808c620 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.760+0000 7fb30cbbd640 10 monclient: get_auth_request con 0x7fb2d803fc90 auth_method 0 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb307fff640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6790/0 conn(0x7fb30813e2d0 legacy=0x7fb308085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311996001 0 0) 0x7fb30813e6a0 con 0x7fb30813e2d0 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 10 monclient(hunting): my global_id is 114140 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb30813b930 con 0x7fb30813e2d0 2026-02-12T17:45:06.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1318572665 0 0) 0x7fb30813b930 con 0x7fb30813e2d0 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb30813e6a0 con 0x7fb30813e2d0 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2f40031a0 con 0x7fb30813e2d0 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 10 monclient: dump: 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2846869422 0 0) 0x7fb30813e6a0 con 0x7fb30813e2d0 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb308090810 con 0x7fb30813e2d0 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fb2f40048a0 con 0x7fb30813e2d0 2026-02-12T17:45:06.769 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:06.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:06.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6790/0 conn(0x7fb30813e2d0 legacy=0x7fb308085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.762+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6790/0 conn(0x7fb30813e2d0 legacy=0x7fb308085720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:06.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.765+0000 7fb30e647640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:45:06.770 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.765+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb30808a820 con 0x7fb308085e30 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb307fff640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6790/0 conn(0x7fb308085e30 legacy=0x7fb308197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982610974 0 0) 0x7fb3080888a0 con 0x7fb308085e30 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 10 monclient(hunting): my global_id is 114143 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb30813e6a0 con 0x7fb308085e30 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1583557837 0 0) 0x7fb30813e6a0 con 0x7fb308085e30 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3080888a0 con 0x7fb308085e30 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fb2f4004ea0 con 0x7fb308085e30 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:06.771 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 10 monclient: dump: 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 702398397 0 0) 0x7fb3080888a0 con 0x7fb308085e30 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb30808f580 con 0x7fb308085e30 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4336 (unknown 0 0 2439453567) 0x7fb2f40071f0 con 0x7fb308085e30 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6790/0 conn(0x7fb308085e30 legacy=0x7fb308197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.772 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb304ff9640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6790/0 conn(0x7fb308085e30 legacy=0x7fb308197c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 64, 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 2150, 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:06.773 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:45:06.774 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:45:06.775 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:06.776 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:06.777 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:06.778 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:06.779 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:45:06.780 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:45:06.781 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:45:06.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.82:6800/2441377515 conn(0x7fb2d803fc90 legacy=0x7fb2d8060140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30e647640 10 monclient: shutdown 2026-02-12T17:45:06.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30e647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:06.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 >> v1:10.20.193.57:6790/0 conn(0x7fb30808c620 legacy=0x7fb308138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30cbbd640 1 -- 10.20.193.57:0/3355738678 reap_dead start 2026-02-12T17:45:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30cbbd640 1 -- 10.20.193.57:0/3355738678 reap_dead start 2026-02-12T17:45:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 shutdown_connections 2026-02-12T17:45:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 >> 10.20.193.57:0/3355738678 conn(0x7fb3080916b0 msgr2=0x7fb30808a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 shutdown_connections 2026-02-12T17:45:06.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.768+0000 7fb30e647640 1 -- 10.20.193.57:0/3355738678 wait complete. 2026-02-12T17:45:06.783 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:45:06.783 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:45:06.783 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:45:06.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.850+0000 7fe99ca07640 10 monclient: get_monmap_and_config 2026-02-12T17:45:06.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.850+0000 7fe99ca07640 10 monclient: build_initial_monmap 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.850+0000 7fe99ca07640 10 monclient: monmap: 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:06.851687+0000 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:06.851687+0000 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:06.848 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 1 Processor -- start 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 1 -- start start 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 10 monclient: init 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 10 monclient(hunting): picked mon.noname-a con 0x7fe998085720 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 10 monclient(hunting): picked mon.noname-c con 0x7fe998086ea0 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 10 monclient(hunting): picked mon.noname-b con 0x7fe998086200 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe998088220 con 0x7fe998085720 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe998089500 con 0x7fe998086ea0 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe998087f40 con 0x7fe998086200 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe99ca07640 10 monclient(hunting): authenticate will time out at 1586.670714s 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe996d76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe998086200 0x7fe9981a2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32922/0 (socket says 10.20.193.57:32922) 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe996d76640 1 -- 10.20.193.57:0/2561583697 learned_addr learned my addr 10.20.193.57:0/2561583697 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:06.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.851+0000 7fe996575640 1 --1- 10.20.193.57:0/2561583697 >> v1:10.20.193.57:6789/0 conn(0x7fe998085720 0x7fe998085af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47124/0 (socket says 10.20.193.57:47124) 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.853+0000 7fe996d76640 1 -- 10.20.193.57:0/2561583697 >> v1:10.20.193.57:6790/0 conn(0x7fe998086200 legacy=0x7fe9981a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.853+0000 7fe996575640 1 -- 10.20.193.57:0/2561583697 >> v1:10.20.193.57:6789/0 conn(0x7fe998085720 legacy=0x7fe998085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651698196 0 0) 0x7fe998088220 con 0x7fe998085720 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient(hunting): my global_id is 74502 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9840035e0 con 0x7fe998085720 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898111487 0 0) 0x7fe998087f40 con 0x7fe998086200 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient(hunting): my global_id is 114146 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe998088220 con 0x7fe998086200 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995d74640 1 -- 10.20.193.57:0/2561583697 >> v1:10.20.193.82:6789/0 conn(0x7fe998086ea0 legacy=0x7fe998180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3598766845 0 0) 0x7fe9840035e0 con 0x7fe998085720 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 >> v1:10.20.193.57:6790/0 conn(0x7fe998086200 legacy=0x7fe9981a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 >> v1:10.20.193.82:6789/0 conn(0x7fe998086ea0 legacy=0x7fe998180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: _finish_hunting 0 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 monclient: found mon.noname-a 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9980867e0 con 0x7fe998085720 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: _finish_auth 0 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: _check_auth_tickets 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe98c0030d0 con 0x7fe998085720 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: dump: 2026-02-12T17:45:06.854 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 5 monclient: authenticate success, global_id 74502 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe98c003360 con 0x7fe998085720 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 4 set_mon_vals no callback set 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 1 -- 10.20.193.57:0/2561583697 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe98c004a50 con 0x7fe998085720 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe995573640 10 monclient: dump: 2026-02-12T17:45:06.855 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 10 monclient: shutdown 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 1 -- 10.20.193.57:0/2561583697 >> v1:10.20.193.57:6789/0 conn(0x7fe998085720 legacy=0x7fe998085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 1 -- 10.20.193.57:0/2561583697 shutdown_connections 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 1 -- 10.20.193.57:0/2561583697 >> 10.20.193.57:0/2561583697 conn(0x7fe9980916b0 msgr2=0x7fe998091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 1 -- 10.20.193.57:0/2561583697 shutdown_connections 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.854+0000 7fe99ca07640 1 -- 10.20.193.57:0/2561583697 wait complete. 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient: build_initial_monmap 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient: monmap: 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:06.856 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 1 Processor -- start 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 1 -- start start 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient: init 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient(hunting): picked mon.noname-b con 0x7fe998085720 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient(hunting): picked mon.noname-c con 0x7fe998086200 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient(hunting): picked mon.noname-a con 0x7fe998086ea0 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe99808ab40 con 0x7fe998086ea0 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe99805d5c0 con 0x7fe998085720 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe998081a90 con 0x7fe998086200 2026-02-12T17:45:06.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:06.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe99ca07640 10 monclient(hunting): authenticate will time out at 1586.674710s 2026-02-12T17:45:06.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe995d74640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe998086200 0x7fe9981a0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:32932/0 (socket says 10.20.193.57:32932) 2026-02-12T17:45:06.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.855+0000 7fe995d74640 1 -- 10.20.193.57:0/836596985 learned_addr learned my addr 10.20.193.57:0/836596985 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.857+0000 7fe996d76640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.57:6789/0 conn(0x7fe998086ea0 legacy=0x7fe9981a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.857+0000 7fe995d74640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.57:6790/0 conn(0x7fe998086200 legacy=0x7fe9981a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe996575640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.82:6789/0 conn(0x7fe998085720 legacy=0x7fe998132f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368934373 0 0) 0x7fe99808ab40 con 0x7fe998086ea0 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): my global_id is 74505 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9640035e0 con 0x7fe998086ea0 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300664287 0 0) 0x7fe998081a90 con 0x7fe998086200 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): my global_id is 114149 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe99808ab40 con 0x7fe998086200 2026-02-12T17:45:06.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1879503742 0 0) 0x7fe9640035e0 con 0x7fe998086ea0 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe998081a90 con 0x7fe998086ea0 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe988003ef0 con 0x7fe998086ea0 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): dump: 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3850014056 0 0) 0x7fe99805d5c0 con 0x7fe998085720 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): my global_id is 5251 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9640035e0 con 0x7fe998085720 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2776881603 0 0) 0x7fe99808ab40 con 0x7fe998086200 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe99805d5c0 con 0x7fe998086200 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe980003390 con 0x7fe998086200 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient(hunting): dump: 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 318227341 0 0) 0x7fe998081a90 con 0x7fe998086ea0 2026-02-12T17:45:06.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.57:6790/0 conn(0x7fe998086200 legacy=0x7fe9981a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.82:6789/0 conn(0x7fe998085720 legacy=0x7fe998132f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient: _finish_hunting 0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 monclient: found mon.a 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9980888a0 con 0x7fe998086ea0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient: _finish_auth 0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient: _check_auth_tickets 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe99ca07640 5 monclient: authenticate success, global_id 74505 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe99ca07640 10 monclient: _renew_subs 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe99ca07640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe9980817b0 con 0x7fe998086ea0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe99ca07640 10 monclient: _renew_subs 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe99ca07640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe9980582c0 con 0x7fe998086ea0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe988005c30 con 0x7fe998086ea0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe9880040d0 con 0x7fe998086ea0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.864 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe994d72640 4 set_mon_vals no callback set 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe97effd640 10 monclient: dump: 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe99ca07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.858+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe998090810 con 0x7fe998133610 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.859+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe988012ae0 con 0x7fe998086ea0 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.859+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(856..856 src has 637..856) ==== 3915+0+0 (unknown 515848217 0 0) 0x7fe98804fbd0 con 0x7fe998086ea0 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.859+0000 7fe995d74640 10 monclient: get_auth_request con 0x7fe96403fc70 auth_method 0 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe996575640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.82:6789/0 conn(0x7fe998133610 legacy=0x7fe99805a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.865 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432502548 0 0) 0x7fe998090810 con 0x7fe998133610 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 10 monclient(hunting): my global_id is 5254 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe998081a90 con 0x7fe998133610 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1636760267 0 0) 0x7fe998081a90 con 0x7fe998133610 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe998090810 con 0x7fe998133610 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe98c004a50 con 0x7fe998133610 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 10 monclient: dump: 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.866 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 389238232 0 0) 0x7fe998090810 con 0x7fe998133610 2026-02-12T17:45:06.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9980811f0 con 0x7fe998133610 2026-02-12T17:45:06.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7fe98c007a20 con 0x7fe998133610 2026-02-12T17:45:06.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:06.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:06.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.82:6789/0 conn(0x7fe998133610 legacy=0x7fe99805a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.867 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.861+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.82:6789/0 conn(0x7fe998133610 legacy=0x7fe99805a180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.865+0000 7fe99ca07640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.865+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe99808f5b0 con 0x7fe99805a890 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.867+0000 7fe996575640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.82:6789/0 conn(0x7fe99805a890 legacy=0x7fe99813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.867+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792062682 0 0) 0x7fe99808f5b0 con 0x7fe99805a890 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.867+0000 7fe97effd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.867+0000 7fe97effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.867+0000 7fe97effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.867+0000 7fe97effd640 10 monclient(hunting): my global_id is 5257 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.867+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe998090810 con 0x7fe99805a890 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4265278625 0 0) 0x7fe998090810 con 0x7fe99805a890 2026-02-12T17:45:06.868 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe99808f5b0 con 0x7fe99805a890 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe98c0053d0 con 0x7fe99805a890 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 10 monclient: dump: 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3534269597 0 0) 0x7fe99808f5b0 con 0x7fe99805a890 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe998087300 con 0x7fe99805a890 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 3810769562) 0x7fe98c007b90 con 0x7fe99805a890 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:06.869 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.82:6789/0 conn(0x7fe99805a890 legacy=0x7fe99813c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe97effd640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.82:6789/0 conn(0x7fe99805a890 legacy=0x7fe99813c510 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 64, 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 1028364, 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.870 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 2, 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:06.871 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:06.872 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:45:06.873 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:06.874 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.875 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.876 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:06.877 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:06.878 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.879 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:06.880 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:06.881 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:45:06.882 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:45:06.883 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe96403fc70 legacy=0x7fe964060120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe99ca07640 10 monclient: shutdown 2026-02-12T17:45:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe99ca07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 >> v1:10.20.193.57:6789/0 conn(0x7fe998086ea0 legacy=0x7fe9981a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe996d76640 1 -- 10.20.193.57:0/836596985 reap_dead start 2026-02-12T17:45:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 shutdown_connections 2026-02-12T17:45:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 >> 10.20.193.57:0/836596985 conn(0x7fe9980916b0 msgr2=0x7fe99808cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 shutdown_connections 2026-02-12T17:45:06.884 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:06.868+0000 7fe99ca07640 1 -- 10.20.193.57:0/836596985 wait complete. 2026-02-12T17:45:06.884 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:45:06.885 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-12T17:45:06.885 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-12T17:45:06.885 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-12T17:45:06.885 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-12T17:45:06.885 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T17:45:06.885 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:45:06.896 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T17:45:06.896 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-12T17:45:06.896 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-12T17:45:06.896 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-12T17:45:06.897 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T17:45:21.897 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-12T17:45:21.898 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-12T17:45:21.898 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-12T17:45:21.898 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-12T17:45:21.898 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:45:21.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.968+0000 7f514decc640 10 monclient: get_monmap_and_config 2026-02-12T17:45:21.964 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.968+0000 7f514decc640 10 monclient: build_initial_monmap 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.968+0000 7f514decc640 10 monclient: monmap: 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:21.969162+0000 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:21.969162+0000 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.968+0000 7f514decc640 1 Processor -- start 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.968+0000 7f514decc640 1 -- start start 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.968+0000 7f514decc640 10 monclient: init 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.968+0000 7f514decc640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.968+0000 7f514decc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.968+0000 7f514decc640 10 monclient(hunting): picked mon.noname-c con 0x7f514808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f514decc640 10 monclient(hunting): picked mon.noname-a con 0x7f514808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f514decc640 10 monclient(hunting): picked mon.noname-b con 0x7f514808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f514decc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f514808d600 con 0x7f514808c730 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f514decc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f514808b1f0 con 0x7f514808ae20 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f514decc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f514808d1f0 con 0x7f514808cb30 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f514decc640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f514decc640 10 monclient(hunting): authenticate will time out at 1601.788042s 2026-02-12T17:45:21.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f5146ffd640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5148181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f5147fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f514808cb30 0x7f51481a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:44074/0 (socket says 10.20.193.57:44074) 2026-02-12T17:45:21.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.969+0000 7f5147fff640 1 -- 10.20.193.57:0/3871780745 learned_addr learned my addr 10.20.193.57:0/3871780745 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.971+0000 7f5147fff640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6790/0 conn(0x7f514808cb30 legacy=0x7f51481a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:21.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:21.971+0000 7f51477fe640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.82:6789/0 conn(0x7f514808ae20 legacy=0x7f514808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:22.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:22.169+0000 7f5146ffd640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5148181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:22.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:22.570+0000 7f5146ffd640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5148181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:23.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:23.371+0000 7f5146ffd640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5148181be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:24.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 10 monclient(hunting): tick 2026-02-12T17:45:24.965 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 1 monclient(hunting): continuing hunt 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6790/0 conn(0x7f514808cb30 legacy=0x7f51481a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.82:6789/0 conn(0x7f514808ae20 legacy=0x7f514808c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5148181be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 10 monclient(hunting): picked mon.noname-c con 0x7f514808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 10 monclient(hunting): picked mon.noname-b con 0x7f514808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 10 monclient(hunting): picked mon.noname-a con 0x7f514808c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 1 -- 10.20.193.57:0/3871780745 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5148057320 con 0x7f514808c730 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 1 -- 10.20.193.57:0/3871780745 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f514808d600 con 0x7f514808ae20 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f5147fff640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5124066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 1 -- 10.20.193.57:0/3871780745 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f512406a0b0 con 0x7f514808cb30 2026-02-12T17:45:24.966 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.968+0000 7f51457fa640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.970+0000 7f5146ffd640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6790/0 conn(0x7f514808cb30 legacy=0x7f5124045060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:24.967 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:24.970+0000 7f51477fe640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.82:6789/0 conn(0x7f514808ae20 legacy=0x7f5124023890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:25.165 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:25.169+0000 7f5147fff640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5124066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:25.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:25.570+0000 7f5147fff640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5124066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:26.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.371+0000 7f5147fff640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5124066860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.919+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59250822 0 0) 0x7f514808d600 con 0x7f514808ae20 2026-02-12T17:45:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.919+0000 7f51467fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.919+0000 7f51467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.919+0000 7f51467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.919+0000 7f51467fc640 10 monclient(hunting): my global_id is 5260 2026-02-12T17:45:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f512c0035e0 con 0x7f514808ae20 2026-02-12T17:45:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267790058 0 0) 0x7f512406a0b0 con 0x7f514808cb30 2026-02-12T17:45:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient(hunting): my global_id is 114152 2026-02-12T17:45:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f514808d600 con 0x7f514808cb30 2026-02-12T17:45:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2417441210 0 0) 0x7f512c0035e0 con 0x7f514808ae20 2026-02-12T17:45:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6790/0 conn(0x7f514808cb30 legacy=0x7f5124045060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.57:6789/0 conn(0x7f514808c730 legacy=0x7f5124066860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:45:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient: _finish_hunting 0 2026-02-12T17:45:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 1 monclient: found mon.noname-c 2026-02-12T17:45:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.82:6789/0 2026-02-12T17:45:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512406b3d0 con 0x7f514808ae20 2026-02-12T17:45:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient: _finish_auth 0 2026-02-12T17:45:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient: _check_auth_tickets 2026-02-12T17:45:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f51340030e0 con 0x7f514808ae20 2026-02-12T17:45:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f51467fc640 10 monclient: dump: 2026-02-12T17:45:26.931 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:26.931 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:26.931 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:26.932 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:26.932 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:26.932 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:26.932 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:26.932 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:26.932 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:26.932 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:26.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f514decc640 5 monclient: authenticate success, global_id 5260 2026-02-12T17:45:26.932 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.920+0000 7f514decc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 <== mon.1 v1:10.20.193.82:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51340033e0 con 0x7f514808ae20 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f51467fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f51467fc640 1 -- 10.20.193.57:0/3871780745 <== mon.1 v1:10.20.193.82:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5134003880 con 0x7f514808ae20 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f51467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f51467fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f51467fc640 10 monclient: dump: 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:26.933 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 4 set_mon_vals no callback set 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 10 monclient: shutdown 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 1 -- 10.20.193.57:0/3871780745 >> v1:10.20.193.82:6789/0 conn(0x7f514808ae20 legacy=0x7f5124023890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 1 -- 10.20.193.57:0/3871780745 shutdown_connections 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 1 -- 10.20.193.57:0/3871780745 >> 10.20.193.57:0/3871780745 conn(0x7f5148091620 msgr2=0x7f5148091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 1 -- 10.20.193.57:0/3871780745 shutdown_connections 2026-02-12T17:45:26.934 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 1 -- 10.20.193.57:0/3871780745 wait complete. 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 10 monclient: build_initial_monmap 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.921+0000 7f514decc640 10 monclient: monmap: 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:26.935 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 1 Processor -- start 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 1 -- start start 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 10 monclient: init 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 10 monclient(hunting): picked mon.noname-a con 0x7f514808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 10 monclient(hunting): picked mon.noname-b con 0x7f514808c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 10 monclient(hunting): picked mon.noname-c con 0x7f514808cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f51477fe640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f514808ae20 legacy=0x7f51481d9ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f514808d9c0 con 0x7f514808ae20 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51480853e0 con 0x7f514808c730 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5148088810 con 0x7f514808cb30 2026-02-12T17:45:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f514decc640 10 monclient(hunting): authenticate will time out at 1606.742451s 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f5147fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f514808cb30 0x7f514823c290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:51584/0 (socket says 10.20.193.57:51584) 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.922+0000 7f5147fff640 1 -- 10.20.193.57:0/535600054 learned_addr learned my addr 10.20.193.57:0/535600054 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5147fff640 1 -- 10.20.193.57:0/535600054 >> v1:10.20.193.57:6790/0 conn(0x7f514808cb30 legacy=0x7f514823c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5146ffd640 1 -- 10.20.193.57:0/535600054 >> v1:10.20.193.82:6789/0 conn(0x7f514808c730 legacy=0x7f514821ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 666886132 0 0) 0x7f5148088810 con 0x7f514808cb30 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): _negotiate 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): my global_id is 114155 2026-02-12T17:45:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51180035e0 con 0x7f514808cb30 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094308200 0 0) 0x7f51480853e0 con 0x7f514808c730 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): _negotiate 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): my global_id is 5263 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5148088810 con 0x7f514808c730 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 657247729 0 0) 0x7f51180035e0 con 0x7f514808cb30 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51480853e0 con 0x7f514808cb30 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f513c004480 con 0x7f514808cb30 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): dump: 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.924+0000 7f5123fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4191163742 0 0) 0x7f51480853e0 con 0x7f514808cb30 2026-02-12T17:45:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 >> v1:10.20.193.82:6789/0 conn(0x7f514808c730 legacy=0x7f514821ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 >> v1:10.20.193.57:6789/0 conn(0x7f514808ae20 legacy=0x7f51481d9ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 10 monclient: _finish_hunting 0 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 1 monclient: found mon.c 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5148083080 con 0x7f514808cb30 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 10 monclient: _finish_auth 0 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 10 monclient: _check_auth_tickets 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 5 monclient: authenticate success, global_id 114155 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 10 monclient: _renew_subs 2026-02-12T17:45:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5148084b40 con 0x7f514808cb30 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 10 monclient: _renew_subs 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5148083be0 con 0x7f514808cb30 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f513c005ca0 con 0x7f514808cb30 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f513c005fc0 con 0x7f514808cb30 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 10 monclient: dump: 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:26.941 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5145ffb640 4 set_mon_vals no callback set 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f513c006160 con 0x7f514808cb30 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(856..856 src has 637..856) ==== 3915+0+0 (unknown 515848217 0 0) 0x7f513c04fcf0 con 0x7f514808cb30 2026-02-12T17:45:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5148085010 con 0x7f514808cb30 2026-02-12T17:45:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.925+0000 7f51477fe640 10 monclient: get_auth_request con 0x7f511803f760 auth_method 0 2026-02-12T17:45:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.928+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f513c0078b0 con 0x7f514808cb30 2026-02-12T17:45:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.928+0000 7f5123fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:26.928+0000 7f5123fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:27.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.073+0000 7f514decc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:45:27.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.073+0000 7f514decc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:45:27.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.073+0000 7f514decc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:27.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.073+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f51480879e0 con 0x7f514808cb30 2026-02-12T17:45:27.070 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.073+0000 7f5123fff640 1 -- 10.20.193.57:0/535600054 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 1477724494) 0x7f513c017c80 con 0x7f514808cb30 2026-02-12T17:45:27.071 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.073+0000 7f5123fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:45:27.071 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.073+0000 7f5123fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:27.071 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:45:27.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.074+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 >> v1:10.20.193.82:6800/2441377515 conn(0x7f511803f760 legacy=0x7f511805fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.074+0000 7f514decc640 10 monclient: shutdown 2026-02-12T17:45:27.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.074+0000 7f514decc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:27.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.074+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 >> v1:10.20.193.57:6790/0 conn(0x7f514808cb30 legacy=0x7f514823c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.074+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 shutdown_connections 2026-02-12T17:45:27.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.074+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 >> 10.20.193.57:0/535600054 conn(0x7f5148091620 msgr2=0x7f5148089310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:27.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.074+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 shutdown_connections 2026-02-12T17:45:27.072 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.074+0000 7f514decc640 1 -- 10.20.193.57:0/535600054 wait complete. 2026-02-12T17:45:27.079 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-12T17:45:27.079 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-12T17:45:27.080 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:45:27.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.148+0000 7f5c97bfe640 10 monclient: get_monmap_and_config 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.148+0000 7f5c97bfe640 10 monclient: build_initial_monmap 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.148+0000 7f5c97bfe640 10 monclient: monmap: 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:27.150196+0000 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:27.150196+0000 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.148+0000 7f5c97bfe640 1 Processor -- start 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.148+0000 7f5c97bfe640 1 -- start start 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.148+0000 7f5c97bfe640 10 monclient: init 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:45:27.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 10 monclient(hunting): picked mon.noname-c con 0x7f5c9008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 10 monclient(hunting): picked mon.noname-a con 0x7f5c9008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 10 monclient(hunting): picked mon.noname-b con 0x7f5c90182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9008a820 con 0x7f5c9008c620 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c90089450 con 0x7f5c9008c250 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c90089730 con 0x7f5c90182cc0 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c97bfe640 10 monclient(hunting): authenticate will time out at 1606.969140s 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c95172640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f5c9008c620 legacy=0x7f5c9008caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c96174640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f5c90182cc0 0x7f5c901a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:51600/0 (socket says 10.20.193.57:51600) 2026-02-12T17:45:27.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.149+0000 7f5c96174640 1 -- 10.20.193.57:0/3057886797 learned_addr learned my addr 10.20.193.57:0/3057886797 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:27.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c96174640 1 -- 10.20.193.57:0/3057886797 >> v1:10.20.193.57:6790/0 conn(0x7f5c90182cc0 legacy=0x7f5c901a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c95973640 1 -- 10.20.193.57:0/3057886797 >> v1:10.20.193.82:6789/0 conn(0x7f5c9008c250 legacy=0x7f5c9008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075343379 0 0) 0x7f5c90089730 con 0x7f5c90182cc0 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient(hunting): my global_id is 114158 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c780035e0 con 0x7f5c90182cc0 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811389889 0 0) 0x7f5c90089450 con 0x7f5c9008c250 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient(hunting): my global_id is 5266 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c90089730 con 0x7f5c9008c250 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 591097429 0 0) 0x7f5c780035e0 con 0x7f5c90182cc0 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 >> v1:10.20.193.82:6789/0 conn(0x7f5c9008c250 legacy=0x7f5c9008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 >> v1:10.20.193.57:6789/0 conn(0x7f5c9008c620 legacy=0x7f5c9008caa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: _finish_hunting 0 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 monclient: found mon.noname-b 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c90089a10 con 0x7f5c90182cc0 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: _finish_auth 0 2026-02-12T17:45:27.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: _check_auth_tickets 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5c8c0041b0 con 0x7f5c90182cc0 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: dump: 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c97bfe640 5 monclient: authenticate success, global_id 114158 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c97bfe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c8c0044b0 con 0x7f5c90182cc0 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 1 -- 10.20.193.57:0/3057886797 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5c8c005bf0 con 0x7f5c90182cc0 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c94971640 10 monclient: dump: 2026-02-12T17:45:27.151 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c97bfe640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.151+0000 7f5c97bfe640 4 set_mon_vals no callback set 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 10 monclient: shutdown 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 1 -- 10.20.193.57:0/3057886797 >> v1:10.20.193.57:6790/0 conn(0x7f5c90182cc0 legacy=0x7f5c901a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 1 -- 10.20.193.57:0/3057886797 shutdown_connections 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 1 -- 10.20.193.57:0/3057886797 >> 10.20.193.57:0/3057886797 conn(0x7f5c900916b0 msgr2=0x7f5c90091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 1 -- 10.20.193.57:0/3057886797 shutdown_connections 2026-02-12T17:45:27.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 1 -- 10.20.193.57:0/3057886797 wait complete. 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 10 monclient: build_initial_monmap 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 10 monclient: monmap: 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 1 Processor -- start 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 1 -- start start 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.152+0000 7f5c97bfe640 10 monclient: init 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 10 monclient(hunting): picked mon.noname-b con 0x7f5c9008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 10 monclient(hunting): picked mon.noname-a con 0x7f5c9008c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 10 monclient(hunting): picked mon.noname-c con 0x7f5c90182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c90086970 con 0x7f5c9008c620 2026-02-12T17:45:27.155 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9013b1c0 con 0x7f5c9008c250 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c9013b4a0 con 0x7f5c90182cc0 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c97bfe640 10 monclient(hunting): authenticate will time out at 1606.973161s 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c95172640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f5c9008c620 legacy=0x7f5c90085e30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c96174640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f5c90182cc0 0x7f5c90195340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:51614/0 (socket says 10.20.193.57:51614) 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.153+0000 7f5c96174640 1 -- 10.20.193.57:0/368217477 learned_addr learned my addr 10.20.193.57:0/368217477 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c96174640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.57:6790/0 conn(0x7f5c90182cc0 legacy=0x7f5c90195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402333180 0 0) 0x7f5c9013b4a0 con 0x7f5c90182cc0 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient(hunting): my global_id is 114161 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c600035e0 con 0x7f5c90182cc0 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 699187642 0 0) 0x7f5c600035e0 con 0x7f5c90182cc0 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c9013b4a0 con 0x7f5c90182cc0 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5c8c005b30 con 0x7f5c90182cc0 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c95973640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.82:6789/0 conn(0x7f5c9008c250 legacy=0x7f5c90085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient(hunting): dump: 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.156 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3663153403 0 0) 0x7f5c9013b4a0 con 0x7f5c90182cc0 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.82:6789/0 conn(0x7f5c9008c250 legacy=0x7f5c90085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.57:6789/0 conn(0x7f5c9008c620 legacy=0x7f5c90085e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 monclient: found mon.c 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9008ee50 con 0x7f5c90182cc0 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c7e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c97bfe640 5 monclient: authenticate success, global_id 114161 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c97bfe640 10 monclient: _renew_subs 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c97bfe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:27.157 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5c9013eb10 con 0x7f5c90182cc0 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c97bfe640 10 monclient: _renew_subs 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c97bfe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.155+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5c9013e0f0 con 0x7f5c90182cc0 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c8c003bf0 con 0x7f5c90182cc0 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c7e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5c8c006380 con 0x7f5c90182cc0 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c7e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c7e7fc640 10 monclient: dump: 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c7ffff640 4 set_mon_vals no callback set 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c97bfe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5c90090810 con 0x7f5c900871e0 2026-02-12T17:45:27.158 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5c8c012ff0 con 0x7f5c90182cc0 2026-02-12T17:45:27.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(856..856 src has 637..856) ==== 3915+0+0 (unknown 515848217 0 0) 0x7f5c8c04fda0 con 0x7f5c90182cc0 2026-02-12T17:45:27.159 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.156+0000 7f5c95172640 10 monclient: get_auth_request con 0x7f5c6003f680 auth_method 0 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c95973640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.57:6790/0 conn(0x7f5c900871e0 legacy=0x7f5c900582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850974381 0 0) 0x7f5c90090810 con 0x7f5c900871e0 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 10 monclient(hunting): my global_id is 114164 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c9013b4a0 con 0x7f5c900871e0 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3535165943 0 0) 0x7f5c9013b4a0 con 0x7f5c900871e0 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c90090810 con 0x7f5c900871e0 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5c80003240 con 0x7f5c900871e0 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.158+0000 7f5c7e7fc640 10 monclient: dump: 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.160 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.159+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4200302820 0 0) 0x7f5c90090810 con 0x7f5c900871e0 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.159+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c900875b0 con 0x7f5c900871e0 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.159+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f5c80005880 con 0x7f5c900871e0 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.159+0000 7f5c7e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.159+0000 7f5c7e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.159+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.57:6790/0 conn(0x7f5c900871e0 legacy=0x7f5c900582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.159+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.57:6790/0 conn(0x7f5c900871e0 legacy=0x7f5c900582c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.162+0000 7f5c97bfe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:45:27.161 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.162+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5c9008f580 con 0x7f5c900589d0 2026-02-12T17:45:27.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c95973640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.57:6790/0 conn(0x7f5c900589d0 legacy=0x7f5c90197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123196659 0 0) 0x7f5c9008f580 con 0x7f5c900589d0 2026-02-12T17:45:27.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 10 monclient(hunting): my global_id is 114167 2026-02-12T17:45:27.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c90090810 con 0x7f5c900589d0 2026-02-12T17:45:27.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3068914946 0 0) 0x7f5c90090810 con 0x7f5c900589d0 2026-02-12T17:45:27.162 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c9008f580 con 0x7f5c900589d0 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5c80003be0 con 0x7f5c900589d0 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.164+0000 7f5c7e7fc640 10 monclient: dump: 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1863973502 0 0) 0x7f5c9008f580 con 0x7f5c900589d0 2026-02-12T17:45:27.163 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5c90055340 con 0x7f5c900589d0 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4493 (unknown 0 0 784363240) 0x7f5c80005ac0 con 0x7f5c900589d0 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c7e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c7e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.57:6790/0 conn(0x7f5c900589d0 legacy=0x7f5c90197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c7e7fc640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.57:6790/0 conn(0x7f5c900589d0 legacy=0x7f5c90197a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 68, 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 22548, 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:27.164 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:27.165 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:27.166 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.167 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:27.168 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:45:27.169 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.82:6800/2441377515 conn(0x7f5c6003f680 legacy=0x7f5c6005fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c97bfe640 10 monclient: shutdown 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c97bfe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 >> v1:10.20.193.57:6790/0 conn(0x7f5c90182cc0 legacy=0x7f5c90195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c96174640 1 -- 10.20.193.57:0/368217477 reap_dead start 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c96174640 1 -- 10.20.193.57:0/368217477 reap_dead start 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 shutdown_connections 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 >> 10.20.193.57:0/368217477 conn(0x7f5c900916b0 msgr2=0x7f5c90089fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 shutdown_connections 2026-02-12T17:45:27.170 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.165+0000 7f5c97bfe640 1 -- 10.20.193.57:0/368217477 wait complete. 2026-02-12T17:45:27.170 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:45:27.170 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-12T17:45:27.170 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:45:27.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient: get_monmap_and_config 2026-02-12T17:45:27.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient: build_initial_monmap 2026-02-12T17:45:27.232 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient: monmap: 2026-02-12T17:45:27.232 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:27.232 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:27.237065+0000 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:27.237065+0000 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 1 Processor -- start 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 1 -- start start 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient: init 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient(hunting): picked mon.noname-a con 0x7f047808c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient(hunting): picked mon.noname-b con 0x7f047808c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient(hunting): picked mon.noname-c con 0x7f0478182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f047808a820 con 0x7f047808c250 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0478089450 con 0x7f0478182cc0 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0478089730 con 0x7f047808c620 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f047d4af640 10 monclient(hunting): authenticate will time out at 1607.055947s 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.235+0000 7f0476ffd640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f047808c250 legacy=0x7f047808a110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.236+0000 7f04767fc640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f047808c620 0x7f047808caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:51650/0 (socket says 10.20.193.57:51650) 2026-02-12T17:45:27.233 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.236+0000 7f04767fc640 1 -- 10.20.193.57:0/1701328973 learned_addr learned my addr 10.20.193.57:0/1701328973 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:27.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f04767fc640 1 -- 10.20.193.57:0/1701328973 >> v1:10.20.193.57:6790/0 conn(0x7f047808c620 legacy=0x7f047808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 -- 10.20.193.57:0/1701328973 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526256090 0 0) 0x7f0478089730 con 0x7f047808c620 2026-02-12T17:45:27.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient(hunting): my global_id is 114170 2026-02-12T17:45:27.235 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 -- 10.20.193.57:0/1701328973 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04640035e0 con 0x7f047808c620 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 -- 10.20.193.57:0/1701328973 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1040747771 0 0) 0x7f04640035e0 con 0x7f047808c620 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 -- 10.20.193.57:0/1701328973 >> v1:10.20.193.82:6789/0 conn(0x7f0478182cc0 legacy=0x7f04781a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 -- 10.20.193.57:0/1701328973 >> v1:10.20.193.57:6789/0 conn(0x7f047808c250 legacy=0x7f047808a110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 monclient: found mon.noname-b 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 -- 10.20.193.57:0/1701328973 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0478089a10 con 0x7f047808c620 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: _finish_auth 0 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 -- 10.20.193.57:0/1701328973 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f04600030d0 con 0x7f047808c620 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: dump: 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.236 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f047d4af640 5 monclient: authenticate success, global_id 114170 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f047d4af640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 -- 10.20.193.57:0/1701328973 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04600033d0 con 0x7f047808c620 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 1 -- 10.20.193.57:0/1701328973 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0460004b10 con 0x7f047808c620 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f047d4af640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f047d4af640 4 set_mon_vals no callback set 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f0475ffb640 10 monclient: dump: 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f047d4af640 10 monclient: shutdown 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f047d4af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f047d4af640 1 -- 10.20.193.57:0/1701328973 >> v1:10.20.193.57:6790/0 conn(0x7f047808c620 legacy=0x7f047808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f047d4af640 1 -- 10.20.193.57:0/1701328973 shutdown_connections 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.238+0000 7f047d4af640 1 -- 10.20.193.57:0/1701328973 >> 10.20.193.57:0/1701328973 conn(0x7f04780916b0 msgr2=0x7f0478091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 1 -- 10.20.193.57:0/1701328973 shutdown_connections 2026-02-12T17:45:27.237 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 1 -- 10.20.193.57:0/1701328973 wait complete. 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient: build_initial_monmap 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient: monmap: 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 1 Processor -- start 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 1 -- start start 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient: init 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient(hunting): picked mon.noname-a con 0x7f047808c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient(hunting): picked mon.noname-c con 0x7f047808c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient(hunting): picked mon.noname-b con 0x7f0478182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0478140620 con 0x7f047808c250 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04780888a0 con 0x7f0478182cc0 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f0476ffd640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f047808c250 legacy=0x7f04781937d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f047813adc0 con 0x7f047808c620 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f047d4af640 10 monclient(hunting): authenticate will time out at 1607.059906s 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f04767fc640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f047808c620 0x7f0478193ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:51652/0 (socket says 10.20.193.57:51652) 2026-02-12T17:45:27.238 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.239+0000 7f04767fc640 1 -- 10.20.193.57:0/2678678259 learned_addr learned my addr 10.20.193.57:0/2678678259 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:27.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04767fc640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.57:6790/0 conn(0x7f047808c620 legacy=0x7f0478193ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44092492 0 0) 0x7f047813adc0 con 0x7f047808c620 2026-02-12T17:45:27.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): my global_id is 114173 2026-02-12T17:45:27.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04440035e0 con 0x7f047808c620 2026-02-12T17:45:27.239 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04777fe640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.82:6789/0 conn(0x7f0478182cc0 legacy=0x7f0478194b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2262674701 0 0) 0x7f04440035e0 con 0x7f047808c620 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f047813adc0 con 0x7f047808c620 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0460003540 con 0x7f047808c620 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): dump: 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325209195 0 0) 0x7f04780888a0 con 0x7f0478182cc0 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient(hunting): my global_id is 5272 2026-02-12T17:45:27.240 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04440035e0 con 0x7f0478182cc0 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 671253906 0 0) 0x7f047813adc0 con 0x7f047808c620 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.82:6789/0 conn(0x7f0478182cc0 legacy=0x7f0478194b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.57:6789/0 conn(0x7f047808c250 legacy=0x7f04781937d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient: _finish_hunting 0 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 monclient: found mon.c 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047813ec10 con 0x7f047808c620 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient: _finish_auth 0 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient: _check_auth_tickets 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f047d4af640 5 monclient: authenticate success, global_id 114173 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f047d4af640 10 monclient: _renew_subs 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f047d4af640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0478086290 con 0x7f047808c620 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f047d4af640 10 monclient: _renew_subs 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f047d4af640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0478085a40 con 0x7f047808c620 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0460004b40 con 0x7f047808c620 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f04600049a0 con 0x7f047808c620 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04577fe640 10 monclient: dump: 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f04757fa640 4 set_mon_vals no callback set 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f047d4af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.242+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0478090810 con 0x7f0478058050 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.243+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0460011e30 con 0x7f047808c620 2026-02-12T17:45:27.241 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.243+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(856..856 src has 637..856) ==== 3915+0+0 (unknown 515848217 0 0) 0x7f046004edc0 con 0x7f047808c620 2026-02-12T17:45:27.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.243+0000 7f04777fe640 10 monclient: get_auth_request con 0x7f044403f7c0 auth_method 0 2026-02-12T17:45:27.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f0476ffd640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.82:6789/0 conn(0x7f0478058050 legacy=0x7f0478058420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899722162 0 0) 0x7f0478090810 con 0x7f0478058050 2026-02-12T17:45:27.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.242 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 10 monclient(hunting): my global_id is 5275 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f047813adc0 con 0x7f0478058050 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 498994136 0 0) 0x7f047813adc0 con 0x7f0478058050 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0478090810 con 0x7f0478058050 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f046c004320 con 0x7f0478058050 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 10 monclient: dump: 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 755641227 0 0) 0x7f0478090810 con 0x7f0478058050 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.245+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04780871f0 con 0x7f0478058050 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.246+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f046c006710 con 0x7f0478058050 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.246+0000 7f04577fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.246+0000 7f04577fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.246+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.82:6789/0 conn(0x7f0478058050 legacy=0x7f0478058420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.243 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.246+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.82:6789/0 conn(0x7f0478058050 legacy=0x7f0478058420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:27.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.249+0000 7f047d4af640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:45:27.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.249+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f047808f5b0 con 0x7f0478058b30 2026-02-12T17:45:27.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.251+0000 7f0476ffd640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.82:6789/0 conn(0x7f0478058b30 legacy=0x7f0478197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:27.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571710224 0 0) 0x7f047808f5b0 con 0x7f0478058b30 2026-02-12T17:45:27.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 10 monclient(hunting): _negotiate 2026-02-12T17:45:27.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:27.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:27.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 10 monclient(hunting): my global_id is 5278 2026-02-12T17:45:27.249 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0478090810 con 0x7f0478058b30 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3737387489 0 0) 0x7f0478090810 con 0x7f0478058b30 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f047808f5b0 con 0x7f0478058b30 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f046c005cb0 con 0x7f0478058b30 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 10 monclient: dump: 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3264622857 0 0) 0x7f047808f5b0 con 0x7f0478058b30 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.252+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0478055340 con 0x7f0478058b30 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4664 (unknown 0 0 3596232205) 0x7f046c006260 con 0x7f0478058b30 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f04577fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f04577fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.82:6789/0 conn(0x7f0478058b30 legacy=0x7f0478197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f04577fe640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.82:6789/0 conn(0x7f0478058b30 legacy=0x7f0478197240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:27.250 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 68, 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 1048748, 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:45:27.251 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.252 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.253 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "num": 4 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "num": 6 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:45:27.254 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:45:27.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.82:6800/2441377515 conn(0x7f044403f7c0 legacy=0x7f044405fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f047d4af640 10 monclient: shutdown 2026-02-12T17:45:27.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f047d4af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:27.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 >> v1:10.20.193.57:6790/0 conn(0x7f047808c620 legacy=0x7f0478193ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:27.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f04777fe640 1 -- 10.20.193.57:0/2678678259 reap_dead start 2026-02-12T17:45:27.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 shutdown_connections 2026-02-12T17:45:27.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 >> 10.20.193.57:0/2678678259 conn(0x7f04780916b0 msgr2=0x7f0478089fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:27.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 shutdown_connections 2026-02-12T17:45:27.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:27.253+0000 7f047d4af640 1 -- 10.20.193.57:0/2678678259 wait complete. 2026-02-12T17:45:27.258 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-12T17:45:27.258 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T17:45:27.920 INFO:tasks.rados.rados.0.trial082.stdout:3853: done (1 left) 2026-02-12T17:45:27.920 INFO:tasks.rados.rados.0.trial082.stdout:3854: snap_create 2026-02-12T17:45:27.920 INFO:tasks.rados.rados.0.trial082.stdout:3852: finishing rollback tid 1 to trial08226312-27 2026-02-12T17:45:27.920 INFO:tasks.rados.rados.0.trial082.stdout:3852: finishing rollback tid 2 to trial08226312-27 2026-02-12T17:45:27.920 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2292 (ObjNum 1237 snap 397 seq_num 1237) dirty exists 2026-02-12T17:45:28.922 INFO:tasks.rados.rados.0.trial082.stdout:3852: done (1 left) 2026-02-12T17:45:28.922 INFO:tasks.rados.rados.0.trial082.stdout:3854: done (0 left) 2026-02-12T17:45:28.922 INFO:tasks.rados.rados.0.trial082.stdout:3855: snap_remove snap 402 2026-02-12T17:45:29.924 INFO:tasks.rados.rados.0.trial082.stdout:3855: done (0 left) 2026-02-12T17:45:29.924 INFO:tasks.rados.rados.0.trial082.stdout:3856: snap_create 2026-02-12T17:45:30.925 INFO:tasks.rados.rados.0.trial082.stdout:3856: done (0 left) 2026-02-12T17:45:30.926 INFO:tasks.rados.rados.0.trial082.stdout:3857: read oid 37 snap -1 2026-02-12T17:45:30.926 INFO:tasks.rados.rados.0.trial082.stdout:3857: expect (ObjNum 1190 snap 382 seq_num 1190) 2026-02-12T17:45:30.926 INFO:tasks.rados.rados.0.trial082.stdout:3858: read oid 47 snap 428 2026-02-12T17:45:30.926 INFO:tasks.rados.rados.0.trial082.stdout:3858: expect deleted 2026-02-12T17:45:30.926 INFO:tasks.rados.rados.0.trial082.stdout:3859: read oid 34 snap -1 2026-02-12T17:45:30.926 INFO:tasks.rados.rados.0.trial082.stdout:3859: expect (ObjNum 1232 snap 394 seq_num 1232) 2026-02-12T17:45:30.926 INFO:tasks.rados.rados.0.trial082.stdout:3860: write oid 40 current snap is 429 2026-02-12T17:45:30.926 INFO:tasks.rados.rados.0.trial082.stdout:3860: seq_num 1306 ranges {749942=571557,1840895=796442,3365252=584690} 2026-02-12T17:45:30.931 INFO:tasks.rados.rados.0.trial082.stdout:3860: writing trial08226312-40 from 749942 to 1321499 tid 1 2026-02-12T17:45:30.936 INFO:tasks.rados.rados.0.trial082.stdout:3860: writing trial08226312-40 from 1840895 to 2637337 tid 2 2026-02-12T17:45:30.941 INFO:tasks.rados.rados.0.trial082.stdout:3860: writing trial08226312-40 from 3365252 to 3949942 tid 3 2026-02-12T17:45:30.941 INFO:tasks.rados.rados.0.trial082.stdout:3861: rollback oid 6 current snap is 429 2026-02-12T17:45:30.941 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 6 to 349 2026-02-12T17:45:30.941 INFO:tasks.rados.rados.0.trial082.stdout:3859: expect (ObjNum 1232 snap 394 seq_num 1232) 2026-02-12T17:45:30.941 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:30.989 INFO:tasks.rados.rados.0.trial082.stdout:3857: expect (ObjNum 1190 snap 382 seq_num 1190) 2026-02-12T17:45:31.011 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:31.033 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 83315 2026-02-12T17:45:31.055 INFO:tasks.rados.rados.0.trial082.stdout:3860: finishing write tid 1 to trial08226312-40 2026-02-12T17:45:31.055 INFO:tasks.rados.rados.0.trial082.stdout:3860: finishing write tid 2 to trial08226312-40 2026-02-12T17:45:31.055 INFO:tasks.rados.rados.0.trial082.stdout:3857: done (4 left) 2026-02-12T17:45:31.055 INFO:tasks.rados.rados.0.trial082.stdout:3858: done (3 left) 2026-02-12T17:45:31.055 INFO:tasks.rados.rados.0.trial082.stdout:3859: done (2 left) 2026-02-12T17:45:31.055 INFO:tasks.rados.rados.0.trial082.stdout:3862: write (excl) oid 44 current snap is 429 2026-02-12T17:45:31.055 INFO:tasks.rados.rados.0.trial082.stdout:3862: seq_num 1307 ranges {766749=646806,1899377=656453,3109028=609462} 2026-02-12T17:45:31.060 INFO:tasks.rados.rados.0.trial082.stdout:3862: writing trial08226312-44 from 766749 to 1413555 tid 1 2026-02-12T17:45:31.065 INFO:tasks.rados.rados.0.trial082.stdout:3862: writing trial08226312-44 from 1899377 to 2555830 tid 2 2026-02-12T17:45:31.069 INFO:tasks.rados.rados.0.trial082.stdout:3862: writing trial08226312-44 from 3109028 to 3718490 tid 3 2026-02-12T17:45:31.069 INFO:tasks.rados.rados.0.trial082.stdout:3863: read oid 12 snap 381 2026-02-12T17:45:31.069 INFO:tasks.rados.rados.0.trial082.stdout:3863: expect (ObjNum 1105 snap 346 seq_num 1105) 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3864: copy_from oid 50 from oid 48 current snap is 429 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3860: finishing write tid 3 to trial08226312-40 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3860: finishing write tid 4 to trial08226312-40 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3860: finishing write tid 5 to trial08226312-40 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3860: oid 40 updating version 0 to 2513 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3860: oid 40 updating version 2513 to 2514 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3860: oid 40 version 2514 is already newer than 2512 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3860: oid 40 version 2514 is already newer than 2511 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 2514 (ObjNum 1306 snap 429 seq_num 1306) dirty exists 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3860: left oid 40 (ObjNum 1306 snap 429 seq_num 1306) 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3861: finishing rollback tid 0 to trial08226312-6 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3861: finishing rollback tid 1 to trial08226312-6 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3861: finishing rollback tid 2 to trial08226312-6 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 2459 (ObjNum 1040 snap 325 seq_num 1040) dirty exists 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3862: finishing write tid 1 to trial08226312-44 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3860: done (4 left) 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3861: done (3 left) 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3865: delete oid 42 current snap is 429 2026-02-12T17:45:31.070 INFO:tasks.rados.rados.0.trial082.stdout:3862: finishing write tid 2 to trial08226312-44 2026-02-12T17:45:31.071 INFO:tasks.rados.rados.0.trial082.stdout:3865: done (3 left) 2026-02-12T17:45:31.071 INFO:tasks.rados.rados.0.trial082.stdout:3866: read oid 4 snap -1 2026-02-12T17:45:31.071 INFO:tasks.rados.rados.0.trial082.stdout:3866: expect (ObjNum 1252 snap 409 seq_num 1252) 2026-02-12T17:45:31.071 INFO:tasks.rados.rados.0.trial082.stdout:3867: snap_remove snap 426 2026-02-12T17:45:31.904 INFO:tasks.rados.rados.0.trial082.stdout:3867: done (4 left) 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3868: rollback oid 3 current snap is 429 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 3 to 349 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3862: finishing write tid 3 to trial08226312-44 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3862: finishing write tid 4 to trial08226312-44 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3862: finishing write tid 5 to trial08226312-44 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3862: oid 44 updating version 0 to 2764 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3862: oid 44 updating version 2764 to 2766 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3862: oid 44 version 2766 is already newer than 2765 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3862: oid 44 version 2766 is already newer than 2763 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2766 (ObjNum 1307 snap 429 seq_num 1307) dirty exists 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3862: left oid 44 (ObjNum 1307 snap 429 seq_num 1307) 2026-02-12T17:45:31.905 INFO:tasks.rados.rados.0.trial082.stdout:3863: expect (ObjNum 1105 snap 346 seq_num 1105) 2026-02-12T17:45:31.983 INFO:tasks.rados.rados.0.trial082.stdout:3866: expect (ObjNum 1252 snap 409 seq_num 1252) 2026-02-12T17:45:31.983 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 418136 2026-02-12T17:45:32.037 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 942806 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3864: finishing copy_from racing read to trial08226312-50 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3864: finishing copy_from to trial08226312-50 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 50 v 2460 (ObjNum 1303 snap 426 seq_num 1303) dirty exists 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3868: finishing rollback tid 0 to trial08226312-3 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3868: finishing rollback tid 1 to trial08226312-3 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3868: finishing rollback tid 2 to trial08226312-3 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 3 v 2500 (ObjNum 1082 snap 341 seq_num 1082) dirty exists 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3862: done (4 left) 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3863: done (3 left) 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3864: done (2 left) 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3866: done (1 left) 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3868: done (0 left) 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3869: read oid 47 snap 385 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3869: expect (ObjNum 1091 snap 345 seq_num 1091) 2026-02-12T17:45:32.126 INFO:tasks.rados.rados.0.trial082.stdout:3870: snap_create 2026-02-12T17:45:32.130 INFO:tasks.rados.rados.0.trial082.stdout:3869: expect (ObjNum 1091 snap 345 seq_num 1091) 2026-02-12T17:45:32.130 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:32.931 INFO:tasks.rados.rados.0.trial082.stdout:3869: done (1 left) 2026-02-12T17:45:32.931 INFO:tasks.rados.rados.0.trial082.stdout:3870: done (0 left) 2026-02-12T17:45:32.931 INFO:tasks.rados.rados.0.trial082.stdout:3871: snap_create 2026-02-12T17:45:33.931 INFO:tasks.rados.rados.0.trial082.stdout:3871: done (0 left) 2026-02-12T17:45:33.932 INFO:tasks.rados.rados.0.trial082.stdout:3872: snap_remove snap 403 2026-02-12T17:45:34.934 INFO:tasks.rados.rados.0.trial082.stdout:3872: done (0 left) 2026-02-12T17:45:34.934 INFO:tasks.rados.rados.0.trial082.stdout:3873: write (excl) oid 39 current snap is 431 2026-02-12T17:45:34.934 INFO:tasks.rados.rados.0.trial082.stdout:3873: seq_num 1309 ranges {400363=513657,1332694=660122} 2026-02-12T17:45:34.937 INFO:tasks.rados.rados.0.trial082.stdout:3873: writing trial08226312-39 from 400363 to 914020 tid 1 2026-02-12T17:45:34.942 INFO:tasks.rados.rados.0.trial082.stdout:3873: writing trial08226312-39 from 1332694 to 1992816 tid 2 2026-02-12T17:45:34.942 INFO:tasks.rados.rados.0.trial082.stdout:3874: write (excl) oid 38 current snap is 431 2026-02-12T17:45:34.942 INFO:tasks.rados.rados.0.trial082.stdout:3873: finishing write tid 1 to trial08226312-39 2026-02-12T17:45:34.942 INFO:tasks.rados.rados.0.trial082.stdout:3874: seq_num 1310 ranges {417170=588906,1674823=342347} 2026-02-12T17:45:34.946 INFO:tasks.rados.rados.0.trial082.stdout:3874: writing trial08226312-38 from 417170 to 1006076 tid 1 2026-02-12T17:45:34.950 INFO:tasks.rados.rados.0.trial082.stdout:3874: writing trial08226312-38 from 1674823 to 2017170 tid 2 2026-02-12T17:45:34.950 INFO:tasks.rados.rados.0.trial082.stdout:3875: write oid 40 current snap is 431 2026-02-12T17:45:34.950 INFO:tasks.rados.rados.0.trial082.stdout:3875: seq_num 1311 ranges {433977=664155,1733305=300672} 2026-02-12T17:45:34.954 INFO:tasks.rados.rados.0.trial082.stdout:3875: writing trial08226312-40 from 433977 to 1098132 tid 1 2026-02-12T17:45:34.959 INFO:tasks.rados.rados.0.trial082.stdout:3875: writing trial08226312-40 from 1733305 to 2033977 tid 2 2026-02-12T17:45:34.959 INFO:tasks.rados.rados.0.trial082.stdout:3876: rollback oid 22 current snap is 431 2026-02-12T17:45:34.959 INFO:tasks.rados.rados.0.trial082.stdout:3873: finishing write tid 2 to trial08226312-39 2026-02-12T17:45:34.959 INFO:tasks.rados.rados.0.trial082.stdout:3873: finishing write tid 3 to trial08226312-39 2026-02-12T17:45:34.959 INFO:tasks.rados.rados.0.trial082.stdout:3873: finishing write tid 4 to trial08226312-39 2026-02-12T17:45:34.959 INFO:tasks.rados.rados.0.trial082.stdout:3873: oid 39 updating version 0 to 2262 2026-02-12T17:45:34.959 INFO:tasks.rados.rados.0.trial082.stdout:3873: oid 39 version 2262 is already newer than 2261 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:3873: oid 39 updating version 2262 to 2263 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 2263 (ObjNum 1309 snap 431 seq_num 1309) dirty exists 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:3873: left oid 39 (ObjNum 1309 snap 431 seq_num 1309) 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:3874: finishing write tid 1 to trial08226312-38 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 22 to 427 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:3874: finishing write tid 2 to trial08226312-38 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:3874: finishing write tid 3 to trial08226312-38 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:3874: finishing write tid 4 to trial08226312-38 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:3874: oid 38 updating version 0 to 2466 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:3874: oid 38 version 2466 is already newer than 2465 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:3874: oid 38 updating version 2466 to 2467 2026-02-12T17:45:34.960 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 2467 (ObjNum 1310 snap 431 seq_num 1310) dirty exists 2026-02-12T17:45:34.961 INFO:tasks.rados.rados.0.trial082.stdout:3874: left oid 38 (ObjNum 1310 snap 431 seq_num 1310) 2026-02-12T17:45:34.961 INFO:tasks.rados.rados.0.trial082.stdout:3873: done (3 left) 2026-02-12T17:45:34.961 INFO:tasks.rados.rados.0.trial082.stdout:3874: done (2 left) 2026-02-12T17:45:34.961 INFO:tasks.rados.rados.0.trial082.stdout:3877: copy_from oid 27 from oid 38 current snap is 431 2026-02-12T17:45:34.961 INFO:tasks.rados.rados.0.trial082.stdout:3878: copy_from oid 11 from oid 48 current snap is 431 2026-02-12T17:45:34.961 INFO:tasks.rados.rados.0.trial082.stdout:3879: snap_create 2026-02-12T17:45:34.962 INFO:tasks.rados.rados.0.trial082.stdout:3875: finishing write tid 1 to trial08226312-40 2026-02-12T17:45:34.962 INFO:tasks.rados.rados.0.trial082.stdout:3875: finishing write tid 2 to trial08226312-40 2026-02-12T17:45:34.962 INFO:tasks.rados.rados.0.trial082.stdout:3875: finishing write tid 3 to trial08226312-40 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:3875: finishing write tid 4 to trial08226312-40 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:3875: oid 40 updating version 0 to 2527 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:3875: oid 40 version 2527 is already newer than 2525 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:3875: oid 40 version 2527 is already newer than 2526 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 40 v 2527 (ObjNum 1311 snap 431 seq_num 1311) dirty exists 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:3875: left oid 40 (ObjNum 1311 snap 431 seq_num 1311) 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:3876: finishing rollback tid 0 to trial08226312-22 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:3876: finishing rollback tid 1 to trial08226312-22 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:3876: finishing rollback tid 2 to trial08226312-22 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 22 v 2522 (ObjNum 1262 snap 410 seq_num 1262) dirty exists 2026-02-12T17:45:34.963 INFO:tasks.rados.rados.0.trial082.stdout:3877: finishing copy_from racing read to trial08226312-27 2026-02-12T17:45:34.964 INFO:tasks.rados.rados.0.trial082.stdout:3878: finishing copy_from racing read to trial08226312-11 2026-02-12T17:45:34.964 INFO:tasks.rados.rados.0.trial082.stdout:3877: finishing copy_from to trial08226312-27 2026-02-12T17:45:34.964 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 27 v 2467 (ObjNum 1310 snap 431 seq_num 1310) dirty exists 2026-02-12T17:45:34.965 INFO:tasks.rados.rados.0.trial082.stdout:3878: finishing copy_from to trial08226312-11 2026-02-12T17:45:34.965 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 2460 (ObjNum 1303 snap 426 seq_num 1303) dirty exists 2026-02-12T17:45:35.941 INFO:tasks.rados.rados.0.trial082.stdout:3875: done (4 left) 2026-02-12T17:45:35.941 INFO:tasks.rados.rados.0.trial082.stdout:3876: done (3 left) 2026-02-12T17:45:35.941 INFO:tasks.rados.rados.0.trial082.stdout:3877: done (2 left) 2026-02-12T17:45:35.941 INFO:tasks.rados.rados.0.trial082.stdout:3878: done (1 left) 2026-02-12T17:45:35.941 INFO:tasks.rados.rados.0.trial082.stdout:3879: done (0 left) 2026-02-12T17:45:35.941 INFO:tasks.rados.rados.0.trial082.stdout:3880: copy_from oid 22 from oid 33 current snap is 432 2026-02-12T17:45:35.941 INFO:tasks.rados.rados.0.trial082.stdout:3881: snap_remove snap 381 2026-02-12T17:45:36.905 INFO:tasks.rados.rados.0.trial082.stdout:3881: done (1 left) 2026-02-12T17:45:36.905 INFO:tasks.rados.rados.0.trial082.stdout:3882: copy_from oid 39 from oid 31 current snap is 432 2026-02-12T17:45:36.905 INFO:tasks.rados.rados.0.trial082.stdout:3880: finishing copy_from to trial08226312-22 2026-02-12T17:45:36.905 INFO:tasks.rados.rados.0.trial082.stdout:3880: got expected ENOENT (src dne) 2026-02-12T17:45:36.905 INFO:tasks.rados.rados.0.trial082.stdout:3880: finishing copy_from racing read to trial08226312-22 2026-02-12T17:45:36.905 INFO:tasks.rados.rados.0.trial082.stdout:3880: done (1 left) 2026-02-12T17:45:36.905 INFO:tasks.rados.rados.0.trial082.stdout:3883: read oid 11 snap -1 2026-02-12T17:45:36.905 INFO:tasks.rados.rados.0.trial082.stdout:3883: expect (ObjNum 1303 snap 426 seq_num 1303) 2026-02-12T17:45:36.906 INFO:tasks.rados.rados.0.trial082.stdout:3884: write (excl) oid 6 current snap is 432 2026-02-12T17:45:36.906 INFO:tasks.rados.rados.0.trial082.stdout:3884: seq_num 1312 ranges {450784=739404,1791787=258997} 2026-02-12T17:45:36.909 INFO:tasks.rados.rados.0.trial082.stdout:3884: writing trial08226312-6 from 450784 to 1190188 tid 1 2026-02-12T17:45:36.912 INFO:tasks.rados.rados.0.trial082.stdout:3884: writing trial08226312-6 from 1791787 to 2050784 tid 2 2026-02-12T17:45:36.912 INFO:tasks.rados.rados.0.trial082.stdout:3885: snap_create 2026-02-12T17:45:36.912 INFO:tasks.rados.rados.0.trial082.stdout:3883: expect (ObjNum 1303 snap 426 seq_num 1303) 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:3884: finishing write tid 1 to trial08226312-6 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:3884: finishing write tid 2 to trial08226312-6 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:3884: finishing write tid 3 to trial08226312-6 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:3884: finishing write tid 4 to trial08226312-6 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:3884: oid 6 updating version 0 to 2462 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:3884: oid 6 version 2462 is already newer than 2461 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:3884: oid 6 updating version 2462 to 2463 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 2463 (ObjNum 1312 snap 432 seq_num 1312) dirty exists 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:3884: left oid 6 (ObjNum 1312 snap 432 seq_num 1312) 2026-02-12T17:45:36.985 INFO:tasks.rados.rados.0.trial082.stdout:3882: finishing copy_from racing read to trial08226312-39 2026-02-12T17:45:36.986 INFO:tasks.rados.rados.0.trial082.stdout:3882: finishing copy_from to trial08226312-39 2026-02-12T17:45:36.986 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 39 v 2289 (ObjNum 1288 snap 424 seq_num 1288) dirty exists 2026-02-12T17:45:37.908 INFO:tasks.rados.rados.0.trial082.stdout:3882: done (3 left) 2026-02-12T17:45:37.908 INFO:tasks.rados.rados.0.trial082.stdout:3883: done (2 left) 2026-02-12T17:45:37.908 INFO:tasks.rados.rados.0.trial082.stdout:3884: done (1 left) 2026-02-12T17:45:37.908 INFO:tasks.rados.rados.0.trial082.stdout:3885: done (0 left) 2026-02-12T17:45:37.909 INFO:tasks.rados.rados.0.trial082.stdout:3886: rollback oid 44 current snap is 433 2026-02-12T17:45:37.909 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 44 to 406 2026-02-12T17:45:37.909 INFO:tasks.rados.rados.0.trial082.stdout:3887: snap_remove snap 342 2026-02-12T17:45:38.910 INFO:tasks.rados.rados.0.trial082.stdout:3887: done (1 left) 2026-02-12T17:45:38.911 INFO:tasks.rados.rados.0.trial082.stdout:3886: finishing rollback tid 0 to trial08226312-44 2026-02-12T17:45:38.911 INFO:tasks.rados.rados.0.trial082.stdout:3886: finishing rollback tid 1 to trial08226312-44 2026-02-12T17:45:38.911 INFO:tasks.rados.rados.0.trial082.stdout:3886: finishing rollback tid 2 to trial08226312-44 2026-02-12T17:45:38.911 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 44 v 2769 (ObjNum 1141 snap 359 seq_num 1141) dirty exists 2026-02-12T17:45:38.911 INFO:tasks.rados.rados.0.trial082.stdout:3888: read oid 33 snap 412 2026-02-12T17:45:38.911 INFO:tasks.rados.rados.0.trial082.stdout:3888: expect (ObjNum 1207 snap 388 seq_num 1207) 2026-02-12T17:45:38.911 INFO:tasks.rados.rados.0.trial082.stdout:3886: done (1 left) 2026-02-12T17:45:38.911 INFO:tasks.rados.rados.0.trial082.stdout:3889: rollback oid 23 current snap is 433 2026-02-12T17:45:38.911 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 23 to 432 2026-02-12T17:45:38.912 INFO:tasks.rados.rados.0.trial082.stdout:3890: write oid 48 current snap is 433 2026-02-12T17:45:38.912 INFO:tasks.rados.rados.0.trial082.stdout:3890: seq_num 1313 ranges {467591=414653,1450269=617322} 2026-02-12T17:45:38.914 INFO:tasks.rados.rados.0.trial082.stdout:3890: writing trial08226312-48 from 467591 to 882244 tid 1 2026-02-12T17:45:38.919 INFO:tasks.rados.rados.0.trial082.stdout:3890: writing trial08226312-48 from 1450269 to 2067591 tid 2 2026-02-12T17:45:38.919 INFO:tasks.rados.rados.0.trial082.stdout:3891: read oid 12 snap -1 2026-02-12T17:45:38.919 INFO:tasks.rados.rados.0.trial082.stdout:3891: expect (ObjNum 1248 snap 408 seq_num 1248) 2026-02-12T17:45:38.920 INFO:tasks.rados.rados.0.trial082.stdout:3892: delete oid 16 current snap is 433 2026-02-12T17:45:38.920 INFO:tasks.rados.rados.0.trial082.stdout:3888: expect (ObjNum 1207 snap 388 seq_num 1207) 2026-02-12T17:45:38.920 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:38.986 INFO:tasks.rados.rados.0.trial082.stdout:3889: finishing rollback tid 0 to trial08226312-23 2026-02-12T17:45:38.987 INFO:tasks.rados.rados.0.trial082.stdout:3888: done (4 left) 2026-02-12T17:45:38.987 INFO:tasks.rados.rados.0.trial082.stdout:3892: done (3 left) 2026-02-12T17:45:38.987 INFO:tasks.rados.rados.0.trial082.stdout:3893: snap_create 2026-02-12T17:45:38.987 INFO:tasks.rados.rados.0.trial082.stdout:3889: finishing rollback tid 1 to trial08226312-23 2026-02-12T17:45:38.987 INFO:tasks.rados.rados.0.trial082.stdout:3889: finishing rollback tid 2 to trial08226312-23 2026-02-12T17:45:38.987 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 23 v 2772 (ObjNum 1289 snap 424 seq_num 1289) dirty exists 2026-02-12T17:45:38.987 INFO:tasks.rados.rados.0.trial082.stdout:3890: finishing write tid 1 to trial08226312-48 2026-02-12T17:45:38.987 INFO:tasks.rados.rados.0.trial082.stdout:3891: expect (ObjNum 1248 snap 408 seq_num 1248) 2026-02-12T17:45:39.116 INFO:tasks.rados.rados.0.trial082.stdout:3890: finishing write tid 2 to trial08226312-48 2026-02-12T17:45:39.116 INFO:tasks.rados.rados.0.trial082.stdout:3890: finishing write tid 3 to trial08226312-48 2026-02-12T17:45:39.117 INFO:tasks.rados.rados.0.trial082.stdout:3890: finishing write tid 4 to trial08226312-48 2026-02-12T17:45:39.117 INFO:tasks.rados.rados.0.trial082.stdout:3890: oid 48 updating version 0 to 2462 2026-02-12T17:45:39.117 INFO:tasks.rados.rados.0.trial082.stdout:3890: oid 48 updating version 2462 to 2463 2026-02-12T17:45:39.117 INFO:tasks.rados.rados.0.trial082.stdout:3890: oid 48 version 2463 is already newer than 2461 2026-02-12T17:45:39.117 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 48 v 2463 (ObjNum 1313 snap 433 seq_num 1313) dirty exists 2026-02-12T17:45:39.117 INFO:tasks.rados.rados.0.trial082.stdout:3890: left oid 48 (ObjNum 1313 snap 433 seq_num 1313) 2026-02-12T17:45:39.915 INFO:tasks.rados.rados.0.trial082.stdout:3889: done (3 left) 2026-02-12T17:45:39.915 INFO:tasks.rados.rados.0.trial082.stdout:3890: done (2 left) 2026-02-12T17:45:39.915 INFO:tasks.rados.rados.0.trial082.stdout:3891: done (1 left) 2026-02-12T17:45:39.915 INFO:tasks.rados.rados.0.trial082.stdout:3893: done (0 left) 2026-02-12T17:45:39.915 INFO:tasks.rados.rados.0.trial082.stdout:3894: delete oid 39 current snap is 434 2026-02-12T17:45:39.916 INFO:tasks.rados.rados.0.trial082.stdout:3894: done (0 left) 2026-02-12T17:45:39.917 INFO:tasks.rados.rados.0.trial082.stdout:3895: read oid 5 snap -1 2026-02-12T17:45:39.917 INFO:tasks.rados.rados.0.trial082.stdout:3895: expect deleted 2026-02-12T17:45:39.917 INFO:tasks.rados.rados.0.trial082.stdout:3896: rollback oid 32 current snap is 434 2026-02-12T17:45:39.917 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 431 2026-02-12T17:45:39.917 INFO:tasks.rados.rados.0.trial082.stdout:3897: snap_remove snap 425 2026-02-12T17:45:40.916 INFO:tasks.rados.rados.0.trial082.stdout:3897: done (2 left) 2026-02-12T17:45:40.916 INFO:tasks.rados.rados.0.trial082.stdout:3898: snap_remove snap 409 2026-02-12T17:45:41.905 INFO:tasks.rados.rados.0.trial082.stdout:3898: done (2 left) 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:3899: copy_from oid 27 from oid 2 current snap is 434 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:3896: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:3896: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:3896: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 2470 (ObjNum 1137 snap 356 seq_num 1137) dirty exists 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:3895: done (2 left) 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:3896: done (1 left) 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:3900: read oid 14 snap -1 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:3900: expect deleted 2026-02-12T17:45:41.906 INFO:tasks.rados.rados.0.trial082.stdout:3901: write (excl) oid 6 current snap is 434 2026-02-12T17:45:41.907 INFO:tasks.rados.rados.0.trial082.stdout:3901: seq_num 1316 ranges {518012=756753,2025715=92297} 2026-02-12T17:45:41.910 INFO:tasks.rados.rados.0.trial082.stdout:3901: writing trial08226312-6 from 518012 to 1274765 tid 1 2026-02-12T17:45:41.914 INFO:tasks.rados.rados.0.trial082.stdout:3901: writing trial08226312-6 from 2025715 to 2118012 tid 2 2026-02-12T17:45:41.914 INFO:tasks.rados.rados.0.trial082.stdout:3902: read oid 8 snap 430 2026-02-12T17:45:41.914 INFO:tasks.rados.rados.0.trial082.stdout:3902: expect (ObjNum 1243 snap 404 seq_num 1243) 2026-02-12T17:45:41.914 INFO:tasks.rados.rados.0.trial082.stdout:3903: snap_remove snap 416 2026-02-12T17:45:42.908 INFO:tasks.rados.rados.0.trial082.stdout:3903: done (4 left) 2026-02-12T17:45:42.908 INFO:tasks.rados.rados.0.trial082.stdout:3904: snap_create 2026-02-12T17:45:42.908 INFO:tasks.rados.rados.0.trial082.stdout:3899: finishing copy_from to trial08226312-27 2026-02-12T17:45:42.908 INFO:tasks.rados.rados.0.trial082.stdout:3899: got expected ENOENT (src dne) 2026-02-12T17:45:42.908 INFO:tasks.rados.rados.0.trial082.stdout:3899: finishing copy_from racing read to trial08226312-27 2026-02-12T17:45:42.908 INFO:tasks.rados.rados.0.trial082.stdout:3901: finishing write tid 1 to trial08226312-6 2026-02-12T17:45:42.908 INFO:tasks.rados.rados.0.trial082.stdout:3901: finishing write tid 2 to trial08226312-6 2026-02-12T17:45:42.908 INFO:tasks.rados.rados.0.trial082.stdout:3901: finishing write tid 3 to trial08226312-6 2026-02-12T17:45:42.909 INFO:tasks.rados.rados.0.trial082.stdout:3901: finishing write tid 4 to trial08226312-6 2026-02-12T17:45:42.909 INFO:tasks.rados.rados.0.trial082.stdout:3901: oid 6 updating version 0 to 2466 2026-02-12T17:45:42.909 INFO:tasks.rados.rados.0.trial082.stdout:3901: oid 6 version 2466 is already newer than 2465 2026-02-12T17:45:42.909 INFO:tasks.rados.rados.0.trial082.stdout:3901: oid 6 version 2466 is already newer than 2464 2026-02-12T17:45:42.909 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 2466 (ObjNum 1316 snap 434 seq_num 1316) dirty exists 2026-02-12T17:45:42.909 INFO:tasks.rados.rados.0.trial082.stdout:3901: left oid 6 (ObjNum 1316 snap 434 seq_num 1316) 2026-02-12T17:45:42.909 INFO:tasks.rados.rados.0.trial082.stdout:3902: expect (ObjNum 1243 snap 404 seq_num 1243) 2026-02-12T17:45:42.909 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:43.908 INFO:tasks.rados.rados.0.trial082.stdout:3899: done (4 left) 2026-02-12T17:45:43.908 INFO:tasks.rados.rados.0.trial082.stdout:3900: done (3 left) 2026-02-12T17:45:43.909 INFO:tasks.rados.rados.0.trial082.stdout:3901: done (2 left) 2026-02-12T17:45:43.909 INFO:tasks.rados.rados.0.trial082.stdout:3902: done (1 left) 2026-02-12T17:45:43.909 INFO:tasks.rados.rados.0.trial082.stdout:3904: done (0 left) 2026-02-12T17:45:43.909 INFO:tasks.rados.rados.0.trial082.stdout:3905: read oid 23 snap -1 2026-02-12T17:45:43.909 INFO:tasks.rados.rados.0.trial082.stdout:3905: expect (ObjNum 1289 snap 424 seq_num 1289) 2026-02-12T17:45:43.909 INFO:tasks.rados.rados.0.trial082.stdout:3906: snap_remove snap 344 2026-02-12T17:45:44.911 INFO:tasks.rados.rados.0.trial082.stdout:3906: done (1 left) 2026-02-12T17:45:44.911 INFO:tasks.rados.rados.0.trial082.stdout:3907: read oid 24 snap -1 2026-02-12T17:45:44.911 INFO:tasks.rados.rados.0.trial082.stdout:3907: expect deleted 2026-02-12T17:45:44.911 INFO:tasks.rados.rados.0.trial082.stdout:3908: copy_from oid 22 from oid 15 current snap is 435 2026-02-12T17:45:44.911 INFO:tasks.rados.rados.0.trial082.stdout:3905: expect (ObjNum 1289 snap 424 seq_num 1289) 2026-02-12T17:45:44.911 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:45.013 INFO:tasks.rados.rados.0.trial082.stdout:3908: finishing copy_from to trial08226312-22 2026-02-12T17:45:45.013 INFO:tasks.rados.rados.0.trial082.stdout:3908: got expected ENOENT (src dne) 2026-02-12T17:45:45.014 INFO:tasks.rados.rados.0.trial082.stdout:3908: finishing copy_from racing read to trial08226312-22 2026-02-12T17:45:45.014 INFO:tasks.rados.rados.0.trial082.stdout:3905: done (2 left) 2026-02-12T17:45:45.014 INFO:tasks.rados.rados.0.trial082.stdout:3907: done (1 left) 2026-02-12T17:45:45.014 INFO:tasks.rados.rados.0.trial082.stdout:3908: done (0 left) 2026-02-12T17:45:45.014 INFO:tasks.rados.rados.0.trial082.stdout:3909: delete oid 29 current snap is 435 2026-02-12T17:45:45.015 INFO:tasks.rados.rados.0.trial082.stdout:3909: done (0 left) 2026-02-12T17:45:45.015 INFO:tasks.rados.rados.0.trial082.stdout:3910: write oid 34 current snap is 435 2026-02-12T17:45:45.015 INFO:tasks.rados.rados.0.trial082.stdout:3910: seq_num 1318 ranges {551626=507251,1626326=418456} 2026-02-12T17:45:45.019 INFO:tasks.rados.rados.0.trial082.stdout:3910: writing trial08226312-34 from 551626 to 1058877 tid 1 2026-02-12T17:45:45.023 INFO:tasks.rados.rados.0.trial082.stdout:3910: writing trial08226312-34 from 1626326 to 2044782 tid 2 2026-02-12T17:45:45.023 INFO:tasks.rados.rados.0.trial082.stdout:3911: read oid 10 snap -1 2026-02-12T17:45:45.023 INFO:tasks.rados.rados.0.trial082.stdout:3911: expect (ObjNum 1270 snap 416 seq_num 1270) 2026-02-12T17:45:45.023 INFO:tasks.rados.rados.0.trial082.stdout:3912: delete oid 43 current snap is 435 2026-02-12T17:45:45.023 INFO:tasks.rados.rados.0.trial082.stdout:3910: finishing write tid 1 to trial08226312-34 2026-02-12T17:45:45.025 INFO:tasks.rados.rados.0.trial082.stdout:3910: finishing write tid 2 to trial08226312-34 2026-02-12T17:45:45.025 INFO:tasks.rados.rados.0.trial082.stdout:3910: finishing write tid 3 to trial08226312-34 2026-02-12T17:45:45.025 INFO:tasks.rados.rados.0.trial082.stdout:3910: finishing write tid 4 to trial08226312-34 2026-02-12T17:45:45.026 INFO:tasks.rados.rados.0.trial082.stdout:3910: oid 34 updating version 0 to 2428 2026-02-12T17:45:45.026 INFO:tasks.rados.rados.0.trial082.stdout:3910: oid 34 version 2428 is already newer than 2427 2026-02-12T17:45:45.026 INFO:tasks.rados.rados.0.trial082.stdout:3910: oid 34 version 2428 is already newer than 2426 2026-02-12T17:45:45.026 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 2428 (ObjNum 1318 snap 435 seq_num 1318) dirty exists 2026-02-12T17:45:45.026 INFO:tasks.rados.rados.0.trial082.stdout:3910: left oid 34 (ObjNum 1318 snap 435 seq_num 1318) 2026-02-12T17:45:45.026 INFO:tasks.rados.rados.0.trial082.stdout:3911: expect (ObjNum 1270 snap 416 seq_num 1270) 2026-02-12T17:45:45.076 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2354794 2026-02-12T17:45:45.121 INFO:tasks.rados.rados.0.trial082.stdout:3910: done (2 left) 2026-02-12T17:45:45.121 INFO:tasks.rados.rados.0.trial082.stdout:3911: done (1 left) 2026-02-12T17:45:45.121 INFO:tasks.rados.rados.0.trial082.stdout:3912: done (0 left) 2026-02-12T17:45:45.122 INFO:tasks.rados.rados.0.trial082.stdout:3913: write (excl) oid 31 current snap is 435 2026-02-12T17:45:45.122 INFO:tasks.rados.rados.0.trial082.stdout:3913: seq_num 1320 ranges {585240=657749,1743290=422125} 2026-02-12T17:45:45.126 INFO:tasks.rados.rados.0.trial082.stdout:3913: writing trial08226312-31 from 585240 to 1242989 tid 1 2026-02-12T17:45:45.130 INFO:tasks.rados.rados.0.trial082.stdout:3913: writing trial08226312-31 from 1743290 to 2165415 tid 2 2026-02-12T17:45:45.130 INFO:tasks.rados.rados.0.trial082.stdout:3914: read oid 10 snap -1 2026-02-12T17:45:45.130 INFO:tasks.rados.rados.0.trial082.stdout:3914: expect (ObjNum 1270 snap 416 seq_num 1270) 2026-02-12T17:45:45.131 INFO:tasks.rados.rados.0.trial082.stdout:3915: rollback oid 20 current snap is 435 2026-02-12T17:45:45.131 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 20 to 410 2026-02-12T17:45:45.131 INFO:tasks.rados.rados.0.trial082.stdout:3913: finishing write tid 1 to trial08226312-31 2026-02-12T17:45:45.131 INFO:tasks.rados.rados.0.trial082.stdout:3916: delete oid 36 current snap is 435 2026-02-12T17:45:45.132 INFO:tasks.rados.rados.0.trial082.stdout:3914: expect (ObjNum 1270 snap 416 seq_num 1270) 2026-02-12T17:45:45.132 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:45.228 INFO:tasks.rados.rados.0.trial082.stdout:3913: finishing write tid 2 to trial08226312-31 2026-02-12T17:45:45.228 INFO:tasks.rados.rados.0.trial082.stdout:3913: finishing write tid 3 to trial08226312-31 2026-02-12T17:45:45.228 INFO:tasks.rados.rados.0.trial082.stdout:3913: finishing write tid 4 to trial08226312-31 2026-02-12T17:45:45.228 INFO:tasks.rados.rados.0.trial082.stdout:3913: oid 31 updating version 0 to 2470 2026-02-12T17:45:45.228 INFO:tasks.rados.rados.0.trial082.stdout:3913: oid 31 version 2470 is already newer than 2469 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3913: oid 31 version 2470 is already newer than 2468 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 31 v 2470 (ObjNum 1320 snap 435 seq_num 1320) dirty exists 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3913: left oid 31 (ObjNum 1320 snap 435 seq_num 1320) 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3915: finishing rollback tid 1 to trial08226312-20 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 20 v 2858 (ObjNum 289 snap 0 seq_num 1) dirty dne 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3913: done (3 left) 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3914: done (2 left) 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3915: done (1 left) 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3916: done (0 left) 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3917: read oid 29 snap -1 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3917: expect deleted 2026-02-12T17:45:45.229 INFO:tasks.rados.rados.0.trial082.stdout:3918: rollback oid 30 current snap is 435 2026-02-12T17:45:45.230 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 30 to 434 2026-02-12T17:45:45.230 INFO:tasks.rados.rados.0.trial082.stdout:3919: write oid 9 current snap is 435 2026-02-12T17:45:45.230 INFO:tasks.rados.rados.0.trial082.stdout:3919: seq_num 1322 ranges {618854=408247,1743901=425794} 2026-02-12T17:45:45.231 INFO:tasks.rados.rados.0.trial082.stdout:3919: writing trial08226312-9 from 618854 to 1027101 tid 1 2026-02-12T17:45:45.236 INFO:tasks.rados.rados.0.trial082.stdout:3919: writing trial08226312-9 from 1743901 to 2169695 tid 2 2026-02-12T17:45:45.236 INFO:tasks.rados.rados.0.trial082.stdout:3920: write oid 38 current snap is 435 2026-02-12T17:45:45.236 INFO:tasks.rados.rados.0.trial082.stdout:3920: seq_num 1323 ranges {635661=599849,1918736=316925} 2026-02-12T17:45:45.240 INFO:tasks.rados.rados.0.trial082.stdout:3920: writing trial08226312-38 from 635661 to 1235510 tid 1 2026-02-12T17:45:45.244 INFO:tasks.rados.rados.0.trial082.stdout:3920: writing trial08226312-38 from 1918736 to 2235661 tid 2 2026-02-12T17:45:45.244 INFO:tasks.rados.rados.0.trial082.stdout:3921: delete oid 47 current snap is 435 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:3918: finishing rollback tid 0 to trial08226312-30 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:3918: finishing rollback tid 1 to trial08226312-30 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:3918: finishing rollback tid 2 to trial08226312-30 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2526 (ObjNum 1305 snap 426 seq_num 1305) dirty exists 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:3919: finishing write tid 1 to trial08226312-9 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:3919: finishing write tid 2 to trial08226312-9 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:3919: finishing write tid 3 to trial08226312-9 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:3919: finishing write tid 4 to trial08226312-9 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:3919: oid 9 updating version 0 to 2577 2026-02-12T17:45:45.245 INFO:tasks.rados.rados.0.trial082.stdout:3919: oid 9 updating version 2577 to 2579 2026-02-12T17:45:45.246 INFO:tasks.rados.rados.0.trial082.stdout:3919: oid 9 version 2579 is already newer than 2578 2026-02-12T17:45:45.246 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 2579 (ObjNum 1322 snap 435 seq_num 1322) dirty exists 2026-02-12T17:45:45.246 INFO:tasks.rados.rados.0.trial082.stdout:3919: left oid 9 (ObjNum 1322 snap 435 seq_num 1322) 2026-02-12T17:45:45.246 INFO:tasks.rados.rados.0.trial082.stdout:3920: finishing write tid 1 to trial08226312-38 2026-02-12T17:45:45.247 INFO:tasks.rados.rados.0.trial082.stdout:3920: finishing write tid 2 to trial08226312-38 2026-02-12T17:45:45.247 INFO:tasks.rados.rados.0.trial082.stdout:3920: finishing write tid 3 to trial08226312-38 2026-02-12T17:45:45.247 INFO:tasks.rados.rados.0.trial082.stdout:3920: finishing write tid 4 to trial08226312-38 2026-02-12T17:45:45.247 INFO:tasks.rados.rados.0.trial082.stdout:3920: oid 38 updating version 0 to 2471 2026-02-12T17:45:45.247 INFO:tasks.rados.rados.0.trial082.stdout:3920: oid 38 updating version 2471 to 2472 2026-02-12T17:45:45.247 INFO:tasks.rados.rados.0.trial082.stdout:3920: oid 38 updating version 2472 to 2473 2026-02-12T17:45:45.247 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 38 v 2473 (ObjNum 1323 snap 435 seq_num 1323) dirty exists 2026-02-12T17:45:45.247 INFO:tasks.rados.rados.0.trial082.stdout:3920: left oid 38 (ObjNum 1323 snap 435 seq_num 1323) 2026-02-12T17:45:45.248 INFO:tasks.rados.rados.0.trial082.stdout:3917: done (4 left) 2026-02-12T17:45:45.248 INFO:tasks.rados.rados.0.trial082.stdout:3918: done (3 left) 2026-02-12T17:45:45.248 INFO:tasks.rados.rados.0.trial082.stdout:3919: done (2 left) 2026-02-12T17:45:45.248 INFO:tasks.rados.rados.0.trial082.stdout:3920: done (1 left) 2026-02-12T17:45:45.248 INFO:tasks.rados.rados.0.trial082.stdout:3921: done (0 left) 2026-02-12T17:45:45.248 INFO:tasks.rados.rados.0.trial082.stdout:3922: copy_from oid 28 from oid 48 current snap is 435 2026-02-12T17:45:45.248 INFO:tasks.rados.rados.0.trial082.stdout:3923: delete oid 49 current snap is 435 2026-02-12T17:45:45.249 INFO:tasks.rados.rados.0.trial082.stdout:3923: done (1 left) 2026-02-12T17:45:45.249 INFO:tasks.rados.rados.0.trial082.stdout:3924: write oid 18 current snap is 435 2026-02-12T17:45:45.249 INFO:tasks.rados.rados.0.trial082.stdout:3924: seq_num 1326 ranges {686082=425596,1577829=433132} 2026-02-12T17:45:45.252 INFO:tasks.rados.rados.0.trial082.stdout:3924: writing trial08226312-18 from 686082 to 1111678 tid 1 2026-02-12T17:45:45.256 INFO:tasks.rados.rados.0.trial082.stdout:3924: writing trial08226312-18 from 1577829 to 2010961 tid 2 2026-02-12T17:45:45.256 INFO:tasks.rados.rados.0.trial082.stdout:3925: copy_from oid 26 from oid 15 current snap is 435 2026-02-12T17:45:45.256 INFO:tasks.rados.rados.0.trial082.stdout:3922: finishing copy_from racing read to trial08226312-28 2026-02-12T17:45:45.256 INFO:tasks.rados.rados.0.trial082.stdout:3922: finishing copy_from to trial08226312-28 2026-02-12T17:45:45.256 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2463 (ObjNum 1313 snap 433 seq_num 1313) dirty exists 2026-02-12T17:45:45.256 INFO:tasks.rados.rados.0.trial082.stdout:3924: finishing write tid 1 to trial08226312-18 2026-02-12T17:45:45.256 INFO:tasks.rados.rados.0.trial082.stdout:3922: done (2 left) 2026-02-12T17:45:45.256 INFO:tasks.rados.rados.0.trial082.stdout:3926: copy_from oid 24 from oid 8 current snap is 435 2026-02-12T17:45:45.257 INFO:tasks.rados.rados.0.trial082.stdout:3927: write oid 34 current snap is 435 2026-02-12T17:45:45.257 INFO:tasks.rados.rados.0.trial082.stdout:3927: seq_num 1327 ranges {702889=500845,1636311=576790} 2026-02-12T17:45:45.260 INFO:tasks.rados.rados.0.trial082.stdout:3927: writing trial08226312-34 from 702889 to 1203734 tid 1 2026-02-12T17:45:45.265 INFO:tasks.rados.rados.0.trial082.stdout:3927: writing trial08226312-34 from 1636311 to 2213101 tid 2 2026-02-12T17:45:45.265 INFO:tasks.rados.rados.0.trial082.stdout:3928: copy_from oid 42 from oid 40 current snap is 435 2026-02-12T17:45:45.265 INFO:tasks.rados.rados.0.trial082.stdout:3925: finishing copy_from to trial08226312-26 2026-02-12T17:45:45.265 INFO:tasks.rados.rados.0.trial082.stdout:3925: got expected ENOENT (src dne) 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3925: finishing copy_from racing read to trial08226312-26 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3924: finishing write tid 2 to trial08226312-18 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3924: finishing write tid 3 to trial08226312-18 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3925: done (4 left) 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3929: read oid 39 snap -1 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3929: expect deleted 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3930: delete oid 19 current snap is 435 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3924: finishing write tid 4 to trial08226312-18 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3924: oid 18 updating version 0 to 2431 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3924: oid 18 version 2431 is already newer than 2430 2026-02-12T17:45:45.266 INFO:tasks.rados.rados.0.trial082.stdout:3924: oid 18 updating version 2431 to 2432 2026-02-12T17:45:45.267 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 2432 (ObjNum 1326 snap 435 seq_num 1326) dirty exists 2026-02-12T17:45:45.267 INFO:tasks.rados.rados.0.trial082.stdout:3924: left oid 18 (ObjNum 1326 snap 435 seq_num 1326) 2026-02-12T17:45:45.267 INFO:tasks.rados.rados.0.trial082.stdout:3926: finishing copy_from racing read to trial08226312-24 2026-02-12T17:45:45.267 INFO:tasks.rados.rados.0.trial082.stdout:3926: finishing copy_from to trial08226312-24 2026-02-12T17:45:45.267 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 24 v 2789 (ObjNum 1243 snap 404 seq_num 1243) dirty exists 2026-02-12T17:45:45.267 INFO:tasks.rados.rados.0.trial082.stdout:3927: finishing write tid 1 to trial08226312-34 2026-02-12T17:45:45.267 INFO:tasks.rados.rados.0.trial082.stdout:3924: done (5 left) 2026-02-12T17:45:45.268 INFO:tasks.rados.rados.0.trial082.stdout:3926: done (4 left) 2026-02-12T17:45:45.268 INFO:tasks.rados.rados.0.trial082.stdout:3929: done (3 left) 2026-02-12T17:45:45.268 INFO:tasks.rados.rados.0.trial082.stdout:3930: done (2 left) 2026-02-12T17:45:45.268 INFO:tasks.rados.rados.0.trial082.stdout:3931: write oid 35 current snap is 435 2026-02-12T17:45:45.268 INFO:tasks.rados.rados.0.trial082.stdout:3931: seq_num 1329 ranges {736503=651343,2153275=183228} 2026-02-12T17:45:45.272 INFO:tasks.rados.rados.0.trial082.stdout:3931: writing trial08226312-35 from 736503 to 1387846 tid 1 2026-02-12T17:45:45.276 INFO:tasks.rados.rados.0.trial082.stdout:3931: writing trial08226312-35 from 2153275 to 2336503 tid 2 2026-02-12T17:45:45.276 INFO:tasks.rados.rados.0.trial082.stdout:3932: rollback oid 28 current snap is 435 2026-02-12T17:45:45.276 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 28 to 427 2026-02-12T17:45:45.276 INFO:tasks.rados.rados.0.trial082.stdout:3927: finishing write tid 2 to trial08226312-34 2026-02-12T17:45:45.276 INFO:tasks.rados.rados.0.trial082.stdout:3927: finishing write tid 3 to trial08226312-34 2026-02-12T17:45:45.276 INFO:tasks.rados.rados.0.trial082.stdout:3927: finishing write tid 4 to trial08226312-34 2026-02-12T17:45:45.277 INFO:tasks.rados.rados.0.trial082.stdout:3927: oid 34 updating version 0 to 2434 2026-02-12T17:45:45.277 INFO:tasks.rados.rados.0.trial082.stdout:3927: oid 34 version 2434 is already newer than 2433 2026-02-12T17:45:45.277 INFO:tasks.rados.rados.0.trial082.stdout:3927: oid 34 updating version 2434 to 2435 2026-02-12T17:45:45.277 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 34 v 2435 (ObjNum 1327 snap 435 seq_num 1327) dirty exists 2026-02-12T17:45:45.277 INFO:tasks.rados.rados.0.trial082.stdout:3927: left oid 34 (ObjNum 1327 snap 435 seq_num 1327) 2026-02-12T17:45:45.277 INFO:tasks.rados.rados.0.trial082.stdout:3928: finishing copy_from racing read to trial08226312-42 2026-02-12T17:45:45.277 INFO:tasks.rados.rados.0.trial082.stdout:3927: done (3 left) 2026-02-12T17:45:45.277 INFO:tasks.rados.rados.0.trial082.stdout:3933: write (excl) oid 41 current snap is 435 2026-02-12T17:45:45.277 INFO:tasks.rados.rados.0.trial082.stdout:3933: seq_num 1330 ranges {753310=726592,2095404=257906} 2026-02-12T17:45:45.281 INFO:tasks.rados.rados.0.trial082.stdout:3933: writing trial08226312-41 from 753310 to 1479902 tid 1 2026-02-12T17:45:45.286 INFO:tasks.rados.rados.0.trial082.stdout:3933: writing trial08226312-41 from 2095404 to 2353310 tid 2 2026-02-12T17:45:45.286 INFO:tasks.rados.rados.0.trial082.stdout:3934: rollback oid 45 current snap is 435 2026-02-12T17:45:45.286 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 45 to 390 2026-02-12T17:45:45.286 INFO:tasks.rados.rados.0.trial082.stdout:3928: finishing copy_from to trial08226312-42 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 2527 (ObjNum 1311 snap 431 seq_num 1311) dirty exists 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3931: finishing write tid 1 to trial08226312-35 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3928: done (4 left) 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3935: read oid 46 snap -1 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3935: expect (ObjNum 1299 snap 426 seq_num 1299) 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3936: read oid 48 snap -1 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3936: expect (ObjNum 1313 snap 433 seq_num 1313) 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3937: rollback oid 32 current snap is 435 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 32 to 427 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3932: finishing rollback tid 0 to trial08226312-28 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3932: finishing rollback tid 1 to trial08226312-28 2026-02-12T17:45:45.287 INFO:tasks.rados.rados.0.trial082.stdout:3931: finishing write tid 2 to trial08226312-35 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3931: finishing write tid 3 to trial08226312-35 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3932: finishing rollback tid 2 to trial08226312-28 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2585 (ObjNum 1303 snap 426 seq_num 1303) dirty exists 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3931: finishing write tid 4 to trial08226312-35 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3931: oid 35 updating version 0 to 2776 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3931: oid 35 version 2776 is already newer than 2774 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3931: oid 35 version 2776 is already newer than 2775 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 2776 (ObjNum 1329 snap 435 seq_num 1329) dirty exists 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3931: left oid 35 (ObjNum 1329 snap 435 seq_num 1329) 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3933: finishing write tid 1 to trial08226312-41 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3931: done (6 left) 2026-02-12T17:45:45.288 INFO:tasks.rados.rados.0.trial082.stdout:3932: done (5 left) 2026-02-12T17:45:45.289 INFO:tasks.rados.rados.0.trial082.stdout:3938: read oid 26 snap 431 2026-02-12T17:45:45.289 INFO:tasks.rados.rados.0.trial082.stdout:3938: expect (ObjNum 1231 snap 394 seq_num 1231) 2026-02-12T17:45:45.289 INFO:tasks.rados.rados.0.trial082.stdout:3939: read oid 15 snap 386 2026-02-12T17:45:45.289 INFO:tasks.rados.rados.0.trial082.stdout:3939: expect deleted 2026-02-12T17:45:45.289 INFO:tasks.rados.rados.0.trial082.stdout:3940: copy_from oid 43 from oid 25 current snap is 435 2026-02-12T17:45:45.289 INFO:tasks.rados.rados.0.trial082.stdout:3941: delete oid 18 current snap is 435 2026-02-12T17:45:45.290 INFO:tasks.rados.rados.0.trial082.stdout:3937: finishing rollback tid 0 to trial08226312-32 2026-02-12T17:45:45.290 INFO:tasks.rados.rados.0.trial082.stdout:3937: finishing rollback tid 1 to trial08226312-32 2026-02-12T17:45:45.290 INFO:tasks.rados.rados.0.trial082.stdout:3937: finishing rollback tid 2 to trial08226312-32 2026-02-12T17:45:45.290 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 32 v 2476 (ObjNum 1137 snap 356 seq_num 1137) dirty exists 2026-02-12T17:45:45.290 INFO:tasks.rados.rados.0.trial082.stdout:3937: done (8 left) 2026-02-12T17:45:45.290 INFO:tasks.rados.rados.0.trial082.stdout:3939: done (7 left) 2026-02-12T17:45:45.290 INFO:tasks.rados.rados.0.trial082.stdout:3941: done (6 left) 2026-02-12T17:45:45.290 INFO:tasks.rados.rados.0.trial082.stdout:3942: write oid 5 current snap is 435 2026-02-12T17:45:45.291 INFO:tasks.rados.rados.0.trial082.stdout:3942: seq_num 1332 ranges {786924=593443,1928721=458203} 2026-02-12T17:45:45.292 INFO:tasks.rados.rados.0.trial082.stdout:3942: writing trial08226312-5 from 786924 to 1380367 tid 1 2026-02-12T17:45:45.296 INFO:tasks.rados.rados.0.trial082.stdout:3942: writing trial08226312-5 from 1928721 to 2386924 tid 2 2026-02-12T17:45:45.297 INFO:tasks.rados.rados.0.trial082.stdout:3943: snap_remove snap 428 2026-02-12T17:45:45.916 INFO:tasks.rados.rados.0.trial082.stdout:3943: done (7 left) 2026-02-12T17:45:45.917 INFO:tasks.rados.rados.0.trial082.stdout:3944: copy_from oid 21 from oid 7 current snap is 435 2026-02-12T17:45:45.917 INFO:tasks.rados.rados.0.trial082.stdout:3934: finishing rollback tid 0 to trial08226312-45 2026-02-12T17:45:45.917 INFO:tasks.rados.rados.0.trial082.stdout:3936: expect (ObjNum 1313 snap 433 seq_num 1313) 2026-02-12T17:45:45.928 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:45.946 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:45.964 INFO:tasks.rados.rados.0.trial082.stdout:3933: finishing write tid 2 to trial08226312-41 2026-02-12T17:45:45.964 INFO:tasks.rados.rados.0.trial082.stdout:3936: done (7 left) 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3945: read oid 32 snap -1 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3945: expect (ObjNum 1137 snap 356 seq_num 1137) 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3946: read oid 19 snap -1 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3946: expect deleted 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3947: read oid 36 snap -1 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3947: expect deleted 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3948: delete oid 15 current snap is 435 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3933: finishing write tid 3 to trial08226312-41 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3933: finishing write tid 4 to trial08226312-41 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3933: oid 41 updating version 0 to 2735 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3933: oid 41 updating version 2735 to 2736 2026-02-12T17:45:45.965 INFO:tasks.rados.rados.0.trial082.stdout:3933: oid 41 updating version 2736 to 2737 2026-02-12T17:45:45.966 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 2737 (ObjNum 1330 snap 435 seq_num 1330) dirty exists 2026-02-12T17:45:45.966 INFO:tasks.rados.rados.0.trial082.stdout:3933: left oid 41 (ObjNum 1330 snap 435 seq_num 1330) 2026-02-12T17:45:45.966 INFO:tasks.rados.rados.0.trial082.stdout:3940: finishing copy_from racing read to trial08226312-43 2026-02-12T17:45:45.966 INFO:tasks.rados.rados.0.trial082.stdout:3935: expect (ObjNum 1299 snap 426 seq_num 1299) 2026-02-12T17:45:46.003 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1234068 2026-02-12T17:45:46.060 INFO:tasks.rados.rados.0.trial082.stdout:3934: finishing rollback tid 1 to trial08226312-45 2026-02-12T17:45:46.060 INFO:tasks.rados.rados.0.trial082.stdout:3934: finishing rollback tid 2 to trial08226312-45 2026-02-12T17:45:46.060 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 45 v 2779 (ObjNum 1103 snap 346 seq_num 1103) dirty exists 2026-02-12T17:45:46.060 INFO:tasks.rados.rados.0.trial082.stdout:3938: expect (ObjNum 1231 snap 394 seq_num 1231) 2026-02-12T17:45:46.060 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:46.163 INFO:tasks.rados.rados.0.trial082.stdout:3940: finishing copy_from to trial08226312-43 2026-02-12T17:45:46.163 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 43 v 2464 (ObjNum 1208 snap 390 seq_num 1208) dirty exists 2026-02-12T17:45:46.163 INFO:tasks.rados.rados.0.trial082.stdout:3942: finishing write tid 1 to trial08226312-5 2026-02-12T17:45:46.163 INFO:tasks.rados.rados.0.trial082.stdout:3942: finishing write tid 2 to trial08226312-5 2026-02-12T17:45:46.163 INFO:tasks.rados.rados.0.trial082.stdout:3933: done (10 left) 2026-02-12T17:45:46.163 INFO:tasks.rados.rados.0.trial082.stdout:3934: done (9 left) 2026-02-12T17:45:46.163 INFO:tasks.rados.rados.0.trial082.stdout:3935: done (8 left) 2026-02-12T17:45:46.163 INFO:tasks.rados.rados.0.trial082.stdout:3938: done (7 left) 2026-02-12T17:45:46.163 INFO:tasks.rados.rados.0.trial082.stdout:3940: done (6 left) 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3948: done (5 left) 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3949: rollback oid 9 current snap is 435 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 9 to 406 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3942: finishing write tid 3 to trial08226312-5 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3942: finishing write tid 4 to trial08226312-5 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3942: oid 5 updating version 0 to 2501 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3942: oid 5 updating version 2501 to 2503 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3942: oid 5 version 2503 is already newer than 2502 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 5 v 2503 (ObjNum 1332 snap 435 seq_num 1332) dirty exists 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3942: left oid 5 (ObjNum 1332 snap 435 seq_num 1332) 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3944: finishing copy_from to trial08226312-21 2026-02-12T17:45:46.164 INFO:tasks.rados.rados.0.trial082.stdout:3944: got expected ENOENT (src dne) 2026-02-12T17:45:46.165 INFO:tasks.rados.rados.0.trial082.stdout:3944: finishing copy_from racing read to trial08226312-21 2026-02-12T17:45:46.165 INFO:tasks.rados.rados.0.trial082.stdout:3945: expect (ObjNum 1137 snap 356 seq_num 1137) 2026-02-12T17:45:46.189 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 973936 2026-02-12T17:45:46.204 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:46.227 INFO:tasks.rados.rados.0.trial082.stdout:3949: finishing rollback tid 0 to trial08226312-9 2026-02-12T17:45:46.227 INFO:tasks.rados.rados.0.trial082.stdout:3949: finishing rollback tid 1 to trial08226312-9 2026-02-12T17:45:46.227 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 9 v 2595 (ObjNum 273 snap 0 seq_num 0) dirty dne 2026-02-12T17:45:46.227 INFO:tasks.rados.rados.0.trial082.stdout:3942: done (5 left) 2026-02-12T17:45:46.227 INFO:tasks.rados.rados.0.trial082.stdout:3944: done (4 left) 2026-02-12T17:45:46.228 INFO:tasks.rados.rados.0.trial082.stdout:3945: done (3 left) 2026-02-12T17:45:46.228 INFO:tasks.rados.rados.0.trial082.stdout:3946: done (2 left) 2026-02-12T17:45:46.228 INFO:tasks.rados.rados.0.trial082.stdout:3947: done (1 left) 2026-02-12T17:45:46.228 INFO:tasks.rados.rados.0.trial082.stdout:3949: done (0 left) 2026-02-12T17:45:46.228 INFO:tasks.rados.rados.0.trial082.stdout:3950: read oid 6 snap 338 2026-02-12T17:45:46.228 INFO:tasks.rados.rados.0.trial082.stdout:3950: expect (ObjNum 1040 snap 325 seq_num 1040) 2026-02-12T17:45:46.228 INFO:tasks.rados.rados.0.trial082.stdout:3951: snap_remove snap 414 2026-02-12T17:45:46.907 INFO:tasks.rados.rados.0.trial082.stdout:3951: done (1 left) 2026-02-12T17:45:46.907 INFO:tasks.rados.rados.0.trial082.stdout:3952: copy_from oid 41 from oid 12 current snap is 435 2026-02-12T17:45:46.907 INFO:tasks.rados.rados.0.trial082.stdout:3950: expect (ObjNum 1040 snap 325 seq_num 1040) 2026-02-12T17:45:46.907 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:46.935 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1604489 2026-02-12T17:45:46.975 INFO:tasks.rados.rados.0.trial082.stdout:3952: finishing copy_from racing read to trial08226312-41 2026-02-12T17:45:46.975 INFO:tasks.rados.rados.0.trial082.stdout:3952: finishing copy_from to trial08226312-41 2026-02-12T17:45:46.975 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 2496 (ObjNum 1248 snap 408 seq_num 1248) dirty exists 2026-02-12T17:45:46.976 INFO:tasks.rados.rados.0.trial082.stdout:3950: done (1 left) 2026-02-12T17:45:46.976 INFO:tasks.rados.rados.0.trial082.stdout:3952: done (0 left) 2026-02-12T17:45:46.976 INFO:tasks.rados.rados.0.trial082.stdout:3953: snap_create 2026-02-12T17:45:47.920 INFO:tasks.rados.rados.0.trial082.stdout:3953: done (0 left) 2026-02-12T17:45:47.920 INFO:tasks.rados.rados.0.trial082.stdout:3954: delete oid 20 current snap is 436 2026-02-12T17:45:47.924 INFO:tasks.rados.rados.0.trial082.stdout:3954: done (0 left) 2026-02-12T17:45:47.924 INFO:tasks.rados.rados.0.trial082.stdout:3955: snap_remove snap 338 2026-02-12T17:45:48.921 INFO:tasks.rados.rados.0.trial082.stdout:3955: done (0 left) 2026-02-12T17:45:48.921 INFO:tasks.rados.rados.0.trial082.stdout:3956: rollback oid 11 current snap is 436 2026-02-12T17:45:48.921 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 395 2026-02-12T17:45:48.921 INFO:tasks.rados.rados.0.trial082.stdout:3957: write (excl) oid 10 current snap is 436 2026-02-12T17:45:48.921 INFO:tasks.rados.rados.0.trial082.stdout:3957: seq_num 1335 ranges {437345=419190,1587814=591466} 2026-02-12T17:45:48.924 INFO:tasks.rados.rados.0.trial082.stdout:3957: writing trial08226312-10 from 437345 to 856535 tid 1 2026-02-12T17:45:48.929 INFO:tasks.rados.rados.0.trial082.stdout:3957: writing trial08226312-10 from 1587814 to 2179280 tid 2 2026-02-12T17:45:48.929 INFO:tasks.rados.rados.0.trial082.stdout:3958: write (excl) oid 42 current snap is 436 2026-02-12T17:45:48.929 INFO:tasks.rados.rados.0.trial082.stdout:3958: seq_num 1336 ranges {454152=494439,1646296=735124} 2026-02-12T17:45:48.933 INFO:tasks.rados.rados.0.trial082.stdout:3958: writing trial08226312-42 from 454152 to 948591 tid 1 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3958: writing trial08226312-42 from 1646296 to 2381420 tid 2 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3959: write (excl) oid 4 current snap is 436 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3956: finishing rollback tid 0 to trial08226312-11 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3956: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3956: finishing rollback tid 2 to trial08226312-11 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 2463 (ObjNum 1181 snap 379 seq_num 1181) dirty exists 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3957: finishing write tid 1 to trial08226312-10 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3957: finishing write tid 2 to trial08226312-10 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3957: finishing write tid 3 to trial08226312-10 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3957: finishing write tid 4 to trial08226312-10 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3957: oid 10 updating version 0 to 2527 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3957: oid 10 updating version 2527 to 2529 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3957: oid 10 version 2529 is already newer than 2528 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 10 v 2529 (ObjNum 1335 snap 436 seq_num 1335) dirty exists 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3957: left oid 10 (ObjNum 1335 snap 436 seq_num 1335) 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3958: finishing write tid 1 to trial08226312-42 2026-02-12T17:45:48.939 INFO:tasks.rados.rados.0.trial082.stdout:3959: seq_num 1337 ranges {470959=569688,1704778=595135} 2026-02-12T17:45:48.942 INFO:tasks.rados.rados.0.trial082.stdout:3959: writing trial08226312-4 from 470959 to 1040647 tid 1 2026-02-12T17:45:48.947 INFO:tasks.rados.rados.0.trial082.stdout:3959: writing trial08226312-4 from 1704778 to 2299913 tid 2 2026-02-12T17:45:48.947 INFO:tasks.rados.rados.0.trial082.stdout:3956: done (3 left) 2026-02-12T17:45:48.947 INFO:tasks.rados.rados.0.trial082.stdout:3957: done (2 left) 2026-02-12T17:45:48.947 INFO:tasks.rados.rados.0.trial082.stdout:3960: write (excl) oid 30 current snap is 436 2026-02-12T17:45:48.947 INFO:tasks.rados.rados.0.trial082.stdout:3960: seq_num 1338 ranges {487766=644937,1646907=738793} 2026-02-12T17:45:48.951 INFO:tasks.rados.rados.0.trial082.stdout:3960: writing trial08226312-30 from 487766 to 1132703 tid 1 2026-02-12T17:45:48.956 INFO:tasks.rados.rados.0.trial082.stdout:3960: writing trial08226312-30 from 1646907 to 2385700 tid 2 2026-02-12T17:45:48.956 INFO:tasks.rados.rados.0.trial082.stdout:3961: write oid 28 current snap is 436 2026-02-12T17:45:48.956 INFO:tasks.rados.rados.0.trial082.stdout:3958: finishing write tid 2 to trial08226312-42 2026-02-12T17:45:48.956 INFO:tasks.rados.rados.0.trial082.stdout:3958: finishing write tid 3 to trial08226312-42 2026-02-12T17:45:48.956 INFO:tasks.rados.rados.0.trial082.stdout:3958: finishing write tid 4 to trial08226312-42 2026-02-12T17:45:48.957 INFO:tasks.rados.rados.0.trial082.stdout:3958: oid 42 updating version 0 to 2613 2026-02-12T17:45:48.957 INFO:tasks.rados.rados.0.trial082.stdout:3958: oid 42 updating version 2613 to 2615 2026-02-12T17:45:48.957 INFO:tasks.rados.rados.0.trial082.stdout:3958: oid 42 version 2615 is already newer than 2614 2026-02-12T17:45:48.957 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 42 v 2615 (ObjNum 1336 snap 436 seq_num 1336) dirty exists 2026-02-12T17:45:48.957 INFO:tasks.rados.rados.0.trial082.stdout:3958: left oid 42 (ObjNum 1336 snap 436 seq_num 1336) 2026-02-12T17:45:48.957 INFO:tasks.rados.rados.0.trial082.stdout:3959: finishing write tid 1 to trial08226312-4 2026-02-12T17:45:48.957 INFO:tasks.rados.rados.0.trial082.stdout:3961: seq_num 1339 ranges {504573=436539,1421742=598804,2437505=67068} 2026-02-12T17:45:48.960 INFO:tasks.rados.rados.0.trial082.stdout:3961: writing trial08226312-28 from 504573 to 941112 tid 1 2026-02-12T17:45:48.964 INFO:tasks.rados.rados.0.trial082.stdout:3961: writing trial08226312-28 from 1421742 to 2020546 tid 2 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3961: writing trial08226312-28 from 2437505 to 2504573 tid 3 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3958: done (3 left) 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3962: read oid 27 snap -1 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3962: expect (ObjNum 1310 snap 431 seq_num 1310) 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3959: finishing write tid 2 to trial08226312-4 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3959: finishing write tid 3 to trial08226312-4 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3959: finishing write tid 4 to trial08226312-4 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3959: oid 4 updating version 0 to 3120 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3959: oid 4 version 3120 is already newer than 3119 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:3959: oid 4 updating version 3120 to 3121 2026-02-12T17:45:48.966 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 3121 (ObjNum 1337 snap 436 seq_num 1337) dirty exists 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3959: left oid 4 (ObjNum 1337 snap 436 seq_num 1337) 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3960: finishing write tid 1 to trial08226312-30 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3960: finishing write tid 2 to trial08226312-30 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3959: done (3 left) 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3963: snap_create 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3960: finishing write tid 3 to trial08226312-30 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3960: finishing write tid 4 to trial08226312-30 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3960: oid 30 updating version 0 to 2531 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3960: oid 30 updating version 2531 to 2532 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3960: oid 30 version 2532 is already newer than 2530 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 30 v 2532 (ObjNum 1338 snap 436 seq_num 1338) dirty exists 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3960: left oid 30 (ObjNum 1338 snap 436 seq_num 1338) 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3961: finishing write tid 1 to trial08226312-28 2026-02-12T17:45:48.967 INFO:tasks.rados.rados.0.trial082.stdout:3961: finishing write tid 2 to trial08226312-28 2026-02-12T17:45:48.968 INFO:tasks.rados.rados.0.trial082.stdout:3962: expect (ObjNum 1310 snap 431 seq_num 1310) 2026-02-12T17:45:48.997 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 674263 2026-02-12T17:45:49.006 INFO:tasks.rados.rados.0.trial082.stdout:3961: finishing write tid 3 to trial08226312-28 2026-02-12T17:45:49.006 INFO:tasks.rados.rados.0.trial082.stdout:3961: finishing write tid 4 to trial08226312-28 2026-02-12T17:45:49.006 INFO:tasks.rados.rados.0.trial082.stdout:3961: finishing write tid 5 to trial08226312-28 2026-02-12T17:45:49.006 INFO:tasks.rados.rados.0.trial082.stdout:3961: oid 28 updating version 0 to 2619 2026-02-12T17:45:49.006 INFO:tasks.rados.rados.0.trial082.stdout:3961: oid 28 version 2619 is already newer than 2617 2026-02-12T17:45:49.006 INFO:tasks.rados.rados.0.trial082.stdout:3961: oid 28 version 2619 is already newer than 2618 2026-02-12T17:45:49.006 INFO:tasks.rados.rados.0.trial082.stdout:3961: oid 28 updating version 2619 to 2620 2026-02-12T17:45:49.006 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 28 v 2620 (ObjNum 1339 snap 436 seq_num 1339) dirty exists 2026-02-12T17:45:49.006 INFO:tasks.rados.rados.0.trial082.stdout:3961: left oid 28 (ObjNum 1339 snap 436 seq_num 1339) 2026-02-12T17:45:49.928 INFO:tasks.rados.rados.0.trial082.stdout:3960: done (3 left) 2026-02-12T17:45:49.928 INFO:tasks.rados.rados.0.trial082.stdout:3961: done (2 left) 2026-02-12T17:45:49.928 INFO:tasks.rados.rados.0.trial082.stdout:3962: done (1 left) 2026-02-12T17:45:49.929 INFO:tasks.rados.rados.0.trial082.stdout:3963: done (0 left) 2026-02-12T17:45:49.929 INFO:tasks.rados.rados.0.trial082.stdout:3964: rollback oid 41 current snap is 437 2026-02-12T17:45:49.929 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 41 to 415 2026-02-12T17:45:49.929 INFO:tasks.rados.rados.0.trial082.stdout:3965: write (excl) oid 11 current snap is 437 2026-02-12T17:45:49.929 INFO:tasks.rados.rados.0.trial082.stdout:3965: seq_num 1340 ranges {521380=511788,1480224=742462} 2026-02-12T17:45:49.932 INFO:tasks.rados.rados.0.trial082.stdout:3965: writing trial08226312-11 from 521380 to 1033168 tid 1 2026-02-12T17:45:49.937 INFO:tasks.rados.rados.0.trial082.stdout:3965: writing trial08226312-11 from 1480224 to 2222686 tid 2 2026-02-12T17:45:49.937 INFO:tasks.rados.rados.0.trial082.stdout:3966: write oid 18 current snap is 437 2026-02-12T17:45:49.937 INFO:tasks.rados.rados.0.trial082.stdout:3966: seq_num 1341 ranges {538187=587037,1538706=602473} 2026-02-12T17:45:49.941 INFO:tasks.rados.rados.0.trial082.stdout:3966: writing trial08226312-18 from 538187 to 1125224 tid 1 2026-02-12T17:45:49.945 INFO:tasks.rados.rados.0.trial082.stdout:3966: writing trial08226312-18 from 1538706 to 2141179 tid 2 2026-02-12T17:45:49.945 INFO:tasks.rados.rados.0.trial082.stdout:3967: write (excl) oid 6 current snap is 437 2026-02-12T17:45:49.945 INFO:tasks.rados.rados.0.trial082.stdout:3967: seq_num 1342 ranges {554994=662286,1997188=557806} 2026-02-12T17:45:49.950 INFO:tasks.rados.rados.0.trial082.stdout:3967: writing trial08226312-6 from 554994 to 1217280 tid 1 2026-02-12T17:45:49.956 INFO:tasks.rados.rados.0.trial082.stdout:3967: writing trial08226312-6 from 1997188 to 2554994 tid 2 2026-02-12T17:45:49.956 INFO:tasks.rados.rados.0.trial082.stdout:3968: read oid 48 snap -1 2026-02-12T17:45:49.956 INFO:tasks.rados.rados.0.trial082.stdout:3968: expect (ObjNum 1313 snap 433 seq_num 1313) 2026-02-12T17:45:49.956 INFO:tasks.rados.rados.0.trial082.stdout:3969: rollback oid 4 current snap is 437 2026-02-12T17:45:49.956 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 4 to 407 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3964: finishing rollback tid 0 to trial08226312-41 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3964: finishing rollback tid 1 to trial08226312-41 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3964: finishing rollback tid 2 to trial08226312-41 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 41 v 2740 (ObjNum 1071 snap 338 seq_num 1071) dirty exists 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3965: finishing write tid 1 to trial08226312-11 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3965: finishing write tid 2 to trial08226312-11 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3965: finishing write tid 3 to trial08226312-11 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3965: finishing write tid 4 to trial08226312-11 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3965: oid 11 updating version 0 to 2464 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3965: oid 11 updating version 2464 to 2465 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:3965: oid 11 updating version 2465 to 2466 2026-02-12T17:45:49.957 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 2466 (ObjNum 1340 snap 437 seq_num 1340) dirty exists 2026-02-12T17:45:49.958 INFO:tasks.rados.rados.0.trial082.stdout:3965: left oid 11 (ObjNum 1340 snap 437 seq_num 1340) 2026-02-12T17:45:49.958 INFO:tasks.rados.rados.0.trial082.stdout:3966: finishing write tid 1 to trial08226312-18 2026-02-12T17:45:49.958 INFO:tasks.rados.rados.0.trial082.stdout:3966: finishing write tid 2 to trial08226312-18 2026-02-12T17:45:49.958 INFO:tasks.rados.rados.0.trial082.stdout:3964: done (5 left) 2026-02-12T17:45:49.958 INFO:tasks.rados.rados.0.trial082.stdout:3965: done (4 left) 2026-02-12T17:45:49.958 INFO:tasks.rados.rados.0.trial082.stdout:3970: write oid 33 current snap is 437 2026-02-12T17:45:49.958 INFO:tasks.rados.rados.0.trial082.stdout:3970: seq_num 1343 ranges {571801=737535,1939317=489789} 2026-02-12T17:45:49.961 INFO:tasks.rados.rados.0.trial082.stdout:3970: writing trial08226312-33 from 571801 to 1309336 tid 1 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:3970: writing trial08226312-33 from 1939317 to 2429106 tid 2 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:3971: delete oid 44 current snap is 437 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:3966: finishing write tid 3 to trial08226312-18 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:3966: finishing write tid 4 to trial08226312-18 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:3966: oid 18 updating version 0 to 2439 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:3966: oid 18 version 2439 is already newer than 2438 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:3966: oid 18 version 2439 is already newer than 2437 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 2439 (ObjNum 1341 snap 437 seq_num 1341) dirty exists 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:3966: left oid 18 (ObjNum 1341 snap 437 seq_num 1341) 2026-02-12T17:45:49.966 INFO:tasks.rados.rados.0.trial082.stdout:3967: finishing write tid 1 to trial08226312-6 2026-02-12T17:45:49.967 INFO:tasks.rados.rados.0.trial082.stdout:3967: finishing write tid 2 to trial08226312-6 2026-02-12T17:45:49.967 INFO:tasks.rados.rados.0.trial082.stdout:3967: finishing write tid 3 to trial08226312-6 2026-02-12T17:45:49.967 INFO:tasks.rados.rados.0.trial082.stdout:3967: finishing write tid 4 to trial08226312-6 2026-02-12T17:45:49.967 INFO:tasks.rados.rados.0.trial082.stdout:3967: oid 6 updating version 0 to 2468 2026-02-12T17:45:49.967 INFO:tasks.rados.rados.0.trial082.stdout:3967: oid 6 updating version 2468 to 2469 2026-02-12T17:45:49.967 INFO:tasks.rados.rados.0.trial082.stdout:3967: oid 6 updating version 2469 to 2470 2026-02-12T17:45:49.967 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 6 v 2470 (ObjNum 1342 snap 437 seq_num 1342) dirty exists 2026-02-12T17:45:49.967 INFO:tasks.rados.rados.0.trial082.stdout:3967: left oid 6 (ObjNum 1342 snap 437 seq_num 1342) 2026-02-12T17:45:49.967 INFO:tasks.rados.rados.0.trial082.stdout:3968: expect (ObjNum 1313 snap 433 seq_num 1313) 2026-02-12T17:45:49.977 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 146049 2026-02-12T17:45:49.994 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:50.013 INFO:tasks.rados.rados.0.trial082.stdout:3969: finishing rollback tid 0 to trial08226312-4 2026-02-12T17:45:50.013 INFO:tasks.rados.rados.0.trial082.stdout:3969: finishing rollback tid 1 to trial08226312-4 2026-02-12T17:45:50.013 INFO:tasks.rados.rados.0.trial082.stdout:3969: finishing rollback tid 2 to trial08226312-4 2026-02-12T17:45:50.013 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 4 v 3125 (ObjNum 1146 snap 364 seq_num 1146) dirty exists 2026-02-12T17:45:50.013 INFO:tasks.rados.rados.0.trial082.stdout:3970: finishing write tid 1 to trial08226312-33 2026-02-12T17:45:50.013 INFO:tasks.rados.rados.0.trial082.stdout:3970: finishing write tid 2 to trial08226312-33 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3970: finishing write tid 3 to trial08226312-33 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3970: finishing write tid 4 to trial08226312-33 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3970: oid 33 updating version 0 to 2742 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3970: oid 33 version 2742 is already newer than 2741 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3970: oid 33 updating version 2742 to 2743 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 33 v 2743 (ObjNum 1343 snap 437 seq_num 1343) dirty exists 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3970: left oid 33 (ObjNum 1343 snap 437 seq_num 1343) 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3966: done (5 left) 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3967: done (4 left) 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3968: done (3 left) 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3969: done (2 left) 2026-02-12T17:45:50.014 INFO:tasks.rados.rados.0.trial082.stdout:3970: done (1 left) 2026-02-12T17:45:50.015 INFO:tasks.rados.rados.0.trial082.stdout:3971: done (0 left) 2026-02-12T17:45:50.015 INFO:tasks.rados.rados.0.trial082.stdout:3972: copy_from oid 40 from oid 21 current snap is 437 2026-02-12T17:45:50.015 INFO:tasks.rados.rados.0.trial082.stdout:3973: delete oid 27 current snap is 437 2026-02-12T17:45:50.015 INFO:tasks.rados.rados.0.trial082.stdout:3972: finishing copy_from to trial08226312-40 2026-02-12T17:45:50.015 INFO:tasks.rados.rados.0.trial082.stdout:3972: got expected ENOENT (src dne) 2026-02-12T17:45:50.015 INFO:tasks.rados.rados.0.trial082.stdout:3972: finishing copy_from racing read to trial08226312-40 2026-02-12T17:45:50.016 INFO:tasks.rados.rados.0.trial082.stdout:3972: done (1 left) 2026-02-12T17:45:50.016 INFO:tasks.rados.rados.0.trial082.stdout:3973: done (0 left) 2026-02-12T17:45:50.016 INFO:tasks.rados.rados.0.trial082.stdout:3974: read oid 43 snap 385 2026-02-12T17:45:50.016 INFO:tasks.rados.rados.0.trial082.stdout:3974: expect (ObjNum 1091 snap 345 seq_num 1091) 2026-02-12T17:45:50.016 INFO:tasks.rados.rados.0.trial082.stdout:3975: delete oid 18 current snap is 437 2026-02-12T17:45:50.016 INFO:tasks.rados.rados.0.trial082.stdout:3975: done (1 left) 2026-02-12T17:45:50.016 INFO:tasks.rados.rados.0.trial082.stdout:3976: write (excl) oid 36 current snap is 437 2026-02-12T17:45:50.016 INFO:tasks.rados.rados.0.trial082.stdout:3976: seq_num 1347 ranges {639029=754884,2173245=465784} 2026-02-12T17:45:50.020 INFO:tasks.rados.rados.0.trial082.stdout:3976: writing trial08226312-36 from 639029 to 1393913 tid 1 2026-02-12T17:45:50.025 INFO:tasks.rados.rados.0.trial082.stdout:3976: writing trial08226312-36 from 2173245 to 2639029 tid 2 2026-02-12T17:45:50.025 INFO:tasks.rados.rados.0.trial082.stdout:3977: write oid 35 current snap is 437 2026-02-12T17:45:50.025 INFO:tasks.rados.rados.0.trial082.stdout:3977: seq_num 1348 ranges {655836=430133,1831727=757138} 2026-02-12T17:45:50.029 INFO:tasks.rados.rados.0.trial082.stdout:3977: writing trial08226312-35 from 655836 to 1085969 tid 1 2026-02-12T17:45:50.035 INFO:tasks.rados.rados.0.trial082.stdout:3977: writing trial08226312-35 from 1831727 to 2588865 tid 2 2026-02-12T17:45:50.036 INFO:tasks.rados.rados.0.trial082.stdout:3978: snap_create 2026-02-12T17:45:50.036 INFO:tasks.rados.rados.0.trial082.stdout:3974: expect (ObjNum 1091 snap 345 seq_num 1091) 2026-02-12T17:45:50.071 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 1331436 2026-02-12T17:45:50.118 INFO:tasks.rados.rados.0.trial082.stdout:3976: finishing write tid 1 to trial08226312-36 2026-02-12T17:45:50.118 INFO:tasks.rados.rados.0.trial082.stdout:3976: finishing write tid 2 to trial08226312-36 2026-02-12T17:45:50.118 INFO:tasks.rados.rados.0.trial082.stdout:3976: finishing write tid 3 to trial08226312-36 2026-02-12T17:45:50.118 INFO:tasks.rados.rados.0.trial082.stdout:3976: finishing write tid 4 to trial08226312-36 2026-02-12T17:45:50.118 INFO:tasks.rados.rados.0.trial082.stdout:3976: oid 36 updating version 0 to 2783 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3976: oid 36 version 2783 is already newer than 2782 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3976: oid 36 version 2783 is already newer than 2781 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 36 v 2783 (ObjNum 1347 snap 437 seq_num 1347) dirty exists 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3976: left oid 36 (ObjNum 1347 snap 437 seq_num 1347) 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3977: finishing write tid 1 to trial08226312-35 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3977: finishing write tid 2 to trial08226312-35 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3977: finishing write tid 3 to trial08226312-35 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3977: finishing write tid 4 to trial08226312-35 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3977: oid 35 updating version 0 to 2785 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3977: oid 35 updating version 2785 to 2786 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3977: oid 35 version 2786 is already newer than 2784 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 35 v 2786 (ObjNum 1348 snap 437 seq_num 1348) dirty exists 2026-02-12T17:45:50.119 INFO:tasks.rados.rados.0.trial082.stdout:3977: left oid 35 (ObjNum 1348 snap 437 seq_num 1348) 2026-02-12T17:45:50.932 INFO:tasks.rados.rados.0.trial082.stdout:3974: done (3 left) 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:3976: done (2 left) 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:3977: done (1 left) 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:3978: done (0 left) 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:3979: read oid 47 snap 434 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:3979: expect deleted 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:3980: read oid 9 snap -1 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:3980: expect deleted 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:3981: rollback oid 37 current snap is 438 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 37 to 387 2026-02-12T17:45:50.933 INFO:tasks.rados.rados.0.trial082.stdout:3982: delete oid 17 current snap is 438 2026-02-12T17:45:50.935 INFO:tasks.rados.rados.0.trial082.stdout:3979: done (3 left) 2026-02-12T17:45:50.935 INFO:tasks.rados.rados.0.trial082.stdout:3980: done (2 left) 2026-02-12T17:45:50.935 INFO:tasks.rados.rados.0.trial082.stdout:3982: done (1 left) 2026-02-12T17:45:50.935 INFO:tasks.rados.rados.0.trial082.stdout:3983: delete oid 29 current snap is 438 2026-02-12T17:45:50.935 INFO:tasks.rados.rados.0.trial082.stdout:3981: finishing rollback tid 0 to trial08226312-37 2026-02-12T17:45:50.936 INFO:tasks.rados.rados.0.trial082.stdout:3981: finishing rollback tid 1 to trial08226312-37 2026-02-12T17:45:50.936 INFO:tasks.rados.rados.0.trial082.stdout:3981: finishing rollback tid 2 to trial08226312-37 2026-02-12T17:45:50.936 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 37 v 2746 (ObjNum 1190 snap 382 seq_num 1190) dirty exists 2026-02-12T17:45:50.937 INFO:tasks.rados.rados.0.trial082.stdout:3981: done (1 left) 2026-02-12T17:45:50.937 INFO:tasks.rados.rados.0.trial082.stdout:3983: done (0 left) 2026-02-12T17:45:50.937 INFO:tasks.rados.rados.0.trial082.stdout:3984: read oid 6 snap -1 2026-02-12T17:45:50.937 INFO:tasks.rados.rados.0.trial082.stdout:3984: expect (ObjNum 1342 snap 437 seq_num 1342) 2026-02-12T17:45:50.937 INFO:tasks.rados.rados.0.trial082.stdout:3985: write oid 18 current snap is 438 2026-02-12T17:45:50.938 INFO:tasks.rados.rados.0.trial082.stdout:3985: seq_num 1351 ranges {706257=655880,1890820=504465} 2026-02-12T17:45:50.942 INFO:tasks.rados.rados.0.trial082.stdout:3985: writing trial08226312-18 from 706257 to 1362137 tid 1 2026-02-12T17:45:50.946 INFO:tasks.rados.rados.0.trial082.stdout:3985: writing trial08226312-18 from 1890820 to 2395285 tid 2 2026-02-12T17:45:50.946 INFO:tasks.rados.rados.0.trial082.stdout:3986: snap_remove snap 395 2026-02-12T17:45:51.907 INFO:tasks.rados.rados.0.trial082.stdout:3986: done (2 left) 2026-02-12T17:45:51.907 INFO:tasks.rados.rados.0.trial082.stdout:3987: snap_create 2026-02-12T17:45:51.907 INFO:tasks.rados.rados.0.trial082.stdout:3984: expect (ObjNum 1342 snap 437 seq_num 1342) 2026-02-12T17:45:52.004 INFO:tasks.rados.rados.0.trial082.stdout:3985: finishing write tid 1 to trial08226312-18 2026-02-12T17:45:52.004 INFO:tasks.rados.rados.0.trial082.stdout:3985: finishing write tid 2 to trial08226312-18 2026-02-12T17:45:52.004 INFO:tasks.rados.rados.0.trial082.stdout:3985: finishing write tid 3 to trial08226312-18 2026-02-12T17:45:52.004 INFO:tasks.rados.rados.0.trial082.stdout:3985: finishing write tid 4 to trial08226312-18 2026-02-12T17:45:52.004 INFO:tasks.rados.rados.0.trial082.stdout:3985: oid 18 updating version 0 to 2443 2026-02-12T17:45:52.004 INFO:tasks.rados.rados.0.trial082.stdout:3985: oid 18 version 2443 is already newer than 2441 2026-02-12T17:45:52.004 INFO:tasks.rados.rados.0.trial082.stdout:3985: oid 18 version 2443 is already newer than 2442 2026-02-12T17:45:52.004 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 18 v 2443 (ObjNum 1351 snap 438 seq_num 1351) dirty exists 2026-02-12T17:45:52.004 INFO:tasks.rados.rados.0.trial082.stdout:3985: left oid 18 (ObjNum 1351 snap 438 seq_num 1351) 2026-02-12T17:45:52.908 INFO:tasks.rados.rados.0.trial082.stdout:3984: done (2 left) 2026-02-12T17:45:52.908 INFO:tasks.rados.rados.0.trial082.stdout:3985: done (1 left) 2026-02-12T17:45:52.908 INFO:tasks.rados.rados.0.trial082.stdout:3987: done (0 left) 2026-02-12T17:45:52.908 INFO:tasks.rados.rados.0.trial082.stdout:3988: copy_from oid 36 from oid 19 current snap is 439 2026-02-12T17:45:52.909 INFO:tasks.rados.rados.0.trial082.stdout:3989: snap_create 2026-02-12T17:45:52.909 INFO:tasks.rados.rados.0.trial082.stdout:3988: finishing copy_from to trial08226312-36 2026-02-12T17:45:52.909 INFO:tasks.rados.rados.0.trial082.stdout:3988: got expected ENOENT (src dne) 2026-02-12T17:45:52.910 INFO:tasks.rados.rados.0.trial082.stdout:3988: finishing copy_from racing read to trial08226312-36 2026-02-12T17:45:53.908 INFO:tasks.rados.rados.0.trial082.stdout:3988: done (1 left) 2026-02-12T17:45:53.908 INFO:tasks.rados.rados.0.trial082.stdout:3989: done (0 left) 2026-02-12T17:45:53.908 INFO:tasks.rados.rados.0.trial082.stdout:3990: write (excl) oid 17 current snap is 440 2026-02-12T17:45:53.909 INFO:tasks.rados.rados.0.trial082.stdout:3990: seq_num 1352 ranges {723064=731129,1949302=764476} 2026-02-12T17:45:53.913 INFO:tasks.rados.rados.0.trial082.stdout:3990: writing trial08226312-17 from 723064 to 1454193 tid 1 2026-02-12T17:45:53.918 INFO:tasks.rados.rados.0.trial082.stdout:3990: writing trial08226312-17 from 1949302 to 2713778 tid 2 2026-02-12T17:45:53.918 INFO:tasks.rados.rados.0.trial082.stdout:3991: snap_remove snap 406 2026-02-12T17:45:54.912 INFO:tasks.rados.rados.0.trial082.stdout:3991: done (1 left) 2026-02-12T17:45:54.912 INFO:tasks.rados.rados.0.trial082.stdout:3992: read oid 40 snap -1 2026-02-12T17:45:54.913 INFO:tasks.rados.rados.0.trial082.stdout:3992: expect (ObjNum 1311 snap 431 seq_num 1311) 2026-02-12T17:45:54.913 INFO:tasks.rados.rados.0.trial082.stdout:3993: read oid 18 snap 390 2026-02-12T17:45:54.913 INFO:tasks.rados.rados.0.trial082.stdout:3993: expect (ObjNum 1193 snap 382 seq_num 1193) 2026-02-12T17:45:54.913 INFO:tasks.rados.rados.0.trial082.stdout:3994: write (excl) oid 19 current snap is 440 2026-02-12T17:45:54.913 INFO:tasks.rados.rados.0.trial082.stdout:3990: finishing write tid 1 to trial08226312-17 2026-02-12T17:45:54.913 INFO:tasks.rados.rados.0.trial082.stdout:3994: seq_num 1353 ranges {739871=406378,1607784=508134} 2026-02-12T17:45:54.916 INFO:tasks.rados.rados.0.trial082.stdout:3994: writing trial08226312-19 from 739871 to 1146249 tid 1 2026-02-12T17:45:54.921 INFO:tasks.rados.rados.0.trial082.stdout:3994: writing trial08226312-19 from 1607784 to 2115918 tid 2 2026-02-12T17:45:54.921 INFO:tasks.rados.rados.0.trial082.stdout:3995: read oid 8 snap 439 2026-02-12T17:45:54.921 INFO:tasks.rados.rados.0.trial082.stdout:3995: expect (ObjNum 1243 snap 404 seq_num 1243) 2026-02-12T17:45:54.921 INFO:tasks.rados.rados.0.trial082.stdout:3996: snap_remove snap 412 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3996: done (5 left) 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3997: rollback oid 15 current snap is 440 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 15 to 415 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3990: finishing write tid 2 to trial08226312-17 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3990: finishing write tid 3 to trial08226312-17 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3990: finishing write tid 4 to trial08226312-17 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3990: oid 17 updating version 0 to 3142 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3990: oid 17 updating version 3142 to 3144 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3990: oid 17 version 3144 is already newer than 3143 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 17 v 3144 (ObjNum 1352 snap 440 seq_num 1352) dirty exists 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3990: left oid 17 (ObjNum 1352 snap 440 seq_num 1352) 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:3992: expect (ObjNum 1311 snap 431 seq_num 1311) 2026-02-12T17:45:55.914 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:56.000 INFO:tasks.rados.rados.0.trial082.stdout:3993: expect (ObjNum 1193 snap 382 seq_num 1193) 2026-02-12T17:45:56.000 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 0 2026-02-12T17:45:56.028 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 724396 2026-02-12T17:45:56.050 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 643289 2026-02-12T17:45:56.070 INFO:tasks.rados.rados.0.trial082.stdout:3994: finishing write tid 1 to trial08226312-19 2026-02-12T17:45:56.070 INFO:tasks.rados.rados.0.trial082.stdout:3994: finishing write tid 2 to trial08226312-19 2026-02-12T17:45:56.070 INFO:tasks.rados.rados.0.trial082.stdout:3994: finishing write tid 3 to trial08226312-19 2026-02-12T17:45:56.070 INFO:tasks.rados.rados.0.trial082.stdout:3994: finishing write tid 4 to trial08226312-19 2026-02-12T17:45:56.071 INFO:tasks.rados.rados.0.trial082.stdout:3994: oid 19 updating version 0 to 3145 2026-02-12T17:45:56.071 INFO:tasks.rados.rados.0.trial082.stdout:3994: oid 19 updating version 3145 to 3154 2026-02-12T17:45:56.071 INFO:tasks.rados.rados.0.trial082.stdout:3994: oid 19 updating version 3154 to 3155 2026-02-12T17:45:56.071 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 19 v 3155 (ObjNum 1353 snap 440 seq_num 1353) dirty exists 2026-02-12T17:45:56.071 INFO:tasks.rados.rados.0.trial082.stdout:3994: left oid 19 (ObjNum 1353 snap 440 seq_num 1353) 2026-02-12T17:45:56.071 INFO:tasks.rados.rados.0.trial082.stdout:3995: expect (ObjNum 1243 snap 404 seq_num 1243) 2026-02-12T17:45:56.071 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 190792 2026-02-12T17:45:56.145 INFO:tasks.rados.rados.0.trial082.stdout:seeking to 2875297 2026-02-12T17:45:56.183 INFO:tasks.rados.rados.0.trial082.stdout:3997: finishing rollback tid 1 to trial08226312-15 2026-02-12T17:45:56.183 INFO:tasks.rados.rados.0.trial082.stdout:3997: finishing rollback tid 2 to trial08226312-15 2026-02-12T17:45:56.183 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 15 v 2505 (ObjNum 1039 snap 325 seq_num 1039) dirty exists 2026-02-12T17:45:56.183 INFO:tasks.rados.rados.0.trial082.stdout:3990: done (5 left) 2026-02-12T17:45:56.184 INFO:tasks.rados.rados.0.trial082.stdout:3992: done (4 left) 2026-02-12T17:45:56.184 INFO:tasks.rados.rados.0.trial082.stdout:3993: done (3 left) 2026-02-12T17:45:56.184 INFO:tasks.rados.rados.0.trial082.stdout:3994: done (2 left) 2026-02-12T17:45:56.184 INFO:tasks.rados.rados.0.trial082.stdout:3995: done (1 left) 2026-02-12T17:45:56.184 INFO:tasks.rados.rados.0.trial082.stdout:3997: done (0 left) 2026-02-12T17:45:56.184 INFO:tasks.rados.rados.0.trial082.stdout:3998: write oid 1 current snap is 440 2026-02-12T17:45:56.184 INFO:tasks.rados.rados.0.trial082.stdout:3998: seq_num 1354 ranges {756678=597980,1782619=768145} 2026-02-12T17:45:56.188 INFO:tasks.rados.rados.0.trial082.stdout:3998: writing trial08226312-1 from 756678 to 1354658 tid 1 2026-02-12T17:45:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3998: writing trial08226312-1 from 1782619 to 2550764 tid 2 2026-02-12T17:45:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3999: rollback oid 11 current snap is 440 2026-02-12T17:45:56.193 INFO:tasks.rados.rados.0.trial082.stdout:3998: finishing write tid 1 to trial08226312-1 2026-02-12T17:45:56.193 INFO:tasks.rados.rados.0.trial082.stdout:rollback oid 11 to 431 2026-02-12T17:45:56.193 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 2 2026-02-12T17:45:56.195 INFO:tasks.rados.rados.0.trial082.stdout:3999: finishing rollback tid 0 to trial08226312-11 2026-02-12T17:45:56.195 INFO:tasks.rados.rados.0.trial082.stdout:3999: finishing rollback tid 1 to trial08226312-11 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3998: finishing write tid 2 to trial08226312-1 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3999: finishing rollback tid 2 to trial08226312-11 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 11 v 2469 (ObjNum 1303 snap 426 seq_num 1303) dirty exists 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3998: finishing write tid 3 to trial08226312-1 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3999: done (1 left) 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout: waiting on 1 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3998: finishing write tid 4 to trial08226312-1 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3998: oid 1 updating version 0 to 2731 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3998: oid 1 updating version 2731 to 2733 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3998: oid 1 version 2733 is already newer than 2732 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:update_object_version oid 1 v 2733 (ObjNum 1354 snap 440 seq_num 1354) dirty exists 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3998: left oid 1 (ObjNum 1354 snap 440 seq_num 1354) 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stdout:3998: done (0 left) 2026-02-12T17:45:56.196 INFO:tasks.rados.rados.0.trial082.stderr:0 errors. 2026-02-12T17:45:56.197 INFO:tasks.rados.rados.0.trial082.stderr: 2026-02-12T17:45:56.325 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T17:45:56.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.395+0000 7fc2a0ac3640 10 monclient: get_monmap_and_config 2026-02-12T17:45:56.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.395+0000 7fc2a0ac3640 10 monclient: build_initial_monmap 2026-02-12T17:45:56.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.395+0000 7fc2a0ac3640 10 monclient: monmap: 2026-02-12T17:45:56.393 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:56.394 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.394 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:56.396344+0000 2026-02-12T17:45:56.394 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:56.396344+0000 2026-02-12T17:45:56.394 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:56.394 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.394 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:56.394 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:56.394 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:56.394 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.395+0000 7fc2a0ac3640 1 Processor -- start 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.395+0000 7fc2a0ac3640 1 -- start start 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.395+0000 7fc2a0ac3640 10 monclient: init 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 10 monclient(hunting): picked mon.noname-a con 0x7fc29c08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 10 monclient(hunting): picked mon.noname-c con 0x7fc29c08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 10 monclient(hunting): picked mon.noname-b con 0x7fc29c08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c08d600 con 0x7fc29c08ae20 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c08b1f0 con 0x7fc29c08c730 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c08d1f0 con 0x7fc29c08cb30 2026-02-12T17:45:56.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:56.396 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc2a0ac3640 10 monclient(hunting): authenticate will time out at 1636.215212s 2026-02-12T17:45:56.396 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc29a575640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7fc29c08ae20 legacy=0x7fc29c08c020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:56.396 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc29ad76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fc29c08cb30 0x7fc29c1a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:46178/0 (socket says 10.20.193.57:46178) 2026-02-12T17:45:56.396 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.396+0000 7fc29ad76640 1 -- 10.20.193.57:0/3958873960 learned_addr learned my addr 10.20.193.57:0/3958873960 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:56.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc29ad76640 1 -- 10.20.193.57:0/3958873960 >> v1:10.20.193.57:6790/0 conn(0x7fc29c08cb30 legacy=0x7fc29c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 1 -- 10.20.193.57:0/3958873960 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900827422 0 0) 0x7fc29c08d1f0 con 0x7fc29c08cb30 2026-02-12T17:45:56.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient(hunting): _negotiate 2026-02-12T17:45:56.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:56.404 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient(hunting): my global_id is 114176 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 1 -- 10.20.193.57:0/3958873960 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2880035e0 con 0x7fc29c08cb30 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299d74640 1 -- 10.20.193.57:0/3958873960 >> v1:10.20.193.82:6789/0 conn(0x7fc29c08c730 legacy=0x7fc29c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 1 -- 10.20.193.57:0/3958873960 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2991783872 0 0) 0x7fc2880035e0 con 0x7fc29c08cb30 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 1 -- 10.20.193.57:0/3958873960 >> v1:10.20.193.82:6789/0 conn(0x7fc29c08c730 legacy=0x7fc29c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 1 -- 10.20.193.57:0/3958873960 >> v1:10.20.193.57:6789/0 conn(0x7fc29c08ae20 legacy=0x7fc29c08c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient: _finish_hunting 0 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 1 monclient: found mon.noname-b 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:56.405 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 1 -- 10.20.193.57:0/3958873960 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c057320 con 0x7fc29c08cb30 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient: _finish_auth 0 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient: _check_auth_tickets 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 1 -- 10.20.193.57:0/3958873960 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc28c004220 con 0x7fc29c08cb30 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc299573640 10 monclient: dump: 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.406 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc2a0ac3640 5 monclient: authenticate success, global_id 114176 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.398+0000 7fc2a0ac3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:56.407 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc299573640 1 -- 10.20.193.57:0/3958873960 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc28c004470 con 0x7fc29c08cb30 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc299573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc299573640 1 -- 10.20.193.57:0/3958873960 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc28c005bf0 con 0x7fc29c08cb30 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc299573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc299573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc299573640 10 monclient: dump: 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.408 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 4 set_mon_vals no callback set 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 10 monclient: shutdown 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/3958873960 >> v1:10.20.193.57:6790/0 conn(0x7fc29c08cb30 legacy=0x7fc29c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.409 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/3958873960 shutdown_connections 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/3958873960 >> 10.20.193.57:0/3958873960 conn(0x7fc29c091620 msgr2=0x7fc29c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/3958873960 shutdown_connections 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/3958873960 wait complete. 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 10 monclient: build_initial_monmap 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.399+0000 7fc2a0ac3640 10 monclient: monmap: 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:56.410 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 1 Processor -- start 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 1 -- start start 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 10 monclient: init 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 10 monclient(hunting): picked mon.noname-c con 0x7fc29c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:56.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 10 monclient(hunting): picked mon.noname-b con 0x7fc29c08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 10 monclient(hunting): picked mon.noname-a con 0x7fc29c08cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c08d9c0 con 0x7fc29c08cb30 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c05cb20 con 0x7fc29c08c730 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc29c05af90 con 0x7fc29c08ae20 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc2a0ac3640 10 monclient(hunting): authenticate will time out at 1636.219373s 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc29ad76640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7fc29c08cb30 legacy=0x7fc29c1a2c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc29a575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fc29c08ae20 0x7fc29c088d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:46184/0 (socket says 10.20.193.57:46184) 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.400+0000 7fc29a575640 1 -- 10.20.193.57:0/1531941760 learned_addr learned my addr 10.20.193.57:0/1531941760 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:56.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc29a575640 1 -- 10.20.193.57:0/1531941760 >> v1:10.20.193.57:6790/0 conn(0x7fc29c08ae20 legacy=0x7fc29c088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2424488919 0 0) 0x7fc29c05af90 con 0x7fc29c08ae20 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc299d74640 1 -- 10.20.193.57:0/1531941760 >> v1:10.20.193.82:6789/0 conn(0x7fc29c08c730 legacy=0x7fc29c089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): my global_id is 114179 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2680035e0 con 0x7fc29c08ae20 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648527877 0 0) 0x7fc29c05cb20 con 0x7fc29c08c730 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:56.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): my global_id is 5284 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc29c05af90 con 0x7fc29c08c730 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1948412831 0 0) 0x7fc2680035e0 con 0x7fc29c08ae20 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc29c05cb20 con 0x7fc29c08ae20 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc290004580 con 0x7fc29c08ae20 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): dump: 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.414 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.402+0000 7fc282ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 380479351 0 0) 0x7fc29c05cb20 con 0x7fc29c08ae20 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 >> v1:10.20.193.82:6789/0 conn(0x7fc29c08c730 legacy=0x7fc29c089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.415 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 >> v1:10.20.193.57:6789/0 conn(0x7fc29c08cb30 legacy=0x7fc29c1a2c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 1 monclient: found mon.c 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c11eb40 con 0x7fc29c08ae20 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 10 monclient: _finish_auth 0 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 5 monclient: authenticate success, global_id 114179 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 10 monclient: _renew_subs 2026-02-12T17:45:56.416 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc29c088810 con 0x7fc29c08ae20 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 10 monclient: _renew_subs 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc29c11ee20 con 0x7fc29c08ae20 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc290004840 con 0x7fc29c08ae20 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc290004ba0 con 0x7fc29c08ae20 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 10 monclient: dump: 2026-02-12T17:45:56.417 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc298d72640 4 set_mon_vals no callback set 2026-02-12T17:45:56.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:56.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:56.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29c0008d0 con 0x7fc29c08ae20 2026-02-12T17:45:56.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fc290004e30 con 0x7fc29c08ae20 2026-02-12T17:45:56.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.403+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(885..885 src has 637..885) ==== 4071+0+0 (unknown 24620271 0 0) 0x7fc29004ed70 con 0x7fc29c08ae20 2026-02-12T17:45:56.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.404+0000 7fc299d74640 10 monclient: get_auth_request con 0x7fc26803f740 auth_method 0 2026-02-12T17:45:56.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.406+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fc290017460 con 0x7fc29c08ae20 2026-02-12T17:45:56.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.406+0000 7fc282ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:56.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.406+0000 7fc282ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:56.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.509+0000 7fc2a0ac3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:45:56.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.509+0000 7fc2a0ac3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:45:56.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.509+0000 7fc2a0ac3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.509+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc29c08f520 con 0x7fc29c08ae20 2026-02-12T17:45:56.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.509+0000 7fc282ffd640 1 -- 10.20.193.57:0/1531941760 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v885) ==== 74+0+13050 (unknown 882084882 0 959330964) 0x7fc290016c10 con 0x7fc29c08ae20 2026-02-12T17:45:56.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.509+0000 7fc282ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:45:56.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.509+0000 7fc282ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:45:56.507 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:45:56.508 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":885,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","created":"2026-02-12T17:28:03.716456+0000","modified":"2026-02-12T17:45:55.910150+0000","last_up_change":"2026-02-12T17:28:09.951573+0000","last_in_change":"2026-02-12T17:28:06.940287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T17:28:11.851529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T17:28:14.923444+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2026-02-12T17:28:39.856093+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"885","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":446,"snap_epoch":885,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rados":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08ee67d7-4cf0-452b-a362-8a5526fccd74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":521925997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":521925997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":521925997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":521925997}]},"public_addr":"10.20.193.57:6803/521925997","cluster_addr":"10.20.193.57:6805/521925997","heartbeat_back_addr":"10.20.193.57:6807/521925997","heartbeat_front_addr":"10.20.193.57:6806/521925997","state":["exists","up"]},{"osd":1,"uuid":"d2ec9481-5b72-4197-a3ed-b1029fb07580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6800","nonce":3025704390}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":3025704390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":3025704390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":3025704390}]},"public_addr":"10.20.193.57:6800/3025704390","cluster_addr":"10.20.193.57:6801/3025704390","heartbeat_back_addr":"10.20.193.57:6804/3025704390","heartbeat_front_addr":"10.20.193.57:6802/3025704390","state":["exists","up"]},{"osd":2,"uuid":"7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3129121469}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3129121469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3129121469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3129121469}]},"public_addr":"10.20.193.57:6808/3129121469","cluster_addr":"10.20.193.57:6809/3129121469","heartbeat_back_addr":"10.20.193.57:6811/3129121469","heartbeat_front_addr":"10.20.193.57:6810/3129121469","state":["exists","up"]},{"osd":3,"uuid":"108524be-58bc-4950-b88f-d85dfa77ef48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6801","nonce":634754599}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6802","nonce":634754599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6804","nonce":634754599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6803","nonce":634754599}]},"public_addr":"10.20.193.82:6801/634754599","cluster_addr":"10.20.193.82:6802/634754599","heartbeat_back_addr":"10.20.193.82:6804/634754599","heartbeat_front_addr":"10.20.193.82:6803/634754599","state":["exists","up"]},{"osd":4,"uuid":"e9bb983d-b2d5-4543-a960-f450bede62cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6805","nonce":687524042}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6806","nonce":687524042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6808","nonce":687524042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6807","nonce":687524042}]},"public_addr":"10.20.193.82:6805/687524042","cluster_addr":"10.20.193.82:6806/687524042","heartbeat_back_addr":"10.20.193.82:6808/687524042","heartbeat_front_addr":"10.20.193.82:6807/687524042","state":["exists","up"]},{"osd":5,"uuid":"047804d0-f125-4ef6-ac99-8f8ed7d594ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6809","nonce":1303150362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6810","nonce":1303150362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6812","nonce":1303150362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6811","nonce":1303150362}]},"public_addr":"10.20.193.82:6809/1303150362","cluster_addr":"10.20.193.82:6810/1303150362","heartbeat_back_addr":"10.20.193.82:6812/1303150362","heartbeat_front_addr":"10.20.193.82:6811/1303150362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.696209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.707695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.711747+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.625181+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.672050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.673463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":345,"length":1},{"begin":351,"length":1},{"begin":402,"length":1},{"begin":413,"length":1},{"begin":416,"length":1},{"begin":419,"length":1},{"begin":421,"length":1},{"begin":423,"length":1},{"begin":432,"length":1},{"begin":435,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":419,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T17:45:56.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.510+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 >> v1:10.20.193.82:6800/2441377515 conn(0x7fc26803f740 legacy=0x7fc26805fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.510+0000 7fc2a0ac3640 10 monclient: shutdown 2026-02-12T17:45:56.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.510+0000 7fc2a0ac3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:56.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.510+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 >> v1:10.20.193.57:6790/0 conn(0x7fc29c08ae20 legacy=0x7fc29c088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.510+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 shutdown_connections 2026-02-12T17:45:56.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.510+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 >> 10.20.193.57:0/1531941760 conn(0x7fc29c091620 msgr2=0x7fc29c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:56.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.510+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 shutdown_connections 2026-02-12T17:45:56.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.510+0000 7fc2a0ac3640 1 -- 10.20.193.57:0/1531941760 wait complete. 2026-02-12T17:45:56.515 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:45:56.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient: get_monmap_and_config 2026-02-12T17:45:56.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient: build_initial_monmap 2026-02-12T17:45:56.582 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient: monmap: 2026-02-12T17:45:56.582 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:56.582 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.582 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:56.584876+0000 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:56.584876+0000 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 1 Processor -- start 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 1 -- start start 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient: init 2026-02-12T17:45:56.583 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient(hunting): picked mon.noname-c con 0x7f2e6808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient(hunting): picked mon.noname-b con 0x7f2e6808cc80 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient(hunting): picked mon.noname-a con 0x7f2e681852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6808d600 con 0x7f2e681852d0 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e68089770 con 0x7f2e6808ae20 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6808b1f0 con 0x7f2e6808cc80 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e6ca1b640 10 monclient(hunting): authenticate will time out at 1636.403798s 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e66d76640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f2e681852d0 legacy=0x7f2e681a56b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:56.584 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e65d74640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f2e6808cc80 0x7f2e68183bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:46196/0 (socket says 10.20.193.57:46196) 2026-02-12T17:45:56.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e65d74640 1 -- 10.20.193.57:0/2481761284 learned_addr learned my addr 10.20.193.57:0/2481761284 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:56.585 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.584+0000 7f2e66575640 1 --1- 10.20.193.57:0/2481761284 >> v1:10.20.193.82:6789/0 conn(0x7f2e6808ae20 0x7f2e6808c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.82:6789/0 says I am v1:10.20.193.57:47466/0 (socket says 10.20.193.57:47466) 2026-02-12T17:45:56.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65d74640 1 -- 10.20.193.57:0/2481761284 >> v1:10.20.193.57:6790/0 conn(0x7f2e6808cc80 legacy=0x7f2e68183bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e66575640 1 -- 10.20.193.57:0/2481761284 >> v1:10.20.193.82:6789/0 conn(0x7f2e6808ae20 legacy=0x7f2e6808c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914427545 0 0) 0x7f2e6808b1f0 con 0x7f2e6808cc80 2026-02-12T17:45:56.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient(hunting): _negotiate 2026-02-12T17:45:56.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:56.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:56.593 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient(hunting): my global_id is 114182 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e540035e0 con 0x7f2e6808cc80 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907175343 0 0) 0x7f2e68089770 con 0x7f2e6808ae20 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient(hunting): _negotiate 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient(hunting): my global_id is 5287 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6808b1f0 con 0x7f2e6808ae20 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1753403796 0 0) 0x7f2e540035e0 con 0x7f2e6808cc80 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 >> v1:10.20.193.82:6789/0 conn(0x7f2e6808ae20 legacy=0x7f2e6808c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 >> v1:10.20.193.57:6789/0 conn(0x7f2e681852d0 legacy=0x7f2e681a56b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: _finish_hunting 0 2026-02-12T17:45:56.594 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 monclient: found mon.noname-b 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6808c020 con 0x7f2e6808cc80 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: _finish_auth 0 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: _check_auth_tickets 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2e50003150 con 0x7f2e6808cc80 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: dump: 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.595 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 5 monclient: authenticate success, global_id 114182 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:56.596 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e50003410 con 0x7f2e6808cc80 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 4 set_mon_vals no callback set 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 1 -- 10.20.193.57:0/2481761284 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2e50004b10 con 0x7f2e6808cc80 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e65573640 10 monclient: dump: 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.597 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 10 monclient: shutdown 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/2481761284 >> v1:10.20.193.57:6790/0 conn(0x7f2e6808cc80 legacy=0x7f2e68183bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/2481761284 shutdown_connections 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/2481761284 >> 10.20.193.57:0/2481761284 conn(0x7f2e68091620 msgr2=0x7f2e68091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:56.598 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/2481761284 shutdown_connections 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.587+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/2481761284 wait complete. 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient: build_initial_monmap 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient: monmap: 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:56.599 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 1 Processor -- start 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 1 -- start start 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient: init 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient(hunting): picked mon.noname-b con 0x7f2e6808ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient(hunting): picked mon.noname-a con 0x7f2e6808cc80 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient(hunting): picked mon.noname-c con 0x7f2e681852d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e680837d0 con 0x7f2e6808cc80 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e680807d0 con 0x7f2e6808ae20 2026-02-12T17:45:56.600 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e68087050 con 0x7f2e681852d0 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e6ca1b640 10 monclient(hunting): authenticate will time out at 1636.407625s 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e65d74640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f2e6808cc80 legacy=0x7f2e680800c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e66d76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f2e681852d0 0x7f2e681849b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:46208/0 (socket says 10.20.193.57:46208) 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.588+0000 7f2e66d76640 1 -- 10.20.193.57:0/1858616064 learned_addr learned my addr 10.20.193.57:0/1858616064 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.590+0000 7f2e66d76640 1 -- 10.20.193.57:0/1858616064 >> v1:10.20.193.57:6790/0 conn(0x7f2e681852d0 legacy=0x7f2e681849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.590+0000 7f2e66575640 1 -- 10.20.193.57:0/1858616064 >> v1:10.20.193.82:6789/0 conn(0x7f2e6808ae20 legacy=0x7f2e6807f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.590+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741760325 0 0) 0x7f2e68087050 con 0x7f2e681852d0 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.590+0000 7f2e4effd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.590+0000 7f2e4effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:56.601 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.590+0000 7f2e4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.590+0000 7f2e4effd640 10 monclient(hunting): my global_id is 114185 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.590+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e340035e0 con 0x7f2e681852d0 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2217159938 0 0) 0x7f2e680807d0 con 0x7f2e6808ae20 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient(hunting): _negotiate 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient(hunting): my global_id is 5290 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e68087050 con 0x7f2e6808ae20 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2851127207 0 0) 0x7f2e340035e0 con 0x7f2e681852d0 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e680807d0 con 0x7f2e681852d0 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2e58005490 con 0x7f2e681852d0 2026-02-12T17:45:56.602 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient(hunting): dump: 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.603 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e66575640 1 --1- 10.20.193.57:0/1858616064 >> v1:10.20.193.82:6789/0 conn(0x7f2e6808ae20 0x7f2e6807f9b0 :-1 s=OPENED pgs=744 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f2e5c0032a0 mon_map magic: 0 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3205456856 0 0) 0x7f2e68087050 con 0x7f2e6808ae20 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e340035e0 con 0x7f2e6808ae20 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1480415494 0 0) 0x7f2e680807d0 con 0x7f2e681852d0 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 >> v1:10.20.193.82:6789/0 conn(0x7f2e6808ae20 legacy=0x7f2e6807f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 >> v1:10.20.193.57:6789/0 conn(0x7f2e6808cc80 legacy=0x7f2e680800c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient: _finish_hunting 0 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 monclient: found mon.c 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e680880e0 con 0x7f2e681852d0 2026-02-12T17:45:56.604 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient: _finish_auth 0 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient: _check_auth_tickets 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 5 monclient: authenticate success, global_id 114185 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2e5c0032a0 con 0x7f2e6808ae20 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 10 monclient: _renew_subs 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e68088810 con 0x7f2e681852d0 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 10 monclient: _renew_subs 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e68081470 con 0x7f2e681852d0 2026-02-12T17:45:56.605 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e58005790 con 0x7f2e681852d0 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f2e58005ab0 con 0x7f2e681852d0 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 10 monclient: dump: 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.606 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e64d72640 4 set_mon_vals no callback set 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e68055340 con 0x7f2e681852d0 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.591+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f2e58005d40 con 0x7f2e681852d0 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.592+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(885..885 src has 637..885) ==== 4071+0+0 (unknown 24620271 0 0) 0x7f2e5804fbe0 con 0x7f2e681852d0 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.592+0000 7f2e66575640 10 monclient: get_auth_request con 0x7f2e3403fa00 auth_method 0 2026-02-12T17:45:56.607 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.594+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f2e58006400 con 0x7f2e681852d0 2026-02-12T17:45:56.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.594+0000 7f2e4effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:56.608 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.594+0000 7f2e4effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:56.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.699+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e68088b20 con 0x7f2e3403fa00 2026-02-12T17:45:56.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.700+0000 7f2e4effd640 1 -- 10.20.193.57:0/1858616064 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+80033 (unknown 2965378022 0 487672730) 0x7f2e5c0079e0 con 0x7f2e3403fa00 2026-02-12T17:45:56.697 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:45:56.697 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:45:56.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.701+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 >> v1:10.20.193.82:6800/2441377515 conn(0x7f2e3403fa00 legacy=0x7f2e3405feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.701+0000 7f2e6ca1b640 10 monclient: shutdown 2026-02-12T17:45:56.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.701+0000 7f2e6ca1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:56.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.701+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 >> v1:10.20.193.57:6790/0 conn(0x7f2e681852d0 legacy=0x7f2e681849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.702+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 shutdown_connections 2026-02-12T17:45:56.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.702+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 >> 10.20.193.57:0/1858616064 conn(0x7f2e68091620 msgr2=0x7f2e681a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:56.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.702+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 shutdown_connections 2026-02-12T17:45:56.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.702+0000 7f2e6ca1b640 1 -- 10.20.193.57:0/1858616064 wait complete. 2026-02-12T17:45:56.705 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":1418,"stamp":"2026-02-12T17:45:55.950750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":505958826,"num_objects":240,"num_object_clones":186,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":240,"num_whiteouts":16,"num_read":8055,"num_read_kb":5936706,"num_write":5659,"num_write_kb":2179335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22336,"ondisk_log_size":22336,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":837684,"kb_used_data":585684,"kb_used_omap":10206,"kb_used_meta":241697,"kb_avail":565393356,"statfs":{"total":579820584960,"available":578962796544,"internally_reserved":0,"allocated":599740416,"data_stored":778659357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10451206,"internal_metadata":247498490},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3551874,"num_objects":1,"num_object_clones":1,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":-1,"num_read":26,"num_read_kb":19079,"num_write":6,"num_write_kb":1134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000377"},"pg_stats":[{"pgid":"3.f","version":"878'780","reported_seq":4977,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.932485+0000","last_change":"2026-02-12T17:45:48.927755+0000","last_active":"2026-02-12T17:45:50.932485+0000","last_peered":"2026-02-12T17:45:50.932485+0000","last_clean":"2026-02-12T17:45:50.932485+0000","last_became_active":"2026-02-12T17:28:42.418489+0000","last_became_peered":"2026-02-12T17:28:42.418489+0000","last_unstale":"2026-02-12T17:45:50.932485+0000","last_undegraded":"2026-02-12T17:45:50.932485+0000","last_fullsized":"2026-02-12T17:45:50.932485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:46:09.709591+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0039326370000000001,"stat_sum":{"num_bytes":12429600,"num_objects":8,"num_object_clones":6,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":300,"num_read_kb":203882,"num_write":192,"num_write_kb":67900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"3.e","version":"880'3127","reported_seq":7237,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.932540+0000","last_change":"2026-02-12T17:45:48.932223+0000","last_active":"2026-02-12T17:45:50.932540+0000","last_peered":"2026-02-12T17:45:50.932540+0000","last_clean":"2026-02-12T17:45:50.932540+0000","last_became_active":"2026-02-12T17:28:42.419359+0000","last_became_peered":"2026-02-12T17:28:42.419359+0000","last_unstale":"2026-02-12T17:45:50.932540+0000","last_undegraded":"2026-02-12T17:45:50.932540+0000","last_fullsized":"2026-02-12T17:45:50.932540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":3127,"log_dups_size":0,"ondisk_log_size":3127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:16:57.971387+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.00839086,"stat_sum":{"num_bytes":47277775,"num_objects":26,"num_object_clones":19,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":4,"num_read":1276,"num_read_kb":1060561,"num_write":752,"num_write_kb":288670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"3.d","version":"878'427","reported_seq":4659,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.948792+0000","last_change":"2026-02-12T17:45:48.923535+0000","last_active":"2026-02-12T17:45:50.948792+0000","last_peered":"2026-02-12T17:45:50.948792+0000","last_clean":"2026-02-12T17:45:50.948792+0000","last_became_active":"2026-02-12T17:28:42.419037+0000","last_became_peered":"2026-02-12T17:28:42.419037+0000","last_unstale":"2026-02-12T17:45:50.948792+0000","last_undegraded":"2026-02-12T17:45:50.948792+0000","last_fullsized":"2026-02-12T17:45:50.948792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:00:01.788472+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0033204570000000002,"stat_sum":{"num_bytes":11902826,"num_objects":4,"num_object_clones":3,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":189,"num_read_kb":151556,"num_write":123,"num_write_kb":55793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"3.c","version":"879'798","reported_seq":4989,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.932440+0000","last_change":"2026-02-12T17:45:48.926693+0000","last_active":"2026-02-12T17:45:50.932440+0000","last_peered":"2026-02-12T17:45:50.932440+0000","last_clean":"2026-02-12T17:45:50.932440+0000","last_became_active":"2026-02-12T17:28:42.419218+0000","last_became_peered":"2026-02-12T17:28:42.419218+0000","last_unstale":"2026-02-12T17:45:50.932440+0000","last_undegraded":"2026-02-12T17:45:50.932440+0000","last_fullsized":"2026-02-12T17:45:50.932440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:36:28.119188+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0029336169999999999,"stat_sum":{"num_bytes":27226398,"num_objects":13,"num_object_clones":11,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":245,"num_read_kb":169114,"num_write":213,"num_write_kb":78544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"3.b","version":"884'1709","reported_seq":5877,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.923474+0000","last_change":"2026-02-12T17:45:54.923608+0000","last_active":"2026-02-12T17:45:54.923474+0000","last_peered":"2026-02-12T17:45:54.923474+0000","last_clean":"2026-02-12T17:45:54.923474+0000","last_became_active":"2026-02-12T17:28:42.422946+0000","last_became_peered":"2026-02-12T17:28:42.422946+0000","last_unstale":"2026-02-12T17:45:54.923474+0000","last_undegraded":"2026-02-12T17:45:54.923474+0000","last_fullsized":"2026-02-12T17:45:54.923474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":1709,"log_dups_size":0,"ondisk_log_size":1709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:50:16.661848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057407980000000001,"stat_sum":{"num_bytes":37604411,"num_objects":18,"num_object_clones":14,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":601,"num_read_kb":453955,"num_write":390,"num_write_kb":149850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"192","length":"1"},{"start":"19d","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"3.a","version":"876'793","reported_seq":4980,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.948761+0000","last_change":"2026-02-12T17:45:48.920741+0000","last_active":"2026-02-12T17:45:50.948761+0000","last_peered":"2026-02-12T17:45:50.948761+0000","last_clean":"2026-02-12T17:45:50.948761+0000","last_became_active":"2026-02-12T17:28:42.419344+0000","last_became_peered":"2026-02-12T17:28:42.419344+0000","last_unstale":"2026-02-12T17:45:50.948761+0000","last_undegraded":"2026-02-12T17:45:50.948761+0000","last_fullsized":"2026-02-12T17:45:50.948761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:39:06.812430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051168100000000005,"stat_sum":{"num_bytes":12985289,"num_objects":8,"num_object_clones":6,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":289,"num_read_kb":233271,"num_write":219,"num_write_kb":79224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"3.9","version":"0'0","reported_seq":4156,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.930434+0000","last_change":"2026-02-12T17:45:48.922909+0000","last_active":"2026-02-12T17:45:50.930434+0000","last_peered":"2026-02-12T17:45:50.930434+0000","last_clean":"2026-02-12T17:45:50.930434+0000","last_became_active":"2026-02-12T17:28:42.419233+0000","last_became_peered":"2026-02-12T17:28:42.419233+0000","last_unstale":"2026-02-12T17:45:50.930434+0000","last_undegraded":"2026-02-12T17:45:50.930434+0000","last_fullsized":"2026-02-12T17:45:50.930434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:27:19.210794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027567299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"3.8","version":"884'1843","reported_seq":5983,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.920047+0000","last_change":"2026-02-12T17:45:54.920151+0000","last_active":"2026-02-12T17:45:54.920047+0000","last_peered":"2026-02-12T17:45:54.920047+0000","last_clean":"2026-02-12T17:45:54.920047+0000","last_became_active":"2026-02-12T17:28:42.423337+0000","last_became_peered":"2026-02-12T17:28:42.423337+0000","last_unstale":"2026-02-12T17:45:54.920047+0000","last_undegraded":"2026-02-12T17:45:54.920047+0000","last_fullsized":"2026-02-12T17:45:54.920047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:39.667189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043312610000000003,"stat_sum":{"num_bytes":30229611,"num_objects":16,"num_object_clones":12,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":2,"num_read":628,"num_read_kb":442258,"num_write":474,"num_write_kb":163560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"192","length":"1"},{"start":"19d","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"1.0","version":"14'112","reported_seq":1853,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.948703+0000","last_change":"2026-02-12T17:28:13.575533+0000","last_active":"2026-02-12T17:45:50.948703+0000","last_peered":"2026-02-12T17:45:50.948703+0000","last_clean":"2026-02-12T17:45:50.948703+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:45:50.948703+0000","last_undegraded":"2026-02-12T17:45:50.948703+0000","last_fullsized":"2026-02-12T17:45:50.948703+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_clean_scrub_stamp":"2026-02-12T17:28:11.958332+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:10:01.188074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1722,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.932399+0000","last_change":"2026-02-12T17:28:19.283491+0000","last_active":"2026-02-12T17:45:50.932399+0000","last_peered":"2026-02-12T17:45:50.932399+0000","last_clean":"2026-02-12T17:45:50.932399+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:45:50.932399+0000","last_undegraded":"2026-02-12T17:45:50.932399+0000","last_fullsized":"2026-02-12T17:45:50.932399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:53.711374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"884'975","reported_seq":5206,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.925142+0000","last_change":"2026-02-12T17:45:54.925237+0000","last_active":"2026-02-12T17:45:54.925142+0000","last_peered":"2026-02-12T17:45:54.925142+0000","last_clean":"2026-02-12T17:45:54.925142+0000","last_became_active":"2026-02-12T17:28:42.422677+0000","last_became_peered":"2026-02-12T17:28:42.422677+0000","last_unstale":"2026-02-12T17:45:54.925142+0000","last_undegraded":"2026-02-12T17:45:54.925142+0000","last_fullsized":"2026-02-12T17:45:54.925142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":975,"log_dups_size":0,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:26:51.633077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0073890600000000002,"stat_sum":{"num_bytes":20600493,"num_objects":6,"num_object_clones":4,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":381,"num_read_kb":250737,"num_write":250,"num_write_kb":105426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"192","length":"1"},{"start":"19d","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":1716,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.948688+0000","last_change":"2026-02-12T17:28:19.724210+0000","last_active":"2026-02-12T17:45:50.948688+0000","last_peered":"2026-02-12T17:45:50.948688+0000","last_clean":"2026-02-12T17:45:50.948688+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:45:50.948688+0000","last_undegraded":"2026-02-12T17:45:50.948688+0000","last_fullsized":"2026-02-12T17:45:50.948688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:54.193528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"884'2634","reported_seq":6773,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.921438+0000","last_change":"2026-02-12T17:45:54.921560+0000","last_active":"2026-02-12T17:45:54.921438+0000","last_peered":"2026-02-12T17:45:54.921438+0000","last_clean":"2026-02-12T17:45:54.921438+0000","last_became_active":"2026-02-12T17:28:42.423031+0000","last_became_peered":"2026-02-12T17:28:42.423031+0000","last_unstale":"2026-02-12T17:45:54.921438+0000","last_undegraded":"2026-02-12T17:45:54.921438+0000","last_fullsized":"2026-02-12T17:45:54.921438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":2634,"log_dups_size":0,"ondisk_log_size":2634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:37:04.801407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043569200000000002,"stat_sum":{"num_bytes":70111436,"num_objects":30,"num_object_clones":24,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":3,"num_read":922,"num_read_kb":702242,"num_write":645,"num_write_kb":274703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"192","length":"1"},{"start":"19d","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":1729,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.915672+0000","last_change":"2026-02-12T17:28:19.286905+0000","last_active":"2026-02-12T17:45:54.915672+0000","last_peered":"2026-02-12T17:45:54.915672+0000","last_clean":"2026-02-12T17:45:54.915672+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:45:54.915672+0000","last_undegraded":"2026-02-12T17:45:54.915672+0000","last_fullsized":"2026-02-12T17:45:54.915672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:35.531511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"878'468","reported_seq":4744,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.918217+0000","last_change":"2026-02-12T17:45:54.918342+0000","last_active":"2026-02-12T17:45:54.918217+0000","last_peered":"2026-02-12T17:45:54.918217+0000","last_clean":"2026-02-12T17:45:54.918217+0000","last_became_active":"2026-02-12T17:28:42.423627+0000","last_became_peered":"2026-02-12T17:28:42.423627+0000","last_unstale":"2026-02-12T17:45:54.918217+0000","last_undegraded":"2026-02-12T17:45:54.918217+0000","last_fullsized":"2026-02-12T17:45:54.918217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:45:24.041950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071095499999999999,"stat_sum":{"num_bytes":10293490,"num_objects":4,"num_object_clones":3,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":165,"num_read_kb":103216,"num_write":109,"num_write_kb":31622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"192","length":"1"},{"start":"19d","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":1723,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.932403+0000","last_change":"2026-02-12T17:28:19.283404+0000","last_active":"2026-02-12T17:45:50.932403+0000","last_peered":"2026-02-12T17:45:50.932403+0000","last_clean":"2026-02-12T17:45:50.932403+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:45:50.932403+0000","last_undegraded":"2026-02-12T17:45:50.932403+0000","last_fullsized":"2026-02-12T17:45:50.932403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:24:22.204036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"878'2504","reported_seq":6539,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.930489+0000","last_change":"2026-02-12T17:45:48.929714+0000","last_active":"2026-02-12T17:45:50.930489+0000","last_peered":"2026-02-12T17:45:50.930489+0000","last_clean":"2026-02-12T17:45:50.930489+0000","last_became_active":"2026-02-12T17:28:42.419254+0000","last_became_peered":"2026-02-12T17:28:42.419254+0000","last_unstale":"2026-02-12T17:45:50.930489+0000","last_undegraded":"2026-02-12T17:45:50.930489+0000","last_fullsized":"2026-02-12T17:45:50.930489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":2504,"log_dups_size":0,"ondisk_log_size":2504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:13:06.181727+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0075931660000000002,"stat_sum":{"num_bytes":66196183,"num_objects":29,"num_object_clones":24,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":1,"num_read":794,"num_read_kb":556537,"num_write":627,"num_write_kb":264992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"3.5","version":"879'2755","reported_seq":6820,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.932449+0000","last_change":"2026-02-12T17:45:48.931641+0000","last_active":"2026-02-12T17:45:50.932449+0000","last_peered":"2026-02-12T17:45:50.932449+0000","last_clean":"2026-02-12T17:45:50.932449+0000","last_became_active":"2026-02-12T17:28:42.419132+0000","last_became_peered":"2026-02-12T17:28:42.419132+0000","last_unstale":"2026-02-12T17:45:50.932449+0000","last_undegraded":"2026-02-12T17:45:50.932449+0000","last_fullsized":"2026-02-12T17:45:50.932449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":2755,"log_dups_size":0,"ondisk_log_size":2755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T17:32:44.987823+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.0078582889999999992,"stat_sum":{"num_bytes":68170523,"num_objects":34,"num_object_clones":28,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":1,"num_read":957,"num_read_kb":719220,"num_write":659,"num_write_kb":277283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":1739,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.917733+0000","last_change":"2026-02-12T17:28:19.289250+0000","last_active":"2026-02-12T17:45:54.917733+0000","last_peered":"2026-02-12T17:45:54.917733+0000","last_clean":"2026-02-12T17:45:54.917733+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:45:54.917733+0000","last_undegraded":"2026-02-12T17:45:54.917733+0000","last_fullsized":"2026-02-12T17:45:54.917733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:19:32.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"884'1281","reported_seq":5532,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.923547+0000","last_change":"2026-02-12T17:45:54.923657+0000","last_active":"2026-02-12T17:45:54.923547+0000","last_peered":"2026-02-12T17:45:54.923547+0000","last_clean":"2026-02-12T17:45:54.923547+0000","last_became_active":"2026-02-12T17:28:42.422926+0000","last_became_peered":"2026-02-12T17:28:42.422926+0000","last_unstale":"2026-02-12T17:45:54.923547+0000","last_undegraded":"2026-02-12T17:45:54.923547+0000","last_fullsized":"2026-02-12T17:45:54.923547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":1281,"log_dups_size":0,"ondisk_log_size":1281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:45:24.591127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058454630000000004,"stat_sum":{"num_bytes":35879358,"num_objects":15,"num_object_clones":12,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":514,"num_read_kb":380910,"num_write":345,"num_write_kb":125380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"192","length":"1"},{"start":"19d","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":1716,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.948748+0000","last_change":"2026-02-12T17:28:19.724251+0000","last_active":"2026-02-12T17:45:50.948748+0000","last_peered":"2026-02-12T17:45:50.948748+0000","last_clean":"2026-02-12T17:45:50.948748+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:45:50.948748+0000","last_undegraded":"2026-02-12T17:45:50.948748+0000","last_fullsized":"2026-02-12T17:45:50.948748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:31:06.358030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"884'1228","reported_seq":5404,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.918527+0000","last_change":"2026-02-12T17:45:54.918629+0000","last_active":"2026-02-12T17:45:54.918527+0000","last_peered":"2026-02-12T17:45:54.918527+0000","last_clean":"2026-02-12T17:45:54.918527+0000","last_became_active":"2026-02-12T17:28:42.423423+0000","last_became_peered":"2026-02-12T17:28:42.423423+0000","last_unstale":"2026-02-12T17:45:54.918527+0000","last_undegraded":"2026-02-12T17:45:54.918527+0000","last_fullsized":"2026-02-12T17:45:54.918527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":1228,"log_dups_size":0,"ondisk_log_size":1228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T20:25:47.034613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027673770000000001,"stat_sum":{"num_bytes":42879604,"num_objects":19,"num_object_clones":16,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":385,"num_read_kb":261269,"num_write":304,"num_write_kb":126518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"192","length":"1"},{"start":"19d","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":1739,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.917878+0000","last_change":"2026-02-12T17:28:19.289150+0000","last_active":"2026-02-12T17:45:54.917878+0000","last_peered":"2026-02-12T17:45:54.917878+0000","last_clean":"2026-02-12T17:45:54.917878+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:45:54.917878+0000","last_undegraded":"2026-02-12T17:45:54.917878+0000","last_fullsized":"2026-02-12T17:45:54.917878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:34:03.582232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"884'899","reported_seq":5123,"reported_epoch":884,"state":"active+clean","last_fresh":"2026-02-12T17:45:54.919017+0000","last_change":"2026-02-12T17:45:54.919133+0000","last_active":"2026-02-12T17:45:54.919017+0000","last_peered":"2026-02-12T17:45:54.919017+0000","last_clean":"2026-02-12T17:45:54.919017+0000","last_became_active":"2026-02-12T17:28:42.423546+0000","last_became_peered":"2026-02-12T17:28:42.423546+0000","last_unstale":"2026-02-12T17:45:54.919017+0000","last_undegraded":"2026-02-12T17:45:54.919017+0000","last_fullsized":"2026-02-12T17:45:54.919017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:40.849396+0000","last_clean_scrub_stamp":"2026-02-12T17:28:40.849396+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:06:38.384561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017534580000000001,"stat_sum":{"num_bytes":11581442,"num_objects":6,"num_object_clones":4,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":247905,"num_write":210,"num_write_kb":87196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"159","length":"1"},{"start":"15f","length":"1"},{"start":"192","length":"1"},{"start":"19d","length":"1"},{"start":"1a0","length":"1"},{"start":"1a5","length":"1"},{"start":"1a7","length":"1"},{"start":"1b0","length":"1"},{"start":"1b3","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":1716,"reported_epoch":880,"state":"active+clean","last_fresh":"2026-02-12T17:45:50.948782+0000","last_change":"2026-02-12T17:28:19.724309+0000","last_active":"2026-02-12T17:45:50.948782+0000","last_peered":"2026-02-12T17:45:50.948782+0000","last_clean":"2026-02-12T17:45:50.948782+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:45:50.948782+0000","last_undegraded":"2026-02-12T17:45:50.948782+0000","last_fullsized":"2026-02-12T17:45:50.948782+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:21:16.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":505368439,"num_objects":236,"num_object_clones":186,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":236,"num_whiteouts":16,"num_read":7969,"num_read_kb":5936633,"num_write":5512,"num_write_kb":2176661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":586567680,"data_stored":770946185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22221,"ondisk_log_size":22221,"up":32,"acting":32,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640471,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145148,"kb_used_data":100140,"kb_used_omap":2036,"kb_used_meta":42955,"kb_avail":94226692,"statfs":{"total":96636764160,"available":96488132608,"internally_reserved":0,"allocated":102543360,"data_stored":140664028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2084926,"internal_metadata":43986882},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640470,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163216,"kb_used_data":118208,"kb_used_omap":2110,"kb_used_meta":42881,"kb_avail":94208624,"statfs":{"total":96636764160,"available":96469630976,"internally_reserved":0,"allocated":121044992,"data_stored":159591701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2161513,"internal_metadata":43910295},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640473,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51984,"kb_used_data":25024,"kb_used_omap":919,"kb_used_meta":26024,"kb_avail":94319856,"statfs":{"total":96636764160,"available":96583532544,"internally_reserved":0,"allocated":25624576,"data_stored":30764163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":941744,"internal_metadata":26648912},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640472,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153308,"kb_used_data":108300,"kb_used_omap":1953,"kb_used_meta":43038,"kb_avail":94218532,"statfs":{"total":96636764160,"available":96479776768,"internally_reserved":0,"allocated":110899200,"data_stored":147650485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2000431,"internal_metadata":44071377},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640473,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152768,"kb_used_data":107760,"kb_used_omap":1462,"kb_used_meta":43529,"kb_avail":94219072,"statfs":{"total":96636764160,"available":96480329728,"internally_reserved":0,"allocated":110346240,"data_stored":136237916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1497814,"internal_metadata":44573994},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640472,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171260,"kb_used_data":126252,"kb_used_omap":1723,"kb_used_meta":43268,"kb_avail":94200580,"statfs":{"total":96636764160,"available":96461393920,"internally_reserved":0,"allocated":129282048,"data_stored":163751064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1764778,"internal_metadata":44307030},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126717952,"data_stored":162104566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":108302336,"data_stored":135115701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":108867584,"data_stored":146532915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23093248,"data_stored":29135921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":119046144,"data_stored":158492387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100540416,"data_stored":139564695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:45:56.707 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-12T17:45:56.707 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-12T17:45:56.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.776+0000 7f2547bb6640 10 monclient: get_monmap_and_config 2026-02-12T17:45:56.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.776+0000 7f2547bb6640 10 monclient: build_initial_monmap 2026-02-12T17:45:56.773 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.776+0000 7f2547bb6640 10 monclient: monmap: 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:45:56.777611+0000 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:45:56.777611+0000 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:45:56.774 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 1 Processor -- start 2026-02-12T17:45:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 1 -- start start 2026-02-12T17:45:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 10 monclient: init 2026-02-12T17:45:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:45:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 10 monclient(hunting): picked mon.noname-c con 0x7f254008bf10 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 10 monclient(hunting): picked mon.noname-a con 0x7f254008cf60 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 10 monclient(hunting): picked mon.noname-b con 0x7f254008c9f0 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:56.780 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2540085510 con 0x7f254008cf60 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2540086290 con 0x7f254008bf10 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25400859f0 con 0x7f254008c9f0 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f2547bb6640 10 monclient(hunting): authenticate will time out at 1636.596523s 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f254512a640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f254008cf60 legacy=0x7f2540181ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f254612c640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f254008c9f0 0x7f25401a3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:46212/0 (socket says 10.20.193.57:46212) 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.777+0000 7f254612c640 1 -- 10.20.193.57:0/496355968 learned_addr learned my addr 10.20.193.57:0/496355968 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.779+0000 7f254612c640 1 -- 10.20.193.57:0/496355968 >> v1:10.20.193.57:6790/0 conn(0x7f254008c9f0 legacy=0x7f25401a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.779+0000 7f254592b640 1 -- 10.20.193.57:0/496355968 >> v1:10.20.193.82:6789/0 conn(0x7f254008bf10 legacy=0x7f254008c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.779+0000 7f2544929640 1 -- 10.20.193.57:0/496355968 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805266414 0 0) 0x7f25400859f0 con 0x7f254008c9f0 2026-02-12T17:45:56.781 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.779+0000 7f2544929640 10 monclient(hunting): _negotiate 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.779+0000 7f2544929640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.779+0000 7f2544929640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.779+0000 7f2544929640 10 monclient(hunting): my global_id is 114188 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.779+0000 7f2544929640 1 -- 10.20.193.57:0/496355968 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25280035e0 con 0x7f254008c9f0 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 1 -- 10.20.193.57:0/496355968 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2873129301 0 0) 0x7f25280035e0 con 0x7f254008c9f0 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 1 -- 10.20.193.57:0/496355968 >> v1:10.20.193.82:6789/0 conn(0x7f254008bf10 legacy=0x7f254008c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 1 -- 10.20.193.57:0/496355968 >> v1:10.20.193.57:6789/0 conn(0x7f254008cf60 legacy=0x7f2540181ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: _finish_hunting 0 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 1 monclient: found mon.noname-b 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.782 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 1 -- 10.20.193.57:0/496355968 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254008d3e0 con 0x7f254008c9f0 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: _finish_auth 0 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: _check_auth_tickets 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 1 -- 10.20.193.57:0/496355968 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f253c004230 con 0x7f254008c9f0 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: dump: 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.783 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 5 monclient: authenticate success, global_id 114188 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 1 -- 10.20.193.57:0/496355968 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f253c004480 con 0x7f254008c9f0 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 10 monclient: get_monmap_and_config success 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 4 set_mon_vals no callback set 2026-02-12T17:45:56.784 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 1 -- 10.20.193.57:0/496355968 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f253c005bf0 con 0x7f254008c9f0 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2544929640 10 monclient: dump: 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.785 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 10 monclient: shutdown 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 1 -- 10.20.193.57:0/496355968 >> v1:10.20.193.57:6790/0 conn(0x7f254008c9f0 legacy=0x7f25401a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 1 -- 10.20.193.57:0/496355968 shutdown_connections 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 1 -- 10.20.193.57:0/496355968 >> 10.20.193.57:0/496355968 conn(0x7f2540091510 msgr2=0x7f2540091910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 1 -- 10.20.193.57:0/496355968 shutdown_connections 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.780+0000 7f2547bb6640 1 -- 10.20.193.57:0/496355968 wait complete. 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient: build_initial_monmap 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient: monmap: 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:45:56.786 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 1 Processor -- start 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 1 -- start start 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient: init 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient: _reopen_session rank -1 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient(hunting): picked mon.noname-a con 0x7f254008bf10 addr v1:10.20.193.57:6789/0 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient(hunting): picked mon.noname-b con 0x7f254008c9f0 addr v1:10.20.193.82:6789/0 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient(hunting): picked mon.noname-c con 0x7f254008cf60 addr v1:10.20.193.57:6790/0 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2540088700 con 0x7f254008bf10 2026-02-12T17:45:56.787 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2540058a70 con 0x7f254008c9f0 2026-02-12T17:45:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2540082ab0 con 0x7f254008cf60 2026-02-12T17:45:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f254592b640 1 -- >> v1:10.20.193.57:6789/0 conn(0x7f254008bf10 legacy=0x7f2540152df0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.57:6789/0 2026-02-12T17:45:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient(hunting): _renew_subs 2026-02-12T17:45:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f2547bb6640 10 monclient(hunting): authenticate will time out at 1636.600531s 2026-02-12T17:45:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f254612c640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f254008cf60 0x7f2540195750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:46226/0 (socket says 10.20.193.57:46226) 2026-02-12T17:45:56.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.781+0000 7f254612c640 1 -- 10.20.193.57:0/646818678 learned_addr learned my addr 10.20.193.57:0/646818678 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.783+0000 7f254612c640 1 -- 10.20.193.57:0/646818678 >> v1:10.20.193.57:6790/0 conn(0x7f254008cf60 legacy=0x7f2540195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.783+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617692912 0 0) 0x7f2540082ab0 con 0x7f254008cf60 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.783+0000 7f252e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.783+0000 7f252e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.783+0000 7f252e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.783+0000 7f252e7fc640 10 monclient(hunting): my global_id is 114191 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.783+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25100035e0 con 0x7f254008cf60 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3785317986 0 0) 0x7f25100035e0 con 0x7f254008cf60 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2540082ab0 con 0x7f254008cf60 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f253c005980 con 0x7f254008cf60 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:45:56.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient(hunting): dump: 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f254512a640 1 -- 10.20.193.57:0/646818678 >> v1:10.20.193.82:6789/0 conn(0x7f254008c9f0 legacy=0x7f2540194030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 11908901 0 0) 0x7f2540082ab0 con 0x7f254008cf60 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 >> v1:10.20.193.82:6789/0 conn(0x7f254008c9f0 legacy=0x7f2540194030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 >> v1:10.20.193.57:6789/0 conn(0x7f254008bf10 legacy=0x7f2540152df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 monclient: found mon.c 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2540082d90 con 0x7f254008cf60 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 5 monclient: authenticate success, global_id 114191 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 10 monclient: _renew_subs 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2540083070 con 0x7f254008cf60 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 10 monclient: _renew_subs 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f25400827d0 con 0x7f254008cf60 2026-02-12T17:45:56.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f253c005c70 con 0x7f254008cf60 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f253c006340 con 0x7f254008cf60 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 10 monclient: dump: 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:45:56.794 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252ffff640 4 set_mon_vals no callback set 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25400008d0 con 0x7f254008cf60 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.784+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f253c012fb0 con 0x7f254008cf60 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.785+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(885..885 src has 637..885) ==== 4071+0+0 (unknown 24620271 0 0) 0x7f253c04fed0 con 0x7f254008cf60 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.785+0000 7f254592b640 10 monclient: get_auth_request con 0x7f251003f610 auth_method 0 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.787+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f253c018620 con 0x7f254008cf60 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.787+0000 7f252e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:45:56.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.787+0000 7f252e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:45:56.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.894+0000 7f2547bb6640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-12T17:45:56.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.894+0000 7f2547bb6640 10 monclient: _send_command 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-12T17:45:56.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.894+0000 7f2547bb6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:45:56.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.894+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true} v 0) -- 0x7f254008aed0 con 0x7f254008cf60 2026-02-12T17:45:56.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.914+0000 7f252e7fc640 1 -- 10.20.193.57:0/646818678 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]=0 pool 'unique_pool_0' removed v886) ==== 175+0+0 (unknown 1481737397 0 0) 0x7f253c017dd0 con 0x7f254008cf60 2026-02-12T17:45:56.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.914+0000 7f252e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}] 2026-02-12T17:45:56.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.914+0000 7f252e7fc640 10 monclient: _finish_command 2 = system:0 pool 'unique_pool_0' removed 2026-02-12T17:45:56.911 INFO:teuthology.orchestra.run.trial057.stderr:pool 'unique_pool_0' removed 2026-02-12T17:45:56.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.915+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 >> v1:10.20.193.82:6800/2441377515 conn(0x7f251003f610 legacy=0x7f251005fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.915+0000 7f2547bb6640 10 monclient: shutdown 2026-02-12T17:45:56.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.915+0000 7f2547bb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:45:56.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.915+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 >> v1:10.20.193.57:6790/0 conn(0x7f254008cf60 legacy=0x7f2540195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:45:56.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.915+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 shutdown_connections 2026-02-12T17:45:56.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.915+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 >> 10.20.193.57:0/646818678 conn(0x7f2540091510 msgr2=0x7f254005dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:45:56.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.915+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 shutdown_connections 2026-02-12T17:45:56.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:45:56.915+0000 7f2547bb6640 1 -- 10.20.193.57:0/646818678 wait complete. 2026-02-12T17:45:56.921 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-12T17:45:56.937 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-12T17:46:57.259 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-12T17:46:57.259 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-12T17:46:57.260 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T17:46:57.260 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T17:46:57.263 INFO:tasks.ceph.mon.a:Started 2026-02-12T17:46:57.263 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-12T17:46:57.263 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-12T17:46:57.264 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-12T17:46:57.264 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T17:47:12.264 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-12T17:47:12.264 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-12T17:47:12.264 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-12T17:47:12.264 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:47:12.264 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.335+0000 7f412685b640 10 monclient: get_monmap_and_config 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.335+0000 7f412685b640 10 monclient: build_initial_monmap 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.335+0000 7f412685b640 10 monclient: monmap: 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:12.336404+0000 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:12.336404+0000 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.335+0000 7f412685b640 1 Processor -- start 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 1 -- start start 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 10 monclient: init 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 10 monclient(hunting): picked mon.noname-b con 0x7f412008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:12.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 10 monclient(hunting): picked mon.noname-a con 0x7f412008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 10 monclient(hunting): picked mon.noname-c con 0x7f412008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f412008d600 con 0x7f412008c730 2026-02-12T17:47:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f412008b1f0 con 0x7f412008cb30 2026-02-12T17:47:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f412008d1f0 con 0x7f412008ae20 2026-02-12T17:47:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f412685b640 10 monclient(hunting): authenticate will time out at 1712.155281s 2026-02-12T17:47:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f411ffff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f412008ae20 0x7f412008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:50384/0 (socket says 10.20.193.57:50384) 2026-02-12T17:47:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f411ffff640 1 -- 10.20.193.57:0/884217990 learned_addr learned my addr 10.20.193.57:0/884217990 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:12.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.336+0000 7f411f7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f412008c730 0x7f4120181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40946/0 (socket says 10.20.193.57:40946) 2026-02-12T17:47:12.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411ffff640 1 -- 10.20.193.57:0/884217990 >> v1:10.20.193.57:6790/0 conn(0x7f412008ae20 legacy=0x7f412008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:12.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411f7fe640 1 -- 10.20.193.57:0/884217990 >> v1:10.20.193.57:6789/0 conn(0x7f412008c730 legacy=0x7f4120181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463903037 0 0) 0x7f412008d1f0 con 0x7f412008ae20 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient(hunting): my global_id is 114194 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41040035e0 con 0x7f412008ae20 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f4124dd1640 1 -- 10.20.193.57:0/884217990 >> v1:10.20.193.82:6789/0 conn(0x7f412008cb30 legacy=0x7f41201a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2483127078 0 0) 0x7f412008d600 con 0x7f412008c730 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient(hunting): my global_id is 124098 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f412008d1f0 con 0x7f412008c730 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1844914845 0 0) 0x7f41040035e0 con 0x7f412008ae20 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 >> v1:10.20.193.82:6789/0 conn(0x7f412008cb30 legacy=0x7f41201a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 >> v1:10.20.193.57:6789/0 conn(0x7f412008c730 legacy=0x7f4120181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: _finish_hunting 0 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 monclient: found mon.noname-b 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:12.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4120057320 con 0x7f412008ae20 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: _finish_auth 0 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: _check_auth_tickets 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f410c0030c0 con 0x7f412008ae20 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: dump: 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f412685b640 5 monclient: authenticate success, global_id 114194 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f412685b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f410c003350 con 0x7f412008ae20 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 1 -- 10.20.193.57:0/884217990 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f410c004960 con 0x7f412008ae20 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f412685b640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f412685b640 4 set_mon_vals no callback set 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.338+0000 7f411effd640 10 monclient: dump: 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:12.336 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 10 monclient: shutdown 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 1 -- 10.20.193.57:0/884217990 >> v1:10.20.193.57:6790/0 conn(0x7f412008ae20 legacy=0x7f412008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 1 -- 10.20.193.57:0/884217990 shutdown_connections 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 1 -- 10.20.193.57:0/884217990 >> 10.20.193.57:0/884217990 conn(0x7f4120091620 msgr2=0x7f4120091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 1 -- 10.20.193.57:0/884217990 shutdown_connections 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 1 -- 10.20.193.57:0/884217990 wait complete. 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 10 monclient: build_initial_monmap 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 10 monclient: monmap: 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 1 Processor -- start 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 1 -- start start 2026-02-12T17:47:12.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.339+0000 7f412685b640 10 monclient: init 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 10 monclient(hunting): picked mon.noname-a con 0x7f412008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 10 monclient(hunting): picked mon.noname-c con 0x7f412008c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 10 monclient(hunting): picked mon.noname-b con 0x7f412008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f412008d9c0 con 0x7f412008ae20 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41200831e0 con 0x7f412008cb30 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4120085540 con 0x7f412008c730 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f412685b640 10 monclient(hunting): authenticate will time out at 1712.159214s 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f411f7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f412008c730 0x7f4120194030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:50400/0 (socket says 10.20.193.57:50400) 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f411ffff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f412008ae20 0x7f4120153350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:40960/0 (socket says 10.20.193.57:40960) 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.340+0000 7f411f7fe640 1 -- 10.20.193.57:0/3679464183 learned_addr learned my addr 10.20.193.57:0/3679464183 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411f7fe640 1 -- 10.20.193.57:0/3679464183 >> v1:10.20.193.57:6790/0 conn(0x7f412008c730 legacy=0x7f4120194030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:12.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411ffff640 1 -- 10.20.193.57:0/3679464183 >> v1:10.20.193.57:6789/0 conn(0x7f412008ae20 legacy=0x7f4120153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884299580 0 0) 0x7f4120085540 con 0x7f412008c730 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): my global_id is 114197 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40f00035e0 con 0x7f412008c730 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 177887109 0 0) 0x7f412008d9c0 con 0x7f412008ae20 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): _negotiate 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): my global_id is 124101 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4120085540 con 0x7f412008ae20 2026-02-12T17:47:12.339 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f4124dd1640 1 -- 10.20.193.57:0/3679464183 >> v1:10.20.193.82:6789/0 conn(0x7f412008cb30 legacy=0x7f4120195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3152883568 0 0) 0x7f40f00035e0 con 0x7f412008c730 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f412008d9c0 con 0x7f412008c730 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4110003540 con 0x7f412008c730 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): dump: 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 433793815 0 0) 0x7f4120085540 con 0x7f412008ae20 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40f00035e0 con 0x7f412008ae20 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f410c002b30 con 0x7f412008ae20 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient(hunting): dump: 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1503832868 0 0) 0x7f412008d9c0 con 0x7f412008c730 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 >> v1:10.20.193.82:6789/0 conn(0x7f412008cb30 legacy=0x7f4120195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 >> v1:10.20.193.57:6789/0 conn(0x7f412008ae20 legacy=0x7f4120153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient: _finish_hunting 0 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 monclient: found mon.c 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:12.340 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4120084ca0 con 0x7f412008c730 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient: _finish_auth 0 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 10 monclient: _check_auth_tickets 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f412685b640 5 monclient: authenticate success, global_id 114197 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f412685b640 10 monclient: _renew_subs 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f412685b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4120084f80 con 0x7f412008c730 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f412685b640 10 monclient: _renew_subs 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f412685b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4120153a60 con 0x7f412008c730 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.342+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4110004bc0 con 0x7f412008c730 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f411cff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f4110004ee0 con 0x7f412008c730 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f411cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f411cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f411cff9640 10 monclient: dump: 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f411e7fc640 4 set_mon_vals no callback set 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f412685b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f412685b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f412685b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41200008d0 con 0x7f412008c730 2026-02-12T17:47:12.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f41100050f0 con 0x7f412008c730 2026-02-12T17:47:12.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f411004eba0 con 0x7f412008c730 2026-02-12T17:47:12.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.343+0000 7f411ffff640 10 monclient: get_auth_request con 0x7f40f003fb30 auth_method 0 2026-02-12T17:47:12.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.345+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f4110017430 con 0x7f412008c730 2026-02-12T17:47:12.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.345+0000 7f411cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:12.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.345+0000 7f411cff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.488+0000 7f412685b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:47:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.488+0000 7f412685b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:12.485 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.488+0000 7f412685b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.488+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f412008f500 con 0x7f412008c730 2026-02-12T17:47:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.489+0000 7f411cff9640 1 -- 10.20.193.57:0/3679464183 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 3093734387) 0x7f4110016be0 con 0x7f412008c730 2026-02-12T17:47:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.489+0000 7f411cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.489+0000 7f411cff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:12.486 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":70,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:47:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.490+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 >> v1:10.20.193.82:6800/2441377515 conn(0x7f40f003fb30 legacy=0x7f40f005ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.490+0000 7f412685b640 10 monclient: shutdown 2026-02-12T17:47:12.486 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.490+0000 7f412685b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:12.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.490+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 >> v1:10.20.193.57:6790/0 conn(0x7f412008c730 legacy=0x7f4120194030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:12.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.490+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 shutdown_connections 2026-02-12T17:47:12.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.490+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 >> 10.20.193.57:0/3679464183 conn(0x7f4120091620 msgr2=0x7f4120059f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:12.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.490+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 shutdown_connections 2026-02-12T17:47:12.487 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:12.490+0000 7f412685b640 1 -- 10.20.193.57:0/3679464183 wait complete. 2026-02-12T17:47:15.494 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:47:15.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient: get_monmap_and_config 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient: build_initial_monmap 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient: monmap: 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:15.565148+0000 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:15.565148+0000 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:15.561 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 1 Processor -- start 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 1 -- start start 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient: init 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient(hunting): picked mon.noname-b con 0x7f008c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient(hunting): picked mon.noname-c con 0x7f008c08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient(hunting): picked mon.noname-a con 0x7f008c08cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c08d600 con 0x7f008c08cb30 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c08b1f0 con 0x7f008c08c730 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c08d1f0 con 0x7f008c08ae20 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.564+0000 7f00919dd640 10 monclient(hunting): authenticate will time out at 1715.383999s 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.565+0000 7f008b7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f008c08cb30 0x7f008c1a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47240/0 (socket says 10.20.193.57:47240) 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.565+0000 7f008b7fe640 1 -- 10.20.193.57:0/820511143 learned_addr learned my addr 10.20.193.57:0/820511143 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:15.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.565+0000 7f008affd640 1 --1- 10.20.193.57:0/820511143 >> v1:10.20.193.57:6790/0 conn(0x7f008c08ae20 0x7f008c08c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:55440/0 (socket says 10.20.193.57:55440) 2026-02-12T17:47:15.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f008b7fe640 1 -- 10.20.193.57:0/820511143 >> v1:10.20.193.57:6789/0 conn(0x7f008c08cb30 legacy=0x7f008c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f008affd640 1 -- 10.20.193.57:0/820511143 >> v1:10.20.193.57:6790/0 conn(0x7f008c08ae20 legacy=0x7f008c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 197709764 0 0) 0x7f008c08d600 con 0x7f008c08cb30 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient(hunting): my global_id is 124104 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00780035e0 con 0x7f008c08cb30 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f008a7fc640 1 -- 10.20.193.57:0/820511143 >> v1:10.20.193.82:6789/0 conn(0x7f008c08c730 legacy=0x7f008c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1432713378 0 0) 0x7f008c08d1f0 con 0x7f008c08ae20 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient(hunting): my global_id is 114200 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f008c08d600 con 0x7f008c08ae20 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 891079879 0 0) 0x7f00780035e0 con 0x7f008c08cb30 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 >> v1:10.20.193.57:6790/0 conn(0x7f008c08ae20 legacy=0x7f008c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 >> v1:10.20.193.82:6789/0 conn(0x7f008c08c730 legacy=0x7f008c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 monclient: found mon.noname-a 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:15.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c057320 con 0x7f008c08cb30 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: _finish_auth 0 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f007c004230 con 0x7f008c08cb30 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: dump: 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f00919dd640 5 monclient: authenticate success, global_id 124104 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f00919dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f007c004480 con 0x7f008c08cb30 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 1 -- 10.20.193.57:0/820511143 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f007c005bf0 con 0x7f008c08cb30 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:15.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f0089ffb640 10 monclient: dump: 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f00919dd640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.567+0000 7f00919dd640 4 set_mon_vals no callback set 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 10 monclient: shutdown 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 1 -- 10.20.193.57:0/820511143 >> v1:10.20.193.57:6789/0 conn(0x7f008c08cb30 legacy=0x7f008c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 1 -- 10.20.193.57:0/820511143 shutdown_connections 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 1 -- 10.20.193.57:0/820511143 >> 10.20.193.57:0/820511143 conn(0x7f008c091620 msgr2=0x7f008c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 1 -- 10.20.193.57:0/820511143 shutdown_connections 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 1 -- 10.20.193.57:0/820511143 wait complete. 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 10 monclient: build_initial_monmap 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 10 monclient: monmap: 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:15.567 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:15.568 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:15.568 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:15.568 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:15.568 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:15.568 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:15.568 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 1 Processor -- start 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 1 -- start start 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.568+0000 7f00919dd640 10 monclient: init 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 10 monclient(hunting): picked mon.noname-c con 0x7f008c08ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 10 monclient(hunting): picked mon.noname-a con 0x7f008c08c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 10 monclient(hunting): picked mon.noname-b con 0x7f008c08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c08d9c0 con 0x7f008c08c730 2026-02-12T17:47:15.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c11c490 con 0x7f008c08cb30 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008c05b160 con 0x7f008c08ae20 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f00919dd640 10 monclient(hunting): authenticate will time out at 1715.388046s 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f008affd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f008c08ae20 0x7f008c088d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:55456/0 (socket says 10.20.193.57:55456) 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.569+0000 7f008affd640 1 -- 10.20.193.57:0/3850660178 learned_addr learned my addr 10.20.193.57:0/3850660178 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f008a7fc640 1 -- 10.20.193.57:0/3850660178 >> v1:10.20.193.57:6789/0 conn(0x7f008c08c730 legacy=0x7f008c089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f008affd640 1 -- 10.20.193.57:0/3850660178 >> v1:10.20.193.57:6790/0 conn(0x7f008c08ae20 legacy=0x7f008c088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406898891 0 0) 0x7f008c08d9c0 con 0x7f008c08c730 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): my global_id is 124107 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f005c0035e0 con 0x7f008c08c730 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434009002 0 0) 0x7f008c05b160 con 0x7f008c08ae20 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): my global_id is 114203 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f008c08d9c0 con 0x7f008c08ae20 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f008b7fe640 1 -- 10.20.193.57:0/3850660178 >> v1:10.20.193.82:6789/0 conn(0x7f008c08cb30 legacy=0x7f008c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3395554948 0 0) 0x7f005c0035e0 con 0x7f008c08c730 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f008c05b160 con 0x7f008c08c730 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0074003340 con 0x7f008c08c730 2026-02-12T17:47:15.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): dump: 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 975663329 0 0) 0x7f008c08d9c0 con 0x7f008c08ae20 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f005c0035e0 con 0x7f008c08ae20 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0080003310 con 0x7f008c08ae20 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient(hunting): dump: 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:15.572 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 617277723 0 0) 0x7f008c05b160 con 0x7f008c08c730 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 >> v1:10.20.193.57:6790/0 conn(0x7f008c08ae20 legacy=0x7f008c088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 >> v1:10.20.193.82:6789/0 conn(0x7f008c08cb30 legacy=0x7f008c1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 monclient: found mon.a 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008c088810 con 0x7f008c08c730 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient: _finish_auth 0 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f00919dd640 5 monclient: authenticate success, global_id 124107 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f00919dd640 10 monclient: _renew_subs 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f00919dd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f008c08a3f0 con 0x7f008c08c730 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f00919dd640 10 monclient: _renew_subs 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f00919dd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f008c05cd00 con 0x7f008c08c730 2026-02-12T17:47:15.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0074003980 con 0x7f008c08c730 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0074003ca0 con 0x7f008c08c730 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f0063fff640 10 monclient: dump: 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.571+0000 7f00897fa640 4 set_mon_vals no callback set 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.572+0000 7f00919dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.572+0000 7f00919dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.572+0000 7f00919dd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.572+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f008c11d730 con 0x7f008c08c730 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.572+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0074003f30 con 0x7f008c08c730 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.572+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f007404eb00 con 0x7f008c08c730 2026-02-12T17:47:15.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.572+0000 7f008affd640 10 monclient: get_auth_request con 0x7f005c03fb30 auth_method 0 2026-02-12T17:47:15.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.574+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f0074017390 con 0x7f008c08c730 2026-02-12T17:47:15.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.574+0000 7f0063fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:15.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.574+0000 7f0063fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:15.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.716+0000 7f00919dd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:47:15.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.716+0000 7f00919dd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:15.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.716+0000 7f00919dd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:15.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.716+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f008c055340 con 0x7f008c08c730 2026-02-12T17:47:15.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.716+0000 7f0063fff640 1 -- 10.20.193.57:0/3850660178 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 3402555948) 0x7f0074016d20 con 0x7f008c08c730 2026-02-12T17:47:15.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.716+0000 7f0063fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:15.713 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.716+0000 7f0063fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:15.713 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":70,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:47:15.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.718+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 >> v1:10.20.193.82:6800/2441377515 conn(0x7f005c03fb30 legacy=0x7f005c05ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:15.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.718+0000 7f00919dd640 10 monclient: shutdown 2026-02-12T17:47:15.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.718+0000 7f00919dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:15.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.718+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 >> v1:10.20.193.57:6789/0 conn(0x7f008c08c730 legacy=0x7f008c089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:15.714 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.718+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 shutdown_connections 2026-02-12T17:47:15.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.718+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 >> 10.20.193.57:0/3850660178 conn(0x7f008c091620 msgr2=0x7f008c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:15.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.718+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 shutdown_connections 2026-02-12T17:47:15.715 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:15.718+0000 7f00919dd640 1 -- 10.20.193.57:0/3850660178 wait complete. 2026-02-12T17:47:18.722 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient: get_monmap_and_config 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient: build_initial_monmap 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient: monmap: 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:18.792870+0000 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:18.792870+0000 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:18.788 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 1 Processor -- start 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 1 -- start start 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient: init 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f33ec08ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f33ec08c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f33ec08cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec08d600 con 0x7f33ec08cb30 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec08b1f0 con 0x7f33ec08ae20 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec08d1f0 con 0x7f33ec08c730 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33f1b0c640 10 monclient(hunting): authenticate will time out at 1718.611750s 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33eaffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f33ec08c730 0x7f33ec181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:55468/0 (socket says 10.20.193.57:55468) 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33eaffd640 1 -- 10.20.193.57:0/2511674857 learned_addr learned my addr 10.20.193.57:0/2511674857 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:18.789 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.792+0000 7f33ebfff640 1 --1- 10.20.193.57:0/2511674857 >> v1:10.20.193.57:6789/0 conn(0x7f33ec08cb30 0x7f33ec1a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47256/0 (socket says 10.20.193.57:47256) 2026-02-12T17:47:18.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.794+0000 7f33ebfff640 1 -- 10.20.193.57:0/2511674857 >> v1:10.20.193.57:6789/0 conn(0x7f33ec08cb30 legacy=0x7f33ec1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:18.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.794+0000 7f33eaffd640 1 -- 10.20.193.57:0/2511674857 >> v1:10.20.193.57:6790/0 conn(0x7f33ec08c730 legacy=0x7f33ec181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:18.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33eb7fe640 1 -- 10.20.193.57:0/2511674857 >> v1:10.20.193.82:6789/0 conn(0x7f33ec08ae20 legacy=0x7f33ec08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:18.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 -- 10.20.193.57:0/2511674857 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2746933553 0 0) 0x7f33ec08d600 con 0x7f33ec08cb30 2026-02-12T17:47:18.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:18.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:18.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:18.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient(hunting): my global_id is 124110 2026-02-12T17:47:18.791 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 -- 10.20.193.57:0/2511674857 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33d00035e0 con 0x7f33ec08cb30 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 -- 10.20.193.57:0/2511674857 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 222278112 0 0) 0x7f33d00035e0 con 0x7f33ec08cb30 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 -- 10.20.193.57:0/2511674857 >> v1:10.20.193.57:6790/0 conn(0x7f33ec08c730 legacy=0x7f33ec181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 -- 10.20.193.57:0/2511674857 >> v1:10.20.193.82:6789/0 conn(0x7f33ec08ae20 legacy=0x7f33ec08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 monclient: found mon.noname-a 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 -- 10.20.193.57:0/2511674857 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec057320 con 0x7f33ec08cb30 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 -- 10.20.193.57:0/2511674857 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f33e0004230 con 0x7f33ec08cb30 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: dump: 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 5 monclient: authenticate success, global_id 124110 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 -- 10.20.193.57:0/2511674857 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33e0004480 con 0x7f33ec08cb30 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 1 -- 10.20.193.57:0/2511674857 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f33e0005b30 con 0x7f33ec08cb30 2026-02-12T17:47:18.792 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 4 set_mon_vals no callback set 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33ea7fc640 10 monclient: dump: 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 10 monclient: shutdown 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2511674857 >> v1:10.20.193.57:6789/0 conn(0x7f33ec08cb30 legacy=0x7f33ec1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2511674857 shutdown_connections 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2511674857 >> 10.20.193.57:0/2511674857 conn(0x7f33ec091620 msgr2=0x7f33ec091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2511674857 shutdown_connections 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.795+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2511674857 wait complete. 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient: build_initial_monmap 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient: monmap: 2026-02-12T17:47:18.793 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 1 Processor -- start 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 1 -- start start 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient: init 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f33ec08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient(hunting): picked mon.noname-b con 0x7f33ec08c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient(hunting): picked mon.noname-c con 0x7f33ec08cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec08d9c0 con 0x7f33ec08ae20 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec05b130 con 0x7f33ec08c730 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec122640 con 0x7f33ec08cb30 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33f1b0c640 10 monclient(hunting): authenticate will time out at 1718.615681s 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33eb7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f33ec08ae20 0x7f33ec117ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47260/0 (socket says 10.20.193.57:47260) 2026-02-12T17:47:18.794 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.796+0000 7f33eb7fe640 1 -- 10.20.193.57:0/2279421528 learned_addr learned my addr 10.20.193.57:0/2279421528 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:18.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.798+0000 7f33ebfff640 1 -- 10.20.193.57:0/2279421528 >> v1:10.20.193.57:6790/0 conn(0x7f33ec08cb30 legacy=0x7f33ec1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:18.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.798+0000 7f33eb7fe640 1 -- 10.20.193.57:0/2279421528 >> v1:10.20.193.57:6789/0 conn(0x7f33ec08ae20 legacy=0x7f33ec117ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:18.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.798+0000 7f33eaffd640 1 -- 10.20.193.57:0/2279421528 >> v1:10.20.193.82:6789/0 conn(0x7f33ec08c730 legacy=0x7f33ec1185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:18.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780034047 0 0) 0x7f33ec08d9c0 con 0x7f33ec08ae20 2026-02-12T17:47:18.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:18.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:18.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:18.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient(hunting): my global_id is 124113 2026-02-12T17:47:18.795 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33bc0035e0 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3320892818 0 0) 0x7f33bc0035e0 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33ec08d9c0 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f33d8003340 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient(hunting): dump: 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3653591512 0 0) 0x7f33ec08d9c0 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 >> v1:10.20.193.57:6790/0 conn(0x7f33ec08cb30 legacy=0x7f33ec1a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 >> v1:10.20.193.82:6789/0 conn(0x7f33ec08c730 legacy=0x7f33ec1185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 monclient: found mon.a 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec11ada0 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient: _finish_auth 0 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 5 monclient: authenticate success, global_id 124113 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 10 monclient: _renew_subs 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f33ec11bc10 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 10 monclient: _renew_subs 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f33ec088810 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f33d8003980 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f33d8003ca0 con 0x7f33ec08ae20 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:18.796 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33e9ffb640 4 set_mon_vals no callback set 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33c7fff640 10 monclient: dump: 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.799+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ec126c40 con 0x7f33ec08ae20 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.800+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f33d8003f30 con 0x7f33ec08ae20 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.800+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f33d804ea30 con 0x7f33ec08ae20 2026-02-12T17:47:18.797 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.800+0000 7f33eaffd640 10 monclient: get_auth_request con 0x7f33bc03f740 auth_method 0 2026-02-12T17:47:18.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.802+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f33d8017320 con 0x7f33ec08ae20 2026-02-12T17:47:18.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.802+0000 7f33c7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:18.798 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.802+0000 7f33c7fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:18.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.945+0000 7f33f1b0c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:47:18.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.945+0000 7f33f1b0c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:18.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.945+0000 7f33f1b0c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:18.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.945+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f33ec055340 con 0x7f33ec08ae20 2026-02-12T17:47:18.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.945+0000 7f33c7fff640 1 -- 10.20.193.57:0/2279421528 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 1563828301) 0x7f33d8016ad0 con 0x7f33ec08ae20 2026-02-12T17:47:18.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.945+0000 7f33c7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:18.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.945+0000 7f33c7fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:18.942 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":70,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"c","quorum_age":6,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:47:18.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.946+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 >> v1:10.20.193.82:6800/2441377515 conn(0x7f33bc03f740 legacy=0x7f33bc05fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:18.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.946+0000 7f33f1b0c640 10 monclient: shutdown 2026-02-12T17:47:18.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.946+0000 7f33f1b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:18.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.946+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 >> v1:10.20.193.57:6789/0 conn(0x7f33ec08ae20 legacy=0x7f33ec117ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:18.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.946+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 shutdown_connections 2026-02-12T17:47:18.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.946+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 >> 10.20.193.57:0/2279421528 conn(0x7f33ec091620 msgr2=0x7f33ec125d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:18.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.946+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 shutdown_connections 2026-02-12T17:47:18.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:18.946+0000 7f33f1b0c640 1 -- 10.20.193.57:0/2279421528 wait complete. 2026-02-12T17:47:21.951 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:47:22.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient: get_monmap_and_config 2026-02-12T17:47:22.017 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient: build_initial_monmap 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient: monmap: 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:22.022103+0000 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:22.022103+0000 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:22.018 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 1 Processor -- start 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 1 -- start start 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient: init 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient(hunting): picked mon.noname-a con 0x7fcd8008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient(hunting): picked mon.noname-c con 0x7fcd8008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient(hunting): picked mon.noname-b con 0x7fcd8008cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8008d600 con 0x7fcd8008ae20 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8008b1f0 con 0x7fcd8008c730 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8008d1f0 con 0x7fcd8008cb30 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.021+0000 7fcd87052640 10 monclient(hunting): authenticate will time out at 1721.840985s 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.022+0000 7fcd84dc7640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fcd8008ae20 0x7fcd8008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:47262/0 (socket says 10.20.193.57:47262) 2026-02-12T17:47:22.019 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.022+0000 7fcd84dc7640 1 -- 10.20.193.57:0/3060487713 learned_addr learned my addr 10.20.193.57:0/3060487713 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:22.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.024+0000 7fcd84dc7640 1 -- 10.20.193.57:0/3060487713 >> v1:10.20.193.57:6789/0 conn(0x7fcd8008ae20 legacy=0x7fcd8008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:22.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.024+0000 7fcd855c8640 1 -- 10.20.193.57:0/3060487713 >> v1:10.20.193.57:6790/0 conn(0x7fcd8008cb30 legacy=0x7fcd801a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:22.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:22.024+0000 7fcd77fff640 1 -- 10.20.193.57:0/3060487713 >> v1:10.20.193.82:6789/0 conn(0x7fcd8008c730 legacy=0x7fcd80181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.280+0000 7fcd777fe640 1 -- 10.20.193.57:0/3060487713 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023677264 0 0) 0x7fcd8008d1f0 con 0x7fcd8008cb30 2026-02-12T17:47:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.280+0000 7fcd777fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:23.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.280+0000 7fcd777fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.280+0000 7fcd777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.280+0000 7fcd777fe640 10 monclient(hunting): my global_id is 114206 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.280+0000 7fcd777fe640 1 -- 10.20.193.57:0/3060487713 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd6c0035e0 con 0x7fcd8008cb30 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.280+0000 7fcd777fe640 1 -- 10.20.193.57:0/3060487713 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4196316165 0 0) 0x7fcd6c0035e0 con 0x7fcd8008cb30 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.280+0000 7fcd777fe640 1 -- 10.20.193.57:0/3060487713 >> v1:10.20.193.82:6789/0 conn(0x7fcd8008c730 legacy=0x7fcd80181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.280+0000 7fcd777fe640 1 -- 10.20.193.57:0/3060487713 >> v1:10.20.193.57:6789/0 conn(0x7fcd8008ae20 legacy=0x7fcd8008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: _finish_hunting 0 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 1 monclient: found mon.noname-b 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 1 -- 10.20.193.57:0/3060487713 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd80057320 con 0x7fcd8008cb30 2026-02-12T17:47:23.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: _finish_auth 0 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: _check_auth_tickets 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 1 -- 10.20.193.57:0/3060487713 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fcd7c004270 con 0x7fcd8008cb30 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: dump: 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:23.282 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 5 monclient: authenticate success, global_id 114206 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 1 -- 10.20.193.57:0/3060487713 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd7c0044c0 con 0x7fcd8008cb30 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 1 -- 10.20.193.57:0/3060487713 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fcd7c004960 con 0x7fcd8008cb30 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 4 set_mon_vals no callback set 2026-02-12T17:47:23.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd777fe640 10 monclient: dump: 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:23.284 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 10 monclient: shutdown 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 1 -- 10.20.193.57:0/3060487713 >> v1:10.20.193.57:6790/0 conn(0x7fcd8008cb30 legacy=0x7fcd801a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 1 -- 10.20.193.57:0/3060487713 shutdown_connections 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 1 -- 10.20.193.57:0/3060487713 >> 10.20.193.57:0/3060487713 conn(0x7fcd80091620 msgr2=0x7fcd80091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 1 -- 10.20.193.57:0/3060487713 shutdown_connections 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.281+0000 7fcd87052640 1 -- 10.20.193.57:0/3060487713 wait complete. 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient: build_initial_monmap 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient: monmap: 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:23.285 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 1 Processor -- start 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 1 -- start start 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient: init 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:23.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient(hunting): picked mon.noname-c con 0x7fcd8008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient(hunting): picked mon.noname-b con 0x7fcd8008c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient(hunting): picked mon.noname-a con 0x7fcd8008cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8008d9c0 con 0x7fcd8008cb30 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd80086a90 con 0x7fcd8008c730 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd80083ae0 con 0x7fcd8008ae20 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd87052640 10 monclient(hunting): authenticate will time out at 1723.101905s 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd855c8640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fcd8008cb30 0x7fcd80195d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39196/0 (socket says 10.20.193.57:39196) 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd855c8640 1 -- 10.20.193.57:0/275861903 learned_addr learned my addr 10.20.193.57:0/275861903 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:23.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.282+0000 7fcd84dc7640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fcd8008ae20 0x7fcd80082cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54492/0 (socket says 10.20.193.57:54492) 2026-02-12T17:47:23.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd855c8640 1 -- 10.20.193.57:0/275861903 >> v1:10.20.193.57:6789/0 conn(0x7fcd8008cb30 legacy=0x7fcd80195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:23.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd84dc7640 1 -- 10.20.193.57:0/275861903 >> v1:10.20.193.57:6790/0 conn(0x7fcd8008ae20 legacy=0x7fcd80082cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:23.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd84dc7640 1 -- 10.20.193.57:0/275861903 >> v1:10.20.193.57:6790/0 conn(0x7fcd8008ae20 legacy=0x7fcd80082cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd84dc7640 1 -- 10.20.193.57:0/275861903 >> v1:10.20.193.57:6790/0 conn(0x7fcd8008ae20 legacy=0x7fcd80082cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd84dc7640 1 --1- 10.20.193.57:0/275861903 >> v1:10.20.193.57:6790/0 conn(0x7fcd8008ae20 0x7fcd80082cc0 :-1 s=OPENED pgs=343 gs=1 cs=1 l=1).handle_message read tag failed 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd84dc7640 1 --1- 10.20.193.57:0/275861903 >> v1:10.20.193.57:6790/0 conn(0x7fcd8008ae20 0x7fcd80082cc0 :-1 s=OPENED pgs=343 gs=1 cs=1 l=1).fault on lossy channel, failing 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.57:6790/0 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd77fff640 1 -- 10.20.193.57:0/275861903 >> v1:10.20.193.82:6789/0 conn(0x7fcd8008c730 legacy=0x7fcd800833d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2728081876 0 0) 0x7fcd80086a90 con 0x7fcd8008c730 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient(hunting): my global_id is 5299 2026-02-12T17:47:23.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd500035e0 con 0x7fcd8008c730 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3680669292 0 0) 0x7fcd500035e0 con 0x7fcd8008c730 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd80086a90 con 0x7fcd8008c730 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fcd68003340 con 0x7fcd8008c730 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient(hunting): dump: 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:23.293 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3950958956 0 0) 0x7fcd80086a90 con 0x7fcd8008c730 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 >> v1:10.20.193.57:6790/0 conn(0x7fcd8008ae20 legacy=0x7fcd80082cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 >> v1:10.20.193.57:6789/0 conn(0x7fcd8008cb30 legacy=0x7fcd80195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient: _finish_hunting 0 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 monclient: found mon.b 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:23.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 --> v1:10.20.193.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8005d310 con 0x7fcd8008c730 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient: _finish_auth 0 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 10 monclient: _check_auth_tickets 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd87052640 5 monclient: authenticate success, global_id 5299 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd87052640 10 monclient: _renew_subs 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd87052640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 --> v1:10.20.193.82:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8005ab90 con 0x7fcd8008c730 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd87052640 10 monclient: _renew_subs 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd87052640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.285+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 --> v1:10.20.193.82:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcd800867b0 con 0x7fcd8008c730 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd68003980 con 0x7fcd8008c730 2026-02-12T17:47:23.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd757fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fcd68003ca0 con 0x7fcd8008c730 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd757fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd757fa640 10 monclient: dump: 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:23.296 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd76ffd640 4 set_mon_vals no callback set 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd87052640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fcd68003f30 con 0x7fcd8008c730 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd87052640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd87052640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.286+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd80086430 con 0x7fcd8008c730 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.287+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fcd6804eb10 con 0x7fcd8008c730 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.287+0000 7fcd84dc7640 10 monclient: get_auth_request con 0x7fcd5003f640 auth_method 0 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.289+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fcd680173a0 con 0x7fcd8008c730 2026-02-12T17:47:23.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.289+0000 7fcd757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:23.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.289+0000 7fcd757fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:23.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.434+0000 7fcd87052640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:47:23.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.434+0000 7fcd87052640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.434+0000 7fcd87052640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.82:6789/0 2026-02-12T17:47:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.434+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 --> v1:10.20.193.82:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcd8005bb20 con 0x7fcd8008c730 2026-02-12T17:47:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.434+0000 7fcd757fa640 1 -- 10.20.193.57:0/275861903 <== mon.1 v1:10.20.193.82:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1595 (unknown 254746657 0 3191372686) 0x7fcd68016b50 con 0x7fcd8008c730 2026-02-12T17:47:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.434+0000 7fcd757fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:23.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.434+0000 7fcd757fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:23.432 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":72,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:47:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.436+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 >> v1:10.20.193.82:6800/2441377515 conn(0x7fcd5003f640 legacy=0x7fcd5005faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:23.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.436+0000 7fcd87052640 10 monclient: shutdown 2026-02-12T17:47:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.436+0000 7fcd87052640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.436+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 >> v1:10.20.193.82:6789/0 conn(0x7fcd8008c730 legacy=0x7fcd800833d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.436+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 shutdown_connections 2026-02-12T17:47:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.436+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 >> 10.20.193.57:0/275861903 conn(0x7fcd80091620 msgr2=0x7fcd800597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.436+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 shutdown_connections 2026-02-12T17:47:23.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:23.436+0000 7fcd87052640 1 -- 10.20.193.57:0/275861903 wait complete. 2026-02-12T17:47:26.441 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:47:26.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.510+0000 7fea2619d640 10 monclient: get_monmap_and_config 2026-02-12T17:47:26.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.510+0000 7fea2619d640 10 monclient: build_initial_monmap 2026-02-12T17:47:26.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.510+0000 7fea2619d640 10 monclient: monmap: 2026-02-12T17:47:26.507 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:26.507 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.507 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:26.511468+0000 2026-02-12T17:47:26.508 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:26.511468+0000 2026-02-12T17:47:26.508 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:26.508 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.508 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:26.508 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:26.508 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:26.508 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 1 Processor -- start 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 1 -- start start 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 10 monclient: init 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 10 monclient(hunting): picked mon.noname-b con 0x7fea2008ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 10 monclient(hunting): picked mon.noname-a con 0x7fea2008c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 10 monclient(hunting): picked mon.noname-c con 0x7fea2008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2008d600 con 0x7fea2008c730 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2008b1f0 con 0x7fea2008cb30 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2008d1f0 con 0x7fea2008ae20 2026-02-12T17:47:26.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:26.511 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea2619d640 10 monclient(hunting): authenticate will time out at 1726.330367s 2026-02-12T17:47:26.511 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea1f7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fea2008ae20 0x7fea2008c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54506/0 (socket says 10.20.193.57:54506) 2026-02-12T17:47:26.511 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.511+0000 7fea1f7fe640 1 -- 10.20.193.57:0/405595644 learned_addr learned my addr 10.20.193.57:0/405595644 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:26.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1f7fe640 1 -- 10.20.193.57:0/405595644 >> v1:10.20.193.57:6790/0 conn(0x7fea2008ae20 legacy=0x7fea2008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1effd640 1 -- 10.20.193.57:0/405595644 >> v1:10.20.193.57:6789/0 conn(0x7fea2008c730 legacy=0x7fea20181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293494092 0 0) 0x7fea2008d1f0 con 0x7fea2008ae20 2026-02-12T17:47:26.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 10 monclient(hunting): my global_id is 114209 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea040035e0 con 0x7fea2008ae20 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278209563 0 0) 0x7fea2008d600 con 0x7fea2008c730 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 10 monclient(hunting): my global_id is 124116 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea2008d1f0 con 0x7fea2008c730 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1ffff640 1 -- 10.20.193.57:0/405595644 >> v1:10.20.193.82:6789/0 conn(0x7fea2008cb30 legacy=0x7fea201a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2385234192 0 0) 0x7fea2008d1f0 con 0x7fea2008c730 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.513+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 >> v1:10.20.193.57:6790/0 conn(0x7fea2008ae20 legacy=0x7fea2008c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 >> v1:10.20.193.82:6789/0 conn(0x7fea2008cb30 legacy=0x7fea201a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 1 monclient: found mon.noname-a 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea20057320 con 0x7fea2008c730 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fea100031a0 con 0x7fea2008c730 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 5 monclient: authenticate success, global_id 124116 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: dump: 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea10003370 con 0x7fea2008c730 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 1 -- 10.20.193.57:0/405595644 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fea10003880 con 0x7fea2008c730 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 4 set_mon_vals no callback set 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea1e7fc640 10 monclient: dump: 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.523 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 10 monclient: shutdown 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 1 -- 10.20.193.57:0/405595644 >> v1:10.20.193.57:6789/0 conn(0x7fea2008c730 legacy=0x7fea20181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 1 -- 10.20.193.57:0/405595644 shutdown_connections 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 1 -- 10.20.193.57:0/405595644 >> 10.20.193.57:0/405595644 conn(0x7fea20091620 msgr2=0x7fea20091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 1 -- 10.20.193.57:0/405595644 shutdown_connections 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 1 -- 10.20.193.57:0/405595644 wait complete. 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 10 monclient: build_initial_monmap 2026-02-12T17:47:26.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.514+0000 7fea2619d640 10 monclient: monmap: 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 1 Processor -- start 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 1 -- start start 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 10 monclient: init 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:26.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 10 monclient(hunting): picked mon.noname-a con 0x7fea2008ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 10 monclient(hunting): picked mon.noname-c con 0x7fea2008c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 10 monclient(hunting): picked mon.noname-b con 0x7fea2008cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2008d9c0 con 0x7fea2008ae20 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2011cbd0 con 0x7fea2008cb30 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2011a870 con 0x7fea2008c730 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea2619d640 10 monclient(hunting): authenticate will time out at 1726.334374s 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea1f7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fea2008ae20 0x7fea20118e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39210/0 (socket says 10.20.193.57:39210) 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea1effd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fea2008c730 0x7fea20119550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54512/0 (socket says 10.20.193.57:54512) 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.515+0000 7fea1f7fe640 1 -- 10.20.193.57:0/4220631158 learned_addr learned my addr 10.20.193.57:0/4220631158 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fea1effd640 1 -- 10.20.193.57:0/4220631158 >> v1:10.20.193.57:6790/0 conn(0x7fea2008c730 legacy=0x7fea20119550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fea1f7fe640 1 -- 10.20.193.57:0/4220631158 >> v1:10.20.193.57:6789/0 conn(0x7fea2008ae20 legacy=0x7fea20118e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fea1effd640 1 --1- 10.20.193.57:0/4220631158 >> v1:10.20.193.57:6790/0 conn(0x7fea2008c730 0x7fea20119550 :-1 s=OPENED pgs=347 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fea2011a870 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964658714 0 0) 0x7fea2008d9c0 con 0x7fea2008ae20 2026-02-12T17:47:26.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): my global_id is 124119 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9f00035e0 con 0x7fea2008ae20 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fea1ffff640 1 -- 10.20.193.57:0/4220631158 >> v1:10.20.193.82:6789/0 conn(0x7fea2008cb30 legacy=0x7fea201a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1283110787 0 0) 0x7fe9f00035e0 con 0x7fea2008ae20 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea2008d9c0 con 0x7fea2008ae20 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fea0c0032d0 con 0x7fea2008ae20 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): dump: 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.527 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1735207678 0 0) 0x7fea2011cbd0 con 0x7fea2008cb30 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 10 monclient(hunting): my global_id is 5305 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.517+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9f00035e0 con 0x7fea2008cb30 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2594736824 0 0) 0x7fea2008d9c0 con 0x7fea2008ae20 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 >> v1:10.20.193.57:6790/0 conn(0x7fea2008c730 legacy=0x7fea20119550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 >> v1:10.20.193.82:6789/0 conn(0x7fea2008cb30 legacy=0x7fea201a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.528 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 monclient: found mon.a 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2011b200 con 0x7fea2008ae20 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 10 monclient: _finish_auth 0 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774353849 0 0) 0x7fea2011a870 con 0x7fea2008c730 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 5 monclient: authenticate success, global_id 124119 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 10 monclient: _renew_subs 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea2011c8f0 con 0x7fea2008ae20 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 10 monclient: _renew_subs 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:26.529 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fea2005cb70 con 0x7fea2008ae20 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea0c003520 con 0x7fea2008ae20 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fea0c004d00 con 0x7fea2008ae20 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 10 monclient: dump: 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.530 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea1dffb640 4 set_mon_vals no callback set 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea2005afb0 con 0x7fea2008ae20 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fea0c011a90 con 0x7fea2008ae20 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.518+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fea0c04ea10 con 0x7fea2008ae20 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.519+0000 7fea1effd640 10 monclient: get_auth_request con 0x7fe9f003f810 auth_method 0 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.521+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fea0c0172a0 con 0x7fea2008ae20 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.521+0000 7fe9fbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:26.531 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.521+0000 7fe9fbfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:26.659 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.663+0000 7fea2619d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:47:26.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.663+0000 7fea2619d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:26.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.663+0000 7fea2619d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:26.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.663+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fea2011c630 con 0x7fea2008ae20 2026-02-12T17:47:26.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.663+0000 7fe9fbfff640 1 -- 10.20.193.57:0/4220631158 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 227454120) 0x7fea0c016a50 con 0x7fea2008ae20 2026-02-12T17:47:26.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.663+0000 7fe9fbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:26.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.663+0000 7fe9fbfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:26.660 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":74,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:47:26.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.664+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe9f003f810 legacy=0x7fe9f005fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.664+0000 7fea2619d640 10 monclient: shutdown 2026-02-12T17:47:26.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.664+0000 7fea2619d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:26.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.664+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 >> v1:10.20.193.57:6789/0 conn(0x7fea2008ae20 legacy=0x7fea20118e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.664+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 shutdown_connections 2026-02-12T17:47:26.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.664+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 >> 10.20.193.57:0/4220631158 conn(0x7fea20091620 msgr2=0x7fea200597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:26.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.664+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 shutdown_connections 2026-02-12T17:47:26.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.664+0000 7fea2619d640 1 -- 10.20.193.57:0/4220631158 wait complete. 2026-02-12T17:47:26.668 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:47:26.668 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-12T17:47:26.668 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.736+0000 7f35b461b640 10 monclient: get_monmap_and_config 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.736+0000 7f35b461b640 10 monclient: build_initial_monmap 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.736+0000 7f35b461b640 10 monclient: monmap: 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:26.737619+0000 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:26.737619+0000 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 1 Processor -- start 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 1 -- start start 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 10 monclient: init 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:47:26.733 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 10 monclient(hunting): picked mon.noname-c con 0x7f35ac085720 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:26.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 10 monclient(hunting): picked mon.noname-a con 0x7f35ac086ea0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:26.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 10 monclient(hunting): picked mon.noname-b con 0x7f35ac086200 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:26.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac088220 con 0x7f35ac086ea0 2026-02-12T17:47:26.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac089500 con 0x7f35ac085720 2026-02-12T17:47:26.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac087f40 con 0x7f35ac086200 2026-02-12T17:47:26.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:26.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b461b640 10 monclient(hunting): authenticate will time out at 1726.556574s 2026-02-12T17:47:26.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b1b8f640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f35ac086ea0 0x7f35ac180a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39224/0 (socket says 10.20.193.57:39224) 2026-02-12T17:47:26.734 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.737+0000 7f35b1b8f640 1 -- 10.20.193.57:0/4178969660 learned_addr learned my addr 10.20.193.57:0/4178969660 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b1b8f640 1 -- 10.20.193.57:0/4178969660 >> v1:10.20.193.57:6789/0 conn(0x7f35ac086ea0 legacy=0x7f35ac180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b2b91640 1 -- 10.20.193.57:0/4178969660 >> v1:10.20.193.57:6790/0 conn(0x7f35ac086200 legacy=0x7f35ac1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b2390640 1 -- 10.20.193.57:0/4178969660 >> v1:10.20.193.82:6789/0 conn(0x7f35ac085720 legacy=0x7f35ac085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603425817 0 0) 0x7f35ac088220 con 0x7f35ac086ea0 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 10 monclient(hunting): my global_id is 124122 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35940035e0 con 0x7f35ac086ea0 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828524529 0 0) 0x7f35ac087f40 con 0x7f35ac086200 2026-02-12T17:47:26.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 10 monclient(hunting): my global_id is 114215 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.739+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ac088220 con 0x7f35ac086200 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970204108 0 0) 0x7f35ac089500 con 0x7f35ac085720 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient(hunting): my global_id is 5308 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ac087f40 con 0x7f35ac085720 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3767160083 0 0) 0x7f35940035e0 con 0x7f35ac086ea0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 >> v1:10.20.193.57:6790/0 conn(0x7f35ac086200 legacy=0x7f35ac1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 >> v1:10.20.193.82:6789/0 conn(0x7f35ac085720 legacy=0x7f35ac085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: _finish_hunting 0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 monclient: found mon.noname-a 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac0867e0 con 0x7f35ac086ea0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: _finish_auth 0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: _check_auth_tickets 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f35a0003150 con 0x7f35ac086ea0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: dump: 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 5 monclient: authenticate success, global_id 124122 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35a00033a0 con 0x7f35ac086ea0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 1 -- 10.20.193.57:0/4178969660 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f35a0004b10 con 0x7f35ac086ea0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b138e640 10 monclient: dump: 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.737 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 4 set_mon_vals no callback set 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 10 monclient: shutdown 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 1 -- 10.20.193.57:0/4178969660 >> v1:10.20.193.57:6789/0 conn(0x7f35ac086ea0 legacy=0x7f35ac180a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 1 -- 10.20.193.57:0/4178969660 shutdown_connections 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 1 -- 10.20.193.57:0/4178969660 >> 10.20.193.57:0/4178969660 conn(0x7f35ac0916b0 msgr2=0x7f35ac091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 1 -- 10.20.193.57:0/4178969660 shutdown_connections 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.740+0000 7f35b461b640 1 -- 10.20.193.57:0/4178969660 wait complete. 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient: build_initial_monmap 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient: monmap: 2026-02-12T17:47:26.738 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 1 Processor -- start 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 1 -- start start 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient: init 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient(hunting): picked mon.noname-c con 0x7f35ac085720 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient(hunting): picked mon.noname-b con 0x7f35ac086200 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient(hunting): picked mon.noname-a con 0x7f35ac086ea0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac13dcc0 con 0x7f35ac086ea0 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac0888a0 con 0x7f35ac086200 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ac08ae60 con 0x7f35ac085720 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b461b640 10 monclient(hunting): authenticate will time out at 1726.560682s 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b2390640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f35ac085720 0x7f35ac1d6b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54532/0 (socket says 10.20.193.57:54532) 2026-02-12T17:47:26.739 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.741+0000 7f35b2390640 1 -- 10.20.193.57:0/735998241 learned_addr learned my addr 10.20.193.57:0/735998241 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:26.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f35b2390640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6790/0 conn(0x7f35ac085720 legacy=0x7f35ac1d6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f35b2b91640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6789/0 conn(0x7f35ac086ea0 legacy=0x7f35ac23c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280670382 0 0) 0x7f35ac08ae60 con 0x7f35ac085720 2026-02-12T17:47:26.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.740 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 10 monclient(hunting): my global_id is 114218 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f357c0035e0 con 0x7f35ac085720 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985689554 0 0) 0x7f35ac13dcc0 con 0x7f35ac086ea0 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 10 monclient(hunting): my global_id is 124125 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ac08ae60 con 0x7f35ac086ea0 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.743+0000 7f35b1b8f640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.82:6789/0 conn(0x7f35ac086200 legacy=0x7f35ac21ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250718047 0 0) 0x7f35ac0888a0 con 0x7f35ac086200 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): my global_id is 5311 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ac13dcc0 con 0x7f35ac086200 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 19595551 0 0) 0x7f357c0035e0 con 0x7f35ac085720 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35ac0888a0 con 0x7f35ac085720 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f359c0033b0 con 0x7f35ac085720 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): dump: 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.741 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 504417569 0 0) 0x7f35ac08ae60 con 0x7f35ac086ea0 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f357c0035e0 con 0x7f35ac086ea0 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f35a8004490 con 0x7f35ac086ea0 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): dump: 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4007070778 0 0) 0x7f35ac13dcc0 con 0x7f35ac086200 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35ac08ae60 con 0x7f35ac086200 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f35a0002fa0 con 0x7f35ac086200 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient(hunting): dump: 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 878396945 0 0) 0x7f35ac0888a0 con 0x7f35ac085720 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.82:6789/0 conn(0x7f35ac086200 legacy=0x7f35ac21ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6789/0 conn(0x7f35ac086ea0 legacy=0x7f35ac23c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 monclient: found mon.c 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac13f1e0 con 0x7f35ac085720 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient: _finish_auth 0 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:26.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b461b640 5 monclient: authenticate success, global_id 114218 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b461b640 10 monclient: _renew_subs 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b461b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac13f4c0 con 0x7f35ac085720 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b461b640 10 monclient: _renew_subs 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b461b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f35ac1402e0 con 0x7f35ac085720 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f359c003980 con 0x7f35ac085720 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f359c003cd0 con 0x7f35ac085720 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f3592ffd640 10 monclient: dump: 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b0b8d640 4 set_mon_vals no callback set 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b461b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.744+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f35ac090810 con 0x7f35ac1d7260 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.745+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f359c003f60 con 0x7f35ac085720 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.745+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f359c04eb50 con 0x7f35ac085720 2026-02-12T17:47:26.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.745+0000 7f35b2b91640 10 monclient: get_auth_request con 0x7f357c03ffd0 auth_method 0 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f35b1b8f640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6789/0 conn(0x7f35ac1d7260 legacy=0x7f35ac05a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143759063 0 0) 0x7f35ac090810 con 0x7f35ac1d7260 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 10 monclient(hunting): my global_id is 124128 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ac0888a0 con 0x7f35ac1d7260 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 904340583 0 0) 0x7f35ac0888a0 con 0x7f35ac1d7260 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35ac090810 con 0x7f35ac1d7260 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f35a0002d70 con 0x7f35ac1d7260 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 10 monclient: dump: 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3812221538 0 0) 0x7f35ac090810 con 0x7f35ac1d7260 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35ac087300 con 0x7f35ac1d7260 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f35a0005310 con 0x7f35ac1d7260 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6789/0 conn(0x7f35ac1d7260 legacy=0x7f35ac05a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.747+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6789/0 conn(0x7f35ac1d7260 legacy=0x7f35ac05a6c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:47:26.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.751+0000 7f35b461b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:47:26.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.751+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f35ac08f590 con 0x7f35ac04d1c0 2026-02-12T17:47:26.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f35b1b8f640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6789/0 conn(0x7f35ac04d1c0 legacy=0x7f35ac25ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045885738 0 0) 0x7f35ac08f590 con 0x7f35ac04d1c0 2026-02-12T17:47:26.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 10 monclient(hunting): my global_id is 124131 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ac090810 con 0x7f35ac04d1c0 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4055529825 0 0) 0x7f35ac090810 con 0x7f35ac04d1c0 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35ac08f590 con 0x7f35ac04d1c0 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f35a0005930 con 0x7f35ac04d1c0 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 10 monclient: dump: 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4139072516 0 0) 0x7f35ac08f590 con 0x7f35ac04d1c0 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 --> v1:10.20.193.57:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f35ac055340 con 0x7f35ac04d1c0 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 <== mon.0 v1:10.20.193.57:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4337 (unknown 0 0 3389120323) 0x7f35a0007cf0 con 0x7f35ac04d1c0 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6789/0 conn(0x7f35ac04d1c0 legacy=0x7f35ac25ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.753+0000 7f3592ffd640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6789/0 conn(0x7f35ac04d1c0 legacy=0x7f35ac25ea90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 74, 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 29430, 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 0, 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:47:26.751 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:47:26.752 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:47:26.753 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.82:6800/2441377515 conn(0x7f357c03ffd0 legacy=0x7f357c060480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b461b640 10 monclient: shutdown 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b461b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 >> v1:10.20.193.57:6790/0 conn(0x7f35ac085720 legacy=0x7f35ac1d6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b2b91640 1 -- 10.20.193.57:0/735998241 reap_dead start 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b2b91640 1 -- 10.20.193.57:0/735998241 reap_dead start 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 shutdown_connections 2026-02-12T17:47:26.754 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 >> 10.20.193.57:0/735998241 conn(0x7f35ac0916b0 msgr2=0x7f35ac057e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:26.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 shutdown_connections 2026-02-12T17:47:26.755 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.754+0000 7f35b461b640 1 -- 10.20.193.57:0/735998241 wait complete. 2026-02-12T17:47:26.755 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:47:26.755 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-12T17:47:26.755 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T17:47:26.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient: get_monmap_and_config 2026-02-12T17:47:26.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient: build_initial_monmap 2026-02-12T17:47:26.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient: monmap: 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:26.823042+0000 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:26.823042+0000 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 1 Processor -- start 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 1 -- start start 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient: init 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f3ef008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f3ef008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f3ef0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef008a820 con 0x7f3ef0182cc0 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef0089450 con 0x7f3ef008c620 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef0089730 con 0x7f3ef008c250 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.822+0000 7f3ef4f0c640 10 monclient(hunting): authenticate will time out at 1726.641911s 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.823+0000 7f3eee575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3ef008c250 0x7f3ef008a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54538/0 (socket says 10.20.193.57:54538) 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.823+0000 7f3eee575640 1 -- 10.20.193.57:0/1831332327 learned_addr learned my addr 10.20.193.57:0/1831332327 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:26.820 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.823+0000 7f3eeed76640 1 --1- 10.20.193.57:0/1831332327 >> v1:10.20.193.57:6789/0 conn(0x7f3ef0182cc0 0x7f3ef01a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39256/0 (socket says 10.20.193.57:39256) 2026-02-12T17:47:26.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eeed76640 1 -- 10.20.193.57:0/1831332327 >> v1:10.20.193.57:6789/0 conn(0x7f3ef0182cc0 legacy=0x7f3ef01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eee575640 1 -- 10.20.193.57:0/1831332327 >> v1:10.20.193.57:6790/0 conn(0x7f3ef008c250 legacy=0x7f3ef008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eedd74640 1 -- 10.20.193.57:0/1831332327 >> v1:10.20.193.82:6789/0 conn(0x7f3ef008c620 legacy=0x7f3ef008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116205989 0 0) 0x7f3ef0089730 con 0x7f3ef008c250 2026-02-12T17:47:26.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): my global_id is 114221 2026-02-12T17:47:26.824 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3edc0035e0 con 0x7f3ef008c250 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2795970302 0 0) 0x7f3ee0003d00 con 0x7f3ef0182cc0 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): my global_id is 124134 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef0089730 con 0x7f3ef0182cc0 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159231884 0 0) 0x7f3ef0089450 con 0x7f3ef008c620 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient(hunting): my global_id is 5314 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ee0003d00 con 0x7f3ef008c620 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3213429068 0 0) 0x7f3edc0035e0 con 0x7f3ef008c250 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 >> v1:10.20.193.82:6789/0 conn(0x7f3ef008c620 legacy=0x7f3ef008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 >> v1:10.20.193.57:6789/0 conn(0x7f3ef0182cc0 legacy=0x7f3ef01a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: _finish_hunting 0 2026-02-12T17:47:26.825 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 monclient: found mon.noname-b 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef0089a10 con 0x7f3ef008c250 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: _finish_auth 0 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: _check_auth_tickets 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3ee40030d0 con 0x7f3ef008c250 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: dump: 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.826 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3ef4f0c640 5 monclient: authenticate success, global_id 114221 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3ef4f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ee4003360 con 0x7f3ef008c250 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 1 -- 10.20.193.57:0/1831332327 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3ee4004960 con 0x7f3ef008c250 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3eed573640 10 monclient: dump: 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.827 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3ef4f0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.825+0000 7f3ef4f0c640 4 set_mon_vals no callback set 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient: shutdown 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1831332327 >> v1:10.20.193.57:6790/0 conn(0x7f3ef008c250 legacy=0x7f3ef008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1831332327 shutdown_connections 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1831332327 >> 10.20.193.57:0/1831332327 conn(0x7f3ef00916b0 msgr2=0x7f3ef0091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1831332327 shutdown_connections 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1831332327 wait complete. 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient: build_initial_monmap 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient: monmap: 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:26.828 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 Processor -- start 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 -- start start 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient: init 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient(hunting): picked mon.noname-c con 0x7f3ef008c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f3ef008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f3ef0182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:26.829 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef013a450 con 0x7f3ef0182cc0 2026-02-12T17:47:26.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef018ffe0 con 0x7f3ef008c620 2026-02-12T17:47:26.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef0138b50 con 0x7f3ef008c250 2026-02-12T17:47:26.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:26.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3ef4f0c640 10 monclient(hunting): authenticate will time out at 1726.645899s 2026-02-12T17:47:26.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3eee575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3ef008c250 0x7f3ef018f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54552/0 (socket says 10.20.193.57:54552) 2026-02-12T17:47:26.830 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.826+0000 7f3eee575640 1 -- 10.20.193.57:0/1026076930 learned_addr learned my addr 10.20.193.57:0/1026076930 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:26.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3eeed76640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6789/0 conn(0x7f3ef0182cc0 legacy=0x7f3ef0195550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3eee575640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6790/0 conn(0x7f3ef008c250 legacy=0x7f3ef018f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.833 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255367517 0 0) 0x7f3ef0138b50 con 0x7f3ef008c250 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): my global_id is 114224 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ebc0035e0 con 0x7f3ef008c250 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684409650 0 0) 0x7f3ef013a450 con 0x7f3ef0182cc0 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): my global_id is 124137 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef0138b50 con 0x7f3ef0182cc0 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3eedd74640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.82:6789/0 conn(0x7f3ef008c620 legacy=0x7f3ef018f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4166711606 0 0) 0x7f3ebc0035e0 con 0x7f3ef008c250 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ef013a450 con 0x7f3ef008c250 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3ee40048a0 con 0x7f3ef008c250 2026-02-12T17:47:26.834 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): dump: 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3306510962 0 0) 0x7f3ef0138b50 con 0x7f3ef0182cc0 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ebc0035e0 con 0x7f3ef0182cc0 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3ee0003fc0 con 0x7f3ef0182cc0 2026-02-12T17:47:26.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient(hunting): dump: 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1695372334 0 0) 0x7f3ef013a450 con 0x7f3ef008c250 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.82:6789/0 conn(0x7f3ef008c620 legacy=0x7f3ef018f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6789/0 conn(0x7f3ef0182cc0 legacy=0x7f3ef0195550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:47:26.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 monclient: found mon.c 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef013a730 con 0x7f3ef008c250 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient: _finish_auth 0 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ef4f0c640 5 monclient: authenticate success, global_id 114224 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ef4f0c640 10 monclient: _renew_subs 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ef4f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef013e990 con 0x7f3ef008c250 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ef4f0c640 10 monclient: _renew_subs 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ef4f0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ef013a170 con 0x7f3ef008c250 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ee4004db0 con 0x7f3ef008c250 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3ee4005100 con 0x7f3ef008c250 2026-02-12T17:47:26.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ed6ffd640 10 monclient: dump: 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3eecd72640 4 set_mon_vals no callback set 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.829+0000 7f3ef4f0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.830+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3ef0090810 con 0x7f3ef013e4e0 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.830+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3ee4005310 con 0x7f3ef008c250 2026-02-12T17:47:26.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.830+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f3ee404eb10 con 0x7f3ef008c250 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.830+0000 7f3eeed76640 10 monclient: get_auth_request con 0x7f3ebc03fb30 auth_method 0 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3eedd74640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6790/0 conn(0x7f3ef013e4e0 legacy=0x7f3ef0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705177163 0 0) 0x7f3ef0090810 con 0x7f3ef013e4e0 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 10 monclient(hunting): my global_id is 114227 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef013a450 con 0x7f3ef013e4e0 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 305441087 0 0) 0x7f3ef013a450 con 0x7f3ef013e4e0 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ef0090810 con 0x7f3ef013e4e0 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3ed8003250 con 0x7f3ef013e4e0 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 10 monclient: dump: 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.839 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4227293959 0 0) 0x7f3ef0090810 con 0x7f3ef013e4e0 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.832+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ef008f5b0 con 0x7f3ef013e4e0 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.833+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f3ed8005880 con 0x7f3ef013e4e0 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.833+0000 7f3ed6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.833+0000 7f3ed6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.833+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6790/0 conn(0x7f3ef013e4e0 legacy=0x7f3ef0085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.833+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6790/0 conn(0x7f3ef013e4e0 legacy=0x7f3ef0085720 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.836+0000 7f3ef4f0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:47:26.840 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.836+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3ef0190e40 con 0x7f3ef0190a70 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.838+0000 7f3eedd74640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6790/0 conn(0x7f3ef0190a70 legacy=0x7f3ef0085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.838+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071196728 0 0) 0x7f3ef0190e40 con 0x7f3ef0190a70 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.838+0000 7f3ed6ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.838+0000 7f3ed6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.838+0000 7f3ed6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.838+0000 7f3ed6ffd640 10 monclient(hunting): my global_id is 114230 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.838+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef0090810 con 0x7f3ef0190a70 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4277685041 0 0) 0x7f3ef0090810 con 0x7f3ef0190a70 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ef0190e40 con 0x7f3ef0190a70 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3ed8003bf0 con 0x7f3ef0190a70 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 10 monclient: dump: 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.842 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2007123444 0 0) 0x7f3ef0190e40 con 0x7f3ef0190a70 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 --> v1:10.20.193.57:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3ef0086540 con 0x7f3ef0190a70 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 <== mon.2 v1:10.20.193.57:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4505 (unknown 0 0 3581053855) 0x7f3ed8005ac0 con 0x7f3ef0190a70 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6790/0 conn(0x7f3ef0190a70 legacy=0x7f3ef0085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.843 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ed6ffd640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6790/0 conn(0x7f3ef0190a70 legacy=0x7f3ef0085e30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: "state": "peon", 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 74, 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 142222, 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 1, 2026-02-12T17:47:26.844 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:47:26.845 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:47:26.846 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:47:26.847 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:47:26.848 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:47:26.849 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.850 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:47:26.851 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: "num": 2 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:47:26.852 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.82:6800/2441377515 conn(0x7f3ebc03fb30 legacy=0x7f3ebc05ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ef4f0c640 10 monclient: shutdown 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ef4f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 >> v1:10.20.193.57:6790/0 conn(0x7f3ef008c250 legacy=0x7f3ef018f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3eeed76640 1 -- 10.20.193.57:0/1026076930 reap_dead start 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3eeed76640 1 -- 10.20.193.57:0/1026076930 reap_dead start 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 shutdown_connections 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 >> 10.20.193.57:0/1026076930 conn(0x7f3ef00916b0 msgr2=0x7f3ef01911e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 shutdown_connections 2026-02-12T17:47:26.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.839+0000 7f3ef4f0c640 1 -- 10.20.193.57:0/1026076930 wait complete. 2026-02-12T17:47:26.854 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:47:26.854 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-12T17:47:26.854 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T17:47:26.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.922+0000 7f1e1fb0c640 10 monclient: get_monmap_and_config 2026-02-12T17:47:26.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.922+0000 7f1e1fb0c640 10 monclient: build_initial_monmap 2026-02-12T17:47:26.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.922+0000 7f1e1fb0c640 10 monclient: monmap: 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:26.923771+0000 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:26.923771+0000 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:26.920 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 1 Processor -- start 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 1 -- start start 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 10 monclient: init 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 10 monclient(hunting): picked mon.noname-b con 0x7f1e1808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 10 monclient(hunting): picked mon.noname-a con 0x7f1e1808c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 10 monclient(hunting): picked mon.noname-c con 0x7f1e18182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e1808a820 con 0x7f1e1808c620 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e18089450 con 0x7f1e18182cc0 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e18089730 con 0x7f1e1808c250 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1fb0c640 10 monclient(hunting): authenticate will time out at 1726.742638s 2026-02-12T17:47:26.922 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1d881640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f1e1808c250 0x7f1e1808a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54578/0 (socket says 10.20.193.57:54578) 2026-02-12T17:47:26.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1d881640 1 -- 10.20.193.57:0/999027772 learned_addr learned my addr 10.20.193.57:0/999027772 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:26.923 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.923+0000 7f1e1d080640 1 --1- 10.20.193.57:0/999027772 >> v1:10.20.193.57:6789/0 conn(0x7f1e1808c620 0x7f1e1808caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39264/0 (socket says 10.20.193.57:39264) 2026-02-12T17:47:26.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.925+0000 7f1e1d080640 1 -- 10.20.193.57:0/999027772 >> v1:10.20.193.57:6789/0 conn(0x7f1e1808c620 legacy=0x7f1e1808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.925+0000 7f1e1d881640 1 -- 10.20.193.57:0/999027772 >> v1:10.20.193.57:6790/0 conn(0x7f1e1808c250 legacy=0x7f1e1808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4267259358 0 0) 0x7f1e0c002c20 con 0x7f1e1808c620 2026-02-12T17:47:26.925 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): my global_id is 124140 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1e082640 1 -- 10.20.193.57:0/999027772 >> v1:10.20.193.82:6789/0 conn(0x7f1e18182cc0 legacy=0x7f1e181a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e000035e0 con 0x7f1e1808c620 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423714201 0 0) 0x7f1e18089730 con 0x7f1e1808c250 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): my global_id is 114233 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e0c002c20 con 0x7f1e1808c250 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392960772 0 0) 0x7f1e18089450 con 0x7f1e18182cc0 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient(hunting): my global_id is 5320 2026-02-12T17:47:26.926 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e18089730 con 0x7f1e18182cc0 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2378488221 0 0) 0x7f1e000035e0 con 0x7f1e1808c620 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 >> v1:10.20.193.57:6790/0 conn(0x7f1e1808c250 legacy=0x7f1e1808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 >> v1:10.20.193.82:6789/0 conn(0x7f1e18182cc0 legacy=0x7f1e181a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: _finish_hunting 0 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 monclient: found mon.noname-a 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e18089a10 con 0x7f1e1808c620 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: _finish_auth 0 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: _check_auth_tickets 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e0c003260 con 0x7f1e1808c620 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: dump: 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.927 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 5 monclient: authenticate success, global_id 124140 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e0c0034f0 con 0x7f1e1808c620 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 1 -- 10.20.193.57:0/999027772 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e0c004a50 con 0x7f1e1808c620 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1c87f640 10 monclient: dump: 2026-02-12T17:47:26.928 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 4 set_mon_vals no callback set 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 10 monclient: shutdown 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/999027772 >> v1:10.20.193.57:6789/0 conn(0x7f1e1808c620 legacy=0x7f1e1808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/999027772 shutdown_connections 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/999027772 >> 10.20.193.57:0/999027772 conn(0x7f1e180916b0 msgr2=0x7f1e18091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/999027772 shutdown_connections 2026-02-12T17:47:26.929 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.926+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/999027772 wait complete. 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient: build_initial_monmap 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient: monmap: 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 1 Processor -- start 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 1 -- start start 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient: init 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:26.930 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient(hunting): picked mon.noname-c con 0x7f1e1808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient(hunting): picked mon.noname-b con 0x7f1e1808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient(hunting): picked mon.noname-a con 0x7f1e18182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e1813ab90 con 0x7f1e18182cc0 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e18182ad0 con 0x7f1e1808c620 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e1813ecc0 con 0x7f1e1808c250 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1fb0c640 10 monclient(hunting): authenticate will time out at 1726.746503s 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1d881640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f1e1808c250 0x7f1e1813e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54582/0 (socket says 10.20.193.57:54582) 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1e082640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f1e18182cc0 0x7f1e181823c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39272/0 (socket says 10.20.193.57:39272) 2026-02-12T17:47:26.931 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.927+0000 7f1e1d881640 1 -- 10.20.193.57:0/546768543 learned_addr learned my addr 10.20.193.57:0/546768543 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e1d881640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.57:6790/0 conn(0x7f1e1808c250 legacy=0x7f1e1813e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e1e082640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.57:6789/0 conn(0x7f1e18182cc0 legacy=0x7f1e181823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937851066 0 0) 0x7f1e1813ecc0 con 0x7f1e1808c250 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 10 monclient(hunting): my global_id is 114236 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1de80035e0 con 0x7f1e1808c250 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010509215 0 0) 0x7f1e1813ab90 con 0x7f1e18182cc0 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.935 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 10 monclient(hunting): my global_id is 124143 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e1813ecc0 con 0x7f1e18182cc0 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e1d080640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.82:6789/0 conn(0x7f1e1808c620 legacy=0x7f1e18181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 653363761 0 0) 0x7f1de80035e0 con 0x7f1e1808c250 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e1813ab90 con 0x7f1e1808c250 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e08002f00 con 0x7f1e1808c250 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.929+0000 7f1e067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): dump: 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.936 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 651428424 0 0) 0x7f1e1813ecc0 con 0x7f1e18182cc0 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1de80035e0 con 0x7f1e18182cc0 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e14004460 con 0x7f1e18182cc0 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): dump: 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.937 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851842727 0 0) 0x7f1e18182ad0 con 0x7f1e1808c620 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient(hunting): my global_id is 5323 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e1813ecc0 con 0x7f1e1808c620 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3390135587 0 0) 0x7f1e1813ab90 con 0x7f1e1808c250 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.82:6789/0 conn(0x7f1e1808c620 legacy=0x7f1e18181cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.57:6789/0 conn(0x7f1e18182cc0 legacy=0x7f1e181823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 monclient: found mon.c 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e180888a0 con 0x7f1e1808c250 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:26.938 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e1fb0c640 5 monclient: authenticate success, global_id 114236 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e1fb0c640 10 monclient: _renew_subs 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e1fb0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1e18138830 con 0x7f1e1808c250 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e1fb0c640 10 monclient: _renew_subs 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e1fb0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1e181965d0 con 0x7f1e1808c250 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e08004bc0 con 0x7f1e1808c250 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e08004ee0 con 0x7f1e1808c250 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e07fff640 4 set_mon_vals no callback set 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 10 monclient: dump: 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.939 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e1fb0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e18090810 con 0x7f1e18085720 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f1e08005170 con 0x7f1e1808c250 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.930+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f1e0804ea40 con 0x7f1e1808c250 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.931+0000 7f1e1e082640 10 monclient: get_auth_request con 0x7f1de803fd10 auth_method 0 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.932+0000 7f1e1d080640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.82:6789/0 conn(0x7f1e18085720 legacy=0x7f1e18085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029476767 0 0) 0x7f1e18090810 con 0x7f1e18085720 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.940 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 10 monclient(hunting): my global_id is 5326 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e1813ab90 con 0x7f1e18085720 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1907558939 0 0) 0x7f1e1813ab90 con 0x7f1e18085720 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e18090810 con 0x7f1e18085720 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e0c002cc0 con 0x7f1e18085720 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 10 monclient: dump: 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.941 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3536778720 0 0) 0x7f1e18090810 con 0x7f1e18085720 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.82:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e1813a2f0 con 0x7f1e18085720 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (unknown 0 0 870318384) 0x7f1e0c0032f0 con 0x7f1e18085720 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.82:6789/0 conn(0x7f1e18085720 legacy=0x7f1e18085af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.933+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.82:6789/0 conn(0x7f1e18085720 legacy=0x7f1e18085af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.936+0000 7f1e1fb0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T17:47:26.942 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.937+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1e1808f5b0 con 0x7f1e18086200 2026-02-12T17:47:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.939+0000 7f1e1d080640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.82:6789/0 conn(0x7f1e18086200 legacy=0x7f1e181978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.939+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576949412 0 0) 0x7f1e1808f5b0 con 0x7f1e18086200 2026-02-12T17:47:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.939+0000 7f1e067fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.939+0000 7f1e067fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:26.943 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.939+0000 7f1e067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.939+0000 7f1e067fc640 10 monclient(hunting): my global_id is 5329 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.939+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e18090810 con 0x7f1e18086200 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 32365682 0 0) 0x7f1e18090810 con 0x7f1e18086200 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e1808f5b0 con 0x7f1e18086200 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f1e0c0053a0 con 0x7f1e18086200 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 10 monclient: dump: 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:26.944 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 508041867 0 0) 0x7f1e1808f5b0 con 0x7f1e18086200 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 --> v1:10.20.193.82:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1e1813d830 con 0x7f1e18086200 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 <== mon.1 v1:10.20.193.82:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4675 (unknown 0 0 2248561011) 0x7f1e0c0076a0 con 0x7f1e18086200 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.82:6789/0 conn(0x7f1e18086200 legacy=0x7f1e181978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e067fc640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.82:6789/0 conn(0x7f1e18086200 legacy=0x7f1e181978e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:47:26.945 INFO:teuthology.orchestra.run.trial057.stdout: "state": "leader", 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "election_epoch": 74, 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "uptime": 1168435, 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "quorum": [ 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: 0, 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: 1, 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: 2 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_age": 1, 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "required_con": "2453899407728394244", 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "required_mon": [ 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:47:26.946 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_con": "4544132024016699391", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "quorum_mon": [ 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:47:26.947 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "outside_quorum": [], 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "extra_probe_peers": [], 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "sync_provider": [], 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "monmap": { 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "epoch": 1, 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "fsid": "2c564c25-fc44-46b7-9900-7876a1cecb3c", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "modified": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "created": "2026-02-12T17:27:47.387807Z", 2026-02-12T17:47:26.948 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release": 20, 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "min_mon_release_name": "tentacle", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "election_strategy": 3, 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "disallowed_leaders": "", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false, 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "tiebreaker_mon": "", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "removed_ranks": "", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "features": { 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "persistent": [ 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "kraken", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "luminous", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "mimic", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "osdmap-prune", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "nautilus", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "octopus", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "pacific", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "elector-pinging", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "quincy", 2026-02-12T17:47:26.949 INFO:teuthology.orchestra.run.trial057.stdout: "reef", 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "squid", 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "tentacle", 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "nvmeof_beacon_diff" 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "optional": [] 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "mons": [ 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 0, 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "name": "a", 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789", 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.950 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6789/0", 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6789/0", 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387857+0000", 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 1, 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "name": "b", 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789", 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.951 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.82:6789/0", 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.82:6789/0", 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387858+0000", 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "rank": 2, 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "name": "c", 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "public_addrs": { 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "addrvec": [ 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "type": "v1", 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790", 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "nonce": 0 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "addr": "10.20.193.57:6790/0", 2026-02-12T17:47:26.952 INFO:teuthology.orchestra.run.trial057.stdout: "public_addr": "10.20.193.57:6790/0", 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "priority": 0, 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "weight": 0, 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "time_added": "2026-02-12T17:27:47:387859+0000", 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "crush_location": [] 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "feature_map": { 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "mon": [ 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "osd": [ 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: "num": 3 2026-02-12T17:47:26.953 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: "client": [ 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: "num": 5 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: ], 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: "mgr": [ 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: { 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: "release": "squid", 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: "num": 1 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: } 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: ] 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: }, 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout: "stretch_mode": false 2026-02-12T17:47:26.954 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:47:26.955 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.82:6800/2441377515 conn(0x7f1de803fd10 legacy=0x7f1de80601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.955 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1fb0c640 10 monclient: shutdown 2026-02-12T17:47:26.955 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1fb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:26.955 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 >> v1:10.20.193.57:6790/0 conn(0x7f1e1808c250 legacy=0x7f1e1813e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:26.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1e082640 1 -- 10.20.193.57:0/546768543 reap_dead start 2026-02-12T17:47:26.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1e082640 1 -- 10.20.193.57:0/546768543 reap_dead start 2026-02-12T17:47:26.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 shutdown_connections 2026-02-12T17:47:26.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 >> 10.20.193.57:0/546768543 conn(0x7f1e180916b0 msgr2=0x7f1e18191250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:26.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 shutdown_connections 2026-02-12T17:47:26.956 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:26.940+0000 7f1e1fb0c640 1 -- 10.20.193.57:0/546768543 wait complete. 2026-02-12T17:47:26.956 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-12T17:47:26.956 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T17:47:26.956 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T17:47:27.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.023+0000 7fd2f9e5b640 10 monclient: get_monmap_and_config 2026-02-12T17:47:27.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.023+0000 7fd2f9e5b640 10 monclient: build_initial_monmap 2026-02-12T17:47:27.020 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.023+0000 7fd2f9e5b640 10 monclient: monmap: 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:27.024808+0000 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:27.024808+0000 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:27.021 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:27.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 1 Processor -- start 2026-02-12T17:47:27.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 1 -- start start 2026-02-12T17:47:27.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 10 monclient: init 2026-02-12T17:47:27.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:27.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:47:27.022 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 10 monclient(hunting): picked mon.noname-a con 0x7fd2f408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:27.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 10 monclient(hunting): picked mon.noname-c con 0x7fd2f408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:27.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 10 monclient(hunting): picked mon.noname-b con 0x7fd2f408cb30 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:27.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f408d600 con 0x7fd2f408ae20 2026-02-12T17:47:27.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f408b1f0 con 0x7fd2f408c730 2026-02-12T17:47:27.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f408d1f0 con 0x7fd2f408cb30 2026-02-12T17:47:27.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:27.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f9e5b640 10 monclient(hunting): authenticate will time out at 1726.843665s 2026-02-12T17:47:27.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f37fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fd2f408ae20 0x7fd2f408c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39286/0 (socket says 10.20.193.57:39286) 2026-02-12T17:47:27.023 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.024+0000 7fd2f37fe640 1 -- 10.20.193.57:0/996251240 learned_addr learned my addr 10.20.193.57:0/996251240 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:27.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.026+0000 7fd2f37fe640 1 -- 10.20.193.57:0/996251240 >> v1:10.20.193.57:6789/0 conn(0x7fd2f408ae20 legacy=0x7fd2f408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:27.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.026+0000 7fd2f3fff640 1 -- 10.20.193.57:0/996251240 >> v1:10.20.193.57:6790/0 conn(0x7fd2f408cb30 legacy=0x7fd2f41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:27.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839534414 0 0) 0x7fd2f408d1f0 con 0x7fd2f408cb30 2026-02-12T17:47:27.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:27.026 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient(hunting): my global_id is 114239 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2d80035e0 con 0x7fd2f408cb30 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499385299 0 0) 0x7fd2f408d600 con 0x7fd2f408ae20 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient(hunting): my global_id is 124146 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f408d1f0 con 0x7fd2f408ae20 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f2ffd640 1 -- 10.20.193.57:0/996251240 >> v1:10.20.193.82:6789/0 conn(0x7fd2f408c730 legacy=0x7fd2f4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1429142847 0 0) 0x7fd2d80035e0 con 0x7fd2f408cb30 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 >> v1:10.20.193.82:6789/0 conn(0x7fd2f408c730 legacy=0x7fd2f4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 >> v1:10.20.193.57:6789/0 conn(0x7fd2f408ae20 legacy=0x7fd2f408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:27.027 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 monclient: found mon.noname-b 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f4057320 con 0x7fd2f408cb30 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2e8004120 con 0x7fd2f408cb30 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 5 monclient: authenticate success, global_id 114239 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: dump: 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:27.028 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2e80043b0 con 0x7fd2f408cb30 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 1 -- 10.20.193.57:0/996251240 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2e80047b0 con 0x7fd2f408cb30 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f27fc640 10 monclient: dump: 2026-02-12T17:47:27.029 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 4 set_mon_vals no callback set 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 10 monclient: shutdown 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/996251240 >> v1:10.20.193.57:6790/0 conn(0x7fd2f408cb30 legacy=0x7fd2f41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:27.030 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/996251240 shutdown_connections 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/996251240 >> 10.20.193.57:0/996251240 conn(0x7fd2f4091620 msgr2=0x7fd2f4091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/996251240 shutdown_connections 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.027+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/996251240 wait complete. 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient: build_initial_monmap 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient: monmap: 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:27.031 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 1 Processor -- start 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 1 -- start start 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient: init 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient(hunting): picked mon.noname-c con 0x7fd2f408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient(hunting): picked mon.noname-b con 0x7fd2f408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient(hunting): picked mon.noname-a con 0x7fd2f408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f408d9c0 con 0x7fd2f408cb30 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f405caa0 con 0x7fd2f408c730 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f4088810 con 0x7fd2f408ae20 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f9e5b640 10 monclient(hunting): authenticate will time out at 1726.847692s 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f37fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fd2f408ae20 0x7fd2f4088d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54592/0 (socket says 10.20.193.57:54592) 2026-02-12T17:47:27.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.028+0000 7fd2f37fe640 1 -- 10.20.193.57:0/1452108537 learned_addr learned my addr 10.20.193.57:0/1452108537 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:27.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.030+0000 7fd2f37fe640 1 -- 10.20.193.57:0/1452108537 >> v1:10.20.193.57:6790/0 conn(0x7fd2f408ae20 legacy=0x7fd2f4088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:27.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.030+0000 7fd2f3fff640 1 -- 10.20.193.57:0/1452108537 >> v1:10.20.193.57:6789/0 conn(0x7fd2f408cb30 legacy=0x7fd2f41a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:27.035 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.030+0000 7fd2f2ffd640 1 -- 10.20.193.57:0/1452108537 >> v1:10.20.193.82:6789/0 conn(0x7fd2f408c730 legacy=0x7fd2f4089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.030+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 534755643 0 0) 0x7fd2f4088810 con 0x7fd2f408ae20 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.030+0000 7fd2cffff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.030+0000 7fd2cffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.030+0000 7fd2cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): my global_id is 114242 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c40035e0 con 0x7fd2f408ae20 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3863071198 0 0) 0x7fd2f408d9c0 con 0x7fd2f408cb30 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): my global_id is 124149 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f4088810 con 0x7fd2f408cb30 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703985222 0 0) 0x7fd2f405caa0 con 0x7fd2f408c730 2026-02-12T17:47:27.036 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): my global_id is 5335 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f408d9c0 con 0x7fd2f408c730 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1623452842 0 0) 0x7fd2c40035e0 con 0x7fd2f408ae20 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2f405caa0 con 0x7fd2f408ae20 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2e00033a0 con 0x7fd2f408ae20 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): dump: 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:27.037 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3119754156 0 0) 0x7fd2f405caa0 con 0x7fd2f408ae20 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 >> v1:10.20.193.82:6789/0 conn(0x7fd2f408c730 legacy=0x7fd2f4089460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 >> v1:10.20.193.57:6789/0 conn(0x7fd2f408cb30 legacy=0x7fd2f41a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 monclient: found mon.c 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f405af80 con 0x7fd2f408ae20 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient: _finish_auth 0 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:27.038 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 5 monclient: authenticate success, global_id 114242 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 10 monclient: _renew_subs 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f408a900 con 0x7fd2f408ae20 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 10 monclient: _renew_subs 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd2f411d660 con 0x7fd2f408ae20 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2e0004b50 con 0x7fd2f408ae20 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd2e0004e70 con 0x7fd2f408ae20 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 10 monclient: dump: 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:27.039 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f1ffb640 4 set_mon_vals no callback set 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f40008d0 con 0x7fd2f408ae20 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.031+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fd2e0011ae0 con 0x7fd2f408ae20 2026-02-12T17:47:27.040 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.032+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fd2e004ea40 con 0x7fd2f408ae20 2026-02-12T17:47:27.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.032+0000 7fd2f2ffd640 10 monclient: get_auth_request con 0x7fd2c403f900 auth_method 0 2026-02-12T17:47:27.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.034+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fd2e0013560 con 0x7fd2f408ae20 2026-02-12T17:47:27.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.034+0000 7fd2cffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:27.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.034+0000 7fd2cffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:27.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.178+0000 7fd2f9e5b640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T17:47:27.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.178+0000 7fd2f9e5b640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T17:47:27.175 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.178+0000 7fd2f9e5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:27.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.178+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fd2f408f520 con 0x7fd2f408ae20 2026-02-12T17:47:27.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.179+0000 7fd2cffff640 1 -- 10.20.193.57:0/1452108537 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fd2e0016a80 con 0x7fd2f408ae20 2026-02-12T17:47:27.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.179+0000 7fd2cffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T17:47:27.176 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.179+0000 7fd2cffff640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:27.177 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.174+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.177 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.174+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=21,config=2,health=13,kv=11,logm=53} crc {auth=2865984495,config=1618278320,health=2846457918,kv=1466688342,logm=725723447}) 2026-02-12T17:47:27.177 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.174+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=21,config=2,health=11,kv=11,logm=55} crc {auth=1726635574,config=1618278320,health=4166504733,kv=1466688342,logm=2113414487}) 2026-02-12T17:47:27.177 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.174+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.177 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.174+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=21,config=2,health=13,kv=11,logm=53} crc {auth=2865984495,config=1618278320,health=2846457918,kv=1466688342,logm=725723447}) 2026-02-12T17:47:27.177 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.174+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=13,kv=10,logm=54} crc {auth=2447683134,config=1618278320,health=2846457918,kv=2472270804,logm=3725151030}) 2026-02-12T17:47:27.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.180+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 >> v1:10.20.193.82:6800/2441377515 conn(0x7fd2c403f900 legacy=0x7fd2c405fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:27.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.180+0000 7fd2f9e5b640 10 monclient: shutdown 2026-02-12T17:47:27.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.180+0000 7fd2f9e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:27.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.180+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 >> v1:10.20.193.57:6790/0 conn(0x7fd2f408ae20 legacy=0x7fd2f4088d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:27.178 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.180+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 shutdown_connections 2026-02-12T17:47:27.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.180+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 >> 10.20.193.57:0/1452108537 conn(0x7fd2f4091620 msgr2=0x7fd2f40597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:27.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.180+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 shutdown_connections 2026-02-12T17:47:27.179 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:27.180+0000 7fd2f9e5b640 1 -- 10.20.193.57:0/1452108537 wait complete. 2026-02-12T17:47:27.185 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T17:47:27.186 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.186 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=923321050}) 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822241441}) 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=923321050}) 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=421198971}) 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=660430790}) 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2941853477}) 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=660430790}) 2026-02-12T17:47:27.187 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.184+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2810576575}) 2026-02-12T17:47:27.189 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.189 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3289166011}) 2026-02-12T17:47:27.189 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3595091275}) 2026-02-12T17:47:27.189 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.189 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3289166011}) 2026-02-12T17:47:27.189 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=600773825}) 2026-02-12T17:47:27.189 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.189 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1060486622}) 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2952375725}) 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1060486622}) 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.185+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=538604449}) 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.186+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.186+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3251840671}) 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.186+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=394654750}) 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.186+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.186+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3251840671}) 2026-02-12T17:47:27.190 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.186+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3824304641}) 2026-02-12T17:47:27.198 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.198 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4236055412}) 2026-02-12T17:47:27.198 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2585474878}) 2026-02-12T17:47:27.198 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.198 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4236055412}) 2026-02-12T17:47:27.198 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2068612757}) 2026-02-12T17:47:27.202 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2341849514}) 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91876798}) 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2341849514}) 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.196+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2763447431}) 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3983327022}) 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3590720404}) 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3983327022}) 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1133228256}) 2026-02-12T17:47:27.203 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3329075091}) 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2165113497}) 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3329075091}) 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.197+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=938015242}) 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3989391569}) 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=615666298}) 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3989391569}) 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3042454348}) 2026-02-12T17:47:27.204 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1430131957}) 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1711834538}) 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1430131957}) 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.198+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=653988649}) 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1632726837}) 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340976633}) 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1632726837}) 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3583723490}) 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.205 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1517178261}) 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3410120620}) 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1517178261}) 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.199+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=203464263}) 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3624420273}) 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2759611153}) 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3624420273}) 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3373602032}) 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=903714383}) 2026-02-12T17:47:27.206 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2788041372}) 2026-02-12T17:47:27.207 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.207 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=903714383}) 2026-02-12T17:47:27.207 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.200+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2324587660}) 2026-02-12T17:47:27.207 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.207 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3044173315}) 2026-02-12T17:47:27.207 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3776083278}) 2026-02-12T17:47:27.207 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.207 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3044173315}) 2026-02-12T17:47:27.207 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=834461450}) 2026-02-12T17:47:27.212 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.212 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3159234509}) 2026-02-12T17:47:27.212 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=167811915}) 2026-02-12T17:47:27.212 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.212 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3159234509}) 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.201+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2137572135}) 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=17758936}) 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3697867996}) 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=17758936}) 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3489402703}) 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1119887743}) 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=352304201}) 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.213 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1119887743}) 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1400576847}) 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2293097915}) 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2070756435}) 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2293097915}) 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.202+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3461990780}) 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1748658283}) 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238238568}) 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.214 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1748658283}) 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1404892583}) 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1758535846}) 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680485860}) 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1758535846}) 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.203+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3375924343}) 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=52979025}) 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=214559735}) 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=52979025}) 2026-02-12T17:47:27.215 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=725793720}) 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1982786178}) 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1908032981}) 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1982786178}) 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.204+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3938194899}) 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2023516553}) 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3053050680}) 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2023516553}) 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3459865342}) 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.216 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1825460214}) 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1026369864}) 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1825460214}) 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.205+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3264477574}) 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1817396328}) 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1706959779}) 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1817396328}) 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=586748441}) 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.217 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1918586454}) 2026-02-12T17:47:27.218 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3993010773}) 2026-02-12T17:47:27.218 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.218 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1918586454}) 2026-02-12T17:47:27.218 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.206+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3164599455}) 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3921323476}) 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=159497038}) 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3921323476}) 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=96180959}) 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=733860021}) 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3974421187}) 2026-02-12T17:47:27.222 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=733860021}) 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.216+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2222552257}) 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=362003265}) 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4267614072}) 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=362003265}) 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1645400571}) 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1400274479}) 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2791195830}) 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.223 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1400274479}) 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.217+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1912416824}) 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4241127364}) 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3330797649}) 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4241127364}) 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1417789547}) 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1793258874}) 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=775265663}) 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1793258874}) 2026-02-12T17:47:27.224 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.218+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2148761104}) 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1073208261}) 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2215987810}) 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1073208261}) 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1179207158}) 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=883151443}) 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3588956371}) 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=883151443}) 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.219+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=446390498}) 2026-02-12T17:47:27.225 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.226 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2711511630}) 2026-02-12T17:47:27.226 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2699145877}) 2026-02-12T17:47:27.226 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.226 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2711511630}) 2026-02-12T17:47:27.226 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2282913823}) 2026-02-12T17:47:27.228 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.228 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3234685202}) 2026-02-12T17:47:27.228 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4115821641}) 2026-02-12T17:47:27.228 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.228 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3234685202}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=467063192}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=818342848}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2143221929}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=818342848}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.220+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=368789838}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.221+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.221+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=210774520}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.221+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3717862292}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.221+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.221+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=210774520}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.221+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2562331115}) 2026-02-12T17:47:27.229 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=86,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=1} crc {logm=604947857,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3827692828}) 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=83,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=4} crc {logm=3768527644,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=2706687205}) 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=86,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=1} crc {logm=604947857,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154,mgrstat=3827692828}) 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=87,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1} crc {logm=1318165298,mdsmap=2204869053,mgr=1606979397,mgr_command_descs=714296370,mgr_metadata=283970154}) 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=65} crc {mgrstat=3262509361,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3814064227,osd_pg_creating=1488139506,osd_snap=4268572662}) 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=64} crc {mgrstat=3262509361,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3332643379,osd_pg_creating=1488139506,osd_snap=3339192344}) 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=65} crc {mgrstat=3262509361,mon_config_key=383892656,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=3814064227,osd_pg_creating=1488139506,osd_snap=4268572662}) 2026-02-12T17:47:27.230 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.222+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=67} crc {mgrstat=3262509361,mon_config_key=3597899217,monmap=2728086219,nvmeofgw=3360707892,osd_metadata=1528087848,osd_pg_creating=1488139506,osd_snap=833468770}) 2026-02-12T17:47:27.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.265+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.265+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=90,osdmap=10} crc {osd_snap=3093041519,osdmap=887830278}) 2026-02-12T17:47:27.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.265+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=86,osdmap=14} crc {osd_snap=3788503532,osdmap=4294744349}) 2026-02-12T17:47:27.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.265+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.265+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=90,osdmap=10} crc {osd_snap=3093041519,osdmap=887830278}) 2026-02-12T17:47:27.267 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.265+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=93,osdmap=7} crc {osd_snap=164028357,osdmap=1865689958}) 2026-02-12T17:47:27.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.267+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.267+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3172995925}) 2026-02-12T17:47:27.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.267+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=187432391}) 2026-02-12T17:47:27.269 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.267+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.267+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3172995925}) 2026-02-12T17:47:27.270 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.267+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1466964635}) 2026-02-12T17:47:27.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=73} crc {osdmap=3404850063}) 2026-02-12T17:47:27.271 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=75} crc {osdmap=2478535950}) 2026-02-12T17:47:27.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T17:47:27.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=73} crc {osdmap=3404850063}) 2026-02-12T17:47:27.272 INFO:tasks.ceph.mon.b.trial082.stderr:2026-02-12T17:47:27.269+0000 7f312a9f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=75} crc {osdmap=1904288406}) 2026-02-12T17:47:28.186 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-12T17:47:28.186 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.256+0000 7f77bafdd640 10 monclient: get_monmap_and_config 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.256+0000 7f77bafdd640 10 monclient: build_initial_monmap 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.256+0000 7f77bafdd640 10 monclient: monmap: 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:28.257580+0000 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:28.257580+0000 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:28.253 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 1 Processor -- start 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 1 -- start start 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 10 monclient: init 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 10 monclient(hunting): picked mon.noname-a con 0x7f77b408ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 10 monclient(hunting): picked mon.noname-b con 0x7f77b408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 10 monclient(hunting): picked mon.noname-c con 0x7f77b408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b408d600 con 0x7f77b408ae20 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b408b1f0 con 0x7f77b408cb30 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b408d1f0 con 0x7f77b408c730 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77bafdd640 10 monclient(hunting): authenticate will time out at 1728.076447s 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77b8d52640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f77b408ae20 0x7f77b408c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39312/0 (socket says 10.20.193.57:39312) 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77b8d52640 1 -- 10.20.193.57:0/4271639631 learned_addr learned my addr 10.20.193.57:0/4271639631 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:28.254 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.257+0000 7f77abfff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f77b408c730 0x7f77b4181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54596/0 (socket says 10.20.193.57:54596) 2026-02-12T17:47:28.255 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77abfff640 1 -- 10.20.193.57:0/4271639631 >> v1:10.20.193.57:6790/0 conn(0x7f77b408c730 legacy=0x7f77b4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77b8d52640 1 -- 10.20.193.57:0/4271639631 >> v1:10.20.193.57:6789/0 conn(0x7f77b408ae20 legacy=0x7f77b408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1318100057 0 0) 0x7f77b408d1f0 con 0x7f77b408c730 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 10 monclient(hunting): my global_id is 114245 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a00035e0 con 0x7f77b408c730 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031017939 0 0) 0x7f77b408d600 con 0x7f77b408ae20 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 10 monclient(hunting): my global_id is 124152 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77b9553640 1 -- 10.20.193.57:0/4271639631 >> v1:10.20.193.82:6789/0 conn(0x7f77b408cb30 legacy=0x7f77b41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b408d1f0 con 0x7f77b408ae20 2026-02-12T17:47:28.256 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2493571760 0 0) 0x7f77a00035e0 con 0x7f77b408c730 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.259+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 >> v1:10.20.193.82:6789/0 conn(0x7f77b408cb30 legacy=0x7f77b41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 >> v1:10.20.193.57:6789/0 conn(0x7f77b408ae20 legacy=0x7f77b408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 1 monclient: found mon.noname-b 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b4057320 con 0x7f77b408c730 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: _finish_auth 0 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f779c003140 con 0x7f77b408c730 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: dump: 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 5 monclient: authenticate success, global_id 114245 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f779c003390 con 0x7f77b408c730 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 1 -- 10.20.193.57:0/4271639631 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f779c004a50 con 0x7f77b408c730 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77ab7fe640 10 monclient: dump: 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:28.257 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 4 set_mon_vals no callback set 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 10 monclient: shutdown 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 1 -- 10.20.193.57:0/4271639631 >> v1:10.20.193.57:6790/0 conn(0x7f77b408c730 legacy=0x7f77b4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 1 -- 10.20.193.57:0/4271639631 shutdown_connections 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 1 -- 10.20.193.57:0/4271639631 >> 10.20.193.57:0/4271639631 conn(0x7f77b4091620 msgr2=0x7f77b4091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 1 -- 10.20.193.57:0/4271639631 shutdown_connections 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 1 -- 10.20.193.57:0/4271639631 wait complete. 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 10 monclient: build_initial_monmap 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.260+0000 7f77bafdd640 10 monclient: monmap: 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 1 Processor -- start 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 1 -- start start 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 10 monclient: init 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:28.258 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 10 monclient(hunting): picked mon.noname-c con 0x7f77b408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 10 monclient(hunting): picked mon.noname-b con 0x7f77b408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 10 monclient(hunting): picked mon.noname-a con 0x7f77b408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b408d9c0 con 0x7f77b408cb30 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b405cbc0 con 0x7f77b408c730 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b405afb0 con 0x7f77b408ae20 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77bafdd640 10 monclient(hunting): authenticate will time out at 1728.080468s 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77b8d52640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f77b408ae20 0x7f77b41330a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54606/0 (socket says 10.20.193.57:54606) 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.261+0000 7f77b8d52640 1 -- 10.20.193.57:0/3040862356 learned_addr learned my addr 10.20.193.57:0/3040862356 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:28.259 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77b8d52640 1 -- 10.20.193.57:0/3040862356 >> v1:10.20.193.57:6790/0 conn(0x7f77b408ae20 legacy=0x7f77b41330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77b9553640 1 -- 10.20.193.57:0/3040862356 >> v1:10.20.193.57:6789/0 conn(0x7f77b408cb30 legacy=0x7f77b41a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77b8d52640 1 --1- 10.20.193.57:0/3040862356 >> v1:10.20.193.57:6790/0 conn(0x7f77b408ae20 0x7f77b41330a0 :-1 s=OPENED pgs=361 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f77b405afb0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77abfff640 1 -- 10.20.193.57:0/3040862356 >> v1:10.20.193.82:6789/0 conn(0x7f77b408c730 legacy=0x7f77b41337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435967600 0 0) 0x7f77b408d9c0 con 0x7f77b408cb30 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 10 monclient(hunting): my global_id is 124155 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77840035e0 con 0x7f77b408cb30 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3719792943 0 0) 0x7f77b4057320 con 0x7f77b408c730 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 10 monclient(hunting): my global_id is 5341 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.263+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b408d9c0 con 0x7f77b408c730 2026-02-12T17:47:28.260 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1303731600 0 0) 0x7f77840035e0 con 0x7f77b408cb30 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77b4057320 con 0x7f77b408cb30 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f77b0004420 con 0x7f77b408cb30 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient(hunting): dump: 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1046137187 0 0) 0x7f77b408d9c0 con 0x7f77b408c730 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77840035e0 con 0x7f77b408c730 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f779c002f90 con 0x7f77b408c730 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient(hunting): dump: 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.261 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1012772289 0 0) 0x7f77b4057320 con 0x7f77b408cb30 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 >> v1:10.20.193.57:6790/0 conn(0x7f77b408ae20 legacy=0x7f77b41330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 >> v1:10.20.193.82:6789/0 conn(0x7f77b408c730 legacy=0x7f77b41337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient: _finish_hunting 0 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 monclient: found mon.a 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b4088810 con 0x7f77b408cb30 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient: _finish_auth 0 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient: _check_auth_tickets 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3313871545 0 0) 0x7f77b405afb0 con 0x7f77b408ae20 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 5 monclient: authenticate success, global_id 124155 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 10 monclient: _renew_subs 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f77b411eed0 con 0x7f77b408cb30 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 10 monclient: _renew_subs 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f77b411e910 con 0x7f77b408cb30 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77b0004600 con 0x7f77b408cb30 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f77b0004c10 con 0x7f77b408cb30 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 10 monclient: dump: 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77aaffd640 4 set_mon_vals no callback set 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.262 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b40008d0 con 0x7f77b408cb30 2026-02-12T17:47:28.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.264+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f77b0004ea0 con 0x7f77b408cb30 2026-02-12T17:47:28.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.265+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f77b004fa40 con 0x7f77b408cb30 2026-02-12T17:47:28.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.265+0000 7f77b8d52640 10 monclient: get_auth_request con 0x7f778403fae0 auth_method 0 2026-02-12T17:47:28.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.267+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f77b0018380 con 0x7f77b408cb30 2026-02-12T17:47:28.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.267+0000 7f77a97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.267+0000 7f77a97fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:28.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.413+0000 7f77bafdd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T17:47:28.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.413+0000 7f77bafdd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:28.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.413+0000 7f77bafdd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.413+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f77b408f500 con 0x7f77b408cb30 2026-02-12T17:47:28.410 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.413+0000 7f77a97fa640 1 -- 10.20.193.57:0/3040862356 <== mon.0 v1:10.20.193.57:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1601 (unknown 254746657 0 2917466221) 0x7f77b0017b30 con 0x7f77b408cb30 2026-02-12T17:47:28.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.413+0000 7f77a97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T17:47:28.411 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.413+0000 7f77a97fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:28.411 INFO:teuthology.orchestra.run.trial057.stdout:{"election_epoch":74,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","modified":"2026-02-12T17:27:47.387807Z","created":"2026-02-12T17:27:47.387807Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":3,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6789","nonce":0}]},"addr":"10.20.193.57:6789/0","public_addr":"10.20.193.57:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387857+0000","crush_location":[]},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6789","nonce":0}]},"addr":"10.20.193.82:6789/0","public_addr":"10.20.193.82:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387858+0000","crush_location":[]},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6790","nonce":0}]},"addr":"10.20.193.57:6790/0","public_addr":"10.20.193.57:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T17:27:47:387859+0000","crush_location":[]}]}} 2026-02-12T17:47:28.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.414+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 >> v1:10.20.193.82:6800/2441377515 conn(0x7f778403fae0 legacy=0x7f778405ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.414+0000 7f77bafdd640 10 monclient: shutdown 2026-02-12T17:47:28.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.414+0000 7f77bafdd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:28.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.414+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 >> v1:10.20.193.57:6789/0 conn(0x7f77b408cb30 legacy=0x7f77b41a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.414+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 shutdown_connections 2026-02-12T17:47:28.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.414+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 >> 10.20.193.57:0/3040862356 conn(0x7f77b4091620 msgr2=0x7f77b40597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:28.412 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.414+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 shutdown_connections 2026-02-12T17:47:28.413 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.414+0000 7f77bafdd640 1 -- 10.20.193.57:0/3040862356 wait complete. 2026-02-12T17:47:28.418 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-12T17:47:28.418 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T17:47:28.434 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T17:47:28.434 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:47:28.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.503+0000 7fe8707d4640 10 monclient: get_monmap_and_config 2026-02-12T17:47:28.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.503+0000 7fe8707d4640 10 monclient: build_initial_monmap 2026-02-12T17:47:28.500 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.503+0000 7fe8707d4640 10 monclient: monmap: 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:28.504333+0000 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:28.504333+0000 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.503+0000 7fe8707d4640 1 Processor -- start 2026-02-12T17:47:28.501 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.503+0000 7fe8707d4640 1 -- start start 2026-02-12T17:47:28.502 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.503+0000 7fe8707d4640 10 monclient: init 2026-02-12T17:47:28.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:28.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:28.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 10 monclient(hunting): picked mon.noname-a con 0x7fe86808ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:28.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 10 monclient(hunting): picked mon.noname-b con 0x7fe86808cc80 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:28.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 10 monclient(hunting): picked mon.noname-c con 0x7fe8681852d0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:28.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86808d600 con 0x7fe86808ae20 2026-02-12T17:47:28.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe868089770 con 0x7fe8681852d0 2026-02-12T17:47:28.506 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86808b1f0 con 0x7fe86808cc80 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe8707d4640 10 monclient(hunting): authenticate will time out at 1728.323259s 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe86e549640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe86808ae20 0x7fe86808c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39336/0 (socket says 10.20.193.57:39336) 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.504+0000 7fe86e549640 1 -- 10.20.193.57:0/2324054974 learned_addr learned my addr 10.20.193.57:0/2324054974 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86dd48640 1 -- 10.20.193.57:0/2324054974 >> v1:10.20.193.57:6790/0 conn(0x7fe86808cc80 legacy=0x7fe868183bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86e549640 1 -- 10.20.193.57:0/2324054974 >> v1:10.20.193.57:6789/0 conn(0x7fe86808ae20 legacy=0x7fe86808c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946562730 0 0) 0x7fe86808b1f0 con 0x7fe86808cc80 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.507 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient(hunting): my global_id is 114251 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8500035e0 con 0x7fe86808cc80 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 149670196 0 0) 0x7fe86808d600 con 0x7fe86808ae20 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient(hunting): my global_id is 124158 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe86808b1f0 con 0x7fe86808ae20 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1066266397 0 0) 0x7fe86808b1f0 con 0x7fe86808ae20 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86ed4a640 1 -- 10.20.193.57:0/2324054974 >> v1:10.20.193.82:6789/0 conn(0x7fe8681852d0 legacy=0x7fe8681a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 >> v1:10.20.193.57:6790/0 conn(0x7fe86808cc80 legacy=0x7fe868183bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 >> v1:10.20.193.82:6789/0 conn(0x7fe8681852d0 legacy=0x7fe8681a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: _finish_hunting 0 2026-02-12T17:47:28.508 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 monclient: found mon.noname-a 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86808c020 con 0x7fe86808ae20 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: _finish_auth 0 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: _check_auth_tickets 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe8707d4640 5 monclient: authenticate success, global_id 124158 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe8580030d0 con 0x7fe86808ae20 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: dump: 2026-02-12T17:47:28.509 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe8707d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8580033d0 con 0x7fe86808ae20 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:28.510 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 1 -- 10.20.193.57:0/2324054974 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe858004b10 con 0x7fe86808ae20 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.506+0000 7fe86d547640 10 monclient: dump: 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.511 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 4 set_mon_vals no callback set 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 10 monclient: shutdown 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 1 -- 10.20.193.57:0/2324054974 >> v1:10.20.193.57:6789/0 conn(0x7fe86808ae20 legacy=0x7fe86808c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 1 -- 10.20.193.57:0/2324054974 shutdown_connections 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 1 -- 10.20.193.57:0/2324054974 >> 10.20.193.57:0/2324054974 conn(0x7fe868091620 msgr2=0x7fe868091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 1 -- 10.20.193.57:0/2324054974 shutdown_connections 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 1 -- 10.20.193.57:0/2324054974 wait complete. 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 10 monclient: build_initial_monmap 2026-02-12T17:47:28.512 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 10 monclient: monmap: 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 1 Processor -- start 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 1 -- start start 2026-02-12T17:47:28.513 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.507+0000 7fe8707d4640 10 monclient: init 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 10 monclient(hunting): picked mon.noname-c con 0x7fe86808ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 10 monclient(hunting): picked mon.noname-b con 0x7fe86808cc80 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 10 monclient(hunting): picked mon.noname-a con 0x7fe8681852d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8680880e0 con 0x7fe8681852d0 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe868088810 con 0x7fe86808cc80 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8680833e0 con 0x7fe86808ae20 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe8707d4640 10 monclient(hunting): authenticate will time out at 1728.327240s 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe86e549640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe86808ae20 0x7fe86807f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54634/0 (socket says 10.20.193.57:54634) 2026-02-12T17:47:28.514 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.508+0000 7fe86e549640 1 -- 10.20.193.57:0/4068638925 learned_addr learned my addr 10.20.193.57:0/4068638925 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:28.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe86ed4a640 1 -- 10.20.193.57:0/4068638925 >> v1:10.20.193.57:6789/0 conn(0x7fe8681852d0 legacy=0x7fe8681849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe86e549640 1 -- 10.20.193.57:0/4068638925 >> v1:10.20.193.57:6790/0 conn(0x7fe86808ae20 legacy=0x7fe86807f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.518 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409934322 0 0) 0x7fe8680880e0 con 0x7fe8681852d0 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): my global_id is 124161 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe86dd48640 1 -- 10.20.193.57:0/4068638925 >> v1:10.20.193.82:6789/0 conn(0x7fe86808cc80 legacy=0x7fe8680800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8380035e0 con 0x7fe8681852d0 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825357700 0 0) 0x7fe8680833e0 con 0x7fe86808ae20 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.519 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): my global_id is 114254 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8680880e0 con 0x7fe86808ae20 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699936482 0 0) 0x7fe868088810 con 0x7fe86808cc80 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): my global_id is 5347 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8680833e0 con 0x7fe86808cc80 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3726080023 0 0) 0x7fe8380035e0 con 0x7fe8681852d0 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe868088810 con 0x7fe8681852d0 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe864004350 con 0x7fe8681852d0 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:28.520 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): dump: 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:28.521 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3026340352 0 0) 0x7fe8680880e0 con 0x7fe86808ae20 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8380035e0 con 0x7fe86808ae20 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe8580048a0 con 0x7fe86808ae20 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient(hunting): dump: 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.522 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2267857468 0 0) 0x7fe868088810 con 0x7fe8681852d0 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 >> v1:10.20.193.57:6790/0 conn(0x7fe86808ae20 legacy=0x7fe86807f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 >> v1:10.20.193.82:6789/0 conn(0x7fe86808cc80 legacy=0x7fe8680800a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient: _finish_hunting 0 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 monclient: found mon.a 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8680836c0 con 0x7fe8681852d0 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient: _finish_auth 0 2026-02-12T17:47:28.523 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 10 monclient: _check_auth_tickets 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe84effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe8707d4640 5 monclient: authenticate success, global_id 124161 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe8707d4640 10 monclient: _renew_subs 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe8707d4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8680807b0 con 0x7fe8681852d0 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe8707d4640 10 monclient: _renew_subs 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe8707d4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.510+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe868083100 con 0x7fe8681852d0 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8640044f0 con 0x7fe8681852d0 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe84effd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe864004c10 con 0x7fe8681852d0 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe84effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.524 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe84effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe86cd46640 4 set_mon_vals no callback set 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe84effd640 10 monclient: dump: 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.525 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe8707d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe8707d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe8707d4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86807a810 con 0x7fe8681852d0 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe864004df0 con 0x7fe8681852d0 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fe86404f930 con 0x7fe8681852d0 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.511+0000 7fe86e549640 10 monclient: get_auth_request con 0x7fe83803fbf0 auth_method 0 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.513+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe864005490 con 0x7fe8681852d0 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.513+0000 7fe84effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.526 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.513+0000 7fe84effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:28.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.614+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe868088b20 con 0x7fe83803fbf0 2026-02-12T17:47:28.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.615+0000 7fe84effd640 1 -- 10.20.193.57:0/4068638925 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33996 (unknown 2965378022 0 2550146449) 0x7fe858007b70 con 0x7fe83803fbf0 2026-02-12T17:47:28.612 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:47:28.613 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:47:28.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.616+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe83803fbf0 legacy=0x7fe8380600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.613 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.616+0000 7fe8707d4640 10 monclient: shutdown 2026-02-12T17:47:28.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.616+0000 7fe8707d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:28.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.616+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 >> v1:10.20.193.57:6789/0 conn(0x7fe8681852d0 legacy=0x7fe8681849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.616+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 shutdown_connections 2026-02-12T17:47:28.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.616+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 >> 10.20.193.57:0/4068638925 conn(0x7fe868091620 msgr2=0x7fe8681a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:28.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.616+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 shutdown_connections 2026-02-12T17:47:28.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.616+0000 7fe8707d4640 1 -- 10.20.193.57:0/4068638925 wait complete. 2026-02-12T17:47:28.620 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":1466,"stamp":"2026-02-12T17:47:27.958398+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":265168,"kb_used_data":13168,"kb_used_omap":10389,"kb_used_meta":241514,"kb_avail":565965872,"statfs":{"total":579820584960,"available":579549052928,"internally_reserved":0,"allocated":13484032,"data_stored":7867822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10638613,"internal_metadata":247311083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000974"},"pg_stats":[{"pgid":"1.0","version":"14'112","reported_seq":1868,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907630+0000","last_change":"2026-02-12T17:28:13.575533+0000","last_active":"2026-02-12T17:46:01.907630+0000","last_peered":"2026-02-12T17:46:01.907630+0000","last_clean":"2026-02-12T17:46:01.907630+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:46:01.907630+0000","last_undegraded":"2026-02-12T17:46:01.907630+0000","last_fullsized":"2026-02-12T17:46:01.907630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_clean_scrub_stamp":"2026-02-12T17:28:11.958332+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:10:01.188074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1737,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907764+0000","last_change":"2026-02-12T17:28:19.283491+0000","last_active":"2026-02-12T17:46:01.907764+0000","last_peered":"2026-02-12T17:46:01.907764+0000","last_clean":"2026-02-12T17:46:01.907764+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:46:01.907764+0000","last_undegraded":"2026-02-12T17:46:01.907764+0000","last_fullsized":"2026-02-12T17:46:01.907764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:53.711374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1731,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907625+0000","last_change":"2026-02-12T17:28:19.724210+0000","last_active":"2026-02-12T17:46:01.907625+0000","last_peered":"2026-02-12T17:46:01.907625+0000","last_clean":"2026-02-12T17:46:01.907625+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:46:01.907625+0000","last_undegraded":"2026-02-12T17:46:01.907625+0000","last_fullsized":"2026-02-12T17:46:01.907625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:54.193528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1736,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912653+0000","last_change":"2026-02-12T17:28:19.286905+0000","last_active":"2026-02-12T17:46:01.912653+0000","last_peered":"2026-02-12T17:46:01.912653+0000","last_clean":"2026-02-12T17:46:01.912653+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:46:01.912653+0000","last_undegraded":"2026-02-12T17:46:01.912653+0000","last_fullsized":"2026-02-12T17:46:01.912653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:35.531511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1738,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907749+0000","last_change":"2026-02-12T17:28:19.283404+0000","last_active":"2026-02-12T17:46:01.907749+0000","last_peered":"2026-02-12T17:46:01.907749+0000","last_clean":"2026-02-12T17:46:01.907749+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:46:01.907749+0000","last_undegraded":"2026-02-12T17:46:01.907749+0000","last_fullsized":"2026-02-12T17:46:01.907749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:24:22.204036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1746,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912771+0000","last_change":"2026-02-12T17:28:19.289250+0000","last_active":"2026-02-12T17:46:01.912771+0000","last_peered":"2026-02-12T17:46:01.912771+0000","last_clean":"2026-02-12T17:46:01.912771+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:46:01.912771+0000","last_undegraded":"2026-02-12T17:46:01.912771+0000","last_fullsized":"2026-02-12T17:46:01.912771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:19:32.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1731,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907624+0000","last_change":"2026-02-12T17:28:19.724251+0000","last_active":"2026-02-12T17:46:01.907624+0000","last_peered":"2026-02-12T17:46:01.907624+0000","last_clean":"2026-02-12T17:46:01.907624+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:46:01.907624+0000","last_undegraded":"2026-02-12T17:46:01.907624+0000","last_fullsized":"2026-02-12T17:46:01.907624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:31:06.358030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1745,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912705+0000","last_change":"2026-02-12T17:28:19.289150+0000","last_active":"2026-02-12T17:46:01.912705+0000","last_peered":"2026-02-12T17:46:01.912705+0000","last_clean":"2026-02-12T17:46:01.912705+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:46:01.912705+0000","last_undegraded":"2026-02-12T17:46:01.912705+0000","last_fullsized":"2026-02-12T17:46:01.912705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:34:03.582232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1730,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907605+0000","last_change":"2026-02-12T17:28:19.724309+0000","last_active":"2026-02-12T17:46:01.907605+0000","last_peered":"2026-02-12T17:46:01.907605+0000","last_clean":"2026-02-12T17:46:01.907605+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:46:01.907605+0000","last_undegraded":"2026-02-12T17:46:01.907605+0000","last_fullsized":"2026-02-12T17:46:01.907605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:21:16.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640490,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":2093,"kb_used_meta":42898,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2144108,"internal_metadata":43927700},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640489,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":2158,"kb_used_meta":42833,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2210741,"internal_metadata":43861067},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640492,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29500,"kb_used_data":2540,"kb_used_omap":938,"kb_used_meta":26005,"kb_avail":94342340,"statfs":{"total":96636764160,"available":96606556160,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":961349,"internal_metadata":26629307},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640490,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":1995,"kb_used_meta":42996,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2043800,"internal_metadata":44028008},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":1501,"kb_used_meta":43490,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1537281,"internal_metadata":44534527},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640490,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47548,"kb_used_data":2540,"kb_used_omap":1700,"kb_used_meta":43291,"kb_avail":94324292,"statfs":{"total":96636764160,"available":96588075008,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1741334,"internal_metadata":44330474},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:47:28.622 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.692+0000 7fc1fb412640 10 monclient: get_monmap_and_config 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.692+0000 7fc1fb412640 10 monclient: build_initial_monmap 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.692+0000 7fc1fb412640 10 monclient: monmap: 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:28.693383+0000 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:28.693383+0000 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.692+0000 7fc1fb412640 1 Processor -- start 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 1 -- start start 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 10 monclient: init 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 10 monclient(hunting): picked mon.noname-b con 0x7fc1f408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:28.689 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 10 monclient(hunting): picked mon.noname-c con 0x7fc1f408c730 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:28.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 10 monclient(hunting): picked mon.noname-a con 0x7fc1f408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:28.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f408d600 con 0x7fc1f408cb30 2026-02-12T17:47:28.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f408b1f0 con 0x7fc1f408c730 2026-02-12T17:47:28.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f408d1f0 con 0x7fc1f408ae20 2026-02-12T17:47:28.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:28.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1fb412640 10 monclient(hunting): authenticate will time out at 1728.512302s 2026-02-12T17:47:28.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1f9187640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fc1f408ae20 0x7fc1f408c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54650/0 (socket says 10.20.193.57:54650) 2026-02-12T17:47:28.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1f9988640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fc1f408cb30 0x7fc1f41a3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39364/0 (socket says 10.20.193.57:39364) 2026-02-12T17:47:28.690 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.693+0000 7fc1f9187640 1 -- 10.20.193.57:0/778556427 learned_addr learned my addr 10.20.193.57:0/778556427 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:28.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1f9988640 1 -- 10.20.193.57:0/778556427 >> v1:10.20.193.57:6789/0 conn(0x7fc1f408cb30 legacy=0x7fc1f41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.691 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1f9187640 1 -- 10.20.193.57:0/778556427 >> v1:10.20.193.57:6790/0 conn(0x7fc1f408ae20 legacy=0x7fc1f408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1f8986640 1 -- 10.20.193.57:0/778556427 >> v1:10.20.193.82:6789/0 conn(0x7fc1f408c730 legacy=0x7fc1f4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250497012 0 0) 0x7fc1f408d600 con 0x7fc1f408cb30 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient(hunting): my global_id is 124164 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1dc0035e0 con 0x7fc1f408cb30 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933004752 0 0) 0x7fc1f408d1f0 con 0x7fc1f408ae20 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient(hunting): my global_id is 114257 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1f408d600 con 0x7fc1f408ae20 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 172058611 0 0) 0x7fc1f408d600 con 0x7fc1f408ae20 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 >> v1:10.20.193.82:6789/0 conn(0x7fc1f408c730 legacy=0x7fc1f4181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 >> v1:10.20.193.57:6789/0 conn(0x7fc1f408cb30 legacy=0x7fc1f41a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:28.692 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 monclient: found mon.noname-b 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f4057320 con 0x7fc1f408ae20 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient: _finish_auth 0 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1e4003140 con 0x7fc1f408ae20 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1e3fff640 10 monclient: dump: 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1fb412640 5 monclient: authenticate success, global_id 114257 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.695+0000 7fc1fb412640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1e40032a0 con 0x7fc1f408ae20 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1e3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1e3fff640 1 -- 10.20.193.57:0/778556427 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1e4004960 con 0x7fc1f408ae20 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 4 set_mon_vals no callback set 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1e3fff640 10 monclient: dump: 2026-02-12T17:47:28.693 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 10 monclient: shutdown 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 1 -- 10.20.193.57:0/778556427 >> v1:10.20.193.57:6790/0 conn(0x7fc1f408ae20 legacy=0x7fc1f408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 1 -- 10.20.193.57:0/778556427 shutdown_connections 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 1 -- 10.20.193.57:0/778556427 >> 10.20.193.57:0/778556427 conn(0x7fc1f4091620 msgr2=0x7fc1f4091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 1 -- 10.20.193.57:0/778556427 shutdown_connections 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 1 -- 10.20.193.57:0/778556427 wait complete. 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 10 monclient: build_initial_monmap 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.696+0000 7fc1fb412640 10 monclient: monmap: 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 1 Processor -- start 2026-02-12T17:47:28.694 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 1 -- start start 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 10 monclient: init 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 10 monclient(hunting): picked mon.noname-c con 0x7fc1f408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 10 monclient(hunting): picked mon.noname-a con 0x7fc1f408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 10 monclient(hunting): picked mon.noname-b con 0x7fc1f408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f408d9c0 con 0x7fc1f408c730 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f411d420 con 0x7fc1f408cb30 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f405ca70 con 0x7fc1f408ae20 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1fb412640 10 monclient(hunting): authenticate will time out at 1728.516306s 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1f9187640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fc1f408ae20 0x7fc1f4088b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54666/0 (socket says 10.20.193.57:54666) 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.697+0000 7fc1f9187640 1 -- 10.20.193.57:0/101961833 learned_addr learned my addr 10.20.193.57:0/101961833 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1f9187640 1 -- 10.20.193.57:0/101961833 >> v1:10.20.193.57:6790/0 conn(0x7fc1f408ae20 legacy=0x7fc1f4088b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1f8986640 1 -- 10.20.193.57:0/101961833 >> v1:10.20.193.57:6789/0 conn(0x7fc1f408c730 legacy=0x7fc1f4089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754475673 0 0) 0x7fc1f405ca70 con 0x7fc1f408ae20 2026-02-12T17:47:28.695 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): my global_id is 114260 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c40035e0 con 0x7fc1f408ae20 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 413269677 0 0) 0x7fc1f408d9c0 con 0x7fc1f408c730 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): my global_id is 124167 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1f405ca70 con 0x7fc1f408c730 2026-02-12T17:47:28.696 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1f9988640 1 -- 10.20.193.57:0/101961833 >> v1:10.20.193.82:6789/0 conn(0x7fc1f408cb30 legacy=0x7fc1f4089940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2647406515 0 0) 0x7fc1c40035e0 con 0x7fc1f408ae20 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1f408d9c0 con 0x7fc1f408ae20 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1e4002f90 con 0x7fc1f408ae20 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): dump: 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1513429427 0 0) 0x7fc1f405ca70 con 0x7fc1f408c730 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1c40035e0 con 0x7fc1f408c730 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1e8003340 con 0x7fc1f408c730 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient(hunting): dump: 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2882493257 0 0) 0x7fc1f408d9c0 con 0x7fc1f408ae20 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 >> v1:10.20.193.82:6789/0 conn(0x7fc1f408cb30 legacy=0x7fc1f4089940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 >> v1:10.20.193.57:6789/0 conn(0x7fc1f408c730 legacy=0x7fc1f4089230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 monclient: found mon.c 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f411e940 con 0x7fc1f408ae20 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient: _finish_auth 0 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:47:28.697 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1fb412640 5 monclient: authenticate success, global_id 114260 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1fb412640 10 monclient: _renew_subs 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1fb412640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.699+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f405ae90 con 0x7fc1f408ae20 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1fb412640 10 monclient: _renew_subs 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1fb412640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1f411e660 con 0x7fc1f408ae20 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1e4004eb0 con 0x7fc1f408ae20 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc1e4005240 con 0x7fc1f408ae20 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1e1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1e1ffb640 10 monclient: dump: 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1e37fe640 4 set_mon_vals no callback set 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1fb412640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1fb412640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1fb412640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f40008d0 con 0x7fc1f408ae20 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fc1e40053e0 con 0x7fc1f408ae20 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.700+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fc1e404ec40 con 0x7fc1f408ae20 2026-02-12T17:47:28.698 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.701+0000 7fc1f8986640 10 monclient: get_auth_request con 0x7fc1c403fa30 auth_method 0 2026-02-12T17:47:28.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.703+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fc1e40174d0 con 0x7fc1f408ae20 2026-02-12T17:47:28.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.703+0000 7fc1e1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.699 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.703+0000 7fc1e1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:28.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.803+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1f408d840 con 0x7fc1c403fa30 2026-02-12T17:47:28.800 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.804+0000 7fc1e1ffb640 1 -- 10.20.193.57:0/101961833 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33996 (unknown 2965378022 0 2550146449) 0x7fc1e80088b0 con 0x7fc1c403fa30 2026-02-12T17:47:28.801 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:47:28.801 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:47:28.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.805+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 >> v1:10.20.193.82:6800/2441377515 conn(0x7fc1c403fa30 legacy=0x7fc1c405fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.802 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.805+0000 7fc1fb412640 10 monclient: shutdown 2026-02-12T17:47:28.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.805+0000 7fc1fb412640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:28.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.805+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 >> v1:10.20.193.57:6790/0 conn(0x7fc1f408ae20 legacy=0x7fc1f4088b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.805+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 shutdown_connections 2026-02-12T17:47:28.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.805+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 >> 10.20.193.57:0/101961833 conn(0x7fc1f4091620 msgr2=0x7fc1f405cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:28.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.805+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 shutdown_connections 2026-02-12T17:47:28.803 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.805+0000 7fc1fb412640 1 -- 10.20.193.57:0/101961833 wait complete. 2026-02-12T17:47:28.809 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":1466,"stamp":"2026-02-12T17:47:27.958398+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":265168,"kb_used_data":13168,"kb_used_omap":10389,"kb_used_meta":241514,"kb_avail":565965872,"statfs":{"total":579820584960,"available":579549052928,"internally_reserved":0,"allocated":13484032,"data_stored":7867822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10638613,"internal_metadata":247311083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000974"},"pg_stats":[{"pgid":"1.0","version":"14'112","reported_seq":1868,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907630+0000","last_change":"2026-02-12T17:28:13.575533+0000","last_active":"2026-02-12T17:46:01.907630+0000","last_peered":"2026-02-12T17:46:01.907630+0000","last_clean":"2026-02-12T17:46:01.907630+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:46:01.907630+0000","last_undegraded":"2026-02-12T17:46:01.907630+0000","last_fullsized":"2026-02-12T17:46:01.907630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_clean_scrub_stamp":"2026-02-12T17:28:11.958332+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:10:01.188074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1737,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907764+0000","last_change":"2026-02-12T17:28:19.283491+0000","last_active":"2026-02-12T17:46:01.907764+0000","last_peered":"2026-02-12T17:46:01.907764+0000","last_clean":"2026-02-12T17:46:01.907764+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:46:01.907764+0000","last_undegraded":"2026-02-12T17:46:01.907764+0000","last_fullsized":"2026-02-12T17:46:01.907764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:53.711374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1731,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907625+0000","last_change":"2026-02-12T17:28:19.724210+0000","last_active":"2026-02-12T17:46:01.907625+0000","last_peered":"2026-02-12T17:46:01.907625+0000","last_clean":"2026-02-12T17:46:01.907625+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:46:01.907625+0000","last_undegraded":"2026-02-12T17:46:01.907625+0000","last_fullsized":"2026-02-12T17:46:01.907625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:54.193528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1736,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912653+0000","last_change":"2026-02-12T17:28:19.286905+0000","last_active":"2026-02-12T17:46:01.912653+0000","last_peered":"2026-02-12T17:46:01.912653+0000","last_clean":"2026-02-12T17:46:01.912653+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:46:01.912653+0000","last_undegraded":"2026-02-12T17:46:01.912653+0000","last_fullsized":"2026-02-12T17:46:01.912653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:35.531511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1738,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907749+0000","last_change":"2026-02-12T17:28:19.283404+0000","last_active":"2026-02-12T17:46:01.907749+0000","last_peered":"2026-02-12T17:46:01.907749+0000","last_clean":"2026-02-12T17:46:01.907749+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:46:01.907749+0000","last_undegraded":"2026-02-12T17:46:01.907749+0000","last_fullsized":"2026-02-12T17:46:01.907749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:24:22.204036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1746,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912771+0000","last_change":"2026-02-12T17:28:19.289250+0000","last_active":"2026-02-12T17:46:01.912771+0000","last_peered":"2026-02-12T17:46:01.912771+0000","last_clean":"2026-02-12T17:46:01.912771+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:46:01.912771+0000","last_undegraded":"2026-02-12T17:46:01.912771+0000","last_fullsized":"2026-02-12T17:46:01.912771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:19:32.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1731,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907624+0000","last_change":"2026-02-12T17:28:19.724251+0000","last_active":"2026-02-12T17:46:01.907624+0000","last_peered":"2026-02-12T17:46:01.907624+0000","last_clean":"2026-02-12T17:46:01.907624+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:46:01.907624+0000","last_undegraded":"2026-02-12T17:46:01.907624+0000","last_fullsized":"2026-02-12T17:46:01.907624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:31:06.358030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1745,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912705+0000","last_change":"2026-02-12T17:28:19.289150+0000","last_active":"2026-02-12T17:46:01.912705+0000","last_peered":"2026-02-12T17:46:01.912705+0000","last_clean":"2026-02-12T17:46:01.912705+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:46:01.912705+0000","last_undegraded":"2026-02-12T17:46:01.912705+0000","last_fullsized":"2026-02-12T17:46:01.912705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:34:03.582232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1730,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907605+0000","last_change":"2026-02-12T17:28:19.724309+0000","last_active":"2026-02-12T17:46:01.907605+0000","last_peered":"2026-02-12T17:46:01.907605+0000","last_clean":"2026-02-12T17:46:01.907605+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:46:01.907605+0000","last_undegraded":"2026-02-12T17:46:01.907605+0000","last_fullsized":"2026-02-12T17:46:01.907605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:21:16.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640490,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":2093,"kb_used_meta":42898,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2144108,"internal_metadata":43927700},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640489,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":2158,"kb_used_meta":42833,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2210741,"internal_metadata":43861067},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640492,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29500,"kb_used_data":2540,"kb_used_omap":938,"kb_used_meta":26005,"kb_avail":94342340,"statfs":{"total":96636764160,"available":96606556160,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":961349,"internal_metadata":26629307},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640490,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":1995,"kb_used_meta":42996,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2043800,"internal_metadata":44028008},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":1501,"kb_used_meta":43490,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1537281,"internal_metadata":44534527},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640490,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47548,"kb_used_data":2540,"kb_used_omap":1700,"kb_used_meta":43291,"kb_avail":94324292,"statfs":{"total":96636764160,"available":96588075008,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1741334,"internal_metadata":44330474},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:47:28.811 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T17:47:28.811 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:47:28.875 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient: get_monmap_and_config 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient: build_initial_monmap 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient: monmap: 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:28.879896+0000 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:28.879896+0000 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:28.876 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:28.877 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.885 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 1 Processor -- start 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 1 -- start start 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient: init 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient(hunting): picked mon.noname-a con 0x7fe53c08ae20 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient(hunting): picked mon.noname-b con 0x7fe53c08c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient(hunting): picked mon.noname-c con 0x7fe53c08cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53c08d600 con 0x7fe53c08ae20 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53c08b1f0 con 0x7fe53c08cb30 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53c08d1f0 con 0x7fe53c08c730 2026-02-12T17:47:28.886 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe543794640 10 monclient(hunting): authenticate will time out at 1728.698807s 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe541509640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fe53c08ae20 0x7fe53c08c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39388/0 (socket says 10.20.193.57:39388) 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe541509640 1 -- 10.20.193.57:0/867360174 learned_addr learned my addr 10.20.193.57:0/867360174 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.879+0000 7fe540d08640 1 --1- 10.20.193.57:0/867360174 >> v1:10.20.193.57:6790/0 conn(0x7fe53c08c730 0x7fe53c181be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54670/0 (socket says 10.20.193.57:54670) 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe540d08640 1 -- 10.20.193.57:0/867360174 >> v1:10.20.193.57:6790/0 conn(0x7fe53c08c730 legacy=0x7fe53c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe541509640 1 -- 10.20.193.57:0/867360174 >> v1:10.20.193.57:6789/0 conn(0x7fe53c08ae20 legacy=0x7fe53c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe541d0a640 1 -- 10.20.193.57:0/867360174 >> v1:10.20.193.82:6789/0 conn(0x7fe53c08cb30 legacy=0x7fe53c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 714022952 0 0) 0x7fe53c08d1f0 con 0x7fe53c08c730 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.887 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient(hunting): my global_id is 114263 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5240035e0 con 0x7fe53c08c730 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919284218 0 0) 0x7fe53c08d600 con 0x7fe53c08ae20 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient(hunting): my global_id is 124170 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe53c08d1f0 con 0x7fe53c08ae20 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1254260792 0 0) 0x7fe5240035e0 con 0x7fe53c08c730 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 >> v1:10.20.193.82:6789/0 conn(0x7fe53c08cb30 legacy=0x7fe53c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 >> v1:10.20.193.57:6789/0 conn(0x7fe53c08ae20 legacy=0x7fe53c08c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.888 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 monclient: found mon.noname-b 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53c057320 con 0x7fe53c08c730 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: _finish_auth 0 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe5300030c0 con 0x7fe53c08c730 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: dump: 2026-02-12T17:47:28.889 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 5 monclient: authenticate success, global_id 114263 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:28.890 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe530003350 con 0x7fe53c08c730 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 1 -- 10.20.193.57:0/867360174 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe5300048a0 con 0x7fe53c08c730 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe52bfff640 10 monclient: dump: 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.891 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 4 set_mon_vals no callback set 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 10 monclient: shutdown 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 1 -- 10.20.193.57:0/867360174 >> v1:10.20.193.57:6790/0 conn(0x7fe53c08c730 legacy=0x7fe53c181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 1 -- 10.20.193.57:0/867360174 shutdown_connections 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 1 -- 10.20.193.57:0/867360174 >> 10.20.193.57:0/867360174 conn(0x7fe53c091620 msgr2=0x7fe53c091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 1 -- 10.20.193.57:0/867360174 shutdown_connections 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.882+0000 7fe543794640 1 -- 10.20.193.57:0/867360174 wait complete. 2026-02-12T17:47:28.892 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient: build_initial_monmap 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient: monmap: 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.893 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 1 Processor -- start 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 1 -- start start 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient: init 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient(hunting): picked mon.noname-b con 0x7fe53c08ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient(hunting): picked mon.noname-c con 0x7fe53c08c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient(hunting): picked mon.noname-a con 0x7fe53c08cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53c08d9c0 con 0x7fe53c08cb30 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53c083310 con 0x7fe53c08ae20 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe53c05b190 con 0x7fe53c08c730 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe543794640 10 monclient(hunting): authenticate will time out at 1728.702831s 2026-02-12T17:47:28.894 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe540d08640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe53c08c730 0x7fe53c194130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54672/0 (socket says 10.20.193.57:54672) 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.883+0000 7fe540d08640 1 -- 10.20.193.57:0/479317144 learned_addr learned my addr 10.20.193.57:0/479317144 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.885+0000 7fe540d08640 1 -- 10.20.193.57:0/479317144 >> v1:10.20.193.57:6790/0 conn(0x7fe53c08c730 legacy=0x7fe53c194130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.885+0000 7fe541d0a640 1 -- 10.20.193.57:0/479317144 >> v1:10.20.193.57:6789/0 conn(0x7fe53c08cb30 legacy=0x7fe53c195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557065527 0 0) 0x7fe53c05b190 con 0x7fe53c08c730 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): my global_id is 114266 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe50c0035e0 con 0x7fe53c08c730 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825155361 0 0) 0x7fe53c08d9c0 con 0x7fe53c08cb30 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.895 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): my global_id is 124173 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe53c05b190 con 0x7fe53c08cb30 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe541509640 1 -- 10.20.193.57:0/479317144 >> v1:10.20.193.82:6789/0 conn(0x7fe53c08ae20 legacy=0x7fe53c086ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2509548817 0 0) 0x7fe50c0035e0 con 0x7fe53c08c730 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe53c08d9c0 con 0x7fe53c08c730 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe5300048a0 con 0x7fe53c08c730 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): dump: 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.896 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2479045941 0 0) 0x7fe53c05b190 con 0x7fe53c08cb30 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe50c0035e0 con 0x7fe53c08cb30 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe538004420 con 0x7fe53c08cb30 2026-02-12T17:47:28.897 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): dump: 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.898 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959671541 0 0) 0x7fe53c083310 con 0x7fe53c08ae20 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient(hunting): my global_id is 5359 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe53c05b190 con 0x7fe53c08ae20 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2682189626 0 0) 0x7fe53c08d9c0 con 0x7fe53c08c730 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 >> v1:10.20.193.82:6789/0 conn(0x7fe53c08ae20 legacy=0x7fe53c086ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 >> v1:10.20.193.57:6789/0 conn(0x7fe53c08cb30 legacy=0x7fe53c195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 monclient: found mon.c 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:28.899 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53c088810 con 0x7fe53c08c730 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient: _finish_auth 0 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe543794640 5 monclient: authenticate success, global_id 114266 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe543794640 10 monclient: _renew_subs 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe543794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe53c153480 con 0x7fe53c08c730 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe543794640 10 monclient: _renew_subs 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe543794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe53c084dd0 con 0x7fe53c08c730 2026-02-12T17:47:28.900 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe530004e80 con 0x7fe53c08c730 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe5300051d0 con 0x7fe53c08c730 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe529ffb640 10 monclient: dump: 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:28.901 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.886+0000 7fe52b7fe640 4 set_mon_vals no callback set 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.887+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe530005460 con 0x7fe53c08c730 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.887+0000 7fe543794640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.887+0000 7fe543794640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.887+0000 7fe543794640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.887+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe53c083e70 con 0x7fe53c08c730 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.887+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fe53004ec40 con 0x7fe53c08c730 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.887+0000 7fe541509640 10 monclient: get_auth_request con 0x7fe50c03fd20 auth_method 0 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.889+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fe5300174d0 con 0x7fe53c08c730 2026-02-12T17:47:28.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.889+0000 7fe529ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:28.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.889+0000 7fe529ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:28.991 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.994+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe53c08d840 con 0x7fe50c03fd20 2026-02-12T17:47:28.992 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.995+0000 7fe529ffb640 1 -- 10.20.193.57:0/479317144 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33996 (unknown 2965378022 0 2550146449) 0x7fe52c0030b0 con 0x7fe50c03fd20 2026-02-12T17:47:28.992 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:47:28.993 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:47:28.993 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.996+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe50c03fd20 legacy=0x7fe50c0601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.996+0000 7fe543794640 10 monclient: shutdown 2026-02-12T17:47:28.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.996+0000 7fe543794640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:28.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.996+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 >> v1:10.20.193.57:6790/0 conn(0x7fe53c08c730 legacy=0x7fe53c194130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:28.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.996+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 shutdown_connections 2026-02-12T17:47:28.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.996+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 >> 10.20.193.57:0/479317144 conn(0x7fe53c091620 msgr2=0x7fe53c0597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:28.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.996+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 shutdown_connections 2026-02-12T17:47:28.994 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:28.996+0000 7fe543794640 1 -- 10.20.193.57:0/479317144 wait complete. 2026-02-12T17:47:29.001 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":1466,"stamp":"2026-02-12T17:47:27.958398+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":265168,"kb_used_data":13168,"kb_used_omap":10389,"kb_used_meta":241514,"kb_avail":565965872,"statfs":{"total":579820584960,"available":579549052928,"internally_reserved":0,"allocated":13484032,"data_stored":7867822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10638613,"internal_metadata":247311083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000974"},"pg_stats":[{"pgid":"1.0","version":"14'112","reported_seq":1868,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907630+0000","last_change":"2026-02-12T17:28:13.575533+0000","last_active":"2026-02-12T17:46:01.907630+0000","last_peered":"2026-02-12T17:46:01.907630+0000","last_clean":"2026-02-12T17:46:01.907630+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:46:01.907630+0000","last_undegraded":"2026-02-12T17:46:01.907630+0000","last_fullsized":"2026-02-12T17:46:01.907630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_clean_scrub_stamp":"2026-02-12T17:28:11.958332+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:10:01.188074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1737,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907764+0000","last_change":"2026-02-12T17:28:19.283491+0000","last_active":"2026-02-12T17:46:01.907764+0000","last_peered":"2026-02-12T17:46:01.907764+0000","last_clean":"2026-02-12T17:46:01.907764+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:46:01.907764+0000","last_undegraded":"2026-02-12T17:46:01.907764+0000","last_fullsized":"2026-02-12T17:46:01.907764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:53.711374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1731,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907625+0000","last_change":"2026-02-12T17:28:19.724210+0000","last_active":"2026-02-12T17:46:01.907625+0000","last_peered":"2026-02-12T17:46:01.907625+0000","last_clean":"2026-02-12T17:46:01.907625+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:46:01.907625+0000","last_undegraded":"2026-02-12T17:46:01.907625+0000","last_fullsized":"2026-02-12T17:46:01.907625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:54.193528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1736,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912653+0000","last_change":"2026-02-12T17:28:19.286905+0000","last_active":"2026-02-12T17:46:01.912653+0000","last_peered":"2026-02-12T17:46:01.912653+0000","last_clean":"2026-02-12T17:46:01.912653+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:46:01.912653+0000","last_undegraded":"2026-02-12T17:46:01.912653+0000","last_fullsized":"2026-02-12T17:46:01.912653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:35.531511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1738,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907749+0000","last_change":"2026-02-12T17:28:19.283404+0000","last_active":"2026-02-12T17:46:01.907749+0000","last_peered":"2026-02-12T17:46:01.907749+0000","last_clean":"2026-02-12T17:46:01.907749+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:46:01.907749+0000","last_undegraded":"2026-02-12T17:46:01.907749+0000","last_fullsized":"2026-02-12T17:46:01.907749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:24:22.204036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1746,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912771+0000","last_change":"2026-02-12T17:28:19.289250+0000","last_active":"2026-02-12T17:46:01.912771+0000","last_peered":"2026-02-12T17:46:01.912771+0000","last_clean":"2026-02-12T17:46:01.912771+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:46:01.912771+0000","last_undegraded":"2026-02-12T17:46:01.912771+0000","last_fullsized":"2026-02-12T17:46:01.912771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:19:32.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1731,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907624+0000","last_change":"2026-02-12T17:28:19.724251+0000","last_active":"2026-02-12T17:46:01.907624+0000","last_peered":"2026-02-12T17:46:01.907624+0000","last_clean":"2026-02-12T17:46:01.907624+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:46:01.907624+0000","last_undegraded":"2026-02-12T17:46:01.907624+0000","last_fullsized":"2026-02-12T17:46:01.907624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:31:06.358030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1745,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912705+0000","last_change":"2026-02-12T17:28:19.289150+0000","last_active":"2026-02-12T17:46:01.912705+0000","last_peered":"2026-02-12T17:46:01.912705+0000","last_clean":"2026-02-12T17:46:01.912705+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:46:01.912705+0000","last_undegraded":"2026-02-12T17:46:01.912705+0000","last_fullsized":"2026-02-12T17:46:01.912705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:34:03.582232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1730,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907605+0000","last_change":"2026-02-12T17:28:19.724309+0000","last_active":"2026-02-12T17:46:01.907605+0000","last_peered":"2026-02-12T17:46:01.907605+0000","last_clean":"2026-02-12T17:46:01.907605+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:46:01.907605+0000","last_undegraded":"2026-02-12T17:46:01.907605+0000","last_fullsized":"2026-02-12T17:46:01.907605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:21:16.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640490,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":2093,"kb_used_meta":42898,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2144108,"internal_metadata":43927700},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640489,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":2158,"kb_used_meta":42833,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2210741,"internal_metadata":43861067},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640492,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29500,"kb_used_data":2540,"kb_used_omap":938,"kb_used_meta":26005,"kb_avail":94342340,"statfs":{"total":96636764160,"available":96606556160,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":961349,"internal_metadata":26629307},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640490,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":1995,"kb_used_meta":42996,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2043800,"internal_metadata":44028008},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640491,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":1501,"kb_used_meta":43490,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1537281,"internal_metadata":44534527},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640490,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47548,"kb_used_data":2540,"kb_used_omap":1700,"kb_used_meta":43291,"kb_avail":94324292,"statfs":{"total":96636764160,"available":96588075008,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1741334,"internal_metadata":44330474},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:47:29.003 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T17:47:29.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.070+0000 7f84092cc640 10 monclient: get_monmap_and_config 2026-02-12T17:47:29.067 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.070+0000 7f84092cc640 10 monclient: build_initial_monmap 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.070+0000 7f84092cc640 10 monclient: monmap: 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:29.071784+0000 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:29.071784+0000 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:29.068 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:29.077 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 1 Processor -- start 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 1 -- start start 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 10 monclient: init 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 10 monclient(hunting): picked mon.noname-b con 0x7f840408ae20 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 10 monclient(hunting): picked mon.noname-a con 0x7f840408c730 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 10 monclient(hunting): picked mon.noname-c con 0x7f840408cb30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840408d600 con 0x7f840408c730 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840408b1f0 con 0x7f840408cb30 2026-02-12T17:47:29.078 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840408d1f0 con 0x7f840408ae20 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f84092cc640 10 monclient(hunting): authenticate will time out at 1728.890679s 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f8402ffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f840408ae20 0x7f840408c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54676/0 (socket says 10.20.193.57:54676) 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.071+0000 7f8402ffd640 1 -- 10.20.193.57:0/3218227913 learned_addr learned my addr 10.20.193.57:0/3218227913 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.073+0000 7f8402ffd640 1 -- 10.20.193.57:0/3218227913 >> v1:10.20.193.57:6790/0 conn(0x7f840408ae20 legacy=0x7f840408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.073+0000 7f84027fc640 1 -- 10.20.193.57:0/3218227913 >> v1:10.20.193.57:6789/0 conn(0x7f840408c730 legacy=0x7f8404181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2103035197 0 0) 0x7f840408d1f0 con 0x7f840408ae20 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient(hunting): my global_id is 114269 2026-02-12T17:47:29.079 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83f00035e0 con 0x7f840408ae20 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84037fe640 1 -- 10.20.193.57:0/3218227913 >> v1:10.20.193.82:6789/0 conn(0x7f840408cb30 legacy=0x7f84041a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639932740 0 0) 0x7f840408d600 con 0x7f840408c730 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient(hunting): my global_id is 124176 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f840408d1f0 con 0x7f840408c730 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4209852020 0 0) 0x7f83f00035e0 con 0x7f840408ae20 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 >> v1:10.20.193.82:6789/0 conn(0x7f840408cb30 legacy=0x7f84041a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 >> v1:10.20.193.57:6789/0 conn(0x7f840408c730 legacy=0x7f8404181be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 monclient: found mon.noname-b 2026-02-12T17:47:29.080 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8404057320 con 0x7f840408ae20 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: _finish_auth 0 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f83f80030c0 con 0x7f840408ae20 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 5 monclient: authenticate success, global_id 114269 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: dump: 2026-02-12T17:47:29.081 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f83f8003350 con 0x7f840408ae20 2026-02-12T17:47:29.082 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 1 -- 10.20.193.57:0/3218227913 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f83f8004960 con 0x7f840408ae20 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 4 set_mon_vals no callback set 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f8401ffb640 10 monclient: dump: 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:29.083 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 10 monclient: shutdown 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 1 -- 10.20.193.57:0/3218227913 >> v1:10.20.193.57:6790/0 conn(0x7f840408ae20 legacy=0x7f840408c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 1 -- 10.20.193.57:0/3218227913 shutdown_connections 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 1 -- 10.20.193.57:0/3218227913 >> 10.20.193.57:0/3218227913 conn(0x7f8404091620 msgr2=0x7f8404091a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 1 -- 10.20.193.57:0/3218227913 shutdown_connections 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.074+0000 7f84092cc640 1 -- 10.20.193.57:0/3218227913 wait complete. 2026-02-12T17:47:29.084 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient: build_initial_monmap 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient: monmap: 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 1 Processor -- start 2026-02-12T17:47:29.085 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 1 -- start start 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient: init 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient(hunting): picked mon.noname-b con 0x7f840408ae20 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient(hunting): picked mon.noname-c con 0x7f840408c730 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient(hunting): picked mon.noname-a con 0x7f840408cb30 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840408d9c0 con 0x7f840408cb30 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8404087f80 con 0x7f840408ae20 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8404088810 con 0x7f840408c730 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84092cc640 10 monclient(hunting): authenticate will time out at 1728.894629s 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84027fc640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f840408c730 0x7f84041941a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54682/0 (socket says 10.20.193.57:54682) 2026-02-12T17:47:29.086 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.075+0000 7f84027fc640 1 -- 10.20.193.57:0/1263157866 learned_addr learned my addr 10.20.193.57:0/1263157866 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f84027fc640 1 -- 10.20.193.57:0/1263157866 >> v1:10.20.193.57:6790/0 conn(0x7f840408c730 legacy=0x7f84041941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f84037fe640 1 -- 10.20.193.57:0/1263157866 >> v1:10.20.193.57:6789/0 conn(0x7f840408cb30 legacy=0x7f84041958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895949181 0 0) 0x7f8404088810 con 0x7f840408c730 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 10 monclient(hunting): my global_id is 114272 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83d00035e0 con 0x7f840408c730 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080831237 0 0) 0x7f840408d9c0 con 0x7f840408cb30 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:29.087 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 10 monclient(hunting): my global_id is 124179 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.077+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8404088810 con 0x7f840408cb30 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 511307554 0 0) 0x7f83d00035e0 con 0x7f840408c730 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f8402ffd640 1 -- 10.20.193.57:0/1263157866 >> v1:10.20.193.82:6789/0 conn(0x7f840408ae20 legacy=0x7f8404086d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f840408d9c0 con 0x7f840408c730 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f83ec003450 con 0x7f840408c730 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient(hunting): dump: 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.088 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2826783946 0 0) 0x7f8404088810 con 0x7f840408cb30 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83d00035e0 con 0x7f840408cb30 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f83f4004420 con 0x7f840408cb30 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:29.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient(hunting): dump: 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3615122200 0 0) 0x7f840408d9c0 con 0x7f840408c730 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 >> v1:10.20.193.82:6789/0 conn(0x7f840408ae20 legacy=0x7f8404086d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:29.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 >> v1:10.20.193.57:6789/0 conn(0x7f840408cb30 legacy=0x7f84041958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient: _finish_hunting 0 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 monclient: found mon.c 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84040834a0 con 0x7f840408c730 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient: _finish_auth 0 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient: _check_auth_tickets 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 5 monclient: authenticate success, global_id 114272 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 10 monclient: _renew_subs 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:29.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8404085800 con 0x7f840408c730 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 10 monclient: _renew_subs 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8404084000 con 0x7f840408c730 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f83ec003b80 con 0x7f840408c730 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f83ec003750 con 0x7f840408c730 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 10 monclient: dump: 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:29.092 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84017fa640 4 set_mon_vals no callback set 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84040008d0 con 0x7f840408c730 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.078+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f83ec003fc0 con 0x7f840408c730 2026-02-12T17:47:29.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.079+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f83ec04ebc0 con 0x7f840408c730 2026-02-12T17:47:29.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.079+0000 7f8402ffd640 10 monclient: get_auth_request con 0x7f83d003fae0 auth_method 0 2026-02-12T17:47:29.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.081+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f83ec017450 con 0x7f840408c730 2026-02-12T17:47:29.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.081+0000 7f83e37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:29.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.081+0000 7f83e37fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:29.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.183+0000 7f84092cc640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:47:29.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.183+0000 7f84092cc640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:47:29.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.183+0000 7f84092cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:29.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.183+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f840408f520 con 0x7f840408c730 2026-02-12T17:47:29.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.184+0000 7f83e37fe640 1 -- 10.20.193.57:0/1263157866 <== mon.2 v1:10.20.193.57:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v887) ==== 74+0+10973 (unknown 3434166701 0 4047058713) 0x7f83ec016c00 con 0x7f840408c730 2026-02-12T17:47:29.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.184+0000 7f83e37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T17:47:29.181 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.184+0000 7f83e37fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:29.182 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:47:29.182 INFO:teuthology.orchestra.run.trial057.stdout:{"epoch":887,"fsid":"2c564c25-fc44-46b7-9900-7876a1cecb3c","created":"2026-02-12T17:28:03.716456+0000","modified":"2026-02-12T17:46:01.905701+0000","last_up_change":"2026-02-12T17:28:09.951573+0000","last_in_change":"2026-02-12T17:28:06.940287+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T17:28:11.851529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T17:28:14.923444+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"08ee67d7-4cf0-452b-a362-8a5526fccd74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6803","nonce":521925997}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6805","nonce":521925997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6807","nonce":521925997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6806","nonce":521925997}]},"public_addr":"10.20.193.57:6803/521925997","cluster_addr":"10.20.193.57:6805/521925997","heartbeat_back_addr":"10.20.193.57:6807/521925997","heartbeat_front_addr":"10.20.193.57:6806/521925997","state":["exists","up"]},{"osd":1,"uuid":"d2ec9481-5b72-4197-a3ed-b1029fb07580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6800","nonce":3025704390}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6801","nonce":3025704390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6804","nonce":3025704390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6802","nonce":3025704390}]},"public_addr":"10.20.193.57:6800/3025704390","cluster_addr":"10.20.193.57:6801/3025704390","heartbeat_back_addr":"10.20.193.57:6804/3025704390","heartbeat_front_addr":"10.20.193.57:6802/3025704390","state":["exists","up"]},{"osd":2,"uuid":"7c4fc08e-2278-4ba2-9a73-c204f6d4f8a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6808","nonce":3129121469}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6809","nonce":3129121469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6811","nonce":3129121469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.57:6810","nonce":3129121469}]},"public_addr":"10.20.193.57:6808/3129121469","cluster_addr":"10.20.193.57:6809/3129121469","heartbeat_back_addr":"10.20.193.57:6811/3129121469","heartbeat_front_addr":"10.20.193.57:6810/3129121469","state":["exists","up"]},{"osd":3,"uuid":"108524be-58bc-4950-b88f-d85dfa77ef48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6801","nonce":634754599}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6802","nonce":634754599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6804","nonce":634754599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6803","nonce":634754599}]},"public_addr":"10.20.193.82:6801/634754599","cluster_addr":"10.20.193.82:6802/634754599","heartbeat_back_addr":"10.20.193.82:6804/634754599","heartbeat_front_addr":"10.20.193.82:6803/634754599","state":["exists","up"]},{"osd":4,"uuid":"e9bb983d-b2d5-4543-a960-f450bede62cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6805","nonce":687524042}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6806","nonce":687524042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6808","nonce":687524042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6807","nonce":687524042}]},"public_addr":"10.20.193.82:6805/687524042","cluster_addr":"10.20.193.82:6806/687524042","heartbeat_back_addr":"10.20.193.82:6808/687524042","heartbeat_front_addr":"10.20.193.82:6807/687524042","state":["exists","up"]},{"osd":5,"uuid":"047804d0-f125-4ef6-ac99-8f8ed7d594ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6809","nonce":1303150362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6810","nonce":1303150362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6812","nonce":1303150362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.82:6811","nonce":1303150362}]},"public_addr":"10.20.193.82:6809/1303150362","cluster_addr":"10.20.193.82:6810/1303150362","heartbeat_back_addr":"10.20.193.82:6812/1303150362","heartbeat_front_addr":"10.20.193.82:6811/1303150362","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.696209+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.707695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.711747+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.625181+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.672050+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T17:28:08.673463+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":402,"length":1},{"begin":413,"length":1},{"begin":419,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T17:47:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.185+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 >> v1:10.20.193.82:6800/2441377515 conn(0x7f83d003fae0 legacy=0x7f83d005ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.185+0000 7f84092cc640 10 monclient: shutdown 2026-02-12T17:47:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.185+0000 7f84092cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.185+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 >> v1:10.20.193.57:6790/0 conn(0x7f840408c730 legacy=0x7f84041941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.185+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 shutdown_connections 2026-02-12T17:47:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.185+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 >> 10.20.193.57:0/1263157866 conn(0x7f8404091620 msgr2=0x7f8404089310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.185+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 shutdown_connections 2026-02-12T17:47:29.183 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:29.185+0000 7f84092cc640 1 -- 10.20.193.57:0/1263157866 wait complete. 2026-02-12T17:47:30.191 INFO:tasks.ceph:Scrubbing osd.0 2026-02-12T17:47:30.192 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-12T17:47:30.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.265+0000 7f0e1ab0c640 10 monclient: get_monmap_and_config 2026-02-12T17:47:30.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.265+0000 7f0e1ab0c640 10 monclient: build_initial_monmap 2026-02-12T17:47:30.263 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.265+0000 7f0e1ab0c640 10 monclient: monmap: 2026-02-12T17:47:30.263 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:30.263 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.263 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:30.266257+0000 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:30.266257+0000 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.265+0000 7f0e1ab0c640 1 Processor -- start 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.265+0000 7f0e1ab0c640 1 -- start start 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.265+0000 7f0e1ab0c640 10 monclient: init 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:30.264 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 10 monclient(hunting): picked mon.noname-b con 0x7f0e1408bf10 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 10 monclient(hunting): picked mon.noname-c con 0x7f0e1408cf60 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 10 monclient(hunting): picked mon.noname-a con 0x7f0e1408c9f0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e14085510 con 0x7f0e1408c9f0 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e14086290 con 0x7f0e1408cf60 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e140859f0 con 0x7f0e1408bf10 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e1ab0c640 10 monclient(hunting): authenticate will time out at 1730.085166s 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e18881640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f0e1408bf10 0x7f0e1408c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54688/0 (socket says 10.20.193.57:54688) 2026-02-12T17:47:30.265 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.266+0000 7f0e18881640 1 -- 10.20.193.57:0/3723402935 learned_addr learned my addr 10.20.193.57:0/3723402935 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:30.273 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e18881640 1 -- 10.20.193.57:0/3723402935 >> v1:10.20.193.57:6790/0 conn(0x7f0e1408bf10 legacy=0x7f0e1408c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e19082640 1 -- 10.20.193.57:0/3723402935 >> v1:10.20.193.57:6789/0 conn(0x7f0e1408c9f0 legacy=0x7f0e141a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065760683 0 0) 0x7f0e140859f0 con 0x7f0e1408bf10 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient(hunting): my global_id is 114275 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e000035e0 con 0x7f0e1408bf10 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0bfff640 1 -- 10.20.193.57:0/3723402935 >> v1:10.20.193.82:6789/0 conn(0x7f0e1408cf60 legacy=0x7f0e14181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081256402 0 0) 0x7f0e14085510 con 0x7f0e1408c9f0 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:30.274 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient(hunting): my global_id is 124182 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e140859f0 con 0x7f0e1408c9f0 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 469737460 0 0) 0x7f0e000035e0 con 0x7f0e1408bf10 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 >> v1:10.20.193.82:6789/0 conn(0x7f0e1408cf60 legacy=0x7f0e14181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 >> v1:10.20.193.57:6789/0 conn(0x7f0e1408c9f0 legacy=0x7f0e141a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: _finish_hunting 0 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 monclient: found mon.noname-b 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1408d3e0 con 0x7f0e1408bf10 2026-02-12T17:47:30.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: _finish_auth 0 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: _check_auth_tickets 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e04003150 con 0x7f0e1408bf10 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: dump: 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:30.276 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e1ab0c640 5 monclient: authenticate success, global_id 114275 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e1ab0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e040033a0 con 0x7f0e1408bf10 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 1 -- 10.20.193.57:0/3723402935 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e04004b10 con 0x7f0e1408bf10 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:30.277 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e0b7fe640 10 monclient: dump: 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e1ab0c640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:30.278 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.268+0000 7f0e1ab0c640 4 set_mon_vals no callback set 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 10 monclient: shutdown 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/3723402935 >> v1:10.20.193.57:6790/0 conn(0x7f0e1408bf10 legacy=0x7f0e1408c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/3723402935 shutdown_connections 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/3723402935 >> 10.20.193.57:0/3723402935 conn(0x7f0e14091510 msgr2=0x7f0e14091910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/3723402935 shutdown_connections 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/3723402935 wait complete. 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 10 monclient: build_initial_monmap 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 10 monclient: monmap: 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:30.279 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 1 Processor -- start 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 1 -- start start 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.269+0000 7f0e1ab0c640 10 monclient: init 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:30.280 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 10 monclient(hunting): picked mon.noname-a con 0x7f0e1408bf10 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 10 monclient(hunting): picked mon.noname-b con 0x7f0e1408c9f0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 10 monclient(hunting): picked mon.noname-c con 0x7f0e1408cf60 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e140588c0 con 0x7f0e1408bf10 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1407eb10 con 0x7f0e1408c9f0 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e14080e70 con 0x7f0e1408cf60 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e1ab0c640 10 monclient(hunting): authenticate will time out at 1730.089202s 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e18881640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f0e1408bf10 0x7f0e14150dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39444/0 (socket says 10.20.193.57:39444) 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.270+0000 7f0e18881640 1 -- 10.20.193.57:0/634245337 learned_addr learned my addr 10.20.193.57:0/634245337 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:30.281 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e18881640 1 -- 10.20.193.57:0/634245337 >> v1:10.20.193.57:6789/0 conn(0x7f0e1408bf10 legacy=0x7f0e14150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e19082640 1 -- 10.20.193.57:0/634245337 >> v1:10.20.193.57:6790/0 conn(0x7f0e1408cf60 legacy=0x7f0e141937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4084760126 0 0) 0x7f0e14080e70 con 0x7f0e1408cf60 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 10 monclient(hunting): my global_id is 114278 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de40035e0 con 0x7f0e1408cf60 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458647754 0 0) 0x7f0e140588c0 con 0x7f0e1408bf10 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:30.282 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 10 monclient(hunting): my global_id is 124185 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e0bfff640 1 -- 10.20.193.57:0/634245337 >> v1:10.20.193.82:6789/0 conn(0x7f0e1408c9f0 legacy=0x7f0e141920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e14080e70 con 0x7f0e1408bf10 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.272+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 DispatchQueue::entry inject delay of 0.002000 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1109069420 0 0) 0x7f0de40035e0 con 0x7f0e1408cf60 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e140588c0 con 0x7f0e1408cf60 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2479470329 0 0) 0x7f0e14080e70 con 0x7f0e1408bf10 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0de40035e0 con 0x7f0e1408bf10 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904220013 0 0) 0x7f0e1407eb10 con 0x7f0e1408c9f0 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): my global_id is 5371 2026-02-12T17:47:30.283 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e14080e70 con 0x7f0e1408c9f0 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e10004490 con 0x7f0e1408cf60 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): dump: 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:30.284 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e04002fa0 con 0x7f0e1408bf10 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient(hunting): dump: 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.285 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1121320829 0 0) 0x7f0e140588c0 con 0x7f0e1408cf60 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 >> v1:10.20.193.82:6789/0 conn(0x7f0e1408c9f0 legacy=0x7f0e141920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 >> v1:10.20.193.57:6789/0 conn(0x7f0e1408bf10 legacy=0x7f0e14150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient: _finish_hunting 0 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 monclient: found mon.c 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:30.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1405df40 con 0x7f0e1408cf60 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient: _finish_auth 0 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient: _check_auth_tickets 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e1ab0c640 5 monclient: authenticate success, global_id 114278 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e1ab0c640 10 monclient: _renew_subs 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e1ab0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e14088700 con 0x7f0e1408cf60 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e1ab0c640 10 monclient: _renew_subs 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e1ab0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e1407f670 con 0x7f0e1408cf60 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e10004a60 con 0x7f0e1408cf60 2026-02-12T17:47:30.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f0e10004630 con 0x7f0e1408cf60 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e097fa640 10 monclient: dump: 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:30.288 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.274+0000 7f0e0affd640 4 set_mon_vals no callback set 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.275+0000 7f0e1ab0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.275+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0e1408aed0 con 0x7f0e1408cf60 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.275+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f0e10004eb0 con 0x7f0e1408cf60 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.275+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f0e1004fad0 con 0x7f0e1408cf60 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.275+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6803/521925997 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0de40865a0 con 0x7f0de4064940 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.275+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_get_version_reply(handle=1 version=887) ==== 24+0+0 (unknown 3331530905 0 0) 0x7f0e1004fe80 con 0x7f0e1408cf60 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.275+0000 7f0e097fa640 10 monclient: handle_get_version_reply finishing 1 version 887 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.275+0000 7f0e0bfff640 10 monclient: get_auth_request con 0x7f0de4064940 auth_method 0 2026-02-12T17:47:30.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.276+0000 7f0e18881640 10 monclient: get_auth_request con 0x7f0de403fd30 auth_method 0 2026-02-12T17:47:30.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.280+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== osd.0 v1:10.20.193.57:6803/521925997 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f0de40865a0 con 0x7f0de4064940 2026-02-12T17:47:30.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.287+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 --> v1:10.20.193.57:6803/521925997 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0e1408f640 con 0x7f0de4064940 2026-02-12T17:47:30.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e097fa640 1 -- 10.20.193.57:0/634245337 <== osd.0 v1:10.20.193.57:6803/521925997 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f0e1408f640 con 0x7f0de4064940 2026-02-12T17:47:30.291 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:47:30.291 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T17:47:30.291 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:47:30.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 >> v1:10.20.193.57:6803/521925997 conn(0x7f0de4064940 legacy=0x7f0de4084d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 >> v1:10.20.193.82:6800/2441377515 conn(0x7f0de403fd30 legacy=0x7f0de40601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e1ab0c640 10 monclient: shutdown 2026-02-12T17:47:30.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e1ab0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:30.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 >> v1:10.20.193.57:6790/0 conn(0x7f0e1408cf60 legacy=0x7f0e141937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e19082640 1 -- 10.20.193.57:0/634245337 reap_dead start 2026-02-12T17:47:30.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 shutdown_connections 2026-02-12T17:47:30.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 >> 10.20.193.57:0/634245337 conn(0x7f0e14091510 msgr2=0x7f0e1405d400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:30.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 shutdown_connections 2026-02-12T17:47:30.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.288+0000 7f0e1ab0c640 1 -- 10.20.193.57:0/634245337 wait complete. 2026-02-12T17:47:30.294 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-12T17:47:30.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.363+0000 7f52140cc640 10 monclient: get_monmap_and_config 2026-02-12T17:47:30.360 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.363+0000 7f52140cc640 10 monclient: build_initial_monmap 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.363+0000 7f52140cc640 10 monclient: monmap: 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:30.364396+0000 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:30.364396+0000 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:30.361 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:30.362 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.363+0000 7f52140cc640 1 Processor -- start 2026-02-12T17:47:30.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 1 -- start start 2026-02-12T17:47:30.362 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 10 monclient: init 2026-02-12T17:47:30.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:30.370 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 10 monclient(hunting): picked mon.noname-c con 0x7f520c087e30 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 10 monclient(hunting): picked mon.noname-b con 0x7f520c085920 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 10 monclient(hunting): picked mon.noname-a con 0x7f520c088200 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520c05ed40 con 0x7f520c088200 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520c085da0 con 0x7f520c087e30 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520c087400 con 0x7f520c085920 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f52140cc640 10 monclient(hunting): authenticate will time out at 1730.183333s 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f5211640640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f520c085920 0x7f520c183a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54704/0 (socket says 10.20.193.57:54704) 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f5211640640 1 -- 10.20.193.57:0/99647072 learned_addr learned my addr 10.20.193.57:0/99647072 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.364+0000 7f5212642640 1 --1- 10.20.193.57:0/99647072 >> v1:10.20.193.57:6789/0 conn(0x7f520c088200 0x7f520c1a51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39456/0 (socket says 10.20.193.57:39456) 2026-02-12T17:47:30.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5212642640 1 -- 10.20.193.57:0/99647072 >> v1:10.20.193.57:6789/0 conn(0x7f520c088200 legacy=0x7f520c1a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5211640640 1 -- 10.20.193.57:0/99647072 >> v1:10.20.193.57:6790/0 conn(0x7f520c085920 legacy=0x7f520c183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198697969 0 0) 0x7f520c05ed40 con 0x7f520c088200 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient(hunting): _negotiate 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient(hunting): my global_id is 124188 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51f40035e0 con 0x7f520c088200 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5211e41640 1 -- 10.20.193.57:0/99647072 >> v1:10.20.193.82:6789/0 conn(0x7f520c087e30 legacy=0x7f520c142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3871735718 0 0) 0x7f520c087400 con 0x7f520c085920 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient(hunting): _negotiate 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:30.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient(hunting): my global_id is 114281 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f520c05ed40 con 0x7f520c085920 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3998024141 0 0) 0x7f520c05ed40 con 0x7f520c085920 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 >> v1:10.20.193.82:6789/0 conn(0x7f520c087e30 legacy=0x7f520c142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 >> v1:10.20.193.57:6789/0 conn(0x7f520c088200 legacy=0x7f520c1a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient: _finish_hunting 0 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 monclient: found mon.noname-b 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520c1434a0 con 0x7f520c085920 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient: _finish_auth 0 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient: _check_auth_tickets 2026-02-12T17:47:30.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5200003150 con 0x7f520c085920 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 10 monclient: dump: 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:30.374 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f52140cc640 5 monclient: authenticate success, global_id 114281 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f52140cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5211640640 1 --1- 10.20.193.57:0/99647072 >> v1:10.20.193.57:6790/0 conn(0x7f520c085920 0x7f520c183a80 :-1 s=OPENED pgs=372 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f52000033a0 config(0 keys) 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.366+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52000033a0 con 0x7f520c085920 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f5210e3f640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 4 set_mon_vals no callback set 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 10 monclient: shutdown 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:30.375 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 1 -- 10.20.193.57:0/99647072 >> v1:10.20.193.57:6790/0 conn(0x7f520c085920 legacy=0x7f520c183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f5210e3f640 1 -- 10.20.193.57:0/99647072 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5200004b10 con 0x7f520c085920 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f5210e3f640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 1 -- 10.20.193.57:0/99647072 shutdown_connections 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 1 -- 10.20.193.57:0/99647072 >> 10.20.193.57:0/99647072 conn(0x7f520c0916b0 msgr2=0x7f520c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 1 -- 10.20.193.57:0/99647072 shutdown_connections 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 1 -- 10.20.193.57:0/99647072 wait complete. 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 10 monclient: build_initial_monmap 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 10 monclient: monmap: 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:30.376 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 1 Processor -- start 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 1 -- start start 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.367+0000 7f52140cc640 10 monclient: init 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:47:30.377 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 10 monclient(hunting): picked mon.noname-b con 0x7f520c085920 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 10 monclient(hunting): picked mon.noname-a con 0x7f520c087e30 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 10 monclient(hunting): picked mon.noname-c con 0x7f520c088200 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520c05e2d0 con 0x7f520c087e30 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520c0888a0 con 0x7f520c085920 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520c139ef0 con 0x7f520c088200 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f52140cc640 10 monclient(hunting): authenticate will time out at 1730.187147s 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f5211640640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f520c087e30 0x7f520c193d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39468/0 (socket says 10.20.193.57:39468) 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.368+0000 7f5211640640 1 -- 10.20.193.57:0/3029497585 learned_addr learned my addr 10.20.193.57:0/3029497585 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f5212642640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.57:6790/0 conn(0x7f520c088200 legacy=0x7f520c1954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f5211640640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.57:6789/0 conn(0x7f520c087e30 legacy=0x7f520c193d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630762780 0 0) 0x7f520c139ef0 con 0x7f520c088200 2026-02-12T17:47:30.378 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): my global_id is 114284 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51dc0035e0 con 0x7f520c088200 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3347317497 0 0) 0x7f520c05e2d0 con 0x7f520c087e30 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): my global_id is 124191 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f520c139ef0 con 0x7f520c087e30 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f5211e41640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.82:6789/0 conn(0x7f520c085920 legacy=0x7f520c152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:30.379 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1454798527 0 0) 0x7f51dc0035e0 con 0x7f520c088200 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f520c05e2d0 con 0x7f520c088200 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5208004610 con 0x7f520c088200 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): dump: 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:30.380 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 514299366 0 0) 0x7f520c139ef0 con 0x7f520c087e30 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51dc0035e0 con 0x7f520c087e30 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5200003540 con 0x7f520c087e30 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient(hunting): dump: 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.381 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1860308644 0 0) 0x7f520c05e2d0 con 0x7f520c088200 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.82:6789/0 conn(0x7f520c085920 legacy=0x7f520c152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.57:6789/0 conn(0x7f520c087e30 legacy=0x7f520c193d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:30.382 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 monclient: found mon.c 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520c13c250 con 0x7f520c088200 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f51fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f52140cc640 5 monclient: authenticate success, global_id 114284 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f52140cc640 10 monclient: _renew_subs 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f52140cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f52140cc640 1 -- 10.20.193.57:0/3029497585 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f520c13aa50 con 0x7f520c088200 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f52140cc640 10 monclient: _renew_subs 2026-02-12T17:47:30.383 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f52140cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.370+0000 7f52140cc640 1 -- 10.20.193.57:0/3029497585 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f520c139580 con 0x7f520c088200 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5208005c30 con 0x7f520c088200 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f51fa7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5208005f50 con 0x7f520c088200 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f51fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f51fa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f51fa7fc640 10 monclient: dump: 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:30.384 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f51fbfff640 4 set_mon_vals no callback set 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f52140cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f52140cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f52140cc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f52140cc640 1 -- 10.20.193.57:0/3029497585 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f520c090810 con 0x7f520c088200 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f5208012bc0 con 0x7f520c088200 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f520804faf0 con 0x7f520c088200 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f5211e41640 10 monclient: get_auth_request con 0x7f51dc03fb80 auth_method 0 2026-02-12T17:47:30.385 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.371+0000 7f5211e41640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.82:6800/2441377515 conn(0x7f51dc03fb80 legacy=0x7f51dc060030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T17:47:30.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.372+0000 7f5211e41640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.82:6800/2441377515 conn(0x7f51dc03fb80 legacy=0x7f51dc060030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T17:47:30.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.372+0000 7f5211e41640 1 --1- 10.20.193.57:0/3029497585 >> v1:10.20.193.82:6800/2441377515 conn(0x7f51dc03fb80 0x7f51dc060030 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=4 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-12T17:47:30.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.372+0000 7f5211e41640 1 --1- 10.20.193.57:0/3029497585 >> v1:10.20.193.82:6800/2441377515 conn(0x7f51dc03fb80 0x7f51dc060030 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=4 cs=0 l=1).fault on lossy channel, failing 2026-02-12T17:47:30.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.372+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.82:6800/2441377515 conn(0x7f51dc03fb80 legacy=0x7f51dc060030 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T17:47:30.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.373+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f5208014610 con 0x7f520c088200 2026-02-12T17:47:30.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.373+0000 7f51fa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:30.386 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:30.373+0000 7f51fa7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:31.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.372+0000 7f51f8ff9640 1 -- 10.20.193.57:0/3029497585 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f51d8024d30 con 0x7f51dc03fb80 2026-02-12T17:47:31.368 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.372+0000 7f5211e41640 10 monclient: get_auth_request con 0x7f51dc03fb80 auth_method 0 2026-02-12T17:47:31.371 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.374+0000 7f51fa7fc640 1 -- 10.20.193.57:0/3029497585 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f51d8024d30 con 0x7f51dc03fb80 2026-02-12T17:47:31.371 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 0 to deep-scrub 2026-02-12T17:47:31.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.375+0000 7f52140cc640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.82:6800/2441377515 conn(0x7f51dc03fb80 legacy=0x7f51d80235f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.375+0000 7f52140cc640 10 monclient: shutdown 2026-02-12T17:47:31.372 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.375+0000 7f52140cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:31.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.375+0000 7f52140cc640 1 -- 10.20.193.57:0/3029497585 >> v1:10.20.193.57:6790/0 conn(0x7f520c088200 legacy=0x7f520c1954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.375+0000 7f52140cc640 1 -- 10.20.193.57:0/3029497585 shutdown_connections 2026-02-12T17:47:31.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.375+0000 7f52140cc640 1 -- 10.20.193.57:0/3029497585 >> 10.20.193.57:0/3029497585 conn(0x7f520c0916b0 msgr2=0x7f520c142280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:31.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.375+0000 7f52140cc640 1 -- 10.20.193.57:0/3029497585 shutdown_connections 2026-02-12T17:47:31.373 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.375+0000 7f52140cc640 1 -- 10.20.193.57:0/3029497585 wait complete. 2026-02-12T17:47:31.381 INFO:tasks.ceph:Scrubbing osd.1 2026-02-12T17:47:31.381 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-12T17:47:31.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.452+0000 7f6f7d81b640 10 monclient: get_monmap_and_config 2026-02-12T17:47:31.449 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.452+0000 7f6f7d81b640 10 monclient: build_initial_monmap 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.452+0000 7f6f7d81b640 10 monclient: monmap: 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:31.453735+0000 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:31.453735+0000 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:31.450 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:31.451 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.459 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 1 Processor -- start 2026-02-12T17:47:31.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 1 -- start start 2026-02-12T17:47:31.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 10 monclient: init 2026-02-12T17:47:31.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:31.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:31.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 10 monclient(hunting): picked mon.noname-b con 0x7f6f7808bf10 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:31.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 10 monclient(hunting): picked mon.noname-a con 0x7f6f7808cf60 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:31.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 10 monclient(hunting): picked mon.noname-c con 0x7f6f7808c9f0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:31.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f78085510 con 0x7f6f7808cf60 2026-02-12T17:47:31.460 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f78086290 con 0x7f6f7808c9f0 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f780859f0 con 0x7f6f7808bf10 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f7d81b640 10 monclient(hunting): authenticate will time out at 1731.272673s 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f76ffd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f6f7808bf10 0x7f6f7808c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54716/0 (socket says 10.20.193.57:54716) 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.453+0000 7f6f76ffd640 1 -- 10.20.193.57:0/2876140079 learned_addr learned my addr 10.20.193.57:0/2876140079 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.455+0000 7f6f76ffd640 1 -- 10.20.193.57:0/2876140079 >> v1:10.20.193.57:6790/0 conn(0x7f6f7808bf10 legacy=0x7f6f7808c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.455+0000 7f6f767fc640 1 -- 10.20.193.57:0/2876140079 >> v1:10.20.193.57:6789/0 conn(0x7f6f7808cf60 legacy=0x7f6f78181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f777fe640 1 -- 10.20.193.57:0/2876140079 >> v1:10.20.193.82:6789/0 conn(0x7f6f7808c9f0 legacy=0x7f6f781a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124513126 0 0) 0x7f6f780859f0 con 0x7f6f7808bf10 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.461 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): my global_id is 114287 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f640035e0 con 0x7f6f7808bf10 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910792170 0 0) 0x7f6f78085510 con 0x7f6f7808cf60 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): my global_id is 124194 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f780859f0 con 0x7f6f7808cf60 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101472538 0 0) 0x7f6f78086290 con 0x7f6f7808c9f0 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.462 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient(hunting): my global_id is 5380 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f78085510 con 0x7f6f7808c9f0 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2824611869 0 0) 0x7f6f640035e0 con 0x7f6f7808bf10 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 >> v1:10.20.193.82:6789/0 conn(0x7f6f7808c9f0 legacy=0x7f6f781a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 >> v1:10.20.193.57:6789/0 conn(0x7f6f7808cf60 legacy=0x7f6f78181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 monclient: found mon.noname-b 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7808d3e0 con 0x7f6f7808bf10 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient: _finish_auth 0 2026-02-12T17:47:31.463 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6f6c003150 con 0x7f6f7808bf10 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient: dump: 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.464 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 5 monclient: authenticate success, global_id 114287 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f6c0033a0 con 0x7f6f7808bf10 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f76ffd640 1 --1- 10.20.193.57:0/2876140079 >> v1:10.20.193.57:6790/0 conn(0x7f6f7808bf10 0x7f6f7808c2e0 :-1 s=OPENED pgs=374 gs=1 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7f6f6c004b10 mon_map magic: 0 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 4 set_mon_vals no callback set 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 10 monclient: shutdown 2026-02-12T17:47:31.465 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 1 -- 10.20.193.57:0/2876140079 >> v1:10.20.193.57:6790/0 conn(0x7f6f7808bf10 legacy=0x7f6f7808c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 1 -- 10.20.193.57:0/2876140079 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6f6c004b10 con 0x7f6f7808bf10 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f75ffb640 10 monclient: discarding stray monitor message mon_map magic: 0 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 1 -- 10.20.193.57:0/2876140079 shutdown_connections 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 1 -- 10.20.193.57:0/2876140079 >> 10.20.193.57:0/2876140079 conn(0x7f6f78091510 msgr2=0x7f6f78091910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 1 -- 10.20.193.57:0/2876140079 shutdown_connections 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.456+0000 7f6f7d81b640 1 -- 10.20.193.57:0/2876140079 wait complete. 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient: build_initial_monmap 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient: monmap: 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:31.466 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 1 Processor -- start 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 1 -- start start 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient: init 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:31.467 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient(hunting): picked mon.noname-a con 0x7f6f7808bf10 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient(hunting): picked mon.noname-b con 0x7f6f7808c9f0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient(hunting): picked mon.noname-c con 0x7f6f7808cf60 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f78089f70 con 0x7f6f7808bf10 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f78089830 con 0x7f6f7808c9f0 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7807f6b0 con 0x7f6f7808cf60 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f7d81b640 10 monclient(hunting): authenticate will time out at 1731.276651s 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f76ffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f6f7808bf10 0x7f6f78088a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39480/0 (socket says 10.20.193.57:39480) 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.457+0000 7f6f76ffd640 1 -- 10.20.193.57:0/3777820540 learned_addr learned my addr 10.20.193.57:0/3777820540 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f76ffd640 1 -- 10.20.193.57:0/3777820540 >> v1:10.20.193.57:6789/0 conn(0x7f6f7808bf10 legacy=0x7f6f78088a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.468 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f777fe640 1 -- 10.20.193.57:0/3777820540 >> v1:10.20.193.57:6790/0 conn(0x7f6f7808cf60 legacy=0x7f6f781a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970700202 0 0) 0x7f6f7807f6b0 con 0x7f6f7808cf60 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 10 monclient(hunting): my global_id is 114290 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f480035e0 con 0x7f6f7808cf60 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418003332 0 0) 0x7f6f78089f70 con 0x7f6f7808bf10 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 10 monclient(hunting): my global_id is 124197 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.459+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f7807f6b0 con 0x7f6f7808bf10 2026-02-12T17:47:31.469 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f767fc640 1 -- 10.20.193.57:0/3777820540 >> v1:10.20.193.82:6789/0 conn(0x7f6f7808c9f0 legacy=0x7f6f78089120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4100300056 0 0) 0x7f6f480035e0 con 0x7f6f7808cf60 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f78089f70 con 0x7f6f7808cf60 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6f680044a0 con 0x7f6f7808cf60 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): dump: 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.470 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 197156871 0 0) 0x7f6f7807f6b0 con 0x7f6f7808bf10 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f480035e0 con 0x7f6f7808bf10 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6f6c002fa0 con 0x7f6f7808bf10 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): dump: 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.471 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651953241 0 0) 0x7f6f78089830 con 0x7f6f7808c9f0 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.472 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient(hunting): my global_id is 5383 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f7807f6b0 con 0x7f6f7808c9f0 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3137423754 0 0) 0x7f6f78089f70 con 0x7f6f7808cf60 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 >> v1:10.20.193.82:6789/0 conn(0x7f6f7808c9f0 legacy=0x7f6f78089120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 >> v1:10.20.193.57:6789/0 conn(0x7f6f7808bf10 legacy=0x7f6f78088a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 monclient: found mon.c 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7808a1d0 con 0x7f6f7808cf60 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient: _finish_auth 0 2026-02-12T17:47:31.473 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f7d81b640 5 monclient: authenticate success, global_id 114290 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f7d81b640 10 monclient: _renew_subs 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f7d81b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7807f0f0 con 0x7f6f7808cf60 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f7d81b640 10 monclient: _renew_subs 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f7d81b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f78089b90 con 0x7f6f7808cf60 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f68004a60 con 0x7f6f7808cf60 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f6f68004db0 con 0x7f6f7808cf60 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.474 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f4ffff640 10 monclient: dump: 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f757fa640 4 set_mon_vals no callback set 2026-02-12T17:47:31.475 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f7d81b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.460+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6f7808aed0 con 0x7f6f7808cf60 2026-02-12T17:47:31.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.461+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f6f68004f50 con 0x7f6f7808cf60 2026-02-12T17:47:31.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.461+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f6f6804fac0 con 0x7f6f7808cf60 2026-02-12T17:47:31.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.461+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6800/3025704390 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f480864f0 con 0x7f6f48064890 2026-02-12T17:47:31.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.461+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_get_version_reply(handle=1 version=887) ==== 24+0+0 (unknown 3331530905 0 0) 0x7f6f6804fe70 con 0x7f6f7808cf60 2026-02-12T17:47:31.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.461+0000 7f6f4ffff640 10 monclient: handle_get_version_reply finishing 1 version 887 2026-02-12T17:47:31.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.461+0000 7f6f767fc640 10 monclient: get_auth_request con 0x7f6f48064890 auth_method 0 2026-02-12T17:47:31.476 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.461+0000 7f6f76ffd640 10 monclient: get_auth_request con 0x7f6f4803fcd0 auth_method 0 2026-02-12T17:47:31.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.466+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== osd.1 v1:10.20.193.57:6800/3025704390 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f6f480864f0 con 0x7f6f48064890 2026-02-12T17:47:31.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 --> v1:10.20.193.57:6800/3025704390 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6f7807f8f0 con 0x7f6f48064890 2026-02-12T17:47:31.477 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f4ffff640 1 -- 10.20.193.57:0/3777820540 <== osd.1 v1:10.20.193.57:6800/3025704390 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f6f600032f0 con 0x7f6f48064890 2026-02-12T17:47:31.478 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:47:31.478 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T17:47:31.478 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:47:31.479 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 >> v1:10.20.193.57:6800/3025704390 conn(0x7f6f48064890 legacy=0x7f6f48084ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 >> v1:10.20.193.82:6800/2441377515 conn(0x7f6f4803fcd0 legacy=0x7f6f48060180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 10 monclient: shutdown 2026-02-12T17:47:31.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:31.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 >> v1:10.20.193.57:6790/0 conn(0x7f6f7808cf60 legacy=0x7f6f781a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f777fe640 1 -- 10.20.193.57:0/3777820540 reap_dead start 2026-02-12T17:47:31.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 shutdown_connections 2026-02-12T17:47:31.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 >> 10.20.193.57:0/3777820540 conn(0x7f6f78091510 msgr2=0x7f6f78057350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:31.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 shutdown_connections 2026-02-12T17:47:31.480 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.473+0000 7f6f7d81b640 1 -- 10.20.193.57:0/3777820540 wait complete. 2026-02-12T17:47:31.481 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-12T17:47:31.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.551+0000 7f63cce36640 10 monclient: get_monmap_and_config 2026-02-12T17:47:31.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.551+0000 7f63cce36640 10 monclient: build_initial_monmap 2026-02-12T17:47:31.548 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.551+0000 7f63cce36640 10 monclient: monmap: 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:31.552712+0000 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:31.552712+0000 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:31.549 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 1 Processor -- start 2026-02-12T17:47:31.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 1 -- start start 2026-02-12T17:47:31.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 10 monclient: init 2026-02-12T17:47:31.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:31.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:47:31.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 10 monclient(hunting): picked mon.noname-a con 0x7f63c808c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:31.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 10 monclient(hunting): picked mon.noname-c con 0x7f63c808c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:31.558 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 10 monclient(hunting): picked mon.noname-b con 0x7f63c8182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c808a820 con 0x7f63c808c250 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c8089450 con 0x7f63c808c620 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c8089730 con 0x7f63c8182cc0 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63cce36640 10 monclient(hunting): authenticate will time out at 1731.371632s 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63c6575640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f63c808c250 0x7f63c808a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39496/0 (socket says 10.20.193.57:39496) 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.552+0000 7f63c6575640 1 -- 10.20.193.57:0/3116213443 learned_addr learned my addr 10.20.193.57:0/3116213443 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.554+0000 7f63c6575640 1 -- 10.20.193.57:0/3116213443 >> v1:10.20.193.57:6789/0 conn(0x7f63c808c250 legacy=0x7f63c808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.554+0000 7f63c6d76640 1 -- 10.20.193.57:0/3116213443 >> v1:10.20.193.57:6790/0 conn(0x7f63c8182cc0 legacy=0x7f63c81a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.554+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255753832 0 0) 0x7f63bc002c20 con 0x7f63c808c250 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.554+0000 7f63c5573640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.559 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.554+0000 7f63c5573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.554+0000 7f63c5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.554+0000 7f63c5573640 10 monclient(hunting): my global_id is 124200 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b40035e0 con 0x7f63c808c250 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924800373 0 0) 0x7f63c8089730 con 0x7f63c8182cc0 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient(hunting): my global_id is 114293 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63bc002c20 con 0x7f63c8182cc0 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5d74640 1 -- 10.20.193.57:0/3116213443 >> v1:10.20.193.82:6789/0 conn(0x7f63c808c620 legacy=0x7f63c808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 892690854 0 0) 0x7f63b40035e0 con 0x7f63c808c250 2026-02-12T17:47:31.560 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 >> v1:10.20.193.57:6790/0 conn(0x7f63c8182cc0 legacy=0x7f63c81a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 >> v1:10.20.193.82:6789/0 conn(0x7f63c808c620 legacy=0x7f63c808caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: _finish_hunting 0 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 monclient: found mon.noname-a 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c8089a10 con 0x7f63c808c250 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: _finish_auth 0 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: _check_auth_tickets 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f63bc003260 con 0x7f63c808c250 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 5 monclient: authenticate success, global_id 124200 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:31.561 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: dump: 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.562 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63bc004960 con 0x7f63c808c250 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 1 -- 10.20.193.57:0/3116213443 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f63bc004cb0 con 0x7f63c808c250 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63c5573640 10 monclient: dump: 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.563 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 4 set_mon_vals no callback set 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 10 monclient: shutdown 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 1 -- 10.20.193.57:0/3116213443 >> v1:10.20.193.57:6789/0 conn(0x7f63c808c250 legacy=0x7f63c808a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 1 -- 10.20.193.57:0/3116213443 shutdown_connections 2026-02-12T17:47:31.564 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 1 -- 10.20.193.57:0/3116213443 >> 10.20.193.57:0/3116213443 conn(0x7f63c80916b0 msgr2=0x7f63c8091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 1 -- 10.20.193.57:0/3116213443 shutdown_connections 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.555+0000 7f63cce36640 1 -- 10.20.193.57:0/3116213443 wait complete. 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient: build_initial_monmap 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient: monmap: 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:31.565 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 1 Processor -- start 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 1 -- start start 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient: init 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient(hunting): picked mon.noname-c con 0x7f63c808c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient(hunting): picked mon.noname-a con 0x7f63c808c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient(hunting): picked mon.noname-b con 0x7f63c8182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c8087210 con 0x7f63c808c620 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c813bfc0 con 0x7f63c8182cc0 2026-02-12T17:47:31.566 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c813c2a0 con 0x7f63c808c250 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63cce36640 10 monclient(hunting): authenticate will time out at 1731.375629s 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63c6575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f63c808c250 0x7f63c8193a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54736/0 (socket says 10.20.193.57:54736) 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.556+0000 7f63c6575640 1 -- 10.20.193.57:0/627986457 learned_addr learned my addr 10.20.193.57:0/627986457 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63c5d74640 1 -- 10.20.193.57:0/627986457 >> v1:10.20.193.57:6789/0 conn(0x7f63c808c620 legacy=0x7f63c813dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63c6575640 1 -- 10.20.193.57:0/627986457 >> v1:10.20.193.57:6790/0 conn(0x7f63c808c250 legacy=0x7f63c8193a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814989082 0 0) 0x7f63c8087210 con 0x7f63c808c620 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 10 monclient(hunting): my global_id is 124203 2026-02-12T17:47:31.567 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63940035e0 con 0x7f63c808c620 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341411001 0 0) 0x7f63c813c2a0 con 0x7f63c808c250 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 10 monclient(hunting): my global_id is 114296 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.558+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63c8087210 con 0x7f63c808c250 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63c6d76640 1 -- 10.20.193.57:0/627986457 >> v1:10.20.193.82:6789/0 conn(0x7f63c8182cc0 legacy=0x7f63c8194d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1293084043 0 0) 0x7f63c8087210 con 0x7f63c808c250 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63c813c2a0 con 0x7f63c808c250 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f63bc003080 con 0x7f63c808c250 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:31.568 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient(hunting): dump: 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:31.569 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 866690187 0 0) 0x7f63940035e0 con 0x7f63c808c620 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63c8087210 con 0x7f63c808c620 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f63b0003340 con 0x7f63c808c620 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient(hunting): dump: 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.570 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1958679299 0 0) 0x7f63c813c2a0 con 0x7f63c808c250 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 >> v1:10.20.193.82:6789/0 conn(0x7f63c8182cc0 legacy=0x7f63c8194d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 >> v1:10.20.193.57:6789/0 conn(0x7f63c808c620 legacy=0x7f63c813dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient: _finish_hunting 0 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 monclient: found mon.c 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c813c580 con 0x7f63c808c250 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient: _finish_auth 0 2026-02-12T17:47:31.571 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient: _check_auth_tickets 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 5 monclient: authenticate success, global_id 114296 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 10 monclient: _renew_subs 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63c813e7e0 con 0x7f63c808c250 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 10 monclient: _renew_subs 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f63c813e620 con 0x7f63c808c250 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63bc004d80 con 0x7f63c808c250 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f63bc0050e0 con 0x7f63c808c250 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.572 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 10 monclient: dump: 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.573 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63c4d72640 4 set_mon_vals no callback set 2026-02-12T17:47:31.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:31.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:31.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c8090810 con 0x7f63c808c250 2026-02-12T17:47:31.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.559+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f63bc005370 con 0x7f63c808c250 2026-02-12T17:47:31.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.560+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f63bc04e830 con 0x7f63c808c250 2026-02-12T17:47:31.574 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.560+0000 7f63c5d74640 10 monclient: get_auth_request con 0x7f639403fb30 auth_method 0 2026-02-12T17:47:31.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.562+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f63bc017180 con 0x7f63c808c250 2026-02-12T17:47:31.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.562+0000 7f63aeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:31.575 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.562+0000 7f63aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:31.660 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.664+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f63c808a820 con 0x7f639403fb30 2026-02-12T17:47:31.661 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.664+0000 7f63aeffd640 1 -- 10.20.193.57:0/627986457 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f63c808a820 con 0x7f639403fb30 2026-02-12T17:47:31.661 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 1 to deep-scrub 2026-02-12T17:47:31.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.665+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 >> v1:10.20.193.82:6800/2441377515 conn(0x7f639403fb30 legacy=0x7f639405ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.665+0000 7f63cce36640 10 monclient: shutdown 2026-02-12T17:47:31.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.665+0000 7f63cce36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:31.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.665+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 >> v1:10.20.193.57:6790/0 conn(0x7f63c808c250 legacy=0x7f63c8193a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.665+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 shutdown_connections 2026-02-12T17:47:31.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.665+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 >> 10.20.193.57:0/627986457 conn(0x7f63c80916b0 msgr2=0x7f63c808a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:31.662 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.665+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 shutdown_connections 2026-02-12T17:47:31.663 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.665+0000 7f63cce36640 1 -- 10.20.193.57:0/627986457 wait complete. 2026-02-12T17:47:31.670 INFO:tasks.ceph:Scrubbing osd.2 2026-02-12T17:47:31.670 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-12T17:47:31.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.739+0000 7febb270c640 10 monclient: get_monmap_and_config 2026-02-12T17:47:31.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.739+0000 7febb270c640 10 monclient: build_initial_monmap 2026-02-12T17:47:31.736 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.739+0000 7febb270c640 10 monclient: monmap: 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:31.740705+0000 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:31.740705+0000 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:31.737 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 1 Processor -- start 2026-02-12T17:47:31.742 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 1 -- start start 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 10 monclient: init 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 10 monclient(hunting): picked mon.noname-c con 0x7febac08bf10 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 10 monclient(hunting): picked mon.noname-a con 0x7febac08cf60 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 10 monclient(hunting): picked mon.noname-b con 0x7febac08c9f0 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febac085510 con 0x7febac08cf60 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febac086290 con 0x7febac08bf10 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febac0859f0 con 0x7febac08c9f0 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:31.743 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb270c640 10 monclient(hunting): authenticate will time out at 1731.559612s 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb0c82640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7febac08c9f0 0x7febac1a3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54740/0 (socket says 10.20.193.57:54740) 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febb0c82640 1 -- 10.20.193.57:0/2052751196 learned_addr learned my addr 10.20.193.57:0/2052751196 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.740+0000 7febab7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7febac08cf60 0x7febac181ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39512/0 (socket says 10.20.193.57:39512) 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.742+0000 7febb0c82640 1 -- 10.20.193.57:0/2052751196 >> v1:10.20.193.57:6790/0 conn(0x7febac08c9f0 legacy=0x7febac1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.742+0000 7febab7fe640 1 -- 10.20.193.57:0/2052751196 >> v1:10.20.193.57:6789/0 conn(0x7febac08cf60 legacy=0x7febac181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.742+0000 7febabfff640 1 -- 10.20.193.57:0/2052751196 >> v1:10.20.193.82:6789/0 conn(0x7febac08bf10 legacy=0x7febac08c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.742+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458578015 0 0) 0x7febac085510 con 0x7febac08cf60 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): my global_id is 124206 2026-02-12T17:47:31.744 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb900035e0 con 0x7febac08cf60 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425577085 0 0) 0x7febac0859f0 con 0x7febac08c9f0 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): my global_id is 114299 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febac085510 con 0x7febac08c9f0 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282425015 0 0) 0x7febac086290 con 0x7febac08bf10 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient(hunting): my global_id is 5392 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febac0859f0 con 0x7febac08bf10 2026-02-12T17:47:31.745 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1189491717 0 0) 0x7febac085510 con 0x7febac08c9f0 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 >> v1:10.20.193.82:6789/0 conn(0x7febac08bf10 legacy=0x7febac08c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 >> v1:10.20.193.57:6789/0 conn(0x7febac08cf60 legacy=0x7febac181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: _finish_hunting 0 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 monclient: found mon.noname-b 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac08d3e0 con 0x7febac08c9f0 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: _finish_auth 0 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: _check_auth_tickets 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feba0004130 con 0x7febac08c9f0 2026-02-12T17:47:31.746 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: dump: 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.747 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 5 monclient: authenticate success, global_id 114299 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feba00043c0 con 0x7febac08c9f0 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 4 set_mon_vals no callback set 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 1 -- 10.20.193.57:0/2052751196 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feba0005a40 con 0x7febac08c9f0 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febaaffd640 10 monclient: dump: 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.748 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 10 monclient: shutdown 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 1 -- 10.20.193.57:0/2052751196 >> v1:10.20.193.57:6790/0 conn(0x7febac08c9f0 legacy=0x7febac1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.749 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 1 -- 10.20.193.57:0/2052751196 shutdown_connections 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 1 -- 10.20.193.57:0/2052751196 >> 10.20.193.57:0/2052751196 conn(0x7febac091510 msgr2=0x7febac091910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 1 -- 10.20.193.57:0/2052751196 shutdown_connections 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.743+0000 7febb270c640 1 -- 10.20.193.57:0/2052751196 wait complete. 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient: build_initial_monmap 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient: monmap: 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:31.750 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 1 Processor -- start 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 1 -- start start 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient: init 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient(hunting): picked mon.noname-a con 0x7febac08bf10 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient(hunting): picked mon.noname-c con 0x7febac08c9f0 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient(hunting): picked mon.noname-b con 0x7febac08cf60 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febac080d70 con 0x7febac08bf10 2026-02-12T17:47:31.751 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febac080510 con 0x7febac08cf60 2026-02-12T17:47:31.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febac0587c0 con 0x7febac08c9f0 2026-02-12T17:47:31.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:31.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febb270c640 10 monclient(hunting): authenticate will time out at 1731.563829s 2026-02-12T17:47:31.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febab7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7febac08c9f0 0x7febac1920a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54742/0 (socket says 10.20.193.57:54742) 2026-02-12T17:47:31.752 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.744+0000 7febab7fe640 1 -- 10.20.193.57:0/1550293872 learned_addr learned my addr 10.20.193.57:0/1550293872 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:31.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.746+0000 7febab7fe640 1 -- 10.20.193.57:0/1550293872 >> v1:10.20.193.57:6790/0 conn(0x7febac08c9f0 legacy=0x7febac1920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.746+0000 7febabfff640 1 -- 10.20.193.57:0/1550293872 >> v1:10.20.193.57:6789/0 conn(0x7febac08bf10 legacy=0x7febac150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429897562 0 0) 0x7febac080d70 con 0x7febac08bf10 2026-02-12T17:47:31.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): my global_id is 124209 2026-02-12T17:47:31.756 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb7c0035e0 con 0x7febac08bf10 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3510007165 0 0) 0x7febac0587c0 con 0x7febac08c9f0 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): my global_id is 114302 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febac080d70 con 0x7febac08c9f0 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb0c82640 1 -- 10.20.193.57:0/1550293872 >> v1:10.20.193.82:6789/0 conn(0x7febac08cf60 legacy=0x7febac1937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3286927901 0 0) 0x7feb7c0035e0 con 0x7febac08bf10 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7febac0587c0 con 0x7febac08bf10 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feb98003380 con 0x7febac08bf10 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:31.757 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): dump: 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:31.758 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2657596492 0 0) 0x7febac080d70 con 0x7febac08c9f0 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb7c0035e0 con 0x7febac08c9f0 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feb9c003570 con 0x7febac08c9f0 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): dump: 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.759 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178658893 0 0) 0x7febac080510 con 0x7febac08cf60 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient(hunting): my global_id is 5395 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febac080d70 con 0x7febac08cf60 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1093244324 0 0) 0x7febac0587c0 con 0x7febac08bf10 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 >> v1:10.20.193.57:6790/0 conn(0x7febac08c9f0 legacy=0x7febac1920a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.760 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 >> v1:10.20.193.82:6789/0 conn(0x7febac08cf60 legacy=0x7febac1937c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient: _finish_hunting 0 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 monclient: found mon.a 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac05de90 con 0x7febac08bf10 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient: _finish_auth 0 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient: _check_auth_tickets 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb270c640 5 monclient: authenticate success, global_id 124209 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb270c640 10 monclient: _renew_subs 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb270c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7febac088700 con 0x7febac08bf10 2026-02-12T17:47:31.761 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb270c640 10 monclient: _renew_subs 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb270c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7febac07f850 con 0x7febac08bf10 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb98003980 con 0x7febac08bf10 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7feb98003ca0 con 0x7febac08bf10 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7feba8ff9640 10 monclient: dump: 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.762 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febaa7fc640 4 set_mon_vals no callback set 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb270c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.747+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7febac08aed0 con 0x7febac08bf10 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.748+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7feb98003f00 con 0x7febac08bf10 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.748+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7feb9804ea40 con 0x7febac08bf10 2026-02-12T17:47:31.763 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.748+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6808/3129121469 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb7c086570 con 0x7feb7c064910 2026-02-12T17:47:31.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.748+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_get_version_reply(handle=1 version=887) ==== 24+0+0 (unknown 3331530905 0 0) 0x7feb9804ed40 con 0x7febac08bf10 2026-02-12T17:47:31.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.748+0000 7feba8ff9640 10 monclient: handle_get_version_reply finishing 1 version 887 2026-02-12T17:47:31.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.748+0000 7febab7fe640 10 monclient: get_auth_request con 0x7feb7c03fd10 auth_method 0 2026-02-12T17:47:31.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.748+0000 7febb0c82640 10 monclient: get_auth_request con 0x7feb7c064910 auth_method 0 2026-02-12T17:47:31.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.753+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== osd.2 v1:10.20.193.57:6808/3129121469 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7feb7c086570 con 0x7feb7c064910 2026-02-12T17:47:31.764 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 --> v1:10.20.193.57:6808/3129121469 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7febac08f660 con 0x7feb7c064910 2026-02-12T17:47:31.765 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7feba8ff9640 1 -- 10.20.193.57:0/1550293872 <== osd.2 v1:10.20.193.57:6808/3129121469 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7febac08f660 con 0x7feb7c064910 2026-02-12T17:47:31.765 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:47:31.765 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T17:47:31.765 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:47:31.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 >> v1:10.20.193.57:6808/3129121469 conn(0x7feb7c064910 legacy=0x7feb7c084d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 >> v1:10.20.193.82:6800/2441377515 conn(0x7feb7c03fd10 legacy=0x7feb7c0601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 10 monclient: shutdown 2026-02-12T17:47:31.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:31.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 >> v1:10.20.193.57:6789/0 conn(0x7febac08bf10 legacy=0x7febac150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb0c82640 1 -- 10.20.193.57:0/1550293872 reap_dead start 2026-02-12T17:47:31.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 shutdown_connections 2026-02-12T17:47:31.767 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 >> 10.20.193.57:0/1550293872 conn(0x7febac091510 msgr2=0x7febac057370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:31.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 shutdown_connections 2026-02-12T17:47:31.768 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.761+0000 7febb270c640 1 -- 10.20.193.57:0/1550293872 wait complete. 2026-02-12T17:47:31.768 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-12T17:47:31.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.837+0000 7fc879f4c640 10 monclient: get_monmap_and_config 2026-02-12T17:47:31.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.837+0000 7fc879f4c640 10 monclient: build_initial_monmap 2026-02-12T17:47:31.835 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.837+0000 7fc879f4c640 10 monclient: monmap: 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:31.838540+0000 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:31.838540+0000 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.836 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 1 Processor -- start 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 1 -- start start 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 10 monclient: init 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 10 monclient(hunting): picked mon.noname-b con 0x7fc87408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 10 monclient(hunting): picked mon.noname-a con 0x7fc87408c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 10 monclient(hunting): picked mon.noname-c con 0x7fc874182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87408a820 con 0x7fc87408c620 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc874089450 con 0x7fc874182cc0 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc874089730 con 0x7fc87408c250 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:31.837 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc879f4c640 10 monclient(hunting): authenticate will time out at 1731.657428s 2026-02-12T17:47:31.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc8737fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fc87408c250 0x7fc87408a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54756/0 (socket says 10.20.193.57:54756) 2026-02-12T17:47:31.838 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.838+0000 7fc8737fe640 1 -- 10.20.193.57:0/1793660349 learned_addr learned my addr 10.20.193.57:0/1793660349 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:31.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8737fe640 1 -- 10.20.193.57:0/1793660349 >> v1:10.20.193.57:6790/0 conn(0x7fc87408c250 legacy=0x7fc87408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc872ffd640 1 -- 10.20.193.57:0/1793660349 >> v1:10.20.193.57:6789/0 conn(0x7fc87408c620 legacy=0x7fc87408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693892141 0 0) 0x7fc874089730 con 0x7fc87408c250 2026-02-12T17:47:31.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.846 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 10 monclient(hunting): my global_id is 114305 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8580035e0 con 0x7fc87408c250 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761288124 0 0) 0x7fc864002c70 con 0x7fc87408c620 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 10 monclient(hunting): my global_id is 124212 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc873fff640 1 -- 10.20.193.57:0/1793660349 >> v1:10.20.193.82:6789/0 conn(0x7fc874182cc0 legacy=0x7fc8741a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.840+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc874089730 con 0x7fc87408c620 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2801072048 0 0) 0x7fc8580035e0 con 0x7fc87408c250 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 >> v1:10.20.193.82:6789/0 conn(0x7fc874182cc0 legacy=0x7fc8741a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 >> v1:10.20.193.57:6789/0 conn(0x7fc87408c620 legacy=0x7fc87408caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.847 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 1 monclient: found mon.noname-b 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc874089a10 con 0x7fc87408c250 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc860003150 con 0x7fc87408c250 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: dump: 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.848 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 5 monclient: authenticate success, global_id 114305 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc860003410 con 0x7fc87408c250 2026-02-12T17:47:31.849 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 4 set_mon_vals no callback set 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 1 -- 10.20.193.57:0/1793660349 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc860004b10 con 0x7fc87408c250 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc8727fc640 10 monclient: dump: 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.850 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 10 monclient: shutdown 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 1 -- 10.20.193.57:0/1793660349 >> v1:10.20.193.57:6790/0 conn(0x7fc87408c250 legacy=0x7fc87408a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 1 -- 10.20.193.57:0/1793660349 shutdown_connections 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 1 -- 10.20.193.57:0/1793660349 >> 10.20.193.57:0/1793660349 conn(0x7fc8740916b0 msgr2=0x7fc874091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 1 -- 10.20.193.57:0/1793660349 shutdown_connections 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 1 -- 10.20.193.57:0/1793660349 wait complete. 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 10 monclient: build_initial_monmap 2026-02-12T17:47:31.851 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.841+0000 7fc879f4c640 10 monclient: monmap: 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 1 Processor -- start 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 1 -- start start 2026-02-12T17:47:31.852 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 10 monclient: init 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 10 monclient(hunting): picked mon.noname-c con 0x7fc87408c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 10 monclient(hunting): picked mon.noname-b con 0x7fc87408c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 10 monclient(hunting): picked mon.noname-a con 0x7fc874182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87405a7d0 con 0x7fc874182cc0 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8740888a0 con 0x7fc87408c620 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc874086540 con 0x7fc87408c250 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc879f4c640 10 monclient(hunting): authenticate will time out at 1731.661373s 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc8737fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fc87408c250 0x7fc874085720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54764/0 (socket says 10.20.193.57:54764) 2026-02-12T17:47:31.853 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.842+0000 7fc8737fe640 1 -- 10.20.193.57:0/1294808521 learned_addr learned my addr 10.20.193.57:0/1294808521 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc8737fe640 1 -- 10.20.193.57:0/1294808521 >> v1:10.20.193.57:6790/0 conn(0x7fc87408c250 legacy=0x7fc874085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc873fff640 1 -- 10.20.193.57:0/1294808521 >> v1:10.20.193.57:6789/0 conn(0x7fc874182cc0 legacy=0x7fc874195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2746327418 0 0) 0x7fc874086540 con 0x7fc87408c250 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): my global_id is 114308 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc872ffd640 1 -- 10.20.193.57:0/1294808521 >> v1:10.20.193.82:6789/0 conn(0x7fc87408c620 legacy=0x7fc874085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8440035e0 con 0x7fc87408c250 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314209935 0 0) 0x7fc87405a7d0 con 0x7fc874182cc0 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.854 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): my global_id is 124215 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc874086540 con 0x7fc874182cc0 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379814374 0 0) 0x7fc8740888a0 con 0x7fc87408c620 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): my global_id is 5401 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc87405a7d0 con 0x7fc87408c620 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2884516201 0 0) 0x7fc8440035e0 con 0x7fc87408c250 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8740888a0 con 0x7fc87408c250 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc860004a50 con 0x7fc87408c250 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:31.855 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): dump: 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.856 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 551545161 0 0) 0x7fc874086540 con 0x7fc874182cc0 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8440035e0 con 0x7fc874182cc0 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc868004420 con 0x7fc874182cc0 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.844+0000 7fc84ffff640 10 monclient(hunting): dump: 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.857 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.1 v1:10.20.193.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 958774604 0 0) 0x7fc87405a7d0 con 0x7fc87408c620 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.82:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc874086540 con 0x7fc87408c620 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.1 v1:10.20.193.82:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc864003540 con 0x7fc87408c620 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient(hunting): dump: 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.858 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2832051701 0 0) 0x7fc8740888a0 con 0x7fc87408c250 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 >> v1:10.20.193.82:6789/0 conn(0x7fc87408c620 legacy=0x7fc874085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 >> v1:10.20.193.57:6789/0 conn(0x7fc874182cc0 legacy=0x7fc874195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 monclient: found mon.c 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:31.859 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc874087170 con 0x7fc87408c250 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient: _finish_auth 0 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 5 monclient: authenticate success, global_id 114308 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 10 monclient: _renew_subs 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc87405c2f0 con 0x7fc87408c250 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 10 monclient: _renew_subs 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc87413e530 con 0x7fc87408c250 2026-02-12T17:47:31.860 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc860005070 con 0x7fc87408c250 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fc860005390 con 0x7fc87408c250 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 10 monclient: dump: 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:31.861 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc871ffb640 4 set_mon_vals no callback set 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87405bb60 con 0x7fc87408c250 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.845+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fc860012000 con 0x7fc87408c250 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.846+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fc86004eba0 con 0x7fc87408c250 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.846+0000 7fc872ffd640 10 monclient: get_auth_request con 0x7fc84403ff20 auth_method 0 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.849+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fc860016e80 con 0x7fc87408c250 2026-02-12T17:47:31.862 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.849+0000 7fc84ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:31.863 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.849+0000 7fc84ffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:31.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.955+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc874090810 con 0x7fc84403ff20 2026-02-12T17:47:31.952 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.955+0000 7fc84ffff640 1 -- 10.20.193.57:0/1294808521 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7fc874090810 con 0x7fc84403ff20 2026-02-12T17:47:31.952 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 2 to deep-scrub 2026-02-12T17:47:31.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.957+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 >> v1:10.20.193.82:6800/2441377515 conn(0x7fc84403ff20 legacy=0x7fc8440603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.957+0000 7fc879f4c640 10 monclient: shutdown 2026-02-12T17:47:31.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.957+0000 7fc879f4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:31.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.957+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 >> v1:10.20.193.57:6790/0 conn(0x7fc87408c250 legacy=0x7fc874085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:31.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.957+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 shutdown_connections 2026-02-12T17:47:31.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.957+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 >> 10.20.193.57:0/1294808521 conn(0x7fc8740916b0 msgr2=0x7fc87408a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:31.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.957+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 shutdown_connections 2026-02-12T17:47:31.954 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:31.957+0000 7fc879f4c640 1 -- 10.20.193.57:0/1294808521 wait complete. 2026-02-12T17:47:31.962 INFO:tasks.ceph:Scrubbing osd.3 2026-02-12T17:47:31.962 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-12T17:47:32.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.034+0000 7fa0f2007640 10 monclient: get_monmap_and_config 2026-02-12T17:47:32.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.034+0000 7fa0f2007640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.032 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.034+0000 7fa0f2007640 10 monclient: monmap: 2026-02-12T17:47:32.032 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.032 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.032 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:32.035207+0000 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:32.035207+0000 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.034+0000 7fa0f2007640 1 Processor -- start 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.034+0000 7fa0f2007640 1 -- start start 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.034+0000 7fa0f2007640 10 monclient: init 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.033 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 10 monclient(hunting): picked mon.noname-b con 0x7fa0ec08bf10 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 10 monclient(hunting): picked mon.noname-c con 0x7fa0ec08cf60 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 10 monclient(hunting): picked mon.noname-a con 0x7fa0ec08c9f0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec085510 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec086290 con 0x7fa0ec08cf60 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec0859f0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0f2007640 10 monclient(hunting): authenticate will time out at 1731.854095s 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0eb7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fa0ec08bf10 0x7fa0ec08c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54776/0 (socket says 10.20.193.57:54776) 2026-02-12T17:47:32.034 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.035+0000 7fa0eb7fe640 1 -- 10.20.193.57:0/4276225912 learned_addr learned my addr 10.20.193.57:0/4276225912 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0eb7fe640 1 -- 10.20.193.57:0/4276225912 >> v1:10.20.193.57:6790/0 conn(0x7fa0ec08bf10 legacy=0x7fa0ec08c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ebfff640 1 -- 10.20.193.57:0/4276225912 >> v1:10.20.193.57:6789/0 conn(0x7fa0ec08c9f0 legacy=0x7fa0ec1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408841962 0 0) 0x7fa0ec085510 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.041 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient(hunting): my global_id is 124218 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0d00035e0 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321453961 0 0) 0x7fa0ec0859f0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient(hunting): my global_id is 114311 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0eaffd640 1 -- 10.20.193.57:0/4276225912 >> v1:10.20.193.82:6789/0 conn(0x7fa0ec08cf60 legacy=0x7fa0ec181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0ec085510 con 0x7fa0ec08bf10 2026-02-12T17:47:32.042 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2771044435 0 0) 0x7fa0d00035e0 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 >> v1:10.20.193.57:6790/0 conn(0x7fa0ec08bf10 legacy=0x7fa0ec08c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 >> v1:10.20.193.82:6789/0 conn(0x7fa0ec08cf60 legacy=0x7fa0ec181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 monclient: found mon.noname-a 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec08d3e0 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa0e0004280 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.043 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: dump: 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.044 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0f2007640 5 monclient: authenticate success, global_id 124218 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0f2007640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0e00044d0 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 1 -- 10.20.193.57:0/4276225912 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa0e0004960 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0ea7fc640 10 monclient: dump: 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.045 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0f2007640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.037+0000 7fa0f2007640 4 set_mon_vals no callback set 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient: shutdown 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 -- 10.20.193.57:0/4276225912 >> v1:10.20.193.57:6789/0 conn(0x7fa0ec08c9f0 legacy=0x7fa0ec1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.046 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 -- 10.20.193.57:0/4276225912 shutdown_connections 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 -- 10.20.193.57:0/4276225912 >> 10.20.193.57:0/4276225912 conn(0x7fa0ec091510 msgr2=0x7fa0ec091910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 -- 10.20.193.57:0/4276225912 shutdown_connections 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 -- 10.20.193.57:0/4276225912 wait complete. 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient: monmap: 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.047 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 Processor -- start 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 -- start start 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient: init 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient(hunting): picked mon.noname-c con 0x7fa0ec08bf10 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient(hunting): picked mon.noname-a con 0x7fa0ec08c9f0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient(hunting): picked mon.noname-b con 0x7fa0ec08cf60 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec05ddb0 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec088700 con 0x7fa0ec08cf60 2026-02-12T17:47:32.048 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec07aec0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.038+0000 7fa0f2007640 10 monclient(hunting): authenticate will time out at 1731.857995s 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.039+0000 7fa0eaffd640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7fa0ec08c9f0 0x7fa0ec1a1ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39562/0 (socket says 10.20.193.57:39562) 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.039+0000 7fa0eb7fe640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fa0ec08bf10 0x7fa0ec084940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54786/0 (socket says 10.20.193.57:54786) 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.039+0000 7fa0eaffd640 1 -- 10.20.193.57:0/3658992723 learned_addr learned my addr 10.20.193.57:0/3658992723 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0eaffd640 1 -- 10.20.193.57:0/3658992723 >> v1:10.20.193.57:6789/0 conn(0x7fa0ec08c9f0 legacy=0x7fa0ec1a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0eb7fe640 1 -- 10.20.193.57:0/3658992723 >> v1:10.20.193.57:6790/0 conn(0x7fa0ec08bf10 legacy=0x7fa0ec084940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 926737859 0 0) 0x7fa0ec07aec0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0eaffd640 1 --1- 10.20.193.57:0/3658992723 >> v1:10.20.193.57:6789/0 conn(0x7fa0ec08c9f0 0x7fa0ec1a1ae0 :-1 s=OPENED pgs=650 gs=2 cs=1 l=1).queue_received will delay after 1.77092e+09 on 0x7fa0ec05ddb0 auth_reply(proto 2 0 (0) Success) 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.049 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): my global_id is 114314 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0ebfff640 1 -- 10.20.193.57:0/3658992723 >> v1:10.20.193.82:6789/0 conn(0x7fa0ec08cf60 legacy=0x7fa0ec1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0bc0035e0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2445185856 0 0) 0x7fa0bc0035e0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0ec07aec0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa0d8003510 con 0x7fa0ec08bf10 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): dump: 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.050 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 256974006 0 0) 0x7fa0ec088700 con 0x7fa0ec08cf60 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.051 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient(hunting): my global_id is 5407 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0bc0035e0 con 0x7fa0ec08cf60 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 419131531 0 0) 0x7fa0ec07aec0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 >> v1:10.20.193.82:6789/0 conn(0x7fa0ec08cf60 legacy=0x7fa0ec1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 >> v1:10.20.193.57:6789/0 conn(0x7fa0ec08c9f0 legacy=0x7fa0ec1a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 monclient: found mon.c 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec0587c0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.052 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710907727 0 0) 0x7fa0ec05ddb0 con 0x7fa0ec08c9f0 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0f2007640 5 monclient: authenticate success, global_id 114314 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0f2007640 10 monclient: _renew_subs 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0f2007640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ec07c1c0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0f2007640 10 monclient: _renew_subs 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0f2007640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa0ec085050 con 0x7fa0ec08bf10 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0d8004b50 con 0x7fa0ec08bf10 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.053 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fa0d8004eb0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0c7fff640 10 monclient: dump: 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.054 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.041+0000 7fa0e9ffb640 4 set_mon_vals no callback set 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.042+0000 7fa0f2007640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.042+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 --> v1:10.20.193.57:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa0ec1a4920 con 0x7fa0ec08bf10 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.042+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fa0d8005110 con 0x7fa0ec08bf10 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.042+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fa0d804ea30 con 0x7fa0ec08bf10 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.042+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 --> v1:10.20.193.82:6801/634754599 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa0bc085fc0 con 0x7fa0bc064360 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.042+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_get_version_reply(handle=1 version=887) ==== 24+0+0 (unknown 3331530905 0 0) 0x7fa0d804ede0 con 0x7fa0ec08bf10 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.042+0000 7fa0c7fff640 10 monclient: handle_get_version_reply finishing 1 version 887 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.042+0000 7fa0eaffd640 10 monclient: get_auth_request con 0x7fa0bc03f7f0 auth_method 0 2026-02-12T17:47:32.055 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.042+0000 7fa0ebfff640 10 monclient: get_auth_request con 0x7fa0bc064360 auth_method 0 2026-02-12T17:47:32.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.047+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== osd.3 v1:10.20.193.82:6801/634754599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7fa0bc085fc0 con 0x7fa0bc064360 2026-02-12T17:47:32.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 --> v1:10.20.193.82:6801/634754599 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa0ec08f410 con 0x7fa0bc064360 2026-02-12T17:47:32.056 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0c7fff640 1 -- 10.20.193.57:0/3658992723 <== osd.3 v1:10.20.193.82:6801/634754599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fa0ec08f410 con 0x7fa0bc064360 2026-02-12T17:47:32.057 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:47:32.057 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T17:47:32.057 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:47:32.058 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 >> v1:10.20.193.82:6801/634754599 conn(0x7fa0bc064360 legacy=0x7fa0bc084770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 >> v1:10.20.193.82:6800/2441377515 conn(0x7fa0bc03f7f0 legacy=0x7fa0bc05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 10 monclient: shutdown 2026-02-12T17:47:32.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 >> v1:10.20.193.57:6790/0 conn(0x7fa0ec08bf10 legacy=0x7fa0ec084940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0ebfff640 1 -- 10.20.193.57:0/3658992723 reap_dead start 2026-02-12T17:47:32.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 shutdown_connections 2026-02-12T17:47:32.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 >> 10.20.193.57:0/3658992723 conn(0x7fa0ec091510 msgr2=0x7fa0ec125d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 shutdown_connections 2026-02-12T17:47:32.059 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.055+0000 7fa0f2007640 1 -- 10.20.193.57:0/3658992723 wait complete. 2026-02-12T17:47:32.060 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-12T17:47:32.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient: get_monmap_and_config 2026-02-12T17:47:32.126 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient: monmap: 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:32.130906+0000 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:32.130906+0000 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:32.127 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 1 Processor -- start 2026-02-12T17:47:32.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 1 -- start start 2026-02-12T17:47:32.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient: init 2026-02-12T17:47:32.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:32.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient(hunting): picked mon.noname-b con 0x7f3f2c08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient(hunting): picked mon.noname-a con 0x7f3f2c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient(hunting): picked mon.noname-c con 0x7f3f2c182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.129 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c08a820 con 0x7f3f2c08c620 2026-02-12T17:47:32.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c089450 con 0x7f3f2c182cc0 2026-02-12T17:47:32.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c089730 con 0x7f3f2c08c250 2026-02-12T17:47:32.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f30eb8640 10 monclient(hunting): authenticate will time out at 1731.949802s 2026-02-12T17:47:32.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f2a575640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3f2c08c250 0x7f3f2c08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54794/0 (socket says 10.20.193.57:54794) 2026-02-12T17:47:32.130 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.130+0000 7f3f2a575640 1 -- 10.20.193.57:0/3084219428 learned_addr learned my addr 10.20.193.57:0/3084219428 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.137 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f2a575640 1 -- 10.20.193.57:0/3084219428 >> v1:10.20.193.57:6790/0 conn(0x7f3f2c08c250 legacy=0x7f3f2c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29d74640 1 -- 10.20.193.57:0/3084219428 >> v1:10.20.193.57:6789/0 conn(0x7f3f2c08c620 legacy=0x7f3f2c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f2ad76640 1 -- 10.20.193.57:0/3084219428 >> v1:10.20.193.82:6789/0 conn(0x7f3f2c182cc0 legacy=0x7f3f2c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076180543 0 0) 0x7f3f14002c70 con 0x7f3f2c08c620 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): my global_id is 124224 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f180035e0 con 0x7f3f2c08c620 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589477879 0 0) 0x7f3f2c089730 con 0x7f3f2c08c250 2026-02-12T17:47:32.138 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): my global_id is 114317 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f14002c70 con 0x7f3f2c08c250 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245221704 0 0) 0x7f3f2c089450 con 0x7f3f2c182cc0 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient(hunting): my global_id is 5410 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c089730 con 0x7f3f2c182cc0 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1300365589 0 0) 0x7f3f180035e0 con 0x7f3f2c08c620 2026-02-12T17:47:32.139 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 >> v1:10.20.193.57:6790/0 conn(0x7f3f2c08c250 legacy=0x7f3f2c08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 >> v1:10.20.193.82:6789/0 conn(0x7f3f2c182cc0 legacy=0x7f3f2c1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 monclient: found mon.noname-a 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c089a10 con 0x7f3f2c08c620 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3f140032b0 con 0x7f3f2c08c620 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 5 monclient: authenticate success, global_id 124224 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:32.140 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: dump: 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.141 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f14003540 con 0x7f3f2c08c620 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 4 set_mon_vals no callback set 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 1 -- 10.20.193.57:0/3084219428 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3f14003900 con 0x7f3f2c08c620 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f29573640 10 monclient: dump: 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.142 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 10 monclient: shutdown 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 1 -- 10.20.193.57:0/3084219428 >> v1:10.20.193.57:6789/0 conn(0x7f3f2c08c620 legacy=0x7f3f2c08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 1 -- 10.20.193.57:0/3084219428 shutdown_connections 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 1 -- 10.20.193.57:0/3084219428 >> 10.20.193.57:0/3084219428 conn(0x7f3f2c0916b0 msgr2=0x7f3f2c091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 1 -- 10.20.193.57:0/3084219428 shutdown_connections 2026-02-12T17:47:32.143 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.133+0000 7f3f30eb8640 1 -- 10.20.193.57:0/3084219428 wait complete. 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient: monmap: 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.144 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 1 Processor -- start 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 1 -- start start 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient: init 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient(hunting): picked mon.noname-b con 0x7f3f2c08c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient(hunting): picked mon.noname-a con 0x7f3f2c08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient(hunting): picked mon.noname-c con 0x7f3f2c182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c05dad0 con 0x7f3f2c08c620 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c138b60 con 0x7f3f2c08c250 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c1375a0 con 0x7f3f2c182cc0 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.145 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f30eb8640 10 monclient(hunting): authenticate will time out at 1731.953776s 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f29d74640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f3f2c08c620 0x7f3f2c136e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39584/0 (socket says 10.20.193.57:39584) 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f2ad76640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f3f2c182cc0 0x7f3f2c193420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54796/0 (socket says 10.20.193.57:54796) 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.134+0000 7f3f29d74640 1 -- 10.20.193.57:0/68498994 learned_addr learned my addr 10.20.193.57:0/68498994 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.136+0000 7f3f2ad76640 1 -- 10.20.193.57:0/68498994 >> v1:10.20.193.57:6790/0 conn(0x7f3f2c182cc0 legacy=0x7f3f2c193420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.136+0000 7f3f29d74640 1 -- 10.20.193.57:0/68498994 >> v1:10.20.193.57:6789/0 conn(0x7f3f2c08c620 legacy=0x7f3f2c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2700303285 0 0) 0x7f3f2c05dad0 con 0x7f3f2c08c620 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f2a575640 1 -- 10.20.193.57:0/68498994 >> v1:10.20.193.82:6789/0 conn(0x7f3f2c08c250 legacy=0x7f3f2c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): my global_id is 124227 2026-02-12T17:47:32.146 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef80035e0 con 0x7f3f2c08c620 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690383099 0 0) 0x7f3f2c1375a0 con 0x7f3f2c182cc0 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): my global_id is 114320 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c05dad0 con 0x7f3f2c182cc0 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 880911012 0 0) 0x7f3f2c138b60 con 0x7f3f2c08c250 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): my global_id is 5413 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c1375a0 con 0x7f3f2c08c250 2026-02-12T17:47:32.147 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 829775655 0 0) 0x7f3ef80035e0 con 0x7f3f2c08c620 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f2c138b60 con 0x7f3f2c08c620 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1178960683 0 0) 0x7f3f2c05dad0 con 0x7f3f2c182cc0 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ef80035e0 con 0x7f3f2c182cc0 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3f140036d0 con 0x7f3f2c08c620 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): dump: 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.148 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3f1c004460 con 0x7f3f2c182cc0 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient(hunting): dump: 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.149 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 316229351 0 0) 0x7f3ef80035e0 con 0x7f3f2c182cc0 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 >> v1:10.20.193.82:6789/0 conn(0x7f3f2c08c250 legacy=0x7f3f2c136780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 >> v1:10.20.193.57:6789/0 conn(0x7f3f2c08c620 legacy=0x7f3f2c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 monclient: found mon.c 2026-02-12T17:47:32.150 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c138e40 con 0x7f3f2c182cc0 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 5 monclient: authenticate success, global_id 114320 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 10 monclient: _renew_subs 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2c13e900 con 0x7f3f2c182cc0 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 10 monclient: _renew_subs 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.151 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3f2c138880 con 0x7f3f2c182cc0 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f1c004a60 con 0x7f3f2c182cc0 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f3f1c004db0 con 0x7f3f2c182cc0 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f12ffd640 10 monclient: dump: 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.152 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f28d72640 4 set_mon_vals no callback set 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.137+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f2c090810 con 0x7f3f2c182cc0 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.138+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f3f1c004f10 con 0x7f3f2c182cc0 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.138+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f3f1c04fa80 con 0x7f3f2c182cc0 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.138+0000 7f3f2a575640 10 monclient: get_auth_request con 0x7f3ef803fcb0 auth_method 0 2026-02-12T17:47:32.153 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.140+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f3f1c018310 con 0x7f3f2c182cc0 2026-02-12T17:47:32.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.140+0000 7f3f12ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.154 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.140+0000 7f3f12ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:32.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.249+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f3f2c055340 con 0x7f3ef803fcb0 2026-02-12T17:47:32.246 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.249+0000 7f3f12ffd640 1 -- 10.20.193.57:0/68498994 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f3f2c055340 con 0x7f3ef803fcb0 2026-02-12T17:47:32.246 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 3 to deep-scrub 2026-02-12T17:47:32.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.250+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 >> v1:10.20.193.82:6800/2441377515 conn(0x7f3ef803fcb0 legacy=0x7f3ef8060160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.250+0000 7f3f30eb8640 10 monclient: shutdown 2026-02-12T17:47:32.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.250+0000 7f3f30eb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.250+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 >> v1:10.20.193.57:6790/0 conn(0x7f3f2c182cc0 legacy=0x7f3f2c193420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.250+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 shutdown_connections 2026-02-12T17:47:32.247 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.250+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 >> 10.20.193.57:0/68498994 conn(0x7f3f2c0916b0 msgr2=0x7f3f2c08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.250+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 shutdown_connections 2026-02-12T17:47:32.248 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.250+0000 7f3f30eb8640 1 -- 10.20.193.57:0/68498994 wait complete. 2026-02-12T17:47:32.255 INFO:tasks.ceph:Scrubbing osd.4 2026-02-12T17:47:32.255 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-12T17:47:32.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.326+0000 7f5332acc640 10 monclient: get_monmap_and_config 2026-02-12T17:47:32.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.326+0000 7f5332acc640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.323 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.326+0000 7f5332acc640 10 monclient: monmap: 2026-02-12T17:47:32.323 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.323 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.323 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:32.327557+0000 2026-02-12T17:47:32.324 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:32.327557+0000 2026-02-12T17:47:32.324 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.324 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.324 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.324 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:32.324 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:32.324 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 1 Processor -- start 2026-02-12T17:47:32.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 1 -- start start 2026-02-12T17:47:32.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 10 monclient: init 2026-02-12T17:47:32.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:32.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 10 monclient(hunting): picked mon.noname-a con 0x7f532c08bf10 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.329 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 10 monclient(hunting): picked mon.noname-b con 0x7f532c08cf60 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 10 monclient(hunting): picked mon.noname-c con 0x7f532c08c9f0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532c085510 con 0x7f532c08bf10 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532c086290 con 0x7f532c08c9f0 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532c0859f0 con 0x7f532c08cf60 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5332acc640 10 monclient(hunting): authenticate will time out at 1732.146447s 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5330841640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7f532c08bf10 0x7f532c08c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39594/0 (socket says 10.20.193.57:39594) 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.327+0000 7f5330841640 1 -- 10.20.193.57:0/3820072710 learned_addr learned my addr 10.20.193.57:0/3820072710 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f5330841640 1 -- 10.20.193.57:0/3820072710 >> v1:10.20.193.57:6789/0 conn(0x7f532c08bf10 legacy=0x7f532c08c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f5323fff640 1 -- 10.20.193.57:0/3820072710 >> v1:10.20.193.57:6790/0 conn(0x7f532c08cf60 legacy=0x7f532c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f5331042640 1 -- 10.20.193.57:0/3820072710 >> v1:10.20.193.82:6789/0 conn(0x7f532c08c9f0 legacy=0x7f532c1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.330 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148245464 0 0) 0x7f532c0859f0 con 0x7f532c08cf60 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 10 monclient(hunting): my global_id is 114323 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53180035e0 con 0x7f532c08cf60 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545323712 0 0) 0x7f532c085510 con 0x7f532c08bf10 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 10 monclient(hunting): my global_id is 124230 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f532c0859f0 con 0x7f532c08bf10 2026-02-12T17:47:32.331 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2958988139 0 0) 0x7f53180035e0 con 0x7f532c08cf60 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 >> v1:10.20.193.82:6789/0 conn(0x7f532c08c9f0 legacy=0x7f532c1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.329+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 >> v1:10.20.193.57:6789/0 conn(0x7f532c08bf10 legacy=0x7f532c08c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 1 monclient: found mon.noname-b 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c08d3e0 con 0x7f532c08cf60 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5314003120 con 0x7f532c08cf60 2026-02-12T17:47:32.332 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: dump: 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.333 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 5 monclient: authenticate success, global_id 114323 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53140033b0 con 0x7f532c08cf60 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 1 -- 10.20.193.57:0/3820072710 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5314003550 con 0x7f532c08cf60 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f53237fe640 10 monclient: dump: 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.334 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 4 set_mon_vals no callback set 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 10 monclient: shutdown 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 1 -- 10.20.193.57:0/3820072710 >> v1:10.20.193.57:6790/0 conn(0x7f532c08cf60 legacy=0x7f532c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 1 -- 10.20.193.57:0/3820072710 shutdown_connections 2026-02-12T17:47:32.335 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 1 -- 10.20.193.57:0/3820072710 >> 10.20.193.57:0/3820072710 conn(0x7f532c091510 msgr2=0x7f532c091910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 1 -- 10.20.193.57:0/3820072710 shutdown_connections 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 1 -- 10.20.193.57:0/3820072710 wait complete. 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.330+0000 7f5332acc640 10 monclient: monmap: 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.336 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 1 Processor -- start 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 1 -- start start 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 10 monclient: init 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 10 monclient(hunting): picked mon.noname-b con 0x7f532c08bf10 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 10 monclient(hunting): picked mon.noname-c con 0x7f532c08c9f0 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 10 monclient(hunting): picked mon.noname-a con 0x7f532c08cf60 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532c153600 con 0x7f532c08cf60 2026-02-12T17:47:32.337 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532c05ddb0 con 0x7f532c08bf10 2026-02-12T17:47:32.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532c088700 con 0x7f532c08c9f0 2026-02-12T17:47:32.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5332acc640 10 monclient(hunting): authenticate will time out at 1732.150347s 2026-02-12T17:47:32.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5323fff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f532c08c9f0 0x7f532c084b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54806/0 (socket says 10.20.193.57:54806) 2026-02-12T17:47:32.338 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.331+0000 7f5323fff640 1 -- 10.20.193.57:0/3395574878 learned_addr learned my addr 10.20.193.57:0/3395574878 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5323fff640 1 -- 10.20.193.57:0/3395574878 >> v1:10.20.193.57:6790/0 conn(0x7f532c08c9f0 legacy=0x7f532c084b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.341 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5331042640 1 -- 10.20.193.57:0/3395574878 >> v1:10.20.193.57:6789/0 conn(0x7f532c08cf60 legacy=0x7f532c195260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475895780 0 0) 0x7f532c088700 con 0x7f532c08c9f0 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): my global_id is 114326 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52fc0035e0 con 0x7f532c08c9f0 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92263501 0 0) 0x7f532c153600 con 0x7f532c08cf60 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): my global_id is 124233 2026-02-12T17:47:32.342 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f532c088700 con 0x7f532c08cf60 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5330841640 1 -- 10.20.193.57:0/3395574878 >> v1:10.20.193.82:6789/0 conn(0x7f532c08bf10 legacy=0x7f532c152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3277088013 0 0) 0x7f52fc0035e0 con 0x7f532c08c9f0 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f532c153600 con 0x7f532c08c9f0 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3877753000 0 0) 0x7f532c088700 con 0x7f532c08cf60 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52fc0035e0 con 0x7f532c08cf60 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5314002b20 con 0x7f532c08c9f0 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): dump: 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.343 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5328004420 con 0x7f532c08cf60 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:32.344 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient(hunting): dump: 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 572965085 0 0) 0x7f532c153600 con 0x7f532c08c9f0 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 >> v1:10.20.193.82:6789/0 conn(0x7f532c08bf10 legacy=0x7f532c152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.345 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 >> v1:10.20.193.57:6789/0 conn(0x7f532c08cf60 legacy=0x7f532c195260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 monclient: found mon.c 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c081290 con 0x7f532c08c9f0 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f53217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5332acc640 5 monclient: authenticate success, global_id 114326 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5332acc640 10 monclient: _renew_subs 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5332acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f532c083650 con 0x7f532c08c9f0 2026-02-12T17:47:32.346 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5332acc640 10 monclient: _renew_subs 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5332acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.333+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f532c085230 con 0x7f532c08c9f0 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5314003dc0 con 0x7f532c08c9f0 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f5314004120 con 0x7f532c08c9f0 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f5322ffd640 4 set_mon_vals no callback set 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 10 monclient: dump: 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.347 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f5332acc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.57:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f532c085530 con 0x7f532c08c9f0 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f53140043b0 con 0x7f532c08c9f0 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f531404ec80 con 0x7f532c08c9f0 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.82:6805/687524042 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52fc086310 con 0x7f52fc0646b0 2026-02-12T17:47:32.348 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_get_version_reply(handle=1 version=887) ==== 24+0+0 (unknown 3331530905 0 0) 0x7f531404f030 con 0x7f532c08c9f0 2026-02-12T17:47:32.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.334+0000 7f53217fa640 10 monclient: handle_get_version_reply finishing 1 version 887 2026-02-12T17:47:32.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.335+0000 7f5330841640 10 monclient: get_auth_request con 0x7f52fc03fa80 auth_method 0 2026-02-12T17:47:32.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.335+0000 7f5331042640 10 monclient: get_auth_request con 0x7f52fc0646b0 auth_method 0 2026-02-12T17:47:32.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.340+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== osd.4 v1:10.20.193.82:6805/687524042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7f52fc086310 con 0x7f52fc0646b0 2026-02-12T17:47:32.349 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 --> v1:10.20.193.82:6805/687524042 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f532c058380 con 0x7f52fc0646b0 2026-02-12T17:47:32.350 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f53217fa640 1 -- 10.20.193.57:0/3395574878 <== osd.4 v1:10.20.193.82:6805/687524042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f532c058380 con 0x7f52fc0646b0 2026-02-12T17:47:32.350 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:47:32.350 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T17:47:32.350 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:47:32.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 >> v1:10.20.193.82:6805/687524042 conn(0x7f52fc0646b0 legacy=0x7f52fc084ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 >> v1:10.20.193.82:6800/2441377515 conn(0x7f52fc03fa80 legacy=0x7f52fc05ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5332acc640 10 monclient: shutdown 2026-02-12T17:47:32.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5332acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 >> v1:10.20.193.57:6790/0 conn(0x7f532c08c9f0 legacy=0x7f532c084b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5331042640 1 -- 10.20.193.57:0/3395574878 reap_dead start 2026-02-12T17:47:32.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 shutdown_connections 2026-02-12T17:47:32.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 >> 10.20.193.57:0/3395574878 conn(0x7f532c091510 msgr2=0x7f532c05d280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.352 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.347+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 shutdown_connections 2026-02-12T17:47:32.353 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.348+0000 7f5332acc640 1 -- 10.20.193.57:0/3395574878 wait complete. 2026-02-12T17:47:32.353 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-12T17:47:32.418 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient: get_monmap_and_config 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient: monmap: 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:32.423041+0000 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:32.423041+0000 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:32.419 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:32.420 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 1 Processor -- start 2026-02-12T17:47:32.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 1 -- start start 2026-02-12T17:47:32.428 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient: init 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient(hunting): picked mon.noname-c con 0x7ff51008c250 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient(hunting): picked mon.noname-b con 0x7ff51008c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient(hunting): picked mon.noname-a con 0x7ff510182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51008a820 con 0x7ff510182cc0 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff510089450 con 0x7ff51008c250 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff510089730 con 0x7ff51008c620 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.422+0000 7ff516252640 10 monclient(hunting): authenticate will time out at 1732.241958s 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.423+0000 7ff50effd640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ff51008c620 0x7ff51008caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54812/0 (socket says 10.20.193.57:54812) 2026-02-12T17:47:32.429 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.423+0000 7ff50ffff640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff510182cc0 0x7ff5101a30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39614/0 (socket says 10.20.193.57:39614) 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.423+0000 7ff50effd640 1 -- 10.20.193.57:0/3527689602 learned_addr learned my addr 10.20.193.57:0/3527689602 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50effd640 1 -- 10.20.193.57:0/3527689602 >> v1:10.20.193.57:6790/0 conn(0x7ff51008c620 legacy=0x7ff51008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50ffff640 1 -- 10.20.193.57:0/3527689602 >> v1:10.20.193.57:6789/0 conn(0x7ff510182cc0 legacy=0x7ff5101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50f7fe640 1 -- 10.20.193.57:0/3527689602 >> v1:10.20.193.82:6789/0 conn(0x7ff51008c250 legacy=0x7ff51008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1157630194 0 0) 0x7ff510089730 con 0x7ff51008c620 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): my global_id is 114329 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4f40035e0 con 0x7ff51008c620 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178824513 0 0) 0x7ff504003d00 con 0x7ff510182cc0 2026-02-12T17:47:32.430 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): my global_id is 124236 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff510089730 con 0x7ff510182cc0 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 376074899 0 0) 0x7ff510089450 con 0x7ff51008c250 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient(hunting): my global_id is 5422 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff504003d00 con 0x7ff51008c250 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4046883734 0 0) 0x7ff4f40035e0 con 0x7ff51008c620 2026-02-12T17:47:32.431 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 >> v1:10.20.193.82:6789/0 conn(0x7ff51008c250 legacy=0x7ff51008a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 >> v1:10.20.193.57:6789/0 conn(0x7ff510182cc0 legacy=0x7ff5101a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 monclient: found mon.noname-b 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff510089a10 con 0x7ff51008c620 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff500003150 con 0x7ff51008c620 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:32.432 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: dump: 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff516252640 5 monclient: authenticate success, global_id 114329 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff516252640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:32.433 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff500003320 con 0x7ff51008c620 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 1 -- 10.20.193.57:0/3527689602 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff500004960 con 0x7ff51008c620 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff516252640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff516252640 4 set_mon_vals no callback set 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.425+0000 7ff50e7fc640 10 monclient: dump: 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.434 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient: shutdown 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 -- 10.20.193.57:0/3527689602 >> v1:10.20.193.57:6790/0 conn(0x7ff51008c620 legacy=0x7ff51008caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 -- 10.20.193.57:0/3527689602 shutdown_connections 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 -- 10.20.193.57:0/3527689602 >> 10.20.193.57:0/3527689602 conn(0x7ff5100916b0 msgr2=0x7ff510091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.435 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 -- 10.20.193.57:0/3527689602 shutdown_connections 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 -- 10.20.193.57:0/3527689602 wait complete. 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient: monmap: 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:32.436 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 Processor -- start 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 -- start start 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient: init 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient(hunting): picked mon.noname-a con 0x7ff51008c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient(hunting): picked mon.noname-b con 0x7ff51008c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient(hunting): picked mon.noname-c con 0x7ff510182cc0 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5100869b0 con 0x7ff51008c250 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51013eae0 con 0x7ff51008c620 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51013e170 con 0x7ff510182cc0 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.437 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.426+0000 7ff516252640 10 monclient(hunting): authenticate will time out at 1732.245981s 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.427+0000 7ff50ffff640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7ff510182cc0 0x7ff510195340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=3 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54816/0 (socket says 10.20.193.57:54816) 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.427+0000 7ff50f7fe640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7ff51008c250 0x7ff510085720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:39616/0 (socket says 10.20.193.57:39616) 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.427+0000 7ff50ffff640 1 -- 10.20.193.57:0/2697270956 learned_addr learned my addr 10.20.193.57:0/2697270956 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff50ffff640 1 -- 10.20.193.57:0/2697270956 >> v1:10.20.193.57:6790/0 conn(0x7ff510182cc0 legacy=0x7ff510195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff50f7fe640 1 -- 10.20.193.57:0/2697270956 >> v1:10.20.193.57:6789/0 conn(0x7ff51008c250 legacy=0x7ff510085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425353978 0 0) 0x7ff51013e170 con 0x7ff510182cc0 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): my global_id is 114332 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4e00035e0 con 0x7ff510182cc0 2026-02-12T17:47:32.438 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff50effd640 1 -- 10.20.193.57:0/2697270956 >> v1:10.20.193.82:6789/0 conn(0x7ff51008c620 legacy=0x7ff510085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973815117 0 0) 0x7ff5100869b0 con 0x7ff51008c250 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): my global_id is 124239 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff51013e170 con 0x7ff51008c250 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1524872702 0 0) 0x7ff4e00035e0 con 0x7ff510182cc0 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5100869b0 con 0x7ff510182cc0 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff504005980 con 0x7ff510182cc0 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): dump: 2026-02-12T17:47:32.439 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2764744378 0 0) 0x7ff51013e170 con 0x7ff51008c250 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4e00035e0 con 0x7ff51008c250 2026-02-12T17:47:32.440 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff4fc003360 con 0x7ff51008c250 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): dump: 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.441 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43149280 0 0) 0x7ff51013eae0 con 0x7ff51008c620 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient(hunting): my global_id is 5425 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff51013e170 con 0x7ff51008c620 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2143835749 0 0) 0x7ff5100869b0 con 0x7ff510182cc0 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 >> v1:10.20.193.82:6789/0 conn(0x7ff51008c620 legacy=0x7ff510085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 >> v1:10.20.193.57:6789/0 conn(0x7ff51008c250 legacy=0x7ff510085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.442 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 monclient: found mon.c 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51013b1c0 con 0x7ff510182cc0 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff516252640 5 monclient: authenticate success, global_id 114332 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff516252640 10 monclient: _renew_subs 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff516252640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff51005de80 con 0x7ff510182cc0 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff516252640 10 monclient: _renew_subs 2026-02-12T17:47:32.443 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff516252640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff510086540 con 0x7ff510182cc0 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff504005d90 con 0x7ff510182cc0 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7ff504006120 con 0x7ff510182cc0 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff50dffb640 4 set_mon_vals no callback set 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.429+0000 7ff4ebfff640 10 monclient: dump: 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.444 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.430+0000 7ff516252640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.430+0000 7ff516252640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.430+0000 7ff516252640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.430+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff510090810 con 0x7ff510182cc0 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.430+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7ff5040063b0 con 0x7ff510182cc0 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.430+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7ff50404fb70 con 0x7ff510182cc0 2026-02-12T17:47:32.445 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.430+0000 7ff50f7fe640 10 monclient: get_auth_request con 0x7ff4e003fd10 auth_method 0 2026-02-12T17:47:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.432+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7ff5040183a0 con 0x7ff510182cc0 2026-02-12T17:47:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.432+0000 7ff4ebfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.446 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.432+0000 7ff4ebfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:32.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.535+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff51008f580 con 0x7ff4e003fd10 2026-02-12T17:47:32.532 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.535+0000 7ff4ebfff640 1 -- 10.20.193.57:0/2697270956 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7ff51008f580 con 0x7ff4e003fd10 2026-02-12T17:47:32.532 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 4 to deep-scrub 2026-02-12T17:47:32.533 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.536+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 >> v1:10.20.193.82:6800/2441377515 conn(0x7ff4e003fd10 legacy=0x7ff4e00601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.536+0000 7ff516252640 10 monclient: shutdown 2026-02-12T17:47:32.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.536+0000 7ff516252640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.536+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 >> v1:10.20.193.57:6790/0 conn(0x7ff510182cc0 legacy=0x7ff510195340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.536+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 shutdown_connections 2026-02-12T17:47:32.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.536+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 >> 10.20.193.57:0/2697270956 conn(0x7ff5100916b0 msgr2=0x7ff51008a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.536+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 shutdown_connections 2026-02-12T17:47:32.534 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.536+0000 7ff516252640 1 -- 10.20.193.57:0/2697270956 wait complete. 2026-02-12T17:47:32.542 INFO:tasks.ceph:Scrubbing osd.5 2026-02-12T17:47:32.542 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-12T17:47:32.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.613+0000 7fe224785640 10 monclient: get_monmap_and_config 2026-02-12T17:47:32.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.613+0000 7fe224785640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.610 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 10 monclient: monmap: 2026-02-12T17:47:32.610 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.610 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.610 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:32.614837+0000 2026-02-12T17:47:32.610 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:32.614837+0000 2026-02-12T17:47:32.610 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.610 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 1 Processor -- start 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 1 -- start start 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 10 monclient: init 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:32.611 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 10 monclient(hunting): picked mon.noname-b con 0x7fe21c08bf10 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 10 monclient(hunting): picked mon.noname-a con 0x7fe21c08cf60 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 10 monclient(hunting): picked mon.noname-c con 0x7fe21c08c9f0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c085510 con 0x7fe21c08cf60 2026-02-12T17:47:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c086290 con 0x7fe21c08c9f0 2026-02-12T17:47:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c0859f0 con 0x7fe21c08bf10 2026-02-12T17:47:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe224785640 10 monclient(hunting): authenticate will time out at 1732.433771s 2026-02-12T17:47:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe2224fa640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe21c08bf10 0x7fe21c08c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54818/0 (socket says 10.20.193.57:54818) 2026-02-12T17:47:32.612 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.614+0000 7fe2224fa640 1 -- 10.20.193.57:0/2196383776 learned_addr learned my addr 10.20.193.57:0/2196383776 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.616+0000 7fe221cf9640 1 -- 10.20.193.57:0/2196383776 >> v1:10.20.193.57:6789/0 conn(0x7fe21c08cf60 legacy=0x7fe21c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.616+0000 7fe2224fa640 1 -- 10.20.193.57:0/2196383776 >> v1:10.20.193.57:6790/0 conn(0x7fe21c08bf10 legacy=0x7fe21c08c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe222cfb640 1 -- 10.20.193.57:0/2196383776 >> v1:10.20.193.82:6789/0 conn(0x7fe21c08c9f0 legacy=0x7fe21c1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 878667940 0 0) 0x7fe21c0859f0 con 0x7fe21c08bf10 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient(hunting): my global_id is 114335 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2040035e0 con 0x7fe21c08bf10 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772961647 0 0) 0x7fe21c086290 con 0x7fe21c08c9f0 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient(hunting): my global_id is 5428 2026-02-12T17:47:32.614 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe21c0859f0 con 0x7fe21c08c9f0 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 264609016 0 0) 0x7fe2040035e0 con 0x7fe21c08bf10 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 >> v1:10.20.193.82:6789/0 conn(0x7fe21c08c9f0 legacy=0x7fe21c1a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 >> v1:10.20.193.57:6789/0 conn(0x7fe21c08cf60 legacy=0x7fe21c181ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 monclient: found mon.noname-b 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c08d3e0 con 0x7fe21c08bf10 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe20c003150 con 0x7fe21c08bf10 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: dump: 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 5 monclient: authenticate success, global_id 114335 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe20c0033a0 con 0x7fe21c08bf10 2026-02-12T17:47:32.615 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 1 -- 10.20.193.57:0/2196383776 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe20c004b10 con 0x7fe21c08bf10 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe2214f8640 10 monclient: dump: 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 4 set_mon_vals no callback set 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 10 monclient: shutdown 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 1 -- 10.20.193.57:0/2196383776 >> v1:10.20.193.57:6790/0 conn(0x7fe21c08bf10 legacy=0x7fe21c08c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 1 -- 10.20.193.57:0/2196383776 shutdown_connections 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 1 -- 10.20.193.57:0/2196383776 >> 10.20.193.57:0/2196383776 conn(0x7fe21c091510 msgr2=0x7fe21c091910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 1 -- 10.20.193.57:0/2196383776 shutdown_connections 2026-02-12T17:47:32.616 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.617+0000 7fe224785640 1 -- 10.20.193.57:0/2196383776 wait complete. 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient: monmap: 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 1 Processor -- start 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 1 -- start start 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient: init 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient(hunting): picked mon.noname-c con 0x7fe21c08bf10 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.618 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient(hunting): picked mon.noname-b con 0x7fe21c08c9f0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient(hunting): picked mon.noname-a con 0x7fe21c08cf60 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c088700 con 0x7fe21c08cf60 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c05ded0 con 0x7fe21c08c9f0 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c151c40 con 0x7fe21c08bf10 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe224785640 10 monclient(hunting): authenticate will time out at 1732.437860s 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe2224fa640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fe21c08bf10 0x7fe21c0847c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54822/0 (socket says 10.20.193.57:54822) 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.618+0000 7fe2224fa640 1 -- 10.20.193.57:0/894996345 learned_addr learned my addr 10.20.193.57:0/894996345 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe2224fa640 1 -- 10.20.193.57:0/894996345 >> v1:10.20.193.57:6790/0 conn(0x7fe21c08bf10 legacy=0x7fe21c0847c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe222cfb640 1 -- 10.20.193.57:0/894996345 >> v1:10.20.193.57:6789/0 conn(0x7fe21c08cf60 legacy=0x7fe21c193790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 457471717 0 0) 0x7fe21c151c40 con 0x7fe21c08bf10 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient(hunting): my global_id is 114338 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1ec0035e0 con 0x7fe21c08bf10 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe221cf9640 1 -- 10.20.193.57:0/894996345 >> v1:10.20.193.82:6789/0 conn(0x7fe21c08c9f0 legacy=0x7fe21c192070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1734358566 0 0) 0x7fe1ec0035e0 con 0x7fe21c08bf10 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe21c151c40 con 0x7fe21c08bf10 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe20c002fa0 con 0x7fe21c08bf10 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient(hunting): dump: 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.619 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3826909070 0 0) 0x7fe21c151c40 con 0x7fe21c08bf10 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 >> v1:10.20.193.82:6789/0 conn(0x7fe21c08c9f0 legacy=0x7fe21c192070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 >> v1:10.20.193.57:6789/0 conn(0x7fe21c08cf60 legacy=0x7fe21c193790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 monclient: found mon.c 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c081270 con 0x7fe21c08bf10 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe224785640 5 monclient: authenticate success, global_id 114338 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe224785640 10 monclient: _renew_subs 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe224785640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c07ef10 con 0x7fe21c08bf10 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe224785640 10 monclient: _renew_subs 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe224785640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe21c084ed0 con 0x7fe21c08bf10 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe20c0050f0 con 0x7fe21c08bf10 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fe20c005410 con 0x7fe21c08bf10 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe220cf7640 4 set_mon_vals no callback set 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe202ffd640 10 monclient: dump: 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.620 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.621+0000 7fe224785640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.622+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 --> v1:10.20.193.57:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe21c0810a0 con 0x7fe21c08bf10 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.622+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fe20c012080 con 0x7fe21c08bf10 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.622+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fe20c04ed50 con 0x7fe21c08bf10 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.622+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 --> v1:10.20.193.82:6809/1303150362 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe1ec086060 con 0x7fe1ec064400 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.622+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_get_version_reply(handle=1 version=887) ==== 24+0+0 (unknown 3331530905 0 0) 0x7fe20c04f100 con 0x7fe21c08bf10 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.622+0000 7fe202ffd640 10 monclient: handle_get_version_reply finishing 1 version 887 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.622+0000 7fe221cf9640 10 monclient: get_auth_request con 0x7fe1ec03f750 auth_method 0 2026-02-12T17:47:32.621 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.622+0000 7fe222cfb640 10 monclient: get_auth_request con 0x7fe1ec064400 auth_method 0 2026-02-12T17:47:32.624 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.627+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== osd.5 v1:10.20.193.82:6809/1303150362 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (unknown 0 0 784407017) 0x7fe1ec086060 con 0x7fe1ec064400 2026-02-12T17:47:32.631 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 --> v1:10.20.193.82:6809/1303150362 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe21c059860 con 0x7fe1ec064400 2026-02-12T17:47:32.632 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe202ffd640 1 -- 10.20.193.57:0/894996345 <== osd.5 v1:10.20.193.82:6809/1303150362 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe21c059860 con 0x7fe1ec064400 2026-02-12T17:47:32.632 INFO:teuthology.orchestra.run.trial057.stdout:{ 2026-02-12T17:47:32.632 INFO:teuthology.orchestra.run.trial057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T17:47:32.632 INFO:teuthology.orchestra.run.trial057.stdout:} 2026-02-12T17:47:32.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 >> v1:10.20.193.82:6809/1303150362 conn(0x7fe1ec064400 legacy=0x7fe1ec084810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 >> v1:10.20.193.82:6800/2441377515 conn(0x7fe1ec03f750 legacy=0x7fe1ec05fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.633 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 10 monclient: shutdown 2026-02-12T17:47:32.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 >> v1:10.20.193.57:6790/0 conn(0x7fe21c08bf10 legacy=0x7fe21c0847c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe222cfb640 1 -- 10.20.193.57:0/894996345 reap_dead start 2026-02-12T17:47:32.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 shutdown_connections 2026-02-12T17:47:32.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 >> 10.20.193.57:0/894996345 conn(0x7fe21c091510 msgr2=0x7fe21c057350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 shutdown_connections 2026-02-12T17:47:32.634 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.635+0000 7fe224785640 1 -- 10.20.193.57:0/894996345 wait complete. 2026-02-12T17:47:32.638 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.706+0000 7f45040c3640 10 monclient: get_monmap_and_config 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.706+0000 7f45040c3640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.706+0000 7f45040c3640 10 monclient: monmap: 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:32.707331+0000 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:32.707331+0000 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:32.703 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.706+0000 7f45040c3640 1 Processor -- start 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.706+0000 7f45040c3640 1 -- start start 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.706+0000 7f45040c3640 10 monclient: init 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 10 monclient(hunting): picked mon.noname-b con 0x7f44fc08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 10 monclient(hunting): picked mon.noname-a con 0x7f44fc08c620 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 10 monclient(hunting): picked mon.noname-c con 0x7f44fc182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc08a820 con 0x7f44fc08c620 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc089450 con 0x7f44fc182cc0 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc089730 con 0x7f44fc08c250 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f45040c3640 10 monclient(hunting): authenticate will time out at 1732.526332s 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f4501e38640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f44fc08c250 0x7f44fc08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54834/0 (socket says 10.20.193.57:54834) 2026-02-12T17:47:32.704 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.707+0000 7f4501e38640 1 -- 10.20.193.57:0/779993623 learned_addr learned my addr 10.20.193.57:0/779993623 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4501e38640 1 -- 10.20.193.57:0/779993623 >> v1:10.20.193.57:6790/0 conn(0x7f44fc08c250 legacy=0x7f44fc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.705 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4501637640 1 -- 10.20.193.57:0/779993623 >> v1:10.20.193.57:6789/0 conn(0x7f44fc08c620 legacy=0x7f44fc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 1 -- 10.20.193.57:0/779993623 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1527033213 0 0) 0x7f44fc089730 con 0x7f44fc08c250 2026-02-12T17:47:32.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient(hunting): my global_id is 114341 2026-02-12T17:47:32.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4502639640 1 -- 10.20.193.57:0/779993623 >> v1:10.20.193.82:6789/0 conn(0x7f44fc182cc0 legacy=0x7f44fc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 1 -- 10.20.193.57:0/779993623 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e40035e0 con 0x7f44fc08c250 2026-02-12T17:47:32.706 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 1 -- 10.20.193.57:0/779993623 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1244896889 0 0) 0x7f44e40035e0 con 0x7f44fc08c250 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 1 -- 10.20.193.57:0/779993623 >> v1:10.20.193.82:6789/0 conn(0x7f44fc182cc0 legacy=0x7f44fc1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 1 -- 10.20.193.57:0/779993623 >> v1:10.20.193.57:6789/0 conn(0x7f44fc08c620 legacy=0x7f44fc08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 1 monclient: found mon.noname-b 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 1 -- 10.20.193.57:0/779993623 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc089a10 con 0x7f44fc08c250 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 1 -- 10.20.193.57:0/779993623 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f44ec003150 con 0x7f44fc08c250 2026-02-12T17:47:32.707 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:32.708 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f4500e36640 10 monclient: dump: 2026-02-12T17:47:32.708 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.708 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.708 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.708 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.708 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.708 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.709 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.709 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.709 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.709 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f45040c3640 5 monclient: authenticate success, global_id 114341 2026-02-12T17:47:32.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.709+0000 7f45040c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:32.709 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f4500e36640 1 -- 10.20.193.57:0/779993623 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44ec003410 con 0x7f44fc08c250 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f4500e36640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f4500e36640 1 -- 10.20.193.57:0/779993623 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f44ec004b10 con 0x7f44fc08c250 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f4500e36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f4500e36640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f4500e36640 10 monclient: dump: 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.710 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 4 set_mon_vals no callback set 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 10 monclient: shutdown 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 1 -- 10.20.193.57:0/779993623 >> v1:10.20.193.57:6790/0 conn(0x7f44fc08c250 legacy=0x7f44fc08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 1 -- 10.20.193.57:0/779993623 shutdown_connections 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 1 -- 10.20.193.57:0/779993623 >> 10.20.193.57:0/779993623 conn(0x7f44fc0916b0 msgr2=0x7f44fc091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 1 -- 10.20.193.57:0/779993623 shutdown_connections 2026-02-12T17:47:32.711 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 1 -- 10.20.193.57:0/779993623 wait complete. 2026-02-12T17:47:32.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.717 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.710+0000 7f45040c3640 10 monclient: monmap: 2026-02-12T17:47:32.717 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.717 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:32.717 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:32.718 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:32.718 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.718 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:32.718 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.718 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:32.718 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:32.719 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 1 Processor -- start 2026-02-12T17:47:32.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 1 -- start start 2026-02-12T17:47:32.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 10 monclient: init 2026-02-12T17:47:32.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T17:47:32.719 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 10 monclient(hunting): picked mon.noname-c con 0x7f44fc08c250 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 10 monclient(hunting): picked mon.noname-b con 0x7f44fc08c620 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 10 monclient(hunting): picked mon.noname-a con 0x7f44fc182cc0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc13c2a0 con 0x7f44fc182cc0 2026-02-12T17:47:32.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc13b8a0 con 0x7f44fc08c620 2026-02-12T17:47:32.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44fc086540 con 0x7f44fc08c250 2026-02-12T17:47:32.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f45040c3640 10 monclient(hunting): authenticate will time out at 1732.530391s 2026-02-12T17:47:32.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f4501e38640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7f44fc08c250 0x7f44fc085720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54842/0 (socket says 10.20.193.57:54842) 2026-02-12T17:47:32.720 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.711+0000 7f4501e38640 1 -- 10.20.193.57:0/2279298255 learned_addr learned my addr 10.20.193.57:0/2279298255 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f4501e38640 1 -- 10.20.193.57:0/2279298255 >> v1:10.20.193.57:6790/0 conn(0x7f44fc08c250 legacy=0x7f44fc085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f4502639640 1 -- 10.20.193.57:0/2279298255 >> v1:10.20.193.57:6789/0 conn(0x7f44fc182cc0 legacy=0x7f44fc195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3133176485 0 0) 0x7f44fc086540 con 0x7f44fc08c250 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): my global_id is 114344 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44cc0035e0 con 0x7f44fc08c250 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f4501637640 1 -- 10.20.193.57:0/2279298255 >> v1:10.20.193.82:6789/0 conn(0x7f44fc08c620 legacy=0x7f44fc085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2089350487 0 0) 0x7f44cc0035e0 con 0x7f44fc08c250 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44fc086540 con 0x7f44fc08c250 2026-02-12T17:47:32.721 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f44ec003150 con 0x7f44fc08c250 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): dump: 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.722 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3570461059 0 0) 0x7f44fc13b8a0 con 0x7f44fc08c620 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 10 monclient(hunting): my global_id is 5437 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44cc0035e0 con 0x7f44fc08c620 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2136176782 0 0) 0x7f44fc086540 con 0x7f44fc08c250 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.713+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 >> v1:10.20.193.82:6789/0 conn(0x7f44fc08c620 legacy=0x7f44fc085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 >> v1:10.20.193.57:6789/0 conn(0x7f44fc182cc0 legacy=0x7f44fc195270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.723 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 1 monclient: found mon.c 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc0888a0 con 0x7f44fc08c250 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 5 monclient: authenticate success, global_id 114344 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 10 monclient: _renew_subs 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc13ed30 con 0x7f44fc08c250 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 10 monclient: _renew_subs 2026-02-12T17:47:32.724 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f44fc13b5c0 con 0x7f44fc08c250 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44ec002af0 con 0x7f44fc08c250 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7f44ec0052a0 con 0x7f44fc08c250 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ebfff640 4 set_mon_vals no callback set 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 10 monclient: dump: 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.725 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44fc13b200 con 0x7f44fc08c250 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.714+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7f44ec011f10 con 0x7f44fc08c250 2026-02-12T17:47:32.726 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.715+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7f44ec04ecc0 con 0x7f44fc08c250 2026-02-12T17:47:32.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.715+0000 7f4501637640 10 monclient: get_auth_request con 0x7f44cc03f880 auth_method 0 2026-02-12T17:47:32.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.716+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7f44ec017610 con 0x7f44fc08c250 2026-02-12T17:47:32.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.716+0000 7f44ea7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.727 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.716+0000 7f44ea7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:32.817 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.820+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f44fc13b030 con 0x7f44cc03f880 2026-02-12T17:47:32.818 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.820+0000 7f44ea7fc640 1 -- 10.20.193.57:0/2279298255 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7f44fc13b030 con 0x7f44cc03f880 2026-02-12T17:47:32.818 INFO:teuthology.orchestra.run.trial057.stderr:instructed osd(s) 5 to deep-scrub 2026-02-12T17:47:32.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.821+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 >> v1:10.20.193.82:6800/2441377515 conn(0x7f44cc03f880 legacy=0x7f44cc05fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.821+0000 7f45040c3640 10 monclient: shutdown 2026-02-12T17:47:32.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.821+0000 7f45040c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.821+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 >> v1:10.20.193.57:6790/0 conn(0x7f44fc08c250 legacy=0x7f44fc085720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.821+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 shutdown_connections 2026-02-12T17:47:32.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.821+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 >> 10.20.193.57:0/2279298255 conn(0x7f44fc0916b0 msgr2=0x7f44fc08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.821+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 shutdown_connections 2026-02-12T17:47:32.819 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.821+0000 7f45040c3640 1 -- 10.20.193.57:0/2279298255 wait complete. 2026-02-12T17:47:32.826 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:47:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.894+0000 7fd756fa5640 10 monclient: get_monmap_and_config 2026-02-12T17:47:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.894+0000 7fd756fa5640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.891 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.894+0000 7fd756fa5640 10 monclient: monmap: 2026-02-12T17:47:32.891 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.891 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.891 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:32.895105+0000 2026-02-12T17:47:32.891 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:32.895105+0000 2026-02-12T17:47:32.891 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.892 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.892 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.892 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:32.892 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:32.892 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.894+0000 7fd756fa5640 1 Processor -- start 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.894+0000 7fd756fa5640 1 -- start start 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.894+0000 7fd756fa5640 10 monclient: init 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 10 monclient(hunting): picked mon.noname-b con 0x7fd750086900 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 10 monclient(hunting): picked mon.noname-a con 0x7fd7500577d0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 10 monclient(hunting): picked mon.noname-c con 0x7fd750185360 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75008f130 con 0x7fd7500577d0 2026-02-12T17:47:32.902 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7500873e0 con 0x7fd750185360 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75008f670 con 0x7fd750086900 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd756fa5640 10 monclient(hunting): authenticate will time out at 1732.714263s 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd754d1a640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fd750086900 0x7fd750086cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54844/0 (socket says 10.20.193.57:54844) 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.895+0000 7fd754d1a640 1 -- 10.20.193.57:0/4092107928 learned_addr learned my addr 10.20.193.57:0/4092107928 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd754d1a640 1 -- 10.20.193.57:0/4092107928 >> v1:10.20.193.57:6790/0 conn(0x7fd750086900 legacy=0x7fd750086cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd747fff640 1 -- 10.20.193.57:0/4092107928 >> v1:10.20.193.57:6789/0 conn(0x7fd7500577d0 legacy=0x7fd750183c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd75551b640 1 -- 10.20.193.57:0/4092107928 >> v1:10.20.193.82:6789/0 conn(0x7fd750185360 legacy=0x7fd7501a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2989291201 0 0) 0x7fd75008f670 con 0x7fd750086900 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.903 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): my global_id is 114347 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd73c0035e0 con 0x7fd750086900 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576230319 0 0) 0x7fd75008f130 con 0x7fd7500577d0 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): my global_id is 124242 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75008f670 con 0x7fd7500577d0 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481752451 0 0) 0x7fd7500873e0 con 0x7fd750185360 2026-02-12T17:47:32.904 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient(hunting): my global_id is 5440 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75008f130 con 0x7fd750185360 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2061535768 0 0) 0x7fd75008f670 con 0x7fd7500577d0 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 >> v1:10.20.193.57:6790/0 conn(0x7fd750086900 legacy=0x7fd750086cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 >> v1:10.20.193.82:6789/0 conn(0x7fd750185360 legacy=0x7fd7501a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 monclient: found mon.noname-a 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:32.905 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75005eca0 con 0x7fd7500577d0 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd738003120 con 0x7fd7500577d0 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: dump: 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.906 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd756fa5640 5 monclient: authenticate success, global_id 124242 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd756fa5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7380033b0 con 0x7fd7500577d0 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 1 -- 10.20.193.57:0/4092107928 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd738003550 con 0x7fd7500577d0 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:32.907 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd7477fe640 10 monclient: dump: 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd756fa5640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:32.908 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.897+0000 7fd756fa5640 4 set_mon_vals no callback set 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.898+0000 7fd756fa5640 10 monclient: shutdown 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.898+0000 7fd756fa5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.898+0000 7fd756fa5640 1 -- 10.20.193.57:0/4092107928 >> v1:10.20.193.57:6789/0 conn(0x7fd7500577d0 legacy=0x7fd750183c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.898+0000 7fd756fa5640 1 -- 10.20.193.57:0/4092107928 shutdown_connections 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.898+0000 7fd756fa5640 1 -- 10.20.193.57:0/4092107928 >> 10.20.193.57:0/4092107928 conn(0x7fd750054c80 msgr2=0x7fd750093820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.898+0000 7fd756fa5640 1 -- 10.20.193.57:0/4092107928 shutdown_connections 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.898+0000 7fd756fa5640 1 -- 10.20.193.57:0/4092107928 wait complete. 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.898+0000 7fd756fa5640 10 monclient: build_initial_monmap 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.898+0000 7fd756fa5640 10 monclient: monmap: 2026-02-12T17:47:32.909 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 1 Processor -- start 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 1 -- start start 2026-02-12T17:47:32.910 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 10 monclient: init 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 10 monclient(hunting): picked mon.noname-c con 0x7fd7500577d0 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 10 monclient(hunting): picked mon.noname-a con 0x7fd750086900 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 10 monclient(hunting): picked mon.noname-b con 0x7fd750185360 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75007dcb0 con 0x7fd750086900 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75008a2e0 con 0x7fd750185360 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75008aa10 con 0x7fd7500577d0 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd756fa5640 10 monclient(hunting): authenticate will time out at 1732.718376s 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd754d1a640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7fd7500577d0 0x7fd750083560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:54848/0 (socket says 10.20.193.57:54848) 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.899+0000 7fd754d1a640 1 -- 10.20.193.57:0/2995082902 learned_addr learned my addr 10.20.193.57:0/2995082902 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:32.911 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd754d1a640 1 -- 10.20.193.57:0/2995082902 >> v1:10.20.193.57:6790/0 conn(0x7fd7500577d0 legacy=0x7fd750083560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd747fff640 1 -- 10.20.193.57:0/2995082902 >> v1:10.20.193.57:6789/0 conn(0x7fd750086900 legacy=0x7fd750173ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511728379 0 0) 0x7fd75008aa10 con 0x7fd7500577d0 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): my global_id is 114350 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7200035e0 con 0x7fd7500577d0 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283631598 0 0) 0x7fd75007dcb0 con 0x7fd750086900 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.912 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): my global_id is 124245 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75008aa10 con 0x7fd750086900 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd75551b640 1 -- 10.20.193.57:0/2995082902 >> v1:10.20.193.82:6789/0 conn(0x7fd750185360 legacy=0x7fd750175600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 102112967 0 0) 0x7fd75008aa10 con 0x7fd750086900 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd75007dcb0 con 0x7fd750086900 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd738003f90 con 0x7fd750086900 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): dump: 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.913 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863561979 0 0) 0x7fd75008a2e0 con 0x7fd750185360 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _negotiate 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): my global_id is 5443 2026-02-12T17:47:32.914 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd75008aa10 con 0x7fd750185360 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3514223549 0 0) 0x7fd7200035e0 con 0x7fd7500577d0 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd75008a2e0 con 0x7fd7500577d0 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd740003530 con 0x7fd7500577d0 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 10 monclient(hunting): dump: 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.915 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.901+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.0 v1:10.20.193.57:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2440064978 0 0) 0x7fd75007dcb0 con 0x7fd750086900 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 >> v1:10.20.193.57:6790/0 conn(0x7fd7500577d0 legacy=0x7fd750083560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 >> v1:10.20.193.82:6789/0 conn(0x7fd750185360 legacy=0x7fd750175600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 10 monclient: _finish_hunting 0 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 1 monclient: found mon.a 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:32.916 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd750080010 con 0x7fd750086900 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 10 monclient: _finish_auth 0 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 10 monclient: _check_auth_tickets 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 5 monclient: authenticate success, global_id 124245 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 10 monclient: _renew_subs 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.57:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd75007f770 con 0x7fd750086900 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 10 monclient: _renew_subs 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.57:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd750083c70 con 0x7fd750086900 2026-02-12T17:47:32.917 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.0 v1:10.20.193.57:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd738002b60 con 0x7fd750086900 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.0 v1:10.20.193.57:6789/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7fd738004220 con 0x7fd750086900 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd746ffd640 4 set_mon_vals no callback set 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 10 monclient: dump: 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:32.918 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.57:6789/0 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.57:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7500008d0 con 0x7fd750086900 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.902+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.0 v1:10.20.193.57:6789/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7fd738012390 con 0x7fd750086900 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.903+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.0 v1:10.20.193.57:6789/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7fd73804ebd0 con 0x7fd750086900 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.903+0000 7fd754d1a640 10 monclient: get_auth_request con 0x7fd72003fcc0 auth_method 0 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.905+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mon.0 v1:10.20.193.57:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7fd7380174c0 con 0x7fd750086900 2026-02-12T17:47:32.919 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.905+0000 7fd7457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:32.920 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:32.905+0000 7fd7457fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:33.004 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.007+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd750057bd0 con 0x7fd72003fcc0 2026-02-12T17:47:33.005 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.008+0000 7fd7457fa640 1 -- 10.20.193.57:0/2995082902 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33996 (unknown 2965378022 0 134339670) 0x7fd7400079e0 con 0x7fd72003fcc0 2026-02-12T17:47:33.005 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:47:33.006 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:47:33.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.009+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 >> v1:10.20.193.82:6800/2441377515 conn(0x7fd72003fcc0 legacy=0x7fd720060170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:33.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.009+0000 7fd756fa5640 10 monclient: shutdown 2026-02-12T17:47:33.006 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.009+0000 7fd756fa5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:33.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.009+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 >> v1:10.20.193.57:6789/0 conn(0x7fd750086900 legacy=0x7fd750173ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:33.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.009+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 shutdown_connections 2026-02-12T17:47:33.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.009+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 >> 10.20.193.57:0/2995082902 conn(0x7fd750054c80 msgr2=0x7fd7500897b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:33.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.009+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 shutdown_connections 2026-02-12T17:47:33.007 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:33.009+0000 7fd756fa5640 1 -- 10.20.193.57:0/2995082902 wait complete. 2026-02-12T17:47:33.013 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":1468,"stamp":"2026-02-12T17:47:31.958790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":265168,"kb_used_data":13168,"kb_used_omap":10389,"kb_used_meta":241514,"kb_avail":565965872,"statfs":{"total":579820584960,"available":579549052928,"internally_reserved":0,"allocated":13484032,"data_stored":7867822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10638613,"internal_metadata":247311083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001069"},"pg_stats":[{"pgid":"1.0","version":"14'112","reported_seq":1868,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907630+0000","last_change":"2026-02-12T17:28:13.575533+0000","last_active":"2026-02-12T17:46:01.907630+0000","last_peered":"2026-02-12T17:46:01.907630+0000","last_clean":"2026-02-12T17:46:01.907630+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:46:01.907630+0000","last_undegraded":"2026-02-12T17:46:01.907630+0000","last_fullsized":"2026-02-12T17:46:01.907630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:11.958332+0000","last_clean_scrub_stamp":"2026-02-12T17:28:11.958332+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:10:01.188074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":1737,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907764+0000","last_change":"2026-02-12T17:28:19.283491+0000","last_active":"2026-02-12T17:46:01.907764+0000","last_peered":"2026-02-12T17:46:01.907764+0000","last_clean":"2026-02-12T17:46:01.907764+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:46:01.907764+0000","last_undegraded":"2026-02-12T17:46:01.907764+0000","last_fullsized":"2026-02-12T17:46:01.907764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:53.711374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1731,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907625+0000","last_change":"2026-02-12T17:28:19.724210+0000","last_active":"2026-02-12T17:46:01.907625+0000","last_peered":"2026-02-12T17:46:01.907625+0000","last_clean":"2026-02-12T17:46:01.907625+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:46:01.907625+0000","last_undegraded":"2026-02-12T17:46:01.907625+0000","last_fullsized":"2026-02-12T17:46:01.907625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:54.193528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1736,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912653+0000","last_change":"2026-02-12T17:28:19.286905+0000","last_active":"2026-02-12T17:46:01.912653+0000","last_peered":"2026-02-12T17:46:01.912653+0000","last_clean":"2026-02-12T17:46:01.912653+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:46:01.912653+0000","last_undegraded":"2026-02-12T17:46:01.912653+0000","last_fullsized":"2026-02-12T17:46:01.912653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:30:35.531511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":1738,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907749+0000","last_change":"2026-02-12T17:28:19.283404+0000","last_active":"2026-02-12T17:46:01.907749+0000","last_peered":"2026-02-12T17:46:01.907749+0000","last_clean":"2026-02-12T17:46:01.907749+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:46:01.907749+0000","last_undegraded":"2026-02-12T17:46:01.907749+0000","last_fullsized":"2026-02-12T17:46:01.907749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:24:22.204036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1746,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912771+0000","last_change":"2026-02-12T17:28:19.289250+0000","last_active":"2026-02-12T17:46:01.912771+0000","last_peered":"2026-02-12T17:46:01.912771+0000","last_clean":"2026-02-12T17:46:01.912771+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:46:01.912771+0000","last_undegraded":"2026-02-12T17:46:01.912771+0000","last_fullsized":"2026-02-12T17:46:01.912771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:19:32.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1731,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907624+0000","last_change":"2026-02-12T17:28:19.724251+0000","last_active":"2026-02-12T17:46:01.907624+0000","last_peered":"2026-02-12T17:46:01.907624+0000","last_clean":"2026-02-12T17:46:01.907624+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:46:01.907624+0000","last_undegraded":"2026-02-12T17:46:01.907624+0000","last_fullsized":"2026-02-12T17:46:01.907624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:31:06.358030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1745,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.912705+0000","last_change":"2026-02-12T17:28:19.289150+0000","last_active":"2026-02-12T17:46:01.912705+0000","last_peered":"2026-02-12T17:46:01.912705+0000","last_clean":"2026-02-12T17:46:01.912705+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:46:01.912705+0000","last_undegraded":"2026-02-12T17:46:01.912705+0000","last_fullsized":"2026-02-12T17:46:01.912705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:34:03.582232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1730,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:46:01.907605+0000","last_change":"2026-02-12T17:28:19.724309+0000","last_active":"2026-02-12T17:46:01.907605+0000","last_peered":"2026-02-12T17:46:01.907605+0000","last_clean":"2026-02-12T17:46:01.907605+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:46:01.907605+0000","last_undegraded":"2026-02-12T17:46:01.907605+0000","last_fullsized":"2026-02-12T17:46:01.907605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:28:15.801239+0000","last_clean_scrub_stamp":"2026-02-12T17:28:15.801239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:21:16.200936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640491,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":2093,"kb_used_meta":42898,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2144108,"internal_metadata":43927700},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640490,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":2158,"kb_used_meta":42833,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2210741,"internal_metadata":43861067},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640493,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29500,"kb_used_data":2540,"kb_used_omap":938,"kb_used_meta":26005,"kb_avail":94342340,"statfs":{"total":96636764160,"available":96606556160,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":961349,"internal_metadata":26629307},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640491,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":1995,"kb_used_meta":42996,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2043800,"internal_metadata":44028008},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640492,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":1501,"kb_used_meta":43490,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1537281,"internal_metadata":44534527},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640491,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47548,"kb_used_data":2540,"kb_used_omap":1700,"kb_used_meta":43291,"kb_avail":94324292,"statfs":{"total":96636764160,"available":96588075008,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1741334,"internal_metadata":44330474},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:47:33.018 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-12T17:28:11.958332+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=28, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=47, tm_sec=29, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T17:47:33.018 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-12T17:28:15.801239+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=28, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=47, tm_sec=29, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T17:47:33.019 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-12T17:28:15.801239+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=28, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=47, tm_sec=29, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T17:47:33.019 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-12T17:28:15.801239+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=28, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=47, tm_sec=29, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T17:47:33.019 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-12T17:28:15.801239+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=28, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=47, tm_sec=29, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T17:47:33.019 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-12T17:28:15.801239+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=28, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=47, tm_sec=29, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T17:47:33.019 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-12T17:28:15.801239+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=28, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=47, tm_sec=29, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T17:47:33.019 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-12T17:28:15.801239+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=28, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=47, tm_sec=29, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T17:47:33.020 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-12T17:28:15.801239+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=28, tm_sec=15, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=17, tm_min=47, tm_sec=29, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T17:47:33.020 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-12T17:47:53.020 DEBUG:teuthology.orchestra.run.trial057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T17:47:53.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient: get_monmap_and_config 2026-02-12T17:47:53.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient: build_initial_monmap 2026-02-12T17:47:53.089 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient: monmap: 2026-02-12T17:47:53.089 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:53.089 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.089 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:53.093932+0000 2026-02-12T17:47:53.089 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:53.093932+0000 2026-02-12T17:47:53.089 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:53.089 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 1 Processor -- start 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 1 -- start start 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient: init 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient(hunting): picked mon.noname-c con 0x7effc408bda0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:53.090 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient(hunting): picked mon.noname-b con 0x7effc408c880 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:53.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient(hunting): picked mon.noname-a con 0x7effc4182d60 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:53.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc408d4e0 con 0x7effc4182d60 2026-02-12T17:47:53.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc40889a0 con 0x7effc408bda0 2026-02-12T17:47:53.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc4088c60 con 0x7effc408c880 2026-02-12T17:47:53.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:53.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effcaf92640 10 monclient(hunting): authenticate will time out at 1752.912834s 2026-02-12T17:47:53.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effc978f640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7effc408c880 0x7effc4181640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36850/0 (socket says 10.20.193.57:36850) 2026-02-12T17:47:53.091 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.093+0000 7effc978f640 1 -- 10.20.193.57:0/220141586 learned_addr learned my addr 10.20.193.57:0/220141586 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:53.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc978f640 1 -- 10.20.193.57:0/220141586 >> v1:10.20.193.57:6790/0 conn(0x7effc408c880 legacy=0x7effc4181640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.092 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effca791640 1 -- 10.20.193.57:0/220141586 >> v1:10.20.193.57:6789/0 conn(0x7effc4182d60 legacy=0x7effc41a3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 -- 10.20.193.57:0/220141586 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197131088 0 0) 0x7effc408d4e0 con 0x7effc4182d60 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient(hunting): my global_id is 124248 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 -- 10.20.193.57:0/220141586 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effac0035e0 con 0x7effc4182d60 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc9f90640 1 -- 10.20.193.57:0/220141586 >> v1:10.20.193.82:6789/0 conn(0x7effc408bda0 legacy=0x7effc408c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 -- 10.20.193.57:0/220141586 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1379637636 0 0) 0x7effac0035e0 con 0x7effc4182d60 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 -- 10.20.193.57:0/220141586 >> v1:10.20.193.57:6790/0 conn(0x7effc408c880 legacy=0x7effc4181640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 -- 10.20.193.57:0/220141586 >> v1:10.20.193.82:6789/0 conn(0x7effc408bda0 legacy=0x7effc408c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: _finish_hunting 0 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 monclient: found mon.noname-a 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.57:6789/0 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 -- 10.20.193.57:0/220141586 --> v1:10.20.193.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc4087ed0 con 0x7effc4182d60 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: _finish_auth 0 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: _check_auth_tickets 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 -- 10.20.193.57:0/220141586 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7effc0004200 con 0x7effc4182d60 2026-02-12T17:47:53.093 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: dump: 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 5 monclient: authenticate success, global_id 124248 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 -- 10.20.193.57:0/220141586 <== mon.0 v1:10.20.193.57:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effc0004490 con 0x7effc4182d60 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 1 -- 10.20.193.57:0/220141586 <== mon.0 v1:10.20.193.57:6789/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7effc0004630 con 0x7effc4182d60 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 4 set_mon_vals no callback set 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effc8f8e640 10 monclient: dump: 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.094 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 10 monclient: shutdown 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 1 -- 10.20.193.57:0/220141586 >> v1:10.20.193.57:6789/0 conn(0x7effc4182d60 legacy=0x7effc41a3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 1 -- 10.20.193.57:0/220141586 shutdown_connections 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 1 -- 10.20.193.57:0/220141586 >> 10.20.193.57:0/220141586 conn(0x7effc4090410 msgr2=0x7effc40914a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 1 -- 10.20.193.57:0/220141586 shutdown_connections 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.096+0000 7effcaf92640 1 -- 10.20.193.57:0/220141586 wait complete. 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient: build_initial_monmap 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient: monmap: 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:53.095 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 1 Processor -- start 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 1 -- start start 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient: init 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient(hunting): picked mon.noname-a con 0x7effc408bda0 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient(hunting): picked mon.noname-c con 0x7effc408c880 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient(hunting): picked mon.noname-b con 0x7effc4182d60 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc4080b70 con 0x7effc408bda0 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc4058780 con 0x7effc4182d60 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc407fd00 con 0x7effc408c880 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effcaf92640 10 monclient(hunting): authenticate will time out at 1752.916858s 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effc9f90640 1 --1- >> v1:10.20.193.57:6789/0 conn(0x7effc408bda0 0x7effc407cd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:43082/0 (socket says 10.20.193.57:43082) 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effc9f90640 1 -- 10.20.193.57:0/943993242 learned_addr learned my addr 10.20.193.57:0/943993242 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:53.096 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.097+0000 7effc978f640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7effc408c880 0x7effc407d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36856/0 (socket says 10.20.193.57:36856) 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.099+0000 7effc978f640 1 -- 10.20.193.57:0/943993242 >> v1:10.20.193.57:6790/0 conn(0x7effc408c880 legacy=0x7effc407d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effc9f90640 1 -- 10.20.193.57:0/943993242 >> v1:10.20.193.57:6789/0 conn(0x7effc408bda0 legacy=0x7effc407cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1084635688 0 0) 0x7effc407fd00 con 0x7effc408c880 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): my global_id is 114353 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effca791640 1 -- 10.20.193.57:0/943993242 >> v1:10.20.193.82:6789/0 conn(0x7effc4182d60 legacy=0x7effc4172970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff940035e0 con 0x7effc408c880 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197274971 0 0) 0x7effc4080b70 con 0x7effc408bda0 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): my global_id is 124251 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc407fd00 con 0x7effc408bda0 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185431363 0 0) 0x7effc4058780 con 0x7effc4182d60 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.098 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): my global_id is 5449 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc4080b70 con 0x7effc4182d60 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 734886186 0 0) 0x7eff940035e0 con 0x7effc408c880 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effc4058780 con 0x7effc408c880 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7effb80032f0 con 0x7effc408c880 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): dump: 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3024163076 0 0) 0x7effc407fd00 con 0x7effc408bda0 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff940035e0 con 0x7effc408bda0 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7effb40033e0 con 0x7effc408bda0 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient(hunting): dump: 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.099 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3246644780 0 0) 0x7effc4058780 con 0x7effc408c880 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 >> v1:10.20.193.82:6789/0 conn(0x7effc4182d60 legacy=0x7effc4172970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 >> v1:10.20.193.57:6789/0 conn(0x7effc408bda0 legacy=0x7effc407cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient: _finish_hunting 0 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 monclient: found mon.c 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc407e810 con 0x7effc408c880 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient: _finish_auth 0 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient: _check_auth_tickets 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effcaf92640 5 monclient: authenticate success, global_id 114353 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effcaf92640 10 monclient: _renew_subs 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effcaf92640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7effc4088690 con 0x7effc408c880 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effcaf92640 10 monclient: _renew_subs 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effcaf92640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7effc407db70 con 0x7effc408c880 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effb8004b50 con 0x7effc408c880 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7effb8004ea0 con 0x7effc408c880 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb3fff640 4 set_mon_vals no callback set 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.100+0000 7effb27fc640 10 monclient: dump: 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.100 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.101+0000 7effcaf92640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.101+0000 7effcaf92640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.101+0000 7effcaf92640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.101+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc40810a0 con 0x7effc408c880 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.101+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7effb8005000 con 0x7effc408c880 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.101+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7effb804ea50 con 0x7effc408c880 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.101+0000 7effc9f90640 10 monclient: get_auth_request con 0x7eff9403fb80 auth_method 0 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.104+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7effb8017360 con 0x7effc408c880 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.104+0000 7effb27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:53.101 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.104+0000 7effb27fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:53.200 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.204+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 --> v1:10.20.193.82:6800/2441377515 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effc405e6c0 con 0x7eff9403fb80 2026-02-12T17:47:53.201 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.205+0000 7effb27fc640 1 -- 10.20.193.57:0/943993242 <== mgr.4105 v1:10.20.193.82:6800/2441377515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34015 (unknown 2965378022 0 3030834797) 0x7effb40088f0 con 0x7eff9403fb80 2026-02-12T17:47:53.202 INFO:teuthology.orchestra.run.trial057.stdout: 2026-02-12T17:47:53.203 INFO:teuthology.orchestra.run.trial057.stderr:dumped all 2026-02-12T17:47:53.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.206+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 >> v1:10.20.193.82:6800/2441377515 conn(0x7eff9403fb80 legacy=0x7eff94060030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.203 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.206+0000 7effcaf92640 10 monclient: shutdown 2026-02-12T17:47:53.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.206+0000 7effcaf92640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:53.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.206+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 >> v1:10.20.193.57:6790/0 conn(0x7effc408c880 legacy=0x7effc407d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.206+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 shutdown_connections 2026-02-12T17:47:53.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.206+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 >> 10.20.193.57:0/943993242 conn(0x7effc4090410 msgr2=0x7effc405d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:53.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.206+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 shutdown_connections 2026-02-12T17:47:53.204 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.206+0000 7effcaf92640 1 -- 10.20.193.57:0/943993242 wait complete. 2026-02-12T17:47:53.210 INFO:teuthology.orchestra.run.trial057.stdout:{"pg_ready":true,"pg_map":{"version":1478,"stamp":"2026-02-12T17:47:51.960520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":265168,"kb_used_data":13168,"kb_used_omap":10389,"kb_used_meta":241514,"kb_avail":565965872,"statfs":{"total":579820584960,"available":579549052928,"internally_reserved":0,"allocated":13484032,"data_stored":7867822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10638613,"internal_metadata":247311083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000990"},"pg_stats":[{"pgid":"1.0","version":"887'114","reported_seq":1878,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:47:32.461055+0000","last_change":"2026-02-12T17:47:32.461055+0000","last_active":"2026-02-12T17:47:32.461055+0000","last_peered":"2026-02-12T17:47:32.461055+0000","last_clean":"2026-02-12T17:47:32.461055+0000","last_became_active":"2026-02-12T17:28:13.575068+0000","last_became_peered":"2026-02-12T17:28:13.575068+0000","last_unstale":"2026-02-12T17:47:32.461055+0000","last_undegraded":"2026-02-12T17:47:32.461055+0000","last_fullsized":"2026-02-12T17:47:32.461055+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"887'114","last_scrub_stamp":"2026-02-12T17:47:32.461022+0000","last_deep_scrub":"887'114","last_deep_scrub_stamp":"2026-02-12T17:47:32.461022+0000","last_clean_scrub_stamp":"2026-02-12T17:47:32.461022+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:59:20.364857+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"887'2","reported_seq":1746,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:47:33.899402+0000","last_change":"2026-02-12T17:47:33.899402+0000","last_active":"2026-02-12T17:47:33.899402+0000","last_peered":"2026-02-12T17:47:33.899402+0000","last_clean":"2026-02-12T17:47:33.899402+0000","last_became_active":"2026-02-12T17:28:17.037841+0000","last_became_peered":"2026-02-12T17:28:17.037841+0000","last_unstale":"2026-02-12T17:47:33.899402+0000","last_undegraded":"2026-02-12T17:47:33.899402+0000","last_fullsized":"2026-02-12T17:47:33.899402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"887'2","last_scrub_stamp":"2026-02-12T17:47:33.899376+0000","last_deep_scrub":"887'2","last_deep_scrub_stamp":"2026-02-12T17:47:33.899376+0000","last_clean_scrub_stamp":"2026-02-12T17:47:33.899376+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:29:07.088962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.000297223,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1739,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:47:35.479948+0000","last_change":"2026-02-12T17:47:35.479948+0000","last_active":"2026-02-12T17:47:35.479948+0000","last_peered":"2026-02-12T17:47:35.479948+0000","last_clean":"2026-02-12T17:47:35.479948+0000","last_became_active":"2026-02-12T17:28:17.035943+0000","last_became_peered":"2026-02-12T17:28:17.035943+0000","last_unstale":"2026-02-12T17:47:35.479948+0000","last_undegraded":"2026-02-12T17:47:35.479948+0000","last_fullsized":"2026-02-12T17:47:35.479948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:47:35.479906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:47:35.479906+0000","last_clean_scrub_stamp":"2026-02-12T17:47:35.479906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:47:30.905692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00023122999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1744,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:47:32.271609+0000","last_change":"2026-02-12T17:47:32.271609+0000","last_active":"2026-02-12T17:47:32.271609+0000","last_peered":"2026-02-12T17:47:32.271609+0000","last_clean":"2026-02-12T17:47:32.271609+0000","last_became_active":"2026-02-12T17:28:17.041395+0000","last_became_peered":"2026-02-12T17:28:17.041395+0000","last_unstale":"2026-02-12T17:47:32.271609+0000","last_undegraded":"2026-02-12T17:47:32.271609+0000","last_fullsized":"2026-02-12T17:47:32.271609+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:47:32.271565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:47:32.271565+0000","last_clean_scrub_stamp":"2026-02-12T17:47:32.271565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:24:44.311086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034900000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"887'3","reported_seq":1747,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:47:32.929360+0000","last_change":"2026-02-12T17:47:32.929360+0000","last_active":"2026-02-12T17:47:32.929360+0000","last_peered":"2026-02-12T17:47:32.929360+0000","last_clean":"2026-02-12T17:47:32.929360+0000","last_became_active":"2026-02-12T17:28:17.037719+0000","last_became_peered":"2026-02-12T17:28:17.037719+0000","last_unstale":"2026-02-12T17:47:32.929360+0000","last_undegraded":"2026-02-12T17:47:32.929360+0000","last_fullsized":"2026-02-12T17:47:32.929360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"887'3","last_scrub_stamp":"2026-02-12T17:47:32.929334+0000","last_deep_scrub":"887'3","last_deep_scrub_stamp":"2026-02-12T17:47:32.929334+0000","last_clean_scrub_stamp":"2026-02-12T17:47:32.929334+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:31:29.396333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00028345699999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1754,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:47:33.026349+0000","last_change":"2026-02-12T17:47:33.026349+0000","last_active":"2026-02-12T17:47:33.026349+0000","last_peered":"2026-02-12T17:47:33.026349+0000","last_clean":"2026-02-12T17:47:33.026349+0000","last_became_active":"2026-02-12T17:28:17.619691+0000","last_became_peered":"2026-02-12T17:28:17.619691+0000","last_unstale":"2026-02-12T17:47:33.026349+0000","last_undegraded":"2026-02-12T17:47:33.026349+0000","last_fullsized":"2026-02-12T17:47:33.026349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:47:33.026298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:47:33.026298+0000","last_clean_scrub_stamp":"2026-02-12T17:47:33.026298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:28:56.911541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00041610399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1739,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:47:33.483740+0000","last_change":"2026-02-12T17:47:33.483740+0000","last_active":"2026-02-12T17:47:33.483740+0000","last_peered":"2026-02-12T17:47:33.483740+0000","last_clean":"2026-02-12T17:47:33.483740+0000","last_became_active":"2026-02-12T17:28:17.616232+0000","last_became_peered":"2026-02-12T17:28:17.616232+0000","last_unstale":"2026-02-12T17:47:33.483740+0000","last_undegraded":"2026-02-12T17:47:33.483740+0000","last_fullsized":"2026-02-12T17:47:33.483740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:47:33.483700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:47:33.483700+0000","last_clean_scrub_stamp":"2026-02-12T17:47:33.483700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:37:34.260069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00025400200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1754,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:47:32.067638+0000","last_change":"2026-02-12T17:47:32.067615+0000","last_active":"2026-02-12T17:47:32.067638+0000","last_peered":"2026-02-12T17:47:32.067638+0000","last_clean":"2026-02-12T17:47:32.067638+0000","last_became_active":"2026-02-12T17:28:17.049042+0000","last_became_peered":"2026-02-12T17:28:17.049042+0000","last_unstale":"2026-02-12T17:47:32.067638+0000","last_undegraded":"2026-02-12T17:47:32.067638+0000","last_fullsized":"2026-02-12T17:47:32.067638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:47:32.067580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:47:32.067580+0000","last_clean_scrub_stamp":"2026-02-12T17:47:32.067580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:16:10.996388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043503900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1739,"reported_epoch":887,"state":"active+clean","last_fresh":"2026-02-12T17:47:34.477990+0000","last_change":"2026-02-12T17:47:34.477958+0000","last_active":"2026-02-12T17:47:34.477990+0000","last_peered":"2026-02-12T17:47:34.477990+0000","last_clean":"2026-02-12T17:47:34.477990+0000","last_became_active":"2026-02-12T17:28:17.616282+0000","last_became_peered":"2026-02-12T17:28:17.616282+0000","last_unstale":"2026-02-12T17:47:34.477990+0000","last_undegraded":"2026-02-12T17:47:34.477990+0000","last_fullsized":"2026-02-12T17:47:34.477990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T17:47:34.477910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T17:47:34.477910+0000","last_clean_scrub_stamp":"2026-02-12T17:47:34.477910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:41:14.793635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030700200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640495,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":2093,"kb_used_meta":42898,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2144108,"internal_metadata":43927700},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640494,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":2158,"kb_used_meta":42833,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2210741,"internal_metadata":43861067},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640497,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29500,"kb_used_data":2540,"kb_used_omap":938,"kb_used_meta":26005,"kb_avail":94342340,"statfs":{"total":96636764160,"available":96606556160,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":961349,"internal_metadata":26629307},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640495,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47028,"kb_used_data":2020,"kb_used_omap":1995,"kb_used_meta":42996,"kb_avail":94324812,"statfs":{"total":96636764160,"available":96588607488,"internally_reserved":0,"allocated":2068480,"data_stored":1134988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2043800,"internal_metadata":44028008},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640496,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47032,"kb_used_data":2024,"kb_used_omap":1501,"kb_used_meta":43490,"kb_avail":94324808,"statfs":{"total":96636764160,"available":96588603392,"internally_reserved":0,"allocated":2072576,"data_stored":1135007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1537281,"internal_metadata":44534527},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640495,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47548,"kb_used_data":2540,"kb_used_omap":1700,"kb_used_meta":43291,"kb_avail":94324292,"statfs":{"total":96636764160,"available":96588075008,"internally_reserved":0,"allocated":2600960,"data_stored":1663916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1741334,"internal_metadata":44330474},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T17:47:53.212 DEBUG:teuthology.orchestra.run.trial057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T17:47:53.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.278+0000 7faef3954640 10 monclient: get_monmap_and_config 2026-02-12T17:47:53.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.278+0000 7faef3954640 10 monclient: build_initial_monmap 2026-02-12T17:47:53.275 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.278+0000 7faef3954640 10 monclient: monmap: 2026-02-12T17:47:53.275 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:53.275 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.276 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:47:53.279467+0000 2026-02-12T17:47:53.276 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:47:53.279467+0000 2026-02-12T17:47:53.276 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:53.276 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.276 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:53.276 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-c 2026-02-12T17:47:53.276 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-b 2026-02-12T17:47:53.277 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.286 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 1 Processor -- start 2026-02-12T17:47:53.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 1 -- start start 2026-02-12T17:47:53.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 10 monclient: init 2026-02-12T17:47:53.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:53.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:53.287 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 10 monclient(hunting): picked mon.noname-a con 0x7faeec08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:53.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 10 monclient(hunting): picked mon.noname-b con 0x7faeec08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:53.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 10 monclient(hunting): picked mon.noname-c con 0x7faeec182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:53.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeec08a820 con 0x7faeec08c250 2026-02-12T17:47:53.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeec089450 con 0x7faeec182cc0 2026-02-12T17:47:53.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeec089730 con 0x7faeec08c620 2026-02-12T17:47:53.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:53.288 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef3954640 10 monclient(hunting): authenticate will time out at 1753.098560s 2026-02-12T17:47:53.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef0ec8640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7faeec08c620 0x7faeec08caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36872/0 (socket says 10.20.193.57:36872) 2026-02-12T17:47:53.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef0ec8640 1 -- 10.20.193.57:0/3828192266 learned_addr learned my addr 10.20.193.57:0/3828192266 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:53.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.279+0000 7faef16c9640 1 --1- 10.20.193.57:0/3828192266 >> v1:10.20.193.57:6789/0 conn(0x7faeec08c250 0x7faeec08a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.57:6789/0 says I am v1:10.20.193.57:43096/0 (socket says 10.20.193.57:43096) 2026-02-12T17:47:53.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faef0ec8640 1 -- 10.20.193.57:0/3828192266 >> v1:10.20.193.57:6790/0 conn(0x7faeec08c620 legacy=0x7faeec08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faef16c9640 1 -- 10.20.193.57:0/3828192266 >> v1:10.20.193.57:6789/0 conn(0x7faeec08c250 legacy=0x7faeec08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.289 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faef1eca640 1 -- 10.20.193.57:0/3828192266 >> v1:10.20.193.82:6789/0 conn(0x7faeec182cc0 legacy=0x7faeec1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 136217343 0 0) 0x7faeec089730 con 0x7faeec08c620 2026-02-12T17:47:53.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 10 monclient(hunting): my global_id is 114356 2026-02-12T17:47:53.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faed40035e0 con 0x7faeec08c620 2026-02-12T17:47:53.290 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108553888 0 0) 0x7faedc002c20 con 0x7faeec08c250 2026-02-12T17:47:53.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.281+0000 7faedbfff640 10 monclient(hunting): my global_id is 124254 2026-02-12T17:47:53.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeec089730 con 0x7faeec08c250 2026-02-12T17:47:53.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913951227 0 0) 0x7faeec089450 con 0x7faeec182cc0 2026-02-12T17:47:53.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.291 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient(hunting): my global_id is 5452 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faedc002c20 con 0x7faeec182cc0 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3146411218 0 0) 0x7faed40035e0 con 0x7faeec08c620 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 >> v1:10.20.193.82:6789/0 conn(0x7faeec182cc0 legacy=0x7faeec1a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 >> v1:10.20.193.57:6789/0 conn(0x7faeec08c250 legacy=0x7faeec08a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: _finish_hunting 0 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 monclient: found mon.noname-b 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec089a10 con 0x7faeec08c620 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: _finish_auth 0 2026-02-12T17:47:53.292 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: _check_auth_tickets 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faee00030d0 con 0x7faeec08c620 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: dump: 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.293 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 5 monclient: authenticate success, global_id 114356 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 <== mon.2 v1:10.20.193.57:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faee0003360 con 0x7faeec08c620 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 1 -- 10.20.193.57:0/3828192266 <== mon.2 v1:10.20.193.57:6790/0 5 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faee0004960 con 0x7faeec08c620 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faedbfff640 10 monclient: dump: 2026-02-12T17:47:53.294 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 10 monclient: get_monmap_and_config success 2026-02-12T17:47:53.295 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 4 set_mon_vals no callback set 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 10 monclient: shutdown 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 1 -- 10.20.193.57:0/3828192266 >> v1:10.20.193.57:6790/0 conn(0x7faeec08c620 legacy=0x7faeec08caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 1 -- 10.20.193.57:0/3828192266 shutdown_connections 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 1 -- 10.20.193.57:0/3828192266 >> 10.20.193.57:0/3828192266 conn(0x7faeec0916b0 msgr2=0x7faeec091ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 1 -- 10.20.193.57:0/3828192266 shutdown_connections 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.282+0000 7faef3954640 1 -- 10.20.193.57:0/3828192266 wait complete. 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient: build_initial_monmap 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient: monmap: 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:epoch 0 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 0.000000 2026-02-12T17:47:53.296 INFO:teuthology.orchestra.run.trial057.stderr:created 0.000000 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 0 (unknown) 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 1 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.noname-a 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.noname-b 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.noname-c 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 1 Processor -- start 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 1 -- start start 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient: init 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient: _reopen_session rank -1 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient(hunting): picked mon.noname-a con 0x7faeec08c250 addr v1:10.20.193.57:6789/0 2026-02-12T17:47:53.297 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient(hunting): picked mon.noname-c con 0x7faeec08c620 addr v1:10.20.193.57:6790/0 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient(hunting): picked mon.noname-b con 0x7faeec182cc0 addr v1:10.20.193.82:6789/0 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 1 -- --> v1:10.20.193.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeec13ec00 con 0x7faeec08c250 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 1 -- --> v1:10.20.193.82:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeec087570 con 0x7faeec182cc0 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 1 -- --> v1:10.20.193.57:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeec13b510 con 0x7faeec08c620 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient(hunting): _renew_subs 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef3954640 10 monclient(hunting): authenticate will time out at 1753.102815s 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef0ec8640 1 --1- >> v1:10.20.193.57:6790/0 conn(0x7faeec08c620 0x7faeec05d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.57:6790/0 says I am v1:10.20.193.57:36878/0 (socket says 10.20.193.57:36878) 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.283+0000 7faef0ec8640 1 -- 10.20.193.57:0/2665852952 learned_addr learned my addr 10.20.193.57:0/2665852952 (peer_addr_for_me v1:10.20.193.57:0/0) 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.285+0000 7faef0ec8640 1 -- 10.20.193.57:0/2665852952 >> v1:10.20.193.57:6790/0 conn(0x7faeec08c620 legacy=0x7faeec05d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.285+0000 7faef16c9640 1 -- 10.20.193.57:0/2665852952 >> v1:10.20.193.57:6789/0 conn(0x7faeec08c250 legacy=0x7faeec05cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195094726 0 0) 0x7faeec13b510 con 0x7faeec08c620 2026-02-12T17:47:53.298 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): my global_id is 114359 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.57:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faebc0035e0 con 0x7faeec08c620 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.0 v1:10.20.193.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307197693 0 0) 0x7faedc003400 con 0x7faeec08c250 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): my global_id is 124257 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeec13b510 con 0x7faeec08c250 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef1eca640 1 -- 10.20.193.57:0/2665852952 >> v1:10.20.193.82:6789/0 conn(0x7faeec182cc0 legacy=0x7faeec195360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4062754621 0 0) 0x7faebc0035e0 con 0x7faeec08c620 2026-02-12T17:47:53.299 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.57:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faedc003400 con 0x7faeec08c620 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faee00034d0 con 0x7faeec08c620 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): dump: 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.300 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.1 v1:10.20.193.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157491260 0 0) 0x7faeec087570 con 0x7faeec182cc0 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _negotiate 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): my global_id is 5455 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.82:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faebc0035e0 con 0x7faeec182cc0 2026-02-12T17:47:53.301 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.0 v1:10.20.193.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2439179394 0 0) 0x7faeec13b510 con 0x7faeec08c250 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.57:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faeec087570 con 0x7faeec08c250 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.0 v1:10.20.193.57:6789/0 3 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faedc004a50 con 0x7faeec08c250 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient(hunting): dump: 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.302 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 386285052 0 0) 0x7faedc003400 con 0x7faeec08c620 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 >> v1:10.20.193.82:6789/0 conn(0x7faeec182cc0 legacy=0x7faeec195360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 >> v1:10.20.193.57:6789/0 conn(0x7faeec08c250 legacy=0x7faeec05cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient: _finish_hunting 0 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 monclient: found mon.c 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.57:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeec0888a0 con 0x7faeec08c620 2026-02-12T17:47:53.303 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient: _finish_auth 0 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient: _check_auth_tickets 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 5 monclient: authenticate success, global_id 114359 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 10 monclient: _renew_subs 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.57:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faeec05db20 con 0x7faeec08c620 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 10 monclient: _renew_subs 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.57:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faeec13b0f0 con 0x7faeec08c620 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faee0004f40 con 0x7faeec08c620 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 6 ==== mon_map magic: 0 ==== 332+0+0 (unknown 2551017130 0 0) 0x7faee0004920 con 0x7faeec08c620 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T17:47:53.304 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faed9ffb640 10 monclient: dump: 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:epoch 1 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:fsid 2c564c25-fc44-46b7-9900-7876a1cecb3c 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:last_changed 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:created 2026-02-12T17:27:47.387807+0000 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:min_mon_release 20 (tentacle) 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:election_strategy: 3 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:0: v1:10.20.193.57:6789/0 mon.a 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:1: v1:10.20.193.82:6789/0 mon.b 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:2: v1:10.20.193.57:6790/0 mon.c 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faedb7fe640 4 set_mon_vals no callback set 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:53.305 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:53.306 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.306 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.286+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.57:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeec090810 con 0x7faeec08c620 2026-02-12T17:47:53.306 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.287+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (unknown 875534291 0 0) 0x7faee0011d70 con 0x7faeec08c620 2026-02-12T17:47:53.306 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.287+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 8 ==== osd_map(887..887 src has 771..887) ==== 3563+0+0 (unknown 3484242122 0 0) 0x7faee004ec00 con 0x7faeec08c620 2026-02-12T17:47:53.306 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.287+0000 7faef16c9640 10 monclient: get_auth_request con 0x7faebc03fd50 auth_method 0 2026-02-12T17:47:53.306 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.289+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (unknown 1092875540 0 2061952362) 0x7faee0017550 con 0x7faeec08c620 2026-02-12T17:47:53.306 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.289+0000 7faed9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T17:47:53.306 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.289+0000 7faed9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T17:47:53.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.393+0000 7faef3954640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-12T17:47:53.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.393+0000 7faef3954640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-12T17:47:53.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.393+0000 7faef3954640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.57:6790/0 2026-02-12T17:47:53.390 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.393+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 --> v1:10.20.193.57:6790/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7faeec13e5f0 con 0x7faeec08c620 2026-02-12T17:47:53.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.396+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7faee0017550 con 0x7faeec08c620 2026-02-12T17:47:53.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.396+0000 7faed9ffb640 10 monclient: handle_config config(1 keys) 2026-02-12T17:47:53.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.396+0000 7faedb7fe640 4 set_mon_vals no callback set 2026-02-12T17:47:53.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.396+0000 7faedb7fe640 10 set_mon_vals mon_health_to_clog = false 2026-02-12T17:47:53.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.396+0000 7faed9ffb640 1 -- 10.20.193.57:0/2665852952 <== mon.2 v1:10.20.193.57:6790/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v3)=0 v3) ==== 123+0+0 (unknown 3022875181 0 0) 0x7faee0016d00 con 0x7faeec08c620 2026-02-12T17:47:53.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.396+0000 7faed9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-12T17:47:53.393 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.396+0000 7faed9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T17:47:53.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.397+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 >> v1:10.20.193.82:6800/2441377515 conn(0x7faebc03fd50 legacy=0x7faebc060200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.394 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.397+0000 7faef3954640 10 monclient: shutdown 2026-02-12T17:47:53.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.397+0000 7faef3954640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T17:47:53.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.397+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 >> v1:10.20.193.57:6790/0 conn(0x7faeec08c620 legacy=0x7faeec05d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T17:47:53.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.397+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 shutdown_connections 2026-02-12T17:47:53.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.397+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 >> 10.20.193.57:0/2665852952 conn(0x7faeec0916b0 msgr2=0x7faeec08a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T17:47:53.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.397+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 shutdown_connections 2026-02-12T17:47:53.395 INFO:teuthology.orchestra.run.trial057.stderr:2026-02-12T17:47:53.397+0000 7faef3954640 1 -- 10.20.193.57:0/2665852952 wait complete. 2026-02-12T17:47:53.402 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T17:47:53.403 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T17:47:53.403 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T17:47:53.403 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.445 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T17:47:53.445 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T17:47:53.445 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.483 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T17:47:53.484 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T17:47:53.484 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.552 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T17:47:53.553 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-12T17:47:53.553 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.581 INFO:tasks.ceph.osd.3:Stopped 2026-02-12T17:47:53.582 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-12T17:47:53.582 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.655 INFO:tasks.ceph.osd.4:Stopped 2026-02-12T17:47:53.656 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-12T17:47:53.656 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.728 INFO:tasks.ceph.osd.5:Stopped 2026-02-12T17:47:53.728 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T17:47:53.729 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T17:47:53.729 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.796 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T17:47:53.796 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T17:47:53.797 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T17:47:53.797 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.807 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T17:47:53.808 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T17:47:53.808 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.858 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T17:47:53.858 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-12T17:47:53.858 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T17:47:53.874 INFO:tasks.ceph.mon.b:Stopped 2026-02-12T17:47:53.874 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T17:47:53.874 DEBUG:teuthology.orchestra.run.trial057:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v ScrubResult | grep -E -v 'scrub mismatch' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MGR_DOWN\)' | grep -E -v '\(PG_AVAILABILITY\)' | grep -E -v '\(SLOW_OPS\)' | grep -E -v 'slow request' | grep -E -v '\(OSD_SLOW_PING_TIME' | grep -E -v '\(MON_NETSPLIT)' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MON_DOWN\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | head -n 1 2026-02-12T17:47:53.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial057.front.sepia.ceph.com 2026-02-12T17:47:53.925 DEBUG:teuthology.orchestra.run.trial057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T17:47:53.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial057.front.sepia.ceph.com 2026-02-12T17:47:53.995 DEBUG:teuthology.orchestra.run.trial057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T17:47:54.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial057.front.sepia.ceph.com 2026-02-12T17:47:54.064 DEBUG:teuthology.orchestra.run.trial057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T17:47:54.138 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial082.front.sepia.ceph.com 2026-02-12T17:47:54.139 DEBUG:teuthology.orchestra.run.trial082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-12T17:47:54.173 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial082.front.sepia.ceph.com 2026-02-12T17:47:54.173 DEBUG:teuthology.orchestra.run.trial082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-12T17:47:54.242 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial082.front.sepia.ceph.com 2026-02-12T17:47:54.243 DEBUG:teuthology.orchestra.run.trial082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-12T17:47:54.314 INFO:tasks.ceph:Archiving mon data... 2026-02-12T17:47:54.316 DEBUG:teuthology.misc:Transferring archived files from trial057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421/data/mon.a.tgz 2026-02-12T17:47:54.316 DEBUG:teuthology.orchestra.run.trial057:> mktemp 2026-02-12T17:47:54.333 INFO:teuthology.orchestra.run.trial057.stdout:/tmp/tmp.Oj1X3Zm3cB 2026-02-12T17:47:54.333 DEBUG:teuthology.orchestra.run.trial057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Oj1X3Zm3cB 2026-02-12T17:47:54.421 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 0666 /tmp/tmp.Oj1X3Zm3cB 2026-02-12T17:47:54.502 DEBUG:teuthology.orchestra.remote:trial057:/tmp/tmp.Oj1X3Zm3cB is 255KB 2026-02-12T17:47:54.595 DEBUG:teuthology.orchestra.run.trial057:> rm -fr /tmp/tmp.Oj1X3Zm3cB 2026-02-12T17:47:54.611 DEBUG:teuthology.misc:Transferring archived files from trial057:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421/data/mon.c.tgz 2026-02-12T17:47:54.612 DEBUG:teuthology.orchestra.run.trial057:> mktemp 2026-02-12T17:47:54.666 INFO:teuthology.orchestra.run.trial057.stdout:/tmp/tmp.2R8pzvUkBT 2026-02-12T17:47:54.667 DEBUG:teuthology.orchestra.run.trial057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.2R8pzvUkBT 2026-02-12T17:47:54.753 DEBUG:teuthology.orchestra.run.trial057:> sudo chmod 0666 /tmp/tmp.2R8pzvUkBT 2026-02-12T17:47:54.833 DEBUG:teuthology.orchestra.remote:trial057:/tmp/tmp.2R8pzvUkBT is 257KB 2026-02-12T17:47:54.898 DEBUG:teuthology.orchestra.run.trial057:> rm -fr /tmp/tmp.2R8pzvUkBT 2026-02-12T17:47:54.915 DEBUG:teuthology.misc:Transferring archived files from trial082:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421/data/mon.b.tgz 2026-02-12T17:47:54.915 DEBUG:teuthology.orchestra.run.trial082:> mktemp 2026-02-12T17:47:54.933 INFO:teuthology.orchestra.run.trial082.stdout:/tmp/tmp.9gAR1Zr72X 2026-02-12T17:47:54.934 DEBUG:teuthology.orchestra.run.trial082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.9gAR1Zr72X 2026-02-12T17:47:55.025 DEBUG:teuthology.orchestra.run.trial082:> sudo chmod 0666 /tmp/tmp.9gAR1Zr72X 2026-02-12T17:47:55.107 DEBUG:teuthology.orchestra.remote:trial082:/tmp/tmp.9gAR1Zr72X is 281KB 2026-02-12T17:47:55.201 DEBUG:teuthology.orchestra.run.trial082:> rm -fr /tmp/tmp.9gAR1Zr72X 2026-02-12T17:47:55.218 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T17:47:55.219 DEBUG:teuthology.orchestra.run.trial057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T17:47:55.221 DEBUG:teuthology.orchestra.run.trial082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T17:47:55.300 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T17:47:55.338 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T17:47:55.339 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T17:47:55.341 DEBUG:teuthology.misc:Transferring archived files from trial057:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421/remote/trial057/crash 2026-02-12T17:47:55.342 DEBUG:teuthology.orchestra.run.trial057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T17:47:55.367 DEBUG:teuthology.misc:Transferring archived files from trial082:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421/remote/trial082/crash 2026-02-12T17:47:55.368 DEBUG:teuthology.orchestra.run.trial082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T17:47:55.401 INFO:tasks.ceph:Compressing logs... 2026-02-12T17:47:55.402 DEBUG:teuthology.orchestra.run.trial057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T17:47:55.412 DEBUG:teuthology.orchestra.run.trial082:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T17:47:55.434 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33447.log 2026-02-12T17:47:55.479 INFO:teuthology.orchestra.run.trial082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23589.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-client.admin.23589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.26312.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-osd.3.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.23589.log.gz 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:gzip/var/log/ceph/ceph-client.0.26312.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23541.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23265.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-client.admin.23541.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-client.admin.23265.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.23541.log.gz 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23265.log.gz 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23483.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23370.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-client.admin.23483.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T17:47:55.480 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-client.admin.23370.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T17:47:55.481 INFO:teuthology.orchestra.run.trial082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.23483.log.gz 2026-02-12T17:47:55.481 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23312.log 2026-02-12T17:47:55.481 INFO:teuthology.orchestra.run.trial082.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23370.log.gz 2026-02-12T17:47:55.481 INFO:teuthology.orchestra.run.trial082.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.23312.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.23312.log.gz 2026-02-12T17:47:55.481 INFO:teuthology.orchestra.run.trial082.stderr: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T17:47:55.490 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34626.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33714.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33447.log.gz 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27746.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26313.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34626.log.gz 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27746.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33714.log.gz 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27091.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27746.log.gz 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26313.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29198.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.26313.log.gz 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-mon.a.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.27091.log.gz 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28683.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36981.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29198.log.gz 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34339.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28683.log.gz 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28953.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36981.log: /var/log/ceph/ceph-client.admin.34339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35591.log 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36981.log.gz 2026-02-12T17:47:55.491 INFO:teuthology.orchestra.run.trial057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34339.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31828.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28953.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30405.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26571.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35591.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27097.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31828.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30405.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26571.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27097.log: gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.29296.log -- replaced with /var/log/ceph/ceph-client.admin.26571.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-osd.0.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.27097.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35020.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31247.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35020.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29296.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32593.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31247.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35020.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32299.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36932.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31247.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32593.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28313.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32299.log.gz 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27894.log 2026-02-12T17:47:55.492 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36932.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35837.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27603.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28313.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36736.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35837.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27894.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33812.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35837.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.27603.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30673.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33812.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36736.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31115.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30673.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33812.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33397.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30673.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35110.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34155.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31115.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36148.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33397.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35110.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35198.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36148.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.34155.log.gz /var/log/ceph/ceph-client.admin.27452.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35198.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36148.log.gz 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32544.log 2026-02-12T17:47:55.493 INFO:teuthology.orchestra.run.trial057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35198.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37128.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32544.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27452.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34971.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32544.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.37128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33910.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37128.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35640.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33910.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34971.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28139.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33910.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35640.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28139.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35640.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34253.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28139.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30111.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28865.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30111.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34253.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37030.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28865.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30111.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29571.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28865.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.37030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32103.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29571.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37030.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29866.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29571.log.gz 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33665.log 2026-02-12T17:47:55.494 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29866.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32103.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30771.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33665.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29866.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30307.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33665.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27098.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30307.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.30771.log.gz -5 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.23638.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27098.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30307.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26620.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.23638.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27098.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31877.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.23638.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34008.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26620.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27688.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34008.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31877.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34204.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28385.log 88.5% 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34008.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27688.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36491.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34204.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28583.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36491.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28385.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28188.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36491.log.gz 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34872.log 2026-02-12T17:47:55.495 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28583.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29345.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28188.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31164.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34872.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23436.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29345.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27992.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31164.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.23436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37275.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23436.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35689.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27992.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.37275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33497.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37275.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34476.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33497.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35689.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32495.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33497.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35788.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32495.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34476.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32002.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35788.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32495.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28783.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.35788.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37079.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.32002.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34921.log 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28783.log.gz 2026-02-12T17:47:55.496 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.37079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30356.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37079.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33861.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr: 89.0%/var/log/ceph/ceph-client.admin.30356.log: -- replaced with /var/log/ceph/ceph-client.admin.34921.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31729.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30356.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28041.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33861.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31016.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31729.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30820.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28041.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28312.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31016.log: /var/log/ceph/ceph-client.admin.30820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32201.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31016.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28312.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30820.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30062.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28312.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33250.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30062.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32201.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28534.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33250.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30062.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32397.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28534.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33250.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35248.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.28534.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34525.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35248.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32397.log.gz 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30258.log 2026-02-12T17:47:55.497 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34525.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35248.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26473.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34525.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35297.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30258.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33005.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.26473.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34724.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 89.0%/var/log/ceph/ceph-client.admin.33005.log: -- replaced with /var/log/ceph/ceph-client.admin.35297.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26797.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33005.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29915.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26797.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34724.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29443.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.26797.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29100.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29915.log.gz/var/log/ceph/ceph-client.admin.29443.log: 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36442.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29100.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29443.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27309.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36442.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29100.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32906.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36442.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31434.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27309.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36687.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32906.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28434.log 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31434.log.gz 2026-02-12T17:47:55.498 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30160.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28434.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36687.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35444.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 89.2%/var/log/ceph/ceph-client.admin.30160.log: -- replaced with /var/log/ceph/ceph-client.admin.28434.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32818.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 88.9%/var/log/ceph/ceph-client.admin.35444.log: -- replaced with /var/log/ceph/ceph-client.admin.30160.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34106.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32818.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35444.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35346.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32818.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27845.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34106.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26522.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 88.5%/var/log/ceph/ceph-client.admin.27845.log: -- replaced with /var/log/ceph/ceph-client.admin.35346.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26800.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27845.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23389.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.26522.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36344.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.26800.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.23389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29149.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.23389.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36050.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36344.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33299.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36050.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29149.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29719.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36050.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27096.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33299.log.gz 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31631.log 2026-02-12T17:47:55.499 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29719.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26804.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27096.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26802.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 89.0%/var/log/ceph/ceph-client.admin.26804.log: -- replaced with /var/log/ceph/ceph-client.admin.31631.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36001.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.26804.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34057.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36001.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.26802.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36540.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34057.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36001.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30209.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34057.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27604.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36540.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37226.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30209.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31385.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.37226.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27604.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29621.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37226.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31385.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 89.0%/var/log/ceph/ceph-client.admin.29621.log: -- replaced with /var/log/ceph/ceph-client.admin.31385.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27943.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 88.0%/var/log/ceph/ceph.audit.log: -- replaced with /var/log/ceph/ceph-client.admin.29621.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34675.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27398.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34675.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27943.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32691.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27398.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34675.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28632.log 2026-02-12T17:47:55.500 INFO:teuthology.orchestra.run.trial057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27398.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27093.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 88.4%/var/log/ceph/ceph-client.admin.28632.log: -- replaced with /var/log/ceph/ceph-client.admin.32691.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28732.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27093.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28632.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29394.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.27093.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28732.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29394.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28732.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32956.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29394.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29817.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27311.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32956.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36246.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27311.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29817.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30722.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27311.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33959.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36246.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37322.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30722.log.gz/var/log/ceph/ceph-client.admin.33959.log: 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.37322.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33959.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32642.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37322.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.37177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30487.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32250.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32642.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36197.log 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30487.log.gz 2026-02-12T17:47:55.501 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29964.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36197.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32250.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33152.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36197.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36638.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29964.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34576.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36638.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33152.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29768.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36638.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33763.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34576.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36393.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33763.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29768.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.18562.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31926.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33763.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph.tmp-client.admin.18562.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36393.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.18562.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30013.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29002.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31926.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35951.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30013.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31680.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35951.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29002.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32152.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35951.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29051.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr: 88.9%/var/log/ceph/ceph-client.admin.32152.log: -- replaced with /var/log/ceph/ceph-client.admin.31680.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28090.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29051.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32152.log.gz 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33577.log 2026-02-12T17:47:55.502 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28090.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29051.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33348.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28090.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30967.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33577.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34822.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.33348.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26408.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30967.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27605.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34822.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30624.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27605.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.26408.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31582.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.27605.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28237.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33201.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30624.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28237.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31582.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27399.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28237.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31483.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36099.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33201.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27399.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26799.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31483.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31065.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36099.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30869.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31065.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.26799.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31533.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30869.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31065.log.gz 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32740.log 2026-02-12T17:47:55.503 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31533.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30869.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26223.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31533.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35542.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32740.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36295.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26223.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36834.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36295.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35542.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36834.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36295.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28483.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36834.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31336.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.28483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35395.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28483.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.31336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34427.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31336.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30918.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.35395.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27310.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30918.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34427.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33054.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30918.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27095.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27310.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27689.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33054.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26383.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27095.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.27689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36589.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36785.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.27689.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.26383.log.gz 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32348.log 2026-02-12T17:47:55.504 INFO:teuthology.orchestra.run.trial057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36589.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35493.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36785.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26803.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32348.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29247.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.26803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36883.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35493.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.26803.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29670.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29247.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.36883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32446.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36883.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.29670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35739.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29670.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.32446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33103.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 91.1% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32446.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.35739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34773.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.33103.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.35739.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30575.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33103.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.34773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31779.log 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34773.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr:/var/log/ceph/ceph-client.admin.30575.log: 88.9%/var/log/ceph/ceph-client.admin.31779.log: -- replaced with /var/log/ceph/ceph-client.admin.30575.log.gz 2026-02-12T17:47:55.505 INFO:teuthology.orchestra.run.trial057.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31779.log.gz 2026-02-12T17:47:55.519 INFO:teuthology.orchestra.run.trial082.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.26312.log.gz 2026-02-12T17:47:55.574 INFO:teuthology.orchestra.run.trial082.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T17:47:55.928 INFO:teuthology.orchestra.run.trial057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-12T17:47:56.306 INFO:teuthology.orchestra.run.trial057.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T17:47:56.738 INFO:teuthology.orchestra.run.trial082.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-12T17:47:56.977 INFO:teuthology.orchestra.run.trial082.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-12T17:47:57.886 INFO:teuthology.orchestra.run.trial057.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T17:47:57.905 INFO:teuthology.orchestra.run.trial082.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-12T17:47:57.957 INFO:teuthology.orchestra.run.trial057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T17:47:58.305 INFO:teuthology.orchestra.run.trial057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T17:47:58.307 INFO:teuthology.orchestra.run.trial057.stderr: 2026-02-12T17:47:58.307 INFO:teuthology.orchestra.run.trial057.stderr:real 0m2.881s 2026-02-12T17:47:58.308 INFO:teuthology.orchestra.run.trial057.stderr:user 0m8.808s 2026-02-12T17:47:58.308 INFO:teuthology.orchestra.run.trial057.stderr:sys 0m0.516s 2026-02-12T17:47:58.407 INFO:teuthology.orchestra.run.trial082.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-12T17:47:58.409 INFO:teuthology.orchestra.run.trial082.stderr: 2026-02-12T17:47:58.409 INFO:teuthology.orchestra.run.trial082.stderr:real 0m2.945s 2026-02-12T17:47:58.409 INFO:teuthology.orchestra.run.trial082.stderr:user 0m7.929s 2026-02-12T17:47:58.409 INFO:teuthology.orchestra.run.trial082.stderr:sys 0m0.363s 2026-02-12T17:47:58.409 INFO:tasks.ceph:Archiving logs... 2026-02-12T17:47:58.410 DEBUG:teuthology.misc:Transferring archived files from trial057:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421/remote/trial057/log 2026-02-12T17:47:58.411 DEBUG:teuthology.orchestra.run.trial057:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T17:47:59.359 DEBUG:teuthology.misc:Transferring archived files from trial082:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421/remote/trial082/log 2026-02-12T17:47:59.359 DEBUG:teuthology.orchestra.run.trial082:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T17:48:00.093 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T17:48:00.103 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T17:48:00.103 DEBUG:teuthology.orchestra.run.trial057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T17:48:00.105 DEBUG:teuthology.orchestra.run.trial082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T17:48:00.256 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T17:48:00.268 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T17:48:00.268 DEBUG:teuthology.orchestra.run.trial057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T17:48:00.270 DEBUG:teuthology.orchestra.run.trial082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T17:48:00.284 INFO:teuthology.orchestra.run.trial057.stderr:bash: line 1: ntpq: command not found 2026-02-12T17:48:00.286 INFO:teuthology.orchestra.run.trial082.stderr:bash: line 1: ntpq: command not found 2026-02-12T17:48:00.318 INFO:teuthology.orchestra.run.trial082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T17:48:00.318 INFO:teuthology.orchestra.run.trial082.stdout:=============================================================================== 2026-02-12T17:48:00.318 INFO:teuthology.orchestra.run.trial082.stdout:^- ntp1.lax.us.hojmark.net 2 7 377 104 -1325us[-1283us] +/- 56ms 2026-02-12T17:48:00.318 INFO:teuthology.orchestra.run.trial082.stdout:^* ntp.nyc.icanbwell.com 2 6 377 39 -18us[ -29us] +/- 2807us 2026-02-12T17:48:00.318 INFO:teuthology.orchestra.run.trial082.stdout:^- rn-03.koehn.com 2 7 377 37 -97us[ -97us] +/- 37ms 2026-02-12T17:48:00.318 INFO:teuthology.orchestra.run.trial082.stdout:^- 149.248.12.167.vultruser> 2 6 377 34 +215us[ +215us] +/- 35ms 2026-02-12T17:48:00.318 INFO:teuthology.orchestra.run.trial057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T17:48:00.318 INFO:teuthology.orchestra.run.trial057.stdout:=============================================================================== 2026-02-12T17:48:00.319 INFO:teuthology.orchestra.run.trial057.stdout:^+ 172-233-177-198.ip.linod> 2 6 377 36 -2177us[-2177us] +/- 94ms 2026-02-12T17:48:00.319 INFO:teuthology.orchestra.run.trial057.stdout:^+ 23.186.168.129 2 7 253 426 -2827us[-2480us] +/- 59ms 2026-02-12T17:48:00.319 INFO:teuthology.orchestra.run.trial057.stdout:^* 149.28.200.179.vultruser> 2 7 377 105 +4833us[+4773us] +/- 41ms 2026-02-12T17:48:00.319 INFO:teuthology.orchestra.run.trial057.stdout:^+ ntp.maxhost.io 2 7 137 99 -3147us[-3147us] +/- 66ms 2026-02-12T17:48:00.319 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T17:48:00.330 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T17:48:00.330 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T17:48:00.345 DEBUG:teuthology.orchestra.run.trial057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T17:48:00.405 DEBUG:teuthology.orchestra.run.trial082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T17:48:00.449 DEBUG:teuthology.orchestra.run.trial057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T17:48:00.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:48:00.477 DEBUG:teuthology.orchestra.run.trial082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T17:48:00.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:48:00.515 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T17:48:00.530 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T17:48:00.543 INFO:teuthology.task.internal:Duration was 1421.624440 seconds 2026-02-12T17:48:00.544 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T17:48:00.556 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T17:48:00.556 DEBUG:teuthology.orchestra.run.trial057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T17:48:00.558 DEBUG:teuthology.orchestra.run.trial082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T17:48:00.594 INFO:teuthology.orchestra.run.trial057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T17:48:00.595 INFO:teuthology.orchestra.run.trial082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T17:48:00.893 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T17:48:00.893 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial057.front.sepia.ceph.com 2026-02-12T17:48:00.893 DEBUG:teuthology.orchestra.run.trial057:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T17:48:00.952 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial082.front.sepia.ceph.com 2026-02-12T17:48:00.952 DEBUG:teuthology.orchestra.run.trial082:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T17:48:00.971 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T17:48:00.971 DEBUG:teuthology.orchestra.run.trial057:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T17:48:00.993 DEBUG:teuthology.orchestra.run.trial082:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T17:48:01.052 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T17:48:01.052 DEBUG:teuthology.orchestra.run.trial057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T17:48:01.054 DEBUG:teuthology.orchestra.run.trial082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T17:48:01.075 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T17:48:01.075 INFO:teuthology.orchestra.run.trial057.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T17:48:01.075 INFO:teuthology.orchestra.run.trial057.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T17:48:01.075 INFO:teuthology.orchestra.run.trial057.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T17:48:01.076 INFO:teuthology.orchestra.run.trial057.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T17:48:01.080 INFO:teuthology.orchestra.run.trial057.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T17:48:01.115 INFO:teuthology.orchestra.run.trial082.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T17:48:01.116 INFO:teuthology.orchestra.run.trial082.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T17:48:01.116 INFO:teuthology.orchestra.run.trial082.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T17:48:01.116 INFO:teuthology.orchestra.run.trial082.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T17:48:01.116 INFO:teuthology.orchestra.run.trial082.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T17:48:01.120 INFO:teuthology.orchestra.run.trial082.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T17:48:01.121 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T17:48:01.135 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T17:48:01.135 DEBUG:teuthology.orchestra.run.trial057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T17:48:01.159 DEBUG:teuthology.orchestra.run.trial082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T17:48:01.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T17:48:01.199 DEBUG:teuthology.orchestra.run.trial057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T17:48:01.201 DEBUG:teuthology.orchestra.run.trial082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T17:48:01.222 INFO:teuthology.orchestra.run.trial057.stdout:kernel.core_pattern = core 2026-02-12T17:48:01.250 INFO:teuthology.orchestra.run.trial082.stdout:kernel.core_pattern = core 2026-02-12T17:48:01.280 DEBUG:teuthology.orchestra.run.trial057:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T17:48:01.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:48:01.294 DEBUG:teuthology.orchestra.run.trial082:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T17:48:01.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:48:01.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T17:48:01.346 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T17:48:01.347 DEBUG:teuthology.misc:Transferring archived files from trial057:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421/remote/trial057 2026-02-12T17:48:01.347 DEBUG:teuthology.orchestra.run.trial057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T17:48:01.376 DEBUG:teuthology.misc:Transferring archived files from trial082:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46421/remote/trial082 2026-02-12T17:48:01.376 DEBUG:teuthology.orchestra.run.trial082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T17:48:01.406 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T17:48:01.406 DEBUG:teuthology.orchestra.run.trial057:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T17:48:01.419 DEBUG:teuthology.orchestra.run.trial082:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T17:48:01.463 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T17:48:01.476 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T17:48:01.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T17:48:01.490 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T17:48:01.490 DEBUG:teuthology.orchestra.run.trial057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T17:48:01.492 DEBUG:teuthology.orchestra.run.trial082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T17:48:01.508 INFO:teuthology.orchestra.run.trial057.stdout: 791883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 17:48 /home/ubuntu/cephtest 2026-02-12T17:48:01.520 INFO:teuthology.orchestra.run.trial082.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 17:48 /home/ubuntu/cephtest 2026-02-12T17:48:01.521 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T17:48:01.533 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T17:48:01.564 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/{bluestore/{alloc$/{hybrid} base mem$/{normal-2} onode-segment$/{512K-onoff} write$/{v1/{compr$/{no$/{no}} v1}}}} rados supported-random-distro$/{centos_latest} thrashers/sync workloads/snaps-few-objects} duration: 1421.6244401931763 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-12T17:48:01.564 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:48:01.701 INFO:teuthology.run:pass